2024-09-21T05:28:39.144 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T05:28:39.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T05:28:39.272 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913497 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/fs/norstats}} email: pdonnell@redhat.com first_in_suite: false job_id: '7913497' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: client dirsize rbytes: false mds: mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 1843221895adccfb3b692060251dd6a0183bc410 subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: client.0: mount_subvol_num: 1 rbytes: false selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi070.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNpgIpX1lCf0/JRB9+ZGlmA1vbJJfPdTYA/dZDm0bm1tVnlwctrTQMFXpumQ1CpK21mGKhJCjkq6POFNVf0EHBY= smithi116.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB7AEwS2uSeW2lylO/fz7ROtM6MSOqMN/cjBK382CdMimts2YteuoxlWIRHqGXcRvBKOZpHxUIJoPu3EMdGcYEc= smithi160.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLomyTie5FhOy1HfIxM51T/AQt2Emqjj8AXZ+25zBsZgIIYg4GDjHm7EMo37XCXIVuukIDvfmZ6/cgDvY3lp8Lg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - quiescer: null - workunit: clients: all: - fs/norstats teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T05:28:39.272 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T05:28:39.272 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T05:28:39.273 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T05:28:39.274 INFO:teuthology.task.internal:Checking packages... 2024-09-21T05:28:39.294 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T05:28:39.294 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T05:28:39.294 INFO:teuthology.packaging:ref: None 2024-09-21T05:28:39.294 INFO:teuthology.packaging:tag: None 2024-09-21T05:28:39.295 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T05:28:39.295 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:28:39.295 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T05:28:39.440 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T05:28:39.441 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T05:28:39.450 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T05:28:39.450 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T05:28:39.545 INFO:teuthology.task.internal:Saving configuration 2024-09-21T05:28:39.565 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T05:28:39.576 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T05:28:39.603 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913497', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 05:23:35.398449', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNpgIpX1lCf0/JRB9+ZGlmA1vbJJfPdTYA/dZDm0bm1tVnlwctrTQMFXpumQ1CpK21mGKhJCjkq6POFNVf0EHBY='} 2024-09-21T05:28:39.627 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913497', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 05:23:35.400173', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB7AEwS2uSeW2lylO/fz7ROtM6MSOqMN/cjBK382CdMimts2YteuoxlWIRHqGXcRvBKOZpHxUIJoPu3EMdGcYEc='} 2024-09-21T05:28:39.648 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913497', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 05:23:35.396459', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLomyTie5FhOy1HfIxM51T/AQt2Emqjj8AXZ+25zBsZgIIYg4GDjHm7EMo37XCXIVuukIDvfmZ6/cgDvY3lp8Lg='} 2024-09-21T05:28:39.648 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T05:28:39.659 INFO:teuthology.task.internal:roles: ubuntu@smithi070.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-21T05:28:39.659 INFO:teuthology.task.internal:roles: ubuntu@smithi116.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-21T05:28:39.659 INFO:teuthology.task.internal:roles: ubuntu@smithi160.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-21T05:28:39.660 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T05:28:39.752 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fad48c48160>, signals=[15]) 2024-09-21T05:28:39.752 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T05:28:39.763 INFO:teuthology.task.internal:Opening connections... 2024-09-21T05:28:39.763 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi070.front.sepia.ceph.com 2024-09-21T05:28:39.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:28:39.840 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi116.front.sepia.ceph.com 2024-09-21T05:28:39.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:28:39.916 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi160.front.sepia.ceph.com 2024-09-21T05:28:39.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:28:39.993 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T05:28:40.014 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2024-09-21T05:28:40.033 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2024-09-21T05:28:40.033 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2024-09-21T05:28:40.090 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream" 2024-09-21T05:28:40.090 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="9" 2024-09-21T05:28:40.090 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos" 2024-09-21T05:28:40.090 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora" 2024-09-21T05:28:40.091 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="9" 2024-09-21T05:28:40.091 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el9" 2024-09-21T05:28:40.091 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T05:28:40.091 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2024-09-21T05:28:40.091 INFO:teuthology.orchestra.run.smithi070.stdout:LOGO="fedora-logo-icon" 2024-09-21T05:28:40.091 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T05:28:40.091 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/" 2024-09-21T05:28:40.091 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T05:28:40.091 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T05:28:40.091 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T05:28:40.092 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2024-09-21T05:28:40.123 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2024-09-21T05:28:40.142 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2024-09-21T05:28:40.142 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2024-09-21T05:28:40.200 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2024-09-21T05:28:40.200 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="9" 2024-09-21T05:28:40.200 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2024-09-21T05:28:40.201 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2024-09-21T05:28:40.201 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="9" 2024-09-21T05:28:40.201 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el9" 2024-09-21T05:28:40.201 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T05:28:40.201 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2024-09-21T05:28:40.201 INFO:teuthology.orchestra.run.smithi116.stdout:LOGO="fedora-logo-icon" 2024-09-21T05:28:40.201 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T05:28:40.201 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2024-09-21T05:28:40.201 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T05:28:40.201 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T05:28:40.201 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T05:28:40.202 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2024-09-21T05:28:40.231 DEBUG:teuthology.orchestra.run.smithi160:> uname -m 2024-09-21T05:28:40.249 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64 2024-09-21T05:28:40.249 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2024-09-21T05:28:40.308 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="CentOS Stream" 2024-09-21T05:28:40.308 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="9" 2024-09-21T05:28:40.308 INFO:teuthology.orchestra.run.smithi160.stdout:ID="centos" 2024-09-21T05:28:40.308 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="rhel fedora" 2024-09-21T05:28:40.308 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="9" 2024-09-21T05:28:40.308 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el9" 2024-09-21T05:28:40.308 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T05:28:40.308 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31" 2024-09-21T05:28:40.308 INFO:teuthology.orchestra.run.smithi160.stdout:LOGO="fedora-logo-icon" 2024-09-21T05:28:40.308 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T05:28:40.308 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://centos.org/" 2024-09-21T05:28:40.308 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T05:28:40.308 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T05:28:40.308 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T05:28:40.309 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2024-09-21T05:28:40.330 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T05:28:40.341 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T05:28:40.376 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T05:28:40.376 DEBUG:teuthology.orchestra.run.smithi070:> test '!' -e /home/ubuntu/cephtest 2024-09-21T05:28:40.379 DEBUG:teuthology.orchestra.run.smithi116:> test '!' -e /home/ubuntu/cephtest 2024-09-21T05:28:40.381 DEBUG:teuthology.orchestra.run.smithi160:> test '!' -e /home/ubuntu/cephtest 2024-09-21T05:28:40.398 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T05:28:40.433 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T05:28:40.433 DEBUG:teuthology.orchestra.run.smithi070:> test -z $(ls -A /var/lib/ceph) 2024-09-21T05:28:40.436 DEBUG:teuthology.orchestra.run.smithi116:> test -z $(ls -A /var/lib/ceph) 2024-09-21T05:28:40.439 DEBUG:teuthology.orchestra.run.smithi160:> test -z $(ls -A /var/lib/ceph) 2024-09-21T05:28:40.529 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T05:28:40.609 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T05:28:40.624 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-21T05:28:40.625 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-21T05:28:40.625 DEBUG:teuthology.orchestra.run.smithi070:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T05:28:40.625 DEBUG:teuthology.orchestra.run.smithi116:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T05:28:40.626 DEBUG:teuthology.orchestra.run.smithi160:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T05:28:40.643 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:28:40.643 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2024-09-21T05:28:40.644 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:28:40.644 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:28:40.644 DEBUG:teuthology.orchestra.run.smithi160:> uname -r 2024-09-21T05:28:40.645 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2024-09-21T05:28:40.701 INFO:teuthology.orchestra.run.smithi116.stdout:5.14.0-503.el9.x86_64 2024-09-21T05:28:40.702 INFO:teuthology.task.kernel:Running kernel on smithi116: 5.14.0-503.el9.x86_64 2024-09-21T05:28:40.702 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum install -y kernel 2024-09-21T05:28:40.703 INFO:teuthology.orchestra.run.smithi070.stdout:5.14.0-503.el9.x86_64 2024-09-21T05:28:40.704 INFO:teuthology.orchestra.run.smithi160.stdout:5.14.0-503.el9.x86_64 2024-09-21T05:28:40.704 INFO:teuthology.task.kernel:Running kernel on smithi070: 5.14.0-503.el9.x86_64 2024-09-21T05:28:40.704 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum install -y kernel 2024-09-21T05:28:40.704 INFO:teuthology.task.kernel:Running kernel on smithi160: 5.14.0-503.el9.x86_64 2024-09-21T05:28:40.704 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum install -y kernel 2024-09-21T05:28:42.926 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.3 MB 00:00 2024-09-21T05:28:42.963 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.3 MB 00:00 2024-09-21T05:28:44.713 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - BaseOS 3.6 MB/s | 8.3 MB 00:02 2024-09-21T05:28:44.898 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-21T05:28:45.302 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - AppStream 16 MB/s | 20 MB 00:01 2024-09-21T05:28:46.414 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - AppStream 35 MB/s | 20 MB 00:00 2024-09-21T05:28:49.057 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-21T05:28:49.752 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - CRB 9.6 MB/s | 6.5 MB 00:00 2024-09-21T05:28:50.508 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 19 kB 00:00 2024-09-21T05:28:51.211 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - Extras packages 81 kB/s | 19 kB 00:00 2024-09-21T05:28:51.278 INFO:teuthology.orchestra.run.smithi160.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-21T05:28:51.756 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 6.5 MB 00:01 2024-09-21T05:28:52.299 INFO:teuthology.orchestra.run.smithi070.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-21T05:28:53.473 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-21T05:28:54.353 INFO:teuthology.orchestra.run.smithi116.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-21T05:28:56.667 INFO:teuthology.orchestra.run.smithi160.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-21T05:28:57.687 INFO:teuthology.orchestra.run.smithi070.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-21T05:28:58.624 INFO:teuthology.orchestra.run.smithi160.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T05:28:58.624 INFO:teuthology.orchestra.run.smithi160.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T05:28:58.715 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-21T05:28:58.719 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-21T05:28:58.720 INFO:teuthology.orchestra.run.smithi160.stdout: Package Architecture Version Repository Size 2024-09-21T05:28:58.720 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-21T05:28:58.720 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-09-21T05:28:58.720 INFO:teuthology.orchestra.run.smithi160.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T05:28:58.720 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-09-21T05:28:58.720 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T05:28:58.720 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T05:28:58.720 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T05:28:58.720 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-21T05:28:58.720 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-09-21T05:28:58.721 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-21T05:28:58.721 INFO:teuthology.orchestra.run.smithi160.stdout:Install 4 Packages 2024-09-21T05:28:58.721 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-21T05:28:58.721 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 79 M 2024-09-21T05:28:58.721 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 126 M 2024-09-21T05:28:58.721 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-09-21T05:28:58.927 INFO:teuthology.orchestra.run.smithi160.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 341 kB/s | 36 kB 00:00 2024-09-21T05:28:59.186 INFO:teuthology.orchestra.run.smithi160.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 43 MB/s | 16 MB 00:00 2024-09-21T05:28:59.561 INFO:teuthology.orchestra.run.smithi160.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 47 MB/s | 35 MB 00:00 2024-09-21T05:28:59.619 INFO:teuthology.orchestra.run.smithi070.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T05:28:59.619 INFO:teuthology.orchestra.run.smithi070.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T05:28:59.700 INFO:teuthology.orchestra.run.smithi116.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-09-21T05:28:59.716 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-21T05:28:59.732 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-21T05:28:59.732 INFO:teuthology.orchestra.run.smithi070.stdout: Package Architecture Version Repository Size 2024-09-21T05:28:59.732 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-21T05:28:59.732 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-21T05:28:59.732 INFO:teuthology.orchestra.run.smithi070.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T05:28:59.732 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-09-21T05:28:59.732 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T05:28:59.732 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T05:28:59.732 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T05:28:59.732 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:28:59.732 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-21T05:28:59.732 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-21T05:28:59.733 INFO:teuthology.orchestra.run.smithi070.stdout:Install 4 Packages 2024-09-21T05:28:59.733 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:28:59.733 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 79 M 2024-09-21T05:28:59.733 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 126 M 2024-09-21T05:28:59.733 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-21T05:28:59.928 INFO:teuthology.orchestra.run.smithi160.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 29 MB/s | 29 MB 00:01 2024-09-21T05:28:59.928 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-09-21T05:28:59.928 INFO:teuthology.orchestra.run.smithi160.stdout:Total 65 MB/s | 79 MB 00:01 2024-09-21T05:29:00.372 INFO:teuthology.orchestra.run.smithi070.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 58 kB/s | 36 kB 00:00 2024-09-21T05:29:00.617 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-09-21T05:29:00.974 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-09-21T05:29:00.975 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-09-21T05:29:01.131 INFO:teuthology.orchestra.run.smithi070.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-21T05:29:01.573 INFO:teuthology.orchestra.run.smithi116.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T05:29:01.574 INFO:teuthology.orchestra.run.smithi116.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T05:29:01.675 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-21T05:29:01.683 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-21T05:29:01.683 INFO:teuthology.orchestra.run.smithi116.stdout: Package Architecture Version Repository Size 2024-09-21T05:29:01.683 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-21T05:29:01.683 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-21T05:29:01.684 INFO:teuthology.orchestra.run.smithi116.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T05:29:01.684 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-21T05:29:01.684 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T05:29:01.684 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T05:29:01.684 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T05:29:01.684 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-21T05:29:01.684 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-21T05:29:01.684 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-21T05:29:01.684 INFO:teuthology.orchestra.run.smithi116.stdout:Install 4 Packages 2024-09-21T05:29:01.684 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-21T05:29:01.685 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 79 M 2024-09-21T05:29:01.685 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 126 M 2024-09-21T05:29:01.685 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-21T05:29:01.831 INFO:teuthology.orchestra.run.smithi070.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 17 MB/s | 35 MB 00:02 2024-09-21T05:29:01.956 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-09-21T05:29:01.957 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-09-21T05:29:02.510 INFO:teuthology.orchestra.run.smithi116.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 64 kB/s | 36 kB 00:00 2024-09-21T05:29:02.589 INFO:teuthology.orchestra.run.smithi070.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 13 MB/s | 29 MB 00:02 2024-09-21T05:29:02.589 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-21T05:29:02.590 INFO:teuthology.orchestra.run.smithi070.stdout:Total 28 MB/s | 79 MB 00:02 2024-09-21T05:29:03.273 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-21T05:29:03.344 INFO:teuthology.orchestra.run.smithi116.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-21T05:29:03.633 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-21T05:29:03.634 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-21T05:29:04.010 INFO:teuthology.orchestra.run.smithi116.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 17 MB/s | 35 MB 00:02 2024-09-21T05:29:04.401 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-09-21T05:29:04.607 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-21T05:29:04.608 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-21T05:29:04.669 INFO:teuthology.orchestra.run.smithi116.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 13 MB/s | 29 MB 00:02 2024-09-21T05:29:04.669 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-21T05:29:04.669 INFO:teuthology.orchestra.run.smithi116.stdout:Total 26 MB/s | 79 MB 00:02 2024-09-21T05:29:05.089 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T05:29:05.170 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T05:29:05.352 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-21T05:29:05.694 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-21T05:29:05.694 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-21T05:29:06.649 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-21T05:29:06.649 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-21T05:29:07.053 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-21T05:29:07.767 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T05:29:07.847 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T05:29:07.936 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T05:29:08.072 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T05:29:09.070 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-21T05:29:09.756 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T05:29:09.844 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T05:29:10.610 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T05:29:10.751 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T05:29:12.606 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T05:29:12.747 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T05:29:12.906 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T05:29:13.014 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:29:15.555 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T05:29:15.675 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:29:17.576 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T05:29:17.614 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:29:17.857 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:29:20.547 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:29:22.437 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:29:56.092 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:29:56.132 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:29:56.508 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:29:56.508 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T05:29:56.508 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T05:29:56.509 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T05:29:57.326 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:29:57.326 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-21T05:29:57.326 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-09-21T05:29:57.326 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T05:29:57.326 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T05:29:57.326 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T05:29:57.326 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T05:29:57.327 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-21T05:29:57.327 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-21T05:29:57.714 DEBUG:teuthology.orchestra.run.smithi160:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T05:29:57.803 INFO:teuthology.orchestra.run.smithi160.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T05:29:57.803 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T05:29:57.803 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T05:29:57.803 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T05:29:57.803 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T05:29:57.803 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-09-21T05:29:57.803 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi160.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T05:29:57.804 DEBUG:teuthology.orchestra.run.smithi160:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T05:29:57.862 INFO:teuthology.orchestra.run.smithi160.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T05:29:57.863 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T05:29:57.863 DEBUG:teuthology.orchestra.run.smithi160:> sudo rpm -qi grub2-tools 2024-09-21T05:29:57.895 INFO:teuthology.orchestra.run.smithi160.stdout:Name : grub2-tools 2024-09-21T05:29:57.895 INFO:teuthology.orchestra.run.smithi160.stdout:Epoch : 1 2024-09-21T05:29:57.895 INFO:teuthology.orchestra.run.smithi160.stdout:Version : 2.06 2024-09-21T05:29:57.895 INFO:teuthology.orchestra.run.smithi160.stdout:Release : 82.el9 2024-09-21T05:29:57.895 INFO:teuthology.orchestra.run.smithi160.stdout:Architecture: x86_64 2024-09-21T05:29:57.895 INFO:teuthology.orchestra.run.smithi160.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T05:29:57.895 INFO:teuthology.orchestra.run.smithi160.stdout:Group : Unspecified 2024-09-21T05:29:57.895 INFO:teuthology.orchestra.run.smithi160.stdout:Size : 8274670 2024-09-21T05:29:57.895 INFO:teuthology.orchestra.run.smithi160.stdout:License : GPLv3+ 2024-09-21T05:29:57.896 INFO:teuthology.orchestra.run.smithi160.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T05:29:57.896 INFO:teuthology.orchestra.run.smithi160.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T05:29:57.896 INFO:teuthology.orchestra.run.smithi160.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T05:29:57.896 INFO:teuthology.orchestra.run.smithi160.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T05:29:57.896 INFO:teuthology.orchestra.run.smithi160.stdout:Packager : builder@centos.org 2024-09-21T05:29:57.896 INFO:teuthology.orchestra.run.smithi160.stdout:Vendor : CentOS 2024-09-21T05:29:57.896 INFO:teuthology.orchestra.run.smithi160.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T05:29:57.896 INFO:teuthology.orchestra.run.smithi160.stdout:Summary : Support tools for GRUB. 2024-09-21T05:29:57.896 INFO:teuthology.orchestra.run.smithi160.stdout:Description : 2024-09-21T05:29:57.896 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-21T05:29:57.896 INFO:teuthology.orchestra.run.smithi160.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T05:29:57.896 INFO:teuthology.orchestra.run.smithi160.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T05:29:57.896 INFO:teuthology.orchestra.run.smithi160.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T05:29:57.896 INFO:teuthology.orchestra.run.smithi160.stdout:hardware devices. 2024-09-21T05:29:57.896 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-21T05:29:57.896 INFO:teuthology.orchestra.run.smithi160.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T05:29:57.897 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T05:29:57.897 INFO:teuthology.task.kernel:Updating grub on smithi160 to boot 5.14.0-508.el9.x86_64 2024-09-21T05:29:57.897 DEBUG:teuthology.orchestra.run.smithi160:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T05:29:58.445 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:29:58.486 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:29:58.626 INFO:teuthology.orchestra.run.smithi160.stderr:Generating grub configuration file ... 2024-09-21T05:29:58.799 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:29:58.800 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T05:29:58.800 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T05:29:58.800 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T05:29:59.616 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:29:59.616 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:29:59.616 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-21T05:29:59.616 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T05:29:59.616 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T05:29:59.616 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T05:29:59.616 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T05:29:59.616 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:29:59.616 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-21T05:29:59.956 INFO:teuthology.orchestra.run.smithi160.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T05:29:59.976 INFO:teuthology.orchestra.run.smithi160.stderr:done 2024-09-21T05:29:59.978 DEBUG:teuthology.orchestra.run.smithi160:> mktemp 2024-09-21T05:29:59.987 DEBUG:teuthology.orchestra.run.smithi070:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T05:29:59.994 INFO:teuthology.orchestra.run.smithi160.stdout:/tmp/tmp.23hUMbKQ9A 2024-09-21T05:29:59.994 DEBUG:teuthology.orchestra.run.smithi160:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.23hUMbKQ9A 2024-09-21T05:30:00.062 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 0666 /tmp/tmp.23hUMbKQ9A 2024-09-21T05:30:00.080 INFO:teuthology.orchestra.run.smithi070.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T05:30:00.080 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T05:30:00.081 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T05:30:00.081 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T05:30:00.081 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T05:30:00.081 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-21T05:30:00.081 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi070.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T05:30:00.081 DEBUG:teuthology.orchestra.run.smithi070:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T05:30:00.138 INFO:teuthology.orchestra.run.smithi070.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T05:30:00.139 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T05:30:00.139 DEBUG:teuthology.orchestra.run.smithi070:> sudo rpm -qi grub2-tools 2024-09-21T05:30:00.173 INFO:teuthology.orchestra.run.smithi070.stdout:Name : grub2-tools 2024-09-21T05:30:00.173 INFO:teuthology.orchestra.run.smithi070.stdout:Epoch : 1 2024-09-21T05:30:00.173 INFO:teuthology.orchestra.run.smithi070.stdout:Version : 2.06 2024-09-21T05:30:00.173 INFO:teuthology.orchestra.run.smithi070.stdout:Release : 82.el9 2024-09-21T05:30:00.173 INFO:teuthology.orchestra.run.smithi070.stdout:Architecture: x86_64 2024-09-21T05:30:00.173 INFO:teuthology.orchestra.run.smithi070.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T05:30:00.173 INFO:teuthology.orchestra.run.smithi070.stdout:Group : Unspecified 2024-09-21T05:30:00.173 INFO:teuthology.orchestra.run.smithi070.stdout:Size : 8274670 2024-09-21T05:30:00.173 INFO:teuthology.orchestra.run.smithi070.stdout:License : GPLv3+ 2024-09-21T05:30:00.173 INFO:teuthology.orchestra.run.smithi070.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T05:30:00.174 INFO:teuthology.orchestra.run.smithi070.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T05:30:00.174 INFO:teuthology.orchestra.run.smithi070.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T05:30:00.174 INFO:teuthology.orchestra.run.smithi070.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T05:30:00.174 INFO:teuthology.orchestra.run.smithi070.stdout:Packager : builder@centos.org 2024-09-21T05:30:00.174 INFO:teuthology.orchestra.run.smithi070.stdout:Vendor : CentOS 2024-09-21T05:30:00.174 INFO:teuthology.orchestra.run.smithi070.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T05:30:00.174 INFO:teuthology.orchestra.run.smithi070.stdout:Summary : Support tools for GRUB. 2024-09-21T05:30:00.174 INFO:teuthology.orchestra.run.smithi070.stdout:Description : 2024-09-21T05:30:00.174 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:30:00.174 INFO:teuthology.orchestra.run.smithi070.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T05:30:00.174 INFO:teuthology.orchestra.run.smithi070.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T05:30:00.174 INFO:teuthology.orchestra.run.smithi070.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T05:30:00.174 INFO:teuthology.orchestra.run.smithi070.stdout:hardware devices. 2024-09-21T05:30:00.174 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:30:00.174 INFO:teuthology.orchestra.run.smithi070.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T05:30:00.175 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T05:30:00.175 INFO:teuthology.task.kernel:Updating grub on smithi070 to boot 5.14.0-508.el9.x86_64 2024-09-21T05:30:00.175 DEBUG:teuthology.orchestra.run.smithi070:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T05:30:00.204 DEBUG:teuthology.orchestra.remote:smithi160:/tmp/tmp.23hUMbKQ9A is 6KB 2024-09-21T05:30:00.252 DEBUG:teuthology.orchestra.run.smithi160:> rm -fr /tmp/tmp.23hUMbKQ9A 2024-09-21T05:30:00.267 DEBUG:teuthology.orchestra.run.smithi160:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T05:30:00.342 INFO:teuthology.orchestra.run.smithi160.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T05:30:00.342 INFO:teuthology.orchestra.run.smithi160.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T05:30:00.342 INFO:teuthology.orchestra.run.smithi160.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T05:30:00.342 INFO:teuthology.orchestra.run.smithi160.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T05:30:00.344 DEBUG:teuthology.orchestra.run.smithi160:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T05:30:00.488 DEBUG:teuthology.orchestra.run.smithi160:> sudo shutdown -r now 2024-09-21T05:30:00.580 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:30:00.626 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:30:00.841 INFO:teuthology.orchestra.run.smithi070.stderr:Generating grub configuration file ... 2024-09-21T05:30:00.949 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:30:00.950 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T05:30:00.950 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T05:30:00.950 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T05:30:01.778 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:30:01.778 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-21T05:30:01.778 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-21T05:30:01.779 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T05:30:01.779 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T05:30:01.779 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T05:30:01.779 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T05:30:01.779 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-21T05:30:01.779 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-21T05:30:02.143 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T05:30:02.179 INFO:teuthology.orchestra.run.smithi070.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T05:30:02.205 INFO:teuthology.orchestra.run.smithi070.stderr:done 2024-09-21T05:30:02.208 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-09-21T05:30:02.223 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.SR44nZVOQz 2024-09-21T05:30:02.224 DEBUG:teuthology.orchestra.run.smithi070:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.SR44nZVOQz 2024-09-21T05:30:02.226 INFO:teuthology.orchestra.run.smithi116.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T05:30:02.227 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T05:30:02.227 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T05:30:02.227 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T05:30:02.227 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T05:30:02.227 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-21T05:30:02.227 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi116.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T05:30:02.227 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T05:30:02.285 INFO:teuthology.orchestra.run.smithi116.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T05:30:02.286 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T05:30:02.286 DEBUG:teuthology.orchestra.run.smithi116:> sudo rpm -qi grub2-tools 2024-09-21T05:30:02.299 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.SR44nZVOQz 2024-09-21T05:30:02.327 INFO:teuthology.orchestra.run.smithi116.stdout:Name : grub2-tools 2024-09-21T05:30:02.327 INFO:teuthology.orchestra.run.smithi116.stdout:Epoch : 1 2024-09-21T05:30:02.327 INFO:teuthology.orchestra.run.smithi116.stdout:Version : 2.06 2024-09-21T05:30:02.327 INFO:teuthology.orchestra.run.smithi116.stdout:Release : 82.el9 2024-09-21T05:30:02.327 INFO:teuthology.orchestra.run.smithi116.stdout:Architecture: x86_64 2024-09-21T05:30:02.327 INFO:teuthology.orchestra.run.smithi116.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T05:30:02.327 INFO:teuthology.orchestra.run.smithi116.stdout:Group : Unspecified 2024-09-21T05:30:02.327 INFO:teuthology.orchestra.run.smithi116.stdout:Size : 8274670 2024-09-21T05:30:02.327 INFO:teuthology.orchestra.run.smithi116.stdout:License : GPLv3+ 2024-09-21T05:30:02.327 INFO:teuthology.orchestra.run.smithi116.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T05:30:02.327 INFO:teuthology.orchestra.run.smithi116.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T05:30:02.327 INFO:teuthology.orchestra.run.smithi116.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T05:30:02.327 INFO:teuthology.orchestra.run.smithi116.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T05:30:02.328 INFO:teuthology.orchestra.run.smithi116.stdout:Packager : builder@centos.org 2024-09-21T05:30:02.328 INFO:teuthology.orchestra.run.smithi116.stdout:Vendor : CentOS 2024-09-21T05:30:02.328 INFO:teuthology.orchestra.run.smithi116.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T05:30:02.328 INFO:teuthology.orchestra.run.smithi116.stdout:Summary : Support tools for GRUB. 2024-09-21T05:30:02.328 INFO:teuthology.orchestra.run.smithi116.stdout:Description : 2024-09-21T05:30:02.328 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-21T05:30:02.328 INFO:teuthology.orchestra.run.smithi116.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T05:30:02.328 INFO:teuthology.orchestra.run.smithi116.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T05:30:02.328 INFO:teuthology.orchestra.run.smithi116.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T05:30:02.328 INFO:teuthology.orchestra.run.smithi116.stdout:hardware devices. 2024-09-21T05:30:02.328 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-21T05:30:02.328 INFO:teuthology.orchestra.run.smithi116.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T05:30:02.329 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T05:30:02.330 INFO:teuthology.task.kernel:Updating grub on smithi116 to boot 5.14.0-508.el9.x86_64 2024-09-21T05:30:02.330 DEBUG:teuthology.orchestra.run.smithi116:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T05:30:02.435 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.SR44nZVOQz is 6KB 2024-09-21T05:30:02.483 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.SR44nZVOQz 2024-09-21T05:30:02.497 DEBUG:teuthology.orchestra.run.smithi070:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T05:30:02.567 INFO:teuthology.orchestra.run.smithi070.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T05:30:02.567 INFO:teuthology.orchestra.run.smithi070.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T05:30:02.567 INFO:teuthology.orchestra.run.smithi070.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T05:30:02.569 INFO:teuthology.orchestra.run.smithi070.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T05:30:02.570 DEBUG:teuthology.orchestra.run.smithi070:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T05:30:02.763 DEBUG:teuthology.orchestra.run.smithi070:> sudo shutdown -r now 2024-09-21T05:30:02.971 INFO:teuthology.orchestra.run.smithi116.stderr:Generating grub configuration file ... 2024-09-21T05:30:04.301 INFO:teuthology.orchestra.run.smithi116.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T05:30:04.332 INFO:teuthology.orchestra.run.smithi116.stderr:done 2024-09-21T05:30:04.335 DEBUG:teuthology.orchestra.run.smithi116:> mktemp 2024-09-21T05:30:04.350 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.aEaxngsvfm 2024-09-21T05:30:04.350 DEBUG:teuthology.orchestra.run.smithi116:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.aEaxngsvfm 2024-09-21T05:30:04.430 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.aEaxngsvfm 2024-09-21T05:30:04.569 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.aEaxngsvfm is 6KB 2024-09-21T05:30:04.617 DEBUG:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.aEaxngsvfm 2024-09-21T05:30:04.632 DEBUG:teuthology.orchestra.run.smithi116:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T05:30:04.695 INFO:teuthology.orchestra.run.smithi116.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T05:30:04.695 INFO:teuthology.orchestra.run.smithi116.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T05:30:04.695 INFO:teuthology.orchestra.run.smithi116.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T05:30:04.695 INFO:teuthology.orchestra.run.smithi116.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T05:30:04.696 DEBUG:teuthology.orchestra.run.smithi116:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T05:30:04.848 DEBUG:teuthology.orchestra.run.smithi116:> sudo shutdown -r now 2024-09-21T05:30:30.514 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-09-21T05:30:30.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-09-21T05:30:30.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:30:32.766 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-21T05:30:32.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-21T05:30:32.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:30:34.854 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-21T05:30:34.854 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-21T05:30:34.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:31:05.071 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-09-21T05:31:09.423 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-09-21T05:31:14.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-09-21T05:31:14.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:31:18.426 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-21T05:31:18.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:31:32.463 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-09-21T05:31:32.771 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T05:31:36.815 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-09-21T05:31:41.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-21T05:31:41.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:31:42.131 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-09-21T05:31:42.495 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-21T05:31:42.495 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-21T05:31:42.496 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2024-09-21T05:31:42.510 INFO:teuthology.orchestra.run.smithi070.stdout:5.14.0-508.el9.x86_64 2024-09-21T05:31:42.510 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T05:31:42.510 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T05:31:42.511 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T05:31:43.512 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-21T05:31:43.512 DEBUG:teuthology.orchestra.run.smithi070:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T05:31:43.641 INFO:teuthology.orchestra.run.smithi070.stdout:ttyS1 2024-09-21T05:31:43.666 DEBUG:teuthology.parallel:result is None 2024-09-21T05:31:44.464 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-09-21T05:31:44.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:31:44.744 DEBUG:teuthology.orchestra.run.smithi160:> true 2024-09-21T05:31:45.145 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-09-21T05:31:45.145 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-508.el9.x86_64"... 2024-09-21T05:31:45.145 DEBUG:teuthology.orchestra.run.smithi160:> uname -r 2024-09-21T05:31:45.162 INFO:teuthology.orchestra.run.smithi160.stdout:5.14.0-508.el9.x86_64 2024-09-21T05:31:45.162 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T05:31:45.162 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T05:31:45.162 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T05:31:46.163 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-09-21T05:31:46.163 DEBUG:teuthology.orchestra.run.smithi160:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T05:31:46.281 INFO:teuthology.orchestra.run.smithi160.stdout:ttyS1 2024-09-21T05:31:46.304 DEBUG:teuthology.parallel:result is None 2024-09-21T05:31:48.815 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-21T05:31:48.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:31:49.201 DEBUG:teuthology.orchestra.run.smithi116:> true 2024-09-21T05:31:49.541 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-21T05:31:49.541 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-21T05:31:49.541 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2024-09-21T05:31:49.555 INFO:teuthology.orchestra.run.smithi116.stdout:5.14.0-508.el9.x86_64 2024-09-21T05:31:49.555 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T05:31:49.555 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T05:31:49.556 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T05:31:50.556 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-21T05:31:50.556 DEBUG:teuthology.orchestra.run.smithi116:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T05:31:50.761 INFO:teuthology.orchestra.run.smithi116.stdout:ttyS1 2024-09-21T05:31:50.796 DEBUG:teuthology.parallel:result is None 2024-09-21T05:31:50.796 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T05:31:50.804 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T05:31:50.804 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T05:31:50.806 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T05:31:50.813 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T05:31:50.857 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T05:31:50.864 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T05:31:50.872 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T05:31:50.873 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T05:31:50.875 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T05:31:50.877 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T05:31:50.928 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T05:31:50.934 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T05:31:50.935 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T05:31:50.942 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T05:31:50.944 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T05:31:50.972 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T05:31:50.975 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T05:31:50.983 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T05:31:50.986 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T05:31:51.141 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T05:31:51.159 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T05:31:51.161 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T05:31:51.168 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T05:31:51.168 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T05:31:51.171 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T05:31:51.173 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T05:31:51.235 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T05:31:51.243 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T05:31:51.244 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T05:31:51.246 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T05:31:51.248 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T05:31:51.272 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T05:31:51.347 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T05:31:51.400 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T05:31:51.477 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T05:31:51.524 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-21T05:31:51.524 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T05:31:51.589 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T05:31:51.660 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T05:31:51.746 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T05:31:51.810 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T05:31:51.854 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-21T05:31:51.854 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T05:31:51.919 DEBUG:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T05:31:51.959 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T05:31:52.020 DEBUG:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T05:31:52.103 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T05:31:52.150 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-21T05:31:52.150 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T05:31:52.219 DEBUG:teuthology.orchestra.run.smithi070:> sudo service rsyslog restart 2024-09-21T05:31:52.221 DEBUG:teuthology.orchestra.run.smithi116:> sudo service rsyslog restart 2024-09-21T05:31:52.224 DEBUG:teuthology.orchestra.run.smithi160:> sudo service rsyslog restart 2024-09-21T05:31:52.281 INFO:teuthology.orchestra.run.smithi070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T05:31:52.307 INFO:teuthology.orchestra.run.smithi116.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T05:31:52.412 INFO:teuthology.orchestra.run.smithi160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T05:31:52.638 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T05:31:52.646 INFO:teuthology.task.internal:Starting timer... 2024-09-21T05:31:52.646 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T05:31:52.659 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T05:31:52.667 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T05:31:52.667 DEBUG:teuthology.orchestra.run.smithi070:> sudo service auditd rotate 2024-09-21T05:31:52.708 INFO:teuthology.orchestra.run.smithi070.stdout:Rotating logs: 2024-09-21T05:31:52.709 DEBUG:teuthology.orchestra.run.smithi116:> sudo service auditd rotate 2024-09-21T05:31:52.890 INFO:teuthology.orchestra.run.smithi116.stdout:Rotating logs: 2024-09-21T05:31:52.892 DEBUG:teuthology.orchestra.run.smithi160:> sudo service auditd rotate 2024-09-21T05:31:53.016 INFO:teuthology.orchestra.run.smithi160.stdout:Rotating logs: 2024-09-21T05:31:53.019 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T05:31:53.019 DEBUG:teuthology.orchestra.run.smithi070:> /usr/sbin/getenforce 2024-09-21T05:31:53.044 INFO:teuthology.orchestra.run.smithi070.stdout:Permissive 2024-09-21T05:31:53.044 DEBUG:teuthology.orchestra.run.smithi116:> /usr/sbin/getenforce 2024-09-21T05:31:53.065 INFO:teuthology.orchestra.run.smithi116.stdout:Permissive 2024-09-21T05:31:53.065 DEBUG:teuthology.orchestra.run.smithi160:> /usr/sbin/getenforce 2024-09-21T05:31:53.114 INFO:teuthology.orchestra.run.smithi160.stdout:Permissive 2024-09-21T05:31:53.114 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi070.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi116.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi160.front.sepia.ceph.com': 'permissive'} 2024-09-21T05:31:53.114 DEBUG:teuthology.orchestra.run.smithi070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T05:31:53.142 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:31:53.143 DEBUG:teuthology.orchestra.run.smithi116:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T05:31:53.169 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:31:53.169 DEBUG:teuthology.orchestra.run.smithi160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T05:31:53.229 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:31:53.230 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T05:31:53.230 DEBUG:teuthology.orchestra.run.smithi070:> sudo /usr/sbin/setenforce permissive 2024-09-21T05:31:53.265 DEBUG:teuthology.orchestra.run.smithi116:> sudo /usr/sbin/setenforce permissive 2024-09-21T05:31:53.294 DEBUG:teuthology.orchestra.run.smithi160:> sudo /usr/sbin/setenforce permissive 2024-09-21T05:31:53.360 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T05:31:53.373 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-21T05:31:53.377 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-21T05:31:53.520 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T05:31:53.530 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T05:31:53.533 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi070.front.sepia.ceph.com,smithi116.front.sepia.ceph.com,smithi160.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T05:35:35.498 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi070.front.sepia.ceph.com'), Remote(name='ubuntu@smithi116.front.sepia.ceph.com'), Remote(name='ubuntu@smithi160.front.sepia.ceph.com')] 2024-09-21T05:35:35.499 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-21T05:35:35.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:35:35.576 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-09-21T05:35:35.658 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-21T05:35:35.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-21T05:35:35.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:35:35.737 DEBUG:teuthology.orchestra.run.smithi116:> true 2024-09-21T05:35:35.814 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-21T05:35:35.814 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-09-21T05:35:35.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:35:35.888 DEBUG:teuthology.orchestra.run.smithi160:> true 2024-09-21T05:35:35.970 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-09-21T05:35:35.970 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T05:35:35.980 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T05:35:35.981 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T05:35:35.981 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T05:35:35.983 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T05:35:35.984 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T05:35:35.986 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T05:35:35.986 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T05:35:36.013 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T05:35:36.014 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T05:35:36.028 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T05:35:36.029 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T05:35:36.039 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T05:35:36.054 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T05:35:36.054 INFO:teuthology.orchestra.run.smithi116.stderr:sudo: ntpd: command not found 2024-09-21T05:35:36.054 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: ntpd: command not found 2024-09-21T05:35:36.065 INFO:teuthology.orchestra.run.smithi070.stdout:506 Cannot talk to daemon 2024-09-21T05:35:36.065 INFO:teuthology.orchestra.run.smithi116.stdout:506 Cannot talk to daemon 2024-09-21T05:35:36.079 INFO:teuthology.orchestra.run.smithi160.stderr:sudo: ntpd: command not found 2024-09-21T05:35:36.079 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T05:35:36.079 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T05:35:36.090 INFO:teuthology.orchestra.run.smithi160.stdout:506 Cannot talk to daemon 2024-09-21T05:35:36.093 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T05:35:36.094 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T05:35:36.105 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T05:35:36.119 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T05:35:36.145 INFO:teuthology.orchestra.run.smithi070.stderr:bash: line 1: ntpq: command not found 2024-09-21T05:35:36.148 INFO:teuthology.orchestra.run.smithi116.stderr:bash: line 1: ntpq: command not found 2024-09-21T05:35:36.148 INFO:teuthology.orchestra.run.smithi070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T05:35:36.149 INFO:teuthology.orchestra.run.smithi070.stdout:=============================================================================== 2024-09-21T05:35:36.149 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:35:36.149 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:35:36.149 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:35:36.149 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:35:36.151 INFO:teuthology.orchestra.run.smithi116.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T05:35:36.151 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================== 2024-09-21T05:35:36.151 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:35:36.151 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:35:36.152 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:35:36.152 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:35:36.175 INFO:teuthology.orchestra.run.smithi160.stderr:bash: line 1: ntpq: command not found 2024-09-21T05:35:36.178 INFO:teuthology.orchestra.run.smithi160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T05:35:36.178 INFO:teuthology.orchestra.run.smithi160.stdout:=============================================================================== 2024-09-21T05:35:36.178 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:35:36.178 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:35:36.179 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:35:36.179 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:35:36.179 INFO:teuthology.run_tasks:Running task install... 2024-09-21T05:35:36.187 DEBUG:teuthology.task.install:project ceph 2024-09-21T05:35:36.187 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T05:35:36.188 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T05:35:36.188 INFO:teuthology.task.install:Using flavor: default 2024-09-21T05:35:36.193 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T05:35:36.193 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T05:35:36.193 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T05:35:36.193 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:35:36.195 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T05:35:36.195 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:35:36.196 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T05:35:36.196 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:35:36.344 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T05:35:36.344 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T05:35:36.351 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T05:35:36.351 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T05:35:36.354 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T05:35:36.354 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T05:35:36.453 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T05:35:36.453 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-21T05:35:36.454 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T05:35:36.459 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T05:35:36.459 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-21T05:35:36.459 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T05:35:36.466 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T05:35:36.466 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-21T05:35:36.466 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T05:35:36.480 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T05:35:36.480 DEBUG:teuthology.orchestra.run.smithi070:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T05:35:36.484 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T05:35:36.485 DEBUG:teuthology.orchestra.run.smithi160:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T05:35:36.492 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T05:35:36.492 DEBUG:teuthology.orchestra.run.smithi116:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T05:35:36.546 DEBUG:teuthology.orchestra.run.smithi070:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T05:35:36.550 DEBUG:teuthology.orchestra.run.smithi160:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T05:35:36.558 DEBUG:teuthology.orchestra.run.smithi116:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T05:35:36.621 DEBUG:teuthology.orchestra.run.smithi070:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T05:35:36.625 DEBUG:teuthology.orchestra.run.smithi160:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T05:35:36.632 DEBUG:teuthology.orchestra.run.smithi116:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T05:35:36.686 INFO:teuthology.orchestra.run.smithi070.stdout:check_obsoletes = 1 2024-09-21T05:35:36.687 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum clean all 2024-09-21T05:35:36.689 INFO:teuthology.orchestra.run.smithi160.stdout:check_obsoletes = 1 2024-09-21T05:35:36.690 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum clean all 2024-09-21T05:35:36.696 INFO:teuthology.orchestra.run.smithi116.stdout:check_obsoletes = 1 2024-09-21T05:35:36.698 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum clean all 2024-09-21T05:35:36.922 INFO:teuthology.orchestra.run.smithi070.stdout:45 files removed 2024-09-21T05:35:36.929 INFO:teuthology.orchestra.run.smithi116.stdout:45 files removed 2024-09-21T05:35:36.931 INFO:teuthology.orchestra.run.smithi160.stdout:45 files removed 2024-09-21T05:35:36.948 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T05:35:36.955 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T05:35:36.958 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T05:35:37.483 INFO:teuthology.orchestra.run.smithi070.stdout:ceph packages for x86_64 334 kB/s | 84 kB 00:00 2024-09-21T05:35:37.508 INFO:teuthology.orchestra.run.smithi160.stdout:ceph packages for x86_64 317 kB/s | 84 kB 00:00 2024-09-21T05:35:37.510 INFO:teuthology.orchestra.run.smithi116.stdout:ceph packages for x86_64 310 kB/s | 84 kB 00:00 2024-09-21T05:35:37.767 INFO:teuthology.orchestra.run.smithi070.stdout:ceph noarch packages 101 kB/s | 24 kB 00:00 2024-09-21T05:35:37.810 INFO:teuthology.orchestra.run.smithi160.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-21T05:35:37.811 INFO:teuthology.orchestra.run.smithi116.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-21T05:35:38.043 INFO:teuthology.orchestra.run.smithi070.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-21T05:35:38.093 INFO:teuthology.orchestra.run.smithi160.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-21T05:35:38.095 INFO:teuthology.orchestra.run.smithi116.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-21T05:35:38.635 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.3 MB 00:00 2024-09-21T05:35:39.584 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - BaseOS 5.5 MB/s | 8.3 MB 00:01 2024-09-21T05:35:40.211 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.3 MB 00:02 2024-09-21T05:35:44.687 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - AppStream 6.0 MB/s | 20 MB 00:03 2024-09-21T05:35:45.010 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - AppStream 4.7 MB/s | 20 MB 00:04 2024-09-21T05:35:48.938 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-21T05:35:49.327 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-21T05:35:50.414 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - Extras packages 74 kB/s | 19 kB 00:00 2024-09-21T05:35:51.019 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 19 kB 00:00 2024-09-21T05:35:51.201 INFO:teuthology.orchestra.run.smithi116.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-21T05:35:52.115 INFO:teuthology.orchestra.run.smithi070.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-21T05:35:56.632 INFO:teuthology.orchestra.run.smithi116.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-21T05:35:56.842 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 20 MB 00:17 2024-09-21T05:35:57.479 INFO:teuthology.orchestra.run.smithi070.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-09-21T05:35:58.802 INFO:teuthology.orchestra.run.smithi116.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T05:35:58.803 INFO:teuthology.orchestra.run.smithi116.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T05:35:58.817 INFO:teuthology.orchestra.run.smithi116.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T05:35:58.818 INFO:teuthology.orchestra.run.smithi116.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T05:35:58.819 INFO:teuthology.orchestra.run.smithi116.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T05:35:58.819 INFO:teuthology.orchestra.run.smithi116.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T05:35:58.821 INFO:teuthology.orchestra.run.smithi116.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T05:35:58.824 INFO:teuthology.orchestra.run.smithi116.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T05:35:58.825 INFO:teuthology.orchestra.run.smithi116.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T05:35:58.888 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-21T05:35:58.907 INFO:teuthology.orchestra.run.smithi116.stdout:======================================================================================= 2024-09-21T05:35:58.907 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-09-21T05:35:58.907 INFO:teuthology.orchestra.run.smithi116.stdout:======================================================================================= 2024-09-21T05:35:58.907 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-21T05:35:58.907 INFO:teuthology.orchestra.run.smithi116.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T05:35:58.908 INFO:teuthology.orchestra.run.smithi116.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T05:35:58.908 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T05:35:58.908 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T05:35:58.908 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T05:35:58.908 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T05:35:58.908 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T05:35:58.908 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T05:35:58.909 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T05:35:58.909 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T05:35:58.909 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T05:35:58.909 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T05:35:58.909 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T05:35:58.909 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T05:35:58.909 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T05:35:58.910 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T05:35:58.910 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T05:35:58.910 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T05:35:58.910 INFO:teuthology.orchestra.run.smithi116.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T05:35:58.910 INFO:teuthology.orchestra.run.smithi116.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T05:35:58.910 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T05:35:58.911 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T05:35:58.911 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T05:35:58.911 INFO:teuthology.orchestra.run.smithi116.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T05:35:58.911 INFO:teuthology.orchestra.run.smithi116.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T05:35:58.911 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T05:35:58.911 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T05:35:58.911 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T05:35:58.912 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T05:35:58.912 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T05:35:58.912 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T05:35:58.912 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T05:35:58.912 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T05:35:58.912 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T05:35:58.912 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T05:35:58.913 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T05:35:58.913 INFO:teuthology.orchestra.run.smithi116.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T05:35:58.913 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrading: 2024-09-21T05:35:58.913 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T05:35:58.913 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T05:35:58.913 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T05:35:58.913 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T05:35:58.914 INFO:teuthology.orchestra.run.smithi116.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T05:35:58.914 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T05:35:58.914 INFO:teuthology.orchestra.run.smithi116.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T05:35:58.914 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T05:35:58.914 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-21T05:35:58.914 INFO:teuthology.orchestra.run.smithi116.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T05:35:58.914 INFO:teuthology.orchestra.run.smithi116.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T05:35:58.914 INFO:teuthology.orchestra.run.smithi116.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T05:35:58.914 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T05:35:58.914 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T05:35:58.914 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T05:35:58.914 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T05:35:58.914 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T05:35:58.914 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T05:35:58.915 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T05:35:58.915 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T05:35:58.915 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T05:35:58.915 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T05:35:58.915 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T05:35:58.915 INFO:teuthology.orchestra.run.smithi116.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T05:35:58.915 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T05:35:58.915 INFO:teuthology.orchestra.run.smithi116.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T05:35:58.915 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T05:35:58.915 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T05:35:58.915 INFO:teuthology.orchestra.run.smithi116.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T05:35:58.915 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T05:35:58.915 INFO:teuthology.orchestra.run.smithi116.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T05:35:58.915 INFO:teuthology.orchestra.run.smithi116.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T05:35:58.915 INFO:teuthology.orchestra.run.smithi116.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T05:35:58.916 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T05:35:58.916 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T05:35:58.916 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T05:35:58.916 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T05:35:58.916 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T05:35:58.916 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T05:35:58.916 INFO:teuthology.orchestra.run.smithi116.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T05:35:58.916 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T05:35:58.916 INFO:teuthology.orchestra.run.smithi116.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T05:35:58.916 INFO:teuthology.orchestra.run.smithi116.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T05:35:58.916 INFO:teuthology.orchestra.run.smithi116.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T05:35:58.916 INFO:teuthology.orchestra.run.smithi116.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T05:35:58.916 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T05:35:58.916 INFO:teuthology.orchestra.run.smithi116.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T05:35:58.916 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T05:35:58.916 INFO:teuthology.orchestra.run.smithi116.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T05:35:58.917 INFO:teuthology.orchestra.run.smithi116.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T05:35:58.917 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T05:35:58.917 INFO:teuthology.orchestra.run.smithi116.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T05:35:58.917 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T05:35:58.917 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T05:35:58.917 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T05:35:58.917 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T05:35:58.917 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T05:35:58.917 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T05:35:58.917 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T05:35:58.917 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T05:35:58.917 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T05:35:58.917 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T05:35:58.917 INFO:teuthology.orchestra.run.smithi116.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T05:35:58.918 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T05:35:58.918 INFO:teuthology.orchestra.run.smithi116.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T05:35:58.918 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T05:35:58.918 INFO:teuthology.orchestra.run.smithi116.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T05:35:58.918 INFO:teuthology.orchestra.run.smithi116.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T05:35:58.918 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T05:35:58.918 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T05:35:58.918 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T05:35:58.918 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T05:35:58.918 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T05:35:58.918 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T05:35:58.918 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T05:35:58.918 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T05:35:58.918 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T05:35:58.918 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T05:35:58.919 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T05:35:58.919 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T05:35:58.919 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T05:35:58.919 INFO:teuthology.orchestra.run.smithi116.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T05:35:58.919 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T05:35:58.919 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T05:35:58.919 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T05:35:58.919 INFO:teuthology.orchestra.run.smithi116.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T05:35:58.919 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T05:35:58.919 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T05:35:58.919 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T05:35:58.919 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T05:35:58.919 INFO:teuthology.orchestra.run.smithi116.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T05:35:58.919 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T05:35:58.919 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T05:35:58.920 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T05:35:58.920 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T05:35:58.920 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T05:35:58.920 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T05:35:58.920 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T05:35:58.920 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T05:35:58.920 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T05:35:58.920 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T05:35:58.920 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T05:35:58.920 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T05:35:58.920 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T05:35:58.920 INFO:teuthology.orchestra.run.smithi116.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T05:35:58.920 INFO:teuthology.orchestra.run.smithi116.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T05:35:58.920 INFO:teuthology.orchestra.run.smithi116.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T05:35:58.920 INFO:teuthology.orchestra.run.smithi116.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T05:35:58.920 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T05:35:58.921 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T05:35:58.921 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T05:35:58.921 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T05:35:58.921 INFO:teuthology.orchestra.run.smithi116.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T05:35:58.921 INFO:teuthology.orchestra.run.smithi116.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T05:35:58.921 INFO:teuthology.orchestra.run.smithi116.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T05:35:58.921 INFO:teuthology.orchestra.run.smithi116.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T05:35:58.921 INFO:teuthology.orchestra.run.smithi116.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T05:35:58.921 INFO:teuthology.orchestra.run.smithi116.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T05:35:58.921 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T05:35:58.921 INFO:teuthology.orchestra.run.smithi116.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T05:35:58.921 INFO:teuthology.orchestra.run.smithi116.stdout:Installing weak dependencies: 2024-09-21T05:35:58.921 INFO:teuthology.orchestra.run.smithi116.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T05:35:58.921 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-21T05:35:58.921 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-21T05:35:58.922 INFO:teuthology.orchestra.run.smithi116.stdout:======================================================================================= 2024-09-21T05:35:58.922 INFO:teuthology.orchestra.run.smithi116.stdout:Install 149 Packages 2024-09-21T05:35:58.922 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrade 8 Packages 2024-09-21T05:35:58.922 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-21T05:35:58.922 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 228 M 2024-09-21T05:35:58.922 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-21T05:35:59.617 INFO:teuthology.orchestra.run.smithi116.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 57 kB/s | 6.6 kB 00:00 2024-09-21T05:35:59.676 INFO:teuthology.orchestra.run.smithi070.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T05:35:59.677 INFO:teuthology.orchestra.run.smithi070.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T05:35:59.690 INFO:teuthology.orchestra.run.smithi070.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T05:35:59.691 INFO:teuthology.orchestra.run.smithi070.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T05:35:59.692 INFO:teuthology.orchestra.run.smithi070.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T05:35:59.693 INFO:teuthology.orchestra.run.smithi070.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T05:35:59.695 INFO:teuthology.orchestra.run.smithi070.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T05:35:59.698 INFO:teuthology.orchestra.run.smithi070.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T05:35:59.698 INFO:teuthology.orchestra.run.smithi070.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T05:35:59.760 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-21T05:35:59.774 INFO:teuthology.orchestra.run.smithi070.stdout:======================================================================================= 2024-09-21T05:35:59.774 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-09-21T05:35:59.774 INFO:teuthology.orchestra.run.smithi070.stdout:======================================================================================= 2024-09-21T05:35:59.774 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-21T05:35:59.774 INFO:teuthology.orchestra.run.smithi070.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T05:35:59.774 INFO:teuthology.orchestra.run.smithi070.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T05:35:59.774 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T05:35:59.774 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T05:35:59.774 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T05:35:59.774 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T05:35:59.774 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T05:35:59.774 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T05:35:59.774 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T05:35:59.775 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T05:35:59.775 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T05:35:59.775 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T05:35:59.775 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T05:35:59.775 INFO:teuthology.orchestra.run.smithi070.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T05:35:59.775 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T05:35:59.775 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T05:35:59.775 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T05:35:59.775 INFO:teuthology.orchestra.run.smithi070.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T05:35:59.775 INFO:teuthology.orchestra.run.smithi070.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T05:35:59.775 INFO:teuthology.orchestra.run.smithi070.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T05:35:59.775 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T05:35:59.775 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T05:35:59.775 INFO:teuthology.orchestra.run.smithi070.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T05:35:59.776 INFO:teuthology.orchestra.run.smithi070.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T05:35:59.776 INFO:teuthology.orchestra.run.smithi070.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T05:35:59.776 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T05:35:59.776 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T05:35:59.776 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T05:35:59.776 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T05:35:59.776 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T05:35:59.776 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T05:35:59.776 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T05:35:59.776 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T05:35:59.776 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T05:35:59.776 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T05:35:59.776 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T05:35:59.776 INFO:teuthology.orchestra.run.smithi070.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T05:35:59.776 INFO:teuthology.orchestra.run.smithi070.stdout:Upgrading: 2024-09-21T05:35:59.777 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T05:35:59.777 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T05:35:59.777 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T05:35:59.777 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T05:35:59.777 INFO:teuthology.orchestra.run.smithi070.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T05:35:59.777 INFO:teuthology.orchestra.run.smithi070.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T05:35:59.777 INFO:teuthology.orchestra.run.smithi070.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T05:35:59.777 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T05:35:59.777 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-09-21T05:35:59.777 INFO:teuthology.orchestra.run.smithi070.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T05:35:59.777 INFO:teuthology.orchestra.run.smithi070.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T05:35:59.777 INFO:teuthology.orchestra.run.smithi070.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T05:35:59.777 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T05:35:59.777 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T05:35:59.777 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T05:35:59.778 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T05:35:59.778 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T05:35:59.778 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T05:35:59.778 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T05:35:59.778 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T05:35:59.778 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T05:35:59.778 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T05:35:59.778 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T05:35:59.778 INFO:teuthology.orchestra.run.smithi070.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T05:35:59.778 INFO:teuthology.orchestra.run.smithi070.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T05:35:59.778 INFO:teuthology.orchestra.run.smithi070.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T05:35:59.778 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T05:35:59.778 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T05:35:59.778 INFO:teuthology.orchestra.run.smithi070.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T05:35:59.778 INFO:teuthology.orchestra.run.smithi070.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T05:35:59.779 INFO:teuthology.orchestra.run.smithi070.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T05:35:59.779 INFO:teuthology.orchestra.run.smithi070.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T05:35:59.779 INFO:teuthology.orchestra.run.smithi070.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T05:35:59.779 INFO:teuthology.orchestra.run.smithi070.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T05:35:59.779 INFO:teuthology.orchestra.run.smithi070.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T05:35:59.779 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T05:35:59.779 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T05:35:59.779 INFO:teuthology.orchestra.run.smithi070.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T05:35:59.779 INFO:teuthology.orchestra.run.smithi070.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T05:35:59.779 INFO:teuthology.orchestra.run.smithi070.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T05:35:59.779 INFO:teuthology.orchestra.run.smithi070.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T05:35:59.779 INFO:teuthology.orchestra.run.smithi070.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T05:35:59.779 INFO:teuthology.orchestra.run.smithi070.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T05:35:59.779 INFO:teuthology.orchestra.run.smithi070.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T05:35:59.779 INFO:teuthology.orchestra.run.smithi070.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T05:35:59.780 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T05:35:59.780 INFO:teuthology.orchestra.run.smithi070.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T05:35:59.780 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T05:35:59.780 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T05:35:59.780 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T05:35:59.780 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T05:35:59.780 INFO:teuthology.orchestra.run.smithi070.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T05:35:59.780 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T05:35:59.780 INFO:teuthology.orchestra.run.smithi070.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T05:35:59.780 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T05:35:59.780 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T05:35:59.780 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T05:35:59.780 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T05:35:59.780 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T05:35:59.780 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T05:35:59.781 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T05:35:59.781 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T05:35:59.781 INFO:teuthology.orchestra.run.smithi070.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T05:35:59.781 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T05:35:59.781 INFO:teuthology.orchestra.run.smithi070.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T05:35:59.781 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T05:35:59.781 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T05:35:59.781 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T05:35:59.781 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T05:35:59.781 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T05:35:59.781 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T05:35:59.781 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T05:35:59.781 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T05:35:59.781 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T05:35:59.781 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T05:35:59.782 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T05:35:59.782 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T05:35:59.782 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T05:35:59.782 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T05:35:59.782 INFO:teuthology.orchestra.run.smithi070.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T05:35:59.782 INFO:teuthology.orchestra.run.smithi070.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T05:35:59.782 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T05:35:59.782 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T05:35:59.782 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T05:35:59.782 INFO:teuthology.orchestra.run.smithi070.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T05:35:59.782 INFO:teuthology.orchestra.run.smithi070.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T05:35:59.782 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T05:35:59.782 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T05:35:59.782 INFO:teuthology.orchestra.run.smithi070.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T05:35:59.782 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T05:35:59.783 INFO:teuthology.orchestra.run.smithi070.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T05:35:59.783 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T05:35:59.783 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T05:35:59.783 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T05:35:59.783 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T05:35:59.783 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T05:35:59.783 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T05:35:59.783 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T05:35:59.783 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T05:35:59.783 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T05:35:59.783 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T05:35:59.783 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T05:35:59.783 INFO:teuthology.orchestra.run.smithi070.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T05:35:59.783 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T05:35:59.783 INFO:teuthology.orchestra.run.smithi070.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T05:35:59.783 INFO:teuthology.orchestra.run.smithi070.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T05:35:59.784 INFO:teuthology.orchestra.run.smithi070.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T05:35:59.784 INFO:teuthology.orchestra.run.smithi070.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T05:35:59.784 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T05:35:59.784 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T05:35:59.784 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T05:35:59.784 INFO:teuthology.orchestra.run.smithi070.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T05:35:59.784 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T05:35:59.784 INFO:teuthology.orchestra.run.smithi070.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T05:35:59.784 INFO:teuthology.orchestra.run.smithi070.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T05:35:59.784 INFO:teuthology.orchestra.run.smithi070.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T05:35:59.784 INFO:teuthology.orchestra.run.smithi070.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T05:35:59.784 INFO:teuthology.orchestra.run.smithi070.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T05:35:59.784 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T05:35:59.784 INFO:teuthology.orchestra.run.smithi070.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T05:35:59.784 INFO:teuthology.orchestra.run.smithi070.stdout:Installing weak dependencies: 2024-09-21T05:35:59.785 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T05:35:59.785 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:35:59.785 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-21T05:35:59.785 INFO:teuthology.orchestra.run.smithi070.stdout:======================================================================================= 2024-09-21T05:35:59.785 INFO:teuthology.orchestra.run.smithi070.stdout:Install 149 Packages 2024-09-21T05:35:59.785 INFO:teuthology.orchestra.run.smithi070.stdout:Upgrade 8 Packages 2024-09-21T05:35:59.785 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:35:59.785 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 228 M 2024-09-21T05:35:59.785 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-21T05:35:59.800 INFO:teuthology.orchestra.run.smithi116.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.7 MB/s | 873 kB 00:00 2024-09-21T05:35:59.867 INFO:teuthology.orchestra.run.smithi116.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 2.2 MB/s | 148 kB 00:00 2024-09-21T05:35:59.992 INFO:teuthology.orchestra.run.smithi116.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-21T05:36:00.059 INFO:teuthology.orchestra.run.smithi116.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 12 MB/s | 2.3 MB 00:00 2024-09-21T05:36:00.118 INFO:teuthology.orchestra.run.smithi116.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 12 MB/s | 1.5 MB 00:00 2024-09-21T05:36:00.435 INFO:teuthology.orchestra.run.smithi116.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 13 MB/s | 5.0 MB 00:00 2024-09-21T05:36:00.548 INFO:teuthology.orchestra.run.smithi070.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 25 kB/s | 6.6 kB 00:00 2024-09-21T05:36:00.685 INFO:teuthology.orchestra.run.smithi116.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 17 MB/s | 20 MB 00:01 2024-09-21T05:36:00.744 INFO:teuthology.orchestra.run.smithi116.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 433 kB/s | 25 kB 00:00 2024-09-21T05:36:00.815 INFO:teuthology.orchestra.run.smithi070.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 3.2 MB/s | 873 kB 00:00 2024-09-21T05:36:01.186 INFO:teuthology.orchestra.run.smithi116.stdout:(10/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 17 MB/s | 18 MB 00:01 2024-09-21T05:36:01.190 INFO:teuthology.orchestra.run.smithi070.stdout:(3/157): ceph-base-19.3.0-5120.g18432218.el9.x8 6.1 MB/s | 5.5 MB 00:00 2024-09-21T05:36:01.291 INFO:teuthology.orchestra.run.smithi070.stdout:(4/157): ceph-immutable-object-cache-19.3.0-512 312 kB/s | 148 kB 00:00 2024-09-21T05:36:01.303 INFO:teuthology.orchestra.run.smithi116.stdout:(11/157): ceph-radosgw-19.3.0-5120.g18432218.el 12 MB/s | 10 MB 00:00 2024-09-21T05:36:01.328 INFO:teuthology.orchestra.run.smithi116.stdout:(12/157): cephfs-mirror-19.3.0-5120.g18432218.e 1.6 MB/s | 226 kB 00:00 2024-09-21T05:36:01.353 INFO:teuthology.orchestra.run.smithi116.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 541 kB/s | 27 kB 00:00 2024-09-21T05:36:01.366 INFO:teuthology.orchestra.run.smithi070.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 13 MB/s | 2.3 MB 00:00 2024-09-21T05:36:01.378 INFO:teuthology.orchestra.run.smithi116.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 635 kB/s | 32 kB 00:00 2024-09-21T05:36:01.445 INFO:teuthology.orchestra.run.smithi116.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 8.1 MB/s | 766 kB 00:00 2024-09-21T05:36:01.470 INFO:teuthology.orchestra.run.smithi116.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 1.7 MB/s | 158 kB 00:00 2024-09-21T05:36:01.504 INFO:teuthology.orchestra.run.smithi116.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.1 MB/s | 127 kB 00:00 2024-09-21T05:36:01.538 INFO:teuthology.orchestra.run.smithi116.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 7.4 MB/s | 507 kB 00:00 2024-09-21T05:36:01.575 INFO:teuthology.orchestra.run.smithi070.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 5.3 MB/s | 1.5 MB 00:00 2024-09-21T05:36:01.596 INFO:teuthology.orchestra.run.smithi116.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 773 kB/s | 45 kB 00:00 2024-09-21T05:36:01.672 INFO:teuthology.orchestra.run.smithi116.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.9 MB/s | 148 kB 00:00 2024-09-21T05:36:01.747 INFO:teuthology.orchestra.run.smithi116.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 2.1 MB/s | 161 kB 00:00 2024-09-21T05:36:01.822 INFO:teuthology.orchestra.run.smithi116.stdout:(22/157): python3-rados-19.3.0-5120.g18432218.e 4.2 MB/s | 321 kB 00:00 2024-09-21T05:36:01.841 INFO:teuthology.orchestra.run.smithi070.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 10 MB/s | 5.0 MB 00:00 2024-09-21T05:36:01.880 INFO:teuthology.orchestra.run.smithi116.stdout:(23/157): python3-rbd-19.3.0-5120.g18432218.el9 5.1 MB/s | 307 kB 00:00 2024-09-21T05:36:01.956 INFO:teuthology.orchestra.run.smithi116.stdout:(24/157): librgw2-19.3.0-5120.g18432218.el9.x86 12 MB/s | 5.3 MB 00:00 2024-09-21T05:36:01.973 INFO:teuthology.orchestra.run.smithi116.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.1 MB/s | 99 kB 00:00 2024-09-21T05:36:01.999 INFO:teuthology.orchestra.run.smithi116.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 2.0 MB/s | 86 kB 00:00 2024-09-21T05:36:02.067 INFO:teuthology.orchestra.run.smithi070.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 11 MB/s | 20 MB 00:01 2024-09-21T05:36:02.074 INFO:teuthology.orchestra.run.smithi116.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.2 MB/s | 170 kB 00:00 2024-09-21T05:36:02.108 INFO:teuthology.orchestra.run.smithi070.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 610 kB/s | 25 kB 00:00 2024-09-21T05:36:02.132 INFO:teuthology.orchestra.run.smithi116.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 20 MB/s | 3.1 MB 00:00 2024-09-21T05:36:02.158 INFO:teuthology.orchestra.run.smithi116.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 410 kB/s | 34 kB 00:00 2024-09-21T05:36:02.191 INFO:teuthology.orchestra.run.smithi116.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 2.6 MB/s | 154 kB 00:00 2024-09-21T05:36:02.708 INFO:teuthology.orchestra.run.smithi116.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 14 MB/s | 7.4 MB 00:00 2024-09-21T05:36:02.808 INFO:teuthology.orchestra.run.smithi116.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 2.9 MB/s | 292 kB 00:00 2024-09-21T05:36:02.875 INFO:teuthology.orchestra.run.smithi116.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 739 kB/s | 49 kB 00:00 2024-09-21T05:36:02.934 INFO:teuthology.orchestra.run.smithi116.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 282 kB/s | 16 kB 00:00 2024-09-21T05:36:03.009 INFO:teuthology.orchestra.run.smithi116.stdout:(35/157): ceph-volume-19.3.0-5120.g18432218.el9 3.7 MB/s | 285 kB 00:00 2024-09-21T05:36:03.093 INFO:teuthology.orchestra.run.smithi116.stdout:(36/157): cephadm-19.3.0-5120.g18432218.el9.noa 9.2 MB/s | 784 kB 00:00 2024-09-21T05:36:03.134 INFO:teuthology.orchestra.run.smithi070.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 8.1 MB/s | 10 MB 00:01 2024-09-21T05:36:03.151 INFO:teuthology.orchestra.run.smithi116.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 315 kB/s | 18 kB 00:00 2024-09-21T05:36:03.192 INFO:teuthology.orchestra.run.smithi070.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 3.8 MB/s | 226 kB 00:00 2024-09-21T05:36:03.251 INFO:teuthology.orchestra.run.smithi070.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 462 kB/s | 27 kB 00:00 2024-09-21T05:36:03.260 INFO:teuthology.orchestra.run.smithi116.stdout:(38/157): fuse-2.9.9-16.el9.x86_64.rpm 736 kB/s | 80 kB 00:00 2024-09-21T05:36:03.301 INFO:teuthology.orchestra.run.smithi070.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 638 kB/s | 32 kB 00:00 2024-09-21T05:36:03.369 INFO:teuthology.orchestra.run.smithi116.stdout:(39/157): libgfortran-11.5.0-2.el9.x86_64.rpm 7.2 MB/s | 801 kB 00:00 2024-09-21T05:36:03.410 INFO:teuthology.orchestra.run.smithi116.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-21T05:36:03.418 INFO:teuthology.orchestra.run.smithi070.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 6.4 MB/s | 766 kB 00:00 2024-09-21T05:36:03.453 INFO:teuthology.orchestra.run.smithi116.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.9 MB/s | 253 kB 00:00 2024-09-21T05:36:03.485 INFO:teuthology.orchestra.run.smithi070.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 2.3 MB/s | 158 kB 00:00 2024-09-21T05:36:03.544 INFO:teuthology.orchestra.run.smithi070.stdout:(16/157): librados-devel-19.3.0-5120.g18432218. 2.1 MB/s | 127 kB 00:00 2024-09-21T05:36:03.594 INFO:teuthology.orchestra.run.smithi116.stdout:(42/157): ceph-mgr-dashboard-19.3.0-5120.g18432 9.9 MB/s | 14 MB 00:01 2024-09-21T05:36:03.637 INFO:teuthology.orchestra.run.smithi116.stdout:(43/157): python3-cryptography-36.0.1-4.el9.x86 6.7 MB/s | 1.2 MB 00:00 2024-09-21T05:36:03.644 INFO:teuthology.orchestra.run.smithi070.stdout:(17/157): libradosstriper1-19.3.0-5120.g1843221 4.9 MB/s | 507 kB 00:00 2024-09-21T05:36:03.678 INFO:teuthology.orchestra.run.smithi116.stdout:(44/157): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-09-21T05:36:03.721 INFO:teuthology.orchestra.run.smithi116.stdout:(45/157): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-09-21T05:36:03.746 INFO:teuthology.orchestra.run.smithi116.stdout:(46/157): python3-ply-3.11-14.el9.noarch.rpm 707 kB/s | 106 kB 00:00 2024-09-21T05:36:03.771 INFO:teuthology.orchestra.run.smithi116.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-21T05:36:03.979 INFO:teuthology.orchestra.run.smithi116.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 2.9 MB/s | 689 kB 00:00 2024-09-21T05:36:04.038 INFO:teuthology.orchestra.run.smithi116.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-21T05:36:04.063 INFO:teuthology.orchestra.run.smithi116.stdout:(50/157): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 943 kB 00:00 2024-09-21T05:36:04.089 INFO:teuthology.orchestra.run.smithi116.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-09-21T05:36:04.094 INFO:teuthology.orchestra.run.smithi070.stdout:(18/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 7.1 MB/s | 18 MB 00:02 2024-09-21T05:36:04.122 INFO:teuthology.orchestra.run.smithi116.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-09-21T05:36:04.144 INFO:teuthology.orchestra.run.smithi070.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 908 kB/s | 45 kB 00:00 2024-09-21T05:36:04.147 INFO:teuthology.orchestra.run.smithi116.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 558 kB/s | 33 kB 00:00 2024-09-21T05:36:04.206 INFO:teuthology.orchestra.run.smithi116.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-09-21T05:36:04.246 INFO:teuthology.orchestra.run.smithi070.stdout:(20/157): librgw2-19.3.0-5120.g18432218.el9.x86 8.8 MB/s | 5.3 MB 00:00 2024-09-21T05:36:04.256 INFO:teuthology.orchestra.run.smithi116.stdout:(55/157): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-09-21T05:36:04.270 INFO:teuthology.orchestra.run.smithi070.stdout:(21/157): python3-ceph-common-19.3.0-5120.g1843 1.2 MB/s | 148 kB 00:00 2024-09-21T05:36:04.295 INFO:teuthology.orchestra.run.smithi070.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 3.1 MB/s | 161 kB 00:00 2024-09-21T05:36:04.298 INFO:teuthology.orchestra.run.smithi116.stdout:(56/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 17 MB/s | 3.0 MB 00:00 2024-09-21T05:36:04.320 INFO:teuthology.orchestra.run.smithi070.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 6.3 MB/s | 321 kB 00:00 2024-09-21T05:36:04.324 INFO:teuthology.orchestra.run.smithi116.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.5 MB/s | 171 kB 00:00 2024-09-21T05:36:04.349 INFO:teuthology.orchestra.run.smithi116.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-21T05:36:04.354 INFO:teuthology.orchestra.run.smithi070.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 5.1 MB/s | 307 kB 00:00 2024-09-21T05:36:04.374 INFO:teuthology.orchestra.run.smithi116.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-09-21T05:36:04.379 INFO:teuthology.orchestra.run.smithi070.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.7 MB/s | 99 kB 00:00 2024-09-21T05:36:04.405 INFO:teuthology.orchestra.run.smithi070.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T05:36:04.408 INFO:teuthology.orchestra.run.smithi116.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-21T05:36:04.433 INFO:teuthology.orchestra.run.smithi116.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 9.7 MB/s | 581 kB 00:00 2024-09-21T05:36:04.459 INFO:teuthology.orchestra.run.smithi116.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 486 kB/s | 24 kB 00:00 2024-09-21T05:36:04.684 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - CRB 1.6 MB/s | 6.5 MB 00:03 2024-09-21T05:36:04.747 INFO:teuthology.orchestra.run.smithi070.stdout:(27/157): ceph-test-19.3.0-5120.g18432218.el9.x 15 MB/s | 40 MB 00:02 2024-09-21T05:36:04.772 INFO:teuthology.orchestra.run.smithi070.stdout:(28/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 463 kB/s | 170 kB 00:00 2024-09-21T05:36:04.798 INFO:teuthology.orchestra.run.smithi070.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 686 kB/s | 34 kB 00:00 2024-09-21T05:36:04.823 INFO:teuthology.orchestra.run.smithi070.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T05:36:04.825 INFO:teuthology.orchestra.run.smithi116.stdout:(63/157): ceph-test-19.3.0-5120.g18432218.el9.x 9.8 MB/s | 40 MB 00:04 2024-09-21T05:36:04.851 INFO:teuthology.orchestra.run.smithi116.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 114 kB/s | 47 kB 00:00 2024-09-21T05:36:04.876 INFO:teuthology.orchestra.run.smithi116.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 701 kB/s | 292 kB 00:00 2024-09-21T05:36:04.890 INFO:teuthology.orchestra.run.smithi070.stdout:(31/157): rbd-mirror-19.3.0-5120.g18432218.el9. 6.1 MB/s | 3.1 MB 00:00 2024-09-21T05:36:04.918 INFO:teuthology.orchestra.run.smithi116.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 574 kB/s | 38 kB 00:00 2024-09-21T05:36:04.948 INFO:teuthology.orchestra.run.smithi070.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 4.9 MB/s | 292 kB 00:00 2024-09-21T05:36:05.007 INFO:teuthology.orchestra.run.smithi070.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 850 kB/s | 49 kB 00:00 2024-09-21T05:36:05.066 INFO:teuthology.orchestra.run.smithi070.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 282 kB/s | 16 kB 00:00 2024-09-21T05:36:05.077 INFO:teuthology.orchestra.run.smithi116.stdout:(67/157): lua-5.4.4-4.el9.x86_64.rpm 753 kB/s | 188 kB 00:00 2024-09-21T05:36:05.124 INFO:teuthology.orchestra.run.smithi070.stdout:(35/157): ceph-volume-19.3.0-5120.g18432218.el9 4.8 MB/s | 285 kB 00:00 2024-09-21T05:36:05.218 INFO:teuthology.orchestra.run.smithi116.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 14 MB/s | 4.9 MB 00:00 2024-09-21T05:36:05.241 INFO:teuthology.orchestra.run.smithi070.stdout:(36/157): cephadm-19.3.0-5120.g18432218.el9.noa 6.6 MB/s | 784 kB 00:00 2024-09-21T05:36:05.277 INFO:teuthology.orchestra.run.smithi116.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-21T05:36:05.308 INFO:teuthology.orchestra.run.smithi070.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 277 kB/s | 18 kB 00:00 2024-09-21T05:36:05.319 INFO:teuthology.orchestra.run.smithi116.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 8.9 MB/s | 910 kB 00:00 2024-09-21T05:36:05.344 INFO:teuthology.orchestra.run.smithi116.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-21T05:36:05.420 INFO:teuthology.orchestra.run.smithi116.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-21T05:36:05.478 INFO:teuthology.orchestra.run.smithi116.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-21T05:36:05.525 INFO:teuthology.orchestra.run.smithi070.stdout:(38/157): ceph-mgr-dashboard-19.3.0-5120.g18432 19 MB/s | 14 MB 00:00 2024-09-21T05:36:05.550 INFO:teuthology.orchestra.run.smithi070.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 330 kB/s | 80 kB 00:00 2024-09-21T05:36:05.604 INFO:teuthology.orchestra.run.smithi116.stdout:(74/157): postgresql-server-13.16-1.el9.x86_64. 20 MB/s | 5.8 MB 00:00 2024-09-21T05:36:05.642 INFO:teuthology.orchestra.run.smithi070.stdout:(40/157): ceph-mgr-diskprediction-local-19.3.0- 9.0 MB/s | 7.4 MB 00:00 2024-09-21T05:36:05.662 INFO:teuthology.orchestra.run.smithi116.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-21T05:36:05.667 INFO:teuthology.orchestra.run.smithi070.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 191 kB 00:00 2024-09-21T05:36:05.721 INFO:teuthology.orchestra.run.smithi116.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-21T05:36:05.754 INFO:teuthology.orchestra.run.smithi116.stdout:(77/157): postgresql-13.16-1.el9.x86_64.rpm 2.3 MB/s | 1.6 MB 00:00 2024-09-21T05:36:05.821 INFO:teuthology.orchestra.run.smithi116.stdout:(78/157): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-21T05:36:05.846 INFO:teuthology.orchestra.run.smithi116.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 278 kB/s | 26 kB 00:00 2024-09-21T05:36:05.851 INFO:teuthology.orchestra.run.smithi070.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-09-21T05:36:05.872 INFO:teuthology.orchestra.run.smithi116.stdout:(80/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-09-21T05:36:05.885 INFO:teuthology.orchestra.run.smithi070.stdout:(43/157): python3-cryptography-36.0.1-4.el9.x86 5.7 MB/s | 1.2 MB 00:00 2024-09-21T05:36:05.897 INFO:teuthology.orchestra.run.smithi116.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 254 kB/s | 19 kB 00:00 2024-09-21T05:36:05.910 INFO:teuthology.orchestra.run.smithi070.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-21T05:36:05.922 INFO:teuthology.orchestra.run.smithi116.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-21T05:36:05.935 INFO:teuthology.orchestra.run.smithi070.stdout:(45/157): libgfortran-11.5.0-2.el9.x86_64.rpm 1.9 MB/s | 801 kB 00:00 2024-09-21T05:36:05.947 INFO:teuthology.orchestra.run.smithi116.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 461 kB/s | 35 kB 00:00 2024-09-21T05:36:05.960 INFO:teuthology.orchestra.run.smithi070.stdout:(46/157): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-09-21T05:36:05.986 INFO:teuthology.orchestra.run.smithi070.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-21T05:36:06.006 INFO:teuthology.orchestra.run.smithi116.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-21T05:36:06.011 INFO:teuthology.orchestra.run.smithi070.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-21T05:36:06.031 INFO:teuthology.orchestra.run.smithi116.stdout:(85/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.2 MB/s | 250 kB 00:00 2024-09-21T05:36:06.065 INFO:teuthology.orchestra.run.smithi116.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-21T05:36:06.090 INFO:teuthology.orchestra.run.smithi116.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 723 kB/s | 42 kB 00:00 2024-09-21T05:36:06.128 INFO:teuthology.orchestra.run.smithi070.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 918 kB/s | 107 kB 00:00 2024-09-21T05:36:06.157 INFO:teuthology.orchestra.run.smithi116.stdout:(88/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 5.1 MB 00:00 2024-09-21T05:36:06.170 INFO:teuthology.orchestra.run.smithi070.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 689 kB 00:00 2024-09-21T05:36:06.182 INFO:teuthology.orchestra.run.smithi116.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-09-21T05:36:06.186 INFO:teuthology.orchestra.run.smithi070.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 371 kB/s | 22 kB 00:00 2024-09-21T05:36:06.208 INFO:teuthology.orchestra.run.smithi116.stdout:(90/157): python3-protobuf-3.14.0-13.el9.noarch 1.8 MB/s | 269 kB 00:00 2024-09-21T05:36:06.220 INFO:teuthology.orchestra.run.smithi070.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 3.9 MB/s | 943 kB 00:00 2024-09-21T05:36:06.233 INFO:teuthology.orchestra.run.smithi116.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-09-21T05:36:06.237 INFO:teuthology.orchestra.run.smithi070.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 651 kB/s | 33 kB 00:00 2024-09-21T05:36:06.251 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - Extras packages 108 kB/s | 19 kB 00:00 2024-09-21T05:36:06.258 INFO:teuthology.orchestra.run.smithi116.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 675 kB/s | 51 kB 00:00 2024-09-21T05:36:06.262 INFO:teuthology.orchestra.run.smithi070.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-09-21T05:36:06.279 INFO:teuthology.orchestra.run.smithi070.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 437 kB/s | 18 kB 00:00 2024-09-21T05:36:06.283 INFO:teuthology.orchestra.run.smithi116.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 711 kB/s | 54 kB 00:00 2024-09-21T05:36:06.296 INFO:teuthology.orchestra.run.smithi070.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 331 kB/s | 11 kB 00:00 2024-09-21T05:36:06.309 INFO:teuthology.orchestra.run.smithi116.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 830 kB/s | 42 kB 00:00 2024-09-21T05:36:06.330 INFO:teuthology.orchestra.run.smithi070.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-21T05:36:06.342 INFO:teuthology.orchestra.run.smithi116.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 757 kB/s | 44 kB 00:00 2024-09-21T05:36:06.389 INFO:teuthology.orchestra.run.smithi070.stdout:(58/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 18 MB/s | 3.0 MB 00:00 2024-09-21T05:36:06.401 INFO:teuthology.orchestra.run.smithi116.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 615 kB/s | 36 kB 00:00 2024-09-21T05:36:06.414 INFO:teuthology.orchestra.run.smithi070.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-21T05:36:06.426 INFO:teuthology.orchestra.run.smithi116.stdout:(97/157): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-21T05:36:06.439 INFO:teuthology.orchestra.run.smithi070.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 416 kB/s | 45 kB 00:00 2024-09-21T05:36:06.451 INFO:teuthology.orchestra.run.smithi116.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-21T05:36:06.481 INFO:teuthology.orchestra.run.smithi070.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-09-21T05:36:06.507 INFO:teuthology.orchestra.run.smithi070.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 365 kB/s | 24 kB 00:00 2024-09-21T05:36:06.510 INFO:teuthology.orchestra.run.smithi116.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 990 kB/s | 58 kB 00:00 2024-09-21T05:36:06.534 INFO:teuthology.orchestra.run.smithi070.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-21T05:36:06.535 INFO:teuthology.orchestra.run.smithi116.stdout:(100/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.7 MB/s | 304 kB 00:00 2024-09-21T05:36:06.557 INFO:teuthology.orchestra.run.smithi070.stdout:(64/157): libtool-2.4.6-46.el9.x86_64.rpm 4.0 MB/s | 581 kB 00:00 2024-09-21T05:36:06.569 INFO:teuthology.orchestra.run.smithi116.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-21T05:36:06.582 INFO:teuthology.orchestra.run.smithi070.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-21T05:36:06.594 INFO:teuthology.orchestra.run.smithi116.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-21T05:36:06.608 INFO:teuthology.orchestra.run.smithi070.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 767 kB/s | 38 kB 00:00 2024-09-21T05:36:06.628 INFO:teuthology.orchestra.run.smithi116.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 765 kB/s | 45 kB 00:00 2024-09-21T05:36:06.633 INFO:teuthology.orchestra.run.smithi070.stdout:(67/157): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-21T05:36:06.700 INFO:teuthology.orchestra.run.smithi070.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-09-21T05:36:06.767 INFO:teuthology.orchestra.run.smithi070.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 27 MB/s | 4.9 MB 00:00 2024-09-21T05:36:06.795 INFO:teuthology.orchestra.run.smithi116.stdout:(104/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-09-21T05:36:06.809 INFO:teuthology.orchestra.run.smithi070.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 8.2 MB/s | 910 kB 00:00 2024-09-21T05:36:06.820 INFO:teuthology.orchestra.run.smithi116.stdout:(105/157): lua-devel-5.4.4-4.el9.x86_64.rpm 99 kB/s | 22 kB 00:00 2024-09-21T05:36:06.834 INFO:teuthology.orchestra.run.smithi070.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-21T05:36:06.870 INFO:teuthology.orchestra.run.smithi116.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 7.2 MB/s | 548 kB 00:00 2024-09-21T05:36:06.893 INFO:teuthology.orchestra.run.smithi070.stdout:(72/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-21T05:36:06.895 INFO:teuthology.orchestra.run.smithi116.stdout:(107/157): gperftools-libs-2.9.1-3.el9.x86_64.r 4.0 MB/s | 308 kB 00:00 2024-09-21T05:36:06.921 INFO:teuthology.orchestra.run.smithi116.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 389 kB/s | 19 kB 00:00 2024-09-21T05:36:06.926 INFO:teuthology.orchestra.run.smithi070.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2024-09-21T05:36:06.946 INFO:teuthology.orchestra.run.smithi116.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T05:36:06.951 INFO:teuthology.orchestra.run.smithi070.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-21T05:36:06.971 INFO:teuthology.orchestra.run.smithi116.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T05:36:06.993 INFO:teuthology.orchestra.run.smithi070.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-21T05:36:06.996 INFO:teuthology.orchestra.run.smithi116.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T05:36:07.030 INFO:teuthology.orchestra.run.smithi116.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-21T05:36:07.069 INFO:teuthology.orchestra.run.smithi070.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-09-21T05:36:07.094 INFO:teuthology.orchestra.run.smithi070.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-21T05:36:07.097 INFO:teuthology.orchestra.run.smithi116.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-21T05:36:07.119 INFO:teuthology.orchestra.run.smithi070.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-21T05:36:07.130 INFO:teuthology.orchestra.run.smithi116.stdout:(114/157): protobuf-compiler-3.14.0-13.el9.x86_ 1.7 MB/s | 863 kB 00:00 2024-09-21T05:36:07.144 INFO:teuthology.orchestra.run.smithi070.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-09-21T05:36:07.170 INFO:teuthology.orchestra.run.smithi070.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-21T05:36:07.173 INFO:teuthology.orchestra.run.smithi116.stdout:(115/157): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-09-21T05:36:07.189 INFO:teuthology.orchestra.run.smithi116.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 2.2 MB/s | 32 kB 00:00 2024-09-21T05:36:07.195 INFO:teuthology.orchestra.run.smithi070.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-21T05:36:07.215 INFO:teuthology.orchestra.run.smithi116.stdout:(117/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 517 kB/s | 43 kB 00:00 2024-09-21T05:36:07.220 INFO:teuthology.orchestra.run.smithi070.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 693 kB/s | 35 kB 00:00 2024-09-21T05:36:07.232 INFO:teuthology.orchestra.run.smithi116.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 335 kB/s | 14 kB 00:00 2024-09-21T05:36:07.257 INFO:teuthology.orchestra.run.smithi116.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-21T05:36:07.282 INFO:teuthology.orchestra.run.smithi116.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-21T05:36:07.289 INFO:teuthology.orchestra.run.smithi160.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-21T05:36:07.296 INFO:teuthology.orchestra.run.smithi070.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-21T05:36:07.308 INFO:teuthology.orchestra.run.smithi116.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-21T05:36:07.321 INFO:teuthology.orchestra.run.smithi070.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-09-21T05:36:07.333 INFO:teuthology.orchestra.run.smithi116.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T05:36:07.346 INFO:teuthology.orchestra.run.smithi070.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-21T05:36:07.363 INFO:teuthology.orchestra.run.smithi070.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.8 MB/s | 77 kB 00:00 2024-09-21T05:36:07.380 INFO:teuthology.orchestra.run.smithi070.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 42 kB 00:00 2024-09-21T05:36:07.400 INFO:teuthology.orchestra.run.smithi116.stdout:(123/157): libarrow-9.0.0-11.el9.x86_64.rpm 8.8 MB/s | 4.4 MB 00:00 2024-09-21T05:36:07.405 INFO:teuthology.orchestra.run.smithi070.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 6.3 MB/s | 269 kB 00:00 2024-09-21T05:36:07.425 INFO:teuthology.orchestra.run.smithi116.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-21T05:36:07.431 INFO:teuthology.orchestra.run.smithi070.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-21T05:36:07.456 INFO:teuthology.orchestra.run.smithi070.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-21T05:36:07.467 INFO:teuthology.orchestra.run.smithi116.stdout:(125/157): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-09-21T05:36:07.481 INFO:teuthology.orchestra.run.smithi070.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T05:36:07.492 INFO:teuthology.orchestra.run.smithi116.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 264 kB/s | 18 kB 00:00 2024-09-21T05:36:07.507 INFO:teuthology.orchestra.run.smithi070.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T05:36:07.518 INFO:teuthology.orchestra.run.smithi116.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-21T05:36:07.543 INFO:teuthology.orchestra.run.smithi116.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-21T05:36:07.568 INFO:teuthology.orchestra.run.smithi116.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-21T05:36:07.590 INFO:teuthology.orchestra.run.smithi070.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-09-21T05:36:07.594 INFO:teuthology.orchestra.run.smithi116.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T05:36:07.616 INFO:teuthology.orchestra.run.smithi070.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 383 kB/s | 42 kB 00:00 2024-09-21T05:36:07.619 INFO:teuthology.orchestra.run.smithi116.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T05:36:07.641 INFO:teuthology.orchestra.run.smithi070.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 884 kB/s | 44 kB 00:00 2024-09-21T05:36:07.644 INFO:teuthology.orchestra.run.smithi116.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T05:36:07.666 INFO:teuthology.orchestra.run.smithi070.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-21T05:36:07.678 INFO:teuthology.orchestra.run.smithi116.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-21T05:36:07.692 INFO:teuthology.orchestra.run.smithi070.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 716 kB/s | 36 kB 00:00 2024-09-21T05:36:07.703 INFO:teuthology.orchestra.run.smithi116.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 665 kB/s | 16 kB 00:00 2024-09-21T05:36:07.717 INFO:teuthology.orchestra.run.smithi070.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-09-21T05:36:07.736 INFO:teuthology.orchestra.run.smithi116.stdout:(135/157): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-09-21T05:36:07.742 INFO:teuthology.orchestra.run.smithi070.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 6.0 MB/s | 304 kB 00:00 2024-09-21T05:36:07.762 INFO:teuthology.orchestra.run.smithi116.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T05:36:07.767 INFO:teuthology.orchestra.run.smithi070.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T05:36:07.787 INFO:teuthology.orchestra.run.smithi116.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-09-21T05:36:07.792 INFO:teuthology.orchestra.run.smithi070.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-21T05:36:07.812 INFO:teuthology.orchestra.run.smithi116.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-21T05:36:07.818 INFO:teuthology.orchestra.run.smithi070.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T05:36:07.829 INFO:teuthology.orchestra.run.smithi116.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-21T05:36:07.846 INFO:teuthology.orchestra.run.smithi116.stdout:(140/157): python3-tempora-5.0.0-2.el9.noarch.r 2.1 MB/s | 36 kB 00:00 2024-09-21T05:36:07.860 INFO:teuthology.orchestra.run.smithi070.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 669 kB/s | 45 kB 00:00 2024-09-21T05:36:07.871 INFO:teuthology.orchestra.run.smithi116.stdout:(141/157): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-09-21T05:36:07.897 INFO:teuthology.orchestra.run.smithi116.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T05:36:07.922 INFO:teuthology.orchestra.run.smithi116.stdout:(143/157): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-21T05:36:07.964 INFO:teuthology.orchestra.run.smithi116.stdout:(144/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.1 MB/s | 2.0 MB 00:00 2024-09-21T05:36:07.989 INFO:teuthology.orchestra.run.smithi116.stdout:(145/157): python3-websocket-client-1.2.3-2.el9 973 kB/s | 90 kB 00:00 2024-09-21T05:36:08.015 INFO:teuthology.orchestra.run.smithi116.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-21T05:36:08.049 INFO:teuthology.orchestra.run.smithi116.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-21T05:36:08.074 INFO:teuthology.orchestra.run.smithi116.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-21T05:36:08.085 INFO:teuthology.orchestra.run.smithi070.stdout:(104/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-21T05:36:08.116 INFO:teuthology.orchestra.run.smithi116.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T05:36:08.135 INFO:teuthology.orchestra.run.smithi070.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T05:36:08.169 INFO:teuthology.orchestra.run.smithi070.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-21T05:36:08.194 INFO:teuthology.orchestra.run.smithi070.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 776 kB/s | 19 kB 00:00 2024-09-21T05:36:08.299 INFO:teuthology.orchestra.run.smithi116.stdout:(150/157): NetworkManager-1.51.0-1.el9.x86_64.r 13 MB/s | 2.3 MB 00:00 2024-09-21T05:36:08.303 INFO:teuthology.orchestra.run.smithi070.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-21T05:36:08.328 INFO:teuthology.orchestra.run.smithi070.stdout:(109/157): lua-devel-5.4.4-4.el9.x86_64.rpm 44 kB/s | 22 kB 00:00 2024-09-21T05:36:08.367 INFO:teuthology.orchestra.run.smithi116.stdout:(151/157): NetworkManager-libnm-1.51.0-1.el9.x8 27 MB/s | 1.8 MB 00:00 2024-09-21T05:36:08.403 INFO:teuthology.orchestra.run.smithi070.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 260 kB/s | 26 kB 00:00 2024-09-21T05:36:08.416 INFO:teuthology.orchestra.run.smithi116.stdout:(152/157): librbd1-19.3.0-5120.g18432218.el9.x8 9.2 MB/s | 3.2 MB 00:00 2024-09-21T05:36:08.429 INFO:teuthology.orchestra.run.smithi070.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.8 MB/s | 67 kB 00:00 2024-09-21T05:36:08.443 INFO:teuthology.orchestra.run.smithi116.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 545 kB/s | 41 kB 00:00 2024-09-21T05:36:08.454 INFO:teuthology.orchestra.run.smithi070.stdout:(112/157): liboath-2.6.7-2.el9.x86_64.rpm 387 kB/s | 49 kB 00:00 2024-09-21T05:36:08.479 INFO:teuthology.orchestra.run.smithi070.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-21T05:36:08.513 INFO:teuthology.orchestra.run.smithi070.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-21T05:36:08.513 INFO:teuthology.orchestra.run.smithi116.stdout:(154/157): librados2-19.3.0-5120.g18432218.el9. 7.3 MB/s | 3.4 MB 00:00 2024-09-21T05:36:08.538 INFO:teuthology.orchestra.run.smithi070.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T05:36:08.550 INFO:teuthology.orchestra.run.smithi116.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-09-21T05:36:08.572 INFO:teuthology.orchestra.run.smithi070.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 962 kB/s | 32 kB 00:00 2024-09-21T05:36:08.576 INFO:teuthology.orchestra.run.smithi116.stdout:(156/157): NetworkManager-tui-1.51.0-1.el9.x86_ 1.5 MB/s | 249 kB 00:00 2024-09-21T05:36:08.605 INFO:teuthology.orchestra.run.smithi070.stdout:(117/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.4 MB/s | 839 kB 00:00 2024-09-21T05:36:08.622 INFO:teuthology.orchestra.run.smithi070.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-21T05:36:08.648 INFO:teuthology.orchestra.run.smithi070.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-21T05:36:08.673 INFO:teuthology.orchestra.run.smithi070.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-21T05:36:08.698 INFO:teuthology.orchestra.run.smithi070.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-21T05:36:08.724 INFO:teuthology.orchestra.run.smithi070.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T05:36:08.742 INFO:teuthology.orchestra.run.smithi116.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 10 MB/s | 2.4 MB 00:00 2024-09-21T05:36:08.748 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-21T05:36:08.748 INFO:teuthology.orchestra.run.smithi116.stdout:Total 23 MB/s | 228 MB 00:09 2024-09-21T05:36:08.749 INFO:teuthology.orchestra.run.smithi070.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-21T05:36:08.774 INFO:teuthology.orchestra.run.smithi070.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 426 kB/s | 11 kB 00:00 2024-09-21T05:36:08.799 INFO:teuthology.orchestra.run.smithi070.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 711 kB/s | 18 kB 00:00 2024-09-21T05:36:08.825 INFO:teuthology.orchestra.run.smithi070.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 926 kB/s | 23 kB 00:00 2024-09-21T05:36:08.850 INFO:teuthology.orchestra.run.smithi070.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 775 kB/s | 19 kB 00:00 2024-09-21T05:36:08.876 INFO:teuthology.orchestra.run.smithi070.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 795 kB/s | 20 kB 00:00 2024-09-21T05:36:08.901 INFO:teuthology.orchestra.run.smithi070.stdout:(129/157): protobuf-compiler-3.14.0-13.el9.x86_ 830 kB/s | 863 kB 00:01 2024-09-21T05:36:08.959 INFO:teuthology.orchestra.run.smithi070.stdout:(130/157): python3-grpcio-1.46.7-10.el9.x86_64. 7.8 MB/s | 2.0 MB 00:00 2024-09-21T05:36:08.985 INFO:teuthology.orchestra.run.smithi070.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.3 MB/s | 79 kB 00:00 2024-09-21T05:36:09.010 INFO:teuthology.orchestra.run.smithi070.stdout:(132/157): python3-logutils-0.3.5-21.el9.noarch 425 kB/s | 46 kB 00:00 2024-09-21T05:36:09.035 INFO:teuthology.orchestra.run.smithi070.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-21T05:36:09.060 INFO:teuthology.orchestra.run.smithi070.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-21T05:36:09.086 INFO:teuthology.orchestra.run.smithi070.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-21T05:36:09.111 INFO:teuthology.orchestra.run.smithi070.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-21T05:36:09.136 INFO:teuthology.orchestra.run.smithi070.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-09-21T05:36:09.161 INFO:teuthology.orchestra.run.smithi070.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-21T05:36:09.195 INFO:teuthology.orchestra.run.smithi070.stdout:(139/157): python3-kubernetes-26.1.0-2.el9.noar 3.2 MB/s | 1.0 MB 00:00 2024-09-21T05:36:09.221 INFO:teuthology.orchestra.run.smithi070.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-09-21T05:36:09.246 INFO:teuthology.orchestra.run.smithi070.stdout:(141/157): python3-rsa-4.9-2.el9.noarch.rpm 705 kB/s | 59 kB 00:00 2024-09-21T05:36:09.271 INFO:teuthology.orchestra.run.smithi070.stdout:(142/157): python3-tempora-5.0.0-2.el9.noarch.r 473 kB/s | 36 kB 00:00 2024-09-21T05:36:09.296 INFO:teuthology.orchestra.run.smithi070.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 989 kB/s | 74 kB 00:00 2024-09-21T05:36:09.322 INFO:teuthology.orchestra.run.smithi070.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-21T05:36:09.355 INFO:teuthology.orchestra.run.smithi070.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-21T05:36:09.381 INFO:teuthology.orchestra.run.smithi070.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 340 kB/s | 20 kB 00:00 2024-09-21T05:36:09.406 INFO:teuthology.orchestra.run.smithi070.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T05:36:09.439 INFO:teuthology.orchestra.run.smithi070.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-21T05:36:09.490 INFO:teuthology.orchestra.run.smithi070.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-21T05:36:09.732 INFO:teuthology.orchestra.run.smithi070.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 10 MB/s | 3.4 MB 00:00 2024-09-21T05:36:09.840 INFO:teuthology.orchestra.run.smithi070.stdout:(151/157): NetworkManager-1.51.0-1.el9.x86_64.r 6.8 MB/s | 2.3 MB 00:00 2024-09-21T05:36:09.932 INFO:teuthology.orchestra.run.smithi070.stdout:(152/157): librbd1-19.3.0-5120.g18432218.el9.x8 6.4 MB/s | 3.2 MB 00:00 2024-09-21T05:36:09.957 INFO:teuthology.orchestra.run.smithi070.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 350 kB/s | 41 kB 00:00 2024-09-21T05:36:09.973 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-21T05:36:10.066 INFO:teuthology.orchestra.run.smithi070.stdout:(154/157): openssl-3.2.2-6.el9.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-09-21T05:36:10.125 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-21T05:36:10.125 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-21T05:36:10.183 INFO:teuthology.orchestra.run.smithi070.stdout:(155/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 21 MB/s | 2.4 MB 00:00 2024-09-21T05:36:10.208 INFO:teuthology.orchestra.run.smithi070.stdout:(156/157): NetworkManager-tui-1.51.0-1.el9.x86_ 904 kB/s | 249 kB 00:00 2024-09-21T05:36:10.253 INFO:teuthology.orchestra.run.smithi070.stdout:(157/157): NetworkManager-libnm-1.51.0-1.el9.x8 3.5 MB/s | 1.8 MB 00:00 2024-09-21T05:36:10.266 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-21T05:36:10.266 INFO:teuthology.orchestra.run.smithi070.stdout:Total 22 MB/s | 228 MB 00:10 2024-09-21T05:36:11.443 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-21T05:36:11.594 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-21T05:36:11.594 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-21T05:36:12.341 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-21T05:36:12.341 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-21T05:36:12.645 INFO:teuthology.orchestra.run.smithi160.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-09-21T05:36:13.807 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-21T05:36:13.808 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-21T05:36:14.863 INFO:teuthology.orchestra.run.smithi160.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T05:36:14.864 INFO:teuthology.orchestra.run.smithi160.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T05:36:14.875 INFO:teuthology.orchestra.run.smithi160.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T05:36:14.875 INFO:teuthology.orchestra.run.smithi160.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T05:36:14.876 INFO:teuthology.orchestra.run.smithi160.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T05:36:14.877 INFO:teuthology.orchestra.run.smithi160.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T05:36:14.879 INFO:teuthology.orchestra.run.smithi160.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T05:36:14.881 INFO:teuthology.orchestra.run.smithi160.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T05:36:14.882 INFO:teuthology.orchestra.run.smithi160.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T05:36:14.945 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-21T05:36:14.971 INFO:teuthology.orchestra.run.smithi160.stdout:======================================================================================= 2024-09-21T05:36:14.971 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-09-21T05:36:14.971 INFO:teuthology.orchestra.run.smithi160.stdout:======================================================================================= 2024-09-21T05:36:14.971 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-09-21T05:36:14.972 INFO:teuthology.orchestra.run.smithi160.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T05:36:14.972 INFO:teuthology.orchestra.run.smithi160.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T05:36:14.972 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T05:36:14.972 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T05:36:14.972 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T05:36:14.972 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T05:36:14.972 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T05:36:14.972 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T05:36:14.972 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T05:36:14.972 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T05:36:14.972 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T05:36:14.972 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T05:36:14.972 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T05:36:14.972 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T05:36:14.973 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T05:36:14.973 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T05:36:14.973 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T05:36:14.973 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T05:36:14.973 INFO:teuthology.orchestra.run.smithi160.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T05:36:14.973 INFO:teuthology.orchestra.run.smithi160.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T05:36:14.973 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T05:36:14.973 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T05:36:14.973 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T05:36:14.973 INFO:teuthology.orchestra.run.smithi160.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T05:36:14.973 INFO:teuthology.orchestra.run.smithi160.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T05:36:14.973 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T05:36:14.973 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T05:36:14.973 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T05:36:14.973 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T05:36:14.974 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T05:36:14.974 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T05:36:14.974 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T05:36:14.974 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T05:36:14.974 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T05:36:14.974 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T05:36:14.974 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T05:36:14.974 INFO:teuthology.orchestra.run.smithi160.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T05:36:14.974 INFO:teuthology.orchestra.run.smithi160.stdout:Upgrading: 2024-09-21T05:36:14.974 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T05:36:14.974 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T05:36:14.974 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T05:36:14.974 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T05:36:14.974 INFO:teuthology.orchestra.run.smithi160.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T05:36:14.975 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T05:36:14.975 INFO:teuthology.orchestra.run.smithi160.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T05:36:14.975 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T05:36:14.975 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-09-21T05:36:14.975 INFO:teuthology.orchestra.run.smithi160.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T05:36:14.975 INFO:teuthology.orchestra.run.smithi160.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T05:36:14.975 INFO:teuthology.orchestra.run.smithi160.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T05:36:14.975 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T05:36:14.975 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T05:36:14.975 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T05:36:14.975 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T05:36:14.975 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T05:36:14.975 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T05:36:14.975 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T05:36:14.975 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T05:36:14.976 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T05:36:14.976 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T05:36:14.976 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T05:36:14.976 INFO:teuthology.orchestra.run.smithi160.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T05:36:14.976 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T05:36:14.976 INFO:teuthology.orchestra.run.smithi160.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T05:36:14.976 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T05:36:14.976 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T05:36:14.976 INFO:teuthology.orchestra.run.smithi160.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T05:36:14.976 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T05:36:14.976 INFO:teuthology.orchestra.run.smithi160.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T05:36:14.976 INFO:teuthology.orchestra.run.smithi160.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T05:36:14.976 INFO:teuthology.orchestra.run.smithi160.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T05:36:14.976 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T05:36:14.976 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T05:36:14.977 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T05:36:14.977 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T05:36:14.977 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T05:36:14.977 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T05:36:14.977 INFO:teuthology.orchestra.run.smithi160.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T05:36:14.977 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T05:36:14.977 INFO:teuthology.orchestra.run.smithi160.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T05:36:14.977 INFO:teuthology.orchestra.run.smithi160.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T05:36:14.977 INFO:teuthology.orchestra.run.smithi160.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T05:36:14.977 INFO:teuthology.orchestra.run.smithi160.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T05:36:14.977 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T05:36:14.977 INFO:teuthology.orchestra.run.smithi160.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T05:36:14.977 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T05:36:14.977 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T05:36:14.977 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T05:36:14.978 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T05:36:14.978 INFO:teuthology.orchestra.run.smithi160.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T05:36:14.978 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T05:36:14.978 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T05:36:14.978 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T05:36:14.978 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T05:36:14.978 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T05:36:14.978 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T05:36:14.978 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T05:36:14.978 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T05:36:14.978 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T05:36:14.978 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T05:36:14.978 INFO:teuthology.orchestra.run.smithi160.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T05:36:14.978 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T05:36:14.979 INFO:teuthology.orchestra.run.smithi160.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T05:36:14.979 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T05:36:14.979 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T05:36:14.979 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T05:36:14.979 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T05:36:14.979 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T05:36:14.979 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T05:36:14.979 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T05:36:14.979 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T05:36:14.979 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T05:36:14.979 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T05:36:14.979 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T05:36:14.979 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T05:36:14.979 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T05:36:14.979 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T05:36:14.980 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T05:36:14.980 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T05:36:14.980 INFO:teuthology.orchestra.run.smithi160.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T05:36:14.980 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T05:36:14.980 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T05:36:14.980 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T05:36:14.980 INFO:teuthology.orchestra.run.smithi160.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T05:36:14.980 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T05:36:14.980 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T05:36:14.980 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T05:36:14.980 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T05:36:14.980 INFO:teuthology.orchestra.run.smithi160.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T05:36:14.980 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T05:36:14.980 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T05:36:14.981 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T05:36:14.981 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T05:36:14.981 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T05:36:14.981 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T05:36:14.981 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T05:36:14.981 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T05:36:14.981 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T05:36:14.981 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T05:36:14.981 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T05:36:14.981 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T05:36:14.981 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T05:36:14.981 INFO:teuthology.orchestra.run.smithi160.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T05:36:14.981 INFO:teuthology.orchestra.run.smithi160.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T05:36:14.981 INFO:teuthology.orchestra.run.smithi160.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T05:36:14.981 INFO:teuthology.orchestra.run.smithi160.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T05:36:14.982 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T05:36:14.982 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T05:36:14.982 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T05:36:14.982 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T05:36:14.982 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T05:36:14.982 INFO:teuthology.orchestra.run.smithi160.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T05:36:14.982 INFO:teuthology.orchestra.run.smithi160.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T05:36:14.982 INFO:teuthology.orchestra.run.smithi160.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T05:36:14.982 INFO:teuthology.orchestra.run.smithi160.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T05:36:14.982 INFO:teuthology.orchestra.run.smithi160.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T05:36:14.982 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T05:36:14.982 INFO:teuthology.orchestra.run.smithi160.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T05:36:14.982 INFO:teuthology.orchestra.run.smithi160.stdout:Installing weak dependencies: 2024-09-21T05:36:14.982 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T05:36:14.983 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-21T05:36:14.983 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-09-21T05:36:14.983 INFO:teuthology.orchestra.run.smithi160.stdout:======================================================================================= 2024-09-21T05:36:14.983 INFO:teuthology.orchestra.run.smithi160.stdout:Install 149 Packages 2024-09-21T05:36:14.983 INFO:teuthology.orchestra.run.smithi160.stdout:Upgrade 8 Packages 2024-09-21T05:36:14.983 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-21T05:36:14.983 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 228 M 2024-09-21T05:36:14.983 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-09-21T05:36:15.338 INFO:teuthology.orchestra.run.smithi160.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 49 kB/s | 6.6 kB 00:00 2024-09-21T05:36:15.513 INFO:teuthology.orchestra.run.smithi160.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.9 MB/s | 873 kB 00:00 2024-09-21T05:36:15.580 INFO:teuthology.orchestra.run.smithi160.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 2.2 MB/s | 148 kB 00:00 2024-09-21T05:36:15.755 INFO:teuthology.orchestra.run.smithi160.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 10 MB/s | 5.5 MB 00:00 2024-09-21T05:36:15.806 INFO:teuthology.orchestra.run.smithi160.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 10 MB/s | 2.3 MB 00:00 2024-09-21T05:36:15.881 INFO:teuthology.orchestra.run.smithi160.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 12 MB/s | 1.5 MB 00:00 2024-09-21T05:36:16.198 INFO:teuthology.orchestra.run.smithi160.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 13 MB/s | 5.0 MB 00:00 2024-09-21T05:36:16.407 INFO:teuthology.orchestra.run.smithi160.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 17 MB/s | 20 MB 00:01 2024-09-21T05:36:16.440 INFO:teuthology.orchestra.run.smithi160.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 761 kB/s | 25 kB 00:00 2024-09-21T05:36:16.832 INFO:teuthology.orchestra.run.smithi160.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 16 MB/s | 10 MB 00:00 2024-09-21T05:36:17.008 INFO:teuthology.orchestra.run.smithi160.stdout:(11/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 16 MB/s | 18 MB 00:01 2024-09-21T05:36:17.032 INFO:teuthology.orchestra.run.smithi160.stdout:(12/157): cephfs-mirror-19.3.0-5120.g18432218.e 1.1 MB/s | 226 kB 00:00 2024-09-21T05:36:17.050 INFO:teuthology.orchestra.run.smithi160.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 651 kB/s | 27 kB 00:00 2024-09-21T05:36:17.075 INFO:teuthology.orchestra.run.smithi160.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 757 kB/s | 32 kB 00:00 2024-09-21T05:36:17.117 INFO:teuthology.orchestra.run.smithi160.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 11 MB/s | 766 kB 00:00 2024-09-21T05:36:17.142 INFO:teuthology.orchestra.run.smithi160.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 2.3 MB/s | 158 kB 00:00 2024-09-21T05:36:17.167 INFO:teuthology.orchestra.run.smithi160.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T05:36:17.201 INFO:teuthology.orchestra.run.smithi160.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 8.4 MB/s | 507 kB 00:00 2024-09-21T05:36:17.251 INFO:teuthology.orchestra.run.smithi160.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 904 kB/s | 45 kB 00:00 2024-09-21T05:36:17.310 INFO:teuthology.orchestra.run.smithi160.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 2.5 MB/s | 148 kB 00:00 2024-09-21T05:36:17.385 INFO:teuthology.orchestra.run.smithi160.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 2.1 MB/s | 161 kB 00:00 2024-09-21T05:36:17.452 INFO:teuthology.orchestra.run.smithi160.stdout:(22/157): librgw2-19.3.0-5120.g18432218.el9.x86 19 MB/s | 5.3 MB 00:00 2024-09-21T05:36:17.486 INFO:teuthology.orchestra.run.smithi160.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 3.1 MB/s | 321 kB 00:00 2024-09-21T05:36:17.511 INFO:teuthology.orchestra.run.smithi160.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 5.1 MB/s | 307 kB 00:00 2024-09-21T05:36:17.536 INFO:teuthology.orchestra.run.smithi160.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T05:36:17.562 INFO:teuthology.orchestra.run.smithi160.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T05:36:17.620 INFO:teuthology.orchestra.run.smithi160.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.9 MB/s | 170 kB 00:00 2024-09-21T05:36:17.721 INFO:teuthology.orchestra.run.smithi160.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 17 MB/s | 3.1 MB 00:00 2024-09-21T05:36:17.746 INFO:teuthology.orchestra.run.smithi160.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 273 kB/s | 34 kB 00:00 2024-09-21T05:36:17.771 INFO:teuthology.orchestra.run.smithi160.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T05:36:18.238 INFO:teuthology.orchestra.run.smithi160.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 16 MB/s | 7.4 MB 00:00 2024-09-21T05:36:18.305 INFO:teuthology.orchestra.run.smithi160.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 4.3 MB/s | 292 kB 00:00 2024-09-21T05:36:18.664 INFO:teuthology.orchestra.run.smithi160.stdout:(33/157): ceph-test-19.3.0-5120.g18432218.el9.x 18 MB/s | 40 MB 00:02 2024-09-21T05:36:18.689 INFO:teuthology.orchestra.run.smithi160.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 128 kB/s | 49 kB 00:00 2024-09-21T05:36:18.696 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-21T05:36:18.714 INFO:teuthology.orchestra.run.smithi160.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 330 kB/s | 16 kB 00:00 2024-09-21T05:36:18.740 INFO:teuthology.orchestra.run.smithi160.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 5.5 MB/s | 285 kB 00:00 2024-09-21T05:36:18.805 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T05:36:18.843 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T05:36:18.897 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T05:36:18.898 INFO:teuthology.orchestra.run.smithi160.stdout:(37/157): ceph-mgr-dashboard-19.3.0-5120.g18432 12 MB/s | 14 MB 00:01 2024-09-21T05:36:18.915 INFO:teuthology.orchestra.run.smithi160.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 105 kB/s | 18 kB 00:00 2024-09-21T05:36:18.938 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T05:36:18.940 INFO:teuthology.orchestra.run.smithi160.stdout:(39/157): cephadm-19.3.0-5120.g18432218.el9.noa 3.4 MB/s | 784 kB 00:00 2024-09-21T05:36:18.964 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T05:36:19.028 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T05:36:19.049 INFO:teuthology.orchestra.run.smithi160.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 531 kB/s | 80 kB 00:00 2024-09-21T05:36:19.075 INFO:teuthology.orchestra.run.smithi160.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-21T05:36:19.116 INFO:teuthology.orchestra.run.smithi160.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.9 MB/s | 801 kB 00:00 2024-09-21T05:36:19.150 INFO:teuthology.orchestra.run.smithi160.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 253 kB 00:00 2024-09-21T05:36:19.193 INFO:teuthology.orchestra.run.smithi160.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-09-21T05:36:19.217 INFO:teuthology.orchestra.run.smithi160.stdout:(45/157): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2024-09-21T05:36:19.284 INFO:teuthology.orchestra.run.smithi160.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-09-21T05:36:19.309 INFO:teuthology.orchestra.run.smithi160.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-21T05:36:19.374 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T05:36:19.459 INFO:teuthology.orchestra.run.smithi160.stdout:(48/157): python3-pycparser-2.20-6.el9.noarch.r 437 kB/s | 135 kB 00:00 2024-09-21T05:36:19.490 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:36:19.577 INFO:teuthology.orchestra.run.smithi160.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 2.3 MB/s | 689 kB 00:00 2024-09-21T05:36:19.610 INFO:teuthology.orchestra.run.smithi160.stdout:(50/157): bison-3.7.4-5.el9.x86_64.rpm 3.1 MB/s | 943 kB 00:00 2024-09-21T05:36:19.615 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:36:19.635 INFO:teuthology.orchestra.run.smithi160.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 371 kB/s | 22 kB 00:00 2024-09-21T05:36:19.649 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:36:19.661 INFO:teuthology.orchestra.run.smithi160.stdout:(52/157): boost-program-options-1.75.0-8.el9.x8 532 kB/s | 107 kB 00:00 2024-09-21T05:36:19.695 INFO:teuthology.orchestra.run.smithi160.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 3.6 MB/s | 313 kB 00:00 2024-09-21T05:36:19.720 INFO:teuthology.orchestra.run.smithi160.stdout:(54/157): flexiblas-3.0.4-8.el9.x86_64.rpm 390 kB/s | 33 kB 00:00 2024-09-21T05:36:19.740 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:36:19.770 INFO:teuthology.orchestra.run.smithi160.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 242 kB/s | 18 kB 00:00 2024-09-21T05:36:19.771 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T05:36:19.801 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T05:36:19.803 INFO:teuthology.orchestra.run.smithi160.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 133 kB/s | 11 kB 00:00 2024-09-21T05:36:19.837 INFO:teuthology.orchestra.run.smithi160.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.5 MB/s | 171 kB 00:00 2024-09-21T05:36:19.871 INFO:teuthology.orchestra.run.smithi160.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-21T05:36:19.904 INFO:teuthology.orchestra.run.smithi160.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 676 kB/s | 45 kB 00:00 2024-09-21T05:36:19.955 INFO:teuthology.orchestra.run.smithi160.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-09-21T05:36:19.970 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T05:36:19.996 INFO:teuthology.orchestra.run.smithi160.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 6.2 MB/s | 581 kB 00:00 2024-09-21T05:36:20.026 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T05:36:20.030 INFO:teuthology.orchestra.run.smithi160.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 326 kB/s | 24 kB 00:00 2024-09-21T05:36:20.055 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T05:36:20.080 INFO:teuthology.orchestra.run.smithi160.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 567 kB/s | 47 kB 00:00 2024-09-21T05:36:20.122 INFO:teuthology.orchestra.run.smithi160.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-21T05:36:20.127 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-21T05:36:20.160 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T05:36:20.181 INFO:teuthology.orchestra.run.smithi160.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-21T05:36:20.189 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T05:36:20.223 INFO:teuthology.orchestra.run.smithi160.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 384 kB/s | 38 kB 00:00 2024-09-21T05:36:20.231 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T05:36:20.253 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T05:36:20.282 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T05:36:20.293 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T05:36:20.307 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T05:36:20.490 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T05:36:20.515 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T05:36:20.540 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T05:36:20.582 INFO:teuthology.orchestra.run.smithi160.stdout:(67/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-21T05:36:20.582 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T05:36:20.646 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T05:36:20.648 INFO:teuthology.orchestra.run.smithi160.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 11 MB/s | 4.9 MB 00:00 2024-09-21T05:36:20.685 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T05:36:20.698 INFO:teuthology.orchestra.run.smithi160.stdout:(69/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.9 MB/s | 3.0 MB 00:01 2024-09-21T05:36:20.761 INFO:teuthology.orchestra.run.smithi160.stdout:(70/157): postgresql-13.16-1.el9.x86_64.rpm 8.8 MB/s | 1.6 MB 00:00 2024-09-21T05:36:20.799 INFO:teuthology.orchestra.run.smithi160.stdout:(71/157): postgresql-contrib-13.16-1.el9.x86_64 5.9 MB/s | 910 kB 00:00 2024-09-21T05:36:20.813 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T05:36:20.824 INFO:teuthology.orchestra.run.smithi160.stdout:(72/157): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-21T05:36:20.883 INFO:teuthology.orchestra.run.smithi160.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-21T05:36:20.917 INFO:teuthology.orchestra.run.smithi160.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 8.6 MB/s | 1.0 MB 00:00 2024-09-21T05:36:20.936 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:36:20.975 INFO:teuthology.orchestra.run.smithi160.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-21T05:36:21.006 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:36:21.059 INFO:teuthology.orchestra.run.smithi160.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 19 MB/s | 5.8 MB 00:00 2024-09-21T05:36:21.084 INFO:teuthology.orchestra.run.smithi160.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-21T05:36:21.095 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T05:36:21.118 INFO:teuthology.orchestra.run.smithi160.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-21T05:36:21.143 INFO:teuthology.orchestra.run.smithi160.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 438 kB/s | 26 kB 00:00 2024-09-21T05:36:21.177 INFO:teuthology.orchestra.run.smithi160.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 327 kB/s | 19 kB 00:00 2024-09-21T05:36:21.208 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:36:21.210 INFO:teuthology.orchestra.run.smithi160.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-09-21T05:36:21.236 INFO:teuthology.orchestra.run.smithi160.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 594 kB/s | 35 kB 00:00 2024-09-21T05:36:21.239 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:36:21.294 INFO:teuthology.orchestra.run.smithi160.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-21T05:36:21.335 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:36:21.347 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T05:36:21.361 INFO:teuthology.orchestra.run.smithi160.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-09-21T05:36:21.368 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:36:21.385 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T05:36:21.419 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T05:36:21.428 INFO:teuthology.orchestra.run.smithi160.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-09-21T05:36:21.459 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:36:21.493 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T05:36:21.497 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T05:36:21.503 INFO:teuthology.orchestra.run.smithi160.stdout:(86/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 17 MB/s | 5.1 MB 00:00 2024-09-21T05:36:21.527 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T05:36:21.529 INFO:teuthology.orchestra.run.smithi160.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 421 kB/s | 42 kB 00:00 2024-09-21T05:36:21.536 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T05:36:21.569 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T05:36:21.570 INFO:teuthology.orchestra.run.smithi160.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-09-21T05:36:21.612 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T05:36:21.646 INFO:teuthology.orchestra.run.smithi160.stdout:(89/157): python3-babel-2.9.1-2.el9.noarch.rpm 7.8 MB/s | 6.0 MB 00:00 2024-09-21T05:36:21.646 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T05:36:21.671 INFO:teuthology.orchestra.run.smithi160.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-09-21T05:36:21.673 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T05:36:21.692 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T05:36:21.705 INFO:teuthology.orchestra.run.smithi160.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.0 MB/s | 279 kB 00:00 2024-09-21T05:36:21.730 INFO:teuthology.orchestra.run.smithi160.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 609 kB/s | 51 kB 00:00 2024-09-21T05:36:21.741 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T05:36:21.745 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T05:36:21.755 INFO:teuthology.orchestra.run.smithi160.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 640 kB/s | 54 kB 00:00 2024-09-21T05:36:21.773 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T05:36:21.794 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T05:36:21.822 INFO:teuthology.orchestra.run.smithi160.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 626 kB/s | 42 kB 00:00 2024-09-21T05:36:21.826 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T05:36:21.847 INFO:teuthology.orchestra.run.smithi160.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 481 kB/s | 44 kB 00:00 2024-09-21T05:36:21.869 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T05:36:21.882 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T05:36:21.889 INFO:teuthology.orchestra.run.smithi160.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-21T05:36:21.908 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T05:36:21.915 INFO:teuthology.orchestra.run.smithi160.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 535 kB/s | 36 kB 00:00 2024-09-21T05:36:21.950 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T05:36:21.957 INFO:teuthology.orchestra.run.smithi160.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 705 kB/s | 47 kB 00:00 2024-09-21T05:36:21.958 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T05:36:21.980 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T05:36:21.984 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T05:36:21.998 INFO:teuthology.orchestra.run.smithi160.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 3.6 MB/s | 304 kB 00:00 2024-09-21T05:36:22.004 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T05:36:22.024 INFO:teuthology.orchestra.run.smithi160.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 862 kB/s | 58 kB 00:00 2024-09-21T05:36:22.033 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T05:36:22.058 INFO:teuthology.orchestra.run.smithi160.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-21T05:36:22.060 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T05:36:22.083 INFO:teuthology.orchestra.run.smithi160.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-21T05:36:22.117 INFO:teuthology.orchestra.run.smithi160.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 763 kB/s | 45 kB 00:00 2024-09-21T05:36:22.130 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T05:36:22.174 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T05:36:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T05:36:22.248 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T05:36:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T05:36:22.388 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T05:36:22.443 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T05:36:22.475 INFO:teuthology.orchestra.run.smithi160.stdout:(104/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-09-21T05:36:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T05:36:22.542 INFO:teuthology.orchestra.run.smithi160.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 10 MB/s | 548 kB 00:00 2024-09-21T05:36:22.567 INFO:teuthology.orchestra.run.smithi160.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 12 MB/s | 308 kB 00:00 2024-09-21T05:36:22.592 INFO:teuthology.orchestra.run.smithi160.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 818 kB/s | 19 kB 00:00 2024-09-21T05:36:22.618 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:36:22.684 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:36:22.718 INFO:teuthology.orchestra.run.smithi160.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-09-21T05:36:22.743 INFO:teuthology.orchestra.run.smithi160.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T05:36:22.768 INFO:teuthology.orchestra.run.smithi160.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T05:36:22.793 INFO:teuthology.orchestra.run.smithi160.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T05:36:22.819 INFO:teuthology.orchestra.run.smithi160.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-21T05:36:22.835 INFO:teuthology.orchestra.run.smithi160.stdout:(113/157): lua-devel-5.4.4-4.el9.x86_64.rpm 30 kB/s | 22 kB 00:00 2024-09-21T05:36:22.878 INFO:teuthology.orchestra.run.smithi160.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-21T05:36:22.894 INFO:teuthology.orchestra.run.smithi160.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.9 MB/s | 43 kB 00:00 2024-09-21T05:36:22.911 INFO:teuthology.orchestra.run.smithi160.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-21T05:36:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:36:22.928 INFO:teuthology.orchestra.run.smithi160.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 848 kB/s | 14 kB 00:00 2024-09-21T05:36:22.954 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T05:36:22.962 INFO:teuthology.orchestra.run.smithi160.stdout:(118/157): python3-asyncssh-2.13.2-5.el9.noarch 4.2 MB/s | 548 kB 00:00 2024-09-21T05:36:22.987 INFO:teuthology.orchestra.run.smithi160.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-21T05:36:23.013 INFO:teuthology.orchestra.run.smithi160.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.9 MB/s | 358 kB 00:00 2024-09-21T05:36:23.025 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T05:36:23.038 INFO:teuthology.orchestra.run.smithi160.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-21T05:36:23.047 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T05:36:23.055 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T05:36:23.072 INFO:teuthology.orchestra.run.smithi160.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-21T05:36:23.076 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T05:36:23.089 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T05:36:23.105 INFO:teuthology.orchestra.run.smithi160.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-21T05:36:23.111 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T05:36:23.130 INFO:teuthology.orchestra.run.smithi160.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-21T05:36:23.149 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T05:36:23.156 INFO:teuthology.orchestra.run.smithi160.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 708 kB/s | 18 kB 00:00 2024-09-21T05:36:23.163 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T05:36:23.181 INFO:teuthology.orchestra.run.smithi160.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 935 kB/s | 23 kB 00:00 2024-09-21T05:36:23.192 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T05:36:23.206 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T05:36:23.215 INFO:teuthology.orchestra.run.smithi160.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 580 kB/s | 19 kB 00:00 2024-09-21T05:36:23.239 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T05:36:23.240 INFO:teuthology.orchestra.run.smithi160.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 785 kB/s | 20 kB 00:00 2024-09-21T05:36:23.274 INFO:teuthology.orchestra.run.smithi160.stdout:(129/157): protobuf-compiler-3.14.0-13.el9.x86_ 746 kB/s | 863 kB 00:01 2024-09-21T05:36:23.282 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T05:36:23.316 INFO:teuthology.orchestra.run.smithi160.stdout:(130/157): python3-grpcio-1.46.7-10.el9.x86_64. 7.3 MB/s | 2.0 MB 00:00 2024-09-21T05:36:23.316 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T05:36:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T05:36:23.349 INFO:teuthology.orchestra.run.smithi160.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.0 MB/s | 79 kB 00:00 2024-09-21T05:36:23.356 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T05:36:23.375 INFO:teuthology.orchestra.run.smithi160.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.4 MB/s | 58 kB 00:00 2024-09-21T05:36:23.400 INFO:teuthology.orchestra.run.smithi160.stdout:(133/157): python3-logutils-0.3.5-21.el9.noarch 368 kB/s | 46 kB 00:00 2024-09-21T05:36:23.401 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T05:36:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T05:36:23.425 INFO:teuthology.orchestra.run.smithi160.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 658 kB/s | 16 kB 00:00 2024-09-21T05:36:23.450 INFO:teuthology.orchestra.run.smithi160.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-21T05:36:23.473 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T05:36:23.484 INFO:teuthology.orchestra.run.smithi160.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-09-21T05:36:23.492 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T05:36:23.509 INFO:teuthology.orchestra.run.smithi160.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 483 kB/s | 28 kB 00:00 2024-09-21T05:36:23.513 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T05:36:23.535 INFO:teuthology.orchestra.run.smithi160.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-21T05:36:23.557 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T05:36:23.560 INFO:teuthology.orchestra.run.smithi160.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T05:36:23.565 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T05:36:23.594 INFO:teuthology.orchestra.run.smithi160.stdout:(140/157): python3-kubernetes-26.1.0-2.el9.noar 2.9 MB/s | 1.0 MB 00:00 2024-09-21T05:36:23.627 INFO:teuthology.orchestra.run.smithi160.stdout:(141/157): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-09-21T05:36:23.637 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T05:36:23.638 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T05:36:23.652 INFO:teuthology.orchestra.run.smithi160.stdout:(142/157): python3-tempora-5.0.0-2.el9.noarch.r 389 kB/s | 36 kB 00:00 2024-09-21T05:36:23.668 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T05:36:23.670 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T05:36:23.677 INFO:teuthology.orchestra.run.smithi160.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 892 kB/s | 74 kB 00:00 2024-09-21T05:36:23.703 INFO:teuthology.orchestra.run.smithi160.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-21T05:36:23.706 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T05:36:23.728 INFO:teuthology.orchestra.run.smithi160.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T05:36:23.728 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T05:36:23.753 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T05:36:23.753 INFO:teuthology.orchestra.run.smithi160.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-21T05:36:23.756 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T05:36:23.779 INFO:teuthology.orchestra.run.smithi160.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T05:36:23.789 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T05:36:23.804 INFO:teuthology.orchestra.run.smithi160.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-21T05:36:23.826 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T05:36:23.831 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T05:36:23.871 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T05:36:23.896 INFO:teuthology.orchestra.run.smithi160.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-21T05:36:23.945 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T05:36:24.013 INFO:teuthology.orchestra.run.smithi160.stdout:(150/157): NetworkManager-1.51.0-1.el9.x86_64.r 20 MB/s | 2.3 MB 00:00 2024-09-21T05:36:24.072 INFO:teuthology.orchestra.run.smithi160.stdout:(151/157): librados2-19.3.0-5120.g18432218.el9. 12 MB/s | 3.4 MB 00:00 2024-09-21T05:36:24.085 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T05:36:24.100 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T05:36:24.121 INFO:teuthology.orchestra.run.smithi160.stdout:(152/157): librbd1-19.3.0-5120.g18432218.el9.x8 10 MB/s | 3.2 MB 00:00 2024-09-21T05:36:24.139 INFO:teuthology.orchestra.run.smithi160.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 613 kB/s | 41 kB 00:00 2024-09-21T05:36:24.148 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T05:36:24.180 INFO:teuthology.orchestra.run.smithi160.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 11 MB/s | 1.8 MB 00:00 2024-09-21T05:36:24.206 INFO:teuthology.orchestra.run.smithi160.stdout:(155/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.9 MB/s | 249 kB 00:00 2024-09-21T05:36:24.256 INFO:teuthology.orchestra.run.smithi160.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-09-21T05:36:24.278 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T05:36:24.306 INFO:teuthology.orchestra.run.smithi160.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 19 MB/s | 2.4 MB 00:00 2024-09-21T05:36:24.312 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-09-21T05:36:24.312 INFO:teuthology.orchestra.run.smithi160.stdout:Total 24 MB/s | 228 MB 00:09 2024-09-21T05:36:24.317 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T05:36:24.358 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T05:36:24.460 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T05:36:24.493 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T05:36:24.534 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T05:36:24.566 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T05:36:24.582 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T05:36:24.667 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T05:36:24.695 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T05:36:24.752 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T05:36:24.790 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T05:36:24.824 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T05:36:24.824 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T05:36:24.862 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T05:36:24.873 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T05:36:24.901 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T05:36:24.904 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T05:36:24.935 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T05:36:24.974 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T05:36:25.006 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T05:36:25.036 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T05:36:25.065 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T05:36:25.067 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T05:36:25.098 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T05:36:25.132 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T05:36:25.140 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T05:36:25.175 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T05:36:25.223 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T05:36:25.261 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T05:36:25.296 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T05:36:25.313 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T05:36:25.345 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T05:36:25.378 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T05:36:25.418 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T05:36:25.447 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T05:36:25.454 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T05:36:25.495 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T05:36:25.501 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T05:36:25.504 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-09-21T05:36:25.536 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T05:36:25.580 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T05:36:25.622 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T05:36:25.681 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-09-21T05:36:25.681 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-09-21T05:36:25.757 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T05:36:25.958 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T05:36:26.008 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T05:36:26.111 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T05:36:26.150 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T05:36:26.190 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T05:36:26.223 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T05:36:26.232 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T05:36:26.247 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T05:36:26.285 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T05:36:26.318 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T05:36:26.417 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T05:36:26.465 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T05:36:26.509 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T05:36:26.525 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T05:36:26.597 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T05:36:26.637 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T05:36:26.794 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T05:36:26.825 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T05:36:26.828 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T05:36:26.853 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T05:36:26.860 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T05:36:26.887 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T05:36:26.927 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T05:36:26.937 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T05:36:26.958 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T05:36:26.996 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T05:36:27.031 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T05:36:27.065 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T05:36:27.106 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T05:36:27.140 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T05:36:27.227 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T05:36:27.271 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T05:36:27.311 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T05:36:27.421 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T05:36:27.478 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T05:36:27.600 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T05:36:27.725 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T05:36:27.928 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-09-21T05:36:27.929 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-09-21T05:36:28.192 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T05:36:28.242 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T05:36:28.276 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T05:36:28.398 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T05:36:28.459 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T05:36:28.512 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T05:36:28.608 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T05:36:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T05:36:28.834 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T05:36:28.863 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T05:36:28.940 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T05:36:28.981 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T05:36:29.082 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T05:36:29.110 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T05:36:29.143 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T05:36:29.477 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T05:36:29.523 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T05:36:29.599 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T05:36:29.613 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T05:36:29.644 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T05:36:29.681 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T05:36:29.719 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T05:36:30.180 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T05:36:30.209 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T05:36:30.272 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T05:36:30.302 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T05:36:30.960 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T05:36:31.076 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T05:36:31.104 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T05:36:31.137 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T05:36:31.462 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T05:36:31.508 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T05:36:31.582 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T05:36:31.613 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T05:36:31.649 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T05:36:32.146 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T05:36:32.178 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T05:36:32.249 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T05:36:32.271 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T05:36:32.551 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:36:32.590 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:36:33.161 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:36:33.210 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T05:36:33.289 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T05:36:33.290 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T05:36:33.290 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T05:36:33.290 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-21T05:36:33.328 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T05:36:34.268 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-09-21T05:36:34.368 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T05:36:34.450 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T05:36:34.557 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:36:34.593 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:36:34.608 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T05:36:34.644 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T05:36:34.669 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T05:36:34.733 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T05:36:35.081 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T05:36:35.164 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:36:35.195 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:36:35.204 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T05:36:35.301 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T05:36:35.301 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T05:36:35.301 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T05:36:35.302 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:36:35.321 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:36:35.339 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T05:36:35.354 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:36:35.446 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:36:35.481 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T05:36:35.515 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T05:36:35.701 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T05:36:35.757 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T05:36:35.785 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T05:36:35.902 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T05:36:35.936 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T05:36:36.008 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T05:36:36.037 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T05:36:36.067 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T05:36:36.239 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T05:36:36.407 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T05:36:36.535 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T05:36:36.645 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:36:36.720 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:36:36.941 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:36:37.049 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T05:36:37.090 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T05:36:37.125 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T05:36:37.198 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T05:36:37.242 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T05:36:37.275 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T05:36:37.318 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T05:36:37.351 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T05:36:37.379 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T05:36:37.447 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T05:36:37.509 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T05:36:37.540 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T05:36:37.584 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T05:36:37.664 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T05:36:37.702 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T05:36:37.746 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T05:36:37.774 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T05:36:37.843 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T05:36:37.890 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T05:36:37.963 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T05:36:38.106 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T05:36:38.167 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T05:36:38.695 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T05:36:38.787 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T05:36:38.825 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T05:36:38.868 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T05:36:38.905 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T05:36:38.948 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T05:36:39.094 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T05:36:39.142 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T05:36:39.253 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T05:36:39.323 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T05:36:39.396 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T05:36:39.427 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T05:36:39.463 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T05:36:39.509 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T05:36:39.545 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T05:36:39.580 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T05:36:39.622 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T05:36:39.760 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T05:36:39.808 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T05:36:39.848 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T05:36:39.952 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T05:36:39.986 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T05:36:40.032 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T05:36:40.059 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T05:36:40.093 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T05:36:40.195 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T05:36:40.319 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T05:36:40.366 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T05:36:40.393 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T05:36:40.428 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T05:36:40.468 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T05:36:40.499 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T05:36:40.529 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T05:36:40.564 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T05:36:40.597 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T05:36:40.638 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T05:36:40.672 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T05:36:40.785 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T05:36:40.828 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T05:36:40.859 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T05:36:40.961 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T05:36:41.010 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T05:36:41.733 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T05:36:41.790 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T05:36:41.824 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T05:36:41.922 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T05:36:41.979 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T05:36:42.024 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T05:36:42.111 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T05:36:42.143 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T05:36:42.320 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T05:36:42.349 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T05:36:42.427 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T05:36:43.070 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T05:36:43.189 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T05:36:44.454 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T05:36:44.544 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T05:36:44.571 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T05:36:44.604 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T05:36:44.941 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T05:36:45.045 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T05:36:45.111 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T05:36:45.111 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /sys 2024-09-21T05:36:45.111 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /proc 2024-09-21T05:36:45.111 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /mnt 2024-09-21T05:36:45.111 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /var/tmp 2024-09-21T05:36:45.111 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /home 2024-09-21T05:36:45.111 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /root 2024-09-21T05:36:45.112 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /tmp 2024-09-21T05:36:45.112 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-21T05:36:45.136 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T05:36:45.166 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T05:36:45.202 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T05:36:45.281 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T05:36:45.297 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T05:36:45.298 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:36:45.298 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T05:36:45.298 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-21T05:36:45.703 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T05:36:45.747 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T05:36:45.802 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T05:36:45.832 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T05:36:46.883 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T05:36:46.910 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T05:36:46.910 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:36:46.910 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T05:36:46.911 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T05:36:46.911 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T05:36:46.911 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-21T05:36:47.142 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T05:36:47.166 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T05:36:47.166 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:36:47.166 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T05:36:47.166 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T05:36:47.166 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T05:36:47.166 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-21T05:36:47.249 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T05:36:47.249 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /sys 2024-09-21T05:36:47.249 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /proc 2024-09-21T05:36:47.250 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /mnt 2024-09-21T05:36:47.250 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /var/tmp 2024-09-21T05:36:47.250 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /home 2024-09-21T05:36:47.250 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /root 2024-09-21T05:36:47.250 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /tmp 2024-09-21T05:36:47.250 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:36:47.428 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T05:36:47.444 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T05:36:47.444 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:36:47.444 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T05:36:47.445 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:36:47.646 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T05:36:47.667 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T05:36:47.667 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:36:47.667 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T05:36:47.667 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T05:36:47.667 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T05:36:47.667 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-21T05:36:47.781 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T05:36:47.838 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T05:36:47.895 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T05:36:48.081 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T05:36:48.121 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:36:48.127 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T05:36:48.153 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:36:48.205 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T05:36:48.293 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T05:36:48.432 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T05:36:48.477 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T05:36:48.509 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T05:36:48.537 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T05:36:48.754 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:36:48.790 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T05:36:48.867 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T05:36:48.867 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T05:36:48.867 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T05:36:48.867 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-21T05:36:48.908 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T05:36:48.989 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T05:36:49.019 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T05:36:49.043 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T05:36:49.056 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T05:36:49.082 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T05:36:49.083 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:36:49.083 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T05:36:49.083 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T05:36:49.083 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T05:36:49.083 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:36:49.101 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T05:36:49.125 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T05:36:49.307 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T05:36:49.330 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T05:36:49.330 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:36:49.330 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T05:36:49.330 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T05:36:49.330 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T05:36:49.330 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:36:49.808 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T05:36:49.831 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T05:36:49.831 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:36:49.831 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T05:36:49.831 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T05:36:49.831 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T05:36:49.831 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:36:49.930 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T05:36:49.986 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T05:36:50.042 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T05:36:50.234 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T05:36:50.283 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T05:36:50.353 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T05:36:50.442 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T05:36:50.588 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T05:36:50.633 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T05:36:50.666 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T05:36:50.694 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T05:36:51.070 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T05:36:51.101 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T05:36:51.132 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T05:36:51.206 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T05:36:51.232 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T05:36:52.338 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T05:36:52.406 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T05:36:53.381 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T05:36:53.415 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T05:36:53.529 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T05:36:53.690 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T05:36:53.717 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T05:36:53.741 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T05:36:53.741 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:36:53.741 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T05:36:53.741 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T05:36:53.741 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T05:36:53.741 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-21T05:36:53.792 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T05:36:53.805 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T05:36:53.903 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T05:36:53.962 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T05:36:54.405 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T05:36:54.455 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T05:36:54.928 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T05:36:54.962 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T05:36:54.985 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T05:36:54.986 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:36:54.986 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T05:36:54.986 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T05:36:54.986 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T05:36:54.986 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-21T05:36:55.029 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T05:36:55.052 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T05:36:55.052 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:36:55.052 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T05:36:55.052 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-21T05:36:55.104 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T05:36:55.128 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T05:36:55.128 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:36:55.128 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T05:36:55.128 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T05:36:55.128 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T05:36:55.128 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-21T05:36:55.412 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T05:36:55.446 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T05:36:55.447 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T05:36:55.470 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T05:36:55.470 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:36:55.470 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T05:36:55.470 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T05:36:55.470 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T05:36:55.470 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-21T05:36:55.559 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T05:36:55.722 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T05:36:55.749 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T05:36:55.773 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T05:36:55.773 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:36:55.773 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T05:36:55.773 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T05:36:55.773 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T05:36:55.773 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:36:55.818 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T05:36:55.828 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T05:36:55.926 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T05:36:56.000 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T05:36:56.959 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T05:36:56.994 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T05:36:57.017 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T05:36:57.017 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:36:57.017 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T05:36:57.017 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T05:36:57.018 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T05:36:57.018 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:36:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T05:36:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T05:36:57.101 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:36:57.101 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T05:36:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:36:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T05:36:57.168 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T05:36:57.168 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:36:57.168 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T05:36:57.168 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T05:36:57.168 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T05:36:57.169 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:36:57.488 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T05:36:57.510 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T05:36:57.510 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:36:57.510 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T05:36:57.511 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T05:36:57.511 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T05:36:57.511 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:36:59.493 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T05:36:59.534 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T05:36:59.574 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T05:36:59.606 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T05:36:59.634 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T05:36:59.844 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T05:36:59.888 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T05:36:59.919 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T05:36:59.948 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T05:37:00.003 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T05:37:00.487 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T05:37:00.487 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /sys 2024-09-21T05:37:00.487 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /proc 2024-09-21T05:37:00.487 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /mnt 2024-09-21T05:37:00.487 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /var/tmp 2024-09-21T05:37:00.487 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /home 2024-09-21T05:37:00.487 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /root 2024-09-21T05:37:00.487 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /tmp 2024-09-21T05:37:00.487 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-21T05:37:00.594 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T05:37:00.626 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T05:37:00.646 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T05:37:00.659 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T05:37:00.678 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T05:37:00.678 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:37:00.678 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T05:37:00.678 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-21T05:37:01.479 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T05:37:01.547 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T05:37:01.563 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T05:37:01.591 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T05:37:01.608 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T05:37:01.632 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T05:37:01.664 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T05:37:01.691 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T05:37:01.695 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T05:37:01.725 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T05:37:01.750 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T05:37:01.784 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T05:37:01.784 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T05:37:01.877 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T05:37:01.877 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T05:37:01.909 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T05:37:01.961 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T05:37:01.963 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T05:37:01.994 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T05:37:01.994 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T05:37:01.999 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T05:37:02.000 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T05:37:02.024 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T05:37:02.070 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T05:37:02.188 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T05:37:02.188 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T05:37:02.271 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T05:37:02.271 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T05:37:02.297 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T05:37:02.297 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:37:02.297 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T05:37:02.297 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T05:37:02.297 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T05:37:02.298 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-21T05:37:02.337 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T05:37:02.538 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T05:37:02.561 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T05:37:02.561 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:37:02.561 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T05:37:02.561 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T05:37:02.561 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T05:37:02.561 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-21T05:37:02.638 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T05:37:02.676 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T05:37:02.696 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T05:37:03.039 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T05:37:03.062 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T05:37:03.062 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:37:03.062 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T05:37:03.062 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T05:37:03.062 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T05:37:03.062 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-21T05:37:03.161 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T05:37:03.217 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T05:37:03.273 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T05:37:03.459 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T05:37:03.506 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T05:37:03.523 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T05:37:03.585 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T05:37:03.598 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T05:37:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T05:37:03.673 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T05:37:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T05:37:03.776 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T05:37:03.802 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T05:37:03.813 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T05:37:03.836 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T05:37:03.836 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T05:37:03.856 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T05:37:03.888 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T05:37:03.915 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T05:37:03.928 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T05:37:03.928 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T05:37:04.012 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T05:37:04.037 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T05:37:04.042 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T05:37:04.042 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T05:37:04.223 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T05:37:04.223 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T05:37:04.307 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T05:37:04.381 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T05:37:04.385 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T05:37:04.414 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T05:37:04.439 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T05:37:04.496 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T05:37:04.521 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T05:37:07.709 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T05:37:07.760 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T05:37:08.703 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T05:37:08.703 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T05:37:08.703 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T05:37:08.703 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T05:37:08.703 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T05:37:08.703 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T05:37:08.703 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T05:37:08.703 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T05:37:08.703 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:37:08.703 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:37:08.703 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T05:37:08.703 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T05:37:08.704 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T05:37:08.704 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T05:37:08.704 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T05:37:08.704 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T05:37:08.704 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T05:37:08.704 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T05:37:08.704 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T05:37:08.704 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T05:37:08.704 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T05:37:08.704 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T05:37:08.704 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T05:37:08.704 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T05:37:08.704 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T05:37:08.704 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T05:37:08.704 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T05:37:08.705 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T05:37:08.705 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T05:37:08.705 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T05:37:08.715 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T05:37:08.715 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T05:37:08.716 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T05:37:08.716 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T05:37:08.716 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T05:37:08.716 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T05:37:08.716 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T05:37:08.716 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T05:37:08.716 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T05:37:08.716 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T05:37:08.716 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T05:37:08.716 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T05:37:08.716 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T05:37:08.716 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T05:37:08.716 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T05:37:08.717 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T05:37:08.717 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T05:37:08.717 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T05:37:08.717 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T05:37:08.717 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T05:37:08.717 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T05:37:08.717 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T05:37:08.717 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T05:37:08.717 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T05:37:08.717 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T05:37:08.717 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T05:37:08.717 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T05:37:08.717 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T05:37:08.717 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T05:37:08.717 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T05:37:08.718 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T05:37:08.718 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T05:37:08.718 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T05:37:08.718 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T05:37:08.718 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T05:37:08.718 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T05:37:08.718 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T05:37:08.718 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T05:37:08.718 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T05:37:08.718 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T05:37:08.718 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T05:37:08.718 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T05:37:08.718 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T05:37:08.719 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T05:37:08.719 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T05:37:08.719 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T05:37:08.719 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T05:37:08.719 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T05:37:08.719 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T05:37:08.719 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T05:37:08.719 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T05:37:08.719 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T05:37:08.719 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T05:37:08.719 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T05:37:08.719 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T05:37:08.719 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T05:37:08.719 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T05:37:08.719 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T05:37:08.720 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T05:37:08.720 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T05:37:08.720 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T05:37:08.720 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T05:37:08.720 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T05:37:08.720 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T05:37:08.720 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T05:37:08.720 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T05:37:08.720 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T05:37:08.720 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T05:37:08.720 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T05:37:08.720 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T05:37:08.720 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T05:37:08.720 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T05:37:08.720 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T05:37:08.721 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T05:37:08.721 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T05:37:08.721 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T05:37:08.721 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T05:37:08.721 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T05:37:08.721 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T05:37:08.721 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T05:37:08.721 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T05:37:08.721 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T05:37:08.721 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T05:37:08.721 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T05:37:08.721 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T05:37:08.721 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T05:37:08.721 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T05:37:08.721 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T05:37:08.722 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T05:37:08.722 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T05:37:08.722 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T05:37:08.722 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T05:37:08.722 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T05:37:08.722 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T05:37:08.722 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T05:37:08.722 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T05:37:08.722 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T05:37:08.722 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T05:37:08.722 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T05:37:08.722 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T05:37:08.722 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T05:37:08.722 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T05:37:08.723 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T05:37:08.723 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T05:37:08.723 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T05:37:08.723 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T05:37:08.723 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T05:37:08.723 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T05:37:08.723 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T05:37:08.723 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T05:37:08.723 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T05:37:08.723 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T05:37:08.723 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T05:37:08.723 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T05:37:08.723 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T05:37:08.723 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T05:37:08.723 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T05:37:08.723 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T05:37:08.724 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T05:37:08.724 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T05:37:08.724 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T05:37:08.724 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T05:37:08.724 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T05:37:08.724 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T05:37:08.725 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T05:37:08.725 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T05:37:08.725 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T05:37:08.725 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T05:37:08.725 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T05:37:08.726 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T05:37:08.726 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T05:37:08.726 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T05:37:08.726 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T05:37:08.726 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T05:37:08.726 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T05:37:08.726 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T05:37:08.752 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T05:37:08.866 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T05:37:09.037 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T05:37:09.071 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T05:37:09.094 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T05:37:09.094 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:37:09.094 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T05:37:09.094 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T05:37:09.094 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T05:37:09.094 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-21T05:37:09.138 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T05:37:09.149 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T05:37:09.249 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T05:37:09.299 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T05:37:10.266 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T05:37:10.298 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T05:37:10.322 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T05:37:10.322 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:37:10.322 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T05:37:10.322 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T05:37:10.322 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T05:37:10.322 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-21T05:37:10.366 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T05:37:10.389 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T05:37:10.389 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:37:10.389 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T05:37:10.389 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-21T05:37:10.442 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T05:37:10.464 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T05:37:10.464 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:37:10.465 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T05:37:10.465 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T05:37:10.465 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T05:37:10.465 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-21T05:37:10.703 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T05:37:10.703 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T05:37:10.703 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T05:37:10.703 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T05:37:10.703 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T05:37:10.703 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T05:37:10.703 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T05:37:10.703 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T05:37:10.704 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:37:10.704 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:37:10.704 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T05:37:10.704 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T05:37:10.704 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T05:37:10.704 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T05:37:10.704 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T05:37:10.704 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T05:37:10.704 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T05:37:10.704 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T05:37:10.704 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T05:37:10.704 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T05:37:10.704 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T05:37:10.704 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T05:37:10.704 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T05:37:10.705 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T05:37:10.705 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T05:37:10.705 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T05:37:10.705 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T05:37:10.705 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T05:37:10.705 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T05:37:10.705 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T05:37:10.705 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T05:37:10.705 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T05:37:10.705 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T05:37:10.705 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T05:37:10.705 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T05:37:10.705 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T05:37:10.705 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T05:37:10.706 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T05:37:10.706 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T05:37:10.706 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T05:37:10.706 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T05:37:10.706 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T05:37:10.706 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T05:37:10.706 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T05:37:10.706 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T05:37:10.706 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T05:37:10.706 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T05:37:10.706 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T05:37:10.706 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T05:37:10.706 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T05:37:10.706 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T05:37:10.706 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T05:37:10.707 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T05:37:10.707 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T05:37:10.707 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T05:37:10.707 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T05:37:10.707 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T05:37:10.707 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T05:37:10.707 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T05:37:10.707 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T05:37:10.707 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T05:37:10.707 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T05:37:10.707 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T05:37:10.707 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T05:37:10.707 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T05:37:10.707 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T05:37:10.708 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T05:37:10.708 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T05:37:10.708 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T05:37:10.708 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T05:37:10.708 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T05:37:10.708 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T05:37:10.708 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T05:37:10.708 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T05:37:10.708 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T05:37:10.708 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T05:37:10.708 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T05:37:10.708 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T05:37:10.708 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T05:37:10.708 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T05:37:10.709 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T05:37:10.710 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T05:37:10.710 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T05:37:10.710 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T05:37:10.710 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T05:37:10.710 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T05:37:10.710 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T05:37:10.710 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T05:37:10.710 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T05:37:10.710 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T05:37:10.710 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T05:37:10.710 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T05:37:10.710 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T05:37:10.710 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T05:37:10.710 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T05:37:10.711 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T05:37:10.711 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T05:37:10.711 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T05:37:10.711 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T05:37:10.711 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T05:37:10.711 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T05:37:10.711 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T05:37:10.711 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T05:37:10.711 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T05:37:10.711 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T05:37:10.711 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T05:37:10.711 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T05:37:10.711 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T05:37:10.711 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T05:37:10.711 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T05:37:10.712 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T05:37:10.712 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T05:37:10.712 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T05:37:10.712 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T05:37:10.712 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T05:37:10.712 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T05:37:10.712 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T05:37:10.712 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T05:37:10.712 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T05:37:10.712 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T05:37:10.712 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T05:37:10.712 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T05:37:10.712 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T05:37:10.712 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T05:37:10.712 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T05:37:10.713 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T05:37:10.713 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T05:37:10.713 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T05:37:10.713 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T05:37:10.713 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T05:37:10.713 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T05:37:10.713 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T05:37:10.713 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T05:37:10.714 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T05:37:10.714 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T05:37:10.714 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T05:37:10.714 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T05:37:10.714 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T05:37:10.714 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T05:37:10.714 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T05:37:10.714 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T05:37:10.714 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T05:37:10.714 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T05:37:10.714 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T05:37:10.714 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T05:37:10.715 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T05:37:10.715 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T05:37:10.715 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T05:37:10.715 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T05:37:10.715 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T05:37:10.715 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T05:37:10.715 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T05:37:10.715 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T05:37:10.715 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T05:37:10.715 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T05:37:10.715 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T05:37:10.715 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T05:37:10.716 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T05:37:10.716 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T05:37:10.716 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T05:37:10.716 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T05:37:10.716 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T05:37:10.716 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T05:37:10.716 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T05:37:10.716 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T05:37:10.792 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T05:37:10.815 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T05:37:10.815 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:37:10.816 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T05:37:10.816 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T05:37:10.816 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T05:37:10.816 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-21T05:37:11.471 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T05:37:11.471 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-21T05:37:11.471 INFO:teuthology.orchestra.run.smithi116.stdout:Upgraded: 2024-09-21T05:37:11.471 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T05:37:11.471 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T05:37:11.471 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T05:37:11.471 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T05:37:11.471 INFO:teuthology.orchestra.run.smithi116.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:11.471 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:11.471 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T05:37:11.471 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T05:37:11.472 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-21T05:37:11.472 INFO:teuthology.orchestra.run.smithi116.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T05:37:11.472 INFO:teuthology.orchestra.run.smithi116.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T05:37:11.472 INFO:teuthology.orchestra.run.smithi116.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T05:37:11.472 INFO:teuthology.orchestra.run.smithi116.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T05:37:11.472 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:11.472 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:11.472 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:11.472 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:11.472 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:37:11.472 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:11.472 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:11.472 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:11.472 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:37:11.473 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:37:11.473 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:37:11.473 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:37:11.473 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:37:11.473 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:11.473 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:11.473 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:37:11.473 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:11.473 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:11.473 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:11.473 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:37:11.473 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:37:11.473 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:11.473 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:11.473 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:37:11.473 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T05:37:11.474 INFO:teuthology.orchestra.run.smithi116.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T05:37:11.474 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T05:37:11.474 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T05:37:11.474 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T05:37:11.474 INFO:teuthology.orchestra.run.smithi116.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T05:37:11.474 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T05:37:11.474 INFO:teuthology.orchestra.run.smithi116.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T05:37:11.474 INFO:teuthology.orchestra.run.smithi116.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T05:37:11.474 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T05:37:11.474 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T05:37:11.474 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:11.474 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:11.474 INFO:teuthology.orchestra.run.smithi116.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:11.474 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T05:37:11.475 INFO:teuthology.orchestra.run.smithi116.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T05:37:11.475 INFO:teuthology.orchestra.run.smithi116.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T05:37:11.475 INFO:teuthology.orchestra.run.smithi116.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T05:37:11.475 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T05:37:11.475 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T05:37:11.475 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:11.475 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:11.475 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T05:37:11.475 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:11.475 INFO:teuthology.orchestra.run.smithi116.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T05:37:11.475 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T05:37:11.475 INFO:teuthology.orchestra.run.smithi116.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T05:37:11.475 INFO:teuthology.orchestra.run.smithi116.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T05:37:11.475 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T05:37:11.475 INFO:teuthology.orchestra.run.smithi116.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T05:37:11.476 INFO:teuthology.orchestra.run.smithi116.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T05:37:11.476 INFO:teuthology.orchestra.run.smithi116.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T05:37:11.476 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T05:37:11.476 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T05:37:11.476 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T05:37:11.476 INFO:teuthology.orchestra.run.smithi116.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T05:37:11.476 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T05:37:11.476 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T05:37:11.476 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T05:37:11.476 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T05:37:11.476 INFO:teuthology.orchestra.run.smithi116.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T05:37:11.476 INFO:teuthology.orchestra.run.smithi116.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T05:37:11.476 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T05:37:11.476 INFO:teuthology.orchestra.run.smithi116.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T05:37:11.476 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T05:37:11.476 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T05:37:11.477 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T05:37:11.477 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:11.477 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:11.477 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:11.477 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T05:37:11.477 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T05:37:11.477 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T05:37:11.477 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T05:37:11.477 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T05:37:11.477 INFO:teuthology.orchestra.run.smithi116.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T05:37:11.477 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T05:37:11.477 INFO:teuthology.orchestra.run.smithi116.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T05:37:11.477 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T05:37:11.477 INFO:teuthology.orchestra.run.smithi116.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T05:37:11.478 INFO:teuthology.orchestra.run.smithi116.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T05:37:11.478 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T05:37:11.478 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T05:37:11.478 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T05:37:11.478 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T05:37:11.478 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T05:37:11.478 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T05:37:11.478 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T05:37:11.478 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T05:37:11.478 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T05:37:11.478 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T05:37:11.478 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T05:37:11.478 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T05:37:11.478 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T05:37:11.479 INFO:teuthology.orchestra.run.smithi116.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T05:37:11.479 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T05:37:11.479 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T05:37:11.479 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T05:37:11.479 INFO:teuthology.orchestra.run.smithi116.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T05:37:11.479 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T05:37:11.479 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T05:37:11.479 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T05:37:11.479 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T05:37:11.479 INFO:teuthology.orchestra.run.smithi116.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T05:37:11.479 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T05:37:11.479 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T05:37:11.479 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T05:37:11.479 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T05:37:11.479 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T05:37:11.480 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T05:37:11.480 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:11.480 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:11.480 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T05:37:11.480 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T05:37:11.480 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T05:37:11.480 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:11.480 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T05:37:11.480 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T05:37:11.480 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T05:37:11.480 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T05:37:11.480 INFO:teuthology.orchestra.run.smithi116.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T05:37:11.480 INFO:teuthology.orchestra.run.smithi116.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T05:37:11.480 INFO:teuthology.orchestra.run.smithi116.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T05:37:11.480 INFO:teuthology.orchestra.run.smithi116.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T05:37:11.481 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T05:37:11.481 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T05:37:11.481 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T05:37:11.481 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T05:37:11.481 INFO:teuthology.orchestra.run.smithi116.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T05:37:11.481 INFO:teuthology.orchestra.run.smithi116.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T05:37:11.481 INFO:teuthology.orchestra.run.smithi116.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T05:37:11.481 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:11.481 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:11.481 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:11.481 INFO:teuthology.orchestra.run.smithi116.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T05:37:11.481 INFO:teuthology.orchestra.run.smithi116.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T05:37:11.481 INFO:teuthology.orchestra.run.smithi116.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T05:37:11.481 INFO:teuthology.orchestra.run.smithi116.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T05:37:11.481 INFO:teuthology.orchestra.run.smithi116.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T05:37:11.482 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T05:37:11.482 INFO:teuthology.orchestra.run.smithi116.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T05:37:11.482 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-21T05:37:11.482 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-21T05:37:11.917 DEBUG:teuthology.parallel:result is None 2024-09-21T05:37:13.542 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T05:37:13.542 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:37:13.542 INFO:teuthology.orchestra.run.smithi070.stdout:Upgraded: 2024-09-21T05:37:13.542 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T05:37:13.542 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T05:37:13.542 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T05:37:13.542 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T05:37:13.543 INFO:teuthology.orchestra.run.smithi070.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:13.543 INFO:teuthology.orchestra.run.smithi070.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:13.543 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T05:37:13.543 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T05:37:13.543 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-21T05:37:13.543 INFO:teuthology.orchestra.run.smithi070.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T05:37:13.543 INFO:teuthology.orchestra.run.smithi070.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T05:37:13.543 INFO:teuthology.orchestra.run.smithi070.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T05:37:13.543 INFO:teuthology.orchestra.run.smithi070.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T05:37:13.543 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:13.543 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:13.543 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:13.543 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:13.543 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:37:13.544 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:13.544 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:13.544 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:13.544 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:37:13.544 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:37:13.544 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:37:13.544 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:37:13.544 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:37:13.544 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:13.544 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:13.544 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:37:13.544 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:13.544 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:13.544 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:13.544 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:37:13.545 INFO:teuthology.orchestra.run.smithi070.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:37:13.545 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:13.545 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:13.545 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:37:13.545 INFO:teuthology.orchestra.run.smithi070.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T05:37:13.545 INFO:teuthology.orchestra.run.smithi070.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T05:37:13.545 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T05:37:13.545 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T05:37:13.545 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T05:37:13.545 INFO:teuthology.orchestra.run.smithi070.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T05:37:13.545 INFO:teuthology.orchestra.run.smithi070.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T05:37:13.545 INFO:teuthology.orchestra.run.smithi070.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T05:37:13.545 INFO:teuthology.orchestra.run.smithi070.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T05:37:13.545 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T05:37:13.546 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T05:37:13.546 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:13.546 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:13.546 INFO:teuthology.orchestra.run.smithi070.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:13.546 INFO:teuthology.orchestra.run.smithi070.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T05:37:13.546 INFO:teuthology.orchestra.run.smithi070.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T05:37:13.546 INFO:teuthology.orchestra.run.smithi070.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T05:37:13.546 INFO:teuthology.orchestra.run.smithi070.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T05:37:13.546 INFO:teuthology.orchestra.run.smithi070.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T05:37:13.546 INFO:teuthology.orchestra.run.smithi070.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T05:37:13.546 INFO:teuthology.orchestra.run.smithi070.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:13.546 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:13.546 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T05:37:13.546 INFO:teuthology.orchestra.run.smithi070.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:13.547 INFO:teuthology.orchestra.run.smithi070.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T05:37:13.547 INFO:teuthology.orchestra.run.smithi070.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T05:37:13.547 INFO:teuthology.orchestra.run.smithi070.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T05:37:13.547 INFO:teuthology.orchestra.run.smithi070.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T05:37:13.547 INFO:teuthology.orchestra.run.smithi070.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T05:37:13.547 INFO:teuthology.orchestra.run.smithi070.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T05:37:13.547 INFO:teuthology.orchestra.run.smithi070.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T05:37:13.547 INFO:teuthology.orchestra.run.smithi070.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T05:37:13.547 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T05:37:13.547 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T05:37:13.547 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T05:37:13.547 INFO:teuthology.orchestra.run.smithi070.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T05:37:13.547 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T05:37:13.547 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T05:37:13.547 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T05:37:13.548 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T05:37:13.548 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T05:37:13.548 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T05:37:13.548 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T05:37:13.548 INFO:teuthology.orchestra.run.smithi070.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T05:37:13.548 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T05:37:13.548 INFO:teuthology.orchestra.run.smithi070.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T05:37:13.548 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T05:37:13.548 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:13.548 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:13.548 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:13.548 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T05:37:13.548 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T05:37:13.548 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T05:37:13.549 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T05:37:13.549 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T05:37:13.549 INFO:teuthology.orchestra.run.smithi070.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T05:37:13.549 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T05:37:13.549 INFO:teuthology.orchestra.run.smithi070.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T05:37:13.549 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T05:37:13.549 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T05:37:13.549 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T05:37:13.549 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T05:37:13.549 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T05:37:13.549 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T05:37:13.549 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T05:37:13.549 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T05:37:13.549 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T05:37:13.549 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T05:37:13.550 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T05:37:13.550 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T05:37:13.550 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T05:37:13.550 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T05:37:13.550 INFO:teuthology.orchestra.run.smithi070.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T05:37:13.550 INFO:teuthology.orchestra.run.smithi070.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T05:37:13.550 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T05:37:13.550 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T05:37:13.550 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T05:37:13.550 INFO:teuthology.orchestra.run.smithi070.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T05:37:13.550 INFO:teuthology.orchestra.run.smithi070.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T05:37:13.550 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T05:37:13.550 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T05:37:13.550 INFO:teuthology.orchestra.run.smithi070.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T05:37:13.551 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T05:37:13.551 INFO:teuthology.orchestra.run.smithi070.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T05:37:13.551 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T05:37:13.551 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T05:37:13.551 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T05:37:13.551 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T05:37:13.551 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T05:37:13.551 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T05:37:13.551 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:13.551 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:13.551 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T05:37:13.551 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T05:37:13.551 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T05:37:13.551 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:13.552 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T05:37:13.552 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T05:37:13.552 INFO:teuthology.orchestra.run.smithi070.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T05:37:13.552 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T05:37:13.552 INFO:teuthology.orchestra.run.smithi070.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T05:37:13.552 INFO:teuthology.orchestra.run.smithi070.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T05:37:13.552 INFO:teuthology.orchestra.run.smithi070.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T05:37:13.552 INFO:teuthology.orchestra.run.smithi070.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T05:37:13.552 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T05:37:13.552 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T05:37:13.552 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T05:37:13.552 INFO:teuthology.orchestra.run.smithi070.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T05:37:13.552 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T05:37:13.552 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T05:37:13.552 INFO:teuthology.orchestra.run.smithi070.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T05:37:13.553 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:13.553 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:13.553 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:13.553 INFO:teuthology.orchestra.run.smithi070.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T05:37:13.553 INFO:teuthology.orchestra.run.smithi070.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T05:37:13.553 INFO:teuthology.orchestra.run.smithi070.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T05:37:13.553 INFO:teuthology.orchestra.run.smithi070.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T05:37:13.553 INFO:teuthology.orchestra.run.smithi070.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T05:37:13.553 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T05:37:13.553 INFO:teuthology.orchestra.run.smithi070.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T05:37:13.554 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:37:13.554 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-21T05:37:14.009 DEBUG:teuthology.parallel:result is None 2024-09-21T05:37:14.833 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T05:37:14.871 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T05:37:14.911 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T05:37:14.935 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T05:37:14.962 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T05:37:15.167 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T05:37:15.209 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T05:37:15.239 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T05:37:15.268 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T05:37:15.315 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T05:37:15.868 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T05:37:15.904 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T05:37:15.924 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T05:37:16.765 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T05:37:16.858 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T05:37:16.908 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T05:37:17.005 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T05:37:17.036 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T05:37:17.062 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T05:37:17.125 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T05:37:17.125 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T05:37:17.163 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T05:37:17.163 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T05:37:17.247 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T05:37:17.272 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T05:37:17.277 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T05:37:17.278 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T05:37:17.474 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T05:37:17.474 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T05:37:17.558 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T05:37:17.623 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T05:37:24.008 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T05:37:24.009 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T05:37:24.009 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T05:37:24.009 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T05:37:24.009 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T05:37:24.009 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T05:37:24.009 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T05:37:24.009 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T05:37:24.009 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:37:24.009 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:37:24.009 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T05:37:24.009 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T05:37:24.009 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T05:37:24.009 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T05:37:24.009 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T05:37:24.009 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T05:37:24.010 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T05:37:24.010 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T05:37:24.010 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T05:37:24.010 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T05:37:24.010 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T05:37:24.010 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T05:37:24.010 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T05:37:24.010 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T05:37:24.010 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T05:37:24.010 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T05:37:24.010 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T05:37:24.010 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T05:37:24.010 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T05:37:24.010 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T05:37:24.022 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T05:37:24.022 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T05:37:24.022 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T05:37:24.022 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T05:37:24.022 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T05:37:24.023 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T05:37:24.023 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T05:37:24.023 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T05:37:24.023 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T05:37:24.023 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T05:37:24.023 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T05:37:24.023 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T05:37:24.023 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T05:37:24.023 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T05:37:24.023 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T05:37:24.023 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T05:37:24.023 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T05:37:24.024 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T05:37:24.024 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T05:37:24.024 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T05:37:24.024 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T05:37:24.024 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T05:37:24.024 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T05:37:24.024 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T05:37:24.024 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T05:37:24.024 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T05:37:24.024 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T05:37:24.024 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T05:37:24.024 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T05:37:24.025 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T05:37:24.025 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T05:37:24.025 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T05:37:24.025 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T05:37:24.025 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T05:37:24.025 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T05:37:24.025 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T05:37:24.025 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T05:37:24.025 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T05:37:24.025 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T05:37:24.025 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T05:37:24.026 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T05:37:24.026 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T05:37:24.026 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T05:37:24.026 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T05:37:24.026 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T05:37:24.026 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T05:37:24.026 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T05:37:24.026 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T05:37:24.026 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T05:37:24.026 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T05:37:24.026 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T05:37:24.027 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T05:37:24.027 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T05:37:24.027 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T05:37:24.027 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T05:37:24.027 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T05:37:24.027 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T05:37:24.027 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T05:37:24.027 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T05:37:24.027 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T05:37:24.027 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T05:37:24.027 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T05:37:24.027 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T05:37:24.027 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T05:37:24.027 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T05:37:24.027 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T05:37:24.028 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T05:37:24.028 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T05:37:24.028 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T05:37:24.028 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T05:37:24.028 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T05:37:24.028 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T05:37:24.028 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T05:37:24.028 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T05:37:24.028 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T05:37:24.028 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T05:37:24.028 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T05:37:24.028 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T05:37:24.028 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T05:37:24.028 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T05:37:24.028 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T05:37:24.029 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T05:37:24.029 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T05:37:24.029 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T05:37:24.029 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T05:37:24.029 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T05:37:24.029 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T05:37:24.029 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T05:37:24.029 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T05:37:24.029 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T05:37:24.029 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T05:37:24.029 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T05:37:24.030 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T05:37:24.030 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T05:37:24.030 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T05:37:24.030 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T05:37:24.030 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T05:37:24.030 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T05:37:24.030 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T05:37:24.030 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T05:37:24.030 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T05:37:24.030 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T05:37:24.030 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T05:37:24.030 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T05:37:24.030 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T05:37:24.030 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T05:37:24.031 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T05:37:24.031 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T05:37:24.031 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T05:37:24.031 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T05:37:24.031 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T05:37:24.031 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T05:37:24.031 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T05:37:24.031 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T05:37:24.031 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T05:37:24.031 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T05:37:24.031 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T05:37:24.031 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T05:37:24.031 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T05:37:24.031 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T05:37:24.032 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T05:37:24.032 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T05:37:24.032 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T05:37:24.032 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T05:37:24.032 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T05:37:24.032 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T05:37:24.032 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T05:37:24.032 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T05:37:24.032 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T05:37:24.032 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T05:37:24.032 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T05:37:24.032 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T05:37:24.032 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T05:37:24.032 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T05:37:24.032 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T05:37:26.329 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T05:37:26.329 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-21T05:37:26.330 INFO:teuthology.orchestra.run.smithi160.stdout:Upgraded: 2024-09-21T05:37:26.330 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T05:37:26.330 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T05:37:26.330 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T05:37:26.330 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T05:37:26.330 INFO:teuthology.orchestra.run.smithi160.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:26.330 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:26.330 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T05:37:26.330 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T05:37:26.330 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-09-21T05:37:26.330 INFO:teuthology.orchestra.run.smithi160.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T05:37:26.330 INFO:teuthology.orchestra.run.smithi160.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T05:37:26.330 INFO:teuthology.orchestra.run.smithi160.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T05:37:26.331 INFO:teuthology.orchestra.run.smithi160.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T05:37:26.331 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:26.331 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:26.331 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:26.331 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:26.331 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:37:26.331 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:26.331 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:26.331 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:26.331 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:37:26.331 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:37:26.331 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:37:26.331 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:37:26.332 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:37:26.332 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:26.332 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:26.332 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:37:26.332 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:26.332 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:26.332 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:26.332 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:37:26.332 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:37:26.332 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:26.332 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:26.332 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:37:26.332 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T05:37:26.332 INFO:teuthology.orchestra.run.smithi160.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T05:37:26.333 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T05:37:26.333 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T05:37:26.333 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T05:37:26.333 INFO:teuthology.orchestra.run.smithi160.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T05:37:26.333 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T05:37:26.333 INFO:teuthology.orchestra.run.smithi160.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T05:37:26.333 INFO:teuthology.orchestra.run.smithi160.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T05:37:26.333 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T05:37:26.333 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T05:37:26.333 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:26.333 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:26.333 INFO:teuthology.orchestra.run.smithi160.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:26.333 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T05:37:26.334 INFO:teuthology.orchestra.run.smithi160.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T05:37:26.334 INFO:teuthology.orchestra.run.smithi160.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T05:37:26.334 INFO:teuthology.orchestra.run.smithi160.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T05:37:26.334 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T05:37:26.334 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T05:37:26.334 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:26.334 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:26.334 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T05:37:26.334 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:26.334 INFO:teuthology.orchestra.run.smithi160.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T05:37:26.334 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T05:37:26.334 INFO:teuthology.orchestra.run.smithi160.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T05:37:26.334 INFO:teuthology.orchestra.run.smithi160.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T05:37:26.335 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T05:37:26.335 INFO:teuthology.orchestra.run.smithi160.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T05:37:26.335 INFO:teuthology.orchestra.run.smithi160.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T05:37:26.335 INFO:teuthology.orchestra.run.smithi160.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T05:37:26.335 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T05:37:26.335 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T05:37:26.335 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T05:37:26.335 INFO:teuthology.orchestra.run.smithi160.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T05:37:26.335 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T05:37:26.335 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T05:37:26.335 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T05:37:26.335 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T05:37:26.335 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T05:37:26.336 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T05:37:26.336 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T05:37:26.336 INFO:teuthology.orchestra.run.smithi160.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T05:37:26.336 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T05:37:26.336 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T05:37:26.336 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T05:37:26.336 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:26.336 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:26.336 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:26.336 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T05:37:26.336 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T05:37:26.336 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T05:37:26.336 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T05:37:26.336 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T05:37:26.336 INFO:teuthology.orchestra.run.smithi160.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T05:37:26.337 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T05:37:26.337 INFO:teuthology.orchestra.run.smithi160.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T05:37:26.337 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T05:37:26.337 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T05:37:26.337 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T05:37:26.337 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T05:37:26.337 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T05:37:26.337 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T05:37:26.337 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T05:37:26.337 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T05:37:26.337 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T05:37:26.337 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T05:37:26.337 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T05:37:26.337 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T05:37:26.337 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T05:37:26.338 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T05:37:26.338 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T05:37:26.338 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T05:37:26.338 INFO:teuthology.orchestra.run.smithi160.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T05:37:26.338 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T05:37:26.338 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T05:37:26.338 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T05:37:26.338 INFO:teuthology.orchestra.run.smithi160.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T05:37:26.338 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T05:37:26.338 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T05:37:26.338 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T05:37:26.338 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T05:37:26.338 INFO:teuthology.orchestra.run.smithi160.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T05:37:26.339 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T05:37:26.339 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T05:37:26.339 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T05:37:26.339 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T05:37:26.339 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T05:37:26.339 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T05:37:26.339 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:26.339 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:26.339 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T05:37:26.339 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T05:37:26.339 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T05:37:26.339 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:26.339 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T05:37:26.339 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T05:37:26.339 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T05:37:26.340 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T05:37:26.340 INFO:teuthology.orchestra.run.smithi160.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T05:37:26.340 INFO:teuthology.orchestra.run.smithi160.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T05:37:26.340 INFO:teuthology.orchestra.run.smithi160.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T05:37:26.340 INFO:teuthology.orchestra.run.smithi160.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T05:37:26.340 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T05:37:26.340 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T05:37:26.340 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T05:37:26.340 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T05:37:26.340 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T05:37:26.340 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T05:37:26.340 INFO:teuthology.orchestra.run.smithi160.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T05:37:26.340 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:26.341 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:26.341 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:37:26.341 INFO:teuthology.orchestra.run.smithi160.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T05:37:26.341 INFO:teuthology.orchestra.run.smithi160.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T05:37:26.341 INFO:teuthology.orchestra.run.smithi160.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T05:37:26.341 INFO:teuthology.orchestra.run.smithi160.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T05:37:26.341 INFO:teuthology.orchestra.run.smithi160.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T05:37:26.341 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T05:37:26.341 INFO:teuthology.orchestra.run.smithi160.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T05:37:26.341 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-21T05:37:26.342 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-21T05:37:26.758 DEBUG:teuthology.parallel:result is None 2024-09-21T05:37:26.758 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:37:26.906 DEBUG:teuthology.orchestra.run.smithi070:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T05:37:26.932 INFO:teuthology.orchestra.run.smithi070.stdout:19.3.0-5120.g18432218.el9 2024-09-21T05:37:26.932 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T05:37:26.933 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T05:37:26.935 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:37:27.080 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T05:37:27.107 INFO:teuthology.orchestra.run.smithi116.stdout:19.3.0-5120.g18432218.el9 2024-09-21T05:37:27.107 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T05:37:27.107 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T05:37:27.109 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:37:27.248 DEBUG:teuthology.orchestra.run.smithi160:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T05:37:27.271 INFO:teuthology.orchestra.run.smithi160.stdout:19.3.0-5120.g18432218.el9 2024-09-21T05:37:27.271 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T05:37:27.271 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T05:37:27.273 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T05:37:27.273 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-21T05:37:27.273 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T05:37:27.305 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-21T05:37:27.305 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T05:37:27.337 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-21T05:37:27.337 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T05:37:27.364 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T05:37:27.364 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-21T05:37:27.364 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T05:37:27.393 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T05:37:27.461 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-21T05:37:27.461 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T05:37:27.492 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T05:37:27.562 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-21T05:37:27.562 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T05:37:27.587 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T05:37:27.651 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T05:37:27.651 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-21T05:37:27.651 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T05:37:27.679 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T05:37:27.746 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-21T05:37:27.746 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T05:37:27.771 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T05:37:27.837 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-21T05:37:27.837 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T05:37:27.862 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T05:37:27.927 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T05:37:27.927 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-21T05:37:27.927 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T05:37:27.952 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T05:37:28.017 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-21T05:37:28.017 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T05:37:28.043 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T05:37:28.110 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-21T05:37:28.110 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T05:37:28.134 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T05:37:28.199 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T05:37:28.289 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'client dirsize rbytes': False}, 'mds': {'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-21T05:37:28.289 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:37:28.290 INFO:tasks.cephadm:Cluster fsid is 96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:37:28.290 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T05:37:28.290 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.70', 'mon.b': '172.21.15.116', 'mon.c': '172.21.15.160'} 2024-09-21T05:37:28.290 INFO:tasks.cephadm:First mon is mon.a on smithi070 2024-09-21T05:37:28.290 INFO:tasks.cephadm:First mgr is x 2024-09-21T05:37:28.290 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T05:37:28.291 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname $(hostname -s) 2024-09-21T05:37:28.317 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname $(hostname -s) 2024-09-21T05:37:28.342 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname $(hostname -s) 2024-09-21T05:37:28.367 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-21T05:37:28.368 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:37:28.507 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.4.75+confusa13', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-21 00:04:17.484514', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.2.22+braggi22', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-20 22:54:16.499090', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-21T05:37:28.653 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-pdonnell-testing-20240920.212106-debug, sha1 1843221895adccfb3b692060251dd6a0183bc410 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:37:28.655 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T05:37:28.655 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T05:37:28.655 DEBUG:teuthology.orchestra.run.smithi070:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T05:37:29.152 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 05:37 /home/ubuntu/cephtest/cephadm 2024-09-21T05:37:29.153 DEBUG:teuthology.orchestra.run.smithi116:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T05:37:29.673 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 05:37 /home/ubuntu/cephtest/cephadm 2024-09-21T05:37:29.673 DEBUG:teuthology.orchestra.run.smithi160:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T05:37:30.193 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 05:37 /home/ubuntu/cephtest/cephadm 2024-09-21T05:37:30.193 DEBUG:teuthology.orchestra.run.smithi070:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T05:37:30.213 DEBUG:teuthology.orchestra.run.smithi116:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T05:37:30.233 DEBUG:teuthology.orchestra.run.smithi160:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T05:37:30.269 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 on all hosts... 2024-09-21T05:37:30.269 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T05:37:30.271 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T05:37:30.275 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T05:37:31.764 INFO:teuthology.orchestra.run.smithi070.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T05:37:31.868 INFO:teuthology.orchestra.run.smithi160.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T05:37:32.084 INFO:teuthology.orchestra.run.smithi116.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T05:38:04.233 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-21T05:38:04.233 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T05:38:04.233 INFO:teuthology.orchestra.run.smithi116.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T05:38:04.233 INFO:teuthology.orchestra.run.smithi116.stdout: "repo_digests": [ 2024-09-21T05:38:04.234 INFO:teuthology.orchestra.run.smithi116.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T05:38:04.234 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-21T05:38:04.234 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-21T05:38:24.858 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:38:24.858 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T05:38:24.858 INFO:teuthology.orchestra.run.smithi070.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T05:38:24.858 INFO:teuthology.orchestra.run.smithi070.stdout: "repo_digests": [ 2024-09-21T05:38:24.858 INFO:teuthology.orchestra.run.smithi070.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T05:38:24.859 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-21T05:38:24.859 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:38:33.271 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-21T05:38:33.271 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T05:38:33.271 INFO:teuthology.orchestra.run.smithi160.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T05:38:33.271 INFO:teuthology.orchestra.run.smithi160.stdout: "repo_digests": [ 2024-09-21T05:38:33.271 INFO:teuthology.orchestra.run.smithi160.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T05:38:33.271 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-21T05:38:33.272 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-21T05:38:33.297 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /etc/ceph 2024-09-21T05:38:33.332 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /etc/ceph 2024-09-21T05:38:33.365 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /etc/ceph 2024-09-21T05:38:33.394 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 777 /etc/ceph 2024-09-21T05:38:33.423 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 777 /etc/ceph 2024-09-21T05:38:33.452 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 777 /etc/ceph 2024-09-21T05:38:33.477 INFO:tasks.cephadm:Writing seed config... 2024-09-21T05:38:33.478 INFO:tasks.cephadm: override: [client] client dirsize rbytes = False 2024-09-21T05:38:33.478 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-21T05:38:33.478 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-21T05:38:33.478 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-21T05:38:33.478 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T05:38:33.478 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T05:38:33.478 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T05:38:33.478 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T05:38:33.478 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T05:38:33.478 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T05:38:33.479 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T05:38:33.479 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-21T05:38:33.479 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T05:38:33.479 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-21T05:38:33.479 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-21T05:38:33.479 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T05:38:33.479 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T05:38:33.479 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-21T05:38:33.479 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T05:38:33.479 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T05:38:33.479 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T05:38:33.479 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T05:38:33.479 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T05:38:33.479 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-21T05:38:33.479 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-21T05:38:33.480 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-21T05:38:33.480 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T05:38:33.497 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 96c6636e-77db-11ef-baf5-efdc52797490 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client dirsize rbytes = False [mds] mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 2024-09-21T05:38:33.498 DEBUG:teuthology.orchestra.run.smithi070:mon.a> sudo journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mon.a.service 2024-09-21T05:38:33.540 DEBUG:teuthology.orchestra.run.smithi070:mgr.x> sudo journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mgr.x.service 2024-09-21T05:38:33.583 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T05:38:33.583 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 -v bootstrap --fsid 96c6636e-77db-11ef-baf5-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.70 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T05:38:33.787 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-21T05:38:33.787 INFO:teuthology.orchestra.run.smithi070.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', '-v', 'bootstrap', '--fsid', '96c6636e-77db-11ef-baf5-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.70', '--skip-admin-label'] 2024-09-21T05:38:33.788 INFO:teuthology.orchestra.run.smithi070.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T05:38:33.788 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying podman|docker is present... 2024-09-21T05:38:33.812 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stdout 5.2.2 2024-09-21T05:38:33.812 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying lvm2 is present... 2024-09-21T05:38:33.813 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying time synchronization is in place... 2024-09-21T05:38:33.820 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T05:38:33.820 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T05:38:33.826 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T05:38:33.826 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2024-09-21T05:38:33.833 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout enabled 2024-09-21T05:38:33.839 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout active 2024-09-21T05:38:33.839 INFO:teuthology.orchestra.run.smithi070.stdout:Unit chronyd.service is enabled and running 2024-09-21T05:38:33.839 INFO:teuthology.orchestra.run.smithi070.stdout:Repeating the final host check... 2024-09-21T05:38:33.861 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stdout 5.2.2 2024-09-21T05:38:33.861 INFO:teuthology.orchestra.run.smithi070.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T05:38:33.861 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl is present 2024-09-21T05:38:33.862 INFO:teuthology.orchestra.run.smithi070.stdout:lvcreate is present 2024-09-21T05:38:33.868 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T05:38:33.868 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T05:38:33.874 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T05:38:33.874 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2024-09-21T05:38:33.880 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout enabled 2024-09-21T05:38:33.887 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout active 2024-09-21T05:38:33.887 INFO:teuthology.orchestra.run.smithi070.stdout:Unit chronyd.service is enabled and running 2024-09-21T05:38:33.887 INFO:teuthology.orchestra.run.smithi070.stdout:Host looks OK 2024-09-21T05:38:33.887 INFO:teuthology.orchestra.run.smithi070.stdout:Cluster fsid: 96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:38:33.887 INFO:teuthology.orchestra.run.smithi070.stdout:Acquiring lock 139721286560112 on /run/cephadm/96c6636e-77db-11ef-baf5-efdc52797490.lock 2024-09-21T05:38:33.887 INFO:teuthology.orchestra.run.smithi070.stdout:Lock 139721286560112 acquired on /run/cephadm/96c6636e-77db-11ef-baf5-efdc52797490.lock 2024-09-21T05:38:33.888 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying IP 172.21.15.70 port 3300 ... 2024-09-21T05:38:33.888 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying IP 172.21.15.70 port 6789 ... 2024-09-21T05:38:33.888 INFO:teuthology.orchestra.run.smithi070.stdout:Base mon IP(s) is [172.21.15.70:3300, 172.21.15.70:6789], mon addrv is [v2:172.21.15.70:3300,v1:172.21.15.70:6789] 2024-09-21T05:38:33.891 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.70 metric 100 2024-09-21T05:38:33.891 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.70 metric 100 2024-09-21T05:38:33.894 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T05:38:33.894 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-21T05:38:33.894 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-21T05:38:33.896 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T05:38:33.896 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T05:38:33.896 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T05:38:33.896 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-21T05:38:33.897 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d3e7/64 scope link noprefixroute 2024-09-21T05:38:33.897 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T05:38:33.897 INFO:teuthology.orchestra.run.smithi070.stdout:Mon IP `172.21.15.70` is in CIDR network `172.21.0.0/20` 2024-09-21T05:38:33.897 INFO:teuthology.orchestra.run.smithi070.stdout:Mon IP `172.21.15.70` is in CIDR network `172.21.0.0/20` 2024-09-21T05:38:33.897 INFO:teuthology.orchestra.run.smithi070.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T05:38:33.898 INFO:teuthology.orchestra.run.smithi070.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T05:38:33.898 INFO:teuthology.orchestra.run.smithi070.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T05:38:34.385 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stdout ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T05:38:34.385 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T05:38:34.386 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T05:38:34.386 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Copying blob sha256:8425bc7408d91b180e7fdc62f23e7ae6603757f4f36e9969a4eaf9fd9416b764 2024-09-21T05:38:34.386 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T05:38:34.386 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Copying config sha256:ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T05:38:34.386 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T05:38:35.265 INFO:teuthology.orchestra.run.smithi070.stdout:ceph: stdout ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T05:38:35.265 INFO:teuthology.orchestra.run.smithi070.stdout:Ceph version: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T05:38:35.265 INFO:teuthology.orchestra.run.smithi070.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T05:38:36.294 INFO:teuthology.orchestra.run.smithi070.stdout:stat: stdout 167 167 2024-09-21T05:38:36.294 INFO:teuthology.orchestra.run.smithi070.stdout:Creating initial keys... 2024-09-21T05:38:37.173 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph-authtool: stdout AQDcW+5mr3rIIxAA2Z4c/vKEd4w1n7THOIV2oQ== 2024-09-21T05:38:38.054 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph-authtool: stdout AQDdW+5mduijHhAAcflobCqNhy95e4GrNwPMow== 2024-09-21T05:38:39.018 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph-authtool: stdout AQDeW+5mrIceFxAAwgRawaQuHwT0zNKQAtwuiA== 2024-09-21T05:38:39.019 INFO:teuthology.orchestra.run.smithi070.stdout:Creating initial monmap... 2024-09-21T05:38:39.866 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T05:38:39.866 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T05:38:39.866 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:38:39.866 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T05:38:39.866 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool for a [v2:172.21.15.70:3300,v1:172.21.15.70:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T05:38:39.866 INFO:teuthology.orchestra.run.smithi070.stdout:setting min_mon_release = quincy 2024-09-21T05:38:39.866 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: set fsid to 96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:38:39.866 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T05:38:39.866 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:38:39.866 INFO:teuthology.orchestra.run.smithi070.stdout:Creating mon... 2024-09-21T05:38:40.838 INFO:teuthology.orchestra.run.smithi070.stdout:create mon.a on 2024-09-21T05:38:41.055 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T05:38:41.192 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T05:38:41.385 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-96c6636e-77db-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-96c6636e-77db-11ef-baf5-efdc52797490.target. 2024-09-21T05:38:41.385 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-96c6636e-77db-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-96c6636e-77db-11ef-baf5-efdc52797490.target. 2024-09-21T05:38:41.632 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-96c6636e-77db-11ef-baf5-efdc52797490@mon.a 2024-09-21T05:38:41.633 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Failed to reset failed state of unit ceph-96c6636e-77db-11ef-baf5-efdc52797490@mon.a.service: Unit ceph-96c6636e-77db-11ef-baf5-efdc52797490@mon.a.service not loaded. 2024-09-21T05:38:41.800 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-96c6636e-77db-11ef-baf5-efdc52797490.target.wants/ceph-96c6636e-77db-11ef-baf5-efdc52797490@mon.a.service → /etc/systemd/system/ceph-96c6636e-77db-11ef-baf5-efdc52797490@.service. 2024-09-21T05:38:42.337 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T05:38:42.337 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout disabled 2024-09-21T05:38:42.345 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T05:38:42.345 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2024-09-21T05:38:42.345 INFO:teuthology.orchestra.run.smithi070.stdout:firewalld.service is not enabled 2024-09-21T05:38:42.345 INFO:teuthology.orchestra.run.smithi070.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T05:38:42.346 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mon to start... 2024-09-21T05:38:42.346 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mon... 2024-09-21T05:38:43.391 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T05:38:43.392 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout id: 96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:38:43.392 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T05:38:43.392 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-21T05:38:43.392 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout services: 2024-09-21T05:38:43.392 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.563295s) 2024-09-21T05:38:43.392 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T05:38:43.392 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T05:38:43.392 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-21T05:38:43.392 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout data: 2024-09-21T05:38:43.392 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T05:38:43.392 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T05:38:43.392 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T05:38:43.392 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T05:38:43.392 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-21T05:38:43.392 INFO:teuthology.orchestra.run.smithi070.stdout:mon is available 2024-09-21T05:38:43.393 INFO:teuthology.orchestra.run.smithi070.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T05:38:44.507 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-21T05:38:44.507 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T05:38:44.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout fsid = 96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:38:44.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T05:38:44.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.70:3300,v1:172.21.15.70:6789] 2024-09-21T05:38:44.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T05:38:44.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T05:38:44.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T05:38:44.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T05:38:44.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-21T05:38:44.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T05:38:44.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T05:38:44.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-21T05:38:44.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T05:38:44.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T05:38:44.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T05:38:44.509 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T05:38:44.509 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T05:38:44.509 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T05:38:44.509 INFO:teuthology.orchestra.run.smithi070.stdout:Generating new minimal ceph.conf... 2024-09-21T05:38:45.550 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:45 smithi070 ceph-mon[30606]: from='client.? 172.21.15.70:0/1850577300' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:38:45.552 INFO:teuthology.orchestra.run.smithi070.stdout:Restarting the monitor... 2024-09-21T05:38:45.812 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:45 smithi070 systemd[1]: Stopping Ceph mon.a for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:38:46.078 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:45 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mon-a[30601]: 2024-09-21T05:38:45.809+0000 7f0b22392640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T05:38:46.078 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:45 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mon-a[30601]: 2024-09-21T05:38:45.809+0000 7f0b22392640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T05:38:46.078 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:46 smithi070 podman[30859]: 2024-09-21 05:38:46.076235438 +0000 UTC m=+0.364757140 container died d54508c5120ace072a4098567d6db6e53966a1dbc13cfb66dcc41994322f76f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T05:38:46.728 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:46 smithi070 podman[30859]: 2024-09-21 05:38:46.434837585 +0000 UTC m=+0.723359293 container cleanup d54508c5120ace072a4098567d6db6e53966a1dbc13cfb66dcc41994322f76f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mon-a, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T05:38:46.728 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:46 smithi070 bash[30859]: ceph-96c6636e-77db-11ef-baf5-efdc52797490-mon-a 2024-09-21T05:38:46.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:46 smithi070 podman[30871]: 2024-09-21 05:38:46.727251628 +0000 UTC m=+0.649814765 container remove d54508c5120ace072a4098567d6db6e53966a1dbc13cfb66dcc41994322f76f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mon-a, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T05:38:46.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:46 smithi070 systemd[1]: ceph-96c6636e-77db-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T05:38:46.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:46 smithi070 systemd[1]: Stopped Ceph mon.a for 96c6636e-77db-11ef-baf5-efdc52797490. 2024-09-21T05:38:46.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:46 smithi070 systemd[1]: Starting Ceph mon.a for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:38:47.341 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 podman[30962]: 2024-09-21 05:38:46.978805524 +0000 UTC m=+0.015037995 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:38:47.341 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 podman[30962]: 2024-09-21 05:38:47.086508948 +0000 UTC m=+0.122741444 container create d741ecc9460fce3a2d7752ab1417e65ab7c69540ef10cd6d103a3341ef4a60b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mon-a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True) 2024-09-21T05:38:47.341 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 podman[30962]: 2024-09-21 05:38:47.30534484 +0000 UTC m=+0.341577300 container init d741ecc9460fce3a2d7752ab1417e65ab7c69540ef10cd6d103a3341ef4a60b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mon-a, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-21T05:38:47.341 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 podman[30962]: 2024-09-21 05:38:47.308582386 +0000 UTC m=+0.344814841 container start d741ecc9460fce3a2d7752ab1417e65ab7c69540ef10cd6d103a3341ef4a60b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T05:38:47.394 INFO:teuthology.orchestra.run.smithi070.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T05:38:47.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T05:38:47.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T05:38:47.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: pidfile_write: ignore empty --pid-file 2024-09-21T05:38:47.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: load: jerasure load: lrc 2024-09-21T05:38:47.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: RocksDB version: 7.9.2 2024-09-21T05:38:47.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Git sha 0 2024-09-21T05:38:47.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T05:38:47.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: DB SUMMARY 2024-09-21T05:38:47.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: DB Session ID: QO52F1AXNRRQ3M03UR5F 2024-09-21T05:38:47.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: CURRENT file: CURRENT 2024-09-21T05:38:47.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T05:38:47.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T05:38:47.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T05:38:47.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 95392 ; 2024-09-21T05:38:47.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.error_if_exists: 0 2024-09-21T05:38:47.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.create_if_missing: 0 2024-09-21T05:38:47.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.paranoid_checks: 1 2024-09-21T05:38:47.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T05:38:47.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T05:38:47.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T05:38:47.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.env: 0x55da99f44d60 2024-09-21T05:38:47.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T05:38:47.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.info_log: 0x55da9e96f360 2024-09-21T05:38:47.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T05:38:47.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.statistics: (nil) 2024-09-21T05:38:47.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.use_fsync: 0 2024-09-21T05:38:47.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.max_log_file_size: 0 2024-09-21T05:38:47.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T05:38:47.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T05:38:47.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T05:38:47.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T05:38:47.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.allow_fallocate: 1 2024-09-21T05:38:47.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T05:38:47.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T05:38:47.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.use_direct_reads: 0 2024-09-21T05:38:47.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T05:38:47.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T05:38:47.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.db_log_dir: 2024-09-21T05:38:47.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.wal_dir: 2024-09-21T05:38:47.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T05:38:47.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T05:38:47.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T05:38:47.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T05:38:47.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T05:38:47.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T05:38:47.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T05:38:47.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T05:38:47.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.write_buffer_manager: 0x55da9e973d60 2024-09-21T05:38:47.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T05:38:47.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T05:38:47.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T05:38:47.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T05:38:47.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T05:38:47.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T05:38:47.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T05:38:47.631 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T05:38:47.631 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.unordered_write: 0 2024-09-21T05:38:47.631 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T05:38:47.631 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T05:38:47.631 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T05:38:47.631 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T05:38:47.631 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.row_cache: None 2024-09-21T05:38:47.631 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.wal_filter: None 2024-09-21T05:38:47.631 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T05:38:47.631 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T05:38:47.631 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.two_write_queues: 0 2024-09-21T05:38:47.631 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T05:38:47.631 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.wal_compression: 0 2024-09-21T05:38:47.632 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.atomic_flush: 0 2024-09-21T05:38:47.632 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T05:38:47.632 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T05:38:47.632 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T05:38:47.632 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.log_readahead_size: 0 2024-09-21T05:38:47.632 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T05:38:47.632 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T05:38:47.632 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T05:38:47.632 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T05:38:47.632 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T05:38:47.632 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T05:38:47.633 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T05:38:47.634 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.max_background_jobs: 2 2024-09-21T05:38:47.634 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.max_background_compactions: -1 2024-09-21T05:38:47.634 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.max_subcompactions: 1 2024-09-21T05:38:47.634 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T05:38:47.634 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T05:38:47.635 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T05:38:47.635 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T05:38:47.635 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T05:38:47.635 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T05:38:47.635 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T05:38:47.635 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T05:38:47.635 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.max_open_files: -1 2024-09-21T05:38:47.635 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T05:38:47.635 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T05:38:47.635 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T05:38:47.635 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T05:38:47.635 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.max_background_flushes: -1 2024-09-21T05:38:47.635 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Compression algorithms supported: 2024-09-21T05:38:47.636 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: kZSTD supported: 0 2024-09-21T05:38:47.636 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: kXpressCompression supported: 0 2024-09-21T05:38:47.636 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: kBZip2Compression supported: 0 2024-09-21T05:38:47.636 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T05:38:47.636 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: kLZ4Compression supported: 1 2024-09-21T05:38:47.636 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: kZlibCompression supported: 1 2024-09-21T05:38:47.636 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T05:38:47.636 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: kSnappyCompression supported: 1 2024-09-21T05:38:47.636 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T05:38:47.636 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T05:38:47.636 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-21T05:38:47.636 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T05:38:47.636 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T05:38:47.636 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.merge_operator: 2024-09-21T05:38:47.637 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.compaction_filter: None 2024-09-21T05:38:47.637 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T05:38:47.637 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T05:38:47.637 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T05:38:47.637 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T05:38:47.637 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55da9e96efa0) 2024-09-21T05:38:47.637 INFO:journalctl@ceph.mon.a.smithi070.stdout: cache_index_and_filter_blocks: 1 2024-09-21T05:38:47.637 INFO:journalctl@ceph.mon.a.smithi070.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T05:38:47.637 INFO:journalctl@ceph.mon.a.smithi070.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T05:38:47.637 INFO:journalctl@ceph.mon.a.smithi070.stdout: pin_top_level_index_and_filter: 1 2024-09-21T05:38:47.637 INFO:journalctl@ceph.mon.a.smithi070.stdout: index_type: 0 2024-09-21T05:38:47.637 INFO:journalctl@ceph.mon.a.smithi070.stdout: data_block_index_type: 0 2024-09-21T05:38:47.637 INFO:journalctl@ceph.mon.a.smithi070.stdout: index_shortening: 1 2024-09-21T05:38:47.638 INFO:journalctl@ceph.mon.a.smithi070.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T05:38:47.638 INFO:journalctl@ceph.mon.a.smithi070.stdout: checksum: 4 2024-09-21T05:38:47.638 INFO:journalctl@ceph.mon.a.smithi070.stdout: no_block_cache: 0 2024-09-21T05:38:47.638 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_cache: 0x55da9a933610 2024-09-21T05:38:47.638 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_cache_name: BinnedLRUCache 2024-09-21T05:38:47.638 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_cache_options: 2024-09-21T05:38:47.638 INFO:journalctl@ceph.mon.a.smithi070.stdout: capacity : 536870912 2024-09-21T05:38:47.638 INFO:journalctl@ceph.mon.a.smithi070.stdout: num_shard_bits : 4 2024-09-21T05:38:47.638 INFO:journalctl@ceph.mon.a.smithi070.stdout: strict_capacity_limit : 0 2024-09-21T05:38:47.638 INFO:journalctl@ceph.mon.a.smithi070.stdout: high_pri_pool_ratio: 0.000 2024-09-21T05:38:47.638 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_cache_compressed: (nil) 2024-09-21T05:38:47.638 INFO:journalctl@ceph.mon.a.smithi070.stdout: persistent_cache: (nil) 2024-09-21T05:38:47.638 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_size: 4096 2024-09-21T05:38:47.638 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_size_deviation: 10 2024-09-21T05:38:47.639 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_restart_interval: 16 2024-09-21T05:38:47.639 INFO:journalctl@ceph.mon.a.smithi070.stdout: index_block_restart_interval: 1 2024-09-21T05:38:47.639 INFO:journalctl@ceph.mon.a.smithi070.stdout: metadata_block_size: 4096 2024-09-21T05:38:47.639 INFO:journalctl@ceph.mon.a.smithi070.stdout: partition_filters: 0 2024-09-21T05:38:47.639 INFO:journalctl@ceph.mon.a.smithi070.stdout: use_delta_encoding: 1 2024-09-21T05:38:47.639 INFO:journalctl@ceph.mon.a.smithi070.stdout: filter_policy: bloomfilter 2024-09-21T05:38:47.639 INFO:journalctl@ceph.mon.a.smithi070.stdout: whole_key_filtering: 1 2024-09-21T05:38:47.639 INFO:journalctl@ceph.mon.a.smithi070.stdout: verify_compression: 0 2024-09-21T05:38:47.639 INFO:journalctl@ceph.mon.a.smithi070.stdout: read_amp_bytes_per_bit: 0 2024-09-21T05:38:47.639 INFO:journalctl@ceph.mon.a.smithi070.stdout: format_version: 5 2024-09-21T05:38:47.639 INFO:journalctl@ceph.mon.a.smithi070.stdout: enable_index_compression: 1 2024-09-21T05:38:47.640 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_align: 0 2024-09-21T05:38:47.640 INFO:journalctl@ceph.mon.a.smithi070.stdout: max_auto_readahead_size: 262144 2024-09-21T05:38:47.640 INFO:journalctl@ceph.mon.a.smithi070.stdout: prepopulate_block_cache: 0 2024-09-21T05:38:47.640 INFO:journalctl@ceph.mon.a.smithi070.stdout: initial_auto_readahead_size: 8192 2024-09-21T05:38:47.640 INFO:journalctl@ceph.mon.a.smithi070.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T05:38:47.640 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T05:38:47.640 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T05:38:47.640 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.compression: NoCompression 2024-09-21T05:38:47.640 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T05:38:47.641 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T05:38:47.641 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T05:38:47.641 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.num_levels: 7 2024-09-21T05:38:47.641 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T05:38:47.641 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T05:38:47.641 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T05:38:47.641 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T05:38:47.641 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T05:38:47.641 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T05:38:47.641 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T05:38:47.641 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T05:38:47.641 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T05:38:47.641 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T05:38:47.642 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T05:38:47.642 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T05:38:47.642 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T05:38:47.642 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T05:38:47.642 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T05:38:47.642 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T05:38:47.642 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T05:38:47.642 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T05:38:47.642 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T05:38:47.642 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T05:38:47.642 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T05:38:47.642 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T05:38:47.642 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T05:38:47.642 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T05:38:47.643 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T05:38:47.643 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T05:38:47.643 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T05:38:47.643 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T05:38:47.643 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T05:38:47.643 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T05:38:47.643 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T05:38:47.643 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T05:38:47.643 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T05:38:47.643 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T05:38:47.643 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T05:38:47.643 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T05:38:47.643 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T05:38:47.644 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T05:38:47.644 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T05:38:47.644 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T05:38:47.644 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T05:38:47.644 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T05:38:47.644 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T05:38:47.644 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T05:38:47.644 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T05:38:47.644 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T05:38:47.644 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T05:38:47.644 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T05:38:47.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T05:38:47.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T05:38:47.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T05:38:47.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T05:38:47.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T05:38:47.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T05:38:47.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.inplace_update_support: 0 2024-09-21T05:38:47.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T05:38:47.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T05:38:47.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T05:38:47.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T05:38:47.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.bloom_locality: 0 2024-09-21T05:38:47.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.max_successive_merges: 0 2024-09-21T05:38:47.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T05:38:47.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T05:38:47.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T05:38:47.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T05:38:47.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.ttl: 2592000 2024-09-21T05:38:47.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T05:38:47.647 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T05:38:47.647 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T05:38:47.647 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.enable_blob_files: false 2024-09-21T05:38:47.647 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.min_blob_size: 0 2024-09-21T05:38:47.647 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T05:38:47.647 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T05:38:47.647 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T05:38:47.647 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T05:38:47.647 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T05:38:47.647 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T05:38:47.647 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T05:38:47.647 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T05:38:47.648 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T05:38:47.648 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T05:38:47.648 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 17bea389-dbac-49e0-b4de-29ab463b55f0 2024-09-21T05:38:47.648 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726897127345024, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T05:38:47.648 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T05:38:47.648 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726897127346225, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91614, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 285, "table_properties": {"data_size": 89661, "index_size": 273, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11730, "raw_average_key_size": 48, "raw_value_size": 82969, "raw_average_value_size": 340, "num_data_blocks": 12, "num_entries": 244, "num_filter_entries": 244, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726897127, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "17bea389-dbac-49e0-b4de-29ab463b55f0", "db_session_id": "QO52F1AXNRRQ3M03UR5F", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T05:38:47.648 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726897127346320, "job": 1, "event": "recovery_finished"} 2024-09-21T05:38:47.648 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T05:38:47.648 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T05:38:47.648 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55da9e992a80 2024-09-21T05:38:47.649 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: DB pointer 0x55da9f738000 2024-09-21T05:38:47.649 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T05:38:47.649 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T05:38:47.649 INFO:journalctl@ceph.mon.a.smithi070.stdout: ** DB Stats ** 2024-09-21T05:38:47.649 INFO:journalctl@ceph.mon.a.smithi070.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T05:38:47.649 INFO:journalctl@ceph.mon.a.smithi070.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T05:38:47.649 INFO:journalctl@ceph.mon.a.smithi070.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T05:38:47.649 INFO:journalctl@ceph.mon.a.smithi070.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T05:38:47.649 INFO:journalctl@ceph.mon.a.smithi070.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T05:38:47.649 INFO:journalctl@ceph.mon.a.smithi070.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T05:38:47.649 INFO:journalctl@ceph.mon.a.smithi070.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T05:38:47.649 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2024-09-21T05:38:47.650 INFO:journalctl@ceph.mon.a.smithi070.stdout: ** Compaction Stats [default] ** 2024-09-21T05:38:47.650 INFO:journalctl@ceph.mon.a.smithi070.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T05:38:47.650 INFO:journalctl@ceph.mon.a.smithi070.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T05:38:47.650 INFO:journalctl@ceph.mon.a.smithi070.stdout: L0 2/0 91.33 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 128.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T05:38:47.650 INFO:journalctl@ceph.mon.a.smithi070.stdout: Sum 2/0 91.33 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 128.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T05:38:47.650 INFO:journalctl@ceph.mon.a.smithi070.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 128.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T05:38:47.650 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2024-09-21T05:38:47.650 INFO:journalctl@ceph.mon.a.smithi070.stdout: ** Compaction Stats [default] ** 2024-09-21T05:38:47.650 INFO:journalctl@ceph.mon.a.smithi070.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T05:38:47.650 INFO:journalctl@ceph.mon.a.smithi070.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T05:38:47.650 INFO:journalctl@ceph.mon.a.smithi070.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 128.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T05:38:47.650 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2024-09-21T05:38:47.650 INFO:journalctl@ceph.mon.a.smithi070.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T05:38:47.651 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2024-09-21T05:38:47.651 INFO:journalctl@ceph.mon.a.smithi070.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T05:38:47.651 INFO:journalctl@ceph.mon.a.smithi070.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T05:38:47.651 INFO:journalctl@ceph.mon.a.smithi070.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T05:38:47.651 INFO:journalctl@ceph.mon.a.smithi070.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T05:38:47.651 INFO:journalctl@ceph.mon.a.smithi070.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T05:38:47.651 INFO:journalctl@ceph.mon.a.smithi070.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T05:38:47.651 INFO:journalctl@ceph.mon.a.smithi070.stdout: Cumulative compaction: 0.00 GB write, 25.71 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T05:38:47.651 INFO:journalctl@ceph.mon.a.smithi070.stdout: Interval compaction: 0.00 GB write, 25.71 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T05:38:47.651 INFO:journalctl@ceph.mon.a.smithi070.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T05:38:47.651 INFO:journalctl@ceph.mon.a.smithi070.stdout: Block cache BinnedLRUCache@0x55da9a933610#2 capacity: 512.00 MB usage: 1.31 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T05:38:47.651 INFO:journalctl@ceph.mon.a.smithi070.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-21T05:38:47.652 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2024-09-21T05:38:47.652 INFO:journalctl@ceph.mon.a.smithi070.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T05:38:47.652 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: starting mon.a rank 0 at public addrs [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] at bind addrs [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:38:47.652 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: mon.a@-1(???) e1 preinit fsid 96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:38:47.652 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: mon.a@-1(???).mds e1 new map 2024-09-21T05:38:47.652 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: mon.a@-1(???).mds e1 print_map 2024-09-21T05:38:47.652 INFO:journalctl@ceph.mon.a.smithi070.stdout: e1 2024-09-21T05:38:47.652 INFO:journalctl@ceph.mon.a.smithi070.stdout: btime 2024-09-21T05:38:42:297125+0000 2024-09-21T05:38:47.652 INFO:journalctl@ceph.mon.a.smithi070.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T05:38:47.652 INFO:journalctl@ceph.mon.a.smithi070.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T05:38:47.652 INFO:journalctl@ceph.mon.a.smithi070.stdout: legacy client fscid: -1 2024-09-21T05:38:47.652 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2024-09-21T05:38:47.652 INFO:journalctl@ceph.mon.a.smithi070.stdout: No filesystems configured 2024-09-21T05:38:47.652 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T05:38:47.653 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T05:38:47.653 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T05:38:47.653 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T05:38:47.653 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T05:38:47.653 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 bash[30962]: d741ecc9460fce3a2d7752ab1417e65ab7c69540ef10cd6d103a3341ef4a60b2 2024-09-21T05:38:47.653 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 systemd[1]: Started Ceph mon.a for 96c6636e-77db-11ef-baf5-efdc52797490. 2024-09-21T05:38:47.653 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T05:38:47.653 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: monmap epoch 1 2024-09-21T05:38:47.653 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: fsid 96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:38:47.653 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: last_changed 2024-09-21T05:38:39.360099+0000 2024-09-21T05:38:47.653 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: created 2024-09-21T05:38:39.360099+0000 2024-09-21T05:38:47.653 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: min_mon_release 19 (squid) 2024-09-21T05:38:47.653 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: election_strategy: 1 2024-09-21T05:38:47.653 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-21T05:38:47.653 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: fsmap 2024-09-21T05:38:47.653 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T05:38:47.654 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:47 smithi070 ceph-mon[30981]: mgrmap e1: no daemons active 2024-09-21T05:38:48.515 INFO:teuthology.orchestra.run.smithi070.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T05:38:48.537 INFO:teuthology.orchestra.run.smithi070.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T05:38:48.537 INFO:teuthology.orchestra.run.smithi070.stdout:Creating mgr... 2024-09-21T05:38:48.538 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T05:38:48.538 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T05:38:48.984 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-96c6636e-77db-11ef-baf5-efdc52797490@mgr.x 2024-09-21T05:38:48.984 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Failed to reset failed state of unit ceph-96c6636e-77db-11ef-baf5-efdc52797490@mgr.x.service: Unit ceph-96c6636e-77db-11ef-baf5-efdc52797490@mgr.x.service not loaded. 2024-09-21T05:38:49.238 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-96c6636e-77db-11ef-baf5-efdc52797490.target.wants/ceph-96c6636e-77db-11ef-baf5-efdc52797490@mgr.x.service → /etc/systemd/system/ceph-96c6636e-77db-11ef-baf5-efdc52797490@.service. 2024-09-21T05:38:49.244 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:48 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1054234738' entity='client.admin' 2024-09-21T05:38:49.745 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:38:49 smithi070 podman[31192]: 2024-09-21 05:38:49.369227464 +0000 UTC m=+0.015846901 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:38:50.995 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:38:50 smithi070 podman[31192]: 2024-09-21 05:38:50.548602255 +0000 UTC m=+1.195221691 container create 85b0c3a2a65042de3f6a5a445b338e4e80c156264e94c1ffbdf8fc4d540e246c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T05:38:52.745 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:38:52 smithi070 podman[31192]: 2024-09-21 05:38:52.276567939 +0000 UTC m=+2.923187369 container init 85b0c3a2a65042de3f6a5a445b338e4e80c156264e94c1ffbdf8fc4d540e246c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True) 2024-09-21T05:38:52.745 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:38:52 smithi070 podman[31192]: 2024-09-21 05:38:52.280496868 +0000 UTC m=+2.927116304 container start 85b0c3a2a65042de3f6a5a445b338e4e80c156264e94c1ffbdf8fc4d540e246c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2) 2024-09-21T05:38:53.220 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T05:38:53.220 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout disabled 2024-09-21T05:38:53.228 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T05:38:53.228 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2024-09-21T05:38:53.228 INFO:teuthology.orchestra.run.smithi070.stdout:firewalld.service is not enabled 2024-09-21T05:38:53.228 INFO:teuthology.orchestra.run.smithi070.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T05:38:53.240 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T05:38:53.240 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout disabled 2024-09-21T05:38:53.249 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T05:38:53.249 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2024-09-21T05:38:53.249 INFO:teuthology.orchestra.run.smithi070.stdout:firewalld.service is not enabled 2024-09-21T05:38:53.249 INFO:teuthology.orchestra.run.smithi070.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-21T05:38:53.249 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mgr to start... 2024-09-21T05:38:53.249 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mgr... 2024-09-21T05:38:53.495 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:38:53 smithi070 bash[31192]: 85b0c3a2a65042de3f6a5a445b338e4e80c156264e94c1ffbdf8fc4d540e246c 2024-09-21T05:38:53.495 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:38:53 smithi070 systemd[1]: Started Ceph mgr.x for 96c6636e-77db-11ef-baf5-efdc52797490. 2024-09-21T05:38:56.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:56 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1133360741' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T05:38:58.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:57 smithi070 ceph-mon[30981]: Activating manager daemon x 2024-09-21T05:38:58.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:57 smithi070 ceph-mon[30981]: mgrmap e2: x(active, starting, since 0.00356987s) 2024-09-21T05:38:58.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:57 smithi070 ceph-mon[30981]: from='mgr.14100 172.21.15.70:0/2187041476' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T05:38:58.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:57 smithi070 ceph-mon[30981]: from='mgr.14100 172.21.15.70:0/2187041476' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T05:38:58.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:57 smithi070 ceph-mon[30981]: from='mgr.14100 172.21.15.70:0/2187041476' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T05:38:58.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:57 smithi070 ceph-mon[30981]: from='mgr.14100 172.21.15.70:0/2187041476' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:38:58.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:57 smithi070 ceph-mon[30981]: from='mgr.14100 172.21.15.70:0/2187041476' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T05:38:58.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:57 smithi070 ceph-mon[30981]: Manager daemon x is now available 2024-09-21T05:38:58.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:57 smithi070 ceph-mon[30981]: from='mgr.14100 172.21.15.70:0/2187041476' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T05:38:58.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:57 smithi070 ceph-mon[30981]: from='mgr.14100 172.21.15.70:0/2187041476' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T05:38:58.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:57 smithi070 ceph-mon[30981]: from='mgr.14100 172.21.15.70:0/2187041476' entity='mgr.x' 2024-09-21T05:38:58.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:57 smithi070 ceph-mon[30981]: from='mgr.14100 172.21.15.70:0/2187041476' entity='mgr.x' 2024-09-21T05:38:58.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:57 smithi070 ceph-mon[30981]: from='mgr.14100 172.21.15.70:0/2187041476' entity='mgr.x' 2024-09-21T05:38:59.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:38:59 smithi070 ceph-mon[30981]: mgrmap e3: x(active, since 1.00806s) 2024-09-21T05:39:00.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:00 smithi070 ceph-mon[30981]: mgrmap e4: x(active, since 2s) 2024-09-21T05:39:02.329 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-21T05:39:02.332 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-09-21T05:39:02.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsid": "96c6636e-77db-11ef-baf5-efdc52797490", 2024-09-21T05:39:02.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T05:39:02.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T05:39:02.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T05:39:02.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T05:39:02.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:39:02.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T05:39:02.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T05:39:02.333 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 0 2024-09-21T05:39:02.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-09-21T05:39:02.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T05:39:02.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T05:39:02.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-09-21T05:39:02.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-21T05:39:02.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T05:39:02.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:39:02.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T05:39:02.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T05:39:02.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:39:02.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T05:39:02.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:39:02.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T05:39:02.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T05:39:02.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T05:39:02.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T05:39:02.338 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T05:39:02.339 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T05:39:02.339 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:39:02.339 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T05:39:02.339 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T05:39:02.339 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T05:39:02.339 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T05:39:02.339 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T05:39:02.339 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T05:39:02.339 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T05:39:02.339 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T05:39:02.339 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T05:39:02.339 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:39:02.340 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T05:39:02.340 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:39:02.340 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T05:38:42:297125+0000", 2024-09-21T05:39:02.340 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T05:39:02.340 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T05:39:02.340 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:39:02.340 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T05:39:02.340 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T05:39:02.340 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T05:39:02.340 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T05:39:02.340 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T05:39:02.340 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T05:39:02.340 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T05:39:02.341 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-09-21T05:39:02.341 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T05:39:02.341 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:39:02.341 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T05:39:02.341 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:39:02.341 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T05:38:42.297906+0000", 2024-09-21T05:39:02.341 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T05:39:02.341 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:39:02.341 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T05:39:02.341 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-09-21T05:39:02.341 INFO:teuthology.orchestra.run.smithi070.stdout:mgr not available, waiting (1/15)... 2024-09-21T05:39:05.462 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:05 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/4128030007' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T05:39:05.587 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-21T05:39:05.655 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-09-21T05:39:05.655 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsid": "96c6636e-77db-11ef-baf5-efdc52797490", 2024-09-21T05:39:05.655 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T05:39:05.655 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T05:39:05.655 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T05:39:05.655 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T05:39:05.655 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:39:05.655 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T05:39:05.655 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T05:39:05.656 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 0 2024-09-21T05:39:05.656 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-09-21T05:39:05.656 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T05:39:05.656 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T05:39:05.656 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-09-21T05:39:05.656 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_age": 17, 2024-09-21T05:39:05.656 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T05:39:05.656 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:39:05.656 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T05:39:05.656 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T05:39:05.656 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:39:05.656 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T05:39:05.656 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:39:05.656 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T05:39:05.656 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T05:39:05.657 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T05:39:05.657 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T05:39:05.657 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T05:39:05.657 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T05:39:05.660 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:39:05.660 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T05:39:05.660 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T05:39:05.660 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T05:39:05.660 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T05:39:05.660 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T05:39:05.660 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T05:39:05.660 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T05:39:05.660 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T05:39:05.660 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T05:39:05.660 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:39:05.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T05:39:05.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:39:05.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T05:38:42:297125+0000", 2024-09-21T05:39:05.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T05:39:05.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T05:39:05.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:39:05.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T05:39:05.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T05:39:05.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T05:39:05.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T05:39:05.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T05:39:05.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T05:39:05.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T05:39:05.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-09-21T05:39:05.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T05:39:05.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:39:05.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T05:39:05.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:39:05.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T05:38:42.297906+0000", 2024-09-21T05:39:05.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T05:39:05.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:39:05.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T05:39:05.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-09-21T05:39:05.662 INFO:teuthology.orchestra.run.smithi070.stdout:mgr is available 2024-09-21T05:39:06.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:06 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3962367989' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T05:39:06.782 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-21T05:39:06.783 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T05:39:06.783 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout fsid = 96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:39:06.783 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T05:39:06.783 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.70:3300,v1:172.21.15.70:6789] 2024-09-21T05:39:06.783 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T05:39:06.783 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T05:39:06.783 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T05:39:06.783 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T05:39:06.783 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-21T05:39:06.783 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T05:39:06.783 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T05:39:06.783 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-21T05:39:06.783 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T05:39:06.783 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T05:39:06.783 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T05:39:06.784 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T05:39:06.784 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T05:39:06.784 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T05:39:06.784 INFO:teuthology.orchestra.run.smithi070.stdout:Enabling cephadm module... 2024-09-21T05:39:07.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:07 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/913917911' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-21T05:39:07.745 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:07 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: ignoring --setuser ceph since I am not root 2024-09-21T05:39:07.745 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:07 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: ignoring --setgroup ceph since I am not root 2024-09-21T05:39:08.730 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:08 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/913917911' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T05:39:08.730 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:08 smithi070 ceph-mon[30981]: mgrmap e5: x(active, since 10s) 2024-09-21T05:39:09.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:09 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3644991090' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T05:39:09.793 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-09-21T05:39:09.794 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T05:39:09.794 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T05:39:09.794 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T05:39:09.794 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T05:39:09.794 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-09-21T05:39:09.794 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for the mgr to restart... 2024-09-21T05:39:09.794 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mgr epoch 5... 2024-09-21T05:39:12.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:12 smithi070 ceph-mon[30981]: Active manager daemon x restarted 2024-09-21T05:39:12.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:12 smithi070 ceph-mon[30981]: Activating manager daemon x 2024-09-21T05:39:12.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:12 smithi070 ceph-mon[30981]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T05:39:12.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:12 smithi070 ceph-mon[30981]: mgrmap e6: x(active, starting, since 0.00391606s) 2024-09-21T05:39:12.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:12 smithi070 ceph-mon[30981]: from='mgr.14116 172.21.15.70:0/522857742' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:39:12.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:12 smithi070 ceph-mon[30981]: from='mgr.14116 172.21.15.70:0/522857742' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T05:39:12.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:12 smithi070 ceph-mon[30981]: from='mgr.14116 172.21.15.70:0/522857742' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T05:39:12.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:12 smithi070 ceph-mon[30981]: from='mgr.14116 172.21.15.70:0/522857742' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T05:39:12.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:12 smithi070 ceph-mon[30981]: from='mgr.14116 172.21.15.70:0/522857742' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T05:39:12.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:12 smithi070 ceph-mon[30981]: Manager daemon x is now available 2024-09-21T05:39:14.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:14 smithi070 ceph-mon[30981]: from='mgr.14116 172.21.15.70:0/522857742' entity='mgr.x' 2024-09-21T05:39:14.147 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:14 smithi070 ceph-mon[30981]: from='mgr.14116 172.21.15.70:0/522857742' entity='mgr.x' 2024-09-21T05:39:14.147 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:14 smithi070 ceph-mon[30981]: Found migration_current of "None". Setting to last migration. 2024-09-21T05:39:14.147 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:14 smithi070 ceph-mon[30981]: from='mgr.14116 172.21.15.70:0/522857742' entity='mgr.x' 2024-09-21T05:39:14.147 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:14 smithi070 ceph-mon[30981]: from='mgr.14116 172.21.15.70:0/522857742' entity='mgr.x' 2024-09-21T05:39:14.147 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:14 smithi070 ceph-mon[30981]: from='mgr.14116 172.21.15.70:0/522857742' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:39:14.147 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:14 smithi070 ceph-mon[30981]: from='mgr.14116 172.21.15.70:0/522857742' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:39:14.147 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:14 smithi070 ceph-mon[30981]: from='mgr.14116 172.21.15.70:0/522857742' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T05:39:14.147 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:14 smithi070 ceph-mon[30981]: from='mgr.14116 172.21.15.70:0/522857742' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T05:39:14.147 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:14 smithi070 ceph-mon[30981]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T05:39:14.147 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:14 smithi070 ceph-mon[30981]: mgrmap e7: x(active, since 1.00598s) 2024-09-21T05:39:14.147 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:14 smithi070 ceph-mon[30981]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T05:39:14.149 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-09-21T05:39:14.149 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T05:39:14.149 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T05:39:14.149 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-09-21T05:39:14.149 INFO:teuthology.orchestra.run.smithi070.stdout:mgr epoch 5 is available 2024-09-21T05:39:14.149 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying orchestrator module is enabled... 2024-09-21T05:39:14.424 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:14 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T05:39:14.180+0000 7f410def2640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:05:39:14] ENGINE Error in HTTPServer.serve 2024-09-21T05:39:14.424 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:14 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: Traceback (most recent call last): 2024-09-21T05:39:14.425 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:14 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:39:14.425 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:14 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: self._connections.run(self.expiration_interval) 2024-09-21T05:39:14.425 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:14 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:39:14.425 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:14 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: self._run(expiration_interval) 2024-09-21T05:39:14.425 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:14 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:39:14.425 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:14 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:39:14.425 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:14 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:39:14.425 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:14 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:39:14.425 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:14 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:39:14.425 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:14 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: s = self.context.wrap_socket( 2024-09-21T05:39:14.425 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:14 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:39:14.425 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:14 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: return self.sslsocket_class._create( 2024-09-21T05:39:14.425 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:14 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:39:14.425 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:14 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: self.do_handshake() 2024-09-21T05:39:14.426 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:14 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:39:14.426 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:14 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: self._sslobj.do_handshake() 2024-09-21T05:39:14.426 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:14 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:39:14.426 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:14 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T05:39:15.369 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:15 smithi070 ceph-mon[30981]: [21/Sep/2024:05:39:13] ENGINE Bus STARTING 2024-09-21T05:39:15.369 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:15 smithi070 ceph-mon[30981]: [21/Sep/2024:05:39:14] ENGINE Serving on http://172.21.15.70:8765 2024-09-21T05:39:15.369 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:15 smithi070 ceph-mon[30981]: [21/Sep/2024:05:39:14] ENGINE Serving on https://172.21.15.70:7150 2024-09-21T05:39:15.369 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:15 smithi070 ceph-mon[30981]: [21/Sep/2024:05:39:14] ENGINE Bus STARTED 2024-09-21T05:39:15.369 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:15 smithi070 ceph-mon[30981]: from='mgr.14116 172.21.15.70:0/522857742' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:39:15.370 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:15 smithi070 ceph-mon[30981]: [21/Sep/2024:05:39:14] ENGINE Error in HTTPServer.serve 2024-09-21T05:39:15.370 INFO:journalctl@ceph.mon.a.smithi070.stdout: Traceback (most recent call last): 2024-09-21T05:39:15.370 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:39:15.370 INFO:journalctl@ceph.mon.a.smithi070.stdout: self._connections.run(self.expiration_interval) 2024-09-21T05:39:15.370 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:39:15.370 INFO:journalctl@ceph.mon.a.smithi070.stdout: self._run(expiration_interval) 2024-09-21T05:39:15.370 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:39:15.370 INFO:journalctl@ceph.mon.a.smithi070.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:39:15.370 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:39:15.370 INFO:journalctl@ceph.mon.a.smithi070.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:39:15.370 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:39:15.370 INFO:journalctl@ceph.mon.a.smithi070.stdout: s = self.context.wrap_socket( 2024-09-21T05:39:15.370 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:39:15.370 INFO:journalctl@ceph.mon.a.smithi070.stdout: return self.sslsocket_class._create( 2024-09-21T05:39:15.370 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:39:15.371 INFO:journalctl@ceph.mon.a.smithi070.stdout: self.do_handshake() 2024-09-21T05:39:15.371 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:39:15.371 INFO:journalctl@ceph.mon.a.smithi070.stdout: self._sslobj.do_handshake() 2024-09-21T05:39:15.371 INFO:journalctl@ceph.mon.a.smithi070.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:39:15.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:15 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1122194071' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-21T05:39:15.646 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2024-09-21T05:39:15.647 INFO:teuthology.orchestra.run.smithi070.stdout:Setting orchestrator backend to cephadm... 2024-09-21T05:39:16.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:16 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1122194071' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-21T05:39:16.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:16 smithi070 ceph-mon[30981]: mgrmap e8: x(active, since 2s) 2024-09-21T05:39:17.386 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:17 smithi070 ceph-mon[30981]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:17.386 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:17 smithi070 ceph-mon[30981]: from='mgr.14116 172.21.15.70:0/522857742' entity='mgr.x' 2024-09-21T05:39:17.386 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:17 smithi070 ceph-mon[30981]: from='mgr.14116 172.21.15.70:0/522857742' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:39:18.016 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T05:39:18.016 INFO:teuthology.orchestra.run.smithi070.stdout:Generating ssh key... 2024-09-21T05:39:18.452 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:18 smithi070 ceph-mon[30981]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:19.188 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:18 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: Generating public/private rsa key pair. 2024-09-21T05:39:19.188 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:18 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: Your identification has been saved in /tmp/tmp90ssvr16/key 2024-09-21T05:39:19.188 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:18 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: Your public key has been saved in /tmp/tmp90ssvr16/key.pub 2024-09-21T05:39:19.188 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:18 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: The key fingerprint is: 2024-09-21T05:39:19.189 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:18 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: SHA256:rVN+2nCov8R+IErw2jA+wCbk6yVyEFJOuAVMJmA9Dcc ceph-96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:39:19.189 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:18 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: The key's randomart image is: 2024-09-21T05:39:19.189 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:18 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: +---[RSA 3072]----+ 2024-09-21T05:39:19.189 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:18 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: |B*+.+. | 2024-09-21T05:39:19.189 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:18 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: |==.o.E | 2024-09-21T05:39:19.189 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:18 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: |oo. . | 2024-09-21T05:39:19.189 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:18 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: |oo . . | 2024-09-21T05:39:19.189 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:18 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: |+. o S o | 2024-09-21T05:39:19.189 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:18 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: |.o+ o o .=.. | 2024-09-21T05:39:19.189 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:18 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: |.+o+ * .o.*.o | 2024-09-21T05:39:19.189 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:18 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: |.oo + o = *. | 2024-09-21T05:39:19.189 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:18 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: |.. . ..=o. | 2024-09-21T05:39:19.189 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:18 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: +----[SHA256]-----+ 2024-09-21T05:39:20.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:19 smithi070 ceph-mon[30981]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:20.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:19 smithi070 ceph-mon[30981]: Generating ssh key... 2024-09-21T05:39:20.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:19 smithi070 ceph-mon[30981]: from='mgr.14116 172.21.15.70:0/522857742' entity='mgr.x' 2024-09-21T05:39:20.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:19 smithi070 ceph-mon[30981]: from='mgr.14116 172.21.15.70:0/522857742' entity='mgr.x' 2024-09-21T05:39:20.630 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRu11eaip2l3r47BtqN8+90AbX8nRJNT4QZiGhNAgbjMYmf4IKIJ+HnZO3/iEVr0QADhjV8T7EbMms2KSa9pyRfN8MFcin1lErswrfNQNCzaBs03/VrH8nKsS/d1QQ0zCZZGN9ZazonXoxdm52vwjIwu8Go7IEZeW7LlaL8KSyXRbCzZzzJIn3bzPYoga7MTzBMtT/X5EwjV8cez34b3IsC/mCDxaW5wzaAd6gPHbLIuA6SzW+KUp11eaLbzJ4YBpv4Qy2//G2r9ZmxHhjWh6qHiw91hgDPr8sx+PQ5J6LAn8Lr/KKa43PkjnfxxNSv0Lds9nZBpFxPHmvmUQMe8Wngqf8DXc60Rv5ouFqREVAVhOSu0DFWlWk4yrUjNvllAP9GupsadlU2KLtgVlDfYm31jF5a6WZUfjM++S7OBS6ztnclCeBCm1M8Q5lAPVSl3gIF5YGzje00+WftYPCTikWbaMAsZiOjCdjwz2W+AUbvD2RqdYqwKB+VnEindReXvs= ceph-96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:39:20.631 INFO:teuthology.orchestra.run.smithi070.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T05:39:20.631 INFO:teuthology.orchestra.run.smithi070.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T05:39:20.638 INFO:teuthology.orchestra.run.smithi070.stdout:Adding host smithi070... 2024-09-21T05:39:21.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:20 smithi070 ceph-mon[30981]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:22.039 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:21 smithi070 ceph-mon[30981]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi070", "addr": "172.21.15.70", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:22.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:22 smithi070 ceph-mon[30981]: Deploying cephadm binary to smithi070 2024-09-21T05:39:24.988 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout Added host 'smithi070' with addr '172.21.15.70' 2024-09-21T05:39:24.988 INFO:teuthology.orchestra.run.smithi070.stdout:Deploying unmanaged mon service... 2024-09-21T05:39:25.641 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:25 smithi070 ceph-mon[30981]: from='mgr.14116 172.21.15.70:0/522857742' entity='mgr.x' 2024-09-21T05:39:25.641 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:25 smithi070 ceph-mon[30981]: Added host smithi070 2024-09-21T05:39:25.641 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:25 smithi070 ceph-mon[30981]: from='mgr.14116 172.21.15.70:0/522857742' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:39:26.422 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T05:39:26.422 INFO:teuthology.orchestra.run.smithi070.stdout:Deploying unmanaged mgr service... 2024-09-21T05:39:26.672 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:26 smithi070 ceph-mon[30981]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:26.672 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:26 smithi070 ceph-mon[30981]: Saving service mon spec with placement count:5 2024-09-21T05:39:26.672 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:26 smithi070 ceph-mon[30981]: from='mgr.14116 172.21.15.70:0/522857742' entity='mgr.x' 2024-09-21T05:39:27.713 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T05:39:28.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:28 smithi070 ceph-mon[30981]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:28.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:28 smithi070 ceph-mon[30981]: Saving service mgr spec with placement count:2 2024-09-21T05:39:28.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:28 smithi070 ceph-mon[30981]: from='mgr.14116 172.21.15.70:0/522857742' entity='mgr.x' 2024-09-21T05:39:29.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:29 smithi070 ceph-mon[30981]: from='mgr.14116 172.21.15.70:0/522857742' entity='mgr.x' 2024-09-21T05:39:29.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:29 smithi070 ceph-mon[30981]: from='mgr.14116 172.21.15.70:0/522857742' entity='mgr.x' 2024-09-21T05:39:29.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:29 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3474677758' entity='client.admin' 2024-09-21T05:39:31.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:30 smithi070 ceph-mon[30981]: from='mgr.14116 172.21.15.70:0/522857742' entity='mgr.x' 2024-09-21T05:39:31.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:30 smithi070 ceph-mon[30981]: from='mgr.14116 172.21.15.70:0/522857742' entity='mgr.x' 2024-09-21T05:39:31.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:30 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1423758380' entity='client.admin' 2024-09-21T05:39:31.541 INFO:teuthology.orchestra.run.smithi070.stdout:Enabling the dashboard module... 2024-09-21T05:39:32.452 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:32 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/4043766039' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-21T05:39:32.452 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:32 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: ignoring --setuser ceph since I am not root 2024-09-21T05:39:32.453 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:32 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: ignoring --setgroup ceph since I am not root 2024-09-21T05:39:33.675 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:33 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/4043766039' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T05:39:33.675 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:33 smithi070 ceph-mon[30981]: mgrmap e9: x(active, since 19s) 2024-09-21T05:39:34.666 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:34 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1412283300' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T05:39:34.901 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-09-21T05:39:34.901 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-21T05:39:34.901 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T05:39:34.901 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T05:39:34.901 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T05:39:34.901 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-09-21T05:39:34.901 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for the mgr to restart... 2024-09-21T05:39:34.901 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mgr epoch 9... 2024-09-21T05:39:37.697 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:37 smithi070 ceph-mon[30981]: Active manager daemon x restarted 2024-09-21T05:39:37.697 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:37 smithi070 ceph-mon[30981]: Activating manager daemon x 2024-09-21T05:39:37.697 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:37 smithi070 ceph-mon[30981]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T05:39:37.698 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:37 smithi070 ceph-mon[30981]: mgrmap e10: x(active, starting, since 0.00415947s) 2024-09-21T05:39:37.698 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:37 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:39:37.698 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:37 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T05:39:37.698 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:37 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T05:39:37.698 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:37 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T05:39:37.698 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:37 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T05:39:37.698 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:37 smithi070 ceph-mon[30981]: Manager daemon x is now available 2024-09-21T05:39:38.706 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:38 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:39:38.706 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:38 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T05:39:38.706 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:38 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T05:39:38.706 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:38 smithi070 ceph-mon[30981]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T05:39:38.706 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:38 smithi070 ceph-mon[30981]: mgrmap e11: x(active, since 1.00645s) 2024-09-21T05:39:38.706 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:38 smithi070 ceph-mon[30981]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T05:39:38.995 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:38 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T05:39:38.878+0000 7f996e858640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:05:39:38] ENGINE Error in HTTPServer.serve 2024-09-21T05:39:38.996 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:38 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: Traceback (most recent call last): 2024-09-21T05:39:38.996 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:38 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:39:38.996 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:38 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: self._connections.run(self.expiration_interval) 2024-09-21T05:39:38.996 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:38 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:39:38.996 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:38 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: self._run(expiration_interval) 2024-09-21T05:39:38.996 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:38 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:39:38.996 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:38 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:39:38.996 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:38 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:39:38.996 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:38 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:39:38.997 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:38 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:39:38.997 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:38 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: s = self.context.wrap_socket( 2024-09-21T05:39:38.997 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:38 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:39:38.997 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:38 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: return self.sslsocket_class._create( 2024-09-21T05:39:38.997 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:38 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:39:38.997 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:38 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: self.do_handshake() 2024-09-21T05:39:38.997 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:38 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:39:38.997 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:38 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: self._sslobj.do_handshake() 2024-09-21T05:39:38.997 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:38 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:39:38.997 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:39:38 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T05:39:39.008 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-09-21T05:39:39.009 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-21T05:39:39.009 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T05:39:39.009 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-09-21T05:39:39.010 INFO:teuthology.orchestra.run.smithi070.stdout:mgr epoch 9 is available 2024-09-21T05:39:39.010 INFO:teuthology.orchestra.run.smithi070.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-21T05:39:39.576 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:39 smithi070 ceph-mon[30981]: [21/Sep/2024:05:39:38] ENGINE Bus STARTING 2024-09-21T05:39:39.576 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:39 smithi070 ceph-mon[30981]: [21/Sep/2024:05:39:38] ENGINE Serving on https://172.21.15.70:7150 2024-09-21T05:39:39.576 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:39 smithi070 ceph-mon[30981]: [21/Sep/2024:05:39:38] ENGINE Error in HTTPServer.serve 2024-09-21T05:39:39.577 INFO:journalctl@ceph.mon.a.smithi070.stdout: Traceback (most recent call last): 2024-09-21T05:39:39.577 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:39:39.577 INFO:journalctl@ceph.mon.a.smithi070.stdout: self._connections.run(self.expiration_interval) 2024-09-21T05:39:39.577 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:39:39.577 INFO:journalctl@ceph.mon.a.smithi070.stdout: self._run(expiration_interval) 2024-09-21T05:39:39.577 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:39:39.577 INFO:journalctl@ceph.mon.a.smithi070.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:39:39.577 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:39:39.577 INFO:journalctl@ceph.mon.a.smithi070.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:39:39.577 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:39:39.577 INFO:journalctl@ceph.mon.a.smithi070.stdout: s = self.context.wrap_socket( 2024-09-21T05:39:39.577 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:39:39.577 INFO:journalctl@ceph.mon.a.smithi070.stdout: return self.sslsocket_class._create( 2024-09-21T05:39:39.577 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:39:39.577 INFO:journalctl@ceph.mon.a.smithi070.stdout: self.do_handshake() 2024-09-21T05:39:39.577 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:39:39.578 INFO:journalctl@ceph.mon.a.smithi070.stdout: self._sslobj.do_handshake() 2024-09-21T05:39:39.578 INFO:journalctl@ceph.mon.a.smithi070.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:39:39.578 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:39 smithi070 ceph-mon[30981]: [21/Sep/2024:05:39:38] ENGINE Serving on http://172.21.15.70:8765 2024-09-21T05:39:39.578 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:39 smithi070 ceph-mon[30981]: [21/Sep/2024:05:39:38] ENGINE Bus STARTED 2024-09-21T05:39:40.686 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:40 smithi070 ceph-mon[30981]: mgrmap e12: x(active, since 2s) 2024-09-21T05:39:40.686 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:40 smithi070 ceph-mon[30981]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:40.686 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:40 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:39:41.384 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+zCCAuOgAwIBAgIUX/fkAiAPDFBZlRrUrzEm5o/T+TIwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkyMTA1Mzk0MFoXDTM0\nMDkyMjA1Mzk0MFowFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjcwMIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEA6KBNR/NixV/zB+BdpiXhTQMdGzjseEdifGcs\nV6t1M6lvlJp2ku3VQkdx07vYizkF/XQTZqiBBDNts/ldqmwu753zIQROQNc9xQSK\nAwe8lxVmH2WrrLJDZpfMlXpSTXu1IYan8H5wAJOy4sC50fz2YCETZ5Hoe9cWjzTF\n30wLFoWFUn5RCyIjvG85SF3OpdV+uBUoF/RPlvr1EfXwbAPgWji3zJ7LjvQX569K\nBJ7JlQLzGUcqWfpYtqgEh/iKxSga7697TpiY30+G5a+VkdnRRk55a6oyuGbw7Q3v\nUvZd/Toqxjq/pH08Pf+qE8PXra7ys6hsdlF5g2cXA424SwlcVGt0MUn59U+oeim6\nTQa/+s6o/yhuLNvdPKfoiwWxq3U19HiK1hiJriLJAy6/DK3osPaCiUa/bRQIhHok\nDHBcrW9iEquU6g8SvATOEeJCyIIZOGh/H/bSZ69wi5P1aacPpIzj7uRg+DGv3bG3\nqx4+6oCNphZ9ets2xB/QneMHqRNGR1R8o11QckA7CUwM5zRgC5+buKQk6RTm33qA\n4mCT7rBZ99cfFwx7jDd8DDHxROX+1GkFsmfKKkGZARN4Jf6F+a4fYvgE5Otd5G0l\nMgebB/cqO8BeNFrXc2ONOr4GWZsG+xz2Jf1IfH+QW9bn9O0y8IOSyYQM2N3igLeT\nKETQL4sCAwEAAaM/MD0wLQYDVR0RBCYwJIIJc21pdGhpMDcwghFkYXNoYm9hcmRf\nc2VydmVyc4cErBUPRjAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQA3\ntGS0TkBOON19/rnBtTJ1g6tHsMnePUNhpKb7twatpIF8tVq0tc9pPYqaNby3Z9KD\njjnox+5OXhwwgz9e4uZ99CekoIDDDc9QaZz186sTKCAj5p2mnxAXzsGKbvIknpeC\nKYwFK7q4Vz0yLXjzX+Ktc4pVZ8w/aQH//ia7zlH6OXwNgwQrgHrB6qXYaZPbsH9M\nXjgBeNILq434M5MbDkEFXpCTtmWt4V0ZZumhwUs5kOrPmbbRfnE/+UW5QiNN6+C1\nmWYdCsS0Pk70lPxQq3QjwG8z+SU1o8ArBOaN/BtlBklTsZ8BpMdsJh/n8yQgvX16\nPW3e3HV3EMky63+EgZETS6X6cVF0JWr5bCf+nhdEZ8mQzvSn1SwYK+lLNiJlmzHE\nGw4te/O4b//irnwdMNAKvBQOF/EcsPYecVnzLTzBtb5vbNlDZgYWAoTm6+wy7woG\nJeCObMNUXHakTHepfz4X47o1HH7KD5CA5AK8nTU8tpwTaLj27YGYRqKl4LixCRLK\nNRfbjSqpu6QASK2iTOPn5vK4UteC5ir+5jnYR5b/Mk0WfZM7E5SWevipPktAIqz+\nWi6pjCtzTqlrI0Md4gtb28jm+VXFUhvpfKeoSOGEowR1+WWxScteX3ztfc483pzf\nryLJ+3P4Wc6i0bIIe9WQPmyoabeodAb27R1etYepLw==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKAIBAAKCAgEA6KBNR/NixV/zB+BdpiXhTQMdGzjseEdifGcsV6t1M6lvlJp2\nku3VQkdx07vYizkF/XQTZqiBBDNts/ldqmwu753zIQROQNc9xQSKAwe8lxVmH2Wr\nrLJDZpfMlXpSTXu1IYan8H5wAJOy4sC50fz2YCETZ5Hoe9cWjzTF30wLFoWFUn5R\nCyIjvG85SF3OpdV+uBUoF/RPlvr1EfXwbAPgWji3zJ7LjvQX569KBJ7JlQLzGUcq\nWfpYtqgEh/iKxSga7697TpiY30+G5a+VkdnRRk55a6oyuGbw7Q3vUvZd/Toqxjq/\npH08Pf+qE8PXra7ys6hsdlF5g2cXA424SwlcVGt0MUn59U+oeim6TQa/+s6o/yhu\nLNvdPKfoiwWxq3U19HiK1hiJriLJAy6/DK3osPaCiUa/bRQIhHokDHBcrW9iEquU\n6g8SvATOEeJCyIIZOGh/H/bSZ69wi5P1aacPpIzj7uRg+DGv3bG3qx4+6oCNphZ9\nets2xB/QneMHqRNGR1R8o11QckA7CUwM5zRgC5+buKQk6RTm33qA4mCT7rBZ99cf\nFwx7jDd8DDHxROX+1GkFsmfKKkGZARN4Jf6F+a4fYvgE5Otd5G0lMgebB/cqO8Be\nNFrXc2ONOr4GWZsG+xz2Jf1IfH+QW9bn9O0y8IOSyYQM2N3igLeTKETQL4sCAwEA\nAQKCAf9JOv+CFpJ3gsomYdcZT1a32otIkGfTgosb89TndZwg4l1LAZbIaIymPRKL\nGE8mmHeSeY8EbNlRXvl/TBtKpUcat/pOcRMdpSfgiGXjYF4sA6rGeSdxPKz0kdtz\nC4uH32MfWK2SpU6c7QLmoLFoXFqikw8zaqeXM9Z9MVRHF/6M96LS0gSxQXcSMCXR\nr00wcSxzFX4gnMHGsf7QCxjY9TF9XNOtdcyEqjiAYZPeY8JZ5M7kGSCk/iPOcByh\nJ2G2BG1ViiOPWNZQ8vMvDF9ycGEOjGqZJMAAvIGErwxFjlzNH6NeGTqxWO/ZCsO0\nOhN9cjms2DD9+o3JdAZuwp3/4FuFNSx3v7RQKR2glHnTRQxY2lRiBePStDCu6MSZ\nNzEkDZJR/CO2vY7UjqT18iArbX8loqYxjaUnTanfUSZDd7G5UzfsAlhTxU9/XW7U\nJs9Z4oFN8gb36yG4zW+ScXlcvmF9aDYh2ObaK7/sIspP/+CmB84pRTJT8o3Fgy/6\n7/ZXJMGZ0XYAVyK5kayhgpV8MWMWwOJ275daA8FNgqDwV/ayXD7baLUdplpBLGf7\nbet2rrLUuAQBW+a86AlKhjhkpVzNH9duFEO/9A72Xc9x1Y8thibZvJpEKJl6GM2L\noUxgFNYeABqLJDdfum/oFug5z+KMlNcjkYhUUHQ59c1qzVzJAoIBAQD0m0BvjzOY\nAxD2o/uibxZFgPo6L7NzS0vVd29wFwd+gIsfSak+SG10gioUIstNhD+ue00MT4ty\n4Ry5CAG/rv+yUeWf3AeL1Au5MP/hYt6OTHGiPVkLM4ge9i096oXZ8z6HdjkjaOfF\n/YZnlzChZq3e3dZJP0xiJDOW4xhVF3FAx+c6rnNu+UYnNbfgtA3C60HMr/vFAG+a\nerKWsXuMJyxjNMZt4lh2VVVtv7MArD17lKtrrGHvFRejk4Lk+2DrsuBvm6H2Pnkw\npA6FNNBonmv+AiduO9yM8HmY5SGOUECA7OjLMWcJu0K3z1z3LBFSzxjBEC7jVHqU\nVTwroF38ypwtAoIBAQDzdjHFbRW3BFLKLTi0s9naqCAnxxFNKRsGCHWjymD3S+Mk\nUTNXuM0kvvjJdIxDj1VU5Kxk+mIUAq7XW5pIZH9pwlbCOFh+NI0UnF+khFBUCvlP\nGXz4/HZgPy+PZnz4XOYVhvUEdxrHSka2EOGztYQxeMspxlcl4TO2/xj9ykaN7klC\n/HRUSgOop1ca7J3MBzzf9KgFKmculCMBg122wrlz77jm/vdxzOv5ZzoHzAHWZGAb\n+RnuX+SjYaNVlpuNIB17Buux3UgYMF6yai4iB1KQ1HYXG+Yf3GeTCF6Cosbu/lFP\nhPPZRd3V3/drCVMa+Yra2S27gJK9VH1OMtVkk/WXAoIBABmnAn3wna+OesPy9JvX\nXJWTbiqWABLSTbSoXuZ5c86/elegqQAgJmJ2mCUedQW/HdKVmcH1waEdnJ6HCW/p\n0WUJE7TNJXlzlnsoeV1QuhhgSfaCyojTMa5VkO8SXlE6Ik+ghWOCR/RKn0LT50S1\n+PwLdcKewcr1Evf6/v1FhRoPHN/Zlb+IouPPzWXiXCMZ+v+VYSkK36lqvrnxCQzs\nusn4qeqyNybJ0ji9Ru+GILiKIeQb4vVo197OxIZxGnv9eW4a+0RQzvLb8a3kmQqv\nupGb9jioTHv3aDkxpnA/WFRtBAjzOGQb4GZYd95wH6z4jRcKNHCg1m4h9jp5CgJN\n2U0CggEBAKCgn6/ZC9WnJZQ8h8g5TQfFmwmDfnfBIhI17J+2+4jNabxhUpWS2M5g\nrTYFDjHY1HzhLpik1abMKlzuE/mlTKcTUDhuAnyp4Vby4OtjXLhGUTyN3XVM5DEW\nHyPmg5c9e5RCaU+b4XARIlwnATKXFPOq9afHM2JLldorrmprVWd5Cp8Gfx3Jg2Z3\nmbGq4WVmdRRxj5Vw54jEtd/esyrMiJzkUcMd/1X21M3E/HV+dMvlh7+M9z3dyLS+\ny4vBhTl0Md8krsa370P+Tcw639sVp7TkaFFQ1+C3gyJwCCL6kHPIGQ908YmtXfIp\nBU16ZnlKoQFI/rJR3v7JSq8YPNBSClsCggEBAIUNbLNJb4H9mPHvLmYJB4DyRx48\nPoV21frIOQBPFAa+78QvjD5B8UXNTNzSDiwkjhhCmHQ/+spMiSMafuFfl41QNk2M\nheZ5rbaKpy77TWksbW5WVM/UoV6lKaVbZWePFvUQO5ebfNGo3xKpdMbQeCIpPKSr\naP1XLU+o35+vLlYZtQ8/wcHPdxZ7VW0LsOXIxkz8cLE1jc2+5ZKrAeO9C4a8gQli\n+4l9q6VayKhKK44Kn4u0NUIsy7IqtYlTf+XGP6ZWd4v9sQluYuUpRqzF5haeYTPB\nCV3JuTnLLcqwBReUPWk72jehAVg9Vm7jWC3MuyAcLhQy6monRGOq6ssF1uA=\n-----END RSA PRIVATE KEY-----\n"} 2024-09-21T05:39:41.701 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:41 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:39:42.826 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-21T05:39:43.160 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:42 smithi070 ceph-mon[30981]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:43.160 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:42 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:39:44.276 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-21T05:39:44.276 INFO:teuthology.orchestra.run.smithi070.stdout:Creating initial admin user... 2024-09-21T05:39:44.601 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:44 smithi070 ceph-mon[30981]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:44.601 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:44 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:39:45.674 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$0QhgTbt8PofGWu6RYL663OxSXG4jkxVKxmofamlrEhw5aQ0/hdWiu", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726897185, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T05:39:45.674 INFO:teuthology.orchestra.run.smithi070.stdout:Fetching dashboard port number... 2024-09-21T05:39:46.276 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:46 smithi070 ceph-mon[30981]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:46.276 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:46 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:39:46.904 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T05:39:46.914 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T05:39:46.914 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout disabled 2024-09-21T05:39:46.921 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T05:39:46.921 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2024-09-21T05:39:46.921 INFO:teuthology.orchestra.run.smithi070.stdout:firewalld.service is not enabled 2024-09-21T05:39:46.921 INFO:teuthology.orchestra.run.smithi070.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T05:39:46.923 INFO:teuthology.orchestra.run.smithi070.stdout:Ceph Dashboard is now available at: 2024-09-21T05:39:46.923 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:39:46.923 INFO:teuthology.orchestra.run.smithi070.stdout: URL: https://smithi070.front.sepia.ceph.com:8443/ 2024-09-21T05:39:46.923 INFO:teuthology.orchestra.run.smithi070.stdout: User: admin 2024-09-21T05:39:46.923 INFO:teuthology.orchestra.run.smithi070.stdout: Password: 7h06obbfhv 2024-09-21T05:39:46.923 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:39:46.924 INFO:teuthology.orchestra.run.smithi070.stdout:Saving cluster configuration to /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/config directory 2024-09-21T05:39:47.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:47 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2220730430' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-21T05:39:48.178 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T05:39:48.179 INFO:teuthology.orchestra.run.smithi070.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T05:39:48.179 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:39:48.179 INFO:teuthology.orchestra.run.smithi070.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T05:39:48.179 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:39:48.179 INFO:teuthology.orchestra.run.smithi070.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T05:39:48.179 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:39:48.179 INFO:teuthology.orchestra.run.smithi070.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T05:39:48.179 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:39:48.179 INFO:teuthology.orchestra.run.smithi070.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T05:39:48.179 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:39:48.179 INFO:teuthology.orchestra.run.smithi070.stdout: ceph telemetry on 2024-09-21T05:39:48.179 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:39:48.179 INFO:teuthology.orchestra.run.smithi070.stdout:For more information see: 2024-09-21T05:39:48.179 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:39:48.180 INFO:teuthology.orchestra.run.smithi070.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T05:39:48.180 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:39:48.180 INFO:teuthology.orchestra.run.smithi070.stdout:Bootstrap complete. 2024-09-21T05:39:48.218 INFO:tasks.cephadm:Fetching config... 2024-09-21T05:39:48.218 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-21T05:39:48.218 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T05:39:48.234 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T05:39:48.234 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-21T05:39:48.234 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T05:39:48.290 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T05:39:48.291 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-21T05:39:48.291 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/keyring of=/dev/stdout 2024-09-21T05:39:48.356 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T05:39:48.356 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-21T05:39:48.356 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T05:39:48.412 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T05:39:48.412 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRu11eaip2l3r47BtqN8+90AbX8nRJNT4QZiGhNAgbjMYmf4IKIJ+HnZO3/iEVr0QADhjV8T7EbMms2KSa9pyRfN8MFcin1lErswrfNQNCzaBs03/VrH8nKsS/d1QQ0zCZZGN9ZazonXoxdm52vwjIwu8Go7IEZeW7LlaL8KSyXRbCzZzzJIn3bzPYoga7MTzBMtT/X5EwjV8cez34b3IsC/mCDxaW5wzaAd6gPHbLIuA6SzW+KUp11eaLbzJ4YBpv4Qy2//G2r9ZmxHhjWh6qHiw91hgDPr8sx+PQ5J6LAn8Lr/KKa43PkjnfxxNSv0Lds9nZBpFxPHmvmUQMe8Wngqf8DXc60Rv5ouFqREVAVhOSu0DFWlWk4yrUjNvllAP9GupsadlU2KLtgVlDfYm31jF5a6WZUfjM++S7OBS6ztnclCeBCm1M8Q5lAPVSl3gIF5YGzje00+WftYPCTikWbaMAsZiOjCdjwz2W+AUbvD2RqdYqwKB+VnEindReXvs= ceph-96c6636e-77db-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T05:39:48.497 INFO:teuthology.orchestra.run.smithi070.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRu11eaip2l3r47BtqN8+90AbX8nRJNT4QZiGhNAgbjMYmf4IKIJ+HnZO3/iEVr0QADhjV8T7EbMms2KSa9pyRfN8MFcin1lErswrfNQNCzaBs03/VrH8nKsS/d1QQ0zCZZGN9ZazonXoxdm52vwjIwu8Go7IEZeW7LlaL8KSyXRbCzZzzJIn3bzPYoga7MTzBMtT/X5EwjV8cez34b3IsC/mCDxaW5wzaAd6gPHbLIuA6SzW+KUp11eaLbzJ4YBpv4Qy2//G2r9ZmxHhjWh6qHiw91hgDPr8sx+PQ5J6LAn8Lr/KKa43PkjnfxxNSv0Lds9nZBpFxPHmvmUQMe8Wngqf8DXc60Rv5ouFqREVAVhOSu0DFWlWk4yrUjNvllAP9GupsadlU2KLtgVlDfYm31jF5a6WZUfjM++S7OBS6ztnclCeBCm1M8Q5lAPVSl3gIF5YGzje00+WftYPCTikWbaMAsZiOjCdjwz2W+AUbvD2RqdYqwKB+VnEindReXvs= ceph-96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:39:48.508 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRu11eaip2l3r47BtqN8+90AbX8nRJNT4QZiGhNAgbjMYmf4IKIJ+HnZO3/iEVr0QADhjV8T7EbMms2KSa9pyRfN8MFcin1lErswrfNQNCzaBs03/VrH8nKsS/d1QQ0zCZZGN9ZazonXoxdm52vwjIwu8Go7IEZeW7LlaL8KSyXRbCzZzzJIn3bzPYoga7MTzBMtT/X5EwjV8cez34b3IsC/mCDxaW5wzaAd6gPHbLIuA6SzW+KUp11eaLbzJ4YBpv4Qy2//G2r9ZmxHhjWh6qHiw91hgDPr8sx+PQ5J6LAn8Lr/KKa43PkjnfxxNSv0Lds9nZBpFxPHmvmUQMe8Wngqf8DXc60Rv5ouFqREVAVhOSu0DFWlWk4yrUjNvllAP9GupsadlU2KLtgVlDfYm31jF5a6WZUfjM++S7OBS6ztnclCeBCm1M8Q5lAPVSl3gIF5YGzje00+WftYPCTikWbaMAsZiOjCdjwz2W+AUbvD2RqdYqwKB+VnEindReXvs= ceph-96c6636e-77db-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T05:39:48.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:48 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1069351219' entity='client.admin' 2024-09-21T05:39:48.632 INFO:teuthology.orchestra.run.smithi116.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRu11eaip2l3r47BtqN8+90AbX8nRJNT4QZiGhNAgbjMYmf4IKIJ+HnZO3/iEVr0QADhjV8T7EbMms2KSa9pyRfN8MFcin1lErswrfNQNCzaBs03/VrH8nKsS/d1QQ0zCZZGN9ZazonXoxdm52vwjIwu8Go7IEZeW7LlaL8KSyXRbCzZzzJIn3bzPYoga7MTzBMtT/X5EwjV8cez34b3IsC/mCDxaW5wzaAd6gPHbLIuA6SzW+KUp11eaLbzJ4YBpv4Qy2//G2r9ZmxHhjWh6qHiw91hgDPr8sx+PQ5J6LAn8Lr/KKa43PkjnfxxNSv0Lds9nZBpFxPHmvmUQMe8Wngqf8DXc60Rv5ouFqREVAVhOSu0DFWlWk4yrUjNvllAP9GupsadlU2KLtgVlDfYm31jF5a6WZUfjM++S7OBS6ztnclCeBCm1M8Q5lAPVSl3gIF5YGzje00+WftYPCTikWbaMAsZiOjCdjwz2W+AUbvD2RqdYqwKB+VnEindReXvs= ceph-96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:39:48.645 DEBUG:teuthology.orchestra.run.smithi160:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRu11eaip2l3r47BtqN8+90AbX8nRJNT4QZiGhNAgbjMYmf4IKIJ+HnZO3/iEVr0QADhjV8T7EbMms2KSa9pyRfN8MFcin1lErswrfNQNCzaBs03/VrH8nKsS/d1QQ0zCZZGN9ZazonXoxdm52vwjIwu8Go7IEZeW7LlaL8KSyXRbCzZzzJIn3bzPYoga7MTzBMtT/X5EwjV8cez34b3IsC/mCDxaW5wzaAd6gPHbLIuA6SzW+KUp11eaLbzJ4YBpv4Qy2//G2r9ZmxHhjWh6qHiw91hgDPr8sx+PQ5J6LAn8Lr/KKa43PkjnfxxNSv0Lds9nZBpFxPHmvmUQMe8Wngqf8DXc60Rv5ouFqREVAVhOSu0DFWlWk4yrUjNvllAP9GupsadlU2KLtgVlDfYm31jF5a6WZUfjM++S7OBS6ztnclCeBCm1M8Q5lAPVSl3gIF5YGzje00+WftYPCTikWbaMAsZiOjCdjwz2W+AUbvD2RqdYqwKB+VnEindReXvs= ceph-96c6636e-77db-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T05:39:48.708 INFO:teuthology.orchestra.run.smithi160.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRu11eaip2l3r47BtqN8+90AbX8nRJNT4QZiGhNAgbjMYmf4IKIJ+HnZO3/iEVr0QADhjV8T7EbMms2KSa9pyRfN8MFcin1lErswrfNQNCzaBs03/VrH8nKsS/d1QQ0zCZZGN9ZazonXoxdm52vwjIwu8Go7IEZeW7LlaL8KSyXRbCzZzzJIn3bzPYoga7MTzBMtT/X5EwjV8cez34b3IsC/mCDxaW5wzaAd6gPHbLIuA6SzW+KUp11eaLbzJ4YBpv4Qy2//G2r9ZmxHhjWh6qHiw91hgDPr8sx+PQ5J6LAn8Lr/KKa43PkjnfxxNSv0Lds9nZBpFxPHmvmUQMe8Wngqf8DXc60Rv5ouFqREVAVhOSu0DFWlWk4yrUjNvllAP9GupsadlU2KLtgVlDfYm31jF5a6WZUfjM++S7OBS6ztnclCeBCm1M8Q5lAPVSl3gIF5YGzje00+WftYPCTikWbaMAsZiOjCdjwz2W+AUbvD2RqdYqwKB+VnEindReXvs= ceph-96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:39:48.722 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T05:39:48.968 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:39:50.673 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:50 smithi070 ceph-mon[30981]: mgrmap e13: x(active, since 12s) 2024-09-21T05:39:50.674 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:50 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1657176778' entity='client.admin' 2024-09-21T05:39:51.115 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T05:39:51.115 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T05:39:51.801 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:39:53.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:52 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:39:53.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:52 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:39:53.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:52 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi070", "name": "osd_memory_target"} : dispatch 2024-09-21T05:39:53.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:52 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:39:53.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:52 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:39:53.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:52 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:39:53.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:52 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:39:53.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:52 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:39:53.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:52 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:39:53.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:52 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:39:53.149 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi116 2024-09-21T05:39:53.149 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-21T05:39:53.149 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/etc/ceph/ceph.conf 2024-09-21T05:39:53.167 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-21T05:39:53.168 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:39:53.226 INFO:tasks.cephadm:Adding host smithi116 to orchestrator... 2024-09-21T05:39:53.226 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph orch host add smithi116 2024-09-21T05:39:53.464 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:39:54.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:53 smithi070 ceph-mon[30981]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:54.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:53 smithi070 ceph-mon[30981]: Updating smithi070:/etc/ceph/ceph.conf 2024-09-21T05:39:54.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:53 smithi070 ceph-mon[30981]: Updating smithi070:/var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:39:54.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:53 smithi070 ceph-mon[30981]: Updating smithi070:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:39:54.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:53 smithi070 ceph-mon[30981]: Updating smithi070:/var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:39:54.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:53 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:39:54.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:53 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:39:54.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:53 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:39:55.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:54 smithi070 ceph-mon[30981]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi116", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:56.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:55 smithi070 ceph-mon[30981]: Deploying cephadm binary to smithi116 2024-09-21T05:39:57.210 INFO:teuthology.orchestra.run.smithi070.stdout:Added host 'smithi116' with addr '172.21.15.116' 2024-09-21T05:39:57.889 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T05:39:58.127 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:39:58.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:58 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:39:58.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:58 smithi070 ceph-mon[30981]: Added host smithi116 2024-09-21T05:39:58.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:58 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:39:58.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:58 smithi070 ceph-mon[30981]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:39:58.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:58 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:39:58.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:58 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:39:58.762 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:39:58.762 INFO:teuthology.orchestra.run.smithi070.stdout:[{"addr": "172.21.15.70", "hostname": "smithi070", "labels": [], "status": ""}, {"addr": "172.21.15.116", "hostname": "smithi116", "labels": [], "status": ""}] 2024-09-21T05:39:59.466 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi160 2024-09-21T05:39:59.466 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-21T05:39:59.466 DEBUG:teuthology.orchestra.run.smithi160:> dd of=/etc/ceph/ceph.conf 2024-09-21T05:39:59.484 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-21T05:39:59.485 DEBUG:teuthology.orchestra.run.smithi160:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:39:59.543 INFO:tasks.cephadm:Adding host smithi160 to orchestrator... 2024-09-21T05:39:59.544 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph orch host add smithi160 2024-09-21T05:39:59.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:59 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:39:59.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:59 smithi070 ceph-mon[30981]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:39:59.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:39:59 smithi070 ceph-mon[30981]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:39:59.786 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:40:01.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:01 smithi070 ceph-mon[30981]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi160", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:01.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:01 smithi070 ceph-mon[30981]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:01.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:01 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:01.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:01 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:01.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:01 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:01.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:01 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:01.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:01 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi116", "name": "osd_memory_target"} : dispatch 2024-09-21T05:40:01.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:01 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:01.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:01 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:03.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:02 smithi070 ceph-mon[30981]: Updating smithi116:/etc/ceph/ceph.conf 2024-09-21T05:40:03.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:02 smithi070 ceph-mon[30981]: Deploying cephadm binary to smithi160 2024-09-21T05:40:03.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:02 smithi070 ceph-mon[30981]: Updating smithi116:/var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:40:03.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:02 smithi070 ceph-mon[30981]: Updating smithi116:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:40:03.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:02 smithi070 ceph-mon[30981]: Updating smithi116:/var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:40:03.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:02 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:03.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:02 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:03.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:02 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:03.707 INFO:teuthology.orchestra.run.smithi070.stdout:Added host 'smithi160' with addr '172.21.15.160' 2024-09-21T05:40:03.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:03 smithi070 ceph-mon[30981]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:03.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:03 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:03.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:03 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:40:04.225 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T05:40:04.465 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:40:05.124 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:40:05.124 INFO:teuthology.orchestra.run.smithi070.stdout:[{"addr": "172.21.15.70", "hostname": "smithi070", "labels": [], "status": ""}, {"addr": "172.21.15.116", "hostname": "smithi116", "labels": [], "status": ""}, {"addr": "172.21.15.160", "hostname": "smithi160", "labels": [], "status": ""}] 2024-09-21T05:40:05.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:04 smithi070 ceph-mon[30981]: Added host smithi160 2024-09-21T05:40:05.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:04 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:05.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:04 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:05.715 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T05:40:05.715 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd crush tunables default 2024-09-21T05:40:05.952 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:40:06.316 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:06 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:06.316 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:06 smithi070 ceph-mon[30981]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:40:06.316 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:06 smithi070 ceph-mon[30981]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:07.043 INFO:teuthology.orchestra.run.smithi070.stderr:adjusted tunables profile to default 2024-09-21T05:40:07.335 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:07 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3833915655' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T05:40:07.647 INFO:tasks.cephadm:Adding mon.a on smithi070 2024-09-21T05:40:07.647 INFO:tasks.cephadm:Adding mon.b on smithi116 2024-09-21T05:40:07.647 INFO:tasks.cephadm:Adding mon.c on smithi160 2024-09-21T05:40:07.648 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph orch apply mon '3;smithi070:172.21.15.70=a;smithi116:172.21.15.116=b;smithi160:172.21.15.160=c' 2024-09-21T05:40:07.892 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T05:40:07.938 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T05:40:08.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:08 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3833915655' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T05:40:08.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:08 smithi070 ceph-mon[30981]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T05:40:08.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:08 smithi070 ceph-mon[30981]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:08.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:08 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:08.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:08 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:08.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:08 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:08.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:08 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:08.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:08 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi160", "name": "osd_memory_target"} : dispatch 2024-09-21T05:40:08.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:08 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:08.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:08 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:08.669 INFO:teuthology.orchestra.run.smithi160.stdout:Scheduled mon update... 2024-09-21T05:40:09.259 DEBUG:teuthology.orchestra.run.smithi116:mon.b> sudo journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mon.b.service 2024-09-21T05:40:09.261 DEBUG:teuthology.orchestra.run.smithi160:mon.c> sudo journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mon.c.service 2024-09-21T05:40:09.264 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T05:40:09.264 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T05:40:09.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:09 smithi070 ceph-mon[30981]: Updating smithi160:/etc/ceph/ceph.conf 2024-09-21T05:40:09.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:09 smithi070 ceph-mon[30981]: Updating smithi160:/var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:40:09.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:09 smithi070 ceph-mon[30981]: Updating smithi160:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:40:09.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:09 smithi070 ceph-mon[30981]: Updating smithi160:/var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:40:09.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:09 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:09.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:09 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:09.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:09 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:09.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:09 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:09.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:09 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:40:09.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:09 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:09.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:09 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:09.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:09 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:09.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:09 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:40:09.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:09 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:10.200 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:40:10.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:10 smithi070 ceph-mon[30981]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi070:172.21.15.70=a;smithi116:172.21.15.116=b;smithi160:172.21.15.160=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:10.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:10 smithi070 ceph-mon[30981]: Saving service mon spec with placement smithi070:172.21.15.70=a;smithi116:172.21.15.116=b;smithi160:172.21.15.160=c;count:3 2024-09-21T05:40:10.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:10 smithi070 ceph-mon[30981]: Deploying daemon mon.c on smithi160 2024-09-21T05:40:10.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:10 smithi070 ceph-mon[30981]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:11.411 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-21T05:40:11.411 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":1,"fsid":"96c6636e-77db-11ef-baf5-efdc52797490","modified":"2024-09-21T05:38:39.360099Z","created":"2024-09-21T05:38:39.360099Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3300","nonce":0},{"type":"v1","addr":"172.21.15.70:6789","nonce":0}]},"addr":"172.21.15.70:6789/0","public_addr":"172.21.15.70:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T05:40:11.411 INFO:teuthology.orchestra.run.smithi160.stderr:dumped monmap epoch 1 2024-09-21T05:40:11.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:11 smithi070 ceph-mon[30981]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:12.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:12 smithi070 ceph-mon[30981]: from='client.? 172.21.15.160:0/104398668' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T05:40:13.047 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T05:40:13.047 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T05:40:13.611 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: load: jerasure load: lrc 2024-09-21T05:40:13.732 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:40:13.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:13 smithi070 ceph-mon[30981]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:13.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: RocksDB version: 7.9.2 2024-09-21T05:40:13.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Git sha 0 2024-09-21T05:40:13.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T05:40:13.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: DB SUMMARY 2024-09-21T05:40:13.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: DB Session ID: YS0EHLAQOVKAAKV9A0NY 2024-09-21T05:40:13.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: CURRENT file: CURRENT 2024-09-21T05:40:13.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T05:40:13.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T05:40:13.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-21T05:40:13.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-21T05:40:13.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.error_if_exists: 0 2024-09-21T05:40:13.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.create_if_missing: 0 2024-09-21T05:40:13.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.paranoid_checks: 1 2024-09-21T05:40:13.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T05:40:13.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T05:40:13.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T05:40:13.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.env: 0x55ef797d7d60 2024-09-21T05:40:13.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T05:40:13.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.info_log: 0x55ef7ff2d360 2024-09-21T05:40:13.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T05:40:13.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.statistics: (nil) 2024-09-21T05:40:13.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.use_fsync: 0 2024-09-21T05:40:13.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.max_log_file_size: 0 2024-09-21T05:40:13.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T05:40:13.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T05:40:13.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T05:40:13.901 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T05:40:13.901 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.allow_fallocate: 1 2024-09-21T05:40:13.901 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T05:40:13.901 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T05:40:13.901 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.use_direct_reads: 0 2024-09-21T05:40:13.901 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T05:40:13.901 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T05:40:13.901 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.db_log_dir: 2024-09-21T05:40:13.901 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.wal_dir: 2024-09-21T05:40:13.901 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T05:40:13.901 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T05:40:13.901 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T05:40:13.901 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T05:40:13.903 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T05:40:13.903 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T05:40:13.903 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T05:40:13.903 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T05:40:13.903 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.write_buffer_manager: 0x55ef7ff31d60 2024-09-21T05:40:13.903 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T05:40:13.903 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T05:40:13.903 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T05:40:13.903 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T05:40:13.903 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T05:40:13.904 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T05:40:13.904 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T05:40:13.904 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T05:40:13.904 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.unordered_write: 0 2024-09-21T05:40:13.904 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T05:40:13.904 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T05:40:13.904 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T05:40:13.904 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T05:40:13.904 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.row_cache: None 2024-09-21T05:40:13.904 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.wal_filter: None 2024-09-21T05:40:13.904 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T05:40:13.904 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T05:40:13.904 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.two_write_queues: 0 2024-09-21T05:40:13.904 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T05:40:13.904 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.wal_compression: 0 2024-09-21T05:40:13.904 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.atomic_flush: 0 2024-09-21T05:40:13.905 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T05:40:13.905 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T05:40:13.905 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T05:40:13.905 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.log_readahead_size: 0 2024-09-21T05:40:13.905 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T05:40:13.905 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T05:40:13.905 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T05:40:13.905 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T05:40:13.905 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T05:40:13.905 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T05:40:13.905 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T05:40:13.905 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.max_background_jobs: 2 2024-09-21T05:40:13.905 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.max_background_compactions: -1 2024-09-21T05:40:13.905 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.max_subcompactions: 1 2024-09-21T05:40:13.905 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T05:40:13.905 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T05:40:13.906 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T05:40:13.906 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T05:40:13.906 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T05:40:13.906 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T05:40:13.906 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T05:40:13.906 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T05:40:13.906 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.max_open_files: -1 2024-09-21T05:40:13.906 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T05:40:13.906 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T05:40:13.906 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T05:40:13.906 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T05:40:13.906 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.max_background_flushes: -1 2024-09-21T05:40:13.906 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Compression algorithms supported: 2024-09-21T05:40:13.906 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: kZSTD supported: 0 2024-09-21T05:40:13.906 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: kXpressCompression supported: 0 2024-09-21T05:40:13.907 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: kBZip2Compression supported: 0 2024-09-21T05:40:13.907 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T05:40:13.907 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: kLZ4Compression supported: 1 2024-09-21T05:40:13.907 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: kZlibCompression supported: 1 2024-09-21T05:40:13.907 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T05:40:13.907 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: kSnappyCompression supported: 1 2024-09-21T05:40:13.907 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T05:40:13.907 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T05:40:13.907 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-21T05:40:13.907 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T05:40:13.907 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T05:40:13.907 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.merge_operator: 2024-09-21T05:40:13.907 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.compaction_filter: None 2024-09-21T05:40:13.907 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T05:40:13.907 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T05:40:13.907 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T05:40:13.908 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T05:40:13.908 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ef7ff2cfa0) 2024-09-21T05:40:13.908 INFO:journalctl@ceph.mon.c.smithi160.stdout: cache_index_and_filter_blocks: 1 2024-09-21T05:40:13.908 INFO:journalctl@ceph.mon.c.smithi160.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T05:40:13.908 INFO:journalctl@ceph.mon.c.smithi160.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T05:40:13.908 INFO:journalctl@ceph.mon.c.smithi160.stdout: pin_top_level_index_and_filter: 1 2024-09-21T05:40:13.908 INFO:journalctl@ceph.mon.c.smithi160.stdout: index_type: 0 2024-09-21T05:40:13.908 INFO:journalctl@ceph.mon.c.smithi160.stdout: data_block_index_type: 0 2024-09-21T05:40:13.908 INFO:journalctl@ceph.mon.c.smithi160.stdout: index_shortening: 1 2024-09-21T05:40:13.908 INFO:journalctl@ceph.mon.c.smithi160.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T05:40:13.908 INFO:journalctl@ceph.mon.c.smithi160.stdout: checksum: 4 2024-09-21T05:40:13.908 INFO:journalctl@ceph.mon.c.smithi160.stdout: no_block_cache: 0 2024-09-21T05:40:13.908 INFO:journalctl@ceph.mon.c.smithi160.stdout: block_cache: 0x55ef7bef1610 2024-09-21T05:40:13.908 INFO:journalctl@ceph.mon.c.smithi160.stdout: block_cache_name: BinnedLRUCache 2024-09-21T05:40:13.908 INFO:journalctl@ceph.mon.c.smithi160.stdout: block_cache_options: 2024-09-21T05:40:13.908 INFO:journalctl@ceph.mon.c.smithi160.stdout: capacity : 536870912 2024-09-21T05:40:13.909 INFO:journalctl@ceph.mon.c.smithi160.stdout: num_shard_bits : 4 2024-09-21T05:40:13.909 INFO:journalctl@ceph.mon.c.smithi160.stdout: strict_capacity_limit : 0 2024-09-21T05:40:13.909 INFO:journalctl@ceph.mon.c.smithi160.stdout: high_pri_pool_ratio: 0.000 2024-09-21T05:40:13.909 INFO:journalctl@ceph.mon.c.smithi160.stdout: block_cache_compressed: (nil) 2024-09-21T05:40:13.909 INFO:journalctl@ceph.mon.c.smithi160.stdout: persistent_cache: (nil) 2024-09-21T05:40:13.909 INFO:journalctl@ceph.mon.c.smithi160.stdout: block_size: 4096 2024-09-21T05:40:13.909 INFO:journalctl@ceph.mon.c.smithi160.stdout: block_size_deviation: 10 2024-09-21T05:40:13.909 INFO:journalctl@ceph.mon.c.smithi160.stdout: block_restart_interval: 16 2024-09-21T05:40:13.909 INFO:journalctl@ceph.mon.c.smithi160.stdout: index_block_restart_interval: 1 2024-09-21T05:40:13.909 INFO:journalctl@ceph.mon.c.smithi160.stdout: metadata_block_size: 4096 2024-09-21T05:40:13.909 INFO:journalctl@ceph.mon.c.smithi160.stdout: partition_filters: 0 2024-09-21T05:40:13.909 INFO:journalctl@ceph.mon.c.smithi160.stdout: use_delta_encoding: 1 2024-09-21T05:40:13.909 INFO:journalctl@ceph.mon.c.smithi160.stdout: filter_policy: bloomfilter 2024-09-21T05:40:13.909 INFO:journalctl@ceph.mon.c.smithi160.stdout: whole_key_filtering: 1 2024-09-21T05:40:13.909 INFO:journalctl@ceph.mon.c.smithi160.stdout: verify_compression: 0 2024-09-21T05:40:13.910 INFO:journalctl@ceph.mon.c.smithi160.stdout: read_amp_bytes_per_bit: 0 2024-09-21T05:40:13.910 INFO:journalctl@ceph.mon.c.smithi160.stdout: format_version: 5 2024-09-21T05:40:13.910 INFO:journalctl@ceph.mon.c.smithi160.stdout: enable_index_compression: 1 2024-09-21T05:40:13.910 INFO:journalctl@ceph.mon.c.smithi160.stdout: block_align: 0 2024-09-21T05:40:13.910 INFO:journalctl@ceph.mon.c.smithi160.stdout: max_auto_readahead_size: 262144 2024-09-21T05:40:13.910 INFO:journalctl@ceph.mon.c.smithi160.stdout: prepopulate_block_cache: 0 2024-09-21T05:40:13.910 INFO:journalctl@ceph.mon.c.smithi160.stdout: initial_auto_readahead_size: 8192 2024-09-21T05:40:13.910 INFO:journalctl@ceph.mon.c.smithi160.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T05:40:13.910 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T05:40:13.910 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T05:40:13.910 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.compression: NoCompression 2024-09-21T05:40:13.910 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T05:40:13.910 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T05:40:13.910 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T05:40:13.910 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.num_levels: 7 2024-09-21T05:40:13.911 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T05:40:13.911 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T05:40:13.911 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T05:40:13.911 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T05:40:13.911 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T05:40:13.911 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T05:40:13.911 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T05:40:13.911 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T05:40:13.911 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T05:40:13.911 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T05:40:13.911 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T05:40:13.911 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T05:40:13.911 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T05:40:13.911 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T05:40:13.911 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T05:40:13.911 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T05:40:13.912 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T05:40:13.912 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T05:40:13.912 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T05:40:13.912 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T05:40:13.912 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T05:40:13.912 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T05:40:13.912 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T05:40:13.912 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T05:40:13.912 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T05:40:13.912 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T05:40:13.912 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T05:40:13.912 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T05:40:13.912 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T05:40:13.912 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T05:40:13.912 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T05:40:13.912 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T05:40:13.913 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T05:40:13.913 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T05:40:13.913 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T05:40:13.913 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T05:40:13.913 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T05:40:13.913 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T05:40:13.913 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T05:40:13.913 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T05:40:13.913 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T05:40:13.913 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T05:40:13.913 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T05:40:13.913 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T05:40:13.913 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T05:40:13.913 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T05:40:13.913 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T05:40:13.913 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T05:40:13.914 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T05:40:13.914 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T05:40:13.914 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T05:40:13.914 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T05:40:13.914 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T05:40:13.914 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T05:40:13.914 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.inplace_update_support: 0 2024-09-21T05:40:13.914 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T05:40:13.914 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T05:40:13.914 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T05:40:13.914 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T05:40:13.914 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.bloom_locality: 0 2024-09-21T05:40:13.914 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.max_successive_merges: 0 2024-09-21T05:40:13.914 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T05:40:13.914 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T05:40:13.915 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T05:40:13.915 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T05:40:13.915 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.ttl: 2592000 2024-09-21T05:40:13.915 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T05:40:13.915 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T05:40:13.915 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T05:40:13.915 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.enable_blob_files: false 2024-09-21T05:40:13.915 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.min_blob_size: 0 2024-09-21T05:40:13.915 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T05:40:13.915 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T05:40:13.915 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T05:40:13.915 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T05:40:13.915 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T05:40:13.915 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T05:40:13.915 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T05:40:13.915 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T05:40:13.916 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T05:40:13.916 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T05:40:13.916 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 8365f145-0a1e-4e93-8743-3b2de781f5cd 2024-09-21T05:40:13.916 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726897213613027, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T05:40:13.916 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T05:40:13.916 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726897213613447, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726897213, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "8365f145-0a1e-4e93-8743-3b2de781f5cd", "db_session_id": "YS0EHLAQOVKAAKV9A0NY", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T05:40:13.916 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726897213613540, "job": 1, "event": "recovery_finished"} 2024-09-21T05:40:13.916 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T05:40:13.916 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T05:40:13.916 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ef7ff50a80 2024-09-21T05:40:13.916 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: DB pointer 0x55ef80cf6000 2024-09-21T05:40:13.916 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T05:40:13.916 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T05:40:13.916 INFO:journalctl@ceph.mon.c.smithi160.stdout: ** DB Stats ** 2024-09-21T05:40:13.916 INFO:journalctl@ceph.mon.c.smithi160.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T05:40:13.916 INFO:journalctl@ceph.mon.c.smithi160.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T05:40:13.917 INFO:journalctl@ceph.mon.c.smithi160.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T05:40:13.917 INFO:journalctl@ceph.mon.c.smithi160.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T05:40:13.917 INFO:journalctl@ceph.mon.c.smithi160.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T05:40:13.917 INFO:journalctl@ceph.mon.c.smithi160.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T05:40:13.917 INFO:journalctl@ceph.mon.c.smithi160.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T05:40:13.917 INFO:journalctl@ceph.mon.c.smithi160.stdout: 2024-09-21T05:40:13.917 INFO:journalctl@ceph.mon.c.smithi160.stdout: ** Compaction Stats [default] ** 2024-09-21T05:40:13.917 INFO:journalctl@ceph.mon.c.smithi160.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T05:40:13.917 INFO:journalctl@ceph.mon.c.smithi160.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T05:40:13.917 INFO:journalctl@ceph.mon.c.smithi160.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T05:40:13.917 INFO:journalctl@ceph.mon.c.smithi160.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T05:40:13.917 INFO:journalctl@ceph.mon.c.smithi160.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T05:40:13.917 INFO:journalctl@ceph.mon.c.smithi160.stdout: 2024-09-21T05:40:13.917 INFO:journalctl@ceph.mon.c.smithi160.stdout: ** Compaction Stats [default] ** 2024-09-21T05:40:13.917 INFO:journalctl@ceph.mon.c.smithi160.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T05:40:13.917 INFO:journalctl@ceph.mon.c.smithi160.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T05:40:13.918 INFO:journalctl@ceph.mon.c.smithi160.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T05:40:13.918 INFO:journalctl@ceph.mon.c.smithi160.stdout: 2024-09-21T05:40:13.918 INFO:journalctl@ceph.mon.c.smithi160.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T05:40:13.918 INFO:journalctl@ceph.mon.c.smithi160.stdout: 2024-09-21T05:40:13.918 INFO:journalctl@ceph.mon.c.smithi160.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T05:40:13.918 INFO:journalctl@ceph.mon.c.smithi160.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T05:40:13.918 INFO:journalctl@ceph.mon.c.smithi160.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T05:40:13.918 INFO:journalctl@ceph.mon.c.smithi160.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T05:40:13.918 INFO:journalctl@ceph.mon.c.smithi160.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T05:40:13.918 INFO:journalctl@ceph.mon.c.smithi160.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T05:40:13.918 INFO:journalctl@ceph.mon.c.smithi160.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T05:40:13.918 INFO:journalctl@ceph.mon.c.smithi160.stdout: Interval compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T05:40:13.918 INFO:journalctl@ceph.mon.c.smithi160.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T05:40:13.918 INFO:journalctl@ceph.mon.c.smithi160.stdout: Block cache BinnedLRUCache@0x55ef7bef1610#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T05:40:13.918 INFO:journalctl@ceph.mon.c.smithi160.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T05:40:13.919 INFO:journalctl@ceph.mon.c.smithi160.stdout: 2024-09-21T05:40:13.919 INFO:journalctl@ceph.mon.c.smithi160.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T05:40:13.919 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-21T05:40:13.919 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: using public_addr v2:172.21.15.160:0/0 -> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-21T05:40:13.919 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: starting mon.c rank -1 at public addrs [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] at bind addrs [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:40:13.919 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: mon.c@-1(???) e0 preinit fsid 96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:40:13.919 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: mon.c@-1(synchronizing).mds e1 new map 2024-09-21T05:40:13.919 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-21T05:40:13.919 INFO:journalctl@ceph.mon.c.smithi160.stdout: e1 2024-09-21T05:40:13.919 INFO:journalctl@ceph.mon.c.smithi160.stdout: btime 2024-09-21T05:38:42:297125+0000 2024-09-21T05:40:13.919 INFO:journalctl@ceph.mon.c.smithi160.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T05:40:13.919 INFO:journalctl@ceph.mon.c.smithi160.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T05:40:13.919 INFO:journalctl@ceph.mon.c.smithi160.stdout: legacy client fscid: -1 2024-09-21T05:40:13.919 INFO:journalctl@ceph.mon.c.smithi160.stdout: 2024-09-21T05:40:13.919 INFO:journalctl@ceph.mon.c.smithi160.stdout: No filesystems configured 2024-09-21T05:40:13.919 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T05:40:13.920 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T05:40:13.920 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T05:40:13.920 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T05:40:13.920 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T05:40:13.920 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T05:40:13.920 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T05:40:13.920 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T05:40:13.920 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T05:40:13.920 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T05:40:13.920 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi160", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:13.920 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:13.920 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:13.920 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:13.920 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:13.920 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:13.920 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi116", "name": "osd_memory_target"} : dispatch 2024-09-21T05:40:13.921 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:13.921 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:13.921 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: Updating smithi116:/etc/ceph/ceph.conf 2024-09-21T05:40:13.921 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: Deploying cephadm binary to smithi160 2024-09-21T05:40:13.921 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: Updating smithi116:/var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:40:13.921 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: Updating smithi116:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:40:13.921 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: Updating smithi116:/var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:40:13.921 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:13.921 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:13.921 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:13.921 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:13.921 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:13.921 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:40:13.921 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: Added host smithi160 2024-09-21T05:40:13.921 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:13.921 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:13.922 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:13.922 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:40:13.922 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:13.922 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3833915655' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T05:40:13.922 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3833915655' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T05:40:13.922 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T05:40:13.922 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:13.922 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:13.922 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:13.922 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:13.922 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:13.922 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi160", "name": "osd_memory_target"} : dispatch 2024-09-21T05:40:13.922 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:13.922 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:13.922 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: Updating smithi160:/etc/ceph/ceph.conf 2024-09-21T05:40:13.923 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: Updating smithi160:/var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:40:13.923 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: Updating smithi160:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:40:13.923 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: Updating smithi160:/var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:40:13.923 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:13.923 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:13.923 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:13.923 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:13.923 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:40:13.923 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:13.923 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:13.923 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:13.923 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:40:13.923 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:13.923 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi070:172.21.15.70=a;smithi116:172.21.15.116=b;smithi160:172.21.15.160=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:13.923 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: Saving service mon spec with placement smithi070:172.21.15.70=a;smithi116:172.21.15.116=b;smithi160:172.21.15.160=c;count:3 2024-09-21T05:40:13.924 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: Deploying daemon mon.c on smithi160 2024-09-21T05:40:13.924 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:13.924 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:13.924 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: from='client.? 172.21.15.160:0/104398668' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T05:40:13.924 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:13.924 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 ceph-mon[33979]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T05:40:13.924 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 bash[33935]: e471412be3096d668a36e06f0ac901c61e4040bda6b134091d9ca548226cfd9a 2024-09-21T05:40:13.924 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:13 smithi160 systemd[1]: Started Ceph mon.c for 96c6636e-77db-11ef-baf5-efdc52797490. 2024-09-21T05:40:18.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:18 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:40:18.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:18 smithi070 ceph-mon[30981]: mon.a calling monitor election 2024-09-21T05:40:18.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:18 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:40:18.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:18 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:40:18.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:18 smithi070 ceph-mon[30981]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:18.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:18 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:40:18.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:18 smithi070 ceph-mon[30981]: mon.c calling monitor election 2024-09-21T05:40:18.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:18 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:40:18.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:18 smithi070 ceph-mon[30981]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:18.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:18 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:40:18.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:18 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:40:18.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:18 smithi070 ceph-mon[30981]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T05:40:18.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:18 smithi070 ceph-mon[30981]: monmap epoch 2 2024-09-21T05:40:18.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:18 smithi070 ceph-mon[30981]: fsid 96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:40:18.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:18 smithi070 ceph-mon[30981]: last_changed 2024-09-21T05:40:13.641017+0000 2024-09-21T05:40:18.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:18 smithi070 ceph-mon[30981]: created 2024-09-21T05:38:39.360099+0000 2024-09-21T05:40:18.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:18 smithi070 ceph-mon[30981]: min_mon_release 19 (squid) 2024-09-21T05:40:18.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:18 smithi070 ceph-mon[30981]: election_strategy: 1 2024-09-21T05:40:18.997 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:18 smithi070 ceph-mon[30981]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-21T05:40:18.997 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:18 smithi070 ceph-mon[30981]: 1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.c 2024-09-21T05:40:18.997 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:18 smithi070 ceph-mon[30981]: fsmap 2024-09-21T05:40:18.997 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:18 smithi070 ceph-mon[30981]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T05:40:18.997 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:18 smithi070 ceph-mon[30981]: mgrmap e13: x(active, since 41s) 2024-09-21T05:40:18.997 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:18 smithi070 ceph-mon[30981]: overall HEALTH_OK 2024-09-21T05:40:18.997 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:18 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:18.997 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:18 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:18.997 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:18 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:18.997 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:18 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:40:18.997 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:18 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:19.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:18 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:40:19.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:18 smithi160 ceph-mon[33979]: mon.a calling monitor election 2024-09-21T05:40:19.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:18 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:40:19.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:18 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:40:19.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:18 smithi160 ceph-mon[33979]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:19.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:18 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:40:19.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:18 smithi160 ceph-mon[33979]: mon.c calling monitor election 2024-09-21T05:40:19.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:18 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:40:19.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:18 smithi160 ceph-mon[33979]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:19.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:18 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:40:19.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:18 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:40:19.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:18 smithi160 ceph-mon[33979]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T05:40:19.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:18 smithi160 ceph-mon[33979]: monmap epoch 2 2024-09-21T05:40:19.150 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:18 smithi160 ceph-mon[33979]: fsid 96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:40:19.150 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:18 smithi160 ceph-mon[33979]: last_changed 2024-09-21T05:40:13.641017+0000 2024-09-21T05:40:19.150 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:18 smithi160 ceph-mon[33979]: created 2024-09-21T05:38:39.360099+0000 2024-09-21T05:40:19.150 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:18 smithi160 ceph-mon[33979]: min_mon_release 19 (squid) 2024-09-21T05:40:19.150 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:18 smithi160 ceph-mon[33979]: election_strategy: 1 2024-09-21T05:40:19.150 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:18 smithi160 ceph-mon[33979]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-21T05:40:19.150 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:18 smithi160 ceph-mon[33979]: 1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.c 2024-09-21T05:40:19.150 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:18 smithi160 ceph-mon[33979]: fsmap 2024-09-21T05:40:19.150 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:18 smithi160 ceph-mon[33979]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T05:40:19.150 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:18 smithi160 ceph-mon[33979]: mgrmap e13: x(active, since 41s) 2024-09-21T05:40:19.150 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:18 smithi160 ceph-mon[33979]: overall HEALTH_OK 2024-09-21T05:40:19.150 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:18 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:19.150 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:18 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:19.150 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:18 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:19.150 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:18 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:40:19.151 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:18 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:19.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:19 smithi070 ceph-mon[30981]: Deploying daemon mon.b on smithi116 2024-09-21T05:40:19.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:19 smithi070 ceph-mon[30981]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:19.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:19 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:40:20.049 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:19 smithi160 ceph-mon[33979]: Deploying daemon mon.b on smithi116 2024-09-21T05:40:20.050 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:19 smithi160 ceph-mon[33979]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:20.050 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:19 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:40:20.414 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-21T05:40:20.414 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":2,"fsid":"96c6636e-77db-11ef-baf5-efdc52797490","modified":"2024-09-21T05:40:13.641017Z","created":"2024-09-21T05:38:39.360099Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3300","nonce":0},{"type":"v1","addr":"172.21.15.70:6789","nonce":0}]},"addr":"172.21.15.70:6789/0","public_addr":"172.21.15.70:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:3300","nonce":0},{"type":"v1","addr":"172.21.15.160:6789","nonce":0}]},"addr":"172.21.15.160:6789/0","public_addr":"172.21.15.160:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T05:40:20.414 INFO:teuthology.orchestra.run.smithi160.stderr:dumped monmap epoch 2 2024-09-21T05:40:20.988 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:20 smithi160 ceph-mon[33979]: from='client.? 172.21.15.160:0/1312589007' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T05:40:20.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:20 smithi070 ceph-mon[30981]: from='client.? 172.21.15.160:0/1312589007' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T05:40:21.991 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T05:40:21.991 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T05:40:21.994 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:21 smithi070 ceph-mon[30981]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:22.019 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:21 smithi160 ceph-mon[33979]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:22.270 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:40:22.401 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: mon.b@-1(???) e0 preinit fsid 96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:40:22.444 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: mon.b@-1(synchronizing).mds e1 new map 2024-09-21T05:40:22.444 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-21T05:40:22.444 INFO:journalctl@ceph.mon.b.smithi116.stdout: e1 2024-09-21T05:40:22.445 INFO:journalctl@ceph.mon.b.smithi116.stdout: btime 2024-09-21T05:38:42:297125+0000 2024-09-21T05:40:22.445 INFO:journalctl@ceph.mon.b.smithi116.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T05:40:22.445 INFO:journalctl@ceph.mon.b.smithi116.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T05:40:22.445 INFO:journalctl@ceph.mon.b.smithi116.stdout: legacy client fscid: -1 2024-09-21T05:40:22.445 INFO:journalctl@ceph.mon.b.smithi116.stdout: 2024-09-21T05:40:22.445 INFO:journalctl@ceph.mon.b.smithi116.stdout: No filesystems configured 2024-09-21T05:40:22.445 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T05:40:22.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T05:40:22.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T05:40:22.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T05:40:22.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T05:40:22.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T05:40:22.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T05:40:22.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T05:40:22.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T05:40:22.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T05:40:22.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi160", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:22.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:22.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:22.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:22.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:22.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:22.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi116", "name": "osd_memory_target"} : dispatch 2024-09-21T05:40:22.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:22.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:22.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: Updating smithi116:/etc/ceph/ceph.conf 2024-09-21T05:40:22.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: Deploying cephadm binary to smithi160 2024-09-21T05:40:22.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: Updating smithi116:/var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:40:22.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: Updating smithi116:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:40:22.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: Updating smithi116:/var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:40:22.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:22.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:22.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:22.807 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:22.807 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:22.807 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:40:22.807 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: Added host smithi160 2024-09-21T05:40:22.807 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:22.807 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:22.807 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:22.807 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:40:22.808 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:22.808 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3833915655' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T05:40:22.808 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3833915655' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T05:40:22.808 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T05:40:22.808 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:22.808 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:22.808 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:22.808 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:22.808 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:22.808 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi160", "name": "osd_memory_target"} : dispatch 2024-09-21T05:40:22.808 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:22.808 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:22.808 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: Updating smithi160:/etc/ceph/ceph.conf 2024-09-21T05:40:22.808 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: Updating smithi160:/var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:40:22.809 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: Updating smithi160:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:40:22.809 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: Updating smithi160:/var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:40:22.809 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:22.809 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:22.809 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:22.809 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:22.809 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:40:22.809 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:22.809 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:22.809 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:22.809 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:40:22.809 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:22.809 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi070:172.21.15.70=a;smithi116:172.21.15.116=b;smithi160:172.21.15.160=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:22.809 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: Saving service mon spec with placement smithi070:172.21.15.70=a;smithi116:172.21.15.116=b;smithi160:172.21.15.160=c;count:3 2024-09-21T05:40:22.809 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: Deploying daemon mon.c on smithi160 2024-09-21T05:40:22.810 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:22.810 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:22.810 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='client.? 172.21.15.160:0/104398668' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T05:40:22.810 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:22.810 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:40:22.810 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: mon.a calling monitor election 2024-09-21T05:40:22.810 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:40:22.810 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:40:22.810 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:22.810 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:40:22.810 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: mon.c calling monitor election 2024-09-21T05:40:22.810 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:40:22.810 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:22.810 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:40:22.810 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:40:22.811 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T05:40:22.811 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: monmap epoch 2 2024-09-21T05:40:22.811 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: fsid 96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:40:22.811 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: last_changed 2024-09-21T05:40:13.641017+0000 2024-09-21T05:40:22.811 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: created 2024-09-21T05:38:39.360099+0000 2024-09-21T05:40:22.811 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: min_mon_release 19 (squid) 2024-09-21T05:40:22.811 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: election_strategy: 1 2024-09-21T05:40:22.811 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-21T05:40:22.811 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: 1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.c 2024-09-21T05:40:22.811 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: fsmap 2024-09-21T05:40:22.811 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T05:40:22.811 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: mgrmap e13: x(active, since 41s) 2024-09-21T05:40:22.811 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: overall HEALTH_OK 2024-09-21T05:40:22.811 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:22.811 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:22.812 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:22.812 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:40:22.812 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:22.812 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: Deploying daemon mon.b on smithi116 2024-09-21T05:40:22.812 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:22.812 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:40:22.812 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: from='client.? 172.21.15.160:0/1312589007' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T05:40:22.812 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:22.812 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 ceph-mon[34332]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T05:40:22.812 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 bash[34313]: 047d833cfc82c8fe5154f15fbef178788e8a0ddc54038073ee0a39d7e1f53aa8 2024-09-21T05:40:22.812 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:22 smithi116 systemd[1]: Started Ceph mon.b for 96c6636e-77db-11ef-baf5-efdc52797490. 2024-09-21T05:40:27.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:27 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:40:27.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:27 smithi070 ceph-mon[30981]: mon.a calling monitor election 2024-09-21T05:40:27.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:27 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:40:27.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:27 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:40:27.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:27 smithi070 ceph-mon[30981]: mon.c calling monitor election 2024-09-21T05:40:27.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:27 smithi070 ceph-mon[30981]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:27.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:27 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:40:27.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:27 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:40:27.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:27 smithi070 ceph-mon[30981]: mon.b calling monitor election 2024-09-21T05:40:27.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:27 smithi070 ceph-mon[30981]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:27.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:27 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:40:27.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:27 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:40:27.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:27 smithi070 ceph-mon[30981]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:27.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:27 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:40:27.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:27 smithi070 ceph-mon[30981]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T05:40:27.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:27 smithi070 ceph-mon[30981]: monmap epoch 3 2024-09-21T05:40:27.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:27 smithi070 ceph-mon[30981]: fsid 96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:40:27.747 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:27 smithi070 ceph-mon[30981]: last_changed 2024-09-21T05:40:22.406265+0000 2024-09-21T05:40:27.747 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:27 smithi070 ceph-mon[30981]: created 2024-09-21T05:38:39.360099+0000 2024-09-21T05:40:27.747 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:27 smithi070 ceph-mon[30981]: min_mon_release 19 (squid) 2024-09-21T05:40:27.747 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:27 smithi070 ceph-mon[30981]: election_strategy: 1 2024-09-21T05:40:27.747 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:27 smithi070 ceph-mon[30981]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-21T05:40:27.747 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:27 smithi070 ceph-mon[30981]: 1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.c 2024-09-21T05:40:27.747 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:27 smithi070 ceph-mon[30981]: 2: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.b 2024-09-21T05:40:27.747 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:27 smithi070 ceph-mon[30981]: fsmap 2024-09-21T05:40:27.747 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:27 smithi070 ceph-mon[30981]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T05:40:27.747 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:27 smithi070 ceph-mon[30981]: mgrmap e13: x(active, since 50s) 2024-09-21T05:40:27.747 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:27 smithi070 ceph-mon[30981]: overall HEALTH_OK 2024-09-21T05:40:27.747 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:27 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:27.747 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:27 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:27.747 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:27 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:27.748 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:27 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:27.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:27 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:40:27.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:27 smithi116 ceph-mon[34332]: mon.a calling monitor election 2024-09-21T05:40:27.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:27 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:40:27.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:27 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:40:27.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:27 smithi116 ceph-mon[34332]: mon.c calling monitor election 2024-09-21T05:40:27.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:27 smithi116 ceph-mon[34332]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:27.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:27 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:40:27.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:27 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:40:27.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:27 smithi116 ceph-mon[34332]: mon.b calling monitor election 2024-09-21T05:40:27.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:27 smithi116 ceph-mon[34332]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:27.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:27 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:40:27.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:27 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:40:27.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:27 smithi116 ceph-mon[34332]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:27.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:27 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:40:27.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:27 smithi116 ceph-mon[34332]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T05:40:27.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:27 smithi116 ceph-mon[34332]: monmap epoch 3 2024-09-21T05:40:27.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:27 smithi116 ceph-mon[34332]: fsid 96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:40:27.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:27 smithi116 ceph-mon[34332]: last_changed 2024-09-21T05:40:22.406265+0000 2024-09-21T05:40:27.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:27 smithi116 ceph-mon[34332]: created 2024-09-21T05:38:39.360099+0000 2024-09-21T05:40:27.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:27 smithi116 ceph-mon[34332]: min_mon_release 19 (squid) 2024-09-21T05:40:27.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:27 smithi116 ceph-mon[34332]: election_strategy: 1 2024-09-21T05:40:27.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:27 smithi116 ceph-mon[34332]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-21T05:40:27.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:27 smithi116 ceph-mon[34332]: 1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.c 2024-09-21T05:40:27.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:27 smithi116 ceph-mon[34332]: 2: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.b 2024-09-21T05:40:27.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:27 smithi116 ceph-mon[34332]: fsmap 2024-09-21T05:40:27.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:27 smithi116 ceph-mon[34332]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T05:40:27.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:27 smithi116 ceph-mon[34332]: mgrmap e13: x(active, since 50s) 2024-09-21T05:40:27.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:27 smithi116 ceph-mon[34332]: overall HEALTH_OK 2024-09-21T05:40:27.807 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:27 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:27.807 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:27 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:27.807 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:27 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:27.807 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:27 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:27.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:27 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:40:27.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:27 smithi160 ceph-mon[33979]: mon.a calling monitor election 2024-09-21T05:40:27.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:27 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:40:27.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:27 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:40:27.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:27 smithi160 ceph-mon[33979]: mon.c calling monitor election 2024-09-21T05:40:27.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:27 smithi160 ceph-mon[33979]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:27.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:27 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:40:27.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:27 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:40:27.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:27 smithi160 ceph-mon[33979]: mon.b calling monitor election 2024-09-21T05:40:27.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:27 smithi160 ceph-mon[33979]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:27.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:27 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:40:27.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:27 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:40:27.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:27 smithi160 ceph-mon[33979]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:27.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:27 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:40:27.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:27 smithi160 ceph-mon[33979]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T05:40:27.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:27 smithi160 ceph-mon[33979]: monmap epoch 3 2024-09-21T05:40:27.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:27 smithi160 ceph-mon[33979]: fsid 96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:40:27.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:27 smithi160 ceph-mon[33979]: last_changed 2024-09-21T05:40:22.406265+0000 2024-09-21T05:40:27.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:27 smithi160 ceph-mon[33979]: created 2024-09-21T05:38:39.360099+0000 2024-09-21T05:40:27.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:27 smithi160 ceph-mon[33979]: min_mon_release 19 (squid) 2024-09-21T05:40:27.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:27 smithi160 ceph-mon[33979]: election_strategy: 1 2024-09-21T05:40:27.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:27 smithi160 ceph-mon[33979]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-21T05:40:27.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:27 smithi160 ceph-mon[33979]: 1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.c 2024-09-21T05:40:27.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:27 smithi160 ceph-mon[33979]: 2: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.b 2024-09-21T05:40:27.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:27 smithi160 ceph-mon[33979]: fsmap 2024-09-21T05:40:27.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:27 smithi160 ceph-mon[33979]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T05:40:27.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:27 smithi160 ceph-mon[33979]: mgrmap e13: x(active, since 50s) 2024-09-21T05:40:27.901 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:27 smithi160 ceph-mon[33979]: overall HEALTH_OK 2024-09-21T05:40:27.901 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:27 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:27.901 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:27 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:27.901 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:27 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:27.901 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:27 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:28.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:28 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:40:28.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:28 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:28.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:28 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:40:28.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:28 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:28.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:28 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:28.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:28 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:40:28.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:28 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:28.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:28 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:40:28.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:28 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:28.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:28 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:28.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:28 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:40:28.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:28 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:28.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:28 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:40:28.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:28 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:28.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:28 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:28.992 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-21T05:40:28.993 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":3,"fsid":"96c6636e-77db-11ef-baf5-efdc52797490","modified":"2024-09-21T05:40:22.406265Z","created":"2024-09-21T05:38:39.360099Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3300","nonce":0},{"type":"v1","addr":"172.21.15.70:6789","nonce":0}]},"addr":"172.21.15.70:6789/0","public_addr":"172.21.15.70:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:3300","nonce":0},{"type":"v1","addr":"172.21.15.160:6789","nonce":0}]},"addr":"172.21.15.160:6789/0","public_addr":"172.21.15.160:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:3300","nonce":0},{"type":"v1","addr":"172.21.15.116:6789","nonce":0}]},"addr":"172.21.15.116:6789/0","public_addr":"172.21.15.116:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-21T05:40:28.993 INFO:teuthology.orchestra.run.smithi160.stderr:dumped monmap epoch 3 2024-09-21T05:40:29.538 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:29 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:29 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:29 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:29.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:29 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:29.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:29 smithi160 ceph-mon[33979]: Updating smithi070:/etc/ceph/ceph.conf 2024-09-21T05:40:29.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:29 smithi160 ceph-mon[33979]: Updating smithi116:/etc/ceph/ceph.conf 2024-09-21T05:40:29.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:29 smithi160 ceph-mon[33979]: Updating smithi160:/etc/ceph/ceph.conf 2024-09-21T05:40:29.539 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:29 smithi160 ceph-mon[33979]: Updating smithi070:/var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:40:29.540 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:29 smithi160 ceph-mon[33979]: Updating smithi160:/var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:40:29.540 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:29 smithi160 ceph-mon[33979]: Updating smithi116:/var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:40:29.540 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:29 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.540 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:29 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.540 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:29 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.540 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:29 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.540 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:29 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.540 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:29 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.540 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:29 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.541 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:29 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.541 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:29 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.541 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:29 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.541 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:29 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.541 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:29 smithi160 ceph-mon[33979]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T05:40:29.541 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:29 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:40:29.541 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:29 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T05:40:29.541 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:29 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:29.541 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:29 smithi160 ceph-mon[33979]: Reconfiguring daemon mon.a on smithi070 2024-09-21T05:40:29.541 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:29 smithi160 ceph-mon[33979]: from='client.? 172.21.15.160:0/2704812731' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T05:40:29.541 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:29 smithi160 ceph-mon[33979]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:29.543 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T05:40:29.543 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T05:40:29.567 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:29 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.567 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:29 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.567 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:29 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:29.567 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:29 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:29.567 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:29 smithi070 ceph-mon[30981]: Updating smithi070:/etc/ceph/ceph.conf 2024-09-21T05:40:29.567 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:29 smithi070 ceph-mon[30981]: Updating smithi116:/etc/ceph/ceph.conf 2024-09-21T05:40:29.568 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:29 smithi070 ceph-mon[30981]: Updating smithi160:/etc/ceph/ceph.conf 2024-09-21T05:40:29.568 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:29 smithi070 ceph-mon[30981]: Updating smithi070:/var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:40:29.568 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:29 smithi070 ceph-mon[30981]: Updating smithi160:/var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:40:29.568 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:29 smithi070 ceph-mon[30981]: Updating smithi116:/var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:40:29.568 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:29 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.568 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:29 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.569 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:29 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.569 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:29 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.569 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:29 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.569 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:29 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.569 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:29 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.569 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:29 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.569 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:29 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.569 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:29 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.569 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:29 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.569 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:29 smithi070 ceph-mon[30981]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T05:40:29.570 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:29 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:40:29.570 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:29 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T05:40:29.570 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:29 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:29.570 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:29 smithi070 ceph-mon[30981]: Reconfiguring daemon mon.a on smithi070 2024-09-21T05:40:29.570 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:29 smithi070 ceph-mon[30981]: from='client.? 172.21.15.160:0/2704812731' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T05:40:29.570 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:29 smithi070 ceph-mon[30981]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:29.782 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:40:29.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:29 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:29 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:29 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:29.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:29 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:29.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:29 smithi116 ceph-mon[34332]: Updating smithi070:/etc/ceph/ceph.conf 2024-09-21T05:40:29.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:29 smithi116 ceph-mon[34332]: Updating smithi116:/etc/ceph/ceph.conf 2024-09-21T05:40:29.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:29 smithi116 ceph-mon[34332]: Updating smithi160:/etc/ceph/ceph.conf 2024-09-21T05:40:29.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:29 smithi116 ceph-mon[34332]: Updating smithi070:/var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:40:29.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:29 smithi116 ceph-mon[34332]: Updating smithi160:/var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:40:29.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:29 smithi116 ceph-mon[34332]: Updating smithi116:/var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:40:29.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:29 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:29 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:29 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:29 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:29 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:29 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:29 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:29 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:29 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:29 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:29 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:29.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:29 smithi116 ceph-mon[34332]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T05:40:29.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:29 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:40:29.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:29 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T05:40:29.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:29 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:29.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:29 smithi116 ceph-mon[34332]: Reconfiguring daemon mon.a on smithi070 2024-09-21T05:40:29.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:29 smithi116 ceph-mon[34332]: from='client.? 172.21.15.160:0/2704812731' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T05:40:29.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:29 smithi116 ceph-mon[34332]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:30.717 INFO:teuthology.orchestra.run.smithi070.stdout:# minimal ceph.conf for 96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:40:30.717 INFO:teuthology.orchestra.run.smithi070.stdout:[global] 2024-09-21T05:40:30.717 INFO:teuthology.orchestra.run.smithi070.stdout: fsid = 96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:40:30.717 INFO:teuthology.orchestra.run.smithi070.stdout: mon_host = [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-21T05:40:31.281 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T05:40:31.281 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-21T05:40:31.281 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T05:40:31.348 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-21T05:40:31.348 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:40:31.412 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-21T05:40:31.412 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T05:40:31.439 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:31 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:31.439 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:31 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:31.439 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:31 smithi116 ceph-mon[34332]: Reconfiguring mon.b (monmap changed)... 2024-09-21T05:40:31.439 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:31 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:40:31.439 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:31 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T05:40:31.439 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:31 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:31.439 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:31 smithi116 ceph-mon[34332]: Reconfiguring daemon mon.b on smithi116 2024-09-21T05:40:31.439 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:31 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3243813410' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:31.440 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-21T05:40:31.440 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:40:31.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:31 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:31.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:31 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:31.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:31 smithi070 ceph-mon[30981]: Reconfiguring mon.b (monmap changed)... 2024-09-21T05:40:31.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:31 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:40:31.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:31 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T05:40:31.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:31 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:31.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:31 smithi070 ceph-mon[30981]: Reconfiguring daemon mon.b on smithi116 2024-09-21T05:40:31.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:31 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3243813410' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:31.504 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-21T05:40:31.504 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T05:40:31.527 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:31 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:31.528 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:31 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:31.528 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:31 smithi160 ceph-mon[33979]: Reconfiguring mon.b (monmap changed)... 2024-09-21T05:40:31.528 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:31 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:40:31.528 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:31 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T05:40:31.528 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:31 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:31.528 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:31 smithi160 ceph-mon[33979]: Reconfiguring daemon mon.b on smithi116 2024-09-21T05:40:31.528 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:31 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3243813410' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:31.532 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-21T05:40:31.532 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:40:31.599 INFO:tasks.cephadm:Adding mgr.x on smithi070 2024-09-21T05:40:31.599 INFO:tasks.cephadm:Adding mgr.y on smithi116 2024-09-21T05:40:31.599 INFO:tasks.cephadm:Adding mgr.z on smithi160 2024-09-21T05:40:31.599 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph orch apply mgr '3;smithi070=x;smithi116=y;smithi160=z' 2024-09-21T05:40:32.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:32 smithi070 ceph-mon[30981]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:32.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:32 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:32.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:32 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:32.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:32 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:40:32.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:32 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T05:40:32.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:32 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:32.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:32 smithi116 ceph-mon[34332]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:32.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:32 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:32.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:32 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:32.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:32 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:40:32.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:32 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T05:40:32.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:32 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:32.585 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:32 smithi160 ceph-mon[33979]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:32.585 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:32 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:32.585 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:32 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:32.585 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:32 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:40:32.585 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:32 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T05:40:32.585 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:32 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:32.712 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:40:33.334 INFO:teuthology.orchestra.run.smithi160.stdout:Scheduled mgr update... 2024-09-21T05:40:33.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:33 smithi070 ceph-mon[30981]: Reconfiguring mon.c (monmap changed)... 2024-09-21T05:40:33.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:33 smithi070 ceph-mon[30981]: Reconfiguring daemon mon.c on smithi160 2024-09-21T05:40:33.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:33 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:33.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:33 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:33.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:33 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:40:33.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:33 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:33.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:33 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:33.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:33 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:33.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:33 smithi116 ceph-mon[34332]: Reconfiguring mon.c (monmap changed)... 2024-09-21T05:40:33.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:33 smithi116 ceph-mon[34332]: Reconfiguring daemon mon.c on smithi160 2024-09-21T05:40:33.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:33 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:33.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:33 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:33.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:33 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:40:33.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:33 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:33.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:33 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:33.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:33 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:33.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:33 smithi160 ceph-mon[33979]: Reconfiguring mon.c (monmap changed)... 2024-09-21T05:40:33.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:33 smithi160 ceph-mon[33979]: Reconfiguring daemon mon.c on smithi160 2024-09-21T05:40:33.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:33 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:33.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:33 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:33.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:33 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:40:33.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:33 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:33.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:33 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:33.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:33 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:33.917 DEBUG:teuthology.orchestra.run.smithi116:mgr.y> sudo journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mgr.y.service 2024-09-21T05:40:33.920 DEBUG:teuthology.orchestra.run.smithi160:mgr.z> sudo journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mgr.z.service 2024-09-21T05:40:33.922 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-21T05:40:33.923 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-21T05:40:33.925 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-21T05:40:33.925 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph config set client debug_client 20 2024-09-21T05:40:33.968 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-21T05:40:33.968 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph config set client debug_ms 1 2024-09-21T05:40:34.012 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-21T05:40:34.012 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-21T05:40:34.055 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-21T05:40:34.055 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-21T05:40:34.098 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-21T05:40:34.098 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-21T05:40:34.141 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-21T05:40:34.141 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-21T05:40:34.184 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-21T05:40:34.184 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-21T05:40:34.222 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:40:34.224 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-21T05:40:34.224 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-21T05:40:34.276 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-21T05:40:34.277 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_merge_size 5 2024-09-21T05:40:34.320 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-21T05:40:34.320 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_bits 3 2024-09-21T05:40:34.363 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-21T05:40:34.363 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_size 100 2024-09-21T05:40:34.406 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-21T05:40:34.406 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-21T05:40:34.449 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-21T05:40:34.449 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-21T05:40:34.478 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:34 smithi070 ceph-mon[30981]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:34.478 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:34 smithi070 ceph-mon[30981]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi070=x;smithi116=y;smithi160=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:34.478 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:34 smithi070 ceph-mon[30981]: Saving service mgr spec with placement smithi070=x;smithi116=y;smithi160=z;count:3 2024-09-21T05:40:34.478 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:34 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:34.478 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:34 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:40:34.479 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:34 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:34.479 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:34 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:34.479 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:34 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:34.479 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:34 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T05:40:34.479 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:34 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T05:40:34.479 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:34 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T05:40:34.479 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:34 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:34.489 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-21T05:40:34.489 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-21T05:40:34.532 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-21T05:40:34.532 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-21T05:40:34.578 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-21T05:40:34.578 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-21T05:40:34.621 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T05:40:34.621 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-21T05:40:34.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:34 smithi160 ceph-mon[33979]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:34.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:34 smithi160 ceph-mon[33979]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi070=x;smithi116=y;smithi160=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:34.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:34 smithi160 ceph-mon[33979]: Saving service mgr spec with placement smithi070=x;smithi116=y;smithi160=z;count:3 2024-09-21T05:40:34.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:34 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:34.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:34 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:40:34.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:34 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:34.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:34 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:34.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:34 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:34.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:34 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T05:40:34.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:34 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T05:40:34.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:34 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T05:40:34.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:34 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:34.664 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T05:40:34.664 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-21T05:40:34.712 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2024-09-21T05:40:34.712 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph config set mgr client_mount_timeout 30 2024-09-21T05:40:34.762 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2024-09-21T05:40:34.762 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph config set mgr debug_client 20 2024-09-21T05:40:34.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:34 smithi116 ceph-mon[34332]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:34.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:34 smithi116 ceph-mon[34332]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi070=x;smithi116=y;smithi160=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:34.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:34 smithi116 ceph-mon[34332]: Saving service mgr spec with placement smithi070=x;smithi116=y;smithi160=z;count:3 2024-09-21T05:40:34.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:34 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:34.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:34 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:40:34.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:34 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:34.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:34 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:34.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:34 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:34.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:34 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T05:40:34.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:34 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T05:40:34.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:34 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T05:40:34.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:34 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:34.807 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2024-09-21T05:40:34.808 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph config set mgr debug_mgr 20 2024-09-21T05:40:34.860 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2024-09-21T05:40:34.860 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph config set mgr debug_ms 1 2024-09-21T05:40:34.913 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T05:40:34.913 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T05:40:34.914 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:40:34.981 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-21T05:40:34.981 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-21T05:40:35.040 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-21T05:40:35.041 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-21T05:40:35.104 DEBUG:tasks.cephadm:set 26 configs 2024-09-21T05:40:35.104 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96c6636e-77db-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi070') 2024-09-21T05:40:35.348 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:35 smithi070 ceph-mon[30981]: Deploying daemon mgr.z on smithi160 2024-09-21T05:40:35.348 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:35 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1371395236' entity='client.admin' 2024-09-21T05:40:35.400 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:40:35.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:35 smithi160 ceph-mon[33979]: Deploying daemon mgr.z on smithi160 2024-09-21T05:40:35.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:35 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1371395236' entity='client.admin' 2024-09-21T05:40:35.649 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 05:40:35 smithi160 systemd[1]: Starting Ceph mgr.z for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:40:35.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:35 smithi116 ceph-mon[34332]: Deploying daemon mgr.z on smithi160 2024-09-21T05:40:35.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:35 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1371395236' entity='client.admin' 2024-09-21T05:40:35.948 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 05:40:35 smithi160 podman[35091]: 2024-09-21 05:40:35.568936431 +0000 UTC m=+0.015457016 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:40:35.948 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 05:40:35 smithi160 podman[35091]: 2024-09-21 05:40:35.689008555 +0000 UTC m=+0.135529129 container create bb38d8e43da1355082f4461ba6d109505c77fc033e22ce3dacacc69379a74c2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-z, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True) 2024-09-21T05:40:35.948 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 05:40:35 smithi160 podman[35091]: 2024-09-21 05:40:35.908256697 +0000 UTC m=+0.354777277 container init bb38d8e43da1355082f4461ba6d109505c77fc033e22ce3dacacc69379a74c2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-z, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T05:40:35.948 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 05:40:35 smithi160 podman[35091]: 2024-09-21 05:40:35.911252148 +0000 UTC m=+0.357772719 container start bb38d8e43da1355082f4461ba6d109505c77fc033e22ce3dacacc69379a74c2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-z, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=) 2024-09-21T05:40:36.336 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 05:40:35 smithi160 ceph-mgr[35110]: -- 172.21.15.160:0/2880045274 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555e5043d0e0 con 0x555e551e0000 2024-09-21T05:40:36.336 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 05:40:35 smithi160 bash[35091]: bb38d8e43da1355082f4461ba6d109505c77fc033e22ce3dacacc69379a74c2a 2024-09-21T05:40:36.336 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 05:40:35 smithi160 systemd[1]: Started Ceph mgr.z for 96c6636e-77db-11ef-baf5-efdc52797490. 2024-09-21T05:40:36.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:36 smithi070 ceph-mon[30981]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:36.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:36 smithi070 ceph-mon[30981]: from='client.? ' entity='client.admin' 2024-09-21T05:40:36.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:36 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:36.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:36 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:36.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:36 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:36.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:36 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T05:40:36.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:36 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T05:40:36.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:36 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T05:40:36.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:36 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:36.519 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:40:36.610 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:36 smithi116 ceph-mon[34332]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:36.610 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:36 smithi116 ceph-mon[34332]: from='client.? ' entity='client.admin' 2024-09-21T05:40:36.610 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:36 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:36.610 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:36 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:36.610 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:36 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:36.610 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:36 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T05:40:36.610 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:36 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T05:40:36.610 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:36 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T05:40:36.610 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:36 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:36.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:36 smithi160 ceph-mon[33979]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:36.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:36 smithi160 ceph-mon[33979]: from='client.? ' entity='client.admin' 2024-09-21T05:40:36.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:36 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:36.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:36 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:36.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:36 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:36.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:36 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T05:40:36.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:36 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T05:40:36.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:36 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T05:40:36.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:36 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:37.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:37 smithi116 ceph-mon[34332]: Deploying daemon mgr.y on smithi116 2024-09-21T05:40:37.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:37 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3260904763' entity='client.admin' 2024-09-21T05:40:37.538 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:37 smithi070 ceph-mon[30981]: Deploying daemon mgr.y on smithi116 2024-09-21T05:40:37.538 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:37 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3260904763' entity='client.admin' 2024-09-21T05:40:37.567 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96c6636e-77db-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi070') 2024-09-21T05:40:37.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:37 smithi160 ceph-mon[33979]: Deploying daemon mgr.y on smithi116 2024-09-21T05:40:37.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:37 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3260904763' entity='client.admin' 2024-09-21T05:40:38.006 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:40:38.006 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:40:38.012 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:40:38.013 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:40:38.054 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Sep 21 05:40:38 smithi116 podman[35148]: 2024-09-21 05:40:38.005054975 +0000 UTC m=+0.121990754 container create 43281668584a56d0c488c06cd9d4dc4f3b557ebe9395e8441ec2b6544f2c5332 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-y, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True) 2024-09-21T05:40:38.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:37.575+0000 7f17bab2f640 1 -- 172.21.15.70:0/781558223 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f179c03fb20 msgr2=0x7f179c042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:38.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:37.575+0000 7f17bab2f640 1 --2- 172.21.15.70:0/781558223 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f179c03fb20 0x7f179c042030 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f17ac005fd0 tx=0x7f17ac009500 comp rx=0 tx=0).stop 2024-09-21T05:40:38.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:37.575+0000 7f17bab2f640 1 -- 172.21.15.70:0/781558223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17b41094a0 msgr2=0x7f17b419b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:38.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:37.575+0000 7f17bab2f640 1 --2- 172.21.15.70:0/781558223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17b41094a0 0x7f17b419b010 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f17a400d950 tx=0x7f17a400de10 comp rx=0 tx=0).stop 2024-09-21T05:40:38.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:37.575+0000 7f17bab2f640 1 -- 172.21.15.70:0/781558223 shutdown_connections 2024-09-21T05:40:38.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:37.575+0000 7f17bab2f640 1 --2- 172.21.15.70:0/781558223 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f179c03fb20 0x7f179c042030 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:38.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:37.575+0000 7f17bab2f640 1 --2- 172.21.15.70:0/781558223 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17b4106900 0x7f17b419a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:38.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:37.575+0000 7f17bab2f640 1 --2- 172.21.15.70:0/781558223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17b41094a0 0x7f17b419b010 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:38.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:37.575+0000 7f17bab2f640 1 --2- 172.21.15.70:0/781558223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f17b406c340 0x7f17b4199e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:38.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:37.575+0000 7f17bab2f640 1 -- 172.21.15.70:0/781558223 >> 172.21.15.70:0/781558223 conn(0x7f17b40fdfe0 msgr2=0x7f17b4104d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:38.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:37.576+0000 7f17bab2f640 1 -- 172.21.15.70:0/781558223 shutdown_connections 2024-09-21T05:40:38.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:37.576+0000 7f17bab2f640 1 -- 172.21.15.70:0/781558223 wait complete. 2024-09-21T05:40:38.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:38 smithi116 ceph-mon[34332]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:38.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:38 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/781558223' entity='client.admin' 2024-09-21T05:40:38.555 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Sep 21 05:40:38 smithi116 podman[35148]: 2024-09-21 05:40:38.224104554 +0000 UTC m=+0.341040299 container init 43281668584a56d0c488c06cd9d4dc4f3b557ebe9395e8441ec2b6544f2c5332 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-y, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-21T05:40:38.555 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Sep 21 05:40:38 smithi116 podman[35148]: 2024-09-21 05:40:38.226867558 +0000 UTC m=+0.343803294 container start 43281668584a56d0c488c06cd9d4dc4f3b557ebe9395e8441ec2b6544f2c5332 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-21T05:40:38.555 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Sep 21 05:40:38 smithi116 ceph-mgr[35167]: -- 172.21.15.116:0/3255628000 <== mon.2 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557d52afb0e0 con 0x557d5789e000 2024-09-21T05:40:38.555 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Sep 21 05:40:38 smithi116 bash[35148]: 43281668584a56d0c488c06cd9d4dc4f3b557ebe9395e8441ec2b6544f2c5332 2024-09-21T05:40:38.555 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Sep 21 05:40:38 smithi116 systemd[1]: Started Ceph mgr.y for 96c6636e-77db-11ef-baf5-efdc52797490. 2024-09-21T05:40:38.606 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:38 smithi070 ceph-mon[30981]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:38.606 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:38 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/781558223' entity='client.admin' 2024-09-21T05:40:38.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:38 smithi160 ceph-mon[33979]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:38.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:38 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/781558223' entity='client.admin' 2024-09-21T05:40:39.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.113+0000 7f7fad6f9640 1 -- 172.21.15.70:0/675986699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fa8102640 msgr2=0x7f7fa8102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:39.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.113+0000 7f7fad6f9640 1 --2- 172.21.15.70:0/675986699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fa8102640 0x7f7fa8102ab0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7f98009900 tx=0x7f7f9802a480 comp rx=0 tx=0).stop 2024-09-21T05:40:39.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.113+0000 7f7fad6f9640 1 -- 172.21.15.70:0/675986699 shutdown_connections 2024-09-21T05:40:39.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.113+0000 7f7fad6f9640 1 --2- 172.21.15.70:0/675986699 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7fa81036d0 0x7f7fa8103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:39.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.113+0000 7f7fad6f9640 1 --2- 172.21.15.70:0/675986699 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fa8104070 0x7f7fa810aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:39.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.113+0000 7f7fad6f9640 1 --2- 172.21.15.70:0/675986699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fa8102640 0x7f7fa8102ab0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:39.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.113+0000 7f7fad6f9640 1 -- 172.21.15.70:0/675986699 >> 172.21.15.70:0/675986699 conn(0x7f7fa80fdfb0 msgr2=0x7f7fa8100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:39.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.113+0000 7f7fad6f9640 1 -- 172.21.15.70:0/675986699 shutdown_connections 2024-09-21T05:40:39.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.113+0000 7f7fad6f9640 1 -- 172.21.15.70:0/675986699 wait complete. 2024-09-21T05:40:39.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.114+0000 7f7fad6f9640 1 Processor -- start 2024-09-21T05:40:39.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.114+0000 7f7fad6f9640 1 -- start start 2024-09-21T05:40:39.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.114+0000 7f7fad6f9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fa8102640 0x7f7fa806b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:39.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.114+0000 7f7fad6f9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fa81036d0 0x7f7fa819ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:39.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.114+0000 7f7fad6f9640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7fa8104070 0x7f7fa81a11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:39.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.114+0000 7f7fad6f9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa810e150 con 0x7f7fa8102640 2024-09-21T05:40:39.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.114+0000 7f7fad6f9640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa810dfd0 con 0x7f7fa81036d0 2024-09-21T05:40:39.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.114+0000 7f7fad6f9640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa810e2d0 con 0x7f7fa8104070 2024-09-21T05:40:39.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.114+0000 7f7fa6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fa8102640 0x7f7fa806b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:39.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.115+0000 7f7fa6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fa8102640 0x7f7fa806b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56784/0 (socket says 172.21.15.70:56784) 2024-09-21T05:40:39.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.115+0000 7f7fa6ffd640 1 -- 172.21.15.70:0/3692437792 learned_addr learned my addr 172.21.15.70:0/3692437792 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:40:39.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.115+0000 7f7fa77fe640 1 --2- 172.21.15.70:0/3692437792 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7fa8104070 0x7f7fa81a11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:39.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.115+0000 7f7fa67fc640 1 --2- 172.21.15.70:0/3692437792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fa81036d0 0x7f7fa819ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:39.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.115+0000 7f7fa6ffd640 1 -- 172.21.15.70:0/3692437792 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7fa8104070 msgr2=0x7f7fa81a11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:39.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.115+0000 7f7fa6ffd640 1 --2- 172.21.15.70:0/3692437792 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7fa8104070 0x7f7fa81a11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:39.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.115+0000 7f7fa6ffd640 1 -- 172.21.15.70:0/3692437792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fa81036d0 msgr2=0x7f7fa819ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:39.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.115+0000 7f7fa6ffd640 1 --2- 172.21.15.70:0/3692437792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fa81036d0 0x7f7fa819ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:39.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.115+0000 7f7fa6ffd640 1 -- 172.21.15.70:0/3692437792 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa81a19b0 con 0x7f7fa8102640 2024-09-21T05:40:39.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.115+0000 7f7fa77fe640 1 --2- 172.21.15.70:0/3692437792 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7fa8104070 0x7f7fa81a11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:40:39.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.115+0000 7f7fa6ffd640 1 --2- 172.21.15.70:0/3692437792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fa8102640 0x7f7fa806b6a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7f98006010 tx=0x7f7f980042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:39.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.115+0000 7f7f8ffff640 1 -- 172.21.15.70:0/3692437792 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9803f030 con 0x7f7fa8102640 2024-09-21T05:40:39.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.115+0000 7f7fad6f9640 1 -- 172.21.15.70:0/3692437792 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fa81a1c40 con 0x7f7fa8102640 2024-09-21T05:40:39.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.115+0000 7f7f8ffff640 1 -- 172.21.15.70:0/3692437792 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1066+0+0 (secure 0 0 0) 0x7f7f98032e20 con 0x7f7fa8102640 2024-09-21T05:40:39.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.115+0000 7f7f8ffff640 1 -- 172.21.15.70:0/3692437792 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f98035070 con 0x7f7fa8102640 2024-09-21T05:40:39.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.115+0000 7f7fad6f9640 1 -- 172.21.15.70:0/3692437792 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fa81a2170 con 0x7f7fa8102640 2024-09-21T05:40:39.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.116+0000 7f7f8ffff640 1 -- 172.21.15.70:0/3692437792 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 51898+0+0 (secure 0 0 0) 0x7f7f98042030 con 0x7f7fa8102640 2024-09-21T05:40:39.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.116+0000 7f7fad6f9640 1 -- 172.21.15.70:0/3692437792 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fa8109820 con 0x7f7fa8102640 2024-09-21T05:40:39.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.117+0000 7f7f8ffff640 1 --2- 172.21.15.70:0/3692437792 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7f9003fb20 0x7f7f90042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:39.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.117+0000 7f7f8ffff640 1 -- 172.21.15.70:0/3692437792 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7f980749c0 con 0x7f7fa8102640 2024-09-21T05:40:39.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.117+0000 7f7fa67fc640 1 --2- 172.21.15.70:0/3692437792 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7f9003fb20 0x7f7f90042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:39.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.117+0000 7f7fa67fc640 1 --2- 172.21.15.70:0/3692437792 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7f9003fb20 0x7f7f90042030 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c009bd0 tx=0x7f7f9c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:39.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.122+0000 7f7f8ffff640 1 -- 172.21.15.70:0/3692437792 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7f98076e20 con 0x7f7fa8102640 2024-09-21T05:40:39.135 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:40:39.136 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:40:39.138 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:40:39.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.331+0000 7f7fad6f9640 1 -- 172.21.15.70:0/3692437792 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f7fa802e640 con 0x7f7fa8102640 2024-09-21T05:40:39.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.335+0000 7f7f8ffff640 1 -- 172.21.15.70:0/3692437792 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v14)=0 v14) ==== 116+0+0 (secure 0 0 0) 0x7f7f980303a0 con 0x7f7fa8102640 2024-09-21T05:40:39.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.338+0000 7f7fad6f9640 1 -- 172.21.15.70:0/3692437792 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7f9003fb20 msgr2=0x7f7f90042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:39.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.338+0000 7f7fad6f9640 1 --2- 172.21.15.70:0/3692437792 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7f9003fb20 0x7f7f90042030 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c009bd0 tx=0x7f7f9c005f90 comp rx=0 tx=0).stop 2024-09-21T05:40:39.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.338+0000 7f7fad6f9640 1 -- 172.21.15.70:0/3692437792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fa8102640 msgr2=0x7f7fa806b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:39.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.338+0000 7f7fad6f9640 1 --2- 172.21.15.70:0/3692437792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fa8102640 0x7f7fa806b6a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7f98006010 tx=0x7f7f980042f0 comp rx=0 tx=0).stop 2024-09-21T05:40:39.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.338+0000 7f7fad6f9640 1 -- 172.21.15.70:0/3692437792 shutdown_connections 2024-09-21T05:40:39.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.338+0000 7f7fad6f9640 1 --2- 172.21.15.70:0/3692437792 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7f9003fb20 0x7f7f90042030 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:39.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.338+0000 7f7fad6f9640 1 --2- 172.21.15.70:0/3692437792 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7fa8104070 0x7f7fa81a11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:39.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.338+0000 7f7fad6f9640 1 --2- 172.21.15.70:0/3692437792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fa81036d0 0x7f7fa819ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:39.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.338+0000 7f7fad6f9640 1 --2- 172.21.15.70:0/3692437792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fa8102640 0x7f7fa806b6a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:39.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.338+0000 7f7fad6f9640 1 -- 172.21.15.70:0/3692437792 >> 172.21.15.70:0/3692437792 conn(0x7f7fa80fdfb0 msgr2=0x7f7fa81069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:39.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.338+0000 7f7fad6f9640 1 -- 172.21.15.70:0/3692437792 shutdown_connections 2024-09-21T05:40:39.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.338+0000 7f7fad6f9640 1 -- 172.21.15.70:0/3692437792 wait complete. 2024-09-21T05:40:39.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.346+0000 7f673f7c4640 1 -- 172.21.15.70:0/227711771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6738102e50 msgr2=0x7f6738103260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:39.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.346+0000 7f673f7c4640 1 --2- 172.21.15.70:0/227711771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6738102e50 0x7f6738103260 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6728009900 tx=0x7f672802a480 comp rx=0 tx=0).stop 2024-09-21T05:40:39.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.346+0000 7f673f7c4640 1 -- 172.21.15.70:0/227711771 shutdown_connections 2024-09-21T05:40:39.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.346+0000 7f673f7c4640 1 --2- 172.21.15.70:0/227711771 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67381037f0 0x7f673810a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:39.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.346+0000 7f673f7c4640 1 --2- 172.21.15.70:0/227711771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6738102e50 0x7f6738103260 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:39.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.346+0000 7f673f7c4640 1 --2- 172.21.15.70:0/227711771 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6738101dc0 0x7f6738102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:39.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.346+0000 7f673f7c4640 1 -- 172.21.15.70:0/227711771 >> 172.21.15.70:0/227711771 conn(0x7f67380fd770 msgr2=0x7f67380ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:39.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.346+0000 7f673f7c4640 1 -- 172.21.15.70:0/227711771 shutdown_connections 2024-09-21T05:40:39.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.346+0000 7f673f7c4640 1 -- 172.21.15.70:0/227711771 wait complete. 2024-09-21T05:40:39.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.347+0000 7f673f7c4640 1 Processor -- start 2024-09-21T05:40:39.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.347+0000 7f673f7c4640 1 -- start start 2024-09-21T05:40:39.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.347+0000 7f673f7c4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6738101dc0 0x7f67380ff590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:39.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.347+0000 7f673f7c4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6738102e50 0x7f673819ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:39.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.347+0000 7f673f7c4640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f67381037f0 0x7f67381a11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:39.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.347+0000 7f673f7c4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f673810d8c0 con 0x7f6738102e50 2024-09-21T05:40:39.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.347+0000 7f673f7c4640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f673810d740 con 0x7f67381037f0 2024-09-21T05:40:39.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.347+0000 7f673f7c4640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f673810da40 con 0x7f6738101dc0 2024-09-21T05:40:39.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.347+0000 7f673cd5f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6738102e50 0x7f673819ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:39.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.347+0000 7f673cd5f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6738102e50 0x7f673819ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56798/0 (socket says 172.21.15.70:56798) 2024-09-21T05:40:39.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.347+0000 7f673cd5f640 1 -- 172.21.15.70:0/1251652219 learned_addr learned my addr 172.21.15.70:0/1251652219 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:40:39.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.347+0000 7f673d560640 1 --2- 172.21.15.70:0/1251652219 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6738101dc0 0x7f67380ff590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:39.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.347+0000 7f673dd61640 1 --2- 172.21.15.70:0/1251652219 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f67381037f0 0x7f67381a11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:39.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.348+0000 7f673cd5f640 1 -- 172.21.15.70:0/1251652219 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6738101dc0 msgr2=0x7f67380ff590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:39.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.348+0000 7f673cd5f640 1 --2- 172.21.15.70:0/1251652219 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6738101dc0 0x7f67380ff590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:39.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.348+0000 7f673cd5f640 1 -- 172.21.15.70:0/1251652219 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f67381037f0 msgr2=0x7f67381a11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:39.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.348+0000 7f673cd5f640 1 --2- 172.21.15.70:0/1251652219 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f67381037f0 0x7f67381a11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:39.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.348+0000 7f673cd5f640 1 -- 172.21.15.70:0/1251652219 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67381a19d0 con 0x7f6738102e50 2024-09-21T05:40:39.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.348+0000 7f673cd5f640 1 --2- 172.21.15.70:0/1251652219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6738102e50 0x7f673819ec80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6728006010 tx=0x7f67280040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:39.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.348+0000 7f672e7fc640 1 -- 172.21.15.70:0/1251652219 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672803f030 con 0x7f6738102e50 2024-09-21T05:40:39.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.348+0000 7f672e7fc640 1 -- 172.21.15.70:0/1251652219 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1066+0+0 (secure 0 0 0) 0x7f67280044c0 con 0x7f6738102e50 2024-09-21T05:40:39.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.348+0000 7f672e7fc640 1 -- 172.21.15.70:0/1251652219 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6728035070 con 0x7f6738102e50 2024-09-21T05:40:39.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.348+0000 7f673f7c4640 1 -- 172.21.15.70:0/1251652219 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67381a1c60 con 0x7f6738102e50 2024-09-21T05:40:39.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.348+0000 7f673f7c4640 1 -- 172.21.15.70:0/1251652219 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67381a20f0 con 0x7f6738102e50 2024-09-21T05:40:39.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.349+0000 7f672e7fc640 1 -- 172.21.15.70:0/1251652219 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 51898+0+0 (secure 0 0 0) 0x7f6728042030 con 0x7f6738102e50 2024-09-21T05:40:39.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.349+0000 7f673f7c4640 1 -- 172.21.15.70:0/1251652219 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6738109940 con 0x7f6738102e50 2024-09-21T05:40:39.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.350+0000 7f672e7fc640 1 --2- 172.21.15.70:0/1251652219 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f672403fb20 0x7f6724042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:39.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.350+0000 7f672e7fc640 1 -- 172.21.15.70:0/1251652219 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6728074920 con 0x7f6738102e50 2024-09-21T05:40:39.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.350+0000 7f673d560640 1 --2- 172.21.15.70:0/1251652219 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f672403fb20 0x7f6724042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:39.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.350+0000 7f673d560640 1 --2- 172.21.15.70:0/1251652219 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f672403fb20 0x7f6724042030 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6734009bd0 tx=0x7f6734005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:39.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.355+0000 7f672e7fc640 1 -- 172.21.15.70:0/1251652219 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f67280303a0 con 0x7f6738102e50 2024-09-21T05:40:39.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.561+0000 7f673f7c4640 1 -- 172.21.15.70:0/1251652219 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f6738063fc0 con 0x7f6738102e50 2024-09-21T05:40:39.564 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:39 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:39.564 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:39 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:39.564 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:39 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:39.564 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:39 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:39.564 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:39 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:40:39.564 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:39 smithi070 ceph-mon[30981]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:39.564 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:39 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3692437792' entity='client.admin' 2024-09-21T05:40:39.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.565+0000 7f672e7fc640 1 -- 172.21.15.70:0/1251652219 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v15)=0 v15) ==== 116+0+0 (secure 0 0 0) 0x7f672804cdc0 con 0x7f6738102e50 2024-09-21T05:40:39.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.567+0000 7f673f7c4640 1 -- 172.21.15.70:0/1251652219 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f672403fb20 msgr2=0x7f6724042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:39.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.567+0000 7f673f7c4640 1 --2- 172.21.15.70:0/1251652219 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f672403fb20 0x7f6724042030 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6734009bd0 tx=0x7f6734005f90 comp rx=0 tx=0).stop 2024-09-21T05:40:39.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.567+0000 7f673f7c4640 1 -- 172.21.15.70:0/1251652219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6738102e50 msgr2=0x7f673819ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:39.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.567+0000 7f673f7c4640 1 --2- 172.21.15.70:0/1251652219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6738102e50 0x7f673819ec80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6728006010 tx=0x7f67280040c0 comp rx=0 tx=0).stop 2024-09-21T05:40:39.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.567+0000 7f673f7c4640 1 -- 172.21.15.70:0/1251652219 shutdown_connections 2024-09-21T05:40:39.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.567+0000 7f673f7c4640 1 --2- 172.21.15.70:0/1251652219 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f672403fb20 0x7f6724042030 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:39.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.567+0000 7f673f7c4640 1 --2- 172.21.15.70:0/1251652219 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f67381037f0 0x7f67381a11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:39.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.567+0000 7f673f7c4640 1 --2- 172.21.15.70:0/1251652219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6738102e50 0x7f673819ec80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:39.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.567+0000 7f673f7c4640 1 --2- 172.21.15.70:0/1251652219 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6738101dc0 0x7f67380ff590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:39.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.568+0000 7f673f7c4640 1 -- 172.21.15.70:0/1251652219 >> 172.21.15.70:0/1251652219 conn(0x7f67380fd770 msgr2=0x7f6738106b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:39.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.568+0000 7f673f7c4640 1 -- 172.21.15.70:0/1251652219 shutdown_connections 2024-09-21T05:40:39.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:39.568+0000 7f673f7c4640 1 -- 172.21.15.70:0/1251652219 wait complete. 2024-09-21T05:40:39.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:39 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:39.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:39 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:39.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:39 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:39.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:39 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:39.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:39 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:40:39.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:39 smithi160 ceph-mon[33979]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:39.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:39 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3692437792' entity='client.admin' 2024-09-21T05:40:39.732 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96c6636e-77db-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi070') 2024-09-21T05:40:39.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:39 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:39.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:39 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:39.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:39 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:39.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:39 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:39.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:39 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:40:39.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:39 smithi116 ceph-mon[34332]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:39.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:39 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3692437792' entity='client.admin' 2024-09-21T05:40:40.378 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:40:40.743 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:40 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:40.743 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:40 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:40.744 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:40 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:40.744 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:40 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:40.744 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:40 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:40.744 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:40 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:40.744 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:40 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:40.744 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:40 smithi070 ceph-mon[30981]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T05:40:40.744 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:40 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T05:40:40.744 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:40 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T05:40:40.744 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:40 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:40.744 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:40 smithi070 ceph-mon[30981]: Reconfiguring daemon mgr.x on smithi070 2024-09-21T05:40:40.744 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:40 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1251652219' entity='client.admin' 2024-09-21T05:40:40.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:40 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:40.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:40 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:40.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:40 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:40.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:40 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:40.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:40 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:40.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:40 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:40.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:40 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:40.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:40 smithi116 ceph-mon[34332]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T05:40:40.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:40 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T05:40:40.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:40 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T05:40:40.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:40 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:40.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:40 smithi116 ceph-mon[34332]: Reconfiguring daemon mgr.x on smithi070 2024-09-21T05:40:40.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:40 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1251652219' entity='client.admin' 2024-09-21T05:40:40.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:40 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:40.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:40 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:40.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:40 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:40.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:40 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:40.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:40 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:40.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:40 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:40.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:40 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:40.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:40 smithi160 ceph-mon[33979]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T05:40:40.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:40 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T05:40:40.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:40 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T05:40:40.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:40 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:40.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:40 smithi160 ceph-mon[33979]: Reconfiguring daemon mgr.x on smithi070 2024-09-21T05:40:40.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:40 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1251652219' entity='client.admin' 2024-09-21T05:40:41.605 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:41 smithi070 ceph-mon[30981]: Standby manager daemon z started 2024-09-21T05:40:41.605 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:41 smithi070 ceph-mon[30981]: from='mgr.? 172.21.15.160:0/572008526' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T05:40:41.605 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:41 smithi070 ceph-mon[30981]: from='mgr.? 172.21.15.160:0/572008526' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T05:40:41.605 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:41 smithi070 ceph-mon[30981]: from='mgr.? 172.21.15.160:0/572008526' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T05:40:41.605 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:41 smithi070 ceph-mon[30981]: from='mgr.? 172.21.15.160:0/572008526' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T05:40:41.605 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:41 smithi070 ceph-mon[30981]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:41.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:41 smithi116 ceph-mon[34332]: Standby manager daemon z started 2024-09-21T05:40:41.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:41 smithi116 ceph-mon[34332]: from='mgr.? 172.21.15.160:0/572008526' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T05:40:41.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:41 smithi116 ceph-mon[34332]: from='mgr.? 172.21.15.160:0/572008526' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T05:40:41.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:41 smithi116 ceph-mon[34332]: from='mgr.? 172.21.15.160:0/572008526' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T05:40:41.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:41 smithi116 ceph-mon[34332]: from='mgr.? 172.21.15.160:0/572008526' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T05:40:41.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:41 smithi116 ceph-mon[34332]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:41.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:41 smithi160 ceph-mon[33979]: Standby manager daemon z started 2024-09-21T05:40:41.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:41 smithi160 ceph-mon[33979]: from='mgr.? 172.21.15.160:0/572008526' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T05:40:41.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:41 smithi160 ceph-mon[33979]: from='mgr.? 172.21.15.160:0/572008526' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T05:40:41.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:41 smithi160 ceph-mon[33979]: from='mgr.? 172.21.15.160:0/572008526' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T05:40:41.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:41 smithi160 ceph-mon[33979]: from='mgr.? 172.21.15.160:0/572008526' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T05:40:41.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:41 smithi160 ceph-mon[33979]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:41.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.925+0000 7f5373605640 1 -- 172.21.15.70:0/1492170866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f536c109470 msgr2=0x7f536c10b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:41.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.925+0000 7f5373605640 1 --2- 172.21.15.70:0/1492170866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f536c109470 0x7f536c10b980 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5364009ca0 tx=0x7f536402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:40:41.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.925+0000 7f5373605640 1 -- 172.21.15.70:0/1492170866 shutdown_connections 2024-09-21T05:40:41.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.925+0000 7f5373605640 1 --2- 172.21.15.70:0/1492170866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f536c109470 0x7f536c10b980 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:41.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.925+0000 7f5373605640 1 --2- 172.21.15.70:0/1492170866 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f536c1068d0 0x7f536c108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:41.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.925+0000 7f5373605640 1 --2- 172.21.15.70:0/1492170866 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f536c06b980 0x7f536c106390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:41.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.925+0000 7f5373605640 1 -- 172.21.15.70:0/1492170866 >> 172.21.15.70:0/1492170866 conn(0x7f536c0fdfb0 msgr2=0x7f536c100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:41.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.925+0000 7f5373605640 1 -- 172.21.15.70:0/1492170866 shutdown_connections 2024-09-21T05:40:41.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.925+0000 7f5373605640 1 -- 172.21.15.70:0/1492170866 wait complete. 2024-09-21T05:40:41.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.926+0000 7f5373605640 1 Processor -- start 2024-09-21T05:40:41.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.926+0000 7f5373605640 1 -- start start 2024-09-21T05:40:41.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.926+0000 7f5373605640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f536c06b980 0x7f536c199e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:41.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.926+0000 7f5373605640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f536c1068d0 0x7f536c19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:41.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.926+0000 7f5373605640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f536c109470 0x7f536c19b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:41.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.926+0000 7f5373605640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f536c10f290 con 0x7f536c109470 2024-09-21T05:40:41.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.926+0000 7f5373605640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f536c10f110 con 0x7f536c06b980 2024-09-21T05:40:41.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.926+0000 7f5373605640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f536c10f410 con 0x7f536c1068d0 2024-09-21T05:40:41.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.927+0000 7f53713a1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f536c06b980 0x7f536c199e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:41.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.927+0000 7f53713a1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f536c06b980 0x7f536c199e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.70:47378/0 (socket says 172.21.15.70:47378) 2024-09-21T05:40:41.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.927+0000 7f53713a1640 1 -- 172.21.15.70:0/2568272635 learned_addr learned my addr 172.21.15.70:0/2568272635 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:40:41.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.927+0000 7f5370ba0640 1 --2- 172.21.15.70:0/2568272635 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f536c1068d0 0x7f536c19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:41.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.927+0000 7f5371ba2640 1 --2- 172.21.15.70:0/2568272635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f536c109470 0x7f536c19b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:41.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.927+0000 7f53713a1640 1 -- 172.21.15.70:0/2568272635 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f536c1068d0 msgr2=0x7f536c19a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:41.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.927+0000 7f53713a1640 1 --2- 172.21.15.70:0/2568272635 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f536c1068d0 0x7f536c19a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:41.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.927+0000 7f53713a1640 1 -- 172.21.15.70:0/2568272635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f536c109470 msgr2=0x7f536c19b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:41.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.927+0000 7f53713a1640 1 --2- 172.21.15.70:0/2568272635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f536c109470 0x7f536c19b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:41.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.927+0000 7f53713a1640 1 -- 172.21.15.70:0/2568272635 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f536c19b870 con 0x7f536c06b980 2024-09-21T05:40:41.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.927+0000 7f5371ba2640 1 --2- 172.21.15.70:0/2568272635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f536c109470 0x7f536c19b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:40:41.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.927+0000 7f53713a1640 1 --2- 172.21.15.70:0/2568272635 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f536c06b980 0x7f536c199e40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f536800d950 tx=0x7f536800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:41.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.928+0000 7f535e7fc640 1 -- 172.21.15.70:0/2568272635 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5368017030 con 0x7f536c06b980 2024-09-21T05:40:41.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.928+0000 7f535e7fc640 1 -- 172.21.15.70:0/2568272635 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(25 keys) ==== 1066+0+0 (secure 0 0 0) 0x7f5368004020 con 0x7f536c06b980 2024-09-21T05:40:41.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.928+0000 7f5373605640 1 -- 172.21.15.70:0/2568272635 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f536c19bb60 con 0x7f536c06b980 2024-09-21T05:40:41.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.928+0000 7f535e7fc640 1 -- 172.21.15.70:0/2568272635 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5368005630 con 0x7f536c06b980 2024-09-21T05:40:41.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.928+0000 7f5373605640 1 -- 172.21.15.70:0/2568272635 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f536c1a2260 con 0x7f536c06b980 2024-09-21T05:40:41.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.929+0000 7f5373605640 1 -- 172.21.15.70:0/2568272635 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f536c0ffad0 con 0x7f536c06b980 2024-09-21T05:40:41.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.929+0000 7f535e7fc640 1 -- 172.21.15.70:0/2568272635 <== mon.2 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 14) ==== 103177+0+0 (secure 0 0 0) 0x7f5368009a30 con 0x7f536c06b980 2024-09-21T05:40:41.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.930+0000 7f535e7fc640 1 --2- 172.21.15.70:0/2568272635 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f535807afd0 0x7f535807d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:41.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.930+0000 7f535e7fc640 1 -- 172.21.15.70:0/2568272635 <== mon.2 v2:172.21.15.116:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f536809c760 con 0x7f536c06b980 2024-09-21T05:40:41.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.930+0000 7f5370ba0640 1 --2- 172.21.15.70:0/2568272635 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f535807afd0 0x7f535807d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:41.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.930+0000 7f5370ba0640 1 --2- 172.21.15.70:0/2568272635 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f535807afd0 0x7f535807d4e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5360009b50 tx=0x7f5360005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:41.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.935+0000 7f535e7fc640 1 -- 172.21.15.70:0/2568272635 <== mon.2 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5368064dc0 con 0x7f536c06b980 2024-09-21T05:40:42.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.125+0000 7f5373605640 1 -- 172.21.15.70:0/2568272635 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f536c063fc0 con 0x7f536c06b980 2024-09-21T05:40:42.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.130+0000 7f535e7fc640 1 -- 172.21.15.70:0/2568272635 <== mon.2 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v17)=0 v17) ==== 127+0+0 (secure 0 0 0) 0x7f53680691a0 con 0x7f536c06b980 2024-09-21T05:40:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.133+0000 7f5373605640 1 -- 172.21.15.70:0/2568272635 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f535807afd0 msgr2=0x7f535807d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.133+0000 7f5373605640 1 --2- 172.21.15.70:0/2568272635 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f535807afd0 0x7f535807d4e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5360009b50 tx=0x7f5360005f90 comp rx=0 tx=0).stop 2024-09-21T05:40:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.133+0000 7f5373605640 1 -- 172.21.15.70:0/2568272635 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f536c06b980 msgr2=0x7f536c199e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.133+0000 7f5373605640 1 --2- 172.21.15.70:0/2568272635 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f536c06b980 0x7f536c199e40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f536800d950 tx=0x7f536800de10 comp rx=0 tx=0).stop 2024-09-21T05:40:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.133+0000 7f5373605640 1 -- 172.21.15.70:0/2568272635 shutdown_connections 2024-09-21T05:40:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.133+0000 7f5373605640 1 --2- 172.21.15.70:0/2568272635 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f535807afd0 0x7f535807d4e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.133+0000 7f5373605640 1 --2- 172.21.15.70:0/2568272635 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f536c1068d0 0x7f536c19a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.133+0000 7f5373605640 1 --2- 172.21.15.70:0/2568272635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f536c109470 0x7f536c19b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.133+0000 7f5373605640 1 --2- 172.21.15.70:0/2568272635 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f536c06b980 0x7f536c199e40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.133+0000 7f5373605640 1 -- 172.21.15.70:0/2568272635 >> 172.21.15.70:0/2568272635 conn(0x7f536c0fdfb0 msgr2=0x7f536c104de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.133+0000 7f5373605640 1 -- 172.21.15.70:0/2568272635 shutdown_connections 2024-09-21T05:40:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.133+0000 7f5373605640 1 -- 172.21.15.70:0/2568272635 wait complete. 2024-09-21T05:40:42.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.798+0000 7f0f456eb640 1 -- 172.21.15.70:0/2019942325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f40104070 msgr2=0x7f0f4010aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:42.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.798+0000 7f0f456eb640 1 --2- 172.21.15.70:0/2019942325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f40104070 0x7f0f4010aa10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0f38009ca0 tx=0x7f0f3802a950 comp rx=0 tx=0).stop 2024-09-21T05:40:42.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.798+0000 7f0f456eb640 1 -- 172.21.15.70:0/2019942325 shutdown_connections 2024-09-21T05:40:42.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.798+0000 7f0f456eb640 1 --2- 172.21.15.70:0/2019942325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f40104070 0x7f0f4010aa10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:42.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.798+0000 7f0f456eb640 1 --2- 172.21.15.70:0/2019942325 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0f401036d0 0x7f0f40103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:42.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.798+0000 7f0f456eb640 1 --2- 172.21.15.70:0/2019942325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f40102640 0x7f0f40102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:42.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.798+0000 7f0f456eb640 1 -- 172.21.15.70:0/2019942325 >> 172.21.15.70:0/2019942325 conn(0x7f0f400fdfb0 msgr2=0x7f0f40100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:42.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.798+0000 7f0f456eb640 1 -- 172.21.15.70:0/2019942325 shutdown_connections 2024-09-21T05:40:42.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.798+0000 7f0f456eb640 1 -- 172.21.15.70:0/2019942325 wait complete. 2024-09-21T05:40:42.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.799+0000 7f0f456eb640 1 Processor -- start 2024-09-21T05:40:42.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.799+0000 7f0f456eb640 1 -- start start 2024-09-21T05:40:42.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.799+0000 7f0f456eb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0f40102640 0x7f0f40199ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:42.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.799+0000 7f0f456eb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f401036d0 0x7f0f4019a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:42.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.799+0000 7f0f456eb640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f40104070 0x7f0f4019b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:42.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.799+0000 7f0f456eb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4010e150 con 0x7f0f401036d0 2024-09-21T05:40:42.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.799+0000 7f0f456eb640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4010dfd0 con 0x7f0f40102640 2024-09-21T05:40:42.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.799+0000 7f0f456eb640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4010e2d0 con 0x7f0f40104070 2024-09-21T05:40:42.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.799+0000 7f0f3e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f401036d0 0x7f0f4019a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:42.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.799+0000 7f0f3e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f401036d0 0x7f0f4019a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40386/0 (socket says 172.21.15.70:40386) 2024-09-21T05:40:42.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.799+0000 7f0f3e7fc640 1 -- 172.21.15.70:0/2116025110 learned_addr learned my addr 172.21.15.70:0/2116025110 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:40:42.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.799+0000 7f0f3effd640 1 --2- 172.21.15.70:0/2116025110 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0f40102640 0x7f0f40199ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:42.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.799+0000 7f0f3f7fe640 1 --2- 172.21.15.70:0/2116025110 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f40104070 0x7f0f4019b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:42.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.800+0000 7f0f3e7fc640 1 -- 172.21.15.70:0/2116025110 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f40104070 msgr2=0x7f0f4019b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:42.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.800+0000 7f0f3e7fc640 1 --2- 172.21.15.70:0/2116025110 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f40104070 0x7f0f4019b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:42.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.800+0000 7f0f3e7fc640 1 -- 172.21.15.70:0/2116025110 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0f40102640 msgr2=0x7f0f40199ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:42.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.800+0000 7f0f3e7fc640 1 --2- 172.21.15.70:0/2116025110 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0f40102640 0x7f0f40199ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:42.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.800+0000 7f0f3e7fc640 1 -- 172.21.15.70:0/2116025110 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4019b910 con 0x7f0f401036d0 2024-09-21T05:40:42.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.800+0000 7f0f3e7fc640 1 --2- 172.21.15.70:0/2116025110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f401036d0 0x7f0f4019a550 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0f3000d950 tx=0x7f0f3000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:42.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.800+0000 7f0f37fff640 1 -- 172.21.15.70:0/2116025110 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f30017030 con 0x7f0f401036d0 2024-09-21T05:40:42.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.800+0000 7f0f456eb640 1 -- 172.21.15.70:0/2116025110 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f4019bc00 con 0x7f0f401036d0 2024-09-21T05:40:42.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.800+0000 7f0f37fff640 1 -- 172.21.15.70:0/2116025110 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1066+0+0 (secure 0 0 0) 0x7f0f30004020 con 0x7f0f401036d0 2024-09-21T05:40:42.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.800+0000 7f0f456eb640 1 -- 172.21.15.70:0/2116025110 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f401a2300 con 0x7f0f401036d0 2024-09-21T05:40:42.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.800+0000 7f0f37fff640 1 -- 172.21.15.70:0/2116025110 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f30005630 con 0x7f0f401036d0 2024-09-21T05:40:42.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.801+0000 7f0f456eb640 1 -- 172.21.15.70:0/2116025110 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f40102ab0 con 0x7f0f401036d0 2024-09-21T05:40:42.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.802+0000 7f0f37fff640 1 -- 172.21.15.70:0/2116025110 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) ==== 103177+0+0 (secure 0 0 0) 0x7f0f30009a30 con 0x7f0f401036d0 2024-09-21T05:40:42.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.802+0000 7f0f37fff640 1 --2- 172.21.15.70:0/2116025110 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0f2c07afd0 0x7f0f2c07d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:42.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.803+0000 7f0f37fff640 1 -- 172.21.15.70:0/2116025110 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0f3009c650 con 0x7f0f401036d0 2024-09-21T05:40:42.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.803+0000 7f0f3effd640 1 --2- 172.21.15.70:0/2116025110 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0f2c07afd0 0x7f0f2c07d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:42.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.803+0000 7f0f3effd640 1 --2- 172.21.15.70:0/2116025110 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0f2c07afd0 0x7f0f2c07d4e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0f28005fd0 tx=0x7f0f2800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:42.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.807+0000 7f0f37fff640 1 -- 172.21.15.70:0/2116025110 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0f300690b0 con 0x7f0f401036d0 2024-09-21T05:40:42.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.995+0000 7f0f456eb640 1 -- 172.21.15.70:0/2116025110 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f0f401a2750 con 0x7f0f401036d0 2024-09-21T05:40:42.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:41.999+0000 7f0f37fff640 1 -- 172.21.15.70:0/2116025110 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v16)=0 v16) ==== 115+0+0 (secure 0 0 0) 0x7f0f3006df60 con 0x7f0f401036d0 2024-09-21T05:40:42.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.001+0000 7f0f456eb640 1 -- 172.21.15.70:0/2116025110 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0f2c07afd0 msgr2=0x7f0f2c07d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:42.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.001+0000 7f0f456eb640 1 --2- 172.21.15.70:0/2116025110 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0f2c07afd0 0x7f0f2c07d4e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0f28005fd0 tx=0x7f0f2800b390 comp rx=0 tx=0).stop 2024-09-21T05:40:42.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.001+0000 7f0f456eb640 1 -- 172.21.15.70:0/2116025110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f401036d0 msgr2=0x7f0f4019a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:42.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.001+0000 7f0f456eb640 1 --2- 172.21.15.70:0/2116025110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f401036d0 0x7f0f4019a550 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0f3000d950 tx=0x7f0f3000de10 comp rx=0 tx=0).stop 2024-09-21T05:40:42.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.001+0000 7f0f456eb640 1 -- 172.21.15.70:0/2116025110 shutdown_connections 2024-09-21T05:40:42.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.001+0000 7f0f456eb640 1 --2- 172.21.15.70:0/2116025110 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0f2c07afd0 0x7f0f2c07d4e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:42.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.001+0000 7f0f456eb640 1 --2- 172.21.15.70:0/2116025110 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f40104070 0x7f0f4019b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:42.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.001+0000 7f0f456eb640 1 --2- 172.21.15.70:0/2116025110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f401036d0 0x7f0f4019a550 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:42.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.001+0000 7f0f456eb640 1 --2- 172.21.15.70:0/2116025110 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0f40102640 0x7f0f40199ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:42.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.001+0000 7f0f456eb640 1 -- 172.21.15.70:0/2116025110 >> 172.21.15.70:0/2116025110 conn(0x7f0f400fdfb0 msgr2=0x7f0f400ff8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:42.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.002+0000 7f0f456eb640 1 -- 172.21.15.70:0/2116025110 shutdown_connections 2024-09-21T05:40:42.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.002+0000 7f0f456eb640 1 -- 172.21.15.70:0/2116025110 wait complete. 2024-09-21T05:40:42.605 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:42 smithi070 ceph-mon[30981]: mgrmap e14: x(active, since 64s), standbys: z 2024-09-21T05:40:42.605 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:42 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T05:40:42.605 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:42 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2116025110' entity='client.admin' 2024-09-21T05:40:42.605 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:42 smithi070 ceph-mon[30981]: from='client.? ' entity='client.admin' 2024-09-21T05:40:42.605 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:42 smithi070 ceph-mon[30981]: from='client.? ' entity='client.admin' 2024-09-21T05:40:42.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.696+0000 7f32a4fe0640 1 -- 172.21.15.70:0/4065805274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32a01083a0 msgr2=0x7f32a010a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:42.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.696+0000 7f32a4fe0640 1 --2- 172.21.15.70:0/4065805274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32a01083a0 0x7f32a010a8b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3298009ca0 tx=0x7f329802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:40:42.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.696+0000 7f32a4fe0640 1 -- 172.21.15.70:0/4065805274 shutdown_connections 2024-09-21T05:40:42.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.696+0000 7f32a4fe0640 1 --2- 172.21.15.70:0/4065805274 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32a0105780 0x7f32a0107c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:42.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.696+0000 7f32a4fe0640 1 --2- 172.21.15.70:0/4065805274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32a01083a0 0x7f32a010a8b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:42.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.696+0000 7f32a4fe0640 1 --2- 172.21.15.70:0/4065805274 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32a0102d20 0x7f32a0105140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:42.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.696+0000 7f32a4fe0640 1 -- 172.21.15.70:0/4065805274 >> 172.21.15.70:0/4065805274 conn(0x7f32a00fd760 msgr2=0x7f32a00ffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:42.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.696+0000 7f32a4fe0640 1 -- 172.21.15.70:0/4065805274 shutdown_connections 2024-09-21T05:40:42.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.696+0000 7f32a4fe0640 1 -- 172.21.15.70:0/4065805274 wait complete. 2024-09-21T05:40:42.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.697+0000 7f32a4fe0640 1 Processor -- start 2024-09-21T05:40:42.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.697+0000 7f32a4fe0640 1 -- start start 2024-09-21T05:40:42.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.697+0000 7f32a4fe0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32a0102d20 0x7f32a01021c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:42.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.697+0000 7f32a4fe0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32a0105780 0x7f32a019ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:42.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.697+0000 7f32a4fe0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32a01083a0 0x7f32a01a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:42.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.697+0000 7f32a4fe0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f32a010e290 con 0x7f32a0105780 2024-09-21T05:40:42.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.697+0000 7f32a4fe0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f32a010e110 con 0x7f32a0102d20 2024-09-21T05:40:42.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.697+0000 7f32a4fe0640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f32a010e410 con 0x7f32a01083a0 2024-09-21T05:40:42.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.697+0000 7f329dd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32a0105780 0x7f32a019ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:42.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.698+0000 7f329dd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32a0105780 0x7f32a019ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40442/0 (socket says 172.21.15.70:40442) 2024-09-21T05:40:42.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.698+0000 7f329dd9b640 1 -- 172.21.15.70:0/1533773553 learned_addr learned my addr 172.21.15.70:0/1533773553 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:40:42.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.698+0000 7f329e59c640 1 --2- 172.21.15.70:0/1533773553 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32a0102d20 0x7f32a01021c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:42.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.698+0000 7f329ed9d640 1 --2- 172.21.15.70:0/1533773553 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32a01083a0 0x7f32a01a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:42.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.698+0000 7f329dd9b640 1 -- 172.21.15.70:0/1533773553 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32a01083a0 msgr2=0x7f32a01a1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:42.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.698+0000 7f329dd9b640 1 --2- 172.21.15.70:0/1533773553 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32a01083a0 0x7f32a01a1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:42.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.698+0000 7f329dd9b640 1 -- 172.21.15.70:0/1533773553 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32a0102d20 msgr2=0x7f32a01021c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:42.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.698+0000 7f329dd9b640 1 --2- 172.21.15.70:0/1533773553 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32a0102d20 0x7f32a01021c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:42.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.698+0000 7f329dd9b640 1 -- 172.21.15.70:0/1533773553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a01a1a20 con 0x7f32a0105780 2024-09-21T05:40:42.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.698+0000 7f329e59c640 1 --2- 172.21.15.70:0/1533773553 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32a0102d20 0x7f32a01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:40:42.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.698+0000 7f329dd9b640 1 --2- 172.21.15.70:0/1533773553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32a0105780 0x7f32a019ecd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f329400e9f0 tx=0x7f329400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:42.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.698+0000 7f328f7fe640 1 -- 172.21.15.70:0/1533773553 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329400cd80 con 0x7f32a0105780 2024-09-21T05:40:42.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.698+0000 7f328f7fe640 1 -- 172.21.15.70:0/1533773553 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f32940054d0 con 0x7f32a0105780 2024-09-21T05:40:42.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.698+0000 7f32a4fe0640 1 -- 172.21.15.70:0/1533773553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32a01a1d10 con 0x7f32a0105780 2024-09-21T05:40:42.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.698+0000 7f328f7fe640 1 -- 172.21.15.70:0/1533773553 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3294010690 con 0x7f32a0105780 2024-09-21T05:40:42.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.698+0000 7f32a4fe0640 1 -- 172.21.15.70:0/1533773553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32a01a21a0 con 0x7f32a0105780 2024-09-21T05:40:42.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.700+0000 7f32a4fe0640 1 -- 172.21.15.70:0/1533773553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32a00ff280 con 0x7f32a0105780 2024-09-21T05:40:42.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.700+0000 7f328f7fe640 1 -- 172.21.15.70:0/1533773553 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) ==== 103177+0+0 (secure 0 0 0) 0x7f32940046c0 con 0x7f32a0105780 2024-09-21T05:40:42.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.701+0000 7f328f7fe640 1 --2- 172.21.15.70:0/1533773553 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f328807afd0 0x7f328807d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:42.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.701+0000 7f329e59c640 1 --2- 172.21.15.70:0/1533773553 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f328807afd0 0x7f328807d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:42.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.701+0000 7f328f7fe640 1 -- 172.21.15.70:0/1533773553 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f329409d0c0 con 0x7f32a0105780 2024-09-21T05:40:42.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.702+0000 7f329e59c640 1 --2- 172.21.15.70:0/1533773553 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f328807afd0 0x7f328807d4e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3290009fc0 tx=0x7f3290005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:42.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.706+0000 7f328f7fe640 1 -- 172.21.15.70:0/1533773553 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3294065880 con 0x7f32a0105780 2024-09-21T05:40:42.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:42 smithi116 ceph-mon[34332]: mgrmap e14: x(active, since 64s), standbys: z 2024-09-21T05:40:42.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:42 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T05:40:42.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:42 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2116025110' entity='client.admin' 2024-09-21T05:40:42.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:42 smithi116 ceph-mon[34332]: from='client.? ' entity='client.admin' 2024-09-21T05:40:42.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:42 smithi116 ceph-mon[34332]: from='client.? ' entity='client.admin' 2024-09-21T05:40:42.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.886+0000 7f32a4fe0640 1 -- 172.21.15.70:0/1533773553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f32a0063fc0 con 0x7f32a0105780 2024-09-21T05:40:42.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.891+0000 7f328f7fe640 1 -- 172.21.15.70:0/1533773553 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v19)=0 v19) ==== 108+0+0 (secure 0 0 0) 0x7f3294069c60 con 0x7f32a0105780 2024-09-21T05:40:42.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.894+0000 7f32a4fe0640 1 -- 172.21.15.70:0/1533773553 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f328807afd0 msgr2=0x7f328807d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:42.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.894+0000 7f32a4fe0640 1 --2- 172.21.15.70:0/1533773553 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f328807afd0 0x7f328807d4e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3290009fc0 tx=0x7f3290005f90 comp rx=0 tx=0).stop 2024-09-21T05:40:42.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.894+0000 7f32a4fe0640 1 -- 172.21.15.70:0/1533773553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32a0105780 msgr2=0x7f32a019ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:42.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.894+0000 7f32a4fe0640 1 --2- 172.21.15.70:0/1533773553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32a0105780 0x7f32a019ecd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f329400e9f0 tx=0x7f329400edf0 comp rx=0 tx=0).stop 2024-09-21T05:40:42.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.894+0000 7f32a4fe0640 1 -- 172.21.15.70:0/1533773553 shutdown_connections 2024-09-21T05:40:42.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.894+0000 7f32a4fe0640 1 --2- 172.21.15.70:0/1533773553 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f328807afd0 0x7f328807d4e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:42.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.894+0000 7f32a4fe0640 1 --2- 172.21.15.70:0/1533773553 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32a01083a0 0x7f32a01a1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:42.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.894+0000 7f32a4fe0640 1 --2- 172.21.15.70:0/1533773553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32a0105780 0x7f32a019ecd0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:42.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.894+0000 7f32a4fe0640 1 --2- 172.21.15.70:0/1533773553 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32a0102d20 0x7f32a01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:42.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.894+0000 7f32a4fe0640 1 -- 172.21.15.70:0/1533773553 >> 172.21.15.70:0/1533773553 conn(0x7f32a00fd760 msgr2=0x7f32a0103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:42.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.894+0000 7f32a4fe0640 1 -- 172.21.15.70:0/1533773553 shutdown_connections 2024-09-21T05:40:42.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.894+0000 7f32a4fe0640 1 -- 172.21.15.70:0/1533773553 wait complete. 2024-09-21T05:40:42.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:42 smithi160 ceph-mon[33979]: mgrmap e14: x(active, since 64s), standbys: z 2024-09-21T05:40:42.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:42 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T05:40:42.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:42 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2116025110' entity='client.admin' 2024-09-21T05:40:42.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:42 smithi160 ceph-mon[33979]: from='client.? ' entity='client.admin' 2024-09-21T05:40:42.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:42 smithi160 ceph-mon[33979]: from='client.? ' entity='client.admin' 2024-09-21T05:40:43.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.134+0000 7f07cea87640 1 -- 172.21.15.70:0/1910715330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07c81036e0 msgr2=0x7f07c8103af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:43.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.134+0000 7f07cea87640 1 --2- 172.21.15.70:0/1910715330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07c81036e0 0x7f07c8103af0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f07b4009900 tx=0x7f07b402a480 comp rx=0 tx=0).stop 2024-09-21T05:40:43.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.134+0000 7f07cea87640 1 -- 172.21.15.70:0/1910715330 shutdown_connections 2024-09-21T05:40:43.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.134+0000 7f07cea87640 1 --2- 172.21.15.70:0/1910715330 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07c8104080 0x7f07c810aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:43.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.134+0000 7f07cea87640 1 --2- 172.21.15.70:0/1910715330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07c81036e0 0x7f07c8103af0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:43.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.134+0000 7f07cea87640 1 --2- 172.21.15.70:0/1910715330 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07c8102650 0x7f07c8102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:43.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.134+0000 7f07cea87640 1 -- 172.21.15.70:0/1910715330 >> 172.21.15.70:0/1910715330 conn(0x7f07c80fdfa0 msgr2=0x7f07c8100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:43.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.134+0000 7f07cea87640 1 -- 172.21.15.70:0/1910715330 shutdown_connections 2024-09-21T05:40:43.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.135+0000 7f07cea87640 1 -- 172.21.15.70:0/1910715330 wait complete. 2024-09-21T05:40:43.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.135+0000 7f07cea87640 1 Processor -- start 2024-09-21T05:40:43.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.135+0000 7f07cea87640 1 -- start start 2024-09-21T05:40:43.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.136+0000 7f07cea87640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07c8102650 0x7f07c806c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:43.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.136+0000 7f07cea87640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07c81036e0 0x7f07c819ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:43.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.136+0000 7f07cea87640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07c8104080 0x7f07c81a11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:43.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.136+0000 7f07cea87640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f07c810e1b0 con 0x7f07c8104080 2024-09-21T05:40:43.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.136+0000 7f07cea87640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f07c810e030 con 0x7f07c8102650 2024-09-21T05:40:43.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.136+0000 7f07cea87640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f07c810e330 con 0x7f07c81036e0 2024-09-21T05:40:43.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.136+0000 7f07cd024640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07c8104080 0x7f07c81a11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:43.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.136+0000 7f07cc823640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07c8102650 0x7f07c806c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:43.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.136+0000 7f07cd024640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07c8104080 0x7f07c81a11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40426/0 (socket says 172.21.15.70:40426) 2024-09-21T05:40:43.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.136+0000 7f07cd024640 1 -- 172.21.15.70:0/2606098985 learned_addr learned my addr 172.21.15.70:0/2606098985 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:40:43.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.136+0000 7f07c7fff640 1 --2- 172.21.15.70:0/2606098985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07c81036e0 0x7f07c819ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:43.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.136+0000 7f07cc823640 1 -- 172.21.15.70:0/2606098985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07c81036e0 msgr2=0x7f07c819ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:43.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.136+0000 7f07cc823640 1 --2- 172.21.15.70:0/2606098985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07c81036e0 0x7f07c819ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:43.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.136+0000 7f07cc823640 1 -- 172.21.15.70:0/2606098985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07c8104080 msgr2=0x7f07c81a11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:43.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.136+0000 7f07cc823640 1 --2- 172.21.15.70:0/2606098985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07c8104080 0x7f07c81a11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:43.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.136+0000 7f07cc823640 1 -- 172.21.15.70:0/2606098985 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c81a19b0 con 0x7f07c8102650 2024-09-21T05:40:43.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.136+0000 7f07cd024640 1 --2- 172.21.15.70:0/2606098985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07c8104080 0x7f07c81a11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:40:43.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.136+0000 7f07cc823640 1 --2- 172.21.15.70:0/2606098985 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07c8102650 0x7f07c806c060 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f07bc00e9f0 tx=0x7f07bc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:43.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.137+0000 7f07c5ffb640 1 -- 172.21.15.70:0/2606098985 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc00ccc0 con 0x7f07c8102650 2024-09-21T05:40:43.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.137+0000 7f07c5ffb640 1 -- 172.21.15.70:0/2606098985 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(25 keys) ==== 1066+0+0 (secure 0 0 0) 0x7f07bc0108c0 con 0x7f07c8102650 2024-09-21T05:40:43.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.137+0000 7f07cea87640 1 -- 172.21.15.70:0/2606098985 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07c81a1ca0 con 0x7f07c8102650 2024-09-21T05:40:43.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.137+0000 7f07c5ffb640 1 -- 172.21.15.70:0/2606098985 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc0187b0 con 0x7f07c8102650 2024-09-21T05:40:43.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.137+0000 7f07cea87640 1 -- 172.21.15.70:0/2606098985 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07c81a2180 con 0x7f07c8102650 2024-09-21T05:40:43.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.138+0000 7f07cea87640 1 -- 172.21.15.70:0/2606098985 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07c8109810 con 0x7f07c8102650 2024-09-21T05:40:43.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.138+0000 7f07c5ffb640 1 -- 172.21.15.70:0/2606098985 <== mon.2 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 14) ==== 103177+0+0 (secure 0 0 0) 0x7f07bc018950 con 0x7f07c8102650 2024-09-21T05:40:43.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.139+0000 7f07c5ffb640 1 --2- 172.21.15.70:0/2606098985 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f07b807afd0 0x7f07b807d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:43.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.139+0000 7f07c5ffb640 1 -- 172.21.15.70:0/2606098985 <== mon.2 v2:172.21.15.116:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f07bc09d020 con 0x7f07c8102650 2024-09-21T05:40:43.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.139+0000 7f07c7fff640 1 --2- 172.21.15.70:0/2606098985 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f07b807afd0 0x7f07b807d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:43.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.139+0000 7f07c7fff640 1 --2- 172.21.15.70:0/2606098985 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f07b807afd0 0x7f07b807d4e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f07b4006010 tx=0x7f07b4005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:43.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.144+0000 7f07c5ffb640 1 -- 172.21.15.70:0/2606098985 <== mon.2 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f07bc069b00 con 0x7f07c8102650 2024-09-21T05:40:43.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.332+0000 7f07cea87640 1 -- 172.21.15.70:0/2606098985 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f07c8064030 con 0x7f07c8102650 2024-09-21T05:40:43.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.337+0000 7f07c5ffb640 1 -- 172.21.15.70:0/2606098985 <== mon.2 v2:172.21.15.116:3300/0 7 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f07bc010e00 con 0x7f07c8102650 2024-09-21T05:40:43.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.337+0000 7f07c5ffb640 1 -- 172.21.15.70:0/2606098985 <== mon.2 v2:172.21.15.116:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v18)=0 v18) ==== 123+0+0 (secure 0 0 0) 0x7f07bc06e9b0 con 0x7f07c8102650 2024-09-21T05:40:43.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.340+0000 7f07cea87640 1 -- 172.21.15.70:0/2606098985 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f07b807afd0 msgr2=0x7f07b807d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:43.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.340+0000 7f07cea87640 1 --2- 172.21.15.70:0/2606098985 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f07b807afd0 0x7f07b807d4e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f07b4006010 tx=0x7f07b4005d50 comp rx=0 tx=0).stop 2024-09-21T05:40:43.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.340+0000 7f07cea87640 1 -- 172.21.15.70:0/2606098985 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07c8102650 msgr2=0x7f07c806c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:43.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.340+0000 7f07cea87640 1 --2- 172.21.15.70:0/2606098985 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07c8102650 0x7f07c806c060 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f07bc00e9f0 tx=0x7f07bc00eeb0 comp rx=0 tx=0).stop 2024-09-21T05:40:43.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.340+0000 7f07cea87640 1 -- 172.21.15.70:0/2606098985 shutdown_connections 2024-09-21T05:40:43.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.340+0000 7f07cea87640 1 --2- 172.21.15.70:0/2606098985 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f07b807afd0 0x7f07b807d4e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:43.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.340+0000 7f07cea87640 1 --2- 172.21.15.70:0/2606098985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07c81036e0 0x7f07c819ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:43.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.340+0000 7f07cea87640 1 --2- 172.21.15.70:0/2606098985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07c8104080 0x7f07c81a11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:43.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.340+0000 7f07cea87640 1 --2- 172.21.15.70:0/2606098985 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07c8102650 0x7f07c806c060 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:43.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.340+0000 7f07cea87640 1 -- 172.21.15.70:0/2606098985 >> 172.21.15.70:0/2606098985 conn(0x7f07c80fdfa0 msgr2=0x7f07c81069e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:43.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.340+0000 7f07cea87640 1 -- 172.21.15.70:0/2606098985 shutdown_connections 2024-09-21T05:40:43.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:42.340+0000 7f07cea87640 1 -- 172.21.15.70:0/2606098985 wait complete. 2024-09-21T05:40:43.728 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:40:43.728 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:40:43.854 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:43 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:43.854 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:43 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1533773553' entity='client.admin' 2024-09-21T05:40:43.854 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:43 smithi070 ceph-mon[30981]: Standby manager daemon y started 2024-09-21T05:40:43.855 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:43 smithi070 ceph-mon[30981]: from='mgr.? 172.21.15.116:0/2906704382' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T05:40:43.855 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:43 smithi070 ceph-mon[30981]: from='mgr.? 172.21.15.116:0/2906704382' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T05:40:43.855 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:43 smithi070 ceph-mon[30981]: from='mgr.? 172.21.15.116:0/2906704382' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T05:40:43.855 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:43 smithi070 ceph-mon[30981]: from='mgr.? 172.21.15.116:0/2906704382' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T05:40:43.855 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:43 smithi070 ceph-mon[30981]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:43.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:43 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:43.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:43 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1533773553' entity='client.admin' 2024-09-21T05:40:43.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:43 smithi160 ceph-mon[33979]: Standby manager daemon y started 2024-09-21T05:40:43.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:43 smithi160 ceph-mon[33979]: from='mgr.? 172.21.15.116:0/2906704382' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T05:40:43.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:43 smithi160 ceph-mon[33979]: from='mgr.? 172.21.15.116:0/2906704382' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T05:40:43.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:43 smithi160 ceph-mon[33979]: from='mgr.? 172.21.15.116:0/2906704382' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T05:40:43.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:43 smithi160 ceph-mon[33979]: from='mgr.? 172.21.15.116:0/2906704382' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T05:40:43.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:43 smithi160 ceph-mon[33979]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:44.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:43 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:44.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:43 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1533773553' entity='client.admin' 2024-09-21T05:40:44.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:43 smithi116 ceph-mon[34332]: Standby manager daemon y started 2024-09-21T05:40:44.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:43 smithi116 ceph-mon[34332]: from='mgr.? 172.21.15.116:0/2906704382' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T05:40:44.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:43 smithi116 ceph-mon[34332]: from='mgr.? 172.21.15.116:0/2906704382' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T05:40:44.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:43 smithi116 ceph-mon[34332]: from='mgr.? 172.21.15.116:0/2906704382' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T05:40:44.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:43 smithi116 ceph-mon[34332]: from='mgr.? 172.21.15.116:0/2906704382' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T05:40:44.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:43 smithi116 ceph-mon[34332]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:44.199 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96c6636e-77db-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi070') 2024-09-21T05:40:44.199 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96c6636e-77db-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi070') 2024-09-21T05:40:44.199 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96c6636e-77db-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi070') 2024-09-21T05:40:45.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:44 smithi160 ceph-mon[33979]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-21T05:40:45.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:44 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T05:40:45.153 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:44 smithi070 ceph-mon[30981]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-21T05:40:45.153 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:44 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T05:40:45.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:44 smithi116 ceph-mon[34332]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-21T05:40:45.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:44 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T05:40:45.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.325+0000 7f54ec571640 1 -- 172.21.15.70:0/2165628180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54e41036d0 msgr2=0x7f54e4103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:45.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.325+0000 7f54ec571640 1 --2- 172.21.15.70:0/2165628180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54e41036d0 0x7f54e4103ae0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f54d4009900 tx=0x7f54d402a480 comp rx=0 tx=0).stop 2024-09-21T05:40:45.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.325+0000 7f54ec571640 1 -- 172.21.15.70:0/2165628180 shutdown_connections 2024-09-21T05:40:45.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.325+0000 7f54ec571640 1 --2- 172.21.15.70:0/2165628180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54e4104070 0x7f54e410aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:45.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.325+0000 7f54ec571640 1 --2- 172.21.15.70:0/2165628180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54e41036d0 0x7f54e4103ae0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:45.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.325+0000 7f54ec571640 1 --2- 172.21.15.70:0/2165628180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f54e4102640 0x7f54e4102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:45.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.325+0000 7f54ec571640 1 -- 172.21.15.70:0/2165628180 >> 172.21.15.70:0/2165628180 conn(0x7f54e40fdfb0 msgr2=0x7f54e4100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:45.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.325+0000 7f54ec571640 1 -- 172.21.15.70:0/2165628180 shutdown_connections 2024-09-21T05:40:45.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.325+0000 7f54ec571640 1 -- 172.21.15.70:0/2165628180 wait complete. 2024-09-21T05:40:45.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.326+0000 7f54ec571640 1 Processor -- start 2024-09-21T05:40:45.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.326+0000 7f54ec571640 1 -- start start 2024-09-21T05:40:45.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.326+0000 7f54ec571640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54e4102640 0x7f54e406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:45.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.326+0000 7f54ec571640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54e41036d0 0x7f54e419ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:45.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.326+0000 7f54ec571640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f54e4104070 0x7f54e41a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:45.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.326+0000 7f54ec571640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f54e410e2d0 con 0x7f54e41036d0 2024-09-21T05:40:45.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.326+0000 7f54ec571640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f54e410e150 con 0x7f54e4104070 2024-09-21T05:40:45.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.326+0000 7f54ec571640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f54e410e450 con 0x7f54e4102640 2024-09-21T05:40:45.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.326+0000 7f54e9b0c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54e41036d0 0x7f54e419ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:45.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.326+0000 7f54e9b0c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54e41036d0 0x7f54e419ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40462/0 (socket says 172.21.15.70:40462) 2024-09-21T05:40:45.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.326+0000 7f54e9b0c640 1 -- 172.21.15.70:0/316732787 learned_addr learned my addr 172.21.15.70:0/316732787 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:40:45.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.326+0000 7f54eab0e640 1 --2- 172.21.15.70:0/316732787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f54e4104070 0x7f54e41a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:45.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.326+0000 7f54ea30d640 1 --2- 172.21.15.70:0/316732787 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54e4102640 0x7f54e406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:45.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.326+0000 7f54e9b0c640 1 -- 172.21.15.70:0/316732787 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54e4102640 msgr2=0x7f54e406b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:45.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.326+0000 7f54e9b0c640 1 --2- 172.21.15.70:0/316732787 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54e4102640 0x7f54e406b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:45.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.326+0000 7f54e9b0c640 1 -- 172.21.15.70:0/316732787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f54e4104070 msgr2=0x7f54e41a12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:45.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.326+0000 7f54e9b0c640 1 --2- 172.21.15.70:0/316732787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f54e4104070 0x7f54e41a12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:45.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.326+0000 7f54e9b0c640 1 -- 172.21.15.70:0/316732787 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54e41a1a40 con 0x7f54e41036d0 2024-09-21T05:40:45.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.327+0000 7f54e9b0c640 1 --2- 172.21.15.70:0/316732787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54e41036d0 0x7f54e419ed60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f54d4009230 tx=0x7f54d4004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:45.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.327+0000 7f54db7fe640 1 -- 172.21.15.70:0/316732787 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d403f030 con 0x7f54e41036d0 2024-09-21T05:40:45.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.327+0000 7f54db7fe640 1 -- 172.21.15.70:0/316732787 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f54d4003d70 con 0x7f54e41036d0 2024-09-21T05:40:45.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.327+0000 7f54ec571640 1 -- 172.21.15.70:0/316732787 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54e41a1cd0 con 0x7f54e41036d0 2024-09-21T05:40:45.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.327+0000 7f54db7fe640 1 -- 172.21.15.70:0/316732787 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d4035070 con 0x7f54e41036d0 2024-09-21T05:40:45.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.327+0000 7f54ec571640 1 -- 172.21.15.70:0/316732787 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54e41a21b0 con 0x7f54e41036d0 2024-09-21T05:40:45.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.328+0000 7f54ec571640 1 -- 172.21.15.70:0/316732787 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54e4109800 con 0x7f54e41036d0 2024-09-21T05:40:45.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.329+0000 7f54db7fe640 1 -- 172.21.15.70:0/316732787 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f54d4042030 con 0x7f54e41036d0 2024-09-21T05:40:45.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.330+0000 7f54db7fe640 1 --2- 172.21.15.70:0/316732787 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f54d00b6500 0x7f54d00b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:45.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.330+0000 7f54ea30d640 1 --2- 172.21.15.70:0/316732787 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f54d00b6500 0x7f54d00b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:45.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.330+0000 7f54db7fe640 1 -- 172.21.15.70:0/316732787 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f54d4106170 con 0x7f54e41036d0 2024-09-21T05:40:45.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.330+0000 7f54ea30d640 1 --2- 172.21.15.70:0/316732787 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f54d00b6500 0x7f54d00b8a10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f54e0005e10 tx=0x7f54e0005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:45.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.333+0000 7f54db7fe640 1 -- 172.21.15.70:0/316732787 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f54d40ce6d0 con 0x7f54e41036d0 2024-09-21T05:40:45.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.519+0000 7f54ec571640 1 -- 172.21.15.70:0/316732787 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f54e402e640 con 0x7f54e41036d0 2024-09-21T05:40:45.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.523+0000 7f54db7fe640 1 -- 172.21.15.70:0/316732787 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v20)=0 v20) ==== 106+0+0 (secure 0 0 0) 0x7f54d40d2ab0 con 0x7f54e41036d0 2024-09-21T05:40:45.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.526+0000 7f54ec571640 1 -- 172.21.15.70:0/316732787 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f54d00b6500 msgr2=0x7f54d00b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:45.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.526+0000 7f54ec571640 1 --2- 172.21.15.70:0/316732787 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f54d00b6500 0x7f54d00b8a10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f54e0005e10 tx=0x7f54e0005da0 comp rx=0 tx=0).stop 2024-09-21T05:40:45.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.526+0000 7f54ec571640 1 -- 172.21.15.70:0/316732787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54e41036d0 msgr2=0x7f54e419ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:45.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.526+0000 7f54ec571640 1 --2- 172.21.15.70:0/316732787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54e41036d0 0x7f54e419ed60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f54d4009230 tx=0x7f54d4004430 comp rx=0 tx=0).stop 2024-09-21T05:40:45.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.526+0000 7f54ec571640 1 -- 172.21.15.70:0/316732787 shutdown_connections 2024-09-21T05:40:45.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.526+0000 7f54ec571640 1 --2- 172.21.15.70:0/316732787 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f54d00b6500 0x7f54d00b8a10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:45.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.526+0000 7f54ec571640 1 --2- 172.21.15.70:0/316732787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f54e4104070 0x7f54e41a12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:45.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.526+0000 7f54ec571640 1 --2- 172.21.15.70:0/316732787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54e41036d0 0x7f54e419ed60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:45.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.526+0000 7f54ec571640 1 --2- 172.21.15.70:0/316732787 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54e4102640 0x7f54e406b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:45.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.526+0000 7f54ec571640 1 -- 172.21.15.70:0/316732787 >> 172.21.15.70:0/316732787 conn(0x7f54e40fdfb0 msgr2=0x7f54e41069d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:45.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.526+0000 7f54ec571640 1 -- 172.21.15.70:0/316732787 shutdown_connections 2024-09-21T05:40:45.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.526+0000 7f54ec571640 1 -- 172.21.15.70:0/316732787 wait complete. 2024-09-21T05:40:45.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.526+0000 7fe8631cb640 1 -- 172.21.15.70:0/2200721583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe85c104070 msgr2=0x7fe85c10aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:45.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.526+0000 7fe8631cb640 1 --2- 172.21.15.70:0/2200721583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe85c104070 0x7fe85c10aa10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe854009ca0 tx=0x7fe85402a950 comp rx=0 tx=0).stop 2024-09-21T05:40:45.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.526+0000 7fe8631cb640 1 -- 172.21.15.70:0/2200721583 shutdown_connections 2024-09-21T05:40:45.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.526+0000 7fe8631cb640 1 --2- 172.21.15.70:0/2200721583 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe85c1036d0 0x7fe85c103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:45.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.526+0000 7fe8631cb640 1 --2- 172.21.15.70:0/2200721583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe85c104070 0x7fe85c10aa10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:45.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.526+0000 7fe8631cb640 1 --2- 172.21.15.70:0/2200721583 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe85c102640 0x7fe85c102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:45.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.526+0000 7fe8631cb640 1 -- 172.21.15.70:0/2200721583 >> 172.21.15.70:0/2200721583 conn(0x7fe85c0fdfb0 msgr2=0x7fe85c100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:45.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.526+0000 7fe8631cb640 1 -- 172.21.15.70:0/2200721583 shutdown_connections 2024-09-21T05:40:45.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.526+0000 7fe8631cb640 1 -- 172.21.15.70:0/2200721583 wait complete. 2024-09-21T05:40:45.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.527+0000 7fe8631cb640 1 Processor -- start 2024-09-21T05:40:45.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.527+0000 7fe8631cb640 1 -- start start 2024-09-21T05:40:45.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.527+0000 7fe8631cb640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe85c102640 0x7fe85c198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:45.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.527+0000 7fe8631cb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe85c1036d0 0x7fe85c1994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:45.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.527+0000 7fe8631cb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe85c104070 0x7fe85c19a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:45.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.527+0000 7fe8631cb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe85c10e270 con 0x7fe85c1036d0 2024-09-21T05:40:45.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.527+0000 7fe8631cb640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe85c10e0f0 con 0x7fe85c104070 2024-09-21T05:40:45.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.527+0000 7fe8631cb640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe85c10e3f0 con 0x7fe85c102640 2024-09-21T05:40:45.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.527+0000 7fe85bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe85c1036d0 0x7fe85c1994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:45.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.527+0000 7fe85bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe85c1036d0 0x7fe85c1994c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40488/0 (socket says 172.21.15.70:40488) 2024-09-21T05:40:45.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.527+0000 7fe85bfff640 1 -- 172.21.15.70:0/2685743179 learned_addr learned my addr 172.21.15.70:0/2685743179 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:40:45.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.527+0000 7fe861768640 1 --2- 172.21.15.70:0/2685743179 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe85c104070 0x7fe85c19a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:45.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.527+0000 7fe860f67640 1 --2- 172.21.15.70:0/2685743179 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe85c102640 0x7fe85c198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:45.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.528+0000 7fe85bfff640 1 -- 172.21.15.70:0/2685743179 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe85c102640 msgr2=0x7fe85c198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:45.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.528+0000 7fe85bfff640 1 --2- 172.21.15.70:0/2685743179 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe85c102640 0x7fe85c198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:45.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.528+0000 7fe85bfff640 1 -- 172.21.15.70:0/2685743179 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe85c104070 msgr2=0x7fe85c19a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:45.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.528+0000 7fe85bfff640 1 --2- 172.21.15.70:0/2685743179 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe85c104070 0x7fe85c19a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:45.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.528+0000 7fe85bfff640 1 -- 172.21.15.70:0/2685743179 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe85c19a880 con 0x7fe85c1036d0 2024-09-21T05:40:45.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.528+0000 7fe860f67640 1 --2- 172.21.15.70:0/2685743179 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe85c102640 0x7fe85c198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:40:45.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.528+0000 7fe85bfff640 1 --2- 172.21.15.70:0/2685743179 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe85c1036d0 0x7fe85c1994c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe848009fd0 tx=0x7fe84800edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:45.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.528+0000 7fe859ffb640 1 -- 172.21.15.70:0/2685743179 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe848020070 con 0x7fe85c1036d0 2024-09-21T05:40:45.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.528+0000 7fe859ffb640 1 -- 172.21.15.70:0/2685743179 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fe84800cd80 con 0x7fe85c1036d0 2024-09-21T05:40:45.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.528+0000 7fe859ffb640 1 -- 172.21.15.70:0/2685743179 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe84801ba70 con 0x7fe85c1036d0 2024-09-21T05:40:45.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.528+0000 7fe8631cb640 1 -- 172.21.15.70:0/2685743179 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe85c19ab70 con 0x7fe85c1036d0 2024-09-21T05:40:45.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.528+0000 7fe8631cb640 1 -- 172.21.15.70:0/2685743179 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe85c06b030 con 0x7fe85c1036d0 2024-09-21T05:40:45.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.530+0000 7fe8631cb640 1 -- 172.21.15.70:0/2685743179 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe85c102ab0 con 0x7fe85c1036d0 2024-09-21T05:40:45.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.531+0000 7fe859ffb640 1 -- 172.21.15.70:0/2685743179 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fe848023070 con 0x7fe85c1036d0 2024-09-21T05:40:45.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.532+0000 7fe859ffb640 1 --2- 172.21.15.70:0/2685743179 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe84c0b6500 0x7fe84c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:45.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.532+0000 7fe859ffb640 1 -- 172.21.15.70:0/2685743179 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe8480e9590 con 0x7fe85c1036d0 2024-09-21T05:40:45.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.532+0000 7fe860f67640 1 --2- 172.21.15.70:0/2685743179 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe84c0b6500 0x7fe84c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:45.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.532+0000 7fe860f67640 1 --2- 172.21.15.70:0/2685743179 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe84c0b6500 0x7fe84c0b8a10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe850009c30 tx=0x7fe850010040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:45.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.537+0000 7fe859ffb640 1 -- 172.21.15.70:0/2685743179 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe8480b5ed0 con 0x7fe85c1036d0 2024-09-21T05:40:45.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.721+0000 7fe8631cb640 1 -- 172.21.15.70:0/2685743179 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7fe85c109410 con 0x7fe85c1036d0 2024-09-21T05:40:45.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.725+0000 7fe859ffb640 1 -- 172.21.15.70:0/2685743179 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v21)=0 v21) ==== 119+0+0 (secure 0 0 0) 0x7fe8480bae10 con 0x7fe85c1036d0 2024-09-21T05:40:45.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.727+0000 7fe8631cb640 1 -- 172.21.15.70:0/2685743179 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe84c0b6500 msgr2=0x7fe84c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:45.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.727+0000 7fe8631cb640 1 --2- 172.21.15.70:0/2685743179 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe84c0b6500 0x7fe84c0b8a10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe850009c30 tx=0x7fe850010040 comp rx=0 tx=0).stop 2024-09-21T05:40:45.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.727+0000 7fe8631cb640 1 -- 172.21.15.70:0/2685743179 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe85c1036d0 msgr2=0x7fe85c1994c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:45.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.727+0000 7fe8631cb640 1 --2- 172.21.15.70:0/2685743179 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe85c1036d0 0x7fe85c1994c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe848009fd0 tx=0x7fe84800edd0 comp rx=0 tx=0).stop 2024-09-21T05:40:45.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.727+0000 7fe8631cb640 1 -- 172.21.15.70:0/2685743179 shutdown_connections 2024-09-21T05:40:45.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.727+0000 7fe8631cb640 1 --2- 172.21.15.70:0/2685743179 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe84c0b6500 0x7fe84c0b8a10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:45.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.727+0000 7fe8631cb640 1 --2- 172.21.15.70:0/2685743179 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe85c104070 0x7fe85c19a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:45.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.727+0000 7fe8631cb640 1 --2- 172.21.15.70:0/2685743179 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe85c1036d0 0x7fe85c1994c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:45.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.727+0000 7fe8631cb640 1 --2- 172.21.15.70:0/2685743179 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe85c102640 0x7fe85c198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:45.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.727+0000 7fe8631cb640 1 -- 172.21.15.70:0/2685743179 >> 172.21.15.70:0/2685743179 conn(0x7fe85c0fdfb0 msgr2=0x7fe85c1069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:45.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.728+0000 7fe8631cb640 1 -- 172.21.15.70:0/2685743179 shutdown_connections 2024-09-21T05:40:45.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:45.728+0000 7fe8631cb640 1 -- 172.21.15.70:0/2685743179 wait complete. 2024-09-21T05:40:46.240 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:45 smithi070 ceph-mon[30981]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:46.240 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:45 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/316732787' entity='client.admin' 2024-09-21T05:40:46.240 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:45 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2685743179' entity='client.admin' 2024-09-21T05:40:46.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:45 smithi116 ceph-mon[34332]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:46.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:45 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/316732787' entity='client.admin' 2024-09-21T05:40:46.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:45 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2685743179' entity='client.admin' 2024-09-21T05:40:46.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:45 smithi160 ceph-mon[33979]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:46.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:45 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/316732787' entity='client.admin' 2024-09-21T05:40:46.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:45 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2685743179' entity='client.admin' 2024-09-21T05:40:46.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.455+0000 7fecc5f02640 1 -- 172.21.15.70:0/882303686 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fecc006c5c0 msgr2=0x7fecc0106440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:46.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.455+0000 7fecc5f02640 1 --2- 172.21.15.70:0/882303686 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fecc006c5c0 0x7fecc0106440 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fecb0009900 tx=0x7fecb002a410 comp rx=0 tx=0).stop 2024-09-21T05:40:46.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.455+0000 7fecc5f02640 1 -- 172.21.15.70:0/882303686 shutdown_connections 2024-09-21T05:40:46.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.455+0000 7fecc5f02640 1 --2- 172.21.15.70:0/882303686 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fecc0109490 0x7fecc010b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:46.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.455+0000 7fecc5f02640 1 --2- 172.21.15.70:0/882303686 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fecc0106980 0x7fecc0108da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:46.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.455+0000 7fecc5f02640 1 --2- 172.21.15.70:0/882303686 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fecc006c5c0 0x7fecc0106440 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:46.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.455+0000 7fecc5f02640 1 -- 172.21.15.70:0/882303686 >> 172.21.15.70:0/882303686 conn(0x7fecc00fdfe0 msgr2=0x7fecc0100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:46.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.455+0000 7fecc5f02640 1 -- 172.21.15.70:0/882303686 shutdown_connections 2024-09-21T05:40:46.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.455+0000 7fecc5f02640 1 -- 172.21.15.70:0/882303686 wait complete. 2024-09-21T05:40:46.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.456+0000 7fecc5f02640 1 Processor -- start 2024-09-21T05:40:46.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.456+0000 7fecc5f02640 1 -- start start 2024-09-21T05:40:46.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.456+0000 7fecc5f02640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fecc006c5c0 0x7fecc0103a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:46.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.456+0000 7fecc5f02640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fecc0106980 0x7fecc0102340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:46.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.456+0000 7fecc5f02640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fecc0109490 0x7fecc0102880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:46.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.456+0000 7fecc5f02640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fecc010f3e0 con 0x7fecc0106980 2024-09-21T05:40:46.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.456+0000 7fecc5f02640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fecc010f260 con 0x7fecc006c5c0 2024-09-21T05:40:46.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.456+0000 7fecc5f02640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fecc010f560 con 0x7fecc0109490 2024-09-21T05:40:46.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.456+0000 7fecbeffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fecc0106980 0x7fecc0102340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:46.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.456+0000 7fecbeffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fecc0106980 0x7fecc0102340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40510/0 (socket says 172.21.15.70:40510) 2024-09-21T05:40:46.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.456+0000 7fecbeffd640 1 -- 172.21.15.70:0/2482209387 learned_addr learned my addr 172.21.15.70:0/2482209387 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:40:46.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.457+0000 7fecbf7fe640 1 --2- 172.21.15.70:0/2482209387 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fecc006c5c0 0x7fecc0103a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:46.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.457+0000 7fecbffff640 1 --2- 172.21.15.70:0/2482209387 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fecc0109490 0x7fecc0102880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:46.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.457+0000 7fecbeffd640 1 -- 172.21.15.70:0/2482209387 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fecc0109490 msgr2=0x7fecc0102880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:46.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.457+0000 7fecbeffd640 1 --2- 172.21.15.70:0/2482209387 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fecc0109490 0x7fecc0102880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:46.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.457+0000 7fecbeffd640 1 -- 172.21.15.70:0/2482209387 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fecc006c5c0 msgr2=0x7fecc0103a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:46.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.457+0000 7fecbeffd640 1 --2- 172.21.15.70:0/2482209387 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fecc006c5c0 0x7fecc0103a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:46.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.457+0000 7fecbeffd640 1 -- 172.21.15.70:0/2482209387 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc0102ef0 con 0x7fecc0106980 2024-09-21T05:40:46.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.457+0000 7fecbf7fe640 1 --2- 172.21.15.70:0/2482209387 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fecc006c5c0 0x7fecc0103a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:40:46.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.457+0000 7fecbffff640 1 --2- 172.21.15.70:0/2482209387 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fecc0109490 0x7fecc0102880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:40:46.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.457+0000 7fecbeffd640 1 --2- 172.21.15.70:0/2482209387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fecc0106980 0x7fecc0102340 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fecb400c920 tx=0x7fecb400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:46.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.457+0000 7fecbcff9640 1 -- 172.21.15.70:0/2482209387 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb4007c70 con 0x7fecc0106980 2024-09-21T05:40:46.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.457+0000 7fecc5f02640 1 -- 172.21.15.70:0/2482209387 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecc01a4090 con 0x7fecc0106980 2024-09-21T05:40:46.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.457+0000 7fecbcff9640 1 -- 172.21.15.70:0/2482209387 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fecb4007e10 con 0x7fecc0106980 2024-09-21T05:40:46.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.457+0000 7fecbcff9640 1 -- 172.21.15.70:0/2482209387 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb40187b0 con 0x7fecc0106980 2024-09-21T05:40:46.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.457+0000 7fecc5f02640 1 -- 172.21.15.70:0/2482209387 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecc01a4500 con 0x7fecc0106980 2024-09-21T05:40:46.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.458+0000 7fecc5f02640 1 -- 172.21.15.70:0/2482209387 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecc0106d90 con 0x7fecc0106980 2024-09-21T05:40:46.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.460+0000 7fecbcff9640 1 -- 172.21.15.70:0/2482209387 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fecb400f450 con 0x7fecc0106980 2024-09-21T05:40:46.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.460+0000 7fecbcff9640 1 --2- 172.21.15.70:0/2482209387 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7feca80b6480 0x7feca80b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:46.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.460+0000 7fecbf7fe640 1 --2- 172.21.15.70:0/2482209387 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7feca80b6480 0x7feca80b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:46.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.461+0000 7fecbcff9640 1 -- 172.21.15.70:0/2482209387 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fecb40e5820 con 0x7fecc0106980 2024-09-21T05:40:46.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.461+0000 7fecbf7fe640 1 --2- 172.21.15.70:0/2482209387 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7feca80b6480 0x7feca80b8990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fecb0005f70 tx=0x7fecb0005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:46.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.465+0000 7fecbcff9640 1 -- 172.21.15.70:0/2482209387 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fecb4014030 con 0x7fecc0106980 2024-09-21T05:40:46.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.650+0000 7fecc5f02640 1 -- 172.21.15.70:0/2482209387 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7fecc002e940 con 0x7fecc0106980 2024-09-21T05:40:46.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.656+0000 7fecbcff9640 1 -- 172.21.15.70:0/2482209387 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v22)=0 v22) ==== 118+0+0 (secure 0 0 0) 0x7fecb40add80 con 0x7fecc0106980 2024-09-21T05:40:46.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.658+0000 7fecc5f02640 1 -- 172.21.15.70:0/2482209387 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7feca80b6480 msgr2=0x7feca80b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:46.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.658+0000 7fecc5f02640 1 --2- 172.21.15.70:0/2482209387 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7feca80b6480 0x7feca80b8990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fecb0005f70 tx=0x7fecb0005d50 comp rx=0 tx=0).stop 2024-09-21T05:40:46.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.658+0000 7fecc5f02640 1 -- 172.21.15.70:0/2482209387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fecc0106980 msgr2=0x7fecc0102340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:46.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.658+0000 7fecc5f02640 1 --2- 172.21.15.70:0/2482209387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fecc0106980 0x7fecc0102340 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fecb400c920 tx=0x7fecb400cde0 comp rx=0 tx=0).stop 2024-09-21T05:40:46.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.659+0000 7fecc5f02640 1 -- 172.21.15.70:0/2482209387 shutdown_connections 2024-09-21T05:40:46.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.659+0000 7fecc5f02640 1 --2- 172.21.15.70:0/2482209387 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7feca80b6480 0x7feca80b8990 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:46.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.659+0000 7fecc5f02640 1 --2- 172.21.15.70:0/2482209387 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fecc0109490 0x7fecc0102880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:46.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.659+0000 7fecc5f02640 1 --2- 172.21.15.70:0/2482209387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fecc0106980 0x7fecc0102340 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:46.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.659+0000 7fecc5f02640 1 --2- 172.21.15.70:0/2482209387 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fecc006c5c0 0x7fecc0103a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:46.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.659+0000 7fecc5f02640 1 -- 172.21.15.70:0/2482209387 >> 172.21.15.70:0/2482209387 conn(0x7fecc00fdfe0 msgr2=0x7fecc0104df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:46.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.659+0000 7fecc5f02640 1 -- 172.21.15.70:0/2482209387 shutdown_connections 2024-09-21T05:40:46.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:46.659+0000 7fecc5f02640 1 -- 172.21.15.70:0/2482209387 wait complete. 2024-09-21T05:40:47.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.285+0000 7f3231a4f640 1 -- 172.21.15.70:0/3131279321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f322c1036d0 msgr2=0x7f322c103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:47.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.285+0000 7f3231a4f640 1 --2- 172.21.15.70:0/3131279321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f322c1036d0 0x7f322c103ae0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3214009900 tx=0x7f321402a480 comp rx=0 tx=0).stop 2024-09-21T05:40:47.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.286+0000 7f3231a4f640 1 -- 172.21.15.70:0/3131279321 shutdown_connections 2024-09-21T05:40:47.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.286+0000 7f3231a4f640 1 --2- 172.21.15.70:0/3131279321 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f322c104070 0x7f322c10aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:47.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.286+0000 7f3231a4f640 1 --2- 172.21.15.70:0/3131279321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f322c1036d0 0x7f322c103ae0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:47.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.286+0000 7f3231a4f640 1 --2- 172.21.15.70:0/3131279321 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f322c102640 0x7f322c102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:47.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.286+0000 7f3231a4f640 1 -- 172.21.15.70:0/3131279321 >> 172.21.15.70:0/3131279321 conn(0x7f322c0fdfb0 msgr2=0x7f322c100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:47.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.286+0000 7f3231a4f640 1 -- 172.21.15.70:0/3131279321 shutdown_connections 2024-09-21T05:40:47.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.286+0000 7f3231a4f640 1 -- 172.21.15.70:0/3131279321 wait complete. 2024-09-21T05:40:47.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.286+0000 7f3231a4f640 1 Processor -- start 2024-09-21T05:40:47.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.287+0000 7f3231a4f640 1 -- start start 2024-09-21T05:40:47.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.287+0000 7f3231a4f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f322c102640 0x7f322c06b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:47.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.287+0000 7f3231a4f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f322c1036d0 0x7f322c19ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:47.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.287+0000 7f3231a4f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f322c104070 0x7f322c1a1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:47.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.287+0000 7f3231a4f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f322c10e270 con 0x7f322c1036d0 2024-09-21T05:40:47.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.287+0000 7f3231a4f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f322c10e0f0 con 0x7f322c102640 2024-09-21T05:40:47.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.287+0000 7f3231a4f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f322c10e3f0 con 0x7f322c104070 2024-09-21T05:40:47.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.287+0000 7f322a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f322c1036d0 0x7f322c19ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:47.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.287+0000 7f322a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f322c1036d0 0x7f322c19ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40530/0 (socket says 172.21.15.70:40530) 2024-09-21T05:40:47.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.287+0000 7f322a7fc640 1 -- 172.21.15.70:0/3619910918 learned_addr learned my addr 172.21.15.70:0/3619910918 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:40:47.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.287+0000 7f322affd640 1 --2- 172.21.15.70:0/3619910918 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f322c102640 0x7f322c06b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:47.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.287+0000 7f322b7fe640 1 --2- 172.21.15.70:0/3619910918 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f322c104070 0x7f322c1a1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:47.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.287+0000 7f322a7fc640 1 -- 172.21.15.70:0/3619910918 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f322c104070 msgr2=0x7f322c1a1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:47.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.287+0000 7f322a7fc640 1 --2- 172.21.15.70:0/3619910918 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f322c104070 0x7f322c1a1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:47.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.287+0000 7f322a7fc640 1 -- 172.21.15.70:0/3619910918 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f322c102640 msgr2=0x7f322c06b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:47.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.287+0000 7f322a7fc640 1 --2- 172.21.15.70:0/3619910918 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f322c102640 0x7f322c06b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:47.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.287+0000 7f322a7fc640 1 -- 172.21.15.70:0/3619910918 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f322c1a19f0 con 0x7f322c1036d0 2024-09-21T05:40:47.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.287+0000 7f322a7fc640 1 --2- 172.21.15.70:0/3619910918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f322c1036d0 0x7f322c19ed30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f32140314b0 tx=0x7f32140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:47.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.288+0000 7f3230a4d640 1 -- 172.21.15.70:0/3619910918 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321403f030 con 0x7f322c1036d0 2024-09-21T05:40:47.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.288+0000 7f3230a4d640 1 -- 172.21.15.70:0/3619910918 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f3214003cb0 con 0x7f322c1036d0 2024-09-21T05:40:47.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.288+0000 7f3230a4d640 1 -- 172.21.15.70:0/3619910918 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3214035070 con 0x7f322c1036d0 2024-09-21T05:40:47.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.288+0000 7f3231a4f640 1 -- 172.21.15.70:0/3619910918 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f322c1a1c80 con 0x7f322c1036d0 2024-09-21T05:40:47.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.288+0000 7f3231a4f640 1 -- 172.21.15.70:0/3619910918 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f322c1a21b0 con 0x7f322c1036d0 2024-09-21T05:40:47.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.289+0000 7f3231a4f640 1 -- 172.21.15.70:0/3619910918 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f322c109820 con 0x7f322c1036d0 2024-09-21T05:40:47.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.290+0000 7f3230a4d640 1 -- 172.21.15.70:0/3619910918 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f3214042030 con 0x7f322c1036d0 2024-09-21T05:40:47.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.291+0000 7f3230a4d640 1 --2- 172.21.15.70:0/3619910918 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f32180b6500 0x7f32180b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:47.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.291+0000 7f322affd640 1 --2- 172.21.15.70:0/3619910918 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f32180b6500 0x7f32180b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:47.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.291+0000 7f3230a4d640 1 -- 172.21.15.70:0/3619910918 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f32141060d0 con 0x7f322c1036d0 2024-09-21T05:40:47.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.291+0000 7f322affd640 1 --2- 172.21.15.70:0/3619910918 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f32180b6500 0x7f32180b8a10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f321c009b60 tx=0x7f321c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:47.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.294+0000 7f3230a4d640 1 -- 172.21.15.70:0/3619910918 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f32140ce630 con 0x7f322c1036d0 2024-09-21T05:40:47.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.475+0000 7f3231a4f640 1 -- 172.21.15.70:0/3619910918 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f322c02e640 con 0x7f322c1036d0 2024-09-21T05:40:47.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.479+0000 7f3230a4d640 1 -- 172.21.15.70:0/3619910918 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v23)=0 v23) ==== 122+0+0 (secure 0 0 0) 0x7f32140d2a10 con 0x7f322c1036d0 2024-09-21T05:40:47.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.482+0000 7f3231a4f640 1 -- 172.21.15.70:0/3619910918 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f32180b6500 msgr2=0x7f32180b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:47.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.482+0000 7f3231a4f640 1 --2- 172.21.15.70:0/3619910918 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f32180b6500 0x7f32180b8a10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f321c009b60 tx=0x7f321c005f90 comp rx=0 tx=0).stop 2024-09-21T05:40:47.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.482+0000 7f3231a4f640 1 -- 172.21.15.70:0/3619910918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f322c1036d0 msgr2=0x7f322c19ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:47.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.482+0000 7f3231a4f640 1 --2- 172.21.15.70:0/3619910918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f322c1036d0 0x7f322c19ed30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f32140314b0 tx=0x7f32140042f0 comp rx=0 tx=0).stop 2024-09-21T05:40:47.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.482+0000 7f3231a4f640 1 -- 172.21.15.70:0/3619910918 shutdown_connections 2024-09-21T05:40:47.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.482+0000 7f3231a4f640 1 --2- 172.21.15.70:0/3619910918 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f32180b6500 0x7f32180b8a10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:47.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.482+0000 7f3231a4f640 1 --2- 172.21.15.70:0/3619910918 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f322c104070 0x7f322c1a1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:47.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.482+0000 7f3231a4f640 1 --2- 172.21.15.70:0/3619910918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f322c1036d0 0x7f322c19ed30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:47.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.482+0000 7f3231a4f640 1 --2- 172.21.15.70:0/3619910918 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f322c102640 0x7f322c06b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:47.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.482+0000 7f3231a4f640 1 -- 172.21.15.70:0/3619910918 >> 172.21.15.70:0/3619910918 conn(0x7f322c0fdfb0 msgr2=0x7f322c1069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:47.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.482+0000 7f3231a4f640 1 -- 172.21.15.70:0/3619910918 shutdown_connections 2024-09-21T05:40:47.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:47.482+0000 7f3231a4f640 1 -- 172.21.15.70:0/3619910918 wait complete. 2024-09-21T05:40:47.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:47 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2482209387' entity='client.admin' 2024-09-21T05:40:47.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:47 smithi070 ceph-mon[30981]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:47.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:47 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3619910918' entity='client.admin' 2024-09-21T05:40:48.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:47 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2482209387' entity='client.admin' 2024-09-21T05:40:48.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:47 smithi116 ceph-mon[34332]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:48.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:47 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3619910918' entity='client.admin' 2024-09-21T05:40:48.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:47 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2482209387' entity='client.admin' 2024-09-21T05:40:48.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:47 smithi160 ceph-mon[33979]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:48.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:47 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3619910918' entity='client.admin' 2024-09-21T05:40:48.538 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96c6636e-77db-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi070') 2024-09-21T05:40:48.591 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:40:48.592 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:40:48.592 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:40:48.922 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:40:48.922 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:40:49.303 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:40:49.304 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:40:49.304 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:40:49.304 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:40:49.337 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:40:49.339 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:40:49.340 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:40:49.676 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:49 smithi070 ceph-mon[30981]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:49.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:49 smithi116 ceph-mon[34332]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:49.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:49 smithi160 ceph-mon[33979]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:51.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.302+0000 7fc9d03c3640 1 -- 172.21.15.70:0/3473596440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9c81047e0 msgr2=0x7fc9c8104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:51.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.302+0000 7fc9d03c3640 1 --2- 172.21.15.70:0/3473596440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9c81047e0 0x7fc9c8104bf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8009900 tx=0x7fc9b802a480 comp rx=0 tx=0).stop 2024-09-21T05:40:51.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.303+0000 7fc9d03c3640 1 -- 172.21.15.70:0/3473596440 shutdown_connections 2024-09-21T05:40:51.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.303+0000 7fc9d03c3640 1 --2- 172.21.15.70:0/3473596440 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9c8105180 0x7fc9c810bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:51.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.303+0000 7fc9d03c3640 1 --2- 172.21.15.70:0/3473596440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9c81047e0 0x7fc9c8104bf0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:51.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.303+0000 7fc9d03c3640 1 --2- 172.21.15.70:0/3473596440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9c8103750 0x7fc9c8103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:51.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.303+0000 7fc9d03c3640 1 -- 172.21.15.70:0/3473596440 >> 172.21.15.70:0/3473596440 conn(0x7fc9c80ff0c0 msgr2=0x7fc9c8101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:51.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.303+0000 7fc9d03c3640 1 -- 172.21.15.70:0/3473596440 shutdown_connections 2024-09-21T05:40:51.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.303+0000 7fc9d03c3640 1 -- 172.21.15.70:0/3473596440 wait complete. 2024-09-21T05:40:51.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.303+0000 7fc9d03c3640 1 Processor -- start 2024-09-21T05:40:51.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.304+0000 7fc9d03c3640 1 -- start start 2024-09-21T05:40:51.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.304+0000 7fc9d03c3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9c8103750 0x7fc9c8199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:51.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.304+0000 7fc9d03c3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9c81047e0 0x7fc9c819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:51.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.304+0000 7fc9d03c3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9c8105180 0x7fc9c819b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:51.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.304+0000 7fc9d03c3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c810f380 con 0x7fc9c8103750 2024-09-21T05:40:51.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.304+0000 7fc9d03c3640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c810f200 con 0x7fc9c81047e0 2024-09-21T05:40:51.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.304+0000 7fc9d03c3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c810f500 con 0x7fc9c8105180 2024-09-21T05:40:51.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.304+0000 7fc9ce15f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9c8103750 0x7fc9c8199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:51.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.304+0000 7fc9ce15f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9c8103750 0x7fc9c8199fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37564/0 (socket says 172.21.15.70:37564) 2024-09-21T05:40:51.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.304+0000 7fc9ce15f640 1 -- 172.21.15.70:0/1525808094 learned_addr learned my addr 172.21.15.70:0/1525808094 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:40:51.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.304+0000 7fc9cd95e640 1 --2- 172.21.15.70:0/1525808094 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9c81047e0 0x7fc9c819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:51.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.304+0000 7fc9ce960640 1 --2- 172.21.15.70:0/1525808094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9c8105180 0x7fc9c819b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:51.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.304+0000 7fc9ce15f640 1 -- 172.21.15.70:0/1525808094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9c8105180 msgr2=0x7fc9c819b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:51.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.304+0000 7fc9ce15f640 1 --2- 172.21.15.70:0/1525808094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9c8105180 0x7fc9c819b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:51.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.304+0000 7fc9ce15f640 1 -- 172.21.15.70:0/1525808094 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9c81047e0 msgr2=0x7fc9c819a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:51.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.304+0000 7fc9ce15f640 1 --2- 172.21.15.70:0/1525808094 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9c81047e0 0x7fc9c819a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:51.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.304+0000 7fc9ce15f640 1 -- 172.21.15.70:0/1525808094 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c819b9d0 con 0x7fc9c8103750 2024-09-21T05:40:51.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.304+0000 7fc9ce960640 1 --2- 172.21.15.70:0/1525808094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9c8105180 0x7fc9c819b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:40:51.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.305+0000 7fc9ce15f640 1 --2- 172.21.15.70:0/1525808094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9c8103750 0x7fc9c8199fa0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc9c400eab0 tx=0x7fc9c400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:51.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.305+0000 7fc9bf7fe640 1 -- 172.21.15.70:0/1525808094 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c400ce40 con 0x7fc9c8103750 2024-09-21T05:40:51.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.305+0000 7fc9d03c3640 1 -- 172.21.15.70:0/1525808094 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9c819bcc0 con 0x7fc9c8103750 2024-09-21T05:40:51.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.305+0000 7fc9bf7fe640 1 -- 172.21.15.70:0/1525808094 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fc9c4011920 con 0x7fc9c8103750 2024-09-21T05:40:51.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.305+0000 7fc9bf7fe640 1 -- 172.21.15.70:0/1525808094 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c40109e0 con 0x7fc9c8103750 2024-09-21T05:40:51.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.305+0000 7fc9d03c3640 1 -- 172.21.15.70:0/1525808094 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9c81a23c0 con 0x7fc9c8103750 2024-09-21T05:40:51.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.306+0000 7fc9d03c3640 1 -- 172.21.15.70:0/1525808094 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9c810a930 con 0x7fc9c8103750 2024-09-21T05:40:51.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.307+0000 7fc9bf7fe640 1 -- 172.21.15.70:0/1525808094 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fc9c4011ad0 con 0x7fc9c8103750 2024-09-21T05:40:51.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.308+0000 7fc9bf7fe640 1 --2- 172.21.15.70:0/1525808094 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc9b40b6480 0x7fc9b40b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:51.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.308+0000 7fc9cd95e640 1 --2- 172.21.15.70:0/1525808094 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc9b40b6480 0x7fc9b40b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:51.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.308+0000 7fc9bf7fe640 1 -- 172.21.15.70:0/1525808094 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc9c40e5c20 con 0x7fc9c8103750 2024-09-21T05:40:51.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.309+0000 7fc9cd95e640 1 --2- 172.21.15.70:0/1525808094 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc9b40b6480 0x7fc9b40b8990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8006010 tx=0x7fc9b8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:51.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.311+0000 7fc9bf7fe640 1 -- 172.21.15.70:0/1525808094 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc9c4016030 con 0x7fc9c8103750 2024-09-21T05:40:51.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.496+0000 7fc9d03c3640 1 -- 172.21.15.70:0/1525808094 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7fc9c802e640 con 0x7fc9c8103750 2024-09-21T05:40:51.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.500+0000 7fc9bf7fe640 1 -- 172.21.15.70:0/1525808094 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v24)=0 v24) ==== 117+0+0 (secure 0 0 0) 0x7fc9c40ae180 con 0x7fc9c8103750 2024-09-21T05:40:51.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.503+0000 7fc9d03c3640 1 -- 172.21.15.70:0/1525808094 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc9b40b6480 msgr2=0x7fc9b40b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:51.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.503+0000 7fc9d03c3640 1 --2- 172.21.15.70:0/1525808094 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc9b40b6480 0x7fc9b40b8990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8006010 tx=0x7fc9b8000bc0 comp rx=0 tx=0).stop 2024-09-21T05:40:51.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.503+0000 7fc9d03c3640 1 -- 172.21.15.70:0/1525808094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9c8103750 msgr2=0x7fc9c8199fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:51.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.503+0000 7fc9d03c3640 1 --2- 172.21.15.70:0/1525808094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9c8103750 0x7fc9c8199fa0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc9c400eab0 tx=0x7fc9c400ef70 comp rx=0 tx=0).stop 2024-09-21T05:40:51.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.503+0000 7fc9d03c3640 1 -- 172.21.15.70:0/1525808094 shutdown_connections 2024-09-21T05:40:51.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.503+0000 7fc9d03c3640 1 --2- 172.21.15.70:0/1525808094 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc9b40b6480 0x7fc9b40b8990 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:51.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.503+0000 7fc9d03c3640 1 --2- 172.21.15.70:0/1525808094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9c8105180 0x7fc9c819b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:51.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.503+0000 7fc9d03c3640 1 --2- 172.21.15.70:0/1525808094 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9c81047e0 0x7fc9c819a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:51.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.503+0000 7fc9d03c3640 1 --2- 172.21.15.70:0/1525808094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9c8103750 0x7fc9c8199fa0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:51.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.503+0000 7fc9d03c3640 1 -- 172.21.15.70:0/1525808094 >> 172.21.15.70:0/1525808094 conn(0x7fc9c80ff0c0 msgr2=0x7fc9c8107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:51.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.503+0000 7fc9d03c3640 1 -- 172.21.15.70:0/1525808094 shutdown_connections 2024-09-21T05:40:51.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:50.503+0000 7fc9d03c3640 1 -- 172.21.15.70:0/1525808094 wait complete. 2024-09-21T05:40:51.737 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96c6636e-77db-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi070') 2024-09-21T05:40:51.737 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96c6636e-77db-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi070') 2024-09-21T05:40:51.737 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96c6636e-77db-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi070') 2024-09-21T05:40:51.737 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96c6636e-77db-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi070') 2024-09-21T05:40:51.737 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96c6636e-77db-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi070') 2024-09-21T05:40:51.738 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96c6636e-77db-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi070') 2024-09-21T05:40:51.738 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96c6636e-77db-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi070') 2024-09-21T05:40:51.738 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96c6636e-77db-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi070') 2024-09-21T05:40:51.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:51 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1525808094' entity='client.admin' 2024-09-21T05:40:51.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:51 smithi116 ceph-mon[34332]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:51.805 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:51 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1525808094' entity='client.admin' 2024-09-21T05:40:51.806 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:51 smithi070 ceph-mon[30981]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:51.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:51 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1525808094' entity='client.admin' 2024-09-21T05:40:51.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:51 smithi160 ceph-mon[33979]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:52.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.336+0000 7fed38752640 1 -- 172.21.15.70:0/3944319735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed30105180 msgr2=0x7fed3010bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:52.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.336+0000 7fed38752640 1 --2- 172.21.15.70:0/3944319735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed30105180 0x7fed3010bb20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fed28009ca0 tx=0x7fed2802a950 comp rx=0 tx=0).stop 2024-09-21T05:40:52.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.336+0000 7fed38752640 1 -- 172.21.15.70:0/3944319735 shutdown_connections 2024-09-21T05:40:52.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.336+0000 7fed38752640 1 --2- 172.21.15.70:0/3944319735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed30105180 0x7fed3010bb20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:52.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.336+0000 7fed38752640 1 --2- 172.21.15.70:0/3944319735 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed301047e0 0x7fed30104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:52.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.336+0000 7fed38752640 1 --2- 172.21.15.70:0/3944319735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed30103750 0x7fed30103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:52.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.336+0000 7fed38752640 1 -- 172.21.15.70:0/3944319735 >> 172.21.15.70:0/3944319735 conn(0x7fed300ff0c0 msgr2=0x7fed30101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:52.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.336+0000 7fed38752640 1 -- 172.21.15.70:0/3944319735 shutdown_connections 2024-09-21T05:40:52.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.336+0000 7fed38752640 1 -- 172.21.15.70:0/3944319735 wait complete. 2024-09-21T05:40:52.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.337+0000 7fed38752640 1 Processor -- start 2024-09-21T05:40:52.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.337+0000 7fed38752640 1 -- start start 2024-09-21T05:40:52.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.337+0000 7fed38752640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed30103750 0x7fed30199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:52.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.337+0000 7fed38752640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed301047e0 0x7fed3019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:52.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.337+0000 7fed38752640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed30105180 0x7fed3019b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:52.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.337+0000 7fed38752640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fed3010f380 con 0x7fed301047e0 2024-09-21T05:40:52.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.337+0000 7fed38752640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fed3010f200 con 0x7fed30103750 2024-09-21T05:40:52.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.337+0000 7fed38752640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fed3010f500 con 0x7fed30105180 2024-09-21T05:40:52.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.337+0000 7fed35ced640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed301047e0 0x7fed3019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:52.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.337+0000 7fed35ced640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed301047e0 0x7fed3019a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37586/0 (socket says 172.21.15.70:37586) 2024-09-21T05:40:52.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.337+0000 7fed35ced640 1 -- 172.21.15.70:0/3637176813 learned_addr learned my addr 172.21.15.70:0/3637176813 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:40:52.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.337+0000 7fed364ee640 1 --2- 172.21.15.70:0/3637176813 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed30103750 0x7fed30199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:52.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.337+0000 7fed36cef640 1 --2- 172.21.15.70:0/3637176813 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed30105180 0x7fed3019b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:52.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.337+0000 7fed35ced640 1 -- 172.21.15.70:0/3637176813 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed30105180 msgr2=0x7fed3019b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:52.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.337+0000 7fed35ced640 1 --2- 172.21.15.70:0/3637176813 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed30105180 0x7fed3019b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:52.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.337+0000 7fed35ced640 1 -- 172.21.15.70:0/3637176813 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed30103750 msgr2=0x7fed30199f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:52.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.337+0000 7fed35ced640 1 --2- 172.21.15.70:0/3637176813 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed30103750 0x7fed30199f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:52.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.337+0000 7fed35ced640 1 -- 172.21.15.70:0/3637176813 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed3019b8c0 con 0x7fed301047e0 2024-09-21T05:40:52.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.337+0000 7fed36cef640 1 --2- 172.21.15.70:0/3637176813 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed30105180 0x7fed3019b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:40:52.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.338+0000 7fed35ced640 1 --2- 172.21.15.70:0/3637176813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed301047e0 0x7fed3019a590 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fed2000d950 tx=0x7fed2000dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:52.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.338+0000 7fed277fe640 1 -- 172.21.15.70:0/3637176813 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed20017070 con 0x7fed301047e0 2024-09-21T05:40:52.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.338+0000 7fed277fe640 1 -- 172.21.15.70:0/3637176813 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fed2000de80 con 0x7fed301047e0 2024-09-21T05:40:52.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.338+0000 7fed38752640 1 -- 172.21.15.70:0/3637176813 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed3019bbb0 con 0x7fed301047e0 2024-09-21T05:40:52.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.338+0000 7fed277fe640 1 -- 172.21.15.70:0/3637176813 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2000f620 con 0x7fed301047e0 2024-09-21T05:40:52.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.338+0000 7fed38752640 1 -- 172.21.15.70:0/3637176813 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed301a2340 con 0x7fed301047e0 2024-09-21T05:40:52.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.339+0000 7fed38752640 1 -- 172.21.15.70:0/3637176813 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed3010a930 con 0x7fed301047e0 2024-09-21T05:40:52.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.341+0000 7fed277fe640 1 -- 172.21.15.70:0/3637176813 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fed20009c30 con 0x7fed301047e0 2024-09-21T05:40:52.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.342+0000 7fed277fe640 1 --2- 172.21.15.70:0/3637176813 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fed1c0b6500 0x7fed1c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:52.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.342+0000 7fed364ee640 1 --2- 172.21.15.70:0/3637176813 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fed1c0b6500 0x7fed1c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:52.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.342+0000 7fed277fe640 1 -- 172.21.15.70:0/3637176813 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fed200e51f0 con 0x7fed301047e0 2024-09-21T05:40:52.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.342+0000 7fed364ee640 1 --2- 172.21.15.70:0/3637176813 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fed1c0b6500 0x7fed1c0b8a10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fed2c00abe0 tx=0x7fed2c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:52.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.345+0000 7fed277fe640 1 -- 172.21.15.70:0/3637176813 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fed200ad7d0 con 0x7fed301047e0 2024-09-21T05:40:52.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.528+0000 7fed38752640 1 -- 172.21.15.70:0/3637176813 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7fed3002e640 con 0x7fed301047e0 2024-09-21T05:40:52.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.532+0000 7fed277fe640 1 -- 172.21.15.70:0/3637176813 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v25)=0 v25) ==== 125+0+0 (secure 0 0 0) 0x7fed200b1bb0 con 0x7fed301047e0 2024-09-21T05:40:52.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.535+0000 7fed38752640 1 -- 172.21.15.70:0/3637176813 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fed1c0b6500 msgr2=0x7fed1c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:52.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.535+0000 7fed38752640 1 --2- 172.21.15.70:0/3637176813 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fed1c0b6500 0x7fed1c0b8a10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fed2c00abe0 tx=0x7fed2c00a2d0 comp rx=0 tx=0).stop 2024-09-21T05:40:52.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.535+0000 7fed38752640 1 -- 172.21.15.70:0/3637176813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed301047e0 msgr2=0x7fed3019a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:52.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.535+0000 7fed38752640 1 --2- 172.21.15.70:0/3637176813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed301047e0 0x7fed3019a590 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fed2000d950 tx=0x7fed2000dd50 comp rx=0 tx=0).stop 2024-09-21T05:40:52.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.535+0000 7fed38752640 1 -- 172.21.15.70:0/3637176813 shutdown_connections 2024-09-21T05:40:52.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.535+0000 7fed38752640 1 --2- 172.21.15.70:0/3637176813 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fed1c0b6500 0x7fed1c0b8a10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:52.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.535+0000 7fed38752640 1 --2- 172.21.15.70:0/3637176813 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed30105180 0x7fed3019b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:52.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.535+0000 7fed38752640 1 --2- 172.21.15.70:0/3637176813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed301047e0 0x7fed3019a590 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:52.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.535+0000 7fed38752640 1 --2- 172.21.15.70:0/3637176813 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed30103750 0x7fed30199f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:52.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.535+0000 7fed38752640 1 -- 172.21.15.70:0/3637176813 >> 172.21.15.70:0/3637176813 conn(0x7fed300ff0c0 msgr2=0x7fed30107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:52.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.535+0000 7fed38752640 1 -- 172.21.15.70:0/3637176813 shutdown_connections 2024-09-21T05:40:52.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.536+0000 7fed38752640 1 -- 172.21.15.70:0/3637176813 wait complete. 2024-09-21T05:40:52.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.548+0000 7feefdc2f640 1 -- 172.21.15.70:0/1657299017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feef8102650 msgr2=0x7feef8102ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:52.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.548+0000 7feefdc2f640 1 --2- 172.21.15.70:0/1657299017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feef8102650 0x7feef8102ac0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7feee8009900 tx=0x7feee802a480 comp rx=0 tx=0).stop 2024-09-21T05:40:52.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.548+0000 7feefdc2f640 1 -- 172.21.15.70:0/1657299017 shutdown_connections 2024-09-21T05:40:52.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.548+0000 7feefdc2f640 1 --2- 172.21.15.70:0/1657299017 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feef81036e0 0x7feef8103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:52.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.548+0000 7feefdc2f640 1 --2- 172.21.15.70:0/1657299017 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feef8104080 0x7feef810aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:52.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.548+0000 7feefdc2f640 1 --2- 172.21.15.70:0/1657299017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feef8102650 0x7feef8102ac0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:52.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.548+0000 7feefdc2f640 1 -- 172.21.15.70:0/1657299017 >> 172.21.15.70:0/1657299017 conn(0x7feef80fdfa0 msgr2=0x7feef8100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:52.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.548+0000 7feefdc2f640 1 -- 172.21.15.70:0/1657299017 shutdown_connections 2024-09-21T05:40:52.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.548+0000 7feefdc2f640 1 -- 172.21.15.70:0/1657299017 wait complete. 2024-09-21T05:40:52.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.549+0000 7feefdc2f640 1 Processor -- start 2024-09-21T05:40:52.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.550+0000 7feefdc2f640 1 -- start start 2024-09-21T05:40:52.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.550+0000 7feefdc2f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feef8102650 0x7feef8199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:52.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.550+0000 7feefdc2f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feef81036e0 0x7feef819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:52.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.550+0000 7feefdc2f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feef8104080 0x7feef819b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:52.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.550+0000 7feefdc2f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7feef810e280 con 0x7feef81036e0 2024-09-21T05:40:52.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.550+0000 7feefdc2f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7feef810e100 con 0x7feef8102650 2024-09-21T05:40:52.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.550+0000 7feefdc2f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7feef810e400 con 0x7feef8104080 2024-09-21T05:40:52.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.550+0000 7feef6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feef81036e0 0x7feef819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:52.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.550+0000 7feef6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feef81036e0 0x7feef819a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37610/0 (socket says 172.21.15.70:37610) 2024-09-21T05:40:52.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.550+0000 7feef6ffd640 1 -- 172.21.15.70:0/1128118905 learned_addr learned my addr 172.21.15.70:0/1128118905 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:40:52.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.550+0000 7feef77fe640 1 --2- 172.21.15.70:0/1128118905 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feef8102650 0x7feef8199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:52.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.550+0000 7feef7fff640 1 --2- 172.21.15.70:0/1128118905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feef8104080 0x7feef819b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:52.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.550+0000 7feef6ffd640 1 -- 172.21.15.70:0/1128118905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feef8104080 msgr2=0x7feef819b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:52.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.550+0000 7feef6ffd640 1 --2- 172.21.15.70:0/1128118905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feef8104080 0x7feef819b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:52.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.550+0000 7feef6ffd640 1 -- 172.21.15.70:0/1128118905 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feef8102650 msgr2=0x7feef8199fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:52.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.550+0000 7feef6ffd640 1 --2- 172.21.15.70:0/1128118905 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feef8102650 0x7feef8199fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:52.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.550+0000 7feef6ffd640 1 -- 172.21.15.70:0/1128118905 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feef819b9d0 con 0x7feef81036e0 2024-09-21T05:40:52.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.550+0000 7feef7fff640 1 --2- 172.21.15.70:0/1128118905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feef8104080 0x7feef819b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:40:52.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.551+0000 7feef6ffd640 1 --2- 172.21.15.70:0/1128118905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feef81036e0 0x7feef819a610 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feeec00d770 tx=0x7feeec00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:52.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.551+0000 7feef4ff9640 1 -- 172.21.15.70:0/1128118905 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec017070 con 0x7feef81036e0 2024-09-21T05:40:52.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.551+0000 7feef4ff9640 1 -- 172.21.15.70:0/1128118905 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7feeec0054d0 con 0x7feef81036e0 2024-09-21T05:40:52.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.551+0000 7feefdc2f640 1 -- 172.21.15.70:0/1128118905 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feef819bcc0 con 0x7feef81036e0 2024-09-21T05:40:52.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.551+0000 7feef4ff9640 1 -- 172.21.15.70:0/1128118905 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec004c80 con 0x7feef81036e0 2024-09-21T05:40:52.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.551+0000 7feefdc2f640 1 -- 172.21.15.70:0/1128118905 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feef81a23c0 con 0x7feef81036e0 2024-09-21T05:40:52.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.552+0000 7feefdc2f640 1 -- 172.21.15.70:0/1128118905 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feef81a2590 con 0x7feef81036e0 2024-09-21T05:40:52.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.553+0000 7feef4ff9640 1 -- 172.21.15.70:0/1128118905 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7feeec004e20 con 0x7feef81036e0 2024-09-21T05:40:52.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.554+0000 7feef4ff9640 1 --2- 172.21.15.70:0/1128118905 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7feee00b6500 0x7feee00b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:52.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.555+0000 7feef77fe640 1 --2- 172.21.15.70:0/1128118905 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7feee00b6500 0x7feee00b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:52.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.555+0000 7feef4ff9640 1 -- 172.21.15.70:0/1128118905 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7feeec0e5130 con 0x7feef81036e0 2024-09-21T05:40:52.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.555+0000 7feef77fe640 1 --2- 172.21.15.70:0/1128118905 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7feee00b6500 0x7feee00b8a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feee8005f70 tx=0x7feee8005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:52.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.559+0000 7feef4ff9640 1 -- 172.21.15.70:0/1128118905 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feeec0ad690 con 0x7feef81036e0 2024-09-21T05:40:52.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.744+0000 7feefdc2f640 1 -- 172.21.15.70:0/1128118905 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7feef81a2b20 con 0x7feef81036e0 2024-09-21T05:40:52.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.749+0000 7feef4ff9640 1 -- 172.21.15.70:0/1128118905 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v26)=0 v26) ==== 119+0+0 (secure 0 0 0) 0x7feeec0b1a70 con 0x7feef81036e0 2024-09-21T05:40:52.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.752+0000 7feefdc2f640 1 -- 172.21.15.70:0/1128118905 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7feee00b6500 msgr2=0x7feee00b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:52.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.752+0000 7feefdc2f640 1 --2- 172.21.15.70:0/1128118905 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7feee00b6500 0x7feee00b8a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feee8005f70 tx=0x7feee8005d50 comp rx=0 tx=0).stop 2024-09-21T05:40:52.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.752+0000 7feefdc2f640 1 -- 172.21.15.70:0/1128118905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feef81036e0 msgr2=0x7feef819a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:52.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.752+0000 7feefdc2f640 1 --2- 172.21.15.70:0/1128118905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feef81036e0 0x7feef819a610 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feeec00d770 tx=0x7feeec00dc30 comp rx=0 tx=0).stop 2024-09-21T05:40:52.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.752+0000 7feefdc2f640 1 -- 172.21.15.70:0/1128118905 shutdown_connections 2024-09-21T05:40:52.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.752+0000 7feefdc2f640 1 --2- 172.21.15.70:0/1128118905 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7feee00b6500 0x7feee00b8a10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:52.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.752+0000 7feefdc2f640 1 --2- 172.21.15.70:0/1128118905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feef8104080 0x7feef819b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:52.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.752+0000 7feefdc2f640 1 --2- 172.21.15.70:0/1128118905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feef81036e0 0x7feef819a610 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:52.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.752+0000 7feefdc2f640 1 --2- 172.21.15.70:0/1128118905 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feef8102650 0x7feef8199fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:52.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.752+0000 7feefdc2f640 1 -- 172.21.15.70:0/1128118905 >> 172.21.15.70:0/1128118905 conn(0x7feef80fdfa0 msgr2=0x7feef80ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:52.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.752+0000 7feefdc2f640 1 -- 172.21.15.70:0/1128118905 shutdown_connections 2024-09-21T05:40:52.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:52.752+0000 7feefdc2f640 1 -- 172.21.15.70:0/1128118905 wait complete. 2024-09-21T05:40:53.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:53 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3637176813' entity='client.admin' 2024-09-21T05:40:53.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:53 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1128118905' entity='client.admin' 2024-09-21T05:40:53.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:53 smithi070 ceph-mon[30981]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:53.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:53 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3637176813' entity='client.admin' 2024-09-21T05:40:53.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:53 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1128118905' entity='client.admin' 2024-09-21T05:40:53.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:53 smithi116 ceph-mon[34332]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:53.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:53 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3637176813' entity='client.admin' 2024-09-21T05:40:53.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:53 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1128118905' entity='client.admin' 2024-09-21T05:40:53.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:53 smithi160 ceph-mon[33979]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:54.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.298+0000 7fb70855b640 1 -- 172.21.15.70:0/41445245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7001036f0 msgr2=0x7fb700103b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:54.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.298+0000 7fb70855b640 1 --2- 172.21.15.70:0/41445245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7001036f0 0x7fb700103b00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0009900 tx=0x7fb6f002a480 comp rx=0 tx=0).stop 2024-09-21T05:40:54.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.298+0000 7fb70855b640 1 -- 172.21.15.70:0/41445245 shutdown_connections 2024-09-21T05:40:54.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.298+0000 7fb70855b640 1 --2- 172.21.15.70:0/41445245 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb700104090 0x7fb70010aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:54.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.298+0000 7fb70855b640 1 --2- 172.21.15.70:0/41445245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7001036f0 0x7fb700103b00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:54.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.298+0000 7fb70855b640 1 --2- 172.21.15.70:0/41445245 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb700102660 0x7fb700102ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:54.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.298+0000 7fb70855b640 1 -- 172.21.15.70:0/41445245 >> 172.21.15.70:0/41445245 conn(0x7fb7000fdfd0 msgr2=0x7fb700100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:54.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.299+0000 7fb70855b640 1 -- 172.21.15.70:0/41445245 shutdown_connections 2024-09-21T05:40:54.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.299+0000 7fb70855b640 1 -- 172.21.15.70:0/41445245 wait complete. 2024-09-21T05:40:54.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.299+0000 7fb70855b640 1 Processor -- start 2024-09-21T05:40:54.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.299+0000 7fb70855b640 1 -- start start 2024-09-21T05:40:54.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.300+0000 7fb70855b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb700102660 0x7fb700199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:54.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.300+0000 7fb70855b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7001036f0 0x7fb70019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:54.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.300+0000 7fb70855b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb700104090 0x7fb70019b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:54.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.300+0000 7fb70855b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb70010e290 con 0x7fb700102660 2024-09-21T05:40:54.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.300+0000 7fb70855b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb70010e110 con 0x7fb700104090 2024-09-21T05:40:54.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.300+0000 7fb70855b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb70010e410 con 0x7fb7001036f0 2024-09-21T05:40:54.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.300+0000 7fb7062f7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb700102660 0x7fb700199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:54.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.300+0000 7fb7062f7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb700102660 0x7fb700199fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37620/0 (socket says 172.21.15.70:37620) 2024-09-21T05:40:54.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.300+0000 7fb7062f7640 1 -- 172.21.15.70:0/2412059182 learned_addr learned my addr 172.21.15.70:0/2412059182 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:40:54.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.300+0000 7fb705af6640 1 --2- 172.21.15.70:0/2412059182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7001036f0 0x7fb70019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:54.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.300+0000 7fb706af8640 1 --2- 172.21.15.70:0/2412059182 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb700104090 0x7fb70019b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:54.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.300+0000 7fb7062f7640 1 -- 172.21.15.70:0/2412059182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7001036f0 msgr2=0x7fb70019a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:54.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.300+0000 7fb7062f7640 1 --2- 172.21.15.70:0/2412059182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7001036f0 0x7fb70019a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:54.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.300+0000 7fb7062f7640 1 -- 172.21.15.70:0/2412059182 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb700104090 msgr2=0x7fb70019b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:54.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.300+0000 7fb7062f7640 1 --2- 172.21.15.70:0/2412059182 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb700104090 0x7fb70019b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:54.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.300+0000 7fb7062f7640 1 -- 172.21.15.70:0/2412059182 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb70019ba00 con 0x7fb700102660 2024-09-21T05:40:54.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.300+0000 7fb7062f7640 1 --2- 172.21.15.70:0/2412059182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb700102660 0x7fb700199fd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00d950 tx=0x7fb6fc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:54.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.301+0000 7fb6f77fe640 1 -- 172.21.15.70:0/2412059182 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc017070 con 0x7fb700102660 2024-09-21T05:40:54.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.301+0000 7fb6f77fe640 1 -- 172.21.15.70:0/2412059182 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fb6fc009c30 con 0x7fb700102660 2024-09-21T05:40:54.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.301+0000 7fb70855b640 1 -- 172.21.15.70:0/2412059182 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb70019bcf0 con 0x7fb700102660 2024-09-21T05:40:54.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.301+0000 7fb6f77fe640 1 -- 172.21.15.70:0/2412059182 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc00f620 con 0x7fb700102660 2024-09-21T05:40:54.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.301+0000 7fb70855b640 1 -- 172.21.15.70:0/2412059182 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7001a23f0 con 0x7fb700102660 2024-09-21T05:40:54.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.302+0000 7fb70855b640 1 -- 172.21.15.70:0/2412059182 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7001a2680 con 0x7fb700102660 2024-09-21T05:40:54.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.303+0000 7fb6f77fe640 1 -- 172.21.15.70:0/2412059182 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fb6fc0109a0 con 0x7fb700102660 2024-09-21T05:40:54.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.304+0000 7fb6f77fe640 1 --2- 172.21.15.70:0/2412059182 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb6ec0b6500 0x7fb6ec0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:54.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.305+0000 7fb705af6640 1 --2- 172.21.15.70:0/2412059182 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb6ec0b6500 0x7fb6ec0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:54.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.305+0000 7fb6f77fe640 1 -- 172.21.15.70:0/2412059182 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb6fc0e51d0 con 0x7fb700102660 2024-09-21T05:40:54.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.305+0000 7fb705af6640 1 --2- 172.21.15.70:0/2412059182 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb6ec0b6500 0x7fb6ec0b8a10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0006010 tx=0x7fb6f0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:54.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.308+0000 7fb6f77fe640 1 -- 172.21.15.70:0/2412059182 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb6fc009de0 con 0x7fb700102660 2024-09-21T05:40:54.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.494+0000 7fb70855b640 1 -- 172.21.15.70:0/2412059182 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fb7001a2850 con 0x7fb700102660 2024-09-21T05:40:54.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.495+0000 7fb6f77fe640 1 -- 172.21.15.70:0/2412059182 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v26)=0 v26) ==== 106+0+0 (secure 0 0 0) 0x7fb6fc0ad7b0 con 0x7fb700102660 2024-09-21T05:40:54.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.497+0000 7fb70855b640 1 -- 172.21.15.70:0/2412059182 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb6ec0b6500 msgr2=0x7fb6ec0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:54.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.497+0000 7fb70855b640 1 --2- 172.21.15.70:0/2412059182 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb6ec0b6500 0x7fb6ec0b8a10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0006010 tx=0x7fb6f0000bc0 comp rx=0 tx=0).stop 2024-09-21T05:40:54.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.497+0000 7fb70855b640 1 -- 172.21.15.70:0/2412059182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb700102660 msgr2=0x7fb700199fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:54.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.497+0000 7fb70855b640 1 --2- 172.21.15.70:0/2412059182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb700102660 0x7fb700199fd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00d950 tx=0x7fb6fc00de10 comp rx=0 tx=0).stop 2024-09-21T05:40:54.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.497+0000 7fb70855b640 1 -- 172.21.15.70:0/2412059182 shutdown_connections 2024-09-21T05:40:54.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.497+0000 7fb70855b640 1 --2- 172.21.15.70:0/2412059182 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb6ec0b6500 0x7fb6ec0b8a10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:54.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.497+0000 7fb70855b640 1 --2- 172.21.15.70:0/2412059182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7001036f0 0x7fb70019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:54.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.497+0000 7fb70855b640 1 --2- 172.21.15.70:0/2412059182 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb700104090 0x7fb70019b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:54.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.497+0000 7fb70855b640 1 --2- 172.21.15.70:0/2412059182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb700102660 0x7fb700199fd0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:54.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.497+0000 7fb70855b640 1 -- 172.21.15.70:0/2412059182 >> 172.21.15.70:0/2412059182 conn(0x7fb7000fdfd0 msgr2=0x7fb70006bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:54.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.498+0000 7fb70855b640 1 -- 172.21.15.70:0/2412059182 shutdown_connections 2024-09-21T05:40:54.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.498+0000 7fb70855b640 1 -- 172.21.15.70:0/2412059182 wait complete. 2024-09-21T05:40:54.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.484+0000 7ff1e671d640 1 -- 172.21.15.70:0/2560570398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1e0102650 msgr2=0x7ff1e0102ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:54.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.484+0000 7ff1e671d640 1 --2- 172.21.15.70:0/2560570398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1e0102650 0x7ff1e0102ac0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0009900 tx=0x7ff1d002a480 comp rx=0 tx=0).stop 2024-09-21T05:40:54.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.484+0000 7ff1e671d640 1 -- 172.21.15.70:0/2560570398 shutdown_connections 2024-09-21T05:40:54.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.484+0000 7ff1e671d640 1 --2- 172.21.15.70:0/2560570398 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff1e01036e0 0x7ff1e0103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:54.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.484+0000 7ff1e671d640 1 --2- 172.21.15.70:0/2560570398 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1e0104080 0x7ff1e010aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:54.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.484+0000 7ff1e671d640 1 --2- 172.21.15.70:0/2560570398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1e0102650 0x7ff1e0102ac0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:54.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.484+0000 7ff1e671d640 1 -- 172.21.15.70:0/2560570398 >> 172.21.15.70:0/2560570398 conn(0x7ff1e00fdfa0 msgr2=0x7ff1e0100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:54.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.484+0000 7ff1e671d640 1 -- 172.21.15.70:0/2560570398 shutdown_connections 2024-09-21T05:40:54.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.484+0000 7ff1e671d640 1 -- 172.21.15.70:0/2560570398 wait complete. 2024-09-21T05:40:54.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.485+0000 7ff1e671d640 1 Processor -- start 2024-09-21T05:40:54.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.485+0000 7ff1e671d640 1 -- start start 2024-09-21T05:40:54.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.485+0000 7ff1e671d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff1e0102650 0x7ff1e006bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:54.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.485+0000 7ff1e671d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1e01036e0 0x7ff1e01a1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:54.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.485+0000 7ff1e671d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1e0104080 0x7ff1e01a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:54.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.485+0000 7ff1e671d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e010e280 con 0x7ff1e0104080 2024-09-21T05:40:54.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.485+0000 7ff1e671d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e010e100 con 0x7ff1e01036e0 2024-09-21T05:40:54.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.485+0000 7ff1e671d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e010e400 con 0x7ff1e0102650 2024-09-21T05:40:54.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.485+0000 7ff1e4cba640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1e0104080 0x7ff1e01a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:54.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.486+0000 7ff1e4cba640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1e0104080 0x7ff1e01a3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37644/0 (socket says 172.21.15.70:37644) 2024-09-21T05:40:54.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.486+0000 7ff1e4cba640 1 -- 172.21.15.70:0/584536296 learned_addr learned my addr 172.21.15.70:0/584536296 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:40:54.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.486+0000 7ff1dffff640 1 --2- 172.21.15.70:0/584536296 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff1e0102650 0x7ff1e006bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:54.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.486+0000 7ff1d7fff640 1 --2- 172.21.15.70:0/584536296 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1e01036e0 0x7ff1e01a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:54.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.486+0000 7ff1e4cba640 1 -- 172.21.15.70:0/584536296 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff1e0102650 msgr2=0x7ff1e006bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:54.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.486+0000 7ff1e4cba640 1 --2- 172.21.15.70:0/584536296 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff1e0102650 0x7ff1e006bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:54.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.486+0000 7ff1e4cba640 1 -- 172.21.15.70:0/584536296 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1e01036e0 msgr2=0x7ff1e01a1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:54.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.486+0000 7ff1e4cba640 1 --2- 172.21.15.70:0/584536296 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1e01036e0 0x7ff1e01a1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:54.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.486+0000 7ff1e4cba640 1 -- 172.21.15.70:0/584536296 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e01a3c00 con 0x7ff1e0104080 2024-09-21T05:40:54.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.486+0000 7ff1e4cba640 1 --2- 172.21.15.70:0/584536296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1e0104080 0x7ff1e01a3690 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff1d800cad0 tx=0x7ff1d800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:54.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.486+0000 7ff1ddffb640 1 -- 172.21.15.70:0/584536296 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d800ae20 con 0x7ff1e0104080 2024-09-21T05:40:54.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.486+0000 7ff1ddffb640 1 -- 172.21.15.70:0/584536296 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7ff1d8005020 con 0x7ff1e0104080 2024-09-21T05:40:54.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.486+0000 7ff1e671d640 1 -- 172.21.15.70:0/584536296 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1e01a3ef0 con 0x7ff1e0104080 2024-09-21T05:40:54.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.486+0000 7ff1ddffb640 1 -- 172.21.15.70:0/584536296 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d800f6b0 con 0x7ff1e0104080 2024-09-21T05:40:54.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.486+0000 7ff1e671d640 1 -- 172.21.15.70:0/584536296 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1e01a4340 con 0x7ff1e0104080 2024-09-21T05:40:54.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.487+0000 7ff1e671d640 1 -- 172.21.15.70:0/584536296 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1e0109830 con 0x7ff1e0104080 2024-09-21T05:40:54.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.489+0000 7ff1ddffb640 1 -- 172.21.15.70:0/584536296 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7ff1d8005580 con 0x7ff1e0104080 2024-09-21T05:40:54.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.490+0000 7ff1ddffb640 1 --2- 172.21.15.70:0/584536296 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7ff1cc0b6480 0x7ff1cc0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:54.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.490+0000 7ff1dffff640 1 --2- 172.21.15.70:0/584536296 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7ff1cc0b6480 0x7ff1cc0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:54.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.490+0000 7ff1ddffb640 1 -- 172.21.15.70:0/584536296 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff1d80e5b30 con 0x7ff1e0104080 2024-09-21T05:40:54.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.490+0000 7ff1dffff640 1 --2- 172.21.15.70:0/584536296 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7ff1cc0b6480 0x7ff1cc0b8990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0005f70 tx=0x7ff1d0005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:54.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.493+0000 7ff1ddffb640 1 -- 172.21.15.70:0/584536296 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff1d8014030 con 0x7ff1e0104080 2024-09-21T05:40:54.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.688+0000 7ff1e671d640 1 -- 172.21.15.70:0/584536296 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7ff1e002e640 con 0x7ff1e0104080 2024-09-21T05:40:54.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.692+0000 7ff1ddffb640 1 -- 172.21.15.70:0/584536296 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v27)=0 v27) ==== 111+0+0 (secure 0 0 0) 0x7ff1d80ae090 con 0x7ff1e0104080 2024-09-21T05:40:54.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.695+0000 7ff1e671d640 1 -- 172.21.15.70:0/584536296 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7ff1cc0b6480 msgr2=0x7ff1cc0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:54.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.695+0000 7ff1e671d640 1 --2- 172.21.15.70:0/584536296 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7ff1cc0b6480 0x7ff1cc0b8990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0005f70 tx=0x7ff1d0005d50 comp rx=0 tx=0).stop 2024-09-21T05:40:54.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.695+0000 7ff1e671d640 1 -- 172.21.15.70:0/584536296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1e0104080 msgr2=0x7ff1e01a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:54.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.695+0000 7ff1e671d640 1 --2- 172.21.15.70:0/584536296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1e0104080 0x7ff1e01a3690 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff1d800cad0 tx=0x7ff1d800cf90 comp rx=0 tx=0).stop 2024-09-21T05:40:54.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.695+0000 7ff1e671d640 1 -- 172.21.15.70:0/584536296 shutdown_connections 2024-09-21T05:40:54.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.695+0000 7ff1e671d640 1 --2- 172.21.15.70:0/584536296 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7ff1cc0b6480 0x7ff1cc0b8990 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:54.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.695+0000 7ff1e671d640 1 --2- 172.21.15.70:0/584536296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1e0104080 0x7ff1e01a3690 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:54.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.695+0000 7ff1e671d640 1 --2- 172.21.15.70:0/584536296 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1e01036e0 0x7ff1e01a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:54.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.695+0000 7ff1e671d640 1 --2- 172.21.15.70:0/584536296 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff1e0102650 0x7ff1e006bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:54.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.695+0000 7ff1e671d640 1 -- 172.21.15.70:0/584536296 >> 172.21.15.70:0/584536296 conn(0x7ff1e00fdfa0 msgr2=0x7ff1e0106a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:54.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.695+0000 7ff1e671d640 1 -- 172.21.15.70:0/584536296 shutdown_connections 2024-09-21T05:40:54.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.695+0000 7ff1e671d640 1 -- 172.21.15.70:0/584536296 wait complete. 2024-09-21T05:40:55.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:54 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:55.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:54 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:55.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:54 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:40:55.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:54 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/584536296' entity='client.admin' 2024-09-21T05:40:55.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:54 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/4203360170' entity='client.admin' 2024-09-21T05:40:55.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:54 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:55.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:54 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:55.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:54 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:55.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:54 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:55.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:54 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:55.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:54 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:40:55.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:54 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/584536296' entity='client.admin' 2024-09-21T05:40:55.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:54 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/4203360170' entity='client.admin' 2024-09-21T05:40:55.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:54 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:55.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:54 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:55.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:54 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:55.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:54 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:55.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:54 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:55.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:54 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:40:55.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:54 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/584536296' entity='client.admin' 2024-09-21T05:40:55.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:54 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/4203360170' entity='client.admin' 2024-09-21T05:40:55.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:54 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:55.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:54 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:55.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:54 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:55.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.941+0000 7f930f86e640 1 -- 172.21.15.70:0/1841380528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9308108370 msgr2=0x7f930810a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:55.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.941+0000 7f930f86e640 1 --2- 172.21.15.70:0/1841380528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9308108370 0x7f930810a880 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9300009ca0 tx=0x7f930002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:40:55.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.941+0000 7f930f86e640 1 -- 172.21.15.70:0/1841380528 shutdown_connections 2024-09-21T05:40:55.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.941+0000 7f930f86e640 1 --2- 172.21.15.70:0/1841380528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9308108370 0x7f930810a880 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:55.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.941+0000 7f930f86e640 1 --2- 172.21.15.70:0/1841380528 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9308105750 0x7f9308107c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:55.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.941+0000 7f930f86e640 1 --2- 172.21.15.70:0/1841380528 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9308102cf0 0x7f9308105110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:55.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.941+0000 7f930f86e640 1 -- 172.21.15.70:0/1841380528 >> 172.21.15.70:0/1841380528 conn(0x7f93080fd770 msgr2=0x7f93080ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:55.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.941+0000 7f930f86e640 1 -- 172.21.15.70:0/1841380528 shutdown_connections 2024-09-21T05:40:55.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.941+0000 7f930f86e640 1 -- 172.21.15.70:0/1841380528 wait complete. 2024-09-21T05:40:55.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.942+0000 7f930f86e640 1 Processor -- start 2024-09-21T05:40:55.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.942+0000 7f930f86e640 1 -- start start 2024-09-21T05:40:55.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.942+0000 7f930f86e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9308102cf0 0x7f9308198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:55.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.942+0000 7f930f86e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9308105750 0x7f9308199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:55.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.942+0000 7f930f86e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9308108370 0x7f9308199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:55.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.942+0000 7f930f86e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f930810e260 con 0x7f9308108370 2024-09-21T05:40:55.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.942+0000 7f930f86e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f930810e0e0 con 0x7f9308102cf0 2024-09-21T05:40:55.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.942+0000 7f930f86e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f930810e3e0 con 0x7f9308105750 2024-09-21T05:40:55.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.942+0000 7f930de0b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9308108370 0x7f9308199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:55.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.942+0000 7f930de0b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9308108370 0x7f9308199fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37684/0 (socket says 172.21.15.70:37684) 2024-09-21T05:40:55.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.942+0000 7f930de0b640 1 -- 172.21.15.70:0/2835174946 learned_addr learned my addr 172.21.15.70:0/2835174946 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:40:55.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.943+0000 7f930d60a640 1 --2- 172.21.15.70:0/2835174946 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9308102cf0 0x7f9308198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:55.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.943+0000 7f930ce09640 1 --2- 172.21.15.70:0/2835174946 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9308105750 0x7f9308199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:55.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.943+0000 7f930de0b640 1 -- 172.21.15.70:0/2835174946 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9308105750 msgr2=0x7f9308199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:55.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.943+0000 7f930de0b640 1 --2- 172.21.15.70:0/2835174946 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9308105750 0x7f9308199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:55.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.943+0000 7f930de0b640 1 -- 172.21.15.70:0/2835174946 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9308102cf0 msgr2=0x7f9308198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:55.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.943+0000 7f930de0b640 1 --2- 172.21.15.70:0/2835174946 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9308102cf0 0x7f9308198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:55.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.943+0000 7f930de0b640 1 -- 172.21.15.70:0/2835174946 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f930819a740 con 0x7f9308108370 2024-09-21T05:40:55.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.943+0000 7f930ce09640 1 --2- 172.21.15.70:0/2835174946 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9308105750 0x7f9308199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:40:55.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.943+0000 7f930de0b640 1 --2- 172.21.15.70:0/2835174946 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9308108370 0x7f9308199fb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f93000097b0 tx=0x7f9300003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:55.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.943+0000 7f92fe7fc640 1 -- 172.21.15.70:0/2835174946 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9300004240 con 0x7f9308108370 2024-09-21T05:40:55.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.943+0000 7f92fe7fc640 1 -- 172.21.15.70:0/2835174946 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f93000305c0 con 0x7f9308108370 2024-09-21T05:40:55.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.943+0000 7f930f86e640 1 -- 172.21.15.70:0/2835174946 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f930819a9d0 con 0x7f9308108370 2024-09-21T05:40:55.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.943+0000 7f92fe7fc640 1 -- 172.21.15.70:0/2835174946 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930002f720 con 0x7f9308108370 2024-09-21T05:40:55.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.943+0000 7f930f86e640 1 -- 172.21.15.70:0/2835174946 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9308101950 con 0x7f9308108370 2024-09-21T05:40:55.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.944+0000 7f930f86e640 1 -- 172.21.15.70:0/2835174946 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9308102370 con 0x7f9308108370 2024-09-21T05:40:55.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.946+0000 7f92fe7fc640 1 -- 172.21.15.70:0/2835174946 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f9300030b00 con 0x7f9308108370 2024-09-21T05:40:55.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.946+0000 7f92fe7fc640 1 --2- 172.21.15.70:0/2835174946 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f92f40b6480 0x7f92f40b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:55.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.946+0000 7f930d60a640 1 --2- 172.21.15.70:0/2835174946 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f92f40b6480 0x7f92f40b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:55.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.947+0000 7f92fe7fc640 1 -- 172.21.15.70:0/2835174946 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9300106db0 con 0x7f9308108370 2024-09-21T05:40:55.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.947+0000 7f930d60a640 1 --2- 172.21.15.70:0/2835174946 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f92f40b6480 0x7f92f40b8990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9304005e10 tx=0x7f9304005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:55.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:55.950+0000 7f92fe7fc640 1 -- 172.21.15.70:0/2835174946 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f93000cf3a0 con 0x7f9308108370 2024-09-21T05:40:56.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:55 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:40:56.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:55 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:56.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:55 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:56.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:55 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:56.037 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:55 smithi070 ceph-mon[30981]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:56.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.134+0000 7f930f86e640 1 -- 172.21.15.70:0/2835174946 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f9308102540 con 0x7f9308108370 2024-09-21T05:40:56.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.138+0000 7f92fe7fc640 1 -- 172.21.15.70:0/2835174946 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v29)=0 v29) ==== 121+0+0 (secure 0 0 0) 0x7f93000d3780 con 0x7f9308108370 2024-09-21T05:40:56.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.140+0000 7f930f86e640 1 -- 172.21.15.70:0/2835174946 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f92f40b6480 msgr2=0x7f92f40b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:56.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.140+0000 7f930f86e640 1 --2- 172.21.15.70:0/2835174946 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f92f40b6480 0x7f92f40b8990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9304005e10 tx=0x7f9304005da0 comp rx=0 tx=0).stop 2024-09-21T05:40:56.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.140+0000 7f930f86e640 1 -- 172.21.15.70:0/2835174946 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9308108370 msgr2=0x7f9308199fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:56.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.140+0000 7f930f86e640 1 --2- 172.21.15.70:0/2835174946 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9308108370 0x7f9308199fb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f93000097b0 tx=0x7f9300003ba0 comp rx=0 tx=0).stop 2024-09-21T05:40:56.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.140+0000 7f930f86e640 1 -- 172.21.15.70:0/2835174946 shutdown_connections 2024-09-21T05:40:56.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.140+0000 7f930f86e640 1 --2- 172.21.15.70:0/2835174946 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f92f40b6480 0x7f92f40b8990 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:56.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.140+0000 7f930f86e640 1 --2- 172.21.15.70:0/2835174946 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9308105750 0x7f9308199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:56.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.140+0000 7f930f86e640 1 --2- 172.21.15.70:0/2835174946 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9308108370 0x7f9308199fb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:56.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.140+0000 7f930f86e640 1 --2- 172.21.15.70:0/2835174946 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9308102cf0 0x7f9308198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:56.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.140+0000 7f930f86e640 1 -- 172.21.15.70:0/2835174946 >> 172.21.15.70:0/2835174946 conn(0x7f93080fd770 msgr2=0x7f9308103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:56.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.140+0000 7f930f86e640 1 -- 172.21.15.70:0/2835174946 shutdown_connections 2024-09-21T05:40:56.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.140+0000 7f930f86e640 1 -- 172.21.15.70:0/2835174946 wait complete. 2024-09-21T05:40:56.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:55 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:40:56.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:55 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:56.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:55 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:56.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:55 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:56.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:55 smithi116 ceph-mon[34332]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:56.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:55 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:40:56.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:55 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:56.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:55 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:56.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:55 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:40:56.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:55 smithi160 ceph-mon[33979]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:56.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.605+0000 7fba04296640 1 -- 172.21.15.70:0/4185808991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9fc104070 msgr2=0x7fb9fc10aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:56.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.605+0000 7fba04296640 1 --2- 172.21.15.70:0/4185808991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9fc104070 0x7fb9fc10aa10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec009900 tx=0x7fb9ec02a480 comp rx=0 tx=0).stop 2024-09-21T05:40:56.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.605+0000 7fba04296640 1 -- 172.21.15.70:0/4185808991 shutdown_connections 2024-09-21T05:40:56.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.605+0000 7fba04296640 1 --2- 172.21.15.70:0/4185808991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9fc1036d0 0x7fb9fc103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:56.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.605+0000 7fba04296640 1 --2- 172.21.15.70:0/4185808991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9fc104070 0x7fb9fc10aa10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:56.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.605+0000 7fba04296640 1 --2- 172.21.15.70:0/4185808991 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9fc102640 0x7fb9fc102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:56.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.605+0000 7fba04296640 1 -- 172.21.15.70:0/4185808991 >> 172.21.15.70:0/4185808991 conn(0x7fb9fc0fdfb0 msgr2=0x7fb9fc100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:56.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.605+0000 7fba04296640 1 -- 172.21.15.70:0/4185808991 shutdown_connections 2024-09-21T05:40:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.605+0000 7fba04296640 1 -- 172.21.15.70:0/4185808991 wait complete. 2024-09-21T05:40:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.606+0000 7fba04296640 1 Processor -- start 2024-09-21T05:40:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.606+0000 7fba04296640 1 -- start start 2024-09-21T05:40:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.606+0000 7fba04296640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9fc102640 0x7fb9fc198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.606+0000 7fba04296640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9fc1036d0 0x7fb9fc1994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.606+0000 7fba04296640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9fc104070 0x7fb9fc19a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.606+0000 7fba04296640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc10e270 con 0x7fb9fc102640 2024-09-21T05:40:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.606+0000 7fba04296640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc10e0f0 con 0x7fb9fc1036d0 2024-09-21T05:40:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.606+0000 7fba04296640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc10e3f0 con 0x7fb9fc104070 2024-09-21T05:40:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.606+0000 7fba02032640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9fc102640 0x7fb9fc198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.606+0000 7fba02032640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9fc102640 0x7fb9fc198e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37658/0 (socket says 172.21.15.70:37658) 2024-09-21T05:40:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.606+0000 7fba02032640 1 -- 172.21.15.70:0/4203360170 learned_addr learned my addr 172.21.15.70:0/4203360170 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:40:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.606+0000 7fba01831640 1 --2- 172.21.15.70:0/4203360170 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9fc1036d0 0x7fb9fc1994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.606+0000 7fba02833640 1 --2- 172.21.15.70:0/4203360170 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9fc104070 0x7fb9fc19a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.606+0000 7fba02032640 1 -- 172.21.15.70:0/4203360170 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9fc104070 msgr2=0x7fb9fc19a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.606+0000 7fba02032640 1 --2- 172.21.15.70:0/4203360170 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9fc104070 0x7fb9fc19a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.606+0000 7fba02032640 1 -- 172.21.15.70:0/4203360170 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9fc1036d0 msgr2=0x7fb9fc1994e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.606+0000 7fba02032640 1 --2- 172.21.15.70:0/4203360170 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9fc1036d0 0x7fb9fc1994e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.606+0000 7fba02032640 1 -- 172.21.15.70:0/4203360170 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9fc19a8a0 con 0x7fb9fc102640 2024-09-21T05:40:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.607+0000 7fba02032640 1 --2- 172.21.15.70:0/4203360170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9fc102640 0x7fb9fc198e70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb9f400db80 tx=0x7fb9f400b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.607+0000 7fb9fb7fe640 1 -- 172.21.15.70:0/4203360170 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4017070 con 0x7fb9fc102640 2024-09-21T05:40:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.607+0000 7fba04296640 1 -- 172.21.15.70:0/4203360170 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9fc19ab90 con 0x7fb9fc102640 2024-09-21T05:40:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.607+0000 7fb9fb7fe640 1 -- 172.21.15.70:0/4203360170 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fb9f4003b70 con 0x7fb9fc102640 2024-09-21T05:40:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.607+0000 7fb9fb7fe640 1 -- 172.21.15.70:0/4203360170 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4010460 con 0x7fb9fc102640 2024-09-21T05:40:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.607+0000 7fba04296640 1 -- 172.21.15.70:0/4203360170 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9fc1a1290 con 0x7fb9fc102640 2024-09-21T05:40:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.608+0000 7fba04296640 1 -- 172.21.15.70:0/4203360170 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9fc109820 con 0x7fb9fc102640 2024-09-21T05:40:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.609+0000 7fb9fb7fe640 1 -- 172.21.15.70:0/4203360170 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fb9f4004020 con 0x7fb9fc102640 2024-09-21T05:40:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.610+0000 7fb9fb7fe640 1 --2- 172.21.15.70:0/4203360170 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb9e40b6480 0x7fb9e40b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.610+0000 7fba01831640 1 --2- 172.21.15.70:0/4203360170 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb9e40b6480 0x7fb9e40b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.610+0000 7fb9fb7fe640 1 -- 172.21.15.70:0/4203360170 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb9f40e5ee0 con 0x7fb9fc102640 2024-09-21T05:40:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.611+0000 7fba01831640 1 --2- 172.21.15.70:0/4203360170 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb9e40b6480 0x7fb9e40b8990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0009ae0 tx=0x7fb9f0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.618+0000 7fb9fb7fe640 1 -- 172.21.15.70:0/4203360170 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb9f40ae440 con 0x7fb9fc102640 2024-09-21T05:40:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.803+0000 7fba04296640 1 -- 172.21.15.70:0/4203360170 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fb9fc02e640 con 0x7fb9fc102640 2024-09-21T05:40:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.808+0000 7fb9fb7fe640 1 -- 172.21.15.70:0/4203360170 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v28)=0 v28) ==== 121+0+0 (secure 0 0 0) 0x7fb9f40b2820 con 0x7fb9fc102640 2024-09-21T05:40:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.810+0000 7fba04296640 1 -- 172.21.15.70:0/4203360170 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb9e40b6480 msgr2=0x7fb9e40b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.810+0000 7fba04296640 1 --2- 172.21.15.70:0/4203360170 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb9e40b6480 0x7fb9e40b8990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0009ae0 tx=0x7fb9f0005f90 comp rx=0 tx=0).stop 2024-09-21T05:40:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.810+0000 7fba04296640 1 -- 172.21.15.70:0/4203360170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9fc102640 msgr2=0x7fb9fc198e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.810+0000 7fba04296640 1 --2- 172.21.15.70:0/4203360170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9fc102640 0x7fb9fc198e70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb9f400db80 tx=0x7fb9f400b630 comp rx=0 tx=0).stop 2024-09-21T05:40:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.810+0000 7fba04296640 1 -- 172.21.15.70:0/4203360170 shutdown_connections 2024-09-21T05:40:56.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.810+0000 7fba04296640 1 --2- 172.21.15.70:0/4203360170 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb9e40b6480 0x7fb9e40b8990 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:56.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.810+0000 7fba04296640 1 --2- 172.21.15.70:0/4203360170 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9fc104070 0x7fb9fc19a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:56.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.810+0000 7fba04296640 1 --2- 172.21.15.70:0/4203360170 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9fc1036d0 0x7fb9fc1994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:56.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.810+0000 7fba04296640 1 --2- 172.21.15.70:0/4203360170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9fc102640 0x7fb9fc198e70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:56.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.810+0000 7fba04296640 1 -- 172.21.15.70:0/4203360170 >> 172.21.15.70:0/4203360170 conn(0x7fb9fc0fdfb0 msgr2=0x7fb9fc1069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:56.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.810+0000 7fba04296640 1 -- 172.21.15.70:0/4203360170 shutdown_connections 2024-09-21T05:40:56.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:54.810+0000 7fba04296640 1 -- 172.21.15.70:0/4203360170 wait complete. 2024-09-21T05:40:56.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.789+0000 7f2501611640 1 -- 172.21.15.70:0/1620170995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24fc109490 msgr2=0x7f24fc10b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:56.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.789+0000 7f2501611640 1 --2- 172.21.15.70:0/1620170995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24fc109490 0x7f24fc10b9a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009900 tx=0x7f24f402a410 comp rx=0 tx=0).stop 2024-09-21T05:40:56.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.789+0000 7f2501611640 1 -- 172.21.15.70:0/1620170995 shutdown_connections 2024-09-21T05:40:56.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.789+0000 7f2501611640 1 --2- 172.21.15.70:0/1620170995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24fc109490 0x7f24fc10b9a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:56.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.789+0000 7f2501611640 1 --2- 172.21.15.70:0/1620170995 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24fc1068f0 0x7f24fc108d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:56.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.789+0000 7f2501611640 1 --2- 172.21.15.70:0/1620170995 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24fc06c6a0 0x7f24fc1063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:56.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.789+0000 7f2501611640 1 -- 172.21.15.70:0/1620170995 >> 172.21.15.70:0/1620170995 conn(0x7f24fc0fdfd0 msgr2=0x7f24fc100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:56.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.789+0000 7f2501611640 1 -- 172.21.15.70:0/1620170995 shutdown_connections 2024-09-21T05:40:56.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.789+0000 7f2501611640 1 -- 172.21.15.70:0/1620170995 wait complete. 2024-09-21T05:40:56.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.790+0000 7f2501611640 1 Processor -- start 2024-09-21T05:40:56.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.790+0000 7f2501611640 1 -- start start 2024-09-21T05:40:56.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.790+0000 7f2501611640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24fc06c6a0 0x7f24fc199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:56.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.790+0000 7f2501611640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24fc1068f0 0x7f24fc19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:56.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.791+0000 7f2501611640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24fc109490 0x7f24fc19b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:56.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.791+0000 7f2501611640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f24fc10f380 con 0x7f24fc1068f0 2024-09-21T05:40:56.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.791+0000 7f2501611640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f24fc10f200 con 0x7f24fc06c6a0 2024-09-21T05:40:56.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.791+0000 7f2501611640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f24fc10f500 con 0x7f24fc109490 2024-09-21T05:40:56.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.791+0000 7f24fa7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24fc1068f0 0x7f24fc19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:56.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.791+0000 7f24fa7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24fc1068f0 0x7f24fc19a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37710/0 (socket says 172.21.15.70:37710) 2024-09-21T05:40:56.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.791+0000 7f24fa7fc640 1 -- 172.21.15.70:0/511564051 learned_addr learned my addr 172.21.15.70:0/511564051 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:40:56.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.791+0000 7f24faffd640 1 --2- 172.21.15.70:0/511564051 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24fc06c6a0 0x7f24fc199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:56.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.791+0000 7f24fb7fe640 1 --2- 172.21.15.70:0/511564051 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24fc109490 0x7f24fc19b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:56.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.791+0000 7f24fa7fc640 1 -- 172.21.15.70:0/511564051 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24fc109490 msgr2=0x7f24fc19b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:56.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.791+0000 7f24fa7fc640 1 --2- 172.21.15.70:0/511564051 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24fc109490 0x7f24fc19b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:56.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.791+0000 7f24fa7fc640 1 -- 172.21.15.70:0/511564051 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24fc06c6a0 msgr2=0x7f24fc199f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:56.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.791+0000 7f24fa7fc640 1 --2- 172.21.15.70:0/511564051 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24fc06c6a0 0x7f24fc199f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:56.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.791+0000 7f24fa7fc640 1 -- 172.21.15.70:0/511564051 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24fc19b930 con 0x7f24fc1068f0 2024-09-21T05:40:56.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.791+0000 7f24fa7fc640 1 --2- 172.21.15.70:0/511564051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24fc1068f0 0x7f24fc19a600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f24f000d950 tx=0x7f24f000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:56.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.791+0000 7f24e3fff640 1 -- 172.21.15.70:0/511564051 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f0017070 con 0x7f24fc1068f0 2024-09-21T05:40:56.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.791+0000 7f24e3fff640 1 -- 172.21.15.70:0/511564051 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f24f0009c30 con 0x7f24fc1068f0 2024-09-21T05:40:56.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.791+0000 7f24e3fff640 1 -- 172.21.15.70:0/511564051 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f000f620 con 0x7f24fc1068f0 2024-09-21T05:40:56.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.791+0000 7f2501611640 1 -- 172.21.15.70:0/511564051 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24fc19bc20 con 0x7f24fc1068f0 2024-09-21T05:40:56.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.792+0000 7f2501611640 1 -- 172.21.15.70:0/511564051 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24fc1a23b0 con 0x7f24fc1068f0 2024-09-21T05:40:56.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.793+0000 7f2501611640 1 -- 172.21.15.70:0/511564051 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24fc106d40 con 0x7f24fc1068f0 2024-09-21T05:40:56.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.795+0000 7f24e3fff640 1 -- 172.21.15.70:0/511564051 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f24f00109a0 con 0x7f24fc1068f0 2024-09-21T05:40:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.796+0000 7f24e3fff640 1 --2- 172.21.15.70:0/511564051 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f24e40b6480 0x7f24e40b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.796+0000 7f24faffd640 1 --2- 172.21.15.70:0/511564051 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f24e40b6480 0x7f24e40b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.796+0000 7f24e3fff640 1 -- 172.21.15.70:0/511564051 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f24f00e51a0 con 0x7f24fc1068f0 2024-09-21T05:40:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.796+0000 7f24faffd640 1 --2- 172.21.15.70:0/511564051 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f24e40b6480 0x7f24e40b8990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f24ec007ec0 tx=0x7f24ec0075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:56.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.799+0000 7f24e3fff640 1 -- 172.21.15.70:0/511564051 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f24f0009de0 con 0x7f24fc1068f0 2024-09-21T05:40:56.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.981+0000 7f2501611640 1 -- 172.21.15.70:0/511564051 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f24fc0ffaf0 con 0x7f24fc1068f0 2024-09-21T05:40:56.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.985+0000 7f24e3fff640 1 -- 172.21.15.70:0/511564051 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v30)=0 v30) ==== 121+0+0 (secure 0 0 0) 0x7f24f00b1ae0 con 0x7f24fc1068f0 2024-09-21T05:40:56.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.988+0000 7f2501611640 1 -- 172.21.15.70:0/511564051 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f24e40b6480 msgr2=0x7f24e40b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:56.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.988+0000 7f2501611640 1 --2- 172.21.15.70:0/511564051 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f24e40b6480 0x7f24e40b8990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f24ec007ec0 tx=0x7f24ec0075b0 comp rx=0 tx=0).stop 2024-09-21T05:40:56.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.988+0000 7f2501611640 1 -- 172.21.15.70:0/511564051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24fc1068f0 msgr2=0x7f24fc19a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:56.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.988+0000 7f2501611640 1 --2- 172.21.15.70:0/511564051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24fc1068f0 0x7f24fc19a600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f24f000d950 tx=0x7f24f000de10 comp rx=0 tx=0).stop 2024-09-21T05:40:56.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.988+0000 7f2501611640 1 -- 172.21.15.70:0/511564051 shutdown_connections 2024-09-21T05:40:56.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.988+0000 7f2501611640 1 --2- 172.21.15.70:0/511564051 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f24e40b6480 0x7f24e40b8990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:56.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.988+0000 7f2501611640 1 --2- 172.21.15.70:0/511564051 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24fc109490 0x7f24fc19b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:56.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.988+0000 7f2501611640 1 --2- 172.21.15.70:0/511564051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24fc1068f0 0x7f24fc19a600 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:56.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.988+0000 7f2501611640 1 --2- 172.21.15.70:0/511564051 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24fc06c6a0 0x7f24fc199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.988+0000 7f2501611640 1 -- 172.21.15.70:0/511564051 >> 172.21.15.70:0/511564051 conn(0x7f24fc0fdfd0 msgr2=0x7f24fc104e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.988+0000 7f2501611640 1 -- 172.21.15.70:0/511564051 shutdown_connections 2024-09-21T05:40:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:56.988+0000 7f2501611640 1 -- 172.21.15.70:0/511564051 wait complete. 2024-09-21T05:40:57.244 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:57 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2835174946' entity='client.admin' 2024-09-21T05:40:57.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:57 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/511564051' entity='client.admin' 2024-09-21T05:40:57.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:57 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2835174946' entity='client.admin' 2024-09-21T05:40:57.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:57 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/511564051' entity='client.admin' 2024-09-21T05:40:57.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.476+0000 7f74be7e4640 1 -- 172.21.15.70:0/2853063347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74b806b980 msgr2=0x7f74b8106390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:57.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.476+0000 7f74be7e4640 1 --2- 172.21.15.70:0/2853063347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74b806b980 0x7f74b8106390 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f74a8009900 tx=0x7f74a802a3f0 comp rx=0 tx=0).stop 2024-09-21T05:40:57.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.476+0000 7f74be7e4640 1 -- 172.21.15.70:0/2853063347 shutdown_connections 2024-09-21T05:40:57.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.476+0000 7f74be7e4640 1 --2- 172.21.15.70:0/2853063347 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74b81068d0 0x7f74b8108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:57.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.476+0000 7f74be7e4640 1 --2- 172.21.15.70:0/2853063347 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74b8109470 0x7f74b810b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:57.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.476+0000 7f74be7e4640 1 --2- 172.21.15.70:0/2853063347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74b806b980 0x7f74b8106390 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:57.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.476+0000 7f74be7e4640 1 -- 172.21.15.70:0/2853063347 >> 172.21.15.70:0/2853063347 conn(0x7f74b80fdfb0 msgr2=0x7f74b8100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:57.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.476+0000 7f74be7e4640 1 -- 172.21.15.70:0/2853063347 shutdown_connections 2024-09-21T05:40:57.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.476+0000 7f74be7e4640 1 -- 172.21.15.70:0/2853063347 wait complete. 2024-09-21T05:40:57.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.476+0000 7f74be7e4640 1 Processor -- start 2024-09-21T05:40:57.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.476+0000 7f74be7e4640 1 -- start start 2024-09-21T05:40:57.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.477+0000 7f74be7e4640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74b806b980 0x7f74b81039c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:57.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.477+0000 7f74be7e4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74b81068d0 0x7f74b8102290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:57.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.477+0000 7f74be7e4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74b8109470 0x7f74b81027d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:57.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.477+0000 7f74be7e4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f74b810f360 con 0x7f74b81068d0 2024-09-21T05:40:57.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.477+0000 7f74be7e4640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f74b810f1e0 con 0x7f74b806b980 2024-09-21T05:40:57.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.477+0000 7f74be7e4640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f74b810f4e0 con 0x7f74b8109470 2024-09-21T05:40:57.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.477+0000 7f74b77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74b81068d0 0x7f74b8102290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:57.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.477+0000 7f74b77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74b81068d0 0x7f74b8102290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37720/0 (socket says 172.21.15.70:37720) 2024-09-21T05:40:57.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.477+0000 7f74b77fe640 1 -- 172.21.15.70:0/2617127699 learned_addr learned my addr 172.21.15.70:0/2617127699 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:40:57.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.477+0000 7f74b7fff640 1 --2- 172.21.15.70:0/2617127699 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74b806b980 0x7f74b81039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:57.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.477+0000 7f74bcd81640 1 --2- 172.21.15.70:0/2617127699 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74b8109470 0x7f74b81027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:57.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.477+0000 7f74b77fe640 1 -- 172.21.15.70:0/2617127699 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74b8109470 msgr2=0x7f74b81027d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:57.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.477+0000 7f74b77fe640 1 --2- 172.21.15.70:0/2617127699 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74b8109470 0x7f74b81027d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:57.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.477+0000 7f74b77fe640 1 -- 172.21.15.70:0/2617127699 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74b806b980 msgr2=0x7f74b81039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:57.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.477+0000 7f74b77fe640 1 --2- 172.21.15.70:0/2617127699 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74b806b980 0x7f74b81039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:57.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.477+0000 7f74b77fe640 1 -- 172.21.15.70:0/2617127699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b8102e40 con 0x7f74b81068d0 2024-09-21T05:40:57.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.478+0000 7f74b77fe640 1 --2- 172.21.15.70:0/2617127699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74b81068d0 0x7f74b8102290 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f74ac00c920 tx=0x7f74ac00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:57.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.478+0000 7f74b57fa640 1 -- 172.21.15.70:0/2617127699 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ac007c70 con 0x7f74b81068d0 2024-09-21T05:40:57.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.478+0000 7f74b57fa640 1 -- 172.21.15.70:0/2617127699 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f74ac007e10 con 0x7f74b81068d0 2024-09-21T05:40:57.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.478+0000 7f74b57fa640 1 -- 172.21.15.70:0/2617127699 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ac0187b0 con 0x7f74b81068d0 2024-09-21T05:40:57.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.478+0000 7f74be7e4640 1 -- 172.21.15.70:0/2617127699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74b81a3fc0 con 0x7f74b81068d0 2024-09-21T05:40:57.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.478+0000 7f74be7e4640 1 -- 172.21.15.70:0/2617127699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74b81a4360 con 0x7f74b81068d0 2024-09-21T05:40:57.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.479+0000 7f74be7e4640 1 -- 172.21.15.70:0/2617127699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74b8106d20 con 0x7f74b81068d0 2024-09-21T05:40:57.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.481+0000 7f74b57fa640 1 -- 172.21.15.70:0/2617127699 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f74ac018970 con 0x7f74b81068d0 2024-09-21T05:40:57.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.481+0000 7f74b57fa640 1 --2- 172.21.15.70:0/2617127699 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f74a00b6500 0x7f74a00b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:57.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.481+0000 7f74b7fff640 1 --2- 172.21.15.70:0/2617127699 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f74a00b6500 0x7f74a00b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:57.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.482+0000 7f74b57fa640 1 -- 172.21.15.70:0/2617127699 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f74ac0e5970 con 0x7f74b81068d0 2024-09-21T05:40:57.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.482+0000 7f74b7fff640 1 --2- 172.21.15.70:0/2617127699 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f74a00b6500 0x7f74a00b8a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f74a8006010 tx=0x7f74a8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:57.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.484+0000 7f74b57fa640 1 -- 172.21.15.70:0/2617127699 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f74ac014030 con 0x7f74b81068d0 2024-09-21T05:40:57.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:57 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2835174946' entity='client.admin' 2024-09-21T05:40:57.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:57 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/511564051' entity='client.admin' 2024-09-21T05:40:57.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.666+0000 7f74be7e4640 1 -- 172.21.15.70:0/2617127699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f74b80ffad0 con 0x7f74b81068d0 2024-09-21T05:40:57.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.670+0000 7f74b57fa640 1 -- 172.21.15.70:0/2617127699 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v31)=0 v31) ==== 120+0+0 (secure 0 0 0) 0x7f74b80ffad0 con 0x7f74b81068d0 2024-09-21T05:40:57.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.673+0000 7f74be7e4640 1 -- 172.21.15.70:0/2617127699 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f74a00b6500 msgr2=0x7f74a00b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:57.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.673+0000 7f74be7e4640 1 --2- 172.21.15.70:0/2617127699 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f74a00b6500 0x7f74a00b8a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f74a8006010 tx=0x7f74a8000bc0 comp rx=0 tx=0).stop 2024-09-21T05:40:57.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.673+0000 7f74be7e4640 1 -- 172.21.15.70:0/2617127699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74b81068d0 msgr2=0x7f74b8102290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:57.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.673+0000 7f74be7e4640 1 --2- 172.21.15.70:0/2617127699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74b81068d0 0x7f74b8102290 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f74ac00c920 tx=0x7f74ac00cde0 comp rx=0 tx=0).stop 2024-09-21T05:40:57.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.673+0000 7f74be7e4640 1 -- 172.21.15.70:0/2617127699 shutdown_connections 2024-09-21T05:40:57.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.673+0000 7f74be7e4640 1 --2- 172.21.15.70:0/2617127699 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f74a00b6500 0x7f74a00b8a10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:57.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.673+0000 7f74be7e4640 1 --2- 172.21.15.70:0/2617127699 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74b8109470 0x7f74b81027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:57.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.673+0000 7f74be7e4640 1 --2- 172.21.15.70:0/2617127699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74b81068d0 0x7f74b8102290 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:57.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.673+0000 7f74be7e4640 1 --2- 172.21.15.70:0/2617127699 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74b806b980 0x7f74b81039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:57.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.673+0000 7f74be7e4640 1 -- 172.21.15.70:0/2617127699 >> 172.21.15.70:0/2617127699 conn(0x7f74b80fdfb0 msgr2=0x7f74b8104d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:57.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.673+0000 7f74be7e4640 1 -- 172.21.15.70:0/2617127699 shutdown_connections 2024-09-21T05:40:57.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.673+0000 7f74be7e4640 1 -- 172.21.15.70:0/2617127699 wait complete. 2024-09-21T05:40:57.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.698+0000 7fb79bb91640 1 -- 172.21.15.70:0/1903878912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb794102580 msgr2=0x7fb794108d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:57.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.698+0000 7fb79bb91640 1 --2- 172.21.15.70:0/1903878912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb794102580 0x7fb794108d60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb784009900 tx=0x7fb78402a410 comp rx=0 tx=0).stop 2024-09-21T05:40:57.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.699+0000 7fb79bb91640 1 -- 172.21.15.70:0/1903878912 shutdown_connections 2024-09-21T05:40:57.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.699+0000 7fb79bb91640 1 --2- 172.21.15.70:0/1903878912 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7941094a0 0x7fb79410b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:57.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.699+0000 7fb79bb91640 1 --2- 172.21.15.70:0/1903878912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb794102580 0x7fb794108d60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:57.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.699+0000 7fb79bb91640 1 --2- 172.21.15.70:0/1903878912 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb794101b50 0x7fb794101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:57.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.699+0000 7fb79bb91640 1 -- 172.21.15.70:0/1903878912 >> 172.21.15.70:0/1903878912 conn(0x7fb7940fd7a0 msgr2=0x7fb7940ffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:57.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.699+0000 7fb79bb91640 1 -- 172.21.15.70:0/1903878912 shutdown_connections 2024-09-21T05:40:57.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.699+0000 7fb79bb91640 1 -- 172.21.15.70:0/1903878912 wait complete. 2024-09-21T05:40:57.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.700+0000 7fb79bb91640 1 Processor -- start 2024-09-21T05:40:57.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.700+0000 7fb79bb91640 1 -- start start 2024-09-21T05:40:57.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.700+0000 7fb79bb91640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb794101b50 0x7fb794199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:57.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.700+0000 7fb79bb91640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb794102580 0x7fb79419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:57.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.700+0000 7fb79bb91640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7941094a0 0x7fb79419b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:57.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.700+0000 7fb79bb91640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb79410f390 con 0x7fb794102580 2024-09-21T05:40:57.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.700+0000 7fb79bb91640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb79410f210 con 0x7fb794101b50 2024-09-21T05:40:57.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.700+0000 7fb79bb91640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb79410f510 con 0x7fb7941094a0 2024-09-21T05:40:57.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.700+0000 7fb79912c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb794102580 0x7fb79419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:57.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.700+0000 7fb79912c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb794102580 0x7fb79419a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37738/0 (socket says 172.21.15.70:37738) 2024-09-21T05:40:57.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.700+0000 7fb79912c640 1 -- 172.21.15.70:0/2552192802 learned_addr learned my addr 172.21.15.70:0/2552192802 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:40:57.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.700+0000 7fb79992d640 1 --2- 172.21.15.70:0/2552192802 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb794101b50 0x7fb794199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:57.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.700+0000 7fb79a12e640 1 --2- 172.21.15.70:0/2552192802 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7941094a0 0x7fb79419b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:57.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.701+0000 7fb79912c640 1 -- 172.21.15.70:0/2552192802 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7941094a0 msgr2=0x7fb79419b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:57.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.701+0000 7fb79912c640 1 --2- 172.21.15.70:0/2552192802 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7941094a0 0x7fb79419b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:57.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.701+0000 7fb79912c640 1 -- 172.21.15.70:0/2552192802 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb794101b50 msgr2=0x7fb794199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:57.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.701+0000 7fb79912c640 1 --2- 172.21.15.70:0/2552192802 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb794101b50 0x7fb794199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:57.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.701+0000 7fb79912c640 1 -- 172.21.15.70:0/2552192802 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb79419b9e0 con 0x7fb794102580 2024-09-21T05:40:57.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.701+0000 7fb79992d640 1 --2- 172.21.15.70:0/2552192802 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb794101b50 0x7fb794199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:40:57.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.701+0000 7fb79912c640 1 --2- 172.21.15.70:0/2552192802 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb794102580 0x7fb79419a620 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb7840314b0 tx=0x7fb7840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:57.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.701+0000 7fb78affd640 1 -- 172.21.15.70:0/2552192802 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78403f030 con 0x7fb794102580 2024-09-21T05:40:57.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.701+0000 7fb79bb91640 1 -- 172.21.15.70:0/2552192802 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb79419bc70 con 0x7fb794102580 2024-09-21T05:40:57.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.701+0000 7fb78affd640 1 -- 172.21.15.70:0/2552192802 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fb784003cb0 con 0x7fb794102580 2024-09-21T05:40:57.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.701+0000 7fb78affd640 1 -- 172.21.15.70:0/2552192802 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb784035070 con 0x7fb794102580 2024-09-21T05:40:57.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.701+0000 7fb79bb91640 1 -- 172.21.15.70:0/2552192802 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7941a2200 con 0x7fb794102580 2024-09-21T05:40:57.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.702+0000 7fb79bb91640 1 -- 172.21.15.70:0/2552192802 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7940ff2c0 con 0x7fb794102580 2024-09-21T05:40:57.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.704+0000 7fb78affd640 1 -- 172.21.15.70:0/2552192802 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fb784042030 con 0x7fb794102580 2024-09-21T05:40:57.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.705+0000 7fb78affd640 1 --2- 172.21.15.70:0/2552192802 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb7800b6480 0x7fb7800b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:57.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.705+0000 7fb79992d640 1 --2- 172.21.15.70:0/2552192802 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb7800b6480 0x7fb7800b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:57.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.705+0000 7fb78affd640 1 -- 172.21.15.70:0/2552192802 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb784106000 con 0x7fb794102580 2024-09-21T05:40:57.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.706+0000 7fb79992d640 1 --2- 172.21.15.70:0/2552192802 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb7800b6480 0x7fb7800b8990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb79000bfd0 tx=0x7fb79000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:57.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.709+0000 7fb78affd640 1 -- 172.21.15.70:0/2552192802 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb7840ce4c0 con 0x7fb794102580 2024-09-21T05:40:57.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.888+0000 7fb79bb91640 1 -- 172.21.15.70:0/2552192802 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7fb79402e640 con 0x7fb794102580 2024-09-21T05:40:57.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.888+0000 7fb78affd640 1 -- 172.21.15.70:0/2552192802 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v31)=0 v31) ==== 108+0+0 (secure 0 0 0) 0x7fb7840d28a0 con 0x7fb794102580 2024-09-21T05:40:57.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.890+0000 7fb79bb91640 1 -- 172.21.15.70:0/2552192802 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb7800b6480 msgr2=0x7fb7800b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:57.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.890+0000 7fb79bb91640 1 --2- 172.21.15.70:0/2552192802 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb7800b6480 0x7fb7800b8990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb79000bfd0 tx=0x7fb79000b390 comp rx=0 tx=0).stop 2024-09-21T05:40:57.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.890+0000 7fb79bb91640 1 -- 172.21.15.70:0/2552192802 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb794102580 msgr2=0x7fb79419a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:57.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.890+0000 7fb79bb91640 1 --2- 172.21.15.70:0/2552192802 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb794102580 0x7fb79419a620 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb7840314b0 tx=0x7fb7840042f0 comp rx=0 tx=0).stop 2024-09-21T05:40:57.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.890+0000 7fb79bb91640 1 -- 172.21.15.70:0/2552192802 shutdown_connections 2024-09-21T05:40:57.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.890+0000 7fb79bb91640 1 --2- 172.21.15.70:0/2552192802 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb7800b6480 0x7fb7800b8990 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:57.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.890+0000 7fb79bb91640 1 --2- 172.21.15.70:0/2552192802 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7941094a0 0x7fb79419b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:57.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.890+0000 7fb79bb91640 1 --2- 172.21.15.70:0/2552192802 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb794102580 0x7fb79419a620 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:57.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.890+0000 7fb79bb91640 1 --2- 172.21.15.70:0/2552192802 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb794101b50 0x7fb794199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:57.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.890+0000 7fb79bb91640 1 -- 172.21.15.70:0/2552192802 >> 172.21.15.70:0/2552192802 conn(0x7fb7940fd7a0 msgr2=0x7fb794107830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:57.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.891+0000 7fb79bb91640 1 -- 172.21.15.70:0/2552192802 shutdown_connections 2024-09-21T05:40:57.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:57.891+0000 7fb79bb91640 1 -- 172.21.15.70:0/2552192802 wait complete. 2024-09-21T05:40:58.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:58 smithi160 ceph-mon[33979]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:58.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:40:58 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2617127699' entity='client.admin' 2024-09-21T05:40:58.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:58 smithi070 ceph-mon[30981]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:58.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:40:58 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2617127699' entity='client.admin' 2024-09-21T05:40:58.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:58 smithi116 ceph-mon[34332]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:40:58.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:40:58 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2617127699' entity='client.admin' 2024-09-21T05:40:58.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.812+0000 7f897b63b640 1 -- 172.21.15.70:0/157241053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8974103750 msgr2=0x7f8974103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:58.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.812+0000 7f897b63b640 1 --2- 172.21.15.70:0/157241053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8974103750 0x7f8974103bc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8964009ca0 tx=0x7f896402a950 comp rx=0 tx=0).stop 2024-09-21T05:40:58.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.812+0000 7f897b63b640 1 -- 172.21.15.70:0/157241053 shutdown_connections 2024-09-21T05:40:58.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.812+0000 7f897b63b640 1 --2- 172.21.15.70:0/157241053 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8974105180 0x7f897410bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:58.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.812+0000 7f897b63b640 1 --2- 172.21.15.70:0/157241053 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89741047e0 0x7f8974104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:58.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.812+0000 7f897b63b640 1 --2- 172.21.15.70:0/157241053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8974103750 0x7f8974103bc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:58.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.812+0000 7f897b63b640 1 -- 172.21.15.70:0/157241053 >> 172.21.15.70:0/157241053 conn(0x7f89740ff0c0 msgr2=0x7f8974101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:58.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.812+0000 7f897b63b640 1 -- 172.21.15.70:0/157241053 shutdown_connections 2024-09-21T05:40:58.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.812+0000 7f897b63b640 1 -- 172.21.15.70:0/157241053 wait complete. 2024-09-21T05:40:58.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.812+0000 7f897b63b640 1 Processor -- start 2024-09-21T05:40:58.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.812+0000 7f897b63b640 1 -- start start 2024-09-21T05:40:58.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.813+0000 7f897b63b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8974103750 0x7f8974199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:58.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.813+0000 7f897b63b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89741047e0 0x7f897419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:58.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.813+0000 7f897b63b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8974105180 0x7f897419b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:58.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.813+0000 7f897b63b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f897410f380 con 0x7f8974103750 2024-09-21T05:40:58.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.813+0000 7f897b63b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f897410f200 con 0x7f8974105180 2024-09-21T05:40:58.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.813+0000 7f897b63b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f897410f500 con 0x7f89741047e0 2024-09-21T05:40:58.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.813+0000 7f89793d7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8974103750 0x7f8974199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:58.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.813+0000 7f89793d7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8974103750 0x7f8974199f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37758/0 (socket says 172.21.15.70:37758) 2024-09-21T05:40:58.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.813+0000 7f89793d7640 1 -- 172.21.15.70:0/1629394573 learned_addr learned my addr 172.21.15.70:0/1629394573 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:40:58.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.813+0000 7f8979bd8640 1 --2- 172.21.15.70:0/1629394573 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8974105180 0x7f897419b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:58.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.813+0000 7f8978bd6640 1 --2- 172.21.15.70:0/1629394573 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89741047e0 0x7f897419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:58.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.813+0000 7f89793d7640 1 -- 172.21.15.70:0/1629394573 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89741047e0 msgr2=0x7f897419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:58.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.813+0000 7f89793d7640 1 --2- 172.21.15.70:0/1629394573 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89741047e0 0x7f897419a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:58.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.813+0000 7f89793d7640 1 -- 172.21.15.70:0/1629394573 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8974105180 msgr2=0x7f897419b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:58.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.813+0000 7f89793d7640 1 --2- 172.21.15.70:0/1629394573 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8974105180 0x7f897419b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:58.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.813+0000 7f89793d7640 1 -- 172.21.15.70:0/1629394573 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f897419b8f0 con 0x7f8974103750 2024-09-21T05:40:58.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.813+0000 7f8979bd8640 1 --2- 172.21.15.70:0/1629394573 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8974105180 0x7f897419b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:40:58.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.813+0000 7f89793d7640 1 --2- 172.21.15.70:0/1629394573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8974103750 0x7f8974199f50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8964000f80 tx=0x7f8964031f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:58.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.813+0000 7f89727fc640 1 -- 172.21.15.70:0/1629394573 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8964034040 con 0x7f8974103750 2024-09-21T05:40:58.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.814+0000 7f89727fc640 1 -- 172.21.15.70:0/1629394573 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f89640308f0 con 0x7f8974103750 2024-09-21T05:40:58.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.814+0000 7f897b63b640 1 -- 172.21.15.70:0/1629394573 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f897419bb80 con 0x7f8974103750 2024-09-21T05:40:58.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.814+0000 7f89727fc640 1 -- 172.21.15.70:0/1629394573 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89640456e0 con 0x7f8974103750 2024-09-21T05:40:58.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.814+0000 7f897b63b640 1 -- 172.21.15.70:0/1629394573 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89741a21a0 con 0x7f8974103750 2024-09-21T05:40:58.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.815+0000 7f897b63b640 1 -- 172.21.15.70:0/1629394573 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f897410a930 con 0x7f8974103750 2024-09-21T05:40:58.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.816+0000 7f89727fc640 1 -- 172.21.15.70:0/1629394573 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f8964037020 con 0x7f8974103750 2024-09-21T05:40:58.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.817+0000 7f89727fc640 1 --2- 172.21.15.70:0/1629394573 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f895c0b6500 0x7f895c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:58.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.817+0000 7f8978bd6640 1 --2- 172.21.15.70:0/1629394573 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f895c0b6500 0x7f895c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:58.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.817+0000 7f89727fc640 1 -- 172.21.15.70:0/1629394573 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8964106940 con 0x7f8974103750 2024-09-21T05:40:58.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.817+0000 7f8978bd6640 1 --2- 172.21.15.70:0/1629394573 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f895c0b6500 0x7f895c0b8a10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8968005e10 tx=0x7f8968005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:58.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.820+0000 7f89727fc640 1 -- 172.21.15.70:0/1629394573 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8964083710 con 0x7f8974103750 2024-09-21T05:40:58.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.986+0000 7fc7364c8640 1 -- 172.21.15.70:0/2572115880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc730104070 msgr2=0x7fc73010aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:58.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.986+0000 7fc7364c8640 1 --2- 172.21.15.70:0/2572115880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc730104070 0x7fc73010aa10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc728009ca0 tx=0x7fc72802a950 comp rx=0 tx=0).stop 2024-09-21T05:40:58.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.986+0000 7fc7364c8640 1 -- 172.21.15.70:0/2572115880 shutdown_connections 2024-09-21T05:40:58.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.986+0000 7fc7364c8640 1 --2- 172.21.15.70:0/2572115880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7301036d0 0x7fc730103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:58.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.986+0000 7fc7364c8640 1 --2- 172.21.15.70:0/2572115880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc730104070 0x7fc73010aa10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:58.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.986+0000 7fc7364c8640 1 --2- 172.21.15.70:0/2572115880 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc730102640 0x7fc730102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:58.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.986+0000 7fc7364c8640 1 -- 172.21.15.70:0/2572115880 >> 172.21.15.70:0/2572115880 conn(0x7fc7300fdfb0 msgr2=0x7fc730100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:58.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.986+0000 7fc7364c8640 1 -- 172.21.15.70:0/2572115880 shutdown_connections 2024-09-21T05:40:58.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.986+0000 7fc7364c8640 1 -- 172.21.15.70:0/2572115880 wait complete. 2024-09-21T05:40:58.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.987+0000 7fc7364c8640 1 Processor -- start 2024-09-21T05:40:58.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.987+0000 7fc7364c8640 1 -- start start 2024-09-21T05:40:58.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.987+0000 7fc7364c8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc730102640 0x7fc730198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:58.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.987+0000 7fc7364c8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7301036d0 0x7fc7301994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:58.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.987+0000 7fc7364c8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc730104070 0x7fc73019a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:58.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.987+0000 7fc7364c8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc73010e270 con 0x7fc730102640 2024-09-21T05:40:58.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.987+0000 7fc7364c8640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc73010e0f0 con 0x7fc730104070 2024-09-21T05:40:58.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.987+0000 7fc7364c8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc73010e3f0 con 0x7fc7301036d0 2024-09-21T05:40:58.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.987+0000 7fc72ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc730102640 0x7fc730198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:58.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.987+0000 7fc72ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc730102640 0x7fc730198e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37778/0 (socket says 172.21.15.70:37778) 2024-09-21T05:40:58.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.987+0000 7fc72ffff640 1 -- 172.21.15.70:0/1496215182 learned_addr learned my addr 172.21.15.70:0/1496215182 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:40:58.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.988+0000 7fc727fff640 1 --2- 172.21.15.70:0/1496215182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7301036d0 0x7fc7301994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:58.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.988+0000 7fc734a65640 1 --2- 172.21.15.70:0/1496215182 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc730104070 0x7fc73019a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:58.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.988+0000 7fc72ffff640 1 -- 172.21.15.70:0/1496215182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7301036d0 msgr2=0x7fc7301994d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:58.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.988+0000 7fc72ffff640 1 --2- 172.21.15.70:0/1496215182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7301036d0 0x7fc7301994d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:58.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.988+0000 7fc72ffff640 1 -- 172.21.15.70:0/1496215182 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc730104070 msgr2=0x7fc73019a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:58.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.988+0000 7fc72ffff640 1 --2- 172.21.15.70:0/1496215182 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc730104070 0x7fc73019a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:58.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.988+0000 7fc72ffff640 1 -- 172.21.15.70:0/1496215182 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc73019a890 con 0x7fc730102640 2024-09-21T05:40:58.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.988+0000 7fc72ffff640 1 --2- 172.21.15.70:0/1496215182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc730102640 0x7fc730198e60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc72000eb00 tx=0x7fc720009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:58.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.988+0000 7fc72dffb640 1 -- 172.21.15.70:0/1496215182 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc72001c070 con 0x7fc730102640 2024-09-21T05:40:58.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.988+0000 7fc7364c8640 1 -- 172.21.15.70:0/1496215182 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc73019ab80 con 0x7fc730102640 2024-09-21T05:40:58.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.988+0000 7fc72dffb640 1 -- 172.21.15.70:0/1496215182 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fc72000bc30 con 0x7fc730102640 2024-09-21T05:40:58.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.988+0000 7fc72dffb640 1 -- 172.21.15.70:0/1496215182 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc720016610 con 0x7fc730102640 2024-09-21T05:40:58.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.988+0000 7fc7364c8640 1 -- 172.21.15.70:0/1496215182 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc73006b030 con 0x7fc730102640 2024-09-21T05:40:58.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.989+0000 7fc7364c8640 1 -- 172.21.15.70:0/1496215182 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc730102ab0 con 0x7fc730102640 2024-09-21T05:40:58.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.992+0000 7fc72dffb640 1 -- 172.21.15.70:0/1496215182 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fc72001f070 con 0x7fc730102640 2024-09-21T05:40:58.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.993+0000 7fc72dffb640 1 --2- 172.21.15.70:0/1496215182 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc71c0b6480 0x7fc71c0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:40:58.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.993+0000 7fc727fff640 1 --2- 172.21.15.70:0/1496215182 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc71c0b6480 0x7fc71c0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:40:58.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.993+0000 7fc72dffb640 1 -- 172.21.15.70:0/1496215182 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc7200e6e90 con 0x7fc730102640 2024-09-21T05:40:58.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.993+0000 7fc727fff640 1 --2- 172.21.15.70:0/1496215182 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc71c0b6480 0x7fc71c0b8990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc718009b60 tx=0x7fc718005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:40:58.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:58.995+0000 7fc72dffb640 1 -- 172.21.15.70:0/1496215182 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc72000bde0 con 0x7fc730102640 2024-09-21T05:40:59.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:59.010+0000 7f897b63b640 1 -- 172.21.15.70:0/1629394573 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f897402e640 con 0x7f8974103750 2024-09-21T05:40:59.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:59.015+0000 7f89727fc640 1 -- 172.21.15.70:0/1629394573 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v32)=0 v32) ==== 121+0+0 (secure 0 0 0) 0x7f89640ceea0 con 0x7f8974103750 2024-09-21T05:40:59.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:59.017+0000 7f897b63b640 1 -- 172.21.15.70:0/1629394573 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f895c0b6500 msgr2=0x7f895c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:59.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:59.017+0000 7f897b63b640 1 --2- 172.21.15.70:0/1629394573 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f895c0b6500 0x7f895c0b8a10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8968005e10 tx=0x7f8968005da0 comp rx=0 tx=0).stop 2024-09-21T05:40:59.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:59.017+0000 7f897b63b640 1 -- 172.21.15.70:0/1629394573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8974103750 msgr2=0x7f8974199f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:59.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:59.017+0000 7f897b63b640 1 --2- 172.21.15.70:0/1629394573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8974103750 0x7f8974199f50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8964000f80 tx=0x7f8964031f50 comp rx=0 tx=0).stop 2024-09-21T05:40:59.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:59.017+0000 7f897b63b640 1 -- 172.21.15.70:0/1629394573 shutdown_connections 2024-09-21T05:40:59.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:59.017+0000 7f897b63b640 1 --2- 172.21.15.70:0/1629394573 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f895c0b6500 0x7f895c0b8a10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:59.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:59.017+0000 7f897b63b640 1 --2- 172.21.15.70:0/1629394573 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89741047e0 0x7f897419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:59.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:59.017+0000 7f897b63b640 1 --2- 172.21.15.70:0/1629394573 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8974105180 0x7f897419b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:59.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:59.017+0000 7f897b63b640 1 --2- 172.21.15.70:0/1629394573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8974103750 0x7f8974199f50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:59.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:59.017+0000 7f897b63b640 1 -- 172.21.15.70:0/1629394573 >> 172.21.15.70:0/1629394573 conn(0x7f89740ff0c0 msgr2=0x7f8974107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:59.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:59.018+0000 7f897b63b640 1 -- 172.21.15.70:0/1629394573 shutdown_connections 2024-09-21T05:40:59.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:59.018+0000 7f897b63b640 1 -- 172.21.15.70:0/1629394573 wait complete. 2024-09-21T05:40:59.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:59.192+0000 7fc7364c8640 1 -- 172.21.15.70:0/1496215182 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fc73006bb10 con 0x7fc730102640 2024-09-21T05:40:59.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:59.196+0000 7fc72dffb640 1 -- 172.21.15.70:0/1496215182 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v33)=0 v33) ==== 120+0+0 (secure 0 0 0) 0x7fc7200af3f0 con 0x7fc730102640 2024-09-21T05:40:59.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:59.199+0000 7fc7364c8640 1 -- 172.21.15.70:0/1496215182 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc71c0b6480 msgr2=0x7fc71c0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:59.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:59.199+0000 7fc7364c8640 1 --2- 172.21.15.70:0/1496215182 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc71c0b6480 0x7fc71c0b8990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc718009b60 tx=0x7fc718005f90 comp rx=0 tx=0).stop 2024-09-21T05:40:59.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:59.199+0000 7fc7364c8640 1 -- 172.21.15.70:0/1496215182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc730102640 msgr2=0x7fc730198e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:40:59.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:59.199+0000 7fc7364c8640 1 --2- 172.21.15.70:0/1496215182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc730102640 0x7fc730198e60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc72000eb00 tx=0x7fc720009f20 comp rx=0 tx=0).stop 2024-09-21T05:40:59.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:59.199+0000 7fc7364c8640 1 -- 172.21.15.70:0/1496215182 shutdown_connections 2024-09-21T05:40:59.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:59.199+0000 7fc7364c8640 1 --2- 172.21.15.70:0/1496215182 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc71c0b6480 0x7fc71c0b8990 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:59.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:59.199+0000 7fc7364c8640 1 --2- 172.21.15.70:0/1496215182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7301036d0 0x7fc7301994d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:59.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:59.199+0000 7fc7364c8640 1 --2- 172.21.15.70:0/1496215182 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc730104070 0x7fc73019a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:59.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:59.199+0000 7fc7364c8640 1 --2- 172.21.15.70:0/1496215182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc730102640 0x7fc730198e60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:40:59.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:59.199+0000 7fc7364c8640 1 -- 172.21.15.70:0/1496215182 >> 172.21.15.70:0/1496215182 conn(0x7fc7300fdfb0 msgr2=0x7fc7301069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:40:59.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:59.199+0000 7fc7364c8640 1 -- 172.21.15.70:0/1496215182 shutdown_connections 2024-09-21T05:40:59.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:40:59.199+0000 7fc7364c8640 1 -- 172.21.15.70:0/1496215182 wait complete. 2024-09-21T05:40:59.719 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96c6636e-77db-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi070') 2024-09-21T05:41:00.207 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:00 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1629394573' entity='client.admin' 2024-09-21T05:41:00.207 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:00 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1496215182' entity='client.admin' 2024-09-21T05:41:00.207 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:00 smithi070 ceph-mon[30981]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:00.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:00 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1629394573' entity='client.admin' 2024-09-21T05:41:00.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:00 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1496215182' entity='client.admin' 2024-09-21T05:41:00.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:00 smithi116 ceph-mon[34332]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:00.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:00 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1629394573' entity='client.admin' 2024-09-21T05:41:00.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:00 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1496215182' entity='client.admin' 2024-09-21T05:41:00.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:00 smithi160 ceph-mon[33979]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:01.669 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:01 smithi070 ceph-mon[30981]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:01.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:01 smithi116 ceph-mon[34332]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:01.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:01 smithi160 ceph-mon[33979]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:02.252 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96c6636e-77db-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi070') 2024-09-21T05:41:02.252 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96c6636e-77db-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi070') 2024-09-21T05:41:02.252 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96c6636e-77db-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi070') 2024-09-21T05:41:02.253 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96c6636e-77db-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi070') 2024-09-21T05:41:02.253 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96c6636e-77db-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi070') 2024-09-21T05:41:02.253 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96c6636e-77db-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi070') 2024-09-21T05:41:02.253 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96c6636e-77db-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi070') 2024-09-21T05:41:02.253 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96c6636e-77db-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi070') 2024-09-21T05:41:02.253 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96c6636e-77db-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi070') 2024-09-21T05:41:02.628 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96c6636e-77db-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi070') 2024-09-21T05:41:02.628 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph config dump 2024-09-21T05:41:02.873 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:41:03.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.283+0000 7f32e9752640 1 -- 172.21.15.70:0/3729983004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32e4104080 msgr2=0x7f32e410aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:41:03.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.283+0000 7f32e9752640 1 --2- 172.21.15.70:0/3729983004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32e4104080 0x7f32e410aa20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f32dc009ca0 tx=0x7f32dc02a950 comp rx=0 tx=0).stop 2024-09-21T05:41:03.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.283+0000 7f32e9752640 1 -- 172.21.15.70:0/3729983004 shutdown_connections 2024-09-21T05:41:03.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.283+0000 7f32e9752640 1 --2- 172.21.15.70:0/3729983004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32e4104080 0x7f32e410aa20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:41:03.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.283+0000 7f32e9752640 1 --2- 172.21.15.70:0/3729983004 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32e41036e0 0x7f32e4103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:41:03.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.283+0000 7f32e9752640 1 --2- 172.21.15.70:0/3729983004 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32e4102650 0x7f32e4102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:41:03.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.283+0000 7f32e9752640 1 -- 172.21.15.70:0/3729983004 >> 172.21.15.70:0/3729983004 conn(0x7f32e40fdfe0 msgr2=0x7f32e4100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:41:03.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.283+0000 7f32e9752640 1 -- 172.21.15.70:0/3729983004 shutdown_connections 2024-09-21T05:41:03.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.283+0000 7f32e9752640 1 -- 172.21.15.70:0/3729983004 wait complete. 2024-09-21T05:41:03.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.283+0000 7f32e9752640 1 Processor -- start 2024-09-21T05:41:03.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.284+0000 7f32e9752640 1 -- start start 2024-09-21T05:41:03.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.284+0000 7f32e9752640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32e4102650 0x7f32e4198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:41:03.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.284+0000 7f32e9752640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32e41036e0 0x7f32e41994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:41:03.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.284+0000 7f32e9752640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32e4104080 0x7f32e419a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:41:03.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.284+0000 7f32e9752640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f32e410e280 con 0x7f32e4104080 2024-09-21T05:41:03.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.284+0000 7f32e9752640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f32e410e100 con 0x7f32e41036e0 2024-09-21T05:41:03.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.284+0000 7f32e9752640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f32e410e400 con 0x7f32e4102650 2024-09-21T05:41:03.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.284+0000 7f32e37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32e4104080 0x7f32e419a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:41:03.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.284+0000 7f32e37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32e4104080 0x7f32e419a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46434/0 (socket says 172.21.15.70:46434) 2024-09-21T05:41:03.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.284+0000 7f32e37fe640 1 -- 172.21.15.70:0/942360307 learned_addr learned my addr 172.21.15.70:0/942360307 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:41:03.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.284+0000 7f32e27fc640 1 --2- 172.21.15.70:0/942360307 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32e41036e0 0x7f32e41994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:41:03.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.284+0000 7f32e2ffd640 1 --2- 172.21.15.70:0/942360307 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32e4102650 0x7f32e4198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:41:03.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.284+0000 7f32e37fe640 1 -- 172.21.15.70:0/942360307 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32e4102650 msgr2=0x7f32e4198e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:41:03.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.284+0000 7f32e37fe640 1 --2- 172.21.15.70:0/942360307 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32e4102650 0x7f32e4198e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:41:03.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.284+0000 7f32e37fe640 1 -- 172.21.15.70:0/942360307 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32e41036e0 msgr2=0x7f32e41994f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:41:03.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.284+0000 7f32e37fe640 1 --2- 172.21.15.70:0/942360307 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32e41036e0 0x7f32e41994f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:41:03.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.284+0000 7f32e37fe640 1 -- 172.21.15.70:0/942360307 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e419a8b0 con 0x7f32e4104080 2024-09-21T05:41:03.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.284+0000 7f32e37fe640 1 --2- 172.21.15.70:0/942360307 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32e4104080 0x7f32e419a090 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f32dc02ae70 tx=0x7f32dc031d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:41:03.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.285+0000 7f32cbfff640 1 -- 172.21.15.70:0/942360307 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc034040 con 0x7f32e4104080 2024-09-21T05:41:03.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.285+0000 7f32cbfff640 1 -- 172.21.15.70:0/942360307 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f32dc0308f0 con 0x7f32e4104080 2024-09-21T05:41:03.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.285+0000 7f32e9752640 1 -- 172.21.15.70:0/942360307 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32e419ab40 con 0x7f32e4104080 2024-09-21T05:41:03.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.285+0000 7f32cbfff640 1 -- 172.21.15.70:0/942360307 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc004760 con 0x7f32e4104080 2024-09-21T05:41:03.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.285+0000 7f32e9752640 1 -- 172.21.15.70:0/942360307 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32e41a12a0 con 0x7f32e4104080 2024-09-21T05:41:03.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.286+0000 7f32e9752640 1 -- 172.21.15.70:0/942360307 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32e4109830 con 0x7f32e4104080 2024-09-21T05:41:03.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.287+0000 7f32cbfff640 1 -- 172.21.15.70:0/942360307 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f32dc037020 con 0x7f32e4104080 2024-09-21T05:41:03.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.288+0000 7f32cbfff640 1 --2- 172.21.15.70:0/942360307 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f32cc0b6500 0x7f32cc0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:41:03.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.288+0000 7f32e2ffd640 1 --2- 172.21.15.70:0/942360307 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f32cc0b6500 0x7f32cc0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:41:03.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.288+0000 7f32cbfff640 1 -- 172.21.15.70:0/942360307 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f32dc1064e0 con 0x7f32e4104080 2024-09-21T05:41:03.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.288+0000 7f32e2ffd640 1 --2- 172.21.15.70:0/942360307 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f32cc0b6500 0x7f32cc0b8a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f32d4009b60 tx=0x7f32d4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:41:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.292+0000 7f32cbfff640 1 -- 172.21.15.70:0/942360307 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f32dc0cea40 con 0x7f32e4104080 2024-09-21T05:41:03.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.477+0000 7f32e9752640 1 -- 172.21.15.70:0/942360307 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f32e4063fc0 con 0x7f32e4104080 2024-09-21T05:41:03.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.478+0000 7f32cbfff640 1 -- 172.21.15.70:0/942360307 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v33) ==== 59+0+21518 (secure 0 0 0) 0x7f32dc0d2e20 con 0x7f32e4104080 2024-09-21T05:41:03.481 INFO:teuthology.orchestra.run.smithi070.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T05:41:03.481 INFO:teuthology.orchestra.run.smithi070.stdout:global dev auth_debug true 2024-09-21T05:41:03.481 INFO:teuthology.orchestra.run.smithi070.stdout:global basic container_image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 * 2024-09-21T05:41:03.481 INFO:teuthology.orchestra.run.smithi070.stdout:global dev debug_asserts_on_shutdown true 2024-09-21T05:41:03.481 INFO:teuthology.orchestra.run.smithi070.stdout:global basic log_to_file true 2024-09-21T05:41:03.481 INFO:teuthology.orchestra.run.smithi070.stdout:global basic log_to_journald false 2024-09-21T05:41:03.481 INFO:teuthology.orchestra.run.smithi070.stdout:global basic log_to_stderr false 2024-09-21T05:41:03.481 INFO:teuthology.orchestra.run.smithi070.stdout:global advanced mon_allow_pool_delete true 2024-09-21T05:41:03.481 INFO:teuthology.orchestra.run.smithi070.stdout:global advanced mon_clock_drift_allowed 1.000000 2024-09-21T05:41:03.481 INFO:teuthology.orchestra.run.smithi070.stdout:global advanced mon_cluster_log_to_file true 2024-09-21T05:41:03.481 INFO:teuthology.orchestra.run.smithi070.stdout:global advanced mon_max_pg_per_osd 10000 2024-09-21T05:41:03.482 INFO:teuthology.orchestra.run.smithi070.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2024-09-21T05:41:03.482 INFO:teuthology.orchestra.run.smithi070.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2024-09-21T05:41:03.482 INFO:teuthology.orchestra.run.smithi070.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2024-09-21T05:41:03.482 INFO:teuthology.orchestra.run.smithi070.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2024-09-21T05:41:03.482 INFO:teuthology.orchestra.run.smithi070.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2024-09-21T05:41:03.482 INFO:teuthology.orchestra.run.smithi070.stdout:global advanced mon_warn_on_too_few_osds false 2024-09-21T05:41:03.482 INFO:teuthology.orchestra.run.smithi070.stdout:global dev ms_die_on_bug true 2024-09-21T05:41:03.482 INFO:teuthology.orchestra.run.smithi070.stdout:global dev ms_die_on_old_message true 2024-09-21T05:41:03.482 INFO:teuthology.orchestra.run.smithi070.stdout:global advanced osd_pool_default_erasure_code_profile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T05:41:03.482 INFO:teuthology.orchestra.run.smithi070.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2024-09-21T05:41:03.482 INFO:teuthology.orchestra.run.smithi070.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2024-09-21T05:41:03.483 INFO:teuthology.orchestra.run.smithi070.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2024-09-21T05:41:03.483 INFO:teuthology.orchestra.run.smithi070.stdout:mon advanced auth_service_ticket_ttl 240.000000 2024-09-21T05:41:03.483 INFO:teuthology.orchestra.run.smithi070.stdout:mon advanced debug_mon 20/20 2024-09-21T05:41:03.483 INFO:teuthology.orchestra.run.smithi070.stdout:mon advanced debug_ms 1/1 2024-09-21T05:41:03.483 INFO:teuthology.orchestra.run.smithi070.stdout:mon advanced debug_paxos 20/20 2024-09-21T05:41:03.483 INFO:teuthology.orchestra.run.smithi070.stdout:mon advanced mon_data_avail_warn 5 2024-09-21T05:41:03.483 INFO:teuthology.orchestra.run.smithi070.stdout:mon advanced mon_down_mkfs_grace 300 2024-09-21T05:41:03.483 INFO:teuthology.orchestra.run.smithi070.stdout:mon advanced mon_mgr_mkfs_grace 240 2024-09-21T05:41:03.483 INFO:teuthology.orchestra.run.smithi070.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T05:41:03.483 INFO:teuthology.orchestra.run.smithi070.stdout:mon dev mon_osd_prime_pg_temp true 2024-09-21T05:41:03.483 INFO:teuthology.orchestra.run.smithi070.stdout:mon advanced mon_osd_reporter_subtree_level osd 2024-09-21T05:41:03.483 INFO:teuthology.orchestra.run.smithi070.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T05:41:03.483 INFO:teuthology.orchestra.run.smithi070.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T05:41:03.483 INFO:teuthology.orchestra.run.smithi070.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2024-09-21T05:41:03.484 INFO:teuthology.orchestra.run.smithi070.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2024-09-21T05:41:03.484 INFO:teuthology.orchestra.run.smithi070.stdout:mon advanced public_network 172.21.0.0/20 * 2024-09-21T05:41:03.484 INFO:teuthology.orchestra.run.smithi070.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2024-09-21T05:41:03.484 INFO:teuthology.orchestra.run.smithi070.stdout:mgr advanced client_mount_timeout 30 2024-09-21T05:41:03.484 INFO:teuthology.orchestra.run.smithi070.stdout:mgr advanced debug_client 20/20 2024-09-21T05:41:03.484 INFO:teuthology.orchestra.run.smithi070.stdout:mgr advanced debug_mgr 20/20 2024-09-21T05:41:03.484 INFO:teuthology.orchestra.run.smithi070.stdout:mgr advanced debug_ms 1/1 2024-09-21T05:41:03.484 INFO:teuthology.orchestra.run.smithi070.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2024-09-21T05:41:03.484 INFO:teuthology.orchestra.run.smithi070.stdout:mgr advanced mgr/cephadm/container_init True * 2024-09-21T05:41:03.484 INFO:teuthology.orchestra.run.smithi070.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2024-09-21T05:41:03.484 INFO:teuthology.orchestra.run.smithi070.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2024-09-21T05:41:03.484 INFO:teuthology.orchestra.run.smithi070.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2024-09-21T05:41:03.484 INFO:teuthology.orchestra.run.smithi070.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T05:41:03.484 INFO:teuthology.orchestra.run.smithi070.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T05:41:03.484 INFO:teuthology.orchestra.run.smithi070.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T05:41:03.485 INFO:teuthology.orchestra.run.smithi070.stdout:osd dev bdev_debug_aio true 2024-09-21T05:41:03.485 INFO:teuthology.orchestra.run.smithi070.stdout:osd dev bluestore_block_size 96636764160 * 2024-09-21T05:41:03.485 INFO:teuthology.orchestra.run.smithi070.stdout:osd advanced bluestore_compression_mode aggressive 2024-09-21T05:41:03.485 INFO:teuthology.orchestra.run.smithi070.stdout:osd dev bluestore_fsck_on_mount true 2024-09-21T05:41:03.485 INFO:teuthology.orchestra.run.smithi070.stdout:osd advanced debug_bluefs 20/20 2024-09-21T05:41:03.485 INFO:teuthology.orchestra.run.smithi070.stdout:osd advanced debug_bluestore 20/20 2024-09-21T05:41:03.485 INFO:teuthology.orchestra.run.smithi070.stdout:osd advanced debug_ms 1/1 2024-09-21T05:41:03.485 INFO:teuthology.orchestra.run.smithi070.stdout:osd advanced debug_osd 20/20 2024-09-21T05:41:03.485 INFO:teuthology.orchestra.run.smithi070.stdout:osd advanced debug_rocksdb 10/10 2024-09-21T05:41:03.485 INFO:teuthology.orchestra.run.smithi070.stdout:osd dev osd_debug_misdirected_ops true 2024-09-21T05:41:03.485 INFO:teuthology.orchestra.run.smithi070.stdout:osd dev osd_debug_op_order true 2024-09-21T05:41:03.485 INFO:teuthology.orchestra.run.smithi070.stdout:osd dev osd_debug_pg_log_writeout true 2024-09-21T05:41:03.485 INFO:teuthology.orchestra.run.smithi070.stdout:osd dev osd_debug_shutdown true 2024-09-21T05:41:03.485 INFO:teuthology.orchestra.run.smithi070.stdout:osd dev osd_debug_verify_cached_snaps true 2024-09-21T05:41:03.485 INFO:teuthology.orchestra.run.smithi070.stdout:osd dev osd_debug_verify_missing_on_start true 2024-09-21T05:41:03.486 INFO:teuthology.orchestra.run.smithi070.stdout:osd dev osd_debug_verify_stray_on_activate true 2024-09-21T05:41:03.486 INFO:teuthology.orchestra.run.smithi070.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2024-09-21T05:41:03.486 INFO:teuthology.orchestra.run.smithi070.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2024-09-21T05:41:03.486 INFO:teuthology.orchestra.run.smithi070.stdout:osd advanced osd_max_omap_entries_per_request 10000 2024-09-21T05:41:03.486 INFO:teuthology.orchestra.run.smithi070.stdout:osd advanced osd_mclock_profile high_recovery_ops 2024-09-21T05:41:03.486 INFO:teuthology.orchestra.run.smithi070.stdout:osd advanced osd_memory_target_autotune true 2024-09-21T05:41:03.486 INFO:teuthology.orchestra.run.smithi070.stdout:osd advanced osd_objectstore bluestore * 2024-09-21T05:41:03.486 INFO:teuthology.orchestra.run.smithi070.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T05:41:03.486 INFO:teuthology.orchestra.run.smithi070.stdout:osd advanced osd_op_queue debug_random * 2024-09-21T05:41:03.486 INFO:teuthology.orchestra.run.smithi070.stdout:osd advanced osd_op_queue_cut_off debug_random * 2024-09-21T05:41:03.486 INFO:teuthology.orchestra.run.smithi070.stdout:osd advanced osd_recover_clone_overlap true 2024-09-21T05:41:03.486 INFO:teuthology.orchestra.run.smithi070.stdout:osd advanced osd_recovery_max_chunk 1048576 2024-09-21T05:41:03.486 INFO:teuthology.orchestra.run.smithi070.stdout:osd advanced osd_scrub_load_threshold 5.000000 2024-09-21T05:41:03.486 INFO:teuthology.orchestra.run.smithi070.stdout:osd advanced osd_scrub_max_interval 600.000000 2024-09-21T05:41:03.487 INFO:teuthology.orchestra.run.smithi070.stdout:osd advanced osd_shutdown_pgref_assert true 2024-09-21T05:41:03.487 INFO:teuthology.orchestra.run.smithi070.stdout:mds advanced debug_mds 20/20 2024-09-21T05:41:03.487 INFO:teuthology.orchestra.run.smithi070.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T05:41:03.487 INFO:teuthology.orchestra.run.smithi070.stdout:mds advanced debug_ms 2/2 2024-09-21T05:41:03.487 INFO:teuthology.orchestra.run.smithi070.stdout:mds advanced mds_bal_fragment_size_max 10000 2024-09-21T05:41:03.487 INFO:teuthology.orchestra.run.smithi070.stdout:mds advanced mds_bal_merge_size 5 2024-09-21T05:41:03.487 INFO:teuthology.orchestra.run.smithi070.stdout:mds advanced mds_bal_replicate_threshold 1.000000 2024-09-21T05:41:03.487 INFO:teuthology.orchestra.run.smithi070.stdout:mds advanced mds_bal_split_bits 3 2024-09-21T05:41:03.487 INFO:teuthology.orchestra.run.smithi070.stdout:mds advanced mds_bal_split_size 100 2024-09-21T05:41:03.487 INFO:teuthology.orchestra.run.smithi070.stdout:mds dev mds_debug_frag true 2024-09-21T05:41:03.487 INFO:teuthology.orchestra.run.smithi070.stdout:mds dev mds_debug_scatterstat true 2024-09-21T05:41:03.487 INFO:teuthology.orchestra.run.smithi070.stdout:mds advanced mds_export_ephemeral_random_max 0.100000 2024-09-21T05:41:03.487 INFO:teuthology.orchestra.run.smithi070.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T05:41:03.487 INFO:teuthology.orchestra.run.smithi070.stdout:mds dev mds_verify_scatter true 2024-09-21T05:41:03.488 INFO:teuthology.orchestra.run.smithi070.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T05:41:03.488 INFO:teuthology.orchestra.run.smithi070.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T05:41:03.488 INFO:teuthology.orchestra.run.smithi070.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T05:41:03.488 INFO:teuthology.orchestra.run.smithi070.stdout:client advanced client_dirsize_rbytes false * 2024-09-21T05:41:03.488 INFO:teuthology.orchestra.run.smithi070.stdout:client advanced client_mount_timeout 600 2024-09-21T05:41:03.488 INFO:teuthology.orchestra.run.smithi070.stdout:client advanced debug_client 20/20 2024-09-21T05:41:03.488 INFO:teuthology.orchestra.run.smithi070.stdout:client advanced debug_ms 1/1 2024-09-21T05:41:03.488 INFO:teuthology.orchestra.run.smithi070.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T05:41:03.488 INFO:teuthology.orchestra.run.smithi070.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T05:41:03.488 INFO:teuthology.orchestra.run.smithi070.stdout:client.rgw advanced rgw_cache_enabled true 2024-09-21T05:41:03.488 INFO:teuthology.orchestra.run.smithi070.stdout:client.rgw advanced rgw_enable_ops_log true 2024-09-21T05:41:03.488 INFO:teuthology.orchestra.run.smithi070.stdout:client.rgw advanced rgw_enable_usage_log true 2024-09-21T05:41:03.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.480+0000 7f32e9752640 1 -- 172.21.15.70:0/942360307 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f32cc0b6500 msgr2=0x7f32cc0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:41:03.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.480+0000 7f32e9752640 1 --2- 172.21.15.70:0/942360307 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f32cc0b6500 0x7f32cc0b8a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f32d4009b60 tx=0x7f32d4005f90 comp rx=0 tx=0).stop 2024-09-21T05:41:03.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.480+0000 7f32e9752640 1 -- 172.21.15.70:0/942360307 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32e4104080 msgr2=0x7f32e419a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:41:03.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.480+0000 7f32e9752640 1 --2- 172.21.15.70:0/942360307 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32e4104080 0x7f32e419a090 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f32dc02ae70 tx=0x7f32dc031d30 comp rx=0 tx=0).stop 2024-09-21T05:41:03.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.480+0000 7f32e9752640 1 -- 172.21.15.70:0/942360307 shutdown_connections 2024-09-21T05:41:03.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.480+0000 7f32e9752640 1 --2- 172.21.15.70:0/942360307 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f32cc0b6500 0x7f32cc0b8a10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:41:03.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.480+0000 7f32e9752640 1 --2- 172.21.15.70:0/942360307 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32e4104080 0x7f32e419a090 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:41:03.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.480+0000 7f32e9752640 1 --2- 172.21.15.70:0/942360307 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32e41036e0 0x7f32e41994f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:41:03.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.480+0000 7f32e9752640 1 --2- 172.21.15.70:0/942360307 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32e4102650 0x7f32e4198e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:41:03.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.480+0000 7f32e9752640 1 -- 172.21.15.70:0/942360307 >> 172.21.15.70:0/942360307 conn(0x7f32e40fdfe0 msgr2=0x7f32e4106a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:41:03.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.481+0000 7f32e9752640 1 -- 172.21.15.70:0/942360307 shutdown_connections 2024-09-21T05:41:03.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:03.481+0000 7f32e9752640 1 -- 172.21.15.70:0/942360307 wait complete. 2024-09-21T05:41:03.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:03 smithi070 ceph-mon[30981]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:03.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:03 smithi116 ceph-mon[34332]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:03.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:03 smithi160 ceph-mon[33979]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:04.161 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T05:41:04.161 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-21T05:41:04.161 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T05:41:04.177 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T05:41:04.178 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_1 2024-09-21T05:41:04.233 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T05:41:04.234 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:41:04.234 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-21T05:41:04.234 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:41:04.234 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:41:04.234 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-21 05:39:50.969648266 +0000 2024-09-21T05:41:04.234 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-21 05:35:16.272167398 +0000 2024-09-21T05:41:04.234 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-21 05:35:16.272167398 +0000 2024-09-21T05:41:04.234 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-09-21 05:35:16.272167398 +0000 2024-09-21T05:41:04.234 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T05:41:04.298 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-21T05:41:04.299 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-21T05:41:04.299 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 9.4892e-05 s, 5.4 MB/s 2024-09-21T05:41:04.300 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T05:41:04.356 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_2 2024-09-21T05:41:04.412 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T05:41:04.412 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:41:04.412 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-21T05:41:04.412 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:41:04.412 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:41:04.413 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-21 05:39:51.001647326 +0000 2024-09-21T05:41:04.413 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-21 05:35:16.580158161 +0000 2024-09-21T05:41:04.413 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-21 05:35:16.580158161 +0000 2024-09-21T05:41:04.413 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-09-21 05:35:16.580158161 +0000 2024-09-21T05:41:04.413 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T05:41:04.476 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-21T05:41:04.476 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-21T05:41:04.476 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000110945 s, 4.6 MB/s 2024-09-21T05:41:04.477 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T05:41:04.534 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_3 2024-09-21T05:41:04.589 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T05:41:04.589 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:41:04.589 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-21T05:41:04.589 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:41:04.589 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:41:04.589 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-21 05:39:51.033646387 +0000 2024-09-21T05:41:04.590 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-21 05:35:16.895148714 +0000 2024-09-21T05:41:04.590 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-21 05:35:16.895148714 +0000 2024-09-21T05:41:04.590 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-09-21 05:35:16.895148714 +0000 2024-09-21T05:41:04.590 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T05:41:04.653 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-21T05:41:04.653 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-21T05:41:04.653 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000107622 s, 4.8 MB/s 2024-09-21T05:41:04.654 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T05:41:04.711 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_4 2024-09-21T05:41:04.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:04 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/942360307' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T05:41:04.759 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T05:41:04.759 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:41:04.759 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-21T05:41:04.759 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:41:04.759 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:41:04.759 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-21 05:39:51.064645477 +0000 2024-09-21T05:41:04.759 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-21 05:35:17.205139416 +0000 2024-09-21T05:41:04.759 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-21 05:35:17.205139416 +0000 2024-09-21T05:41:04.759 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-09-21 05:35:17.205139416 +0000 2024-09-21T05:41:04.760 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T05:41:04.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:04 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/942360307' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T05:41:04.822 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-21T05:41:04.822 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-21T05:41:04.822 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000108696 s, 4.7 MB/s 2024-09-21T05:41:04.824 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T05:41:04.879 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-21T05:41:04.880 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T05:41:04.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:04 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/942360307' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T05:41:04.900 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T05:41:04.900 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_1 2024-09-21T05:41:04.959 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T05:41:04.959 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:41:04.960 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-21T05:41:04.960 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:41:04.960 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:41:04.960 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-09-21 05:40:37.725603514 +0000 2024-09-21T05:41:04.960 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-21 05:35:14.576587472 +0000 2024-09-21T05:41:04.960 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-21 05:35:14.576587472 +0000 2024-09-21T05:41:04.960 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-09-21 05:35:14.576587472 +0000 2024-09-21T05:41:04.960 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T05:41:05.029 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-09-21T05:41:05.030 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-09-21T05:41:05.030 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000209676 s, 2.4 MB/s 2024-09-21T05:41:05.031 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T05:41:05.089 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_2 2024-09-21T05:41:05.147 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T05:41:05.147 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:41:05.147 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-21T05:41:05.147 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:41:05.147 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:41:05.148 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-09-21 05:40:37.725603514 +0000 2024-09-21T05:41:05.148 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-21 05:35:14.896581931 +0000 2024-09-21T05:41:05.148 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-21 05:35:14.896581931 +0000 2024-09-21T05:41:05.148 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-09-21 05:35:14.896581931 +0000 2024-09-21T05:41:05.148 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T05:41:05.213 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-09-21T05:41:05.213 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-09-21T05:41:05.213 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000185407 s, 2.8 MB/s 2024-09-21T05:41:05.215 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T05:41:05.273 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_3 2024-09-21T05:41:05.329 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T05:41:05.329 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:41:05.329 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-21T05:41:05.329 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:41:05.329 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:41:05.329 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-09-21 05:40:37.726603496 +0000 2024-09-21T05:41:05.329 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-21 05:35:15.220576320 +0000 2024-09-21T05:41:05.329 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-21 05:35:15.220576320 +0000 2024-09-21T05:41:05.330 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-09-21 05:35:15.220576320 +0000 2024-09-21T05:41:05.330 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T05:41:05.394 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-09-21T05:41:05.394 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-09-21T05:41:05.395 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000227955 s, 2.2 MB/s 2024-09-21T05:41:05.396 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T05:41:05.453 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_4 2024-09-21T05:41:05.508 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T05:41:05.509 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:41:05.509 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-21T05:41:05.509 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:41:05.509 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:41:05.509 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-09-21 05:40:37.726603496 +0000 2024-09-21T05:41:05.509 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-21 05:35:15.530570952 +0000 2024-09-21T05:41:05.509 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-21 05:35:15.530570952 +0000 2024-09-21T05:41:05.509 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-09-21 05:35:15.530570952 +0000 2024-09-21T05:41:05.509 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T05:41:05.572 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-09-21T05:41:05.572 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-09-21T05:41:05.573 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000233187 s, 2.2 MB/s 2024-09-21T05:41:05.574 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T05:41:05.631 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-21T05:41:05.631 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T05:41:05.651 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T05:41:05.651 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_1 2024-09-21T05:41:05.710 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T05:41:05.710 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:41:05.711 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-21T05:41:05.711 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:41:05.711 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:41:05.711 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-09-21 05:40:35.393256686 +0000 2024-09-21T05:41:05.711 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-09-21 05:35:14.582816870 +0000 2024-09-21T05:41:05.711 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-09-21 05:35:14.582816870 +0000 2024-09-21T05:41:05.711 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-09-21 05:35:14.582816870 +0000 2024-09-21T05:41:05.711 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T05:41:05.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:05 smithi070 ceph-mon[30981]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:05.778 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:05 smithi160 ceph-mon[33979]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:05.782 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-09-21T05:41:05.782 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-09-21T05:41:05.782 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000238338 s, 2.1 MB/s 2024-09-21T05:41:05.783 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T05:41:05.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:05 smithi116 ceph-mon[34332]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:05.843 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_2 2024-09-21T05:41:05.899 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T05:41:05.900 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:41:05.900 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-21T05:41:05.900 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:41:05.900 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:41:05.900 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-09-21 05:40:35.394256672 +0000 2024-09-21T05:41:05.900 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-09-21 05:35:14.918812319 +0000 2024-09-21T05:41:05.900 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-09-21 05:35:14.918812319 +0000 2024-09-21T05:41:05.900 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-09-21 05:35:14.918812319 +0000 2024-09-21T05:41:05.900 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T05:41:05.966 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-09-21T05:41:05.966 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-09-21T05:41:05.966 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000222895 s, 2.3 MB/s 2024-09-21T05:41:05.967 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T05:41:06.026 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_3 2024-09-21T05:41:06.082 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T05:41:06.082 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:41:06.082 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-21T05:41:06.082 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:41:06.082 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:41:06.082 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-09-21 05:40:35.394256672 +0000 2024-09-21T05:41:06.083 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-09-21 05:35:15.237807998 +0000 2024-09-21T05:41:06.083 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-09-21 05:35:15.237807998 +0000 2024-09-21T05:41:06.083 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-09-21 05:35:15.237807998 +0000 2024-09-21T05:41:06.083 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T05:41:06.147 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-09-21T05:41:06.148 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-09-21T05:41:06.148 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000211439 s, 2.4 MB/s 2024-09-21T05:41:06.149 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T05:41:06.206 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_4 2024-09-21T05:41:06.262 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T05:41:06.262 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:41:06.262 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-21T05:41:06.262 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:41:06.262 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:41:06.262 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-09-21 05:40:35.395256658 +0000 2024-09-21T05:41:06.262 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-09-21 05:35:15.559803636 +0000 2024-09-21T05:41:06.262 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-09-21 05:35:15.559803636 +0000 2024-09-21T05:41:06.262 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-09-21 05:35:15.559803636 +0000 2024-09-21T05:41:06.263 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T05:41:06.326 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-09-21T05:41:06.326 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-09-21T05:41:06.326 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000225036 s, 2.3 MB/s 2024-09-21T05:41:06.327 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T05:41:06.384 INFO:tasks.cephadm:Deploying osd.0 on smithi070 with /dev/vg_nvme/lv_4... 2024-09-21T05:41:06.384 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T05:41:06.634 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:41:07.687 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:07 smithi070 ceph-mon[30981]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:07.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:07 smithi116 ceph-mon[34332]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:07.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:07 smithi160 ceph-mon[33979]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:08.972 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:41:08.999 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi070:vg_nvme/lv_4 2024-09-21T05:41:09.244 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:41:09.638 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:09 smithi070 ceph-mon[30981]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:09.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.728+0000 7f604163b640 1 -- 172.21.15.70:0/1885159850 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f603c102d10 msgr2=0x7f603c105150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:41:09.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.728+0000 7f604163b640 1 --2- 172.21.15.70:0/1885159850 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f603c102d10 0x7f603c105150 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f602c009900 tx=0x7f602c02a410 comp rx=0 tx=0).stop 2024-09-21T05:41:09.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.728+0000 7f604163b640 1 -- 172.21.15.70:0/1885159850 shutdown_connections 2024-09-21T05:41:09.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.728+0000 7f604163b640 1 --2- 172.21.15.70:0/1885159850 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f603c105790 0x7f603c107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:41:09.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.728+0000 7f604163b640 1 --2- 172.21.15.70:0/1885159850 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f603c1083b0 0x7f603c10a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:41:09.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.728+0000 7f604163b640 1 --2- 172.21.15.70:0/1885159850 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f603c102d10 0x7f603c105150 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:41:09.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.728+0000 7f604163b640 1 -- 172.21.15.70:0/1885159850 >> 172.21.15.70:0/1885159850 conn(0x7f603c0fd770 msgr2=0x7f603c0ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:41:09.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.728+0000 7f604163b640 1 -- 172.21.15.70:0/1885159850 shutdown_connections 2024-09-21T05:41:09.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.728+0000 7f604163b640 1 -- 172.21.15.70:0/1885159850 wait complete. 2024-09-21T05:41:09.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.728+0000 7f604163b640 1 Processor -- start 2024-09-21T05:41:09.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.729+0000 7f604163b640 1 -- start start 2024-09-21T05:41:09.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.729+0000 7f604163b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f603c102d10 0x7f603c199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:41:09.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.729+0000 7f604163b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f603c105790 0x7f603c19a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:41:09.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.729+0000 7f604163b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f603c1083b0 0x7f603c19b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:41:09.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.729+0000 7f604163b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f603c10f400 con 0x7f603c1083b0 2024-09-21T05:41:09.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.729+0000 7f604163b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f603c10f280 con 0x7f603c105790 2024-09-21T05:41:09.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.729+0000 7f604163b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f603c10f580 con 0x7f603c102d10 2024-09-21T05:41:09.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.729+0000 7f603b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f603c1083b0 0x7f603c19b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:41:09.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.729+0000 7f603b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f603c1083b0 0x7f603c19b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46448/0 (socket says 172.21.15.70:46448) 2024-09-21T05:41:09.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.729+0000 7f603b7fe640 1 -- 172.21.15.70:0/1505392762 learned_addr learned my addr 172.21.15.70:0/1505392762 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:41:09.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.729+0000 7f603affd640 1 --2- 172.21.15.70:0/1505392762 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f603c102d10 0x7f603c199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:41:09.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.729+0000 7f603a7fc640 1 --2- 172.21.15.70:0/1505392762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f603c105790 0x7f603c19a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:41:09.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.729+0000 7f603b7fe640 1 -- 172.21.15.70:0/1505392762 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f603c102d10 msgr2=0x7f603c199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:41:09.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.729+0000 7f603b7fe640 1 --2- 172.21.15.70:0/1505392762 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f603c102d10 0x7f603c199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:41:09.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.729+0000 7f603b7fe640 1 -- 172.21.15.70:0/1505392762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f603c105790 msgr2=0x7f603c19a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:41:09.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.729+0000 7f603b7fe640 1 --2- 172.21.15.70:0/1505392762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f603c105790 0x7f603c19a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:41:09.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.729+0000 7f603b7fe640 1 -- 172.21.15.70:0/1505392762 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f603c19ba20 con 0x7f603c1083b0 2024-09-21T05:41:09.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.730+0000 7f603b7fe640 1 --2- 172.21.15.70:0/1505392762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f603c1083b0 0x7f603c19b200 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f603400b970 tx=0x7f603400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:41:09.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.730+0000 7f6023fff640 1 -- 172.21.15.70:0/1505392762 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6034019070 con 0x7f603c1083b0 2024-09-21T05:41:09.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.730+0000 7f6023fff640 1 -- 172.21.15.70:0/1505392762 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f6034014440 con 0x7f603c1083b0 2024-09-21T05:41:09.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.730+0000 7f604163b640 1 -- 172.21.15.70:0/1505392762 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f603c19bd10 con 0x7f603c1083b0 2024-09-21T05:41:09.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.730+0000 7f6023fff640 1 -- 172.21.15.70:0/1505392762 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60340075d0 con 0x7f603c1083b0 2024-09-21T05:41:09.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.730+0000 7f604163b640 1 -- 172.21.15.70:0/1505392762 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f603c1a2410 con 0x7f603c1083b0 2024-09-21T05:41:09.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.731+0000 7f604163b640 1 -- 172.21.15.70:0/1505392762 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f603c0ff290 con 0x7f603c1083b0 2024-09-21T05:41:09.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.732+0000 7f6023fff640 1 -- 172.21.15.70:0/1505392762 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f603401c070 con 0x7f603c1083b0 2024-09-21T05:41:09.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.733+0000 7f6023fff640 1 --2- 172.21.15.70:0/1505392762 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f60240b6480 0x7f60240b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:41:09.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.733+0000 7f603affd640 1 --2- 172.21.15.70:0/1505392762 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f60240b6480 0x7f60240b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:41:09.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.733+0000 7f6023fff640 1 -- 172.21.15.70:0/1505392762 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f60340e5050 con 0x7f603c1083b0 2024-09-21T05:41:09.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.733+0000 7f603affd640 1 --2- 172.21.15.70:0/1505392762 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f60240b6480 0x7f60240b8990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f602c005f70 tx=0x7f602c005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:41:09.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.736+0000 7f6023fff640 1 -- 172.21.15.70:0/1505392762 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f60340ad5b0 con 0x7f603c1083b0 2024-09-21T05:41:09.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:09 smithi116 ceph-mon[34332]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:09.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:09 smithi160 ceph-mon[33979]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:09.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:09.922+0000 7f604163b640 1 -- 172.21.15.70:0/1505392762 --> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f603c063800 con 0x7f60240b6480 2024-09-21T05:41:10.616 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:10 smithi070 ceph-mon[30981]: from='client.14385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:10.616 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:10 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:41:10.616 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:10 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:41:10.616 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:10 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:10.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:10 smithi116 ceph-mon[34332]: from='client.14385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:10.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:10 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:41:10.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:10 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:41:10.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:10 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:10.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:10 smithi160 ceph-mon[33979]: from='client.14385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:10.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:10 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:41:10.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:10 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:41:10.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:10 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:11.582 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:11 smithi070 ceph-mon[30981]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:11.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:11 smithi116 ceph-mon[34332]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:11.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:11 smithi160 ceph-mon[33979]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:12.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:12 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3477344150' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "00be8b82-7cb1-443f-ad18-02916f734df7"} : dispatch 2024-09-21T05:41:12.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:12 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3477344150' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "00be8b82-7cb1-443f-ad18-02916f734df7"}]': finished 2024-09-21T05:41:12.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:12 smithi070 ceph-mon[30981]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T05:41:12.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:12 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:41:12.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:12 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3477344150' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "00be8b82-7cb1-443f-ad18-02916f734df7"} : dispatch 2024-09-21T05:41:12.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:12 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3477344150' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "00be8b82-7cb1-443f-ad18-02916f734df7"}]': finished 2024-09-21T05:41:12.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:12 smithi116 ceph-mon[34332]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T05:41:12.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:12 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:41:12.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:12 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3477344150' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "00be8b82-7cb1-443f-ad18-02916f734df7"} : dispatch 2024-09-21T05:41:12.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:12 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3477344150' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "00be8b82-7cb1-443f-ad18-02916f734df7"}]': finished 2024-09-21T05:41:12.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:12 smithi160 ceph-mon[33979]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T05:41:12.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:12 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:41:13.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:13 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1368521156' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:41:13.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:13 smithi070 ceph-mon[30981]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:13.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:13 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1368521156' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:41:13.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:13 smithi116 ceph-mon[34332]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:13.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:13 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1368521156' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:41:13.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:13 smithi160 ceph-mon[33979]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:15.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:15 smithi070 ceph-mon[30981]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:15.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:15 smithi116 ceph-mon[34332]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:15.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:15 smithi160 ceph-mon[33979]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:17.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:17 smithi070 ceph-mon[30981]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:17.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:17 smithi116 ceph-mon[34332]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:17.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:17 smithi160 ceph-mon[33979]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:19.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:19 smithi070 ceph-mon[30981]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:19.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:19 smithi116 ceph-mon[34332]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:19.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:19 smithi160 ceph-mon[33979]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:20.870 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:20 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T05:41:20.870 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:20 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:20.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:20 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T05:41:20.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:20 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:21.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:20 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T05:41:21.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:20 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:22.049 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:21 smithi160 ceph-mon[33979]: Deploying daemon osd.0 on smithi070 2024-09-21T05:41:22.050 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:21 smithi160 ceph-mon[33979]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:22.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:21 smithi116 ceph-mon[34332]: Deploying daemon osd.0 on smithi070 2024-09-21T05:41:22.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:21 smithi116 ceph-mon[34332]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:22.205 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:21 smithi070 ceph-mon[30981]: Deploying daemon osd.0 on smithi070 2024-09-21T05:41:22.205 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:21 smithi070 ceph-mon[30981]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:23.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:23 smithi070 ceph-mon[30981]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:23.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:23 smithi116 ceph-mon[34332]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:23.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:23 smithi160 ceph-mon[33979]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:25.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:25 smithi070 ceph-mon[30981]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:25.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:25 smithi116 ceph-mon[34332]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:25.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:25 smithi160 ceph-mon[33979]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:27.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:27 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:41:27.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:27 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:27.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:27 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:27.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:27 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:41:27.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:27 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:27.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:27 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:27.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:27 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:41:27.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:27 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:27.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:27 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:28.218 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:28 smithi070 ceph-mon[30981]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:28.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:28 smithi116 ceph-mon[34332]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:28.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:28 smithi160 ceph-mon[33979]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:29.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:29 smithi070 ceph-mon[30981]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:29.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:29 smithi116 ceph-mon[34332]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:29.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:29 smithi160 ceph-mon[33979]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:30.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:30 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:30.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:30 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:30.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:30 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:30.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:30 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:41:30.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:30 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:31.135 INFO:teuthology.orchestra.run.smithi070.stdout:Created osd(s) 0 on host 'smithi070' 2024-09-21T05:41:31.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:31.132+0000 7f6023fff640 1 -- 172.21.15.70:0/1505392762 <== mgr.14150 v2:172.21.15.70:6800/1366013939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f603c063800 con 0x7f60240b6480 2024-09-21T05:41:31.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:31.135+0000 7f604163b640 1 -- 172.21.15.70:0/1505392762 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f60240b6480 msgr2=0x7f60240b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:41:31.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:31.135+0000 7f604163b640 1 --2- 172.21.15.70:0/1505392762 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f60240b6480 0x7f60240b8990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f602c005f70 tx=0x7f602c005d50 comp rx=0 tx=0).stop 2024-09-21T05:41:31.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:31.135+0000 7f604163b640 1 -- 172.21.15.70:0/1505392762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f603c1083b0 msgr2=0x7f603c19b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:41:31.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:31.135+0000 7f604163b640 1 --2- 172.21.15.70:0/1505392762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f603c1083b0 0x7f603c19b200 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f603400b970 tx=0x7f603400be30 comp rx=0 tx=0).stop 2024-09-21T05:41:31.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:31.135+0000 7f604163b640 1 -- 172.21.15.70:0/1505392762 shutdown_connections 2024-09-21T05:41:31.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:31.135+0000 7f604163b640 1 --2- 172.21.15.70:0/1505392762 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f60240b6480 0x7f60240b8990 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:41:31.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:31.135+0000 7f604163b640 1 --2- 172.21.15.70:0/1505392762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f603c1083b0 0x7f603c19b200 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:41:31.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:31.135+0000 7f604163b640 1 --2- 172.21.15.70:0/1505392762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f603c105790 0x7f603c19a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:41:31.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:31.135+0000 7f604163b640 1 --2- 172.21.15.70:0/1505392762 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f603c102d10 0x7f603c199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:41:31.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:31.135+0000 7f604163b640 1 -- 172.21.15.70:0/1505392762 >> 172.21.15.70:0/1505392762 conn(0x7f603c0fd770 msgr2=0x7f603c103ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:41:31.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:31.135+0000 7f604163b640 1 -- 172.21.15.70:0/1505392762 shutdown_connections 2024-09-21T05:41:31.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:41:31.135+0000 7f604163b640 1 -- 172.21.15.70:0/1505392762 wait complete. 2024-09-21T05:41:31.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:30 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:31.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:30 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:31.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:30 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:31.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:30 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:41:31.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:30 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:31.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:30 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:31.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:30 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:31.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:30 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:31.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:30 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:41:31.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:30 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:31.820 DEBUG:teuthology.orchestra.run.smithi070:osd.0> sudo journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.0.service 2024-09-21T05:41:31.822 INFO:tasks.cephadm:Deploying osd.1 on smithi116 with /dev/vg_nvme/lv_4... 2024-09-21T05:41:31.822 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T05:41:32.071 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T05:41:32.113 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:31 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:41:32.113 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:31 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:32.113 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:31 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:32.113 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:31 smithi070 ceph-mon[30981]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:32.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:31 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:41:32.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:31 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:32.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:31 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:32.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:31 smithi160 ceph-mon[33979]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:32.191 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:31 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:41:32.191 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:31 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:32.191 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:31 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:32.191 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:31 smithi116 ceph-mon[34332]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:33.717 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:33 smithi116 ceph-mon[34332]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:33.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:33 smithi070 ceph-mon[30981]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:33.745 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 21 05:41:33 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-0[46523]: 2024-09-21T05:41:33.422+0000 7f1c9d197640 -1 osd.0 0 log_to_monitors true 2024-09-21T05:41:33.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:33 smithi160 ceph-mon[33979]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:34.366 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-21T05:41:34.391 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi116:vg_nvme/lv_4 2024-09-21T05:41:34.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:34 smithi116 ceph-mon[34332]: from='osd.0 [v2:172.21.15.70:6802/1667051447,v1:172.21.15.70:6803/1667051447]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T05:41:34.645 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T05:41:34.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:34 smithi070 ceph-mon[30981]: from='osd.0 [v2:172.21.15.70:6802/1667051447,v1:172.21.15.70:6803/1667051447]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T05:41:34.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:34 smithi160 ceph-mon[33979]: from='osd.0 [v2:172.21.15.70:6802/1667051447,v1:172.21.15.70:6803/1667051447]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T05:41:35.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.085+0000 7fa2c6b50640 1 -- 172.21.15.116:0/3960350147 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2c0109500 msgr2=0x7fa2c010b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:41:35.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.085+0000 7fa2c6b50640 1 --2- 172.21.15.116:0/3960350147 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2c0109500 0x7fa2c010b980 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8009ca0 tx=0x7fa2b802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:41:35.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.085+0000 7fa2c6b50640 1 -- 172.21.15.116:0/3960350147 shutdown_connections 2024-09-21T05:41:35.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.085+0000 7fa2c6b50640 1 --2- 172.21.15.116:0/3960350147 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2c0106ba0 0x7fa2c0108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:41:35.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.085+0000 7fa2c6b50640 1 --2- 172.21.15.116:0/3960350147 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2c0109500 0x7fa2c010b980 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:41:35.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.085+0000 7fa2c6b50640 1 --2- 172.21.15.116:0/3960350147 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2c0101b00 0x7fa2c0101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:41:35.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.085+0000 7fa2c6b50640 1 -- 172.21.15.116:0/3960350147 >> 172.21.15.116:0/3960350147 conn(0x7fa2c00fd770 msgr2=0x7fa2c00ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:41:35.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.085+0000 7fa2c6b50640 1 -- 172.21.15.116:0/3960350147 shutdown_connections 2024-09-21T05:41:35.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.085+0000 7fa2c6b50640 1 -- 172.21.15.116:0/3960350147 wait complete. 2024-09-21T05:41:35.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.086+0000 7fa2c6b50640 1 Processor -- start 2024-09-21T05:41:35.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.086+0000 7fa2c6b50640 1 -- start start 2024-09-21T05:41:35.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.086+0000 7fa2c6b50640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2c0101b00 0x7fa2c01041d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:41:35.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.086+0000 7fa2c6b50640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2c0106ba0 0x7fa2c0102aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:41:35.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.086+0000 7fa2c6b50640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2c0109500 0x7fa2c0102fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:41:35.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.086+0000 7fa2c6b50640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c010f360 con 0x7fa2c0101b00 2024-09-21T05:41:35.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.086+0000 7fa2c6b50640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c010f1e0 con 0x7fa2c0109500 2024-09-21T05:41:35.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.086+0000 7fa2c6b50640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c010f4e0 con 0x7fa2c0106ba0 2024-09-21T05:41:35.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.086+0000 7fa2c50ed640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2c0109500 0x7fa2c0102fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:41:35.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.086+0000 7fa2c50ed640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2c0109500 0x7fa2c0102fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:51828/0 (socket says 172.21.15.116:51828) 2024-09-21T05:41:35.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.086+0000 7fa2c50ed640 1 -- 172.21.15.116:0/3354941212 learned_addr learned my addr 172.21.15.116:0/3354941212 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-21T05:41:35.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.086+0000 7fa2bffff640 1 --2- 172.21.15.116:0/3354941212 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2c0106ba0 0x7fa2c0102aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:41:35.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.086+0000 7fa2c48ec640 1 --2- 172.21.15.116:0/3354941212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2c0101b00 0x7fa2c01041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:41:35.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.086+0000 7fa2c50ed640 1 -- 172.21.15.116:0/3354941212 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2c0106ba0 msgr2=0x7fa2c0102aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:41:35.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.086+0000 7fa2c50ed640 1 --2- 172.21.15.116:0/3354941212 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2c0106ba0 0x7fa2c0102aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:41:35.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.086+0000 7fa2c50ed640 1 -- 172.21.15.116:0/3354941212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2c0101b00 msgr2=0x7fa2c01041d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:41:35.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.086+0000 7fa2c50ed640 1 --2- 172.21.15.116:0/3354941212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2c0101b00 0x7fa2c01041d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:41:35.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.087+0000 7fa2c50ed640 1 -- 172.21.15.116:0/3354941212 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2c01036e0 con 0x7fa2c0109500 2024-09-21T05:41:35.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.087+0000 7fa2c48ec640 1 --2- 172.21.15.116:0/3354941212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2c0101b00 0x7fa2c01041d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:41:35.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.087+0000 7fa2c50ed640 1 --2- 172.21.15.116:0/3354941212 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2c0109500 0x7fa2c0102fe0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa2b80097b0 tx=0x7fa2b8003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:41:35.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.087+0000 7fa2bdffb640 1 -- 172.21.15.116:0/3354941212 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8032eb0 con 0x7fa2c0109500 2024-09-21T05:41:35.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.087+0000 7fa2bdffb640 1 -- 172.21.15.116:0/3354941212 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fa2b80044f0 con 0x7fa2c0109500 2024-09-21T05:41:35.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.087+0000 7fa2c6b50640 1 -- 172.21.15.116:0/3354941212 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2c01a3fb0 con 0x7fa2c0109500 2024-09-21T05:41:35.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.087+0000 7fa2bdffb640 1 -- 172.21.15.116:0/3354941212 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8030cc0 con 0x7fa2c0109500 2024-09-21T05:41:35.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.088+0000 7fa2c6b50640 1 -- 172.21.15.116:0/3354941212 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2c01a4350 con 0x7fa2c0109500 2024-09-21T05:41:35.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.089+0000 7fa2c6b50640 1 -- 172.21.15.116:0/3354941212 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2c0101f10 con 0x7fa2c0109500 2024-09-21T05:41:35.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.090+0000 7fa2bdffb640 1 -- 172.21.15.116:0/3354941212 <== mon.2 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fa2b80046a0 con 0x7fa2c0109500 2024-09-21T05:41:35.093 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.091+0000 7fa2bdffb640 1 --2- 172.21.15.116:0/3354941212 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa2b00b6500 0x7fa2b00b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:41:35.093 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.091+0000 7fa2bdffb640 1 -- 172.21.15.116:0/3354941212 <== mon.2 v2:172.21.15.116:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1361+0+0 (secure 0 0 0) 0x7fa2b81069b0 con 0x7fa2c0109500 2024-09-21T05:41:35.093 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.091+0000 7fa2c48ec640 1 --2- 172.21.15.116:0/3354941212 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa2b00b6500 0x7fa2b00b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:41:35.093 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.091+0000 7fa2c48ec640 1 --2- 172.21.15.116:0/3354941212 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa2b00b6500 0x7fa2b00b8a10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4005d00 tx=0x7fa2b4005ed0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:41:35.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.095+0000 7fa2bdffb640 1 -- 172.21.15.116:0/3354941212 <== mon.2 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa2b80cee40 con 0x7fa2c0109500 2024-09-21T05:41:35.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:35.289+0000 7fa2c6b50640 1 -- 172.21.15.116:0/3354941212 --> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fa2c0063800 con 0x7fa2b00b6500 2024-09-21T05:41:35.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:35 smithi116 ceph-mon[34332]: from='osd.0 [v2:172.21.15.70:6802/1667051447,v1:172.21.15.70:6803/1667051447]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T05:41:35.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:35 smithi116 ceph-mon[34332]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T05:41:35.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:35 smithi116 ceph-mon[34332]: from='osd.0 [v2:172.21.15.70:6802/1667051447,v1:172.21.15.70:6803/1667051447]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-21T05:41:35.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:35 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:41:35.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:35 smithi116 ceph-mon[34332]: Detected new or changed devices on smithi070 2024-09-21T05:41:35.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:35 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:35.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:35 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:35.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:35 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:41:35.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:35 smithi116 ceph-mon[34332]: Adjusting osd_memory_target on smithi070 to 17088M 2024-09-21T05:41:35.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:35 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:35.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:35 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:35.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:35 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:41:35.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:35 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:35.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:35 smithi116 ceph-mon[34332]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:35.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:35 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:41:35.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:35 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:41:35.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:35 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:35.556 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:35 smithi116 ceph-mon[34332]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:35.745 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 21 05:41:35 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-0[46523]: 2024-09-21T05:41:35.424+0000 7f1c99119640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T05:41:35.745 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 21 05:41:35 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-0[46523]: 2024-09-21T05:41:35.430+0000 7f1c94f17640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:41:35.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:35 smithi070 ceph-mon[30981]: from='osd.0 [v2:172.21.15.70:6802/1667051447,v1:172.21.15.70:6803/1667051447]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T05:41:35.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:35 smithi070 ceph-mon[30981]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T05:41:35.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:35 smithi070 ceph-mon[30981]: from='osd.0 [v2:172.21.15.70:6802/1667051447,v1:172.21.15.70:6803/1667051447]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-21T05:41:35.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:35 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:41:35.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:35 smithi070 ceph-mon[30981]: Detected new or changed devices on smithi070 2024-09-21T05:41:35.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:35 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:35.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:35 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:35.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:35 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:41:35.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:35 smithi070 ceph-mon[30981]: Adjusting osd_memory_target on smithi070 to 17088M 2024-09-21T05:41:35.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:35 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:35.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:35 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:35.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:35 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:41:35.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:35 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:35.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:35 smithi070 ceph-mon[30981]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:35.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:35 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:41:35.747 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:35 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:41:35.747 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:35 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:35.747 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:35 smithi070 ceph-mon[30981]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:35.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:35 smithi160 ceph-mon[33979]: from='osd.0 [v2:172.21.15.70:6802/1667051447,v1:172.21.15.70:6803/1667051447]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T05:41:35.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:35 smithi160 ceph-mon[33979]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T05:41:35.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:35 smithi160 ceph-mon[33979]: from='osd.0 [v2:172.21.15.70:6802/1667051447,v1:172.21.15.70:6803/1667051447]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-21T05:41:35.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:35 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:41:35.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:35 smithi160 ceph-mon[33979]: Detected new or changed devices on smithi070 2024-09-21T05:41:35.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:35 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:35.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:35 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:35.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:35 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:41:35.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:35 smithi160 ceph-mon[33979]: Adjusting osd_memory_target on smithi070 to 17088M 2024-09-21T05:41:35.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:35 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:35.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:35 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:35.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:35 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:41:35.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:35 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:35.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:35 smithi160 ceph-mon[33979]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:35.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:35 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:41:35.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:35 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:41:35.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:35 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:35.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:35 smithi160 ceph-mon[33979]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:36.698 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:36 smithi116 ceph-mon[34332]: purged_snaps scrub starts 2024-09-21T05:41:36.699 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:36 smithi116 ceph-mon[34332]: purged_snaps scrub ok 2024-09-21T05:41:36.699 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:36 smithi116 ceph-mon[34332]: from='osd.0 [v2:172.21.15.70:6802/1667051447,v1:172.21.15.70:6803/1667051447]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-21T05:41:36.699 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:36 smithi116 ceph-mon[34332]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T05:41:36.699 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:36 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:41:36.699 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:36 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:41:36.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:36 smithi070 ceph-mon[30981]: purged_snaps scrub starts 2024-09-21T05:41:36.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:36 smithi070 ceph-mon[30981]: purged_snaps scrub ok 2024-09-21T05:41:36.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:36 smithi070 ceph-mon[30981]: from='osd.0 [v2:172.21.15.70:6802/1667051447,v1:172.21.15.70:6803/1667051447]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-21T05:41:36.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:36 smithi070 ceph-mon[30981]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T05:41:36.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:36 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:41:36.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:36 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:41:36.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:36 smithi160 ceph-mon[33979]: purged_snaps scrub starts 2024-09-21T05:41:36.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:36 smithi160 ceph-mon[33979]: purged_snaps scrub ok 2024-09-21T05:41:36.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:36 smithi160 ceph-mon[33979]: from='osd.0 [v2:172.21.15.70:6802/1667051447,v1:172.21.15.70:6803/1667051447]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-21T05:41:36.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:36 smithi160 ceph-mon[33979]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T05:41:36.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:36 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:41:36.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:36 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:41:37.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:37 smithi116 ceph-mon[34332]: osd.0 [v2:172.21.15.70:6802/1667051447,v1:172.21.15.70:6803/1667051447] boot 2024-09-21T05:41:37.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:37 smithi116 ceph-mon[34332]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T05:41:37.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:37 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:41:37.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:37 smithi116 ceph-mon[34332]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:37.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:37 smithi070 ceph-mon[30981]: osd.0 [v2:172.21.15.70:6802/1667051447,v1:172.21.15.70:6803/1667051447] boot 2024-09-21T05:41:37.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:37 smithi070 ceph-mon[30981]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T05:41:37.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:37 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:41:37.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:37 smithi070 ceph-mon[30981]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:37.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:37 smithi160 ceph-mon[33979]: osd.0 [v2:172.21.15.70:6802/1667051447,v1:172.21.15.70:6803/1667051447] boot 2024-09-21T05:41:37.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:37 smithi160 ceph-mon[33979]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T05:41:37.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:37 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:41:37.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:37 smithi160 ceph-mon[33979]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:41:38.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:38 smithi070 ceph-mon[30981]: from='client.? 172.21.15.116:0/878252688' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28ca8c5c-5e81-4e64-ac0e-3c8c3c2d3930"} : dispatch 2024-09-21T05:41:38.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:38 smithi070 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28ca8c5c-5e81-4e64-ac0e-3c8c3c2d3930"} : dispatch 2024-09-21T05:41:38.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:38 smithi070 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28ca8c5c-5e81-4e64-ac0e-3c8c3c2d3930"}]': finished 2024-09-21T05:41:38.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:38 smithi070 ceph-mon[30981]: osdmap e9: 2 total, 1 up, 2 in 2024-09-21T05:41:38.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:38 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:41:38.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:38 smithi070 ceph-mon[30981]: from='client.? 172.21.15.116:0/362015061' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:41:38.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:38 smithi116 ceph-mon[34332]: from='client.? 172.21.15.116:0/878252688' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28ca8c5c-5e81-4e64-ac0e-3c8c3c2d3930"} : dispatch 2024-09-21T05:41:38.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:38 smithi116 ceph-mon[34332]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28ca8c5c-5e81-4e64-ac0e-3c8c3c2d3930"} : dispatch 2024-09-21T05:41:38.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:38 smithi116 ceph-mon[34332]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28ca8c5c-5e81-4e64-ac0e-3c8c3c2d3930"}]': finished 2024-09-21T05:41:38.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:38 smithi116 ceph-mon[34332]: osdmap e9: 2 total, 1 up, 2 in 2024-09-21T05:41:38.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:38 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:41:38.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:38 smithi116 ceph-mon[34332]: from='client.? 172.21.15.116:0/362015061' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:41:38.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:38 smithi160 ceph-mon[33979]: from='client.? 172.21.15.116:0/878252688' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28ca8c5c-5e81-4e64-ac0e-3c8c3c2d3930"} : dispatch 2024-09-21T05:41:38.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:38 smithi160 ceph-mon[33979]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28ca8c5c-5e81-4e64-ac0e-3c8c3c2d3930"} : dispatch 2024-09-21T05:41:38.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:38 smithi160 ceph-mon[33979]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28ca8c5c-5e81-4e64-ac0e-3c8c3c2d3930"}]': finished 2024-09-21T05:41:38.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:38 smithi160 ceph-mon[33979]: osdmap e9: 2 total, 1 up, 2 in 2024-09-21T05:41:38.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:38 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:41:38.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:38 smithi160 ceph-mon[33979]: from='client.? 172.21.15.116:0/362015061' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:41:39.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:39 smithi070 ceph-mon[30981]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:39.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:39 smithi116 ceph-mon[34332]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:39.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:39 smithi160 ceph-mon[33979]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:41.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:41 smithi070 ceph-mon[30981]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:41.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:41 smithi116 ceph-mon[34332]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:41.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:41 smithi160 ceph-mon[33979]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:43.738 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:43 smithi116 ceph-mon[34332]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:43.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:43 smithi070 ceph-mon[30981]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:43.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:43 smithi160 ceph-mon[33979]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:45.717 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:45 smithi116 ceph-mon[34332]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:45.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:45 smithi070 ceph-mon[30981]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:45.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:45 smithi160 ceph-mon[33979]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:46.513 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:46 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T05:41:46.513 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:46 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:46.513 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:46 smithi116 ceph-mon[34332]: Deploying daemon osd.1 on smithi116 2024-09-21T05:41:46.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:46 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T05:41:46.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:46 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:46.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:46 smithi070 ceph-mon[30981]: Deploying daemon osd.1 on smithi116 2024-09-21T05:41:46.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:46 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T05:41:46.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:46 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:46.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:46 smithi160 ceph-mon[33979]: Deploying daemon osd.1 on smithi116 2024-09-21T05:41:47.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:47 smithi070 ceph-mon[30981]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:47.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:47 smithi116 ceph-mon[34332]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:47.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:47 smithi160 ceph-mon[33979]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:49.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:49 smithi116 ceph-mon[34332]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:49.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:49 smithi070 ceph-mon[30981]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:49.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:49 smithi160 ceph-mon[33979]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:51.533 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:51 smithi116 ceph-mon[34332]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:51.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:51 smithi070 ceph-mon[30981]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:51.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:51 smithi160 ceph-mon[33979]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:52.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:52 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:41:52.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:52 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:52.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:52 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:52.755 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:52 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:41:52.755 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:52 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:52.755 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:52 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:52.799 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:52 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:41:52.800 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:52 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:52.800 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:52 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:53.649 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:53 smithi116 ceph-mon[34332]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:53.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:53 smithi070 ceph-mon[30981]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:53.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:53 smithi160 ceph-mon[33979]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:55.827 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:55 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:55.827 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:55 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:55.827 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:55 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:55.827 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:55 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:41:55.827 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:55 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:55.827 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:55 smithi116 ceph-mon[34332]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:55.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:55 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:55.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:55 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:55.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:55 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:55.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:55 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:41:55.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:55 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:55.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:55 smithi160 ceph-mon[33979]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:55.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:55 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:55.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:55 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:55.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:55 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:55.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:55 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:41:55.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:55 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:55.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:55 smithi070 ceph-mon[30981]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:56.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:56.100+0000 7fa2bdffb640 1 -- 172.21.15.116:0/3354941212 <== mgr.14150 v2:172.21.15.70:6800/1366013939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa2c0063800 con 0x7fa2b00b6500 2024-09-21T05:41:56.102 INFO:teuthology.orchestra.run.smithi116.stdout:Created osd(s) 1 on host 'smithi116' 2024-09-21T05:41:56.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:56.102+0000 7fa2c6b50640 1 -- 172.21.15.116:0/3354941212 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa2b00b6500 msgr2=0x7fa2b00b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:41:56.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:56.102+0000 7fa2c6b50640 1 --2- 172.21.15.116:0/3354941212 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa2b00b6500 0x7fa2b00b8a10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4005d00 tx=0x7fa2b4005ed0 comp rx=0 tx=0).stop 2024-09-21T05:41:56.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:56.102+0000 7fa2c6b50640 1 -- 172.21.15.116:0/3354941212 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2c0109500 msgr2=0x7fa2c0102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:41:56.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:56.102+0000 7fa2c6b50640 1 --2- 172.21.15.116:0/3354941212 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2c0109500 0x7fa2c0102fe0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa2b80097b0 tx=0x7fa2b8003ba0 comp rx=0 tx=0).stop 2024-09-21T05:41:56.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:56.102+0000 7fa2c6b50640 1 -- 172.21.15.116:0/3354941212 shutdown_connections 2024-09-21T05:41:56.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:56.102+0000 7fa2c6b50640 1 --2- 172.21.15.116:0/3354941212 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa2b00b6500 0x7fa2b00b8a10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:41:56.105 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:56.102+0000 7fa2c6b50640 1 --2- 172.21.15.116:0/3354941212 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2c0106ba0 0x7fa2c0102aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:41:56.105 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:56.102+0000 7fa2c6b50640 1 --2- 172.21.15.116:0/3354941212 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2c0109500 0x7fa2c0102fe0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:41:56.105 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:56.102+0000 7fa2c6b50640 1 --2- 172.21.15.116:0/3354941212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2c0101b00 0x7fa2c01041d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:41:56.105 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:56.102+0000 7fa2c6b50640 1 -- 172.21.15.116:0/3354941212 >> 172.21.15.116:0/3354941212 conn(0x7fa2c00fd770 msgr2=0x7fa2c0107970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:41:56.105 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:56.102+0000 7fa2c6b50640 1 -- 172.21.15.116:0/3354941212 shutdown_connections 2024-09-21T05:41:56.105 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:41:56.102+0000 7fa2c6b50640 1 -- 172.21.15.116:0/3354941212 wait complete. 2024-09-21T05:41:56.713 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:56 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:41:56.713 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:56 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:56.714 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:56 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:56.739 DEBUG:teuthology.orchestra.run.smithi116:osd.1> sudo journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.1.service 2024-09-21T05:41:56.741 INFO:tasks.cephadm:Deploying osd.2 on smithi160 with /dev/vg_nvme/lv_4... 2024-09-21T05:41:56.742 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T05:41:56.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:56 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:41:56.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:56 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:56.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:56 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:56.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:56 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:41:56.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:56 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:56.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:56 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:56.995 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:41:57.810 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:57 smithi160 ceph-mon[33979]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:57.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:57 smithi070 ceph-mon[30981]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:57.909 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:57 smithi116 ceph-mon[34332]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:58.554 INFO:journalctl@ceph.osd.1.smithi116.stdout:Sep 21 05:41:58 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-1[38270]: 2024-09-21T05:41:58.357+0000 7fa6050c2640 -1 osd.1 0 log_to_monitors true 2024-09-21T05:41:58.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:58 smithi160 ceph-mon[33979]: from='osd.1 [v2:172.21.15.116:6800/1037621846,v1:172.21.15.116:6801/1037621846]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T05:41:58.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:58 smithi160 ceph-mon[33979]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T05:41:58.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:58 smithi070 ceph-mon[30981]: from='osd.1 [v2:172.21.15.116:6800/1037621846,v1:172.21.15.116:6801/1037621846]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T05:41:58.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:58 smithi070 ceph-mon[30981]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T05:41:59.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:58 smithi116 ceph-mon[34332]: from='osd.1 [v2:172.21.15.116:6800/1037621846,v1:172.21.15.116:6801/1037621846]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T05:41:59.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:58 smithi116 ceph-mon[34332]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T05:41:59.379 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-21T05:41:59.405 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi160:vg_nvme/lv_4 2024-09-21T05:41:59.676 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:41:59.804 INFO:journalctl@ceph.osd.1.smithi116.stdout:Sep 21 05:41:59 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-1[38270]: 2024-09-21T05:41:59.606+0000 7fa601044640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T05:41:59.804 INFO:journalctl@ceph.osd.1.smithi116.stdout:Sep 21 05:41:59 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-1[38270]: 2024-09-21T05:41:59.610+0000 7fa5fce42640 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:41:59.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:59 smithi116 ceph-mon[34332]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T05:41:59.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:59 smithi116 ceph-mon[34332]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T05:41:59.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:59 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:41:59.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:59 smithi116 ceph-mon[34332]: from='osd.1 [v2:172.21.15.116:6800/1037621846,v1:172.21.15.116:6801/1037621846]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi116", "root=default"]} : dispatch 2024-09-21T05:41:59.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:59 smithi116 ceph-mon[34332]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi116", "root=default"]} : dispatch 2024-09-21T05:41:59.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:59 smithi116 ceph-mon[34332]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:59.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:59 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:59.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:59 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:59.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:59 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:41:59.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:59 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:59.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:59 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:59.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:59 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:41:59.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:41:59 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:59.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:59 smithi160 ceph-mon[33979]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T05:41:59.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:59 smithi160 ceph-mon[33979]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T05:41:59.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:59 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:41:59.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:59 smithi160 ceph-mon[33979]: from='osd.1 [v2:172.21.15.116:6800/1037621846,v1:172.21.15.116:6801/1037621846]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi116", "root=default"]} : dispatch 2024-09-21T05:41:59.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:59 smithi160 ceph-mon[33979]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi116", "root=default"]} : dispatch 2024-09-21T05:41:59.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:59 smithi160 ceph-mon[33979]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:59.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:59 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:59.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:59 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:59.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:59 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:41:59.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:59 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:59.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:59 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:59.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:59 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:41:59.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:41:59 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:59.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:59 smithi070 ceph-mon[30981]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T05:41:59.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:59 smithi070 ceph-mon[30981]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T05:41:59.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:59 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:41:59.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:59 smithi070 ceph-mon[30981]: from='osd.1 [v2:172.21.15.116:6800/1037621846,v1:172.21.15.116:6801/1037621846]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi116", "root=default"]} : dispatch 2024-09-21T05:41:59.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:59 smithi070 ceph-mon[30981]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi116", "root=default"]} : dispatch 2024-09-21T05:41:59.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:59 smithi070 ceph-mon[30981]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:41:59.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:59 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:59.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:59 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:59.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:59 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:41:59.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:59 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:41:59.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:59 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:59.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:59 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:41:59.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:41:59 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:00.124 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.122+0000 7fda2f72b640 1 -- 172.21.15.160:0/484947741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda28103780 msgr2=0x7fda28103bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:42:00.124 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.122+0000 7fda2f72b640 1 --2- 172.21.15.160:0/484947741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda28103780 0x7fda28103bf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fda24009900 tx=0x7fda2402a480 comp rx=0 tx=0).stop 2024-09-21T05:42:00.124 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.122+0000 7fda2f72b640 1 -- 172.21.15.160:0/484947741 shutdown_connections 2024-09-21T05:42:00.124 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.122+0000 7fda2f72b640 1 --2- 172.21.15.160:0/484947741 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda281051b0 0x7fda2810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:42:00.124 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.122+0000 7fda2f72b640 1 --2- 172.21.15.160:0/484947741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda28104810 0x7fda28104c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:42:00.125 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.122+0000 7fda2f72b640 1 --2- 172.21.15.160:0/484947741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda28103780 0x7fda28103bf0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:42:00.125 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.122+0000 7fda2f72b640 1 -- 172.21.15.160:0/484947741 >> 172.21.15.160:0/484947741 conn(0x7fda280ff0f0 msgr2=0x7fda281015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:42:00.125 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.122+0000 7fda2f72b640 1 -- 172.21.15.160:0/484947741 shutdown_connections 2024-09-21T05:42:00.125 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.122+0000 7fda2f72b640 1 -- 172.21.15.160:0/484947741 wait complete. 2024-09-21T05:42:00.127 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.123+0000 7fda2f72b640 1 Processor -- start 2024-09-21T05:42:00.127 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.123+0000 7fda2f72b640 1 -- start start 2024-09-21T05:42:00.127 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.123+0000 7fda2f72b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda28103780 0x7fda28076e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:42:00.127 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.123+0000 7fda2f72b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda28104810 0x7fda28075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:42:00.127 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.123+0000 7fda2f72b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda281051b0 0x7fda28075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:42:00.127 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.123+0000 7fda2f72b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fda2810f400 con 0x7fda281051b0 2024-09-21T05:42:00.127 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.123+0000 7fda2f72b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fda2810f280 con 0x7fda28103780 2024-09-21T05:42:00.127 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.123+0000 7fda2f72b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fda2810f580 con 0x7fda28104810 2024-09-21T05:42:00.127 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.123+0000 7fda2ccc6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda28104810 0x7fda28075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:42:00.127 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.123+0000 7fda2ccc6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda28104810 0x7fda28075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:44356/0 (socket says 172.21.15.160:44356) 2024-09-21T05:42:00.127 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.123+0000 7fda2ccc6640 1 -- 172.21.15.160:0/1234476429 learned_addr learned my addr 172.21.15.160:0/1234476429 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-09-21T05:42:00.127 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.123+0000 7fda2dcc8640 1 --2- 172.21.15.160:0/1234476429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda281051b0 0x7fda28075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:42:00.128 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.123+0000 7fda2d4c7640 1 --2- 172.21.15.160:0/1234476429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda28103780 0x7fda28076e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:42:00.128 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.124+0000 7fda2ccc6640 1 -- 172.21.15.160:0/1234476429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda28103780 msgr2=0x7fda28076e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:42:00.128 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.124+0000 7fda2ccc6640 1 --2- 172.21.15.160:0/1234476429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda28103780 0x7fda28076e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:42:00.128 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.124+0000 7fda2ccc6640 1 -- 172.21.15.160:0/1234476429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda281051b0 msgr2=0x7fda28075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:42:00.128 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.124+0000 7fda2ccc6640 1 --2- 172.21.15.160:0/1234476429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda281051b0 0x7fda28075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:42:00.128 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.124+0000 7fda2ccc6640 1 -- 172.21.15.160:0/1234476429 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda28076350 con 0x7fda28104810 2024-09-21T05:42:00.128 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.124+0000 7fda2ccc6640 1 --2- 172.21.15.160:0/1234476429 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda28104810 0x7fda28075710 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fda1800e9f0 tx=0x7fda1800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:42:00.128 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.124+0000 7fda1e7fc640 1 -- 172.21.15.160:0/1234476429 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1800cd80 con 0x7fda28104810 2024-09-21T05:42:00.128 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.124+0000 7fda1e7fc640 1 -- 172.21.15.160:0/1234476429 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fda180108e0 con 0x7fda28104810 2024-09-21T05:42:00.128 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.124+0000 7fda1e7fc640 1 -- 172.21.15.160:0/1234476429 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda180188b0 con 0x7fda28104810 2024-09-21T05:42:00.128 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.124+0000 7fda2f72b640 1 -- 172.21.15.160:0/1234476429 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda281a4060 con 0x7fda28104810 2024-09-21T05:42:00.129 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.124+0000 7fda2f72b640 1 -- 172.21.15.160:0/1234476429 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda281a4510 con 0x7fda28104810 2024-09-21T05:42:00.129 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.126+0000 7fda2f72b640 1 -- 172.21.15.160:0/1234476429 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda2810a960 con 0x7fda28104810 2024-09-21T05:42:00.129 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.127+0000 7fda1e7fc640 1 -- 172.21.15.160:0/1234476429 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fda18010a90 con 0x7fda28104810 2024-09-21T05:42:00.129 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.127+0000 7fda1e7fc640 1 --2- 172.21.15.160:0/1234476429 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fda140b6500 0x7fda140b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:42:00.129 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.128+0000 7fda1e7fc640 1 -- 172.21.15.160:0/1234476429 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2029+0+0 (secure 0 0 0) 0x7fda180e5ca0 con 0x7fda28104810 2024-09-21T05:42:00.130 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.128+0000 7fda2d4c7640 1 --2- 172.21.15.160:0/1234476429 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fda140b6500 0x7fda140b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:42:00.130 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.128+0000 7fda2d4c7640 1 --2- 172.21.15.160:0/1234476429 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fda140b6500 0x7fda140b8a10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fda24000c00 tx=0x7fda24005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:42:00.133 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.132+0000 7fda1e7fc640 1 -- 172.21.15.160:0/1234476429 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fda180adea0 con 0x7fda28104810 2024-09-21T05:42:00.362 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:00.359+0000 7fda2f72b640 1 -- 172.21.15.160:0/1234476429 --> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fda28063800 con 0x7fda140b6500 2024-09-21T05:42:00.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:00 smithi160 ceph-mon[33979]: Detected new or changed devices on smithi116 2024-09-21T05:42:00.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:00 smithi160 ceph-mon[33979]: Adjusting osd_memory_target on smithi116 to 17088M 2024-09-21T05:42:00.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:00 smithi160 ceph-mon[33979]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-21T05:42:00.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:00 smithi160 ceph-mon[33979]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T05:42:00.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:00 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:42:00.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:00 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:42:00.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:00 smithi160 ceph-mon[33979]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:00.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:00 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:42:00.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:00 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:42:00.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:00 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:00.916 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:00 smithi116 ceph-mon[34332]: Detected new or changed devices on smithi116 2024-09-21T05:42:00.916 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:00 smithi116 ceph-mon[34332]: Adjusting osd_memory_target on smithi116 to 17088M 2024-09-21T05:42:00.916 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:00 smithi116 ceph-mon[34332]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-21T05:42:00.916 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:00 smithi116 ceph-mon[34332]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T05:42:00.916 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:00 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:42:00.916 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:00 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:42:00.916 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:00 smithi116 ceph-mon[34332]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:00.916 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:00 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:42:00.916 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:00 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:42:00.916 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:00 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:00.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:00 smithi070 ceph-mon[30981]: Detected new or changed devices on smithi116 2024-09-21T05:42:00.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:00 smithi070 ceph-mon[30981]: Adjusting osd_memory_target on smithi116 to 17088M 2024-09-21T05:42:00.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:00 smithi070 ceph-mon[30981]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-21T05:42:00.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:00 smithi070 ceph-mon[30981]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T05:42:00.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:00 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:42:00.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:00 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:42:00.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:00 smithi070 ceph-mon[30981]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:00.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:00 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:42:00.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:00 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:42:00.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:00 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:01.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:01 smithi116 ceph-mon[34332]: purged_snaps scrub starts 2024-09-21T05:42:01.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:01 smithi116 ceph-mon[34332]: purged_snaps scrub ok 2024-09-21T05:42:01.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:01 smithi116 ceph-mon[34332]: osd.1 [v2:172.21.15.116:6800/1037621846,v1:172.21.15.116:6801/1037621846] boot 2024-09-21T05:42:01.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:01 smithi116 ceph-mon[34332]: osdmap e12: 2 total, 2 up, 2 in 2024-09-21T05:42:01.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:01 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:42:01.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:01 smithi116 ceph-mon[34332]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:01.888 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:01 smithi160 ceph-mon[33979]: purged_snaps scrub starts 2024-09-21T05:42:01.888 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:01 smithi160 ceph-mon[33979]: purged_snaps scrub ok 2024-09-21T05:42:01.888 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:01 smithi160 ceph-mon[33979]: osd.1 [v2:172.21.15.116:6800/1037621846,v1:172.21.15.116:6801/1037621846] boot 2024-09-21T05:42:01.888 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:01 smithi160 ceph-mon[33979]: osdmap e12: 2 total, 2 up, 2 in 2024-09-21T05:42:01.889 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:01 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:42:01.889 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:01 smithi160 ceph-mon[33979]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:01.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:01 smithi070 ceph-mon[30981]: purged_snaps scrub starts 2024-09-21T05:42:01.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:01 smithi070 ceph-mon[30981]: purged_snaps scrub ok 2024-09-21T05:42:01.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:01 smithi070 ceph-mon[30981]: osd.1 [v2:172.21.15.116:6800/1037621846,v1:172.21.15.116:6801/1037621846] boot 2024-09-21T05:42:01.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:01 smithi070 ceph-mon[30981]: osdmap e12: 2 total, 2 up, 2 in 2024-09-21T05:42:01.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:01 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:42:01.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:01 smithi070 ceph-mon[30981]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:02.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:02 smithi160 ceph-mon[33979]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T05:42:02.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:02 smithi160 ceph-mon[33979]: from='client.? 172.21.15.160:0/2843394951' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e9b42bf2-a38b-4cf9-8774-4950de12d0f2"} : dispatch 2024-09-21T05:42:02.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:02 smithi160 ceph-mon[33979]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e9b42bf2-a38b-4cf9-8774-4950de12d0f2"} : dispatch 2024-09-21T05:42:02.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:02 smithi160 ceph-mon[33979]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e9b42bf2-a38b-4cf9-8774-4950de12d0f2"}]': finished 2024-09-21T05:42:02.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:02 smithi070 ceph-mon[30981]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T05:42:02.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:02 smithi070 ceph-mon[30981]: from='client.? 172.21.15.160:0/2843394951' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e9b42bf2-a38b-4cf9-8774-4950de12d0f2"} : dispatch 2024-09-21T05:42:02.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:02 smithi070 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e9b42bf2-a38b-4cf9-8774-4950de12d0f2"} : dispatch 2024-09-21T05:42:02.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:02 smithi070 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e9b42bf2-a38b-4cf9-8774-4950de12d0f2"}]': finished 2024-09-21T05:42:03.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:02 smithi116 ceph-mon[34332]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T05:42:03.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:02 smithi116 ceph-mon[34332]: from='client.? 172.21.15.160:0/2843394951' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e9b42bf2-a38b-4cf9-8774-4950de12d0f2"} : dispatch 2024-09-21T05:42:03.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:02 smithi116 ceph-mon[34332]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e9b42bf2-a38b-4cf9-8774-4950de12d0f2"} : dispatch 2024-09-21T05:42:03.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:02 smithi116 ceph-mon[34332]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e9b42bf2-a38b-4cf9-8774-4950de12d0f2"}]': finished 2024-09-21T05:42:03.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:03 smithi160 ceph-mon[33979]: osdmap e14: 3 total, 2 up, 3 in 2024-09-21T05:42:03.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:03 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:42:03.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:03 smithi160 ceph-mon[33979]: from='client.? 172.21.15.160:0/3656188629' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:42:03.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:03 smithi160 ceph-mon[33979]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:03.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:03 smithi070 ceph-mon[30981]: osdmap e14: 3 total, 2 up, 3 in 2024-09-21T05:42:03.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:03 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:42:03.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:03 smithi070 ceph-mon[30981]: from='client.? 172.21.15.160:0/3656188629' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:42:03.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:03 smithi070 ceph-mon[30981]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:04.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:03 smithi116 ceph-mon[34332]: osdmap e14: 3 total, 2 up, 3 in 2024-09-21T05:42:04.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:03 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:42:04.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:03 smithi116 ceph-mon[34332]: from='client.? 172.21.15.160:0/3656188629' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:42:04.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:03 smithi116 ceph-mon[34332]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:05.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:05 smithi070 ceph-mon[30981]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:05.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:05 smithi116 ceph-mon[34332]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:05.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:05 smithi160 ceph-mon[33979]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:07.608 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:07 smithi160 ceph-mon[33979]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:07.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:07 smithi070 ceph-mon[30981]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:07.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:07 smithi116 ceph-mon[34332]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:09.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:09 smithi070 ceph-mon[30981]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:09.520 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:09 smithi160 ceph-mon[33979]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:09.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:09 smithi116 ceph-mon[34332]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:10.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:10 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T05:42:10.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:10 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:10.781 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:10 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T05:42:10.781 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:10 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:10.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:10 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T05:42:10.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:10 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:11.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:11 smithi070 ceph-mon[30981]: Deploying daemon osd.2 on smithi160 2024-09-21T05:42:11.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:11 smithi070 ceph-mon[30981]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:11.761 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:11 smithi160 ceph-mon[33979]: Deploying daemon osd.2 on smithi160 2024-09-21T05:42:11.761 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:11 smithi160 ceph-mon[33979]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:11.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:11 smithi116 ceph-mon[34332]: Deploying daemon osd.2 on smithi160 2024-09-21T05:42:11.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:11 smithi116 ceph-mon[34332]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:13.708 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:13 smithi160 ceph-mon[33979]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:13.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:13 smithi070 ceph-mon[30981]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:13.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:13 smithi116 ceph-mon[34332]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:15.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:15 smithi070 ceph-mon[30981]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:15.751 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:15 smithi160 ceph-mon[33979]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:15.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:15 smithi116 ceph-mon[34332]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:17.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:16 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:42:17.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:16 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:17.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:16 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:17.299 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:16 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:42:17.299 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:16 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:17.299 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:16 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:17.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:16 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:42:17.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:16 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:17.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:16 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:18.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:17 smithi070 ceph-mon[30981]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:18.267 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:17 smithi160 ceph-mon[33979]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:18.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:17 smithi116 ceph-mon[34332]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:19.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:19 smithi160 ceph-mon[33979]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:19.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:19 smithi070 ceph-mon[30981]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:19.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:19 smithi116 ceph-mon[34332]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:20.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:20 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:20.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:20 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:20.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:20 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:20.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:20 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:42:20.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:20 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:20.835 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:20 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:20.835 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:20 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:20.835 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:20 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:20.835 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:20 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:42:20.835 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:20 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:20.875 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:20.873+0000 7fda1e7fc640 1 -- 172.21.15.160:0/1234476429 <== mgr.14150 v2:172.21.15.70:6800/1366013939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fda28063800 con 0x7fda140b6500 2024-09-21T05:42:20.876 INFO:teuthology.orchestra.run.smithi160.stdout:Created osd(s) 2 on host 'smithi160' 2024-09-21T05:42:20.878 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:20.876+0000 7fda2f72b640 1 -- 172.21.15.160:0/1234476429 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fda140b6500 msgr2=0x7fda140b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:42:20.878 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:20.876+0000 7fda2f72b640 1 --2- 172.21.15.160:0/1234476429 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fda140b6500 0x7fda140b8a10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fda24000c00 tx=0x7fda24005d50 comp rx=0 tx=0).stop 2024-09-21T05:42:20.878 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:20.876+0000 7fda2f72b640 1 -- 172.21.15.160:0/1234476429 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda28104810 msgr2=0x7fda28075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:42:20.878 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:20.876+0000 7fda2f72b640 1 --2- 172.21.15.160:0/1234476429 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda28104810 0x7fda28075710 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fda1800e9f0 tx=0x7fda1800eeb0 comp rx=0 tx=0).stop 2024-09-21T05:42:20.878 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:20.876+0000 7fda2f72b640 1 -- 172.21.15.160:0/1234476429 shutdown_connections 2024-09-21T05:42:20.878 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:20.876+0000 7fda2f72b640 1 --2- 172.21.15.160:0/1234476429 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fda140b6500 0x7fda140b8a10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:42:20.878 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:20.876+0000 7fda2f72b640 1 --2- 172.21.15.160:0/1234476429 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda28104810 0x7fda28075710 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:42:20.878 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:20.876+0000 7fda2f72b640 1 --2- 172.21.15.160:0/1234476429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda281051b0 0x7fda28075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:42:20.878 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:20.876+0000 7fda2f72b640 1 --2- 172.21.15.160:0/1234476429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda28103780 0x7fda28076e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:42:20.878 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:20.876+0000 7fda2f72b640 1 -- 172.21.15.160:0/1234476429 >> 172.21.15.160:0/1234476429 conn(0x7fda280ff0f0 msgr2=0x7fda28107b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:42:20.878 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:20.876+0000 7fda2f72b640 1 -- 172.21.15.160:0/1234476429 shutdown_connections 2024-09-21T05:42:20.879 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:42:20.876+0000 7fda2f72b640 1 -- 172.21.15.160:0/1234476429 wait complete. 2024-09-21T05:42:20.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:20 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:20.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:20 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:20.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:20 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:20.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:20 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:42:20.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:20 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:21.432 DEBUG:teuthology.orchestra.run.smithi160:osd.2> sudo journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.2.service 2024-09-21T05:42:21.434 INFO:tasks.cephadm:Deploying osd.3 on smithi070 with /dev/vg_nvme/lv_3... 2024-09-21T05:42:21.434 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T05:42:21.689 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:42:21.725 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:21 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:42:21.725 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:21 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:21.725 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:21 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:21.725 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:21 smithi160 ceph-mon[33979]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:21.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:21 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:42:21.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:21 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:21.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:21 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:21.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:21 smithi070 ceph-mon[30981]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:21.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:21 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:42:21.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:21 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:21.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:21 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:21.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:21 smithi116 ceph-mon[34332]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:23.074 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:23 smithi070 ceph-mon[30981]: from='osd.2 [v2:172.21.15.160:6800/69260815,v1:172.21.15.160:6801/69260815]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T05:42:23.074 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:23 smithi070 ceph-mon[30981]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T05:42:23.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:23 smithi160 ceph-mon[33979]: from='osd.2 [v2:172.21.15.160:6800/69260815,v1:172.21.15.160:6801/69260815]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T05:42:23.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:23 smithi160 ceph-mon[33979]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T05:42:23.149 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 05:42:22 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-2[38217]: 2024-09-21T05:42:22.969+0000 7fce9943b640 -1 osd.2 0 log_to_monitors true 2024-09-21T05:42:23.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:23 smithi116 ceph-mon[34332]: from='osd.2 [v2:172.21.15.160:6800/69260815,v1:172.21.15.160:6801/69260815]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T05:42:23.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:23 smithi116 ceph-mon[34332]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T05:42:24.148 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 05:42:24 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-2[38217]: 2024-09-21T05:42:24.045+0000 7fce953bd640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T05:42:24.148 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 05:42:24 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-2[38217]: 2024-09-21T05:42:24.051+0000 7fce911bb640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:42:24.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:24 smithi160 ceph-mon[33979]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T05:42:24.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:24 smithi160 ceph-mon[33979]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T05:42:24.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:24 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:42:24.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:24 smithi160 ceph-mon[33979]: from='osd.2 [v2:172.21.15.160:6800/69260815,v1:172.21.15.160:6801/69260815]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]} : dispatch 2024-09-21T05:42:24.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:24 smithi160 ceph-mon[33979]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]} : dispatch 2024-09-21T05:42:24.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:24 smithi160 ceph-mon[33979]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:24.206 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:24 smithi070 ceph-mon[30981]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T05:42:24.207 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:24 smithi070 ceph-mon[30981]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T05:42:24.207 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:24 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:42:24.207 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:24 smithi070 ceph-mon[30981]: from='osd.2 [v2:172.21.15.160:6800/69260815,v1:172.21.15.160:6801/69260815]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]} : dispatch 2024-09-21T05:42:24.207 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:24 smithi070 ceph-mon[30981]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]} : dispatch 2024-09-21T05:42:24.207 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:24 smithi070 ceph-mon[30981]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:42:24.237 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi070:vg_nvme/lv_3 2024-09-21T05:42:24.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:24 smithi116 ceph-mon[34332]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T05:42:24.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:24 smithi116 ceph-mon[34332]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T05:42:24.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:24 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:42:24.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:24 smithi116 ceph-mon[34332]: from='osd.2 [v2:172.21.15.160:6800/69260815,v1:172.21.15.160:6801/69260815]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]} : dispatch 2024-09-21T05:42:24.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:24 smithi116 ceph-mon[34332]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]} : dispatch 2024-09-21T05:42:24.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:24 smithi116 ceph-mon[34332]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:42:24.502 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:42:25.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.002+0000 7f1ec87c0640 1 -- 172.21.15.70:0/3740886011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ec006b920 msgr2=0x7f1ec01063f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:42:25.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.002+0000 7f1ec87c0640 1 --2- 172.21.15.70:0/3740886011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ec006b920 0x7f1ec01063f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009900 tx=0x7f1ebc02a410 comp rx=0 tx=0).stop 2024-09-21T05:42:25.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.002+0000 7f1ec87c0640 1 -- 172.21.15.70:0/3740886011 shutdown_connections 2024-09-21T05:42:25.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.002+0000 7f1ec87c0640 1 --2- 172.21.15.70:0/3740886011 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ec0106930 0x7f1ec0108d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:42:25.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.002+0000 7f1ec87c0640 1 --2- 172.21.15.70:0/3740886011 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1ec0109470 0x7f1ec010b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:42:25.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.002+0000 7f1ec87c0640 1 --2- 172.21.15.70:0/3740886011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ec006b920 0x7f1ec01063f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:42:25.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.002+0000 7f1ec87c0640 1 -- 172.21.15.70:0/3740886011 >> 172.21.15.70:0/3740886011 conn(0x7f1ec00fdfb0 msgr2=0x7f1ec0100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:42:25.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.002+0000 7f1ec87c0640 1 -- 172.21.15.70:0/3740886011 shutdown_connections 2024-09-21T05:42:25.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.002+0000 7f1ec87c0640 1 -- 172.21.15.70:0/3740886011 wait complete. 2024-09-21T05:42:25.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.003+0000 7f1ec87c0640 1 Processor -- start 2024-09-21T05:42:25.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.003+0000 7f1ec87c0640 1 -- start start 2024-09-21T05:42:25.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.003+0000 7f1ec87c0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ec006b920 0x7f1ec0199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:42:25.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.003+0000 7f1ec87c0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ec0106930 0x7f1ec019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:42:25.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.003+0000 7f1ec87c0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1ec0109470 0x7f1ec019b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:42:25.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.003+0000 7f1ec87c0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec010f360 con 0x7f1ec0106930 2024-09-21T05:42:25.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.003+0000 7f1ec87c0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec010f1e0 con 0x7f1ec0109470 2024-09-21T05:42:25.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.003+0000 7f1ec87c0640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec010f4e0 con 0x7f1ec006b920 2024-09-21T05:42:25.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.003+0000 7f1ec5d5b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ec0106930 0x7f1ec019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:42:25.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.003+0000 7f1ec5d5b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ec0106930 0x7f1ec019a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53300/0 (socket says 172.21.15.70:53300) 2024-09-21T05:42:25.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.003+0000 7f1ec5d5b640 1 -- 172.21.15.70:0/3321861844 learned_addr learned my addr 172.21.15.70:0/3321861844 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:42:25.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.004+0000 7f1ec6d5d640 1 --2- 172.21.15.70:0/3321861844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1ec0109470 0x7f1ec019b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:42:25.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.004+0000 7f1ec655c640 1 --2- 172.21.15.70:0/3321861844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ec006b920 0x7f1ec0199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:42:25.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.004+0000 7f1ec5d5b640 1 -- 172.21.15.70:0/3321861844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ec006b920 msgr2=0x7f1ec0199f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:42:25.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.004+0000 7f1ec5d5b640 1 --2- 172.21.15.70:0/3321861844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ec006b920 0x7f1ec0199f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:42:25.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.004+0000 7f1ec5d5b640 1 -- 172.21.15.70:0/3321861844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1ec0109470 msgr2=0x7f1ec019b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:42:25.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.004+0000 7f1ec5d5b640 1 --2- 172.21.15.70:0/3321861844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1ec0109470 0x7f1ec019b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:42:25.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.004+0000 7f1ec5d5b640 1 -- 172.21.15.70:0/3321861844 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec019b9a0 con 0x7f1ec0106930 2024-09-21T05:42:25.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.004+0000 7f1ec5d5b640 1 --2- 172.21.15.70:0/3321861844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ec0106930 0x7f1ec019a5e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1eb000e9f0 tx=0x7f1eb000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:42:25.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.004+0000 7f1eb77fe640 1 -- 172.21.15.70:0/3321861844 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb000cd80 con 0x7f1ec0106930 2024-09-21T05:42:25.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.004+0000 7f1eb77fe640 1 -- 172.21.15.70:0/3321861844 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f1eb00108e0 con 0x7f1ec0106930 2024-09-21T05:42:25.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.004+0000 7f1ec87c0640 1 -- 172.21.15.70:0/3321861844 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ec019bc90 con 0x7f1ec0106930 2024-09-21T05:42:25.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.004+0000 7f1eb77fe640 1 -- 172.21.15.70:0/3321861844 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb00188b0 con 0x7f1ec0106930 2024-09-21T05:42:25.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.004+0000 7f1ec87c0640 1 -- 172.21.15.70:0/3321861844 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ec01a2390 con 0x7f1ec0106930 2024-09-21T05:42:25.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.006+0000 7f1ec87c0640 1 -- 172.21.15.70:0/3321861844 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ec00ffad0 con 0x7f1ec0106930 2024-09-21T05:42:25.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.007+0000 7f1eb77fe640 1 -- 172.21.15.70:0/3321861844 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f1eb0010a90 con 0x7f1ec0106930 2024-09-21T05:42:25.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.007+0000 7f1eb77fe640 1 --2- 172.21.15.70:0/3321861844 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1eac0b6500 0x7f1eac0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:42:25.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.008+0000 7f1ec655c640 1 --2- 172.21.15.70:0/3321861844 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1eac0b6500 0x7f1eac0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:42:25.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.008+0000 7f1eb77fe640 1 -- 172.21.15.70:0/3321861844 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2571+0+0 (secure 0 0 0) 0x7f1eb00e5f30 con 0x7f1ec0106930 2024-09-21T05:42:25.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.008+0000 7f1ec655c640 1 --2- 172.21.15.70:0/3321861844 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1eac0b6500 0x7f1eac0b8a10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc006010 tx=0x7f1ebc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:42:25.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.012+0000 7f1eb77fe640 1 -- 172.21.15.70:0/3321861844 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1eb00b2250 con 0x7f1ec0106930 2024-09-21T05:42:25.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:25 smithi160 ceph-mon[33979]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-09-21T05:42:25.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:25 smithi160 ceph-mon[33979]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T05:42:25.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:25 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:42:25.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:25 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:42:25.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:25 smithi160 ceph-mon[33979]: Detected new or changed devices on smithi160 2024-09-21T05:42:25.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:25 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:25.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:25 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:25.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:25 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:42:25.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:25 smithi160 ceph-mon[33979]: Adjusting osd_memory_target on smithi160 to 17088M 2024-09-21T05:42:25.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:25 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:25.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:25 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:25.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:25 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:42:25.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:25 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:25.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:25.237+0000 7f1ec87c0640 1 -- 172.21.15.70:0/3321861844 --> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f1ec0063800 con 0x7f1eac0b6500 2024-09-21T05:42:25.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:25 smithi116 ceph-mon[34332]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-09-21T05:42:25.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:25 smithi116 ceph-mon[34332]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T05:42:25.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:25 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:42:25.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:25 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:42:25.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:25 smithi116 ceph-mon[34332]: Detected new or changed devices on smithi160 2024-09-21T05:42:25.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:25 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:25.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:25 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:25.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:25 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:42:25.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:25 smithi116 ceph-mon[34332]: Adjusting osd_memory_target on smithi160 to 17088M 2024-09-21T05:42:25.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:25 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:25.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:25 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:25.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:25 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:42:25.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:25 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:25.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:25 smithi070 ceph-mon[30981]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-09-21T05:42:25.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:25 smithi070 ceph-mon[30981]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T05:42:25.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:25 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:42:25.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:25 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:42:25.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:25 smithi070 ceph-mon[30981]: Detected new or changed devices on smithi160 2024-09-21T05:42:25.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:25 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:25.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:25 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:25.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:25 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:42:25.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:25 smithi070 ceph-mon[30981]: Adjusting osd_memory_target on smithi160 to 17088M 2024-09-21T05:42:25.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:25 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:25.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:25 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:25.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:25 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:42:25.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:25 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:26.358 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:26 smithi070 ceph-mon[30981]: purged_snaps scrub starts 2024-09-21T05:42:26.358 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:26 smithi070 ceph-mon[30981]: purged_snaps scrub ok 2024-09-21T05:42:26.358 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:26 smithi070 ceph-mon[30981]: osd.2 [v2:172.21.15.160:6800/69260815,v1:172.21.15.160:6801/69260815] boot 2024-09-21T05:42:26.359 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:26 smithi070 ceph-mon[30981]: osdmap e17: 3 total, 3 up, 3 in 2024-09-21T05:42:26.359 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:26 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:42:26.359 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:26 smithi070 ceph-mon[30981]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:26.359 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:26 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:42:26.359 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:26 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:42:26.359 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:26 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:26.359 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:26 smithi070 ceph-mon[30981]: pgmap v91: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:26.359 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:26 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T05:42:26.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:26 smithi160 ceph-mon[33979]: purged_snaps scrub starts 2024-09-21T05:42:26.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:26 smithi160 ceph-mon[33979]: purged_snaps scrub ok 2024-09-21T05:42:26.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:26 smithi160 ceph-mon[33979]: osd.2 [v2:172.21.15.160:6800/69260815,v1:172.21.15.160:6801/69260815] boot 2024-09-21T05:42:26.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:26 smithi160 ceph-mon[33979]: osdmap e17: 3 total, 3 up, 3 in 2024-09-21T05:42:26.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:26 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:42:26.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:26 smithi160 ceph-mon[33979]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:26.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:26 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:42:26.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:26 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:42:26.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:26 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:26.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:26 smithi160 ceph-mon[33979]: pgmap v91: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:26.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:26 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T05:42:26.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:26 smithi116 ceph-mon[34332]: purged_snaps scrub starts 2024-09-21T05:42:26.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:26 smithi116 ceph-mon[34332]: purged_snaps scrub ok 2024-09-21T05:42:26.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:26 smithi116 ceph-mon[34332]: osd.2 [v2:172.21.15.160:6800/69260815,v1:172.21.15.160:6801/69260815] boot 2024-09-21T05:42:26.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:26 smithi116 ceph-mon[34332]: osdmap e17: 3 total, 3 up, 3 in 2024-09-21T05:42:26.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:26 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:42:26.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:26 smithi116 ceph-mon[34332]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:26.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:26 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:42:26.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:26 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:42:26.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:26 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:26.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:26 smithi116 ceph-mon[34332]: pgmap v91: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:26.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:26 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T05:42:27.195 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:27 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T05:42:27.195 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:27 smithi070 ceph-mon[30981]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T05:42:27.195 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:27 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T05:42:27.195 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 21 05:42:27 smithi070 sudo[51047]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T05:42:27.195 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 21 05:42:27 smithi070 sudo[51047]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:42:27.196 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 21 05:42:27 smithi070 sudo[51047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:42:27.196 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 21 05:42:27 smithi070 sudo[51047]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:42:27.196 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 21 05:42:27 smithi070 sudo[51050]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T05:42:27.196 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 21 05:42:27 smithi070 sudo[51050]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:42:27.196 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 21 05:42:27 smithi070 sudo[51050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:42:27.196 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 21 05:42:27 smithi070 sudo[51050]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:42:27.363 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:27 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T05:42:27.363 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:27 smithi160 ceph-mon[33979]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T05:42:27.363 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:27 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T05:42:27.363 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 05:42:27 smithi160 sudo[42123]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T05:42:27.363 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 05:42:27 smithi160 sudo[42123]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:42:27.363 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 05:42:27 smithi160 sudo[42123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:42:27.364 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 05:42:27 smithi160 sudo[42123]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:42:27.364 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 05:42:27 smithi160 sudo[42126]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T05:42:27.364 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 05:42:27 smithi160 sudo[42126]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:42:27.364 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 05:42:27 smithi160 sudo[42126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:42:27.364 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 05:42:27 smithi160 sudo[42126]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:42:27.402 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:27 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T05:42:27.402 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:27 smithi116 ceph-mon[34332]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T05:42:27.403 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:27 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T05:42:27.403 INFO:journalctl@ceph.osd.1.smithi116.stdout:Sep 21 05:42:27 smithi116 sudo[41927]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T05:42:27.403 INFO:journalctl@ceph.osd.1.smithi116.stdout:Sep 21 05:42:27 smithi116 sudo[41927]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:42:27.403 INFO:journalctl@ceph.osd.1.smithi116.stdout:Sep 21 05:42:27 smithi116 sudo[41927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:42:27.403 INFO:journalctl@ceph.osd.1.smithi116.stdout:Sep 21 05:42:27 smithi116 sudo[41927]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:42:27.403 INFO:journalctl@ceph.osd.1.smithi116.stdout:Sep 21 05:42:27 smithi116 sudo[41930]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T05:42:27.403 INFO:journalctl@ceph.osd.1.smithi116.stdout:Sep 21 05:42:27 smithi116 sudo[41930]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:42:27.403 INFO:journalctl@ceph.osd.1.smithi116.stdout:Sep 21 05:42:27 smithi116 sudo[41930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:42:27.403 INFO:journalctl@ceph.osd.1.smithi116.stdout:Sep 21 05:42:27 smithi116 sudo[41930]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:42:27.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:27 smithi070 sudo[51064]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T05:42:27.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:27 smithi070 sudo[51064]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:42:27.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:27 smithi070 sudo[51064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:42:27.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:27 smithi070 sudo[51064]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:42:27.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:27 smithi070 sudo[51071]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T05:42:27.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:27 smithi070 sudo[51071]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:42:27.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:27 smithi070 sudo[51071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:42:27.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:27 smithi070 sudo[51071]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:42:27.650 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:27 smithi160 sudo[42129]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T05:42:27.650 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:27 smithi160 sudo[42129]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:42:27.650 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:27 smithi160 sudo[42129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:42:27.650 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:27 smithi160 sudo[42129]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:42:27.650 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:27 smithi160 sudo[42132]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T05:42:27.650 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:27 smithi160 sudo[42132]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:42:27.650 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:27 smithi160 sudo[42132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:42:27.650 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:27 smithi160 sudo[42132]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:42:27.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:27 smithi116 sudo[41933]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T05:42:27.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:27 smithi116 sudo[41933]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:42:27.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:27 smithi116 sudo[41933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:42:27.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:27 smithi116 sudo[41933]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:42:27.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:27 smithi116 sudo[41936]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T05:42:27.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:27 smithi116 sudo[41936]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:42:27.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:27 smithi116 sudo[41936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:42:27.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:27 smithi116 sudo[41936]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:42:28.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:28 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T05:42:28.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:28 smithi070 ceph-mon[30981]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T05:42:28.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:28 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:28.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:28 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:28.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:28 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:28.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:28 smithi070 ceph-mon[30981]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T05:42:28.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:28 smithi070 ceph-mon[30981]: pgmap v94: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:28.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:28 smithi070 ceph-mon[30981]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T05:42:28.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:28 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:42:28.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:28 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:42:28.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:28 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:42:28.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:28 smithi070 ceph-mon[30981]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T05:42:28.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:28 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:42:28.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:28 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:42:28.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:28 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:42:28.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:28 smithi070 ceph-mon[30981]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T05:42:28.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:28 smithi070 ceph-mon[30981]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T05:42:28.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:28 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:42:28.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:28 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:42:28.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:28 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:42:28.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:28 smithi070 ceph-mon[30981]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T05:42:28.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:28 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1218487570' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "25d8e9a8-3c14-43d6-9bb1-b44cd377133f"} : dispatch 2024-09-21T05:42:28.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:28 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1218487570' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "25d8e9a8-3c14-43d6-9bb1-b44cd377133f"}]': finished 2024-09-21T05:42:28.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:28 smithi070 ceph-mon[30981]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T05:42:28.247 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:28 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:42:28.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:28.321+0000 7f1eb77fe640 1 -- 172.21.15.70:0/3321861844 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f1eb00ea070 con 0x7f1ec0106930 2024-09-21T05:42:28.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:28 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T05:42:28.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:28 smithi160 ceph-mon[33979]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T05:42:28.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:28 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:28.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:28 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:28.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:28 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:28.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:28 smithi160 ceph-mon[33979]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T05:42:28.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:28 smithi160 ceph-mon[33979]: pgmap v94: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:28.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:28 smithi160 ceph-mon[33979]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T05:42:28.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:28 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:42:28.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:28 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:42:28.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:28 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:42:28.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:28 smithi160 ceph-mon[33979]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T05:42:28.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:28 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:42:28.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:28 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:42:28.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:28 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:42:28.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:28 smithi160 ceph-mon[33979]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T05:42:28.400 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:28 smithi160 ceph-mon[33979]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T05:42:28.400 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:28 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:42:28.400 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:28 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:42:28.400 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:28 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:42:28.400 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:28 smithi160 ceph-mon[33979]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T05:42:28.400 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:28 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1218487570' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "25d8e9a8-3c14-43d6-9bb1-b44cd377133f"} : dispatch 2024-09-21T05:42:28.400 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:28 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1218487570' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "25d8e9a8-3c14-43d6-9bb1-b44cd377133f"}]': finished 2024-09-21T05:42:28.400 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:28 smithi160 ceph-mon[33979]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T05:42:28.400 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:28 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:42:28.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:28 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T05:42:28.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:28 smithi116 ceph-mon[34332]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T05:42:28.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:28 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:28.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:28 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:28.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:28 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:28.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:28 smithi116 ceph-mon[34332]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T05:42:28.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:28 smithi116 ceph-mon[34332]: pgmap v94: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:28.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:28 smithi116 ceph-mon[34332]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T05:42:28.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:28 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:42:28.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:28 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:42:28.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:28 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:42:28.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:28 smithi116 ceph-mon[34332]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T05:42:28.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:28 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:42:28.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:28 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:42:28.556 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:28 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:42:28.556 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:28 smithi116 ceph-mon[34332]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T05:42:28.556 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:28 smithi116 ceph-mon[34332]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T05:42:28.556 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:28 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:42:28.556 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:28 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:42:28.556 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:28 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:42:28.556 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:28 smithi116 ceph-mon[34332]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T05:42:28.556 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:28 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1218487570' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "25d8e9a8-3c14-43d6-9bb1-b44cd377133f"} : dispatch 2024-09-21T05:42:28.556 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:28 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1218487570' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "25d8e9a8-3c14-43d6-9bb1-b44cd377133f"}]': finished 2024-09-21T05:42:28.556 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:28 smithi116 ceph-mon[34332]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T05:42:28.556 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:28 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:42:29.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:29 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2218665137' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:42:29.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:29 smithi160 ceph-mon[33979]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-21T05:42:29.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:29 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2218665137' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:42:29.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:29 smithi070 ceph-mon[30981]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-21T05:42:29.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:29 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2218665137' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:42:29.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:29 smithi116 ceph-mon[34332]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-21T05:42:30.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:30 smithi160 ceph-mon[33979]: pgmap v96: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:30.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:30 smithi070 ceph-mon[30981]: pgmap v96: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:30.535 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:30 smithi116 ceph-mon[34332]: pgmap v96: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:31.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:31 smithi160 ceph-mon[33979]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:31.744 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:31 smithi070 ceph-mon[30981]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:31.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:31 smithi116 ceph-mon[34332]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:33.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:33 smithi070 ceph-mon[30981]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:33.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:33 smithi116 ceph-mon[34332]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:33.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:33 smithi160 ceph-mon[33979]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:35.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:35 smithi070 ceph-mon[30981]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:35.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:35 smithi116 ceph-mon[34332]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:35.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:35 smithi160 ceph-mon[33979]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:36.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:36 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T05:42:36.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:36 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:36.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:36 smithi070 ceph-mon[30981]: Deploying daemon osd.3 on smithi070 2024-09-21T05:42:36.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:36 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T05:42:36.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:36 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:36.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:36 smithi116 ceph-mon[34332]: Deploying daemon osd.3 on smithi070 2024-09-21T05:42:36.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:36 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T05:42:36.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:36 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:36.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:36 smithi160 ceph-mon[33979]: Deploying daemon osd.3 on smithi070 2024-09-21T05:42:37.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:37 smithi070 ceph-mon[30981]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:37.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:37 smithi116 ceph-mon[34332]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:37.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:37 smithi160 ceph-mon[33979]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:39.609 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:39 smithi070 ceph-mon[30981]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:39.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:39 smithi116 ceph-mon[34332]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:39.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:39 smithi160 ceph-mon[33979]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:41.667 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:41 smithi070 ceph-mon[30981]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:41.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:41 smithi116 ceph-mon[34332]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:41.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:41 smithi160 ceph-mon[33979]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:42.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:42 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:42:42.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:42 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:42.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:42 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:42.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:42 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:42:42.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:42 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:42.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:42 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:43.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:42 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:42:43.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:42 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:43.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:42 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:43.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:43 smithi070 ceph-mon[30981]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:44.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:43 smithi116 ceph-mon[34332]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:44.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:43 smithi160 ceph-mon[33979]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:46.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:46 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:46.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:46 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:46.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:46 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:46.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:46 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:42:46.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:46 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:46.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:46 smithi070 ceph-mon[30981]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:46.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:46 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:46.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:46 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:46.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:46 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:46.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:46 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:42:46.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:46 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:46.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:46 smithi160 ceph-mon[33979]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:46.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:46 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:46.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:46 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:46.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:46 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:46.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:46 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:42:46.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:46 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:46.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:46 smithi116 ceph-mon[34332]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:46.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:46.634+0000 7f1eb77fe640 1 -- 172.21.15.70:0/3321861844 <== mgr.14150 v2:172.21.15.70:6800/1366013939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1ec0063800 con 0x7f1eac0b6500 2024-09-21T05:42:46.637 INFO:teuthology.orchestra.run.smithi070.stdout:Created osd(s) 3 on host 'smithi070' 2024-09-21T05:42:46.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:46.636+0000 7f1ec87c0640 1 -- 172.21.15.70:0/3321861844 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1eac0b6500 msgr2=0x7f1eac0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:42:46.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:46.636+0000 7f1ec87c0640 1 --2- 172.21.15.70:0/3321861844 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1eac0b6500 0x7f1eac0b8a10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc006010 tx=0x7f1ebc000bc0 comp rx=0 tx=0).stop 2024-09-21T05:42:46.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:46.636+0000 7f1ec87c0640 1 -- 172.21.15.70:0/3321861844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ec0106930 msgr2=0x7f1ec019a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:42:46.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:46.636+0000 7f1ec87c0640 1 --2- 172.21.15.70:0/3321861844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ec0106930 0x7f1ec019a5e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1eb000e9f0 tx=0x7f1eb000eeb0 comp rx=0 tx=0).stop 2024-09-21T05:42:46.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:46.636+0000 7f1ec87c0640 1 -- 172.21.15.70:0/3321861844 shutdown_connections 2024-09-21T05:42:46.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:46.636+0000 7f1ec87c0640 1 --2- 172.21.15.70:0/3321861844 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1eac0b6500 0x7f1eac0b8a10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:42:46.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:46.636+0000 7f1ec87c0640 1 --2- 172.21.15.70:0/3321861844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1ec0109470 0x7f1ec019b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:42:46.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:46.636+0000 7f1ec87c0640 1 --2- 172.21.15.70:0/3321861844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ec0106930 0x7f1ec019a5e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:42:46.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:46.636+0000 7f1ec87c0640 1 --2- 172.21.15.70:0/3321861844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ec006b920 0x7f1ec0199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:42:46.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:46.636+0000 7f1ec87c0640 1 -- 172.21.15.70:0/3321861844 >> 172.21.15.70:0/3321861844 conn(0x7f1ec00fdfb0 msgr2=0x7f1ec0104e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:42:46.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:46.637+0000 7f1ec87c0640 1 -- 172.21.15.70:0/3321861844 shutdown_connections 2024-09-21T05:42:46.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:42:46.637+0000 7f1ec87c0640 1 -- 172.21.15.70:0/3321861844 wait complete. 2024-09-21T05:42:47.333 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:47 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:42:47.333 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:47 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:47.333 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:47 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:47.362 DEBUG:teuthology.orchestra.run.smithi070:osd.3> sudo journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.3.service 2024-09-21T05:42:47.364 INFO:tasks.cephadm:Deploying osd.4 on smithi116 with /dev/vg_nvme/lv_3... 2024-09-21T05:42:47.364 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T05:42:47.393 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:47 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:42:47.393 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:47 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:47.393 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:47 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:47.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:47 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:42:47.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:47 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:47.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:47 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:47.620 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T05:42:48.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:48 smithi116 ceph-mon[34332]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:48.383 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:48 smithi070 ceph-mon[30981]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:48.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:48 smithi160 ceph-mon[33979]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:48.673 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 21 05:42:48 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-3[53065]: 2024-09-21T05:42:48.381+0000 7fe9cfbfd640 -1 osd.3 0 log_to_monitors true 2024-09-21T05:42:49.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:49 smithi070 ceph-mon[30981]: from='osd.3 [v2:172.21.15.70:6810/3849416072,v1:172.21.15.70:6811/3849416072]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T05:42:49.317 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:49 smithi116 ceph-mon[34332]: from='osd.3 [v2:172.21.15.70:6810/3849416072,v1:172.21.15.70:6811/3849416072]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T05:42:49.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:49 smithi160 ceph-mon[33979]: from='osd.3 [v2:172.21.15.70:6810/3849416072,v1:172.21.15.70:6811/3849416072]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T05:42:50.196 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:50 smithi116 ceph-mon[34332]: from='osd.3 [v2:172.21.15.70:6810/3849416072,v1:172.21.15.70:6811/3849416072]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T05:42:50.196 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:50 smithi116 ceph-mon[34332]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T05:42:50.196 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:50 smithi116 ceph-mon[34332]: from='osd.3 [v2:172.21.15.70:6810/3849416072,v1:172.21.15.70:6811/3849416072]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-21T05:42:50.196 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:50 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:42:50.196 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:50 smithi116 ceph-mon[34332]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:50.198 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-21T05:42:50.225 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi116:vg_nvme/lv_3 2024-09-21T05:42:50.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:50 smithi070 ceph-mon[30981]: from='osd.3 [v2:172.21.15.70:6810/3849416072,v1:172.21.15.70:6811/3849416072]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T05:42:50.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:50 smithi070 ceph-mon[30981]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T05:42:50.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:50 smithi070 ceph-mon[30981]: from='osd.3 [v2:172.21.15.70:6810/3849416072,v1:172.21.15.70:6811/3849416072]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-21T05:42:50.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:50 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:42:50.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:50 smithi070 ceph-mon[30981]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:50.245 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 21 05:42:50 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-3[53065]: 2024-09-21T05:42:50.125+0000 7fe9cbb7f640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T05:42:50.245 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 21 05:42:50 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-3[53065]: 2024-09-21T05:42:50.131+0000 7fe9c797d640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:42:50.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:50 smithi160 ceph-mon[33979]: from='osd.3 [v2:172.21.15.70:6810/3849416072,v1:172.21.15.70:6811/3849416072]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T05:42:50.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:50 smithi160 ceph-mon[33979]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T05:42:50.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:50 smithi160 ceph-mon[33979]: from='osd.3 [v2:172.21.15.70:6810/3849416072,v1:172.21.15.70:6811/3849416072]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-21T05:42:50.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:50 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:42:50.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:50 smithi160 ceph-mon[33979]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:42:50.519 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T05:42:51.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.992+0000 7fe8fa0d5640 1 -- 172.21.15.116:0/2007916873 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8f41036d0 msgr2=0x7fe8f4103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:42:51.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.992+0000 7fe8fa0d5640 1 --2- 172.21.15.116:0/2007916873 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8f41036d0 0x7fe8f4103ae0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc009900 tx=0x7fe8dc02a480 comp rx=0 tx=0).stop 2024-09-21T05:42:51.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.992+0000 7fe8fa0d5640 1 -- 172.21.15.116:0/2007916873 shutdown_connections 2024-09-21T05:42:51.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.992+0000 7fe8fa0d5640 1 --2- 172.21.15.116:0/2007916873 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8f4104070 0x7fe8f410aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:42:51.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.992+0000 7fe8fa0d5640 1 --2- 172.21.15.116:0/2007916873 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8f41036d0 0x7fe8f4103ae0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:42:51.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.992+0000 7fe8fa0d5640 1 --2- 172.21.15.116:0/2007916873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8f4102640 0x7fe8f4102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:42:51.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.992+0000 7fe8fa0d5640 1 -- 172.21.15.116:0/2007916873 >> 172.21.15.116:0/2007916873 conn(0x7fe8f40fdfb0 msgr2=0x7fe8f4100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:42:51.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.992+0000 7fe8fa0d5640 1 -- 172.21.15.116:0/2007916873 shutdown_connections 2024-09-21T05:42:51.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.992+0000 7fe8fa0d5640 1 -- 172.21.15.116:0/2007916873 wait complete. 2024-09-21T05:42:51.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.993+0000 7fe8fa0d5640 1 Processor -- start 2024-09-21T05:42:51.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.993+0000 7fe8fa0d5640 1 -- start start 2024-09-21T05:42:51.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.994+0000 7fe8fa0d5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8f4102640 0x7fe8f406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:42:51.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.994+0000 7fe8fa0d5640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8f41036d0 0x7fe8f419ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:42:51.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.994+0000 7fe8fa0d5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8f4104070 0x7fe8f41a1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:42:51.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.994+0000 7fe8fa0d5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f410e270 con 0x7fe8f4102640 2024-09-21T05:42:51.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.994+0000 7fe8fa0d5640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f410e0f0 con 0x7fe8f4104070 2024-09-21T05:42:51.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.994+0000 7fe8fa0d5640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f410e3f0 con 0x7fe8f41036d0 2024-09-21T05:42:51.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.994+0000 7fe8f37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8f4102640 0x7fe8f406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:42:51.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.994+0000 7fe8f3fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8f4104070 0x7fe8f41a1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:42:51.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.994+0000 7fe8f37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8f4102640 0x7fe8f406b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.116:58000/0 (socket says 172.21.15.116:58000) 2024-09-21T05:42:51.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.994+0000 7fe8f37fe640 1 -- 172.21.15.116:0/398431462 learned_addr learned my addr 172.21.15.116:0/398431462 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-21T05:42:51.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.994+0000 7fe8f2ffd640 1 --2- 172.21.15.116:0/398431462 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8f41036d0 0x7fe8f419ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:42:51.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.994+0000 7fe8f3fff640 1 -- 172.21.15.116:0/398431462 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8f41036d0 msgr2=0x7fe8f419ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:42:51.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.994+0000 7fe8f3fff640 1 --2- 172.21.15.116:0/398431462 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8f41036d0 0x7fe8f419ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:42:51.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.994+0000 7fe8f3fff640 1 -- 172.21.15.116:0/398431462 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8f4102640 msgr2=0x7fe8f406b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:42:51.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.994+0000 7fe8f3fff640 1 --2- 172.21.15.116:0/398431462 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8f4102640 0x7fe8f406b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:42:51.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.994+0000 7fe8f3fff640 1 -- 172.21.15.116:0/398431462 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f41a1a80 con 0x7fe8f4104070 2024-09-21T05:42:51.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.994+0000 7fe8f37fe640 1 --2- 172.21.15.116:0/398431462 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8f4102640 0x7fe8f406b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:42:51.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.994+0000 7fe8f3fff640 1 --2- 172.21.15.116:0/398431462 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8f4104070 0x7fe8f41a1260 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec00ca30 tx=0x7fe8ec00cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:42:51.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.994+0000 7fe8f0ff9640 1 -- 172.21.15.116:0/398431462 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec007d90 con 0x7fe8f4104070 2024-09-21T05:42:51.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.995+0000 7fe8fa0d5640 1 -- 172.21.15.116:0/398431462 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8f41a1d70 con 0x7fe8f4104070 2024-09-21T05:42:51.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.995+0000 7fe8f0ff9640 1 -- 172.21.15.116:0/398431462 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fe8ec005020 con 0x7fe8f4104070 2024-09-21T05:42:51.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.995+0000 7fe8f0ff9640 1 -- 172.21.15.116:0/398431462 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec00f670 con 0x7fe8f4104070 2024-09-21T05:42:51.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.995+0000 7fe8fa0d5640 1 -- 172.21.15.116:0/398431462 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8f41a2220 con 0x7fe8f4104070 2024-09-21T05:42:51.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.996+0000 7fe8fa0d5640 1 -- 172.21.15.116:0/398431462 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8f4109820 con 0x7fe8f4104070 2024-09-21T05:42:51.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.997+0000 7fe8f0ff9640 1 -- 172.21.15.116:0/398431462 <== mon.2 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fe8ec005580 con 0x7fe8f4104070 2024-09-21T05:42:51.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.998+0000 7fe8f0ff9640 1 --2- 172.21.15.116:0/398431462 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe8e00b6510 0x7fe8e00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:42:51.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.999+0000 7fe8f0ff9640 1 -- 172.21.15.116:0/398431462 <== mon.2 v2:172.21.15.116:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3389+0+0 (secure 0 0 0) 0x7fe8ec0e6600 con 0x7fe8f4104070 2024-09-21T05:42:51.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.999+0000 7fe8f37fe640 1 --2- 172.21.15.116:0/398431462 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe8e00b6510 0x7fe8e00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:42:51.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:50.999+0000 7fe8f37fe640 1 --2- 172.21.15.116:0/398431462 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe8e00b6510 0x7fe8e00b8a20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4005fd0 tx=0x7fe8e400b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:42:51.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:51.001+0000 7fe8f0ff9640 1 -- 172.21.15.116:0/398431462 <== mon.2 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe8ec014070 con 0x7fe8f4104070 2024-09-21T05:42:51.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:42:51.196+0000 7fe8fa0d5640 1 -- 172.21.15.116:0/398431462 --> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fe8f4063800 con 0x7fe8e00b6510 2024-09-21T05:42:51.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:51 smithi160 ceph-mon[33979]: from='osd.3 [v2:172.21.15.70:6810/3849416072,v1:172.21.15.70:6811/3849416072]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-21T05:42:51.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:51 smithi160 ceph-mon[33979]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T05:42:51.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:51 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:42:51.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:51 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:42:51.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:51 smithi160 ceph-mon[33979]: Detected new or changed devices on smithi070 2024-09-21T05:42:51.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:51 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:51.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:51 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:51.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:51 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:42:51.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:51 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T05:42:51.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:51 smithi160 ceph-mon[33979]: Adjusting osd_memory_target on smithi070 to 8544M 2024-09-21T05:42:51.401 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:51 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:51.401 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:51 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:51.401 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:51 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:42:51.401 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:51 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:51.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:51 smithi070 ceph-mon[30981]: from='osd.3 [v2:172.21.15.70:6810/3849416072,v1:172.21.15.70:6811/3849416072]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-21T05:42:51.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:51 smithi070 ceph-mon[30981]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T05:42:51.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:51 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:42:51.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:51 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:42:51.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:51 smithi070 ceph-mon[30981]: Detected new or changed devices on smithi070 2024-09-21T05:42:51.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:51 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:51.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:51 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:51.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:51 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:42:51.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:51 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T05:42:51.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:51 smithi070 ceph-mon[30981]: Adjusting osd_memory_target on smithi070 to 8544M 2024-09-21T05:42:51.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:51 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:51.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:51 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:51.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:51 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:42:51.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:51 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:51.516 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:51 smithi116 ceph-mon[34332]: from='osd.3 [v2:172.21.15.70:6810/3849416072,v1:172.21.15.70:6811/3849416072]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-21T05:42:51.516 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:51 smithi116 ceph-mon[34332]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T05:42:51.516 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:51 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:42:51.516 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:51 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:42:51.516 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:51 smithi116 ceph-mon[34332]: Detected new or changed devices on smithi070 2024-09-21T05:42:51.516 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:51 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:51.516 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:51 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:51.516 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:51 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:42:51.516 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:51 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T05:42:51.517 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:51 smithi116 ceph-mon[34332]: Adjusting osd_memory_target on smithi070 to 8544M 2024-09-21T05:42:51.517 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:51 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:51.517 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:51 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:51.517 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:51 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:42:51.517 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:51 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:42:52.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:52 smithi160 ceph-mon[33979]: purged_snaps scrub starts 2024-09-21T05:42:52.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:52 smithi160 ceph-mon[33979]: purged_snaps scrub ok 2024-09-21T05:42:52.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:52 smithi160 ceph-mon[33979]: osd.3 [v2:172.21.15.70:6810/3849416072,v1:172.21.15.70:6811/3849416072] boot 2024-09-21T05:42:52.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:52 smithi160 ceph-mon[33979]: osdmap e23: 4 total, 4 up, 4 in 2024-09-21T05:42:52.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:52 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:42:52.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:52 smithi160 ceph-mon[33979]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:52.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:52 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:42:52.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:52 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:42:52.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:52 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:52.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:52 smithi160 ceph-mon[33979]: pgmap v110: 1 pgs: 1 peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2024-09-21T05:42:52.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:52 smithi070 ceph-mon[30981]: purged_snaps scrub starts 2024-09-21T05:42:52.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:52 smithi070 ceph-mon[30981]: purged_snaps scrub ok 2024-09-21T05:42:52.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:52 smithi070 ceph-mon[30981]: osd.3 [v2:172.21.15.70:6810/3849416072,v1:172.21.15.70:6811/3849416072] boot 2024-09-21T05:42:52.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:52 smithi070 ceph-mon[30981]: osdmap e23: 4 total, 4 up, 4 in 2024-09-21T05:42:52.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:52 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:42:52.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:52 smithi070 ceph-mon[30981]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:52.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:52 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:42:52.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:52 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:42:52.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:52 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:52.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:52 smithi070 ceph-mon[30981]: pgmap v110: 1 pgs: 1 peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2024-09-21T05:42:52.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:52 smithi116 ceph-mon[34332]: purged_snaps scrub starts 2024-09-21T05:42:52.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:52 smithi116 ceph-mon[34332]: purged_snaps scrub ok 2024-09-21T05:42:52.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:52 smithi116 ceph-mon[34332]: osd.3 [v2:172.21.15.70:6810/3849416072,v1:172.21.15.70:6811/3849416072] boot 2024-09-21T05:42:52.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:52 smithi116 ceph-mon[34332]: osdmap e23: 4 total, 4 up, 4 in 2024-09-21T05:42:52.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:52 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:42:52.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:52 smithi116 ceph-mon[34332]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:52.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:52 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:42:52.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:52 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:42:52.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:52 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:52.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:52 smithi116 ceph-mon[34332]: pgmap v110: 1 pgs: 1 peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2024-09-21T05:42:53.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:53 smithi116 ceph-mon[34332]: osdmap e24: 4 total, 4 up, 4 in 2024-09-21T05:42:53.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:53 smithi160 ceph-mon[33979]: osdmap e24: 4 total, 4 up, 4 in 2024-09-21T05:42:53.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:53 smithi070 ceph-mon[30981]: osdmap e24: 4 total, 4 up, 4 in 2024-09-21T05:42:54.243 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:54 smithi116 ceph-mon[34332]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T05:42:54.243 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:54 smithi116 ceph-mon[34332]: pgmap v113: 1 pgs: 1 peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2024-09-21T05:42:54.243 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:54 smithi116 ceph-mon[34332]: from='client.? 172.21.15.116:0/128844607' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bdb84cbd-d718-4f69-90d0-2e732e580df6"} : dispatch 2024-09-21T05:42:54.243 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:54 smithi116 ceph-mon[34332]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bdb84cbd-d718-4f69-90d0-2e732e580df6"} : dispatch 2024-09-21T05:42:54.243 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:54 smithi116 ceph-mon[34332]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bdb84cbd-d718-4f69-90d0-2e732e580df6"}]': finished 2024-09-21T05:42:54.243 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:54 smithi116 ceph-mon[34332]: osdmap e26: 5 total, 4 up, 5 in 2024-09-21T05:42:54.243 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:54 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:42:54.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:54 smithi160 ceph-mon[33979]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T05:42:54.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:54 smithi160 ceph-mon[33979]: pgmap v113: 1 pgs: 1 peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2024-09-21T05:42:54.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:54 smithi160 ceph-mon[33979]: from='client.? 172.21.15.116:0/128844607' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bdb84cbd-d718-4f69-90d0-2e732e580df6"} : dispatch 2024-09-21T05:42:54.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:54 smithi160 ceph-mon[33979]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bdb84cbd-d718-4f69-90d0-2e732e580df6"} : dispatch 2024-09-21T05:42:54.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:54 smithi160 ceph-mon[33979]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bdb84cbd-d718-4f69-90d0-2e732e580df6"}]': finished 2024-09-21T05:42:54.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:54 smithi160 ceph-mon[33979]: osdmap e26: 5 total, 4 up, 5 in 2024-09-21T05:42:54.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:54 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:42:54.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:54 smithi070 ceph-mon[30981]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T05:42:54.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:54 smithi070 ceph-mon[30981]: pgmap v113: 1 pgs: 1 peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2024-09-21T05:42:54.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:54 smithi070 ceph-mon[30981]: from='client.? 172.21.15.116:0/128844607' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bdb84cbd-d718-4f69-90d0-2e732e580df6"} : dispatch 2024-09-21T05:42:54.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:54 smithi070 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bdb84cbd-d718-4f69-90d0-2e732e580df6"} : dispatch 2024-09-21T05:42:54.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:54 smithi070 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bdb84cbd-d718-4f69-90d0-2e732e580df6"}]': finished 2024-09-21T05:42:54.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:54 smithi070 ceph-mon[30981]: osdmap e26: 5 total, 4 up, 5 in 2024-09-21T05:42:54.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:54 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:42:55.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:55 smithi160 ceph-mon[33979]: from='client.? 172.21.15.116:0/817661924' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:42:55.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:55 smithi070 ceph-mon[30981]: from='client.? 172.21.15.116:0/817661924' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:42:55.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:55 smithi116 ceph-mon[34332]: from='client.? 172.21.15.116:0/817661924' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:42:56.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:56 smithi160 ceph-mon[33979]: pgmap v115: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-21T05:42:56.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:56 smithi070 ceph-mon[30981]: pgmap v115: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-21T05:42:56.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:56 smithi116 ceph-mon[34332]: pgmap v115: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-21T05:42:57.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:57 smithi070 ceph-mon[30981]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T05:42:57.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:57 smithi116 ceph-mon[34332]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T05:42:57.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:57 smithi160 ceph-mon[33979]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T05:42:59.506 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:42:59 smithi116 ceph-mon[34332]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-21T05:42:59.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:42:59 smithi070 ceph-mon[30981]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-21T05:42:59.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:42:59 smithi160 ceph-mon[33979]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-21T05:43:01.550 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:01 smithi116 ceph-mon[34332]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T05:43:01.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:01 smithi070 ceph-mon[30981]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T05:43:01.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:01 smithi160 ceph-mon[33979]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T05:43:02.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:02 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T05:43:02.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:02 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:02.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:02 smithi116 ceph-mon[34332]: Deploying daemon osd.4 on smithi116 2024-09-21T05:43:02.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:02 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T05:43:02.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:02 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:02.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:02 smithi070 ceph-mon[30981]: Deploying daemon osd.4 on smithi116 2024-09-21T05:43:02.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:02 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T05:43:02.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:02 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:02.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:02 smithi160 ceph-mon[33979]: Deploying daemon osd.4 on smithi116 2024-09-21T05:43:03.720 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:03 smithi116 ceph-mon[34332]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T05:43:03.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:03 smithi070 ceph-mon[30981]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T05:43:03.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:03 smithi160 ceph-mon[33979]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T05:43:05.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:05 smithi116 ceph-mon[34332]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T05:43:05.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:05 smithi070 ceph-mon[30981]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T05:43:05.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:05 smithi160 ceph-mon[33979]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T05:43:07.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:07 smithi070 ceph-mon[30981]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:43:07.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:07 smithi116 ceph-mon[34332]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:43:07.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:07 smithi160 ceph-mon[33979]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:43:08.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:08 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:08.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:08 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:08.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:08 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:09.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:08 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:09.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:08 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:09.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:08 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:09.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:08 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:09.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:08 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:09.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:08 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:09.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:09 smithi070 ceph-mon[30981]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-21T05:43:10.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:09 smithi116 ceph-mon[34332]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-21T05:43:10.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:09 smithi160 ceph-mon[33979]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-21T05:43:11.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:11 smithi116 ceph-mon[34332]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-21T05:43:11.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:11 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:11.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:11 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:11.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:11 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:11.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:11 smithi070 ceph-mon[30981]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-21T05:43:11.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:11 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:11.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:11 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:11.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:11 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:11.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:11 smithi160 ceph-mon[33979]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-21T05:43:11.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:11 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:11.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:11 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:11.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:11 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:12.713 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:12 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:43:12.713 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:12 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:12.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:12 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:43:12.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:12 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:12.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:43:12.751+0000 7fe8f0ff9640 1 -- 172.21.15.116:0/398431462 <== mgr.14150 v2:172.21.15.70:6800/1366013939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe8f4063800 con 0x7fe8e00b6510 2024-09-21T05:43:12.755 INFO:teuthology.orchestra.run.smithi116.stdout:Created osd(s) 4 on host 'smithi116' 2024-09-21T05:43:12.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:43:12.754+0000 7fe8fa0d5640 1 -- 172.21.15.116:0/398431462 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe8e00b6510 msgr2=0x7fe8e00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:12.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:43:12.754+0000 7fe8fa0d5640 1 --2- 172.21.15.116:0/398431462 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe8e00b6510 0x7fe8e00b8a20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4005fd0 tx=0x7fe8e400b480 comp rx=0 tx=0).stop 2024-09-21T05:43:12.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:43:12.754+0000 7fe8fa0d5640 1 -- 172.21.15.116:0/398431462 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8f4104070 msgr2=0x7fe8f41a1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:12.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:43:12.754+0000 7fe8fa0d5640 1 --2- 172.21.15.116:0/398431462 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8f4104070 0x7fe8f41a1260 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec00ca30 tx=0x7fe8ec00cef0 comp rx=0 tx=0).stop 2024-09-21T05:43:12.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:43:12.754+0000 7fe8fa0d5640 1 -- 172.21.15.116:0/398431462 shutdown_connections 2024-09-21T05:43:12.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:43:12.754+0000 7fe8fa0d5640 1 --2- 172.21.15.116:0/398431462 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe8e00b6510 0x7fe8e00b8a20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:12.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:43:12.754+0000 7fe8fa0d5640 1 --2- 172.21.15.116:0/398431462 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8f41036d0 0x7fe8f419ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:12.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:43:12.754+0000 7fe8fa0d5640 1 --2- 172.21.15.116:0/398431462 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8f4104070 0x7fe8f41a1260 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:12.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:43:12.754+0000 7fe8fa0d5640 1 --2- 172.21.15.116:0/398431462 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8f4102640 0x7fe8f406b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:12.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:43:12.754+0000 7fe8fa0d5640 1 -- 172.21.15.116:0/398431462 >> 172.21.15.116:0/398431462 conn(0x7fe8f40fdfb0 msgr2=0x7fe8f41069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:43:12.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:43:12.754+0000 7fe8fa0d5640 1 -- 172.21.15.116:0/398431462 shutdown_connections 2024-09-21T05:43:12.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:43:12.754+0000 7fe8fa0d5640 1 -- 172.21.15.116:0/398431462 wait complete. 2024-09-21T05:43:12.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:12 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:43:12.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:12 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:13.368 DEBUG:teuthology.orchestra.run.smithi116:osd.4> sudo journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.4.service 2024-09-21T05:43:13.370 INFO:tasks.cephadm:Deploying osd.5 on smithi160 with /dev/vg_nvme/lv_3... 2024-09-21T05:43:13.370 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T05:43:13.626 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:13 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:13.626 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:13 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:13.626 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:13 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:13.626 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:13 smithi116 ceph-mon[34332]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-21T05:43:13.628 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:43:13.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:13 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:13.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:13 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:13.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:13 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:13.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:13 smithi070 ceph-mon[30981]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-21T05:43:13.749 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:13.749 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:13.749 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:13 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:13.749 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:13 smithi160 ceph-mon[33979]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-21T05:43:14.554 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 21 05:43:14 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-4[44508]: 2024-09-21T05:43:14.279+0000 7ff869e3c640 -1 osd.4 0 log_to_monitors true 2024-09-21T05:43:14.884 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:14 smithi116 ceph-mon[34332]: from='osd.4 [v2:172.21.15.116:6808/3444857438,v1:172.21.15.116:6809/3444857438]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T05:43:14.884 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:14 smithi116 ceph-mon[34332]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T05:43:14.973 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:14 smithi160 ceph-mon[33979]: from='osd.4 [v2:172.21.15.116:6808/3444857438,v1:172.21.15.116:6809/3444857438]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T05:43:14.973 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:14 smithi160 ceph-mon[33979]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T05:43:15.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:14 smithi070 ceph-mon[30981]: from='osd.4 [v2:172.21.15.116:6808/3444857438,v1:172.21.15.116:6809/3444857438]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T05:43:15.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:14 smithi070 ceph-mon[30981]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T05:43:15.897 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:15 smithi116 ceph-mon[34332]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T05:43:15.898 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:15 smithi116 ceph-mon[34332]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T05:43:15.898 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:15 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:43:15.898 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:15 smithi116 ceph-mon[34332]: from='osd.4 [v2:172.21.15.116:6808/3444857438,v1:172.21.15.116:6809/3444857438]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]} : dispatch 2024-09-21T05:43:15.898 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:15 smithi116 ceph-mon[34332]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]} : dispatch 2024-09-21T05:43:15.898 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:15 smithi116 ceph-mon[34332]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-21T05:43:16.061 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:15 smithi160 ceph-mon[33979]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T05:43:16.062 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:15 smithi160 ceph-mon[33979]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T05:43:16.062 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:15 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:43:16.062 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:15 smithi160 ceph-mon[33979]: from='osd.4 [v2:172.21.15.116:6808/3444857438,v1:172.21.15.116:6809/3444857438]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]} : dispatch 2024-09-21T05:43:16.062 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:15 smithi160 ceph-mon[33979]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]} : dispatch 2024-09-21T05:43:16.062 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:15 smithi160 ceph-mon[33979]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-21T05:43:16.065 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-21T05:43:16.092 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi160:vg_nvme/lv_3 2024-09-21T05:43:16.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:15 smithi070 ceph-mon[30981]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T05:43:16.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:15 smithi070 ceph-mon[30981]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T05:43:16.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:15 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:43:16.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:15 smithi070 ceph-mon[30981]: from='osd.4 [v2:172.21.15.116:6808/3444857438,v1:172.21.15.116:6809/3444857438]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]} : dispatch 2024-09-21T05:43:16.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:15 smithi070 ceph-mon[30981]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]} : dispatch 2024-09-21T05:43:16.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:15 smithi070 ceph-mon[30981]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-21T05:43:16.356 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:43:16.554 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 21 05:43:16 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-4[44508]: 2024-09-21T05:43:16.201+0000 7ff865dbe640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T05:43:16.554 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 21 05:43:16 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-4[44508]: 2024-09-21T05:43:16.206+0000 7ff85dbb4640 -1 osd.4 28 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:43:16.849 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.843+0000 7f7e5a675640 1 -- 172.21.15.160:0/1316149192 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e54104880 msgr2=0x7f7e54104c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:16.849 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.843+0000 7f7e5a675640 1 --2- 172.21.15.160:0/1316149192 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e54104880 0x7f7e54104c90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7e48009900 tx=0x7f7e4802a480 comp rx=0 tx=0).stop 2024-09-21T05:43:16.849 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.843+0000 7f7e5a675640 1 -- 172.21.15.160:0/1316149192 shutdown_connections 2024-09-21T05:43:16.849 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.843+0000 7f7e5a675640 1 --2- 172.21.15.160:0/1316149192 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e54104880 0x7f7e54104c90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:16.849 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.843+0000 7f7e5a675640 1 --2- 172.21.15.160:0/1316149192 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7e54105220 0x7f7e5410bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:16.849 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.843+0000 7f7e5a675640 1 --2- 172.21.15.160:0/1316149192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e541037f0 0x7f7e54103c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:16.849 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.843+0000 7f7e5a675640 1 -- 172.21.15.160:0/1316149192 >> 172.21.15.160:0/1316149192 conn(0x7f7e540ff180 msgr2=0x7f7e54101610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:43:16.849 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.843+0000 7f7e5a675640 1 -- 172.21.15.160:0/1316149192 shutdown_connections 2024-09-21T05:43:16.849 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.843+0000 7f7e5a675640 1 -- 172.21.15.160:0/1316149192 wait complete. 2024-09-21T05:43:16.849 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.844+0000 7f7e5a675640 1 Processor -- start 2024-09-21T05:43:16.850 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.844+0000 7f7e5a675640 1 -- start start 2024-09-21T05:43:16.850 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.844+0000 7f7e5a675640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e541037f0 0x7f7e54199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:16.850 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.844+0000 7f7e5a675640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e54104880 0x7f7e5419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:16.850 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.844+0000 7f7e5a675640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7e54105220 0x7f7e5419b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:16.850 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.844+0000 7f7e5a675640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5410f3b0 con 0x7f7e54104880 2024-09-21T05:43:16.850 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.844+0000 7f7e5a675640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5410f230 con 0x7f7e54105220 2024-09-21T05:43:16.850 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.844+0000 7f7e5a675640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5410f530 con 0x7f7e541037f0 2024-09-21T05:43:16.850 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.844+0000 7f7e53fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e541037f0 0x7f7e54199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:16.850 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.844+0000 7f7e53fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e541037f0 0x7f7e54199f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:35810/0 (socket says 172.21.15.160:35810) 2024-09-21T05:43:16.850 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.844+0000 7f7e53fff640 1 -- 172.21.15.160:0/1598287726 learned_addr learned my addr 172.21.15.160:0/1598287726 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-09-21T05:43:16.850 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.844+0000 7f7e58c12640 1 --2- 172.21.15.160:0/1598287726 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7e54105220 0x7f7e5419b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:16.850 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.844+0000 7f7e537fe640 1 --2- 172.21.15.160:0/1598287726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e54104880 0x7f7e5419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:16.850 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.845+0000 7f7e53fff640 1 -- 172.21.15.160:0/1598287726 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7e54105220 msgr2=0x7f7e5419b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:16.851 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.845+0000 7f7e53fff640 1 --2- 172.21.15.160:0/1598287726 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7e54105220 0x7f7e5419b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:16.851 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.845+0000 7f7e53fff640 1 -- 172.21.15.160:0/1598287726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e54104880 msgr2=0x7f7e5419a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:16.851 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.845+0000 7f7e53fff640 1 --2- 172.21.15.160:0/1598287726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e54104880 0x7f7e5419a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:16.851 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.845+0000 7f7e53fff640 1 -- 172.21.15.160:0/1598287726 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e5419b9a0 con 0x7f7e541037f0 2024-09-21T05:43:16.851 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.845+0000 7f7e53fff640 1 --2- 172.21.15.160:0/1598287726 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e541037f0 0x7f7e54199f70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7e4400d950 tx=0x7f7e4400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:43:16.851 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.845+0000 7f7e517fa640 1 -- 172.21.15.160:0/1598287726 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e44017030 con 0x7f7e541037f0 2024-09-21T05:43:16.851 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.845+0000 7f7e5a675640 1 -- 172.21.15.160:0/1598287726 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e5419bc90 con 0x7f7e541037f0 2024-09-21T05:43:16.851 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.845+0000 7f7e5a675640 1 -- 172.21.15.160:0/1598287726 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e541a2390 con 0x7f7e541037f0 2024-09-21T05:43:16.851 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.845+0000 7f7e517fa640 1 -- 172.21.15.160:0/1598287726 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f7e44004020 con 0x7f7e541037f0 2024-09-21T05:43:16.851 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.845+0000 7f7e517fa640 1 -- 172.21.15.160:0/1598287726 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e440047a0 con 0x7f7e541037f0 2024-09-21T05:43:16.852 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.846+0000 7f7e5a675640 1 -- 172.21.15.160:0/1598287726 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e400052c0 con 0x7f7e541037f0 2024-09-21T05:43:16.852 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.848+0000 7f7e517fa640 1 -- 172.21.15.160:0/1598287726 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f7e440041d0 con 0x7f7e541037f0 2024-09-21T05:43:16.852 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.849+0000 7f7e517fa640 1 --2- 172.21.15.160:0/1598287726 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7e3c0b6590 0x7f7e3c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:16.852 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.849+0000 7f7e517fa640 1 -- 172.21.15.160:0/1598287726 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3821+0+0 (secure 0 0 0) 0x7f7e440e60b0 con 0x7f7e541037f0 2024-09-21T05:43:16.852 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.849+0000 7f7e537fe640 1 --2- 172.21.15.160:0/1598287726 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7e3c0b6590 0x7f7e3c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:16.853 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.850+0000 7f7e537fe640 1 --2- 172.21.15.160:0/1598287726 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7e3c0b6590 0x7f7e3c0b8aa0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7e48006010 tx=0x7f7e48000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:43:16.855 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:16.852+0000 7f7e517fa640 1 -- 172.21.15.160:0/1598287726 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7e440adab0 con 0x7f7e541037f0 2024-09-21T05:43:16.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:16 smithi160 ceph-mon[33979]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-21T05:43:16.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:16 smithi160 ceph-mon[33979]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T05:43:16.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:16 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:43:16.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:16 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:43:16.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:16 smithi160 ceph-mon[33979]: from='osd.4 ' entity='osd.4' 2024-09-21T05:43:16.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:16 smithi160 ceph-mon[33979]: Detected new or changed devices on smithi116 2024-09-21T05:43:16.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:16 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:16.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:16 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:16.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:16 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:43:16.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:16 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T05:43:16.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:16 smithi160 ceph-mon[33979]: Adjusting osd_memory_target on smithi116 to 8544M 2024-09-21T05:43:16.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:16 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:16.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:16 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:16.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:16 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:43:16.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:16 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:17.051 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:17.048+0000 7f7e5a675640 1 -- 172.21.15.160:0/1598287726 --> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f7e40000bf0 con 0x7f7e3c0b6590 2024-09-21T05:43:17.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:16 smithi116 ceph-mon[34332]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-21T05:43:17.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:16 smithi116 ceph-mon[34332]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T05:43:17.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:16 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:43:17.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:16 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:43:17.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:16 smithi116 ceph-mon[34332]: from='osd.4 ' entity='osd.4' 2024-09-21T05:43:17.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:16 smithi116 ceph-mon[34332]: Detected new or changed devices on smithi116 2024-09-21T05:43:17.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:16 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:17.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:16 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:17.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:16 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:43:17.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:16 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T05:43:17.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:16 smithi116 ceph-mon[34332]: Adjusting osd_memory_target on smithi116 to 8544M 2024-09-21T05:43:17.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:16 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:17.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:16 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:17.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:16 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:43:17.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:16 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:17.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:16 smithi070 ceph-mon[30981]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-21T05:43:17.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:16 smithi070 ceph-mon[30981]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T05:43:17.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:16 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:43:17.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:16 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:43:17.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:16 smithi070 ceph-mon[30981]: from='osd.4 ' entity='osd.4' 2024-09-21T05:43:17.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:16 smithi070 ceph-mon[30981]: Detected new or changed devices on smithi116 2024-09-21T05:43:17.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:16 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:17.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:16 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:17.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:16 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:43:17.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:16 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T05:43:17.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:16 smithi070 ceph-mon[30981]: Adjusting osd_memory_target on smithi116 to 8544M 2024-09-21T05:43:17.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:16 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:17.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:16 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:17.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:16 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:43:17.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:16 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:17.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:17 smithi160 ceph-mon[33979]: purged_snaps scrub starts 2024-09-21T05:43:17.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:17 smithi160 ceph-mon[33979]: purged_snaps scrub ok 2024-09-21T05:43:17.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:17 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:43:17.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:17 smithi160 ceph-mon[33979]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:17.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:17 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:43:17.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:17 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:43:17.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:17 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:17.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:17 smithi160 ceph-mon[33979]: osd.4 [v2:172.21.15.116:6808/3444857438,v1:172.21.15.116:6809/3444857438] boot 2024-09-21T05:43:17.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:17 smithi160 ceph-mon[33979]: osdmap e29: 5 total, 5 up, 5 in 2024-09-21T05:43:17.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:17 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:43:17.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:17 smithi160 ceph-mon[33979]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-21T05:43:18.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:17 smithi116 ceph-mon[34332]: purged_snaps scrub starts 2024-09-21T05:43:18.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:17 smithi116 ceph-mon[34332]: purged_snaps scrub ok 2024-09-21T05:43:18.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:17 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:43:18.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:17 smithi116 ceph-mon[34332]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:18.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:17 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:43:18.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:17 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:43:18.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:17 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:18.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:17 smithi116 ceph-mon[34332]: osd.4 [v2:172.21.15.116:6808/3444857438,v1:172.21.15.116:6809/3444857438] boot 2024-09-21T05:43:18.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:17 smithi116 ceph-mon[34332]: osdmap e29: 5 total, 5 up, 5 in 2024-09-21T05:43:18.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:17 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:43:18.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:17 smithi116 ceph-mon[34332]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-21T05:43:18.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:17 smithi070 ceph-mon[30981]: purged_snaps scrub starts 2024-09-21T05:43:18.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:17 smithi070 ceph-mon[30981]: purged_snaps scrub ok 2024-09-21T05:43:18.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:17 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:43:18.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:17 smithi070 ceph-mon[30981]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:18.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:17 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:43:18.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:17 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:43:18.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:17 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:18.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:17 smithi070 ceph-mon[30981]: osd.4 [v2:172.21.15.116:6808/3444857438,v1:172.21.15.116:6809/3444857438] boot 2024-09-21T05:43:18.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:17 smithi070 ceph-mon[30981]: osdmap e29: 5 total, 5 up, 5 in 2024-09-21T05:43:18.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:17 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:43:18.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:17 smithi070 ceph-mon[30981]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-21T05:43:19.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:19 smithi160 ceph-mon[33979]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T05:43:19.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:19 smithi070 ceph-mon[30981]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T05:43:19.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:19 smithi116 ceph-mon[34332]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T05:43:20.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:20 smithi160 ceph-mon[33979]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:20.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:20 smithi160 ceph-mon[33979]: from='client.? 172.21.15.160:0/1094173774' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a490eeba-549f-4caa-8cd5-4168a23dafa8"} : dispatch 2024-09-21T05:43:20.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:20 smithi160 ceph-mon[33979]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a490eeba-549f-4caa-8cd5-4168a23dafa8"} : dispatch 2024-09-21T05:43:20.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:20 smithi160 ceph-mon[33979]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a490eeba-549f-4caa-8cd5-4168a23dafa8"}]': finished 2024-09-21T05:43:20.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:20 smithi160 ceph-mon[33979]: osdmap e31: 6 total, 5 up, 6 in 2024-09-21T05:43:20.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:20 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:43:20.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:20 smithi160 ceph-mon[33979]: from='client.? 172.21.15.160:0/133114778' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:43:20.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:20 smithi070 ceph-mon[30981]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:20.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:20 smithi070 ceph-mon[30981]: from='client.? 172.21.15.160:0/1094173774' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a490eeba-549f-4caa-8cd5-4168a23dafa8"} : dispatch 2024-09-21T05:43:20.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:20 smithi070 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a490eeba-549f-4caa-8cd5-4168a23dafa8"} : dispatch 2024-09-21T05:43:20.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:20 smithi070 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a490eeba-549f-4caa-8cd5-4168a23dafa8"}]': finished 2024-09-21T05:43:20.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:20 smithi070 ceph-mon[30981]: osdmap e31: 6 total, 5 up, 6 in 2024-09-21T05:43:20.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:20 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:43:20.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:20 smithi070 ceph-mon[30981]: from='client.? 172.21.15.160:0/133114778' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:43:20.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:20 smithi116 ceph-mon[34332]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:20.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:20 smithi116 ceph-mon[34332]: from='client.? 172.21.15.160:0/1094173774' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a490eeba-549f-4caa-8cd5-4168a23dafa8"} : dispatch 2024-09-21T05:43:20.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:20 smithi116 ceph-mon[34332]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a490eeba-549f-4caa-8cd5-4168a23dafa8"} : dispatch 2024-09-21T05:43:20.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:20 smithi116 ceph-mon[34332]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a490eeba-549f-4caa-8cd5-4168a23dafa8"}]': finished 2024-09-21T05:43:20.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:20 smithi116 ceph-mon[34332]: osdmap e31: 6 total, 5 up, 6 in 2024-09-21T05:43:20.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:20 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:43:20.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:20 smithi116 ceph-mon[34332]: from='client.? 172.21.15.160:0/133114778' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:43:21.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:21 smithi070 ceph-mon[30981]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:21.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:21 smithi116 ceph-mon[34332]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:21.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:21 smithi160 ceph-mon[33979]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:23.700 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:23 smithi160 ceph-mon[33979]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:23.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:23 smithi070 ceph-mon[30981]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:23.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:23 smithi116 ceph-mon[34332]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:25.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:25 smithi160 ceph-mon[33979]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:25.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:25 smithi070 ceph-mon[30981]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:25.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:25 smithi116 ceph-mon[34332]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:27.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:27 smithi070 ceph-mon[30981]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:27.784 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:27 smithi160 ceph-mon[33979]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:27.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:27 smithi116 ceph-mon[34332]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:28.738 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:28 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T05:43:28.738 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:28 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:28.738 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:28 smithi160 ceph-mon[33979]: Deploying daemon osd.5 on smithi160 2024-09-21T05:43:28.744 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:28 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T05:43:28.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:28 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:28.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:28 smithi070 ceph-mon[30981]: Deploying daemon osd.5 on smithi160 2024-09-21T05:43:28.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:28 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T05:43:28.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:28 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:28.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:28 smithi116 ceph-mon[34332]: Deploying daemon osd.5 on smithi160 2024-09-21T05:43:29.708 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:29 smithi160 ceph-mon[33979]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:29.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:29 smithi070 ceph-mon[30981]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:29.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:29 smithi116 ceph-mon[34332]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:31.599 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:31 smithi160 ceph-mon[33979]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:31.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:31 smithi070 ceph-mon[30981]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:31.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:31 smithi116 ceph-mon[34332]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:33.589 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:33 smithi160 ceph-mon[33979]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:33.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:33 smithi070 ceph-mon[30981]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:33.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:33 smithi116 ceph-mon[34332]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:34.797 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:34 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:34.797 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:34 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:34.797 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:34 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:35.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:34 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:35.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:34 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:35.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:34 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:35.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:34 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:35.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:34 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:35.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:34 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:36.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:35 smithi116 ceph-mon[34332]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:36.087 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:35 smithi160 ceph-mon[33979]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:36.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:35 smithi070 ceph-mon[30981]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:38.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:38 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:38.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:38 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:38.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:38 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:38.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:38 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:43:38.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:38 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:38.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:38 smithi160 ceph-mon[33979]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:38.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:38 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:38.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:38 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:38.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:38 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:38.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:38 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:43:38.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:38 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:38.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:38 smithi070 ceph-mon[30981]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:38.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:38 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:38.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:38 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:38.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:38 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:38.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:38 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:43:38.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:38 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:38.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:38 smithi116 ceph-mon[34332]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:38.808 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:38.806+0000 7f7e517fa640 1 -- 172.21.15.160:0/1598287726 <== mgr.14150 v2:172.21.15.70:6800/1366013939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7e40000bf0 con 0x7f7e3c0b6590 2024-09-21T05:43:38.808 INFO:teuthology.orchestra.run.smithi160.stdout:Created osd(s) 5 on host 'smithi160' 2024-09-21T05:43:38.811 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:38.809+0000 7f7e5a675640 1 -- 172.21.15.160:0/1598287726 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7e3c0b6590 msgr2=0x7f7e3c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:38.811 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:38.809+0000 7f7e5a675640 1 --2- 172.21.15.160:0/1598287726 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7e3c0b6590 0x7f7e3c0b8aa0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7e48006010 tx=0x7f7e48000bc0 comp rx=0 tx=0).stop 2024-09-21T05:43:38.811 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:38.809+0000 7f7e5a675640 1 -- 172.21.15.160:0/1598287726 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e541037f0 msgr2=0x7f7e54199f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:38.812 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:38.809+0000 7f7e5a675640 1 --2- 172.21.15.160:0/1598287726 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e541037f0 0x7f7e54199f70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7e4400d950 tx=0x7f7e4400de10 comp rx=0 tx=0).stop 2024-09-21T05:43:38.812 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:38.809+0000 7f7e5a675640 1 -- 172.21.15.160:0/1598287726 shutdown_connections 2024-09-21T05:43:38.812 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:38.809+0000 7f7e5a675640 1 --2- 172.21.15.160:0/1598287726 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7e3c0b6590 0x7f7e3c0b8aa0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:38.812 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:38.809+0000 7f7e5a675640 1 --2- 172.21.15.160:0/1598287726 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7e54105220 0x7f7e5419b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:38.812 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:38.809+0000 7f7e5a675640 1 --2- 172.21.15.160:0/1598287726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e54104880 0x7f7e5419a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:38.812 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:38.809+0000 7f7e5a675640 1 --2- 172.21.15.160:0/1598287726 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e541037f0 0x7f7e54199f70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:38.812 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:38.809+0000 7f7e5a675640 1 -- 172.21.15.160:0/1598287726 >> 172.21.15.160:0/1598287726 conn(0x7f7e540ff180 msgr2=0x7f7e54107ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:43:38.812 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:38.809+0000 7f7e5a675640 1 -- 172.21.15.160:0/1598287726 shutdown_connections 2024-09-21T05:43:38.812 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:43:38.809+0000 7f7e5a675640 1 -- 172.21.15.160:0/1598287726 wait complete. 2024-09-21T05:43:39.414 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:39 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:39.414 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:39 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:39.414 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:39 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:39.441 DEBUG:teuthology.orchestra.run.smithi160:osd.5> sudo journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.5.service 2024-09-21T05:43:39.443 INFO:tasks.cephadm:Deploying osd.6 on smithi070 with /dev/vg_nvme/lv_2... 2024-09-21T05:43:39.443 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T05:43:39.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:39 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:39.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:39 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:39.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:39 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:39.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:39 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:39.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:39 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:39.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:39 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:39.699 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:40.362 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:40 smithi160 ceph-mon[33979]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:40.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:40 smithi070 ceph-mon[30981]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:40.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:40 smithi116 ceph-mon[34332]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:41.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:41 smithi160 ceph-mon[33979]: from='osd.5 [v2:172.21.15.160:6808/3063220427,v1:172.21.15.160:6809/3063220427]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T05:43:41.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:41 smithi160 ceph-mon[33979]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T05:43:41.399 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:43:40 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:43:40.959+0000 7f1b9225b640 -1 osd.5 0 log_to_monitors true 2024-09-21T05:43:41.483 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:41 smithi070 ceph-mon[30981]: from='osd.5 [v2:172.21.15.160:6808/3063220427,v1:172.21.15.160:6809/3063220427]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T05:43:41.483 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:41 smithi070 ceph-mon[30981]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T05:43:41.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:41 smithi116 ceph-mon[34332]: from='osd.5 [v2:172.21.15.160:6808/3063220427,v1:172.21.15.160:6809/3063220427]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T05:43:41.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:41 smithi116 ceph-mon[34332]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T05:43:42.380 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:42 smithi160 ceph-mon[33979]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T05:43:42.380 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:42 smithi160 ceph-mon[33979]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T05:43:42.380 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:42 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:43:42.380 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:42 smithi160 ceph-mon[33979]: from='osd.5 [v2:172.21.15.160:6808/3063220427,v1:172.21.15.160:6809/3063220427]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]} : dispatch 2024-09-21T05:43:42.380 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:42 smithi160 ceph-mon[33979]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]} : dispatch 2024-09-21T05:43:42.380 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:42 smithi160 ceph-mon[33979]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:42.413 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:42 smithi070 ceph-mon[30981]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T05:43:42.413 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:42 smithi070 ceph-mon[30981]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T05:43:42.413 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:42 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:43:42.413 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:42 smithi070 ceph-mon[30981]: from='osd.5 [v2:172.21.15.160:6808/3063220427,v1:172.21.15.160:6809/3063220427]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]} : dispatch 2024-09-21T05:43:42.413 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:42 smithi070 ceph-mon[30981]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]} : dispatch 2024-09-21T05:43:42.413 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:42 smithi070 ceph-mon[30981]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:42.416 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:43:42.447 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi070:vg_nvme/lv_2 2024-09-21T05:43:42.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:42 smithi116 ceph-mon[34332]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T05:43:42.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:42 smithi116 ceph-mon[34332]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T05:43:42.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:42 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:43:42.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:42 smithi116 ceph-mon[34332]: from='osd.5 [v2:172.21.15.160:6808/3063220427,v1:172.21.15.160:6809/3063220427]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]} : dispatch 2024-09-21T05:43:42.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:42 smithi116 ceph-mon[34332]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]} : dispatch 2024-09-21T05:43:42.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:42 smithi116 ceph-mon[34332]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:42.648 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:43:42 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:43:42.619+0000 7f1b8e1dd640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T05:43:42.648 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:43:42 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:43:42.624+0000 7f1b85fd3640 -1 osd.5 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:43:42.745 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:43.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.226+0000 7fe74bd1c640 1 -- 172.21.15.70:0/2227381412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe7441037f0 msgr2=0x7fe74410a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:43.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.226+0000 7fe74bd1c640 1 --2- 172.21.15.70:0/2227381412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe7441037f0 0x7fe74410a190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe73c009ca0 tx=0x7fe73c02a950 comp rx=0 tx=0).stop 2024-09-21T05:43:43.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.226+0000 7fe74bd1c640 1 -- 172.21.15.70:0/2227381412 shutdown_connections 2024-09-21T05:43:43.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.226+0000 7fe74bd1c640 1 --2- 172.21.15.70:0/2227381412 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe744102e50 0x7fe744103260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:43.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.226+0000 7fe74bd1c640 1 --2- 172.21.15.70:0/2227381412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe7441037f0 0x7fe74410a190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:43.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.226+0000 7fe74bd1c640 1 --2- 172.21.15.70:0/2227381412 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe744101dc0 0x7fe744102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:43.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.226+0000 7fe74bd1c640 1 -- 172.21.15.70:0/2227381412 >> 172.21.15.70:0/2227381412 conn(0x7fe7440fd770 msgr2=0x7fe7440ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:43:43.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.226+0000 7fe74bd1c640 1 -- 172.21.15.70:0/2227381412 shutdown_connections 2024-09-21T05:43:43.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.226+0000 7fe74bd1c640 1 -- 172.21.15.70:0/2227381412 wait complete. 2024-09-21T05:43:43.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.227+0000 7fe74bd1c640 1 Processor -- start 2024-09-21T05:43:43.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.227+0000 7fe74bd1c640 1 -- start start 2024-09-21T05:43:43.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.227+0000 7fe74bd1c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe744101dc0 0x7fe74410d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:43.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.227+0000 7fe74bd1c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe744102e50 0x7fe74410bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:43.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.227+0000 7fe74bd1c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7441037f0 0x7fe74410c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:43.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.227+0000 7fe74bd1c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe74410f380 con 0x7fe744101dc0 2024-09-21T05:43:43.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.227+0000 7fe74bd1c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe74410f200 con 0x7fe744102e50 2024-09-21T05:43:43.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.227+0000 7fe74bd1c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe74410f500 con 0x7fe7441037f0 2024-09-21T05:43:43.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.227+0000 7fe749ab8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe744101dc0 0x7fe74410d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:43.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.227+0000 7fe749ab8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe744101dc0 0x7fe74410d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36098/0 (socket says 172.21.15.70:36098) 2024-09-21T05:43:43.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.227+0000 7fe749ab8640 1 -- 172.21.15.70:0/2525979359 learned_addr learned my addr 172.21.15.70:0/2525979359 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:43:43.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.227+0000 7fe74a2b9640 1 --2- 172.21.15.70:0/2525979359 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7441037f0 0x7fe74410c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:43.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.227+0000 7fe7492b7640 1 --2- 172.21.15.70:0/2525979359 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe744102e50 0x7fe74410bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:43.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.228+0000 7fe749ab8640 1 -- 172.21.15.70:0/2525979359 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7441037f0 msgr2=0x7fe74410c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:43.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.228+0000 7fe749ab8640 1 --2- 172.21.15.70:0/2525979359 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7441037f0 0x7fe74410c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:43.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.228+0000 7fe749ab8640 1 -- 172.21.15.70:0/2525979359 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe744102e50 msgr2=0x7fe74410bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:43.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.228+0000 7fe749ab8640 1 --2- 172.21.15.70:0/2525979359 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe744102e50 0x7fe74410bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:43.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.228+0000 7fe749ab8640 1 -- 172.21.15.70:0/2525979359 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe74410c690 con 0x7fe744101dc0 2024-09-21T05:43:43.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.228+0000 7fe749ab8640 1 --2- 172.21.15.70:0/2525979359 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe744101dc0 0x7fe74410d210 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe74000c920 tx=0x7fe74000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:43:43.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.228+0000 7fe73affd640 1 -- 172.21.15.70:0/2525979359 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe740007c70 con 0x7fe744101dc0 2024-09-21T05:43:43.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.228+0000 7fe73affd640 1 -- 172.21.15.70:0/2525979359 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fe740007e10 con 0x7fe744101dc0 2024-09-21T05:43:43.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.228+0000 7fe74bd1c640 1 -- 172.21.15.70:0/2525979359 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7441a3fd0 con 0x7fe744101dc0 2024-09-21T05:43:43.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.228+0000 7fe73affd640 1 -- 172.21.15.70:0/2525979359 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7400187b0 con 0x7fe744101dc0 2024-09-21T05:43:43.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.228+0000 7fe74bd1c640 1 -- 172.21.15.70:0/2525979359 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7441a4370 con 0x7fe744101dc0 2024-09-21T05:43:43.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.229+0000 7fe74bd1c640 1 -- 172.21.15.70:0/2525979359 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe744102230 con 0x7fe744101dc0 2024-09-21T05:43:43.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.232+0000 7fe73affd640 1 -- 172.21.15.70:0/2525979359 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fe740018970 con 0x7fe744101dc0 2024-09-21T05:43:43.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.233+0000 7fe73affd640 1 --2- 172.21.15.70:0/2525979359 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe7300b6590 0x7fe7300b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:43.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.233+0000 7fe7492b7640 1 --2- 172.21.15.70:0/2525979359 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe7300b6590 0x7fe7300b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:43.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.233+0000 7fe73affd640 1 -- 172.21.15.70:0/2525979359 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4286+0+0 (secure 0 0 0) 0x7fe7400e65d0 con 0x7fe744101dc0 2024-09-21T05:43:43.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.234+0000 7fe7492b7640 1 --2- 172.21.15.70:0/2525979359 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe7300b6590 0x7fe7300b8aa0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe734005fd0 tx=0x7fe73400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:43:43.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.236+0000 7fe73affd640 1 -- 172.21.15.70:0/2525979359 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe740014030 con 0x7fe744101dc0 2024-09-21T05:43:43.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:43:43.430+0000 7fe74bd1c640 1 -- 172.21.15.70:0/2525979359 --> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fe744063800 con 0x7fe7300b6590 2024-09-21T05:43:43.432 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:43 smithi070 ceph-mon[30981]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-09-21T05:43:43.433 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:43 smithi070 ceph-mon[30981]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T05:43:43.433 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:43 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:43:43.433 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:43 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:43:43.433 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:43 smithi070 ceph-mon[30981]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T05:43:43.433 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:43 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:43:43.433 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:43 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:43.433 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:43 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:43.433 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:43 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:43:43.433 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:43 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T05:43:43.433 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:43 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:43.433 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:43 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:43.433 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:43 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:43:43.433 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:43 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:43.433 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:43 smithi070 ceph-mon[30981]: from='osd.5 ' entity='osd.5' 2024-09-21T05:43:43.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:43 smithi116 ceph-mon[34332]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-09-21T05:43:43.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:43 smithi116 ceph-mon[34332]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T05:43:43.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:43 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:43:43.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:43 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:43:43.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:43 smithi116 ceph-mon[34332]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T05:43:43.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:43 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:43:43.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:43 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:43.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:43 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:43.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:43 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:43:43.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:43 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T05:43:43.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:43 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:43.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:43 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:43.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:43 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:43:43.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:43 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:43.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:43 smithi116 ceph-mon[34332]: from='osd.5 ' entity='osd.5' 2024-09-21T05:43:43.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:43 smithi160 ceph-mon[33979]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-09-21T05:43:43.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:43 smithi160 ceph-mon[33979]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T05:43:43.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:43 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:43:43.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:43 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:43:43.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:43 smithi160 ceph-mon[33979]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T05:43:43.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:43 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:43:43.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:43 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:43.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:43 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:43.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:43 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:43:43.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:43 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T05:43:43.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:43 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:43.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:43 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:43.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:43 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:43:43.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:43 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:43:43.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:43 smithi160 ceph-mon[33979]: from='osd.5 ' entity='osd.5' 2024-09-21T05:43:44.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:44 smithi070 ceph-mon[30981]: purged_snaps scrub starts 2024-09-21T05:43:44.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:44 smithi070 ceph-mon[30981]: purged_snaps scrub ok 2024-09-21T05:43:44.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:44 smithi070 ceph-mon[30981]: Detected new or changed devices on smithi160 2024-09-21T05:43:44.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:44 smithi070 ceph-mon[30981]: Adjusting osd_memory_target on smithi160 to 8544M 2024-09-21T05:43:44.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:44 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:43:44.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:44 smithi070 ceph-mon[30981]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:44.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:44 smithi070 ceph-mon[30981]: osd.5 [v2:172.21.15.160:6808/3063220427,v1:172.21.15.160:6809/3063220427] boot 2024-09-21T05:43:44.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:44 smithi070 ceph-mon[30981]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T05:43:44.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:44 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:43:44.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:44 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:43:44.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:44 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:43:44.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:44 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:44.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:44 smithi116 ceph-mon[34332]: purged_snaps scrub starts 2024-09-21T05:43:44.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:44 smithi116 ceph-mon[34332]: purged_snaps scrub ok 2024-09-21T05:43:44.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:44 smithi116 ceph-mon[34332]: Detected new or changed devices on smithi160 2024-09-21T05:43:44.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:44 smithi116 ceph-mon[34332]: Adjusting osd_memory_target on smithi160 to 8544M 2024-09-21T05:43:44.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:44 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:43:44.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:44 smithi116 ceph-mon[34332]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:44.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:44 smithi116 ceph-mon[34332]: osd.5 [v2:172.21.15.160:6808/3063220427,v1:172.21.15.160:6809/3063220427] boot 2024-09-21T05:43:44.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:44 smithi116 ceph-mon[34332]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T05:43:44.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:44 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:43:44.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:44 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:43:44.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:44 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:43:44.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:44 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:44.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:44 smithi160 ceph-mon[33979]: purged_snaps scrub starts 2024-09-21T05:43:44.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:44 smithi160 ceph-mon[33979]: purged_snaps scrub ok 2024-09-21T05:43:44.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:44 smithi160 ceph-mon[33979]: Detected new or changed devices on smithi160 2024-09-21T05:43:44.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:44 smithi160 ceph-mon[33979]: Adjusting osd_memory_target on smithi160 to 8544M 2024-09-21T05:43:44.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:44 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:43:44.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:44 smithi160 ceph-mon[33979]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:43:44.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:44 smithi160 ceph-mon[33979]: osd.5 [v2:172.21.15.160:6808/3063220427,v1:172.21.15.160:6809/3063220427] boot 2024-09-21T05:43:44.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:44 smithi160 ceph-mon[33979]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T05:43:44.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:44 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:43:44.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:44 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:43:44.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:44 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:43:44.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:44 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:45.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:45 smithi070 ceph-mon[30981]: from='client.14523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:45.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:45 smithi070 ceph-mon[30981]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T05:43:45.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:45 smithi116 ceph-mon[34332]: from='client.14523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:45.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:45 smithi116 ceph-mon[34332]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T05:43:45.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:45 smithi160 ceph-mon[33979]: from='client.14523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:45.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:45 smithi160 ceph-mon[33979]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T05:43:46.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:46 smithi070 ceph-mon[30981]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:43:46.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:46 smithi070 ceph-mon[30981]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T05:43:46.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:46 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/99977251' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1bf22f48-c02f-4f09-b0fe-2597a55fd795"} : dispatch 2024-09-21T05:43:46.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:46 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/99977251' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1bf22f48-c02f-4f09-b0fe-2597a55fd795"}]': finished 2024-09-21T05:43:46.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:46 smithi070 ceph-mon[30981]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T05:43:46.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:46 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:43:46.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:46 smithi116 ceph-mon[34332]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:43:46.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:46 smithi116 ceph-mon[34332]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T05:43:46.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:46 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/99977251' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1bf22f48-c02f-4f09-b0fe-2597a55fd795"} : dispatch 2024-09-21T05:43:46.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:46 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/99977251' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1bf22f48-c02f-4f09-b0fe-2597a55fd795"}]': finished 2024-09-21T05:43:46.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:46 smithi116 ceph-mon[34332]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T05:43:46.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:46 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:43:46.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:46 smithi160 ceph-mon[33979]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:43:46.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:46 smithi160 ceph-mon[33979]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T05:43:46.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:46 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/99977251' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1bf22f48-c02f-4f09-b0fe-2597a55fd795"} : dispatch 2024-09-21T05:43:46.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:46 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/99977251' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1bf22f48-c02f-4f09-b0fe-2597a55fd795"}]': finished 2024-09-21T05:43:46.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:46 smithi160 ceph-mon[33979]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T05:43:46.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:46 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:43:47.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:47 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2336545533' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:43:47.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:47 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2336545533' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:43:47.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:47 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2336545533' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:43:48.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:48 smithi070 ceph-mon[30981]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T05:43:48.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:48 smithi116 ceph-mon[34332]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T05:43:48.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:48 smithi160 ceph-mon[33979]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T05:43:49.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:49 smithi070 ceph-mon[30981]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-21T05:43:49.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:49 smithi116 ceph-mon[34332]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-21T05:43:49.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:49 smithi160 ceph-mon[33979]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-21T05:43:51.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:51 smithi070 ceph-mon[30981]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-21T05:43:51.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:51 smithi116 ceph-mon[34332]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-21T05:43:51.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:51 smithi160 ceph-mon[33979]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-21T05:43:53.483 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:53 smithi070 ceph-mon[30981]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T05:43:53.700 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:53 smithi160 ceph-mon[33979]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T05:43:53.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:53 smithi116 ceph-mon[34332]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T05:43:55.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:54 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T05:43:55.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:54 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:55.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:54 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T05:43:55.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:54 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:55.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:54 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T05:43:55.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:54 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:56.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:55 smithi116 ceph-mon[34332]: Deploying daemon osd.6 on smithi070 2024-09-21T05:43:56.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:55 smithi116 ceph-mon[34332]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T05:43:56.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:55 smithi160 ceph-mon[33979]: Deploying daemon osd.6 on smithi070 2024-09-21T05:43:56.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:55 smithi160 ceph-mon[33979]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T05:43:56.169 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:55 smithi070 ceph-mon[30981]: Deploying daemon osd.6 on smithi070 2024-09-21T05:43:56.169 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:55 smithi070 ceph-mon[30981]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T05:43:57.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:57 smithi070 ceph-mon[30981]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:43:57.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:57 smithi116 ceph-mon[34332]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:43:57.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:57 smithi160 ceph-mon[33979]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:43:59.738 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:43:59 smithi070 ceph-mon[30981]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:43:59.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:43:59 smithi116 ceph-mon[34332]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:43:59.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:43:59 smithi160 ceph-mon[33979]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:44:01.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:01 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:01.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:01 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:01.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:01 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:01.477 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:01 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:01.478 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:01 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:01.478 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:01 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:01.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:01 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:01.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:01 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:01.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:01 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:02.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:02 smithi160 ceph-mon[33979]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:44:02.412 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:02 smithi070 ceph-mon[30981]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:44:02.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:02 smithi116 ceph-mon[34332]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:44:03.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:03 smithi070 ceph-mon[30981]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:44:03.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:03 smithi116 ceph-mon[34332]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:44:03.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:03 smithi160 ceph-mon[33979]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:44:04.938 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:04 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:04.938 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:04 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:04.938 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:04 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:04.938 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:04 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:04.938 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:04 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:04.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:44:04.979+0000 7fe73affd640 1 -- 172.21.15.70:0/2525979359 <== mgr.14150 v2:172.21.15.70:6800/1366013939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe744063800 con 0x7fe7300b6590 2024-09-21T05:44:04.981 INFO:teuthology.orchestra.run.smithi070.stdout:Created osd(s) 6 on host 'smithi070' 2024-09-21T05:44:04.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:44:04.981+0000 7fe74bd1c640 1 -- 172.21.15.70:0/2525979359 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe7300b6590 msgr2=0x7fe7300b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:04.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:44:04.981+0000 7fe74bd1c640 1 --2- 172.21.15.70:0/2525979359 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe7300b6590 0x7fe7300b8aa0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe734005fd0 tx=0x7fe73400b390 comp rx=0 tx=0).stop 2024-09-21T05:44:04.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:44:04.981+0000 7fe74bd1c640 1 -- 172.21.15.70:0/2525979359 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe744101dc0 msgr2=0x7fe74410d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:04.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:44:04.981+0000 7fe74bd1c640 1 --2- 172.21.15.70:0/2525979359 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe744101dc0 0x7fe74410d210 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe74000c920 tx=0x7fe74000cde0 comp rx=0 tx=0).stop 2024-09-21T05:44:04.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:44:04.981+0000 7fe74bd1c640 1 -- 172.21.15.70:0/2525979359 shutdown_connections 2024-09-21T05:44:04.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:44:04.981+0000 7fe74bd1c640 1 --2- 172.21.15.70:0/2525979359 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe7300b6590 0x7fe7300b8aa0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:04.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:44:04.981+0000 7fe74bd1c640 1 --2- 172.21.15.70:0/2525979359 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7441037f0 0x7fe74410c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:04.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:44:04.981+0000 7fe74bd1c640 1 --2- 172.21.15.70:0/2525979359 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe744102e50 0x7fe74410bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:04.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:44:04.981+0000 7fe74bd1c640 1 --2- 172.21.15.70:0/2525979359 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe744101dc0 0x7fe74410d210 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:04.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:44:04.981+0000 7fe74bd1c640 1 -- 172.21.15.70:0/2525979359 >> 172.21.15.70:0/2525979359 conn(0x7fe7440fd770 msgr2=0x7fe744106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:04.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:44:04.981+0000 7fe74bd1c640 1 -- 172.21.15.70:0/2525979359 shutdown_connections 2024-09-21T05:44:04.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:44:04.981+0000 7fe74bd1c640 1 -- 172.21.15.70:0/2525979359 wait complete. 2024-09-21T05:44:05.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:04 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:05.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:04 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:05.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:04 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:05.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:04 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:05.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:04 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:05.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:04 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:05.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:04 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:05.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:04 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:05.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:04 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:05.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:04 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:05.719 DEBUG:teuthology.orchestra.run.smithi070:osd.6> sudo journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.6.service 2024-09-21T05:44:05.721 INFO:tasks.cephadm:Deploying osd.7 on smithi116 with /dev/vg_nvme/lv_2... 2024-09-21T05:44:05.721 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T05:44:05.977 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T05:44:05.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:05 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:05.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:05 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:05.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:05 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:05.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:05 smithi070 ceph-mon[30981]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:44:06.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:05 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:06.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:05 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:06.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:05 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:06.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:05 smithi116 ceph-mon[34332]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:44:06.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:05 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:06.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:05 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:06.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:05 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:06.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:05 smithi160 ceph-mon[33979]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:44:06.978 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:44:06 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:44:06.862+0000 7fa8a5d96640 -1 osd.6 0 log_to_monitors true 2024-09-21T05:44:07.110 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:06 smithi116 ceph-mon[34332]: from='osd.6 [v2:172.21.15.70:6818/3650315688,v1:172.21.15.70:6819/3650315688]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T05:44:07.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:06 smithi070 ceph-mon[30981]: from='osd.6 [v2:172.21.15.70:6818/3650315688,v1:172.21.15.70:6819/3650315688]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T05:44:07.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:06 smithi160 ceph-mon[33979]: from='osd.6 [v2:172.21.15.70:6818/3650315688,v1:172.21.15.70:6819/3650315688]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T05:44:08.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:07 smithi116 ceph-mon[34332]: from='osd.6 [v2:172.21.15.70:6818/3650315688,v1:172.21.15.70:6819/3650315688]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T05:44:08.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:07 smithi116 ceph-mon[34332]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T05:44:08.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:07 smithi116 ceph-mon[34332]: from='osd.6 [v2:172.21.15.70:6818/3650315688,v1:172.21.15.70:6819/3650315688]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-21T05:44:08.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:07 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:44:08.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:07 smithi116 ceph-mon[34332]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:44:08.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:07 smithi070 ceph-mon[30981]: from='osd.6 [v2:172.21.15.70:6818/3650315688,v1:172.21.15.70:6819/3650315688]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T05:44:08.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:07 smithi070 ceph-mon[30981]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T05:44:08.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:07 smithi070 ceph-mon[30981]: from='osd.6 [v2:172.21.15.70:6818/3650315688,v1:172.21.15.70:6819/3650315688]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-21T05:44:08.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:07 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:44:08.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:07 smithi070 ceph-mon[30981]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:44:08.246 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:44:07 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:44:07.994+0000 7fa8a1d18640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T05:44:08.246 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:44:08 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:44:08.002+0000 7fa89db16640 -1 osd.6 40 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:44:08.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:07 smithi160 ceph-mon[33979]: from='osd.6 [v2:172.21.15.70:6818/3650315688,v1:172.21.15.70:6819/3650315688]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T05:44:08.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:07 smithi160 ceph-mon[33979]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T05:44:08.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:07 smithi160 ceph-mon[33979]: from='osd.6 [v2:172.21.15.70:6818/3650315688,v1:172.21.15.70:6819/3650315688]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-21T05:44:08.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:07 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:44:08.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:07 smithi160 ceph-mon[33979]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:44:08.579 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-21T05:44:08.607 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi116:vg_nvme/lv_2 2024-09-21T05:44:08.861 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T05:44:09.152 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:08 smithi116 ceph-mon[34332]: from='osd.6 [v2:172.21.15.70:6818/3650315688,v1:172.21.15.70:6819/3650315688]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-21T05:44:09.152 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:08 smithi116 ceph-mon[34332]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T05:44:09.152 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:08 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:44:09.153 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:08 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:44:09.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.373+0000 7f543a8d8640 1 -- 172.21.15.116:0/4094587963 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5434104070 msgr2=0x7f543410aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:09.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.373+0000 7f543a8d8640 1 --2- 172.21.15.116:0/4094587963 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5434104070 0x7f543410aa10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f542c009ca0 tx=0x7f542c02a950 comp rx=0 tx=0).stop 2024-09-21T05:44:09.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.373+0000 7f543a8d8640 1 -- 172.21.15.116:0/4094587963 shutdown_connections 2024-09-21T05:44:09.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.373+0000 7f543a8d8640 1 --2- 172.21.15.116:0/4094587963 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5434104070 0x7f543410aa10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:09.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.373+0000 7f543a8d8640 1 --2- 172.21.15.116:0/4094587963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54341036d0 0x7f5434103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:09.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.373+0000 7f543a8d8640 1 --2- 172.21.15.116:0/4094587963 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5434102640 0x7f5434102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:09.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.373+0000 7f543a8d8640 1 -- 172.21.15.116:0/4094587963 >> 172.21.15.116:0/4094587963 conn(0x7f54340fdfb0 msgr2=0x7f5434100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:09.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.373+0000 7f543a8d8640 1 -- 172.21.15.116:0/4094587963 shutdown_connections 2024-09-21T05:44:09.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.373+0000 7f543a8d8640 1 -- 172.21.15.116:0/4094587963 wait complete. 2024-09-21T05:44:09.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.374+0000 7f543a8d8640 1 Processor -- start 2024-09-21T05:44:09.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.374+0000 7f543a8d8640 1 -- start start 2024-09-21T05:44:09.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.374+0000 7f543a8d8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5434102640 0x7f5434199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:09.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.374+0000 7f543a8d8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54341036d0 0x7f543419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:09.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.374+0000 7f543a8d8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5434104070 0x7f543419b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:09.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.374+0000 7f543a8d8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f543410e270 con 0x7f54341036d0 2024-09-21T05:44:09.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.374+0000 7f543a8d8640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f543410e0f0 con 0x7f5434102640 2024-09-21T05:44:09.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.374+0000 7f543a8d8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f543410e3f0 con 0x7f5434104070 2024-09-21T05:44:09.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.374+0000 7f5433fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5434102640 0x7f5434199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:09.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.374+0000 7f5433fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5434102640 0x7f5434199f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:53590/0 (socket says 172.21.15.116:53590) 2024-09-21T05:44:09.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.374+0000 7f5433fff640 1 -- 172.21.15.116:0/34571278 learned_addr learned my addr 172.21.15.116:0/34571278 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-21T05:44:09.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.374+0000 7f5438e75640 1 --2- 172.21.15.116:0/34571278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5434104070 0x7f543419b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:09.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.374+0000 7f542bfff640 1 --2- 172.21.15.116:0/34571278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54341036d0 0x7f543419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:09.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.374+0000 7f5433fff640 1 -- 172.21.15.116:0/34571278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5434104070 msgr2=0x7f543419b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:09.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.374+0000 7f5433fff640 1 --2- 172.21.15.116:0/34571278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5434104070 0x7f543419b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:09.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.374+0000 7f5433fff640 1 -- 172.21.15.116:0/34571278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54341036d0 msgr2=0x7f543419a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:09.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.374+0000 7f5433fff640 1 --2- 172.21.15.116:0/34571278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54341036d0 0x7f543419a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:09.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.374+0000 7f5433fff640 1 -- 172.21.15.116:0/34571278 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f543419b950 con 0x7f5434102640 2024-09-21T05:44:09.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.374+0000 7f542bfff640 1 --2- 172.21.15.116:0/34571278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54341036d0 0x7f543419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:44:09.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.375+0000 7f5433fff640 1 --2- 172.21.15.116:0/34571278 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5434102640 0x7f5434199f20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f542400c890 tx=0x7f542400cd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:09.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.375+0000 7f5431ffb640 1 -- 172.21.15.116:0/34571278 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5424004220 con 0x7f5434102640 2024-09-21T05:44:09.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.375+0000 7f5431ffb640 1 -- 172.21.15.116:0/34571278 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f54240043c0 con 0x7f5434102640 2024-09-21T05:44:09.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.375+0000 7f543a8d8640 1 -- 172.21.15.116:0/34571278 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f543419bc40 con 0x7f5434102640 2024-09-21T05:44:09.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.375+0000 7f5431ffb640 1 -- 172.21.15.116:0/34571278 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5424004a00 con 0x7f5434102640 2024-09-21T05:44:09.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.375+0000 7f543a8d8640 1 -- 172.21.15.116:0/34571278 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54341a2340 con 0x7f5434102640 2024-09-21T05:44:09.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.376+0000 7f543a8d8640 1 -- 172.21.15.116:0/34571278 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54341a2510 con 0x7f5434102640 2024-09-21T05:44:09.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.377+0000 7f5431ffb640 1 -- 172.21.15.116:0/34571278 <== mon.2 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f54240079b0 con 0x7f5434102640 2024-09-21T05:44:09.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.378+0000 7f5431ffb640 1 --2- 172.21.15.116:0/34571278 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f54200b6510 0x7f54200b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:09.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.378+0000 7f5431ffb640 1 -- 172.21.15.116:0/34571278 <== mon.2 v2:172.21.15.116:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4965+0+0 (secure 0 0 0) 0x7f54240e6420 con 0x7f5434102640 2024-09-21T05:44:09.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.378+0000 7f542bfff640 1 --2- 172.21.15.116:0/34571278 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f54200b6510 0x7f54200b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:09.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.379+0000 7f542bfff640 1 --2- 172.21.15.116:0/34571278 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f54200b6510 0x7f54200b8a20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f541c009b50 tx=0x7f541c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:09.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.383+0000 7f5431ffb640 1 -- 172.21.15.116:0/34571278 <== mon.2 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5424014030 con 0x7f5434102640 2024-09-21T05:44:09.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:08 smithi160 ceph-mon[33979]: from='osd.6 [v2:172.21.15.70:6818/3650315688,v1:172.21.15.70:6819/3650315688]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-21T05:44:09.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:08 smithi160 ceph-mon[33979]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T05:44:09.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:08 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:44:09.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:08 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:44:09.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:08 smithi070 ceph-mon[30981]: from='osd.6 [v2:172.21.15.70:6818/3650315688,v1:172.21.15.70:6819/3650315688]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-21T05:44:09.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:08 smithi070 ceph-mon[30981]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T05:44:09.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:08 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:44:09.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:08 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:44:09.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:09.589+0000 7f543a8d8640 1 -- 172.21.15.116:0/34571278 --> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f54340fff20 con 0x7f54200b6510 2024-09-21T05:44:10.209 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:09 smithi116 ceph-mon[34332]: purged_snaps scrub starts 2024-09-21T05:44:10.209 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:09 smithi116 ceph-mon[34332]: purged_snaps scrub ok 2024-09-21T05:44:10.209 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:09 smithi116 ceph-mon[34332]: osd.6 [v2:172.21.15.70:6818/3650315688,v1:172.21.15.70:6819/3650315688] boot 2024-09-21T05:44:10.209 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:09 smithi116 ceph-mon[34332]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T05:44:10.209 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:09 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:44:10.209 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:09 smithi116 ceph-mon[34332]: Detected new or changed devices on smithi070 2024-09-21T05:44:10.209 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:09 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:10.209 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:09 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:10.210 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:09 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:10.210 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:09 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:10.210 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:09 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:10.210 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:09 smithi116 ceph-mon[34332]: Adjusting osd_memory_target on smithi070 to 5696M 2024-09-21T05:44:10.210 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:09 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:10.210 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:09 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:10.210 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:09 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:10.210 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:09 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:10.210 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:09 smithi116 ceph-mon[34332]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:10.210 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:09 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:44:10.210 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:09 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:44:10.210 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:09 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:10.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:09 smithi160 ceph-mon[33979]: purged_snaps scrub starts 2024-09-21T05:44:10.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:09 smithi160 ceph-mon[33979]: purged_snaps scrub ok 2024-09-21T05:44:10.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:09 smithi160 ceph-mon[33979]: osd.6 [v2:172.21.15.70:6818/3650315688,v1:172.21.15.70:6819/3650315688] boot 2024-09-21T05:44:10.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:09 smithi160 ceph-mon[33979]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T05:44:10.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:09 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:44:10.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:09 smithi160 ceph-mon[33979]: Detected new or changed devices on smithi070 2024-09-21T05:44:10.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:09 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:10.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:09 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:10.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:09 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:10.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:09 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:10.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:09 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:10.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:09 smithi160 ceph-mon[33979]: Adjusting osd_memory_target on smithi070 to 5696M 2024-09-21T05:44:10.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:09 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:10.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:09 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:10.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:09 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:10.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:09 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:10.400 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:09 smithi160 ceph-mon[33979]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:10.400 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:09 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:44:10.400 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:09 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:44:10.400 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:09 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:10.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:09 smithi070 ceph-mon[30981]: purged_snaps scrub starts 2024-09-21T05:44:10.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:09 smithi070 ceph-mon[30981]: purged_snaps scrub ok 2024-09-21T05:44:10.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:09 smithi070 ceph-mon[30981]: osd.6 [v2:172.21.15.70:6818/3650315688,v1:172.21.15.70:6819/3650315688] boot 2024-09-21T05:44:10.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:09 smithi070 ceph-mon[30981]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T05:44:10.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:09 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:44:10.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:09 smithi070 ceph-mon[30981]: Detected new or changed devices on smithi070 2024-09-21T05:44:10.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:09 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:10.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:09 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:10.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:09 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:10.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:09 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:10.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:09 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:10.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:09 smithi070 ceph-mon[30981]: Adjusting osd_memory_target on smithi070 to 5696M 2024-09-21T05:44:10.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:09 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:10.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:09 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:10.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:09 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:10.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:09 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:10.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:09 smithi070 ceph-mon[30981]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:10.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:09 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:44:10.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:09 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:44:10.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:09 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:11.471 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:11 smithi116 ceph-mon[34332]: from='client.24428 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:11.471 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:11 smithi116 ceph-mon[34332]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T05:44:11.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:11 smithi070 ceph-mon[30981]: from='client.24428 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:11.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:11 smithi070 ceph-mon[30981]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T05:44:11.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:11 smithi160 ceph-mon[33979]: from='client.24428 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:11.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:11 smithi160 ceph-mon[33979]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T05:44:12.432 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:12 smithi116 ceph-mon[34332]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:12.432 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:12 smithi116 ceph-mon[34332]: from='client.? 172.21.15.116:0/7303514' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "40d59744-4860-4a92-aa21-3f33e575e5b7"} : dispatch 2024-09-21T05:44:12.432 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:12 smithi116 ceph-mon[34332]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "40d59744-4860-4a92-aa21-3f33e575e5b7"} : dispatch 2024-09-21T05:44:12.432 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:12 smithi116 ceph-mon[34332]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "40d59744-4860-4a92-aa21-3f33e575e5b7"}]': finished 2024-09-21T05:44:12.432 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:12 smithi116 ceph-mon[34332]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T05:44:12.432 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:12 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:44:12.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:12 smithi070 ceph-mon[30981]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:12.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:12 smithi070 ceph-mon[30981]: from='client.? 172.21.15.116:0/7303514' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "40d59744-4860-4a92-aa21-3f33e575e5b7"} : dispatch 2024-09-21T05:44:12.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:12 smithi070 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "40d59744-4860-4a92-aa21-3f33e575e5b7"} : dispatch 2024-09-21T05:44:12.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:12 smithi070 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "40d59744-4860-4a92-aa21-3f33e575e5b7"}]': finished 2024-09-21T05:44:12.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:12 smithi070 ceph-mon[30981]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T05:44:12.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:12 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:44:12.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:12 smithi160 ceph-mon[33979]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:12.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:12 smithi160 ceph-mon[33979]: from='client.? 172.21.15.116:0/7303514' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "40d59744-4860-4a92-aa21-3f33e575e5b7"} : dispatch 2024-09-21T05:44:12.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:12 smithi160 ceph-mon[33979]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "40d59744-4860-4a92-aa21-3f33e575e5b7"} : dispatch 2024-09-21T05:44:12.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:12 smithi160 ceph-mon[33979]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "40d59744-4860-4a92-aa21-3f33e575e5b7"}]': finished 2024-09-21T05:44:12.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:12 smithi160 ceph-mon[33979]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T05:44:12.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:12 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:44:13.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:13 smithi070 ceph-mon[30981]: from='client.? 172.21.15.116:0/3021521758' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:44:13.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:13 smithi116 ceph-mon[34332]: from='client.? 172.21.15.116:0/3021521758' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:44:13.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:13 smithi160 ceph-mon[33979]: from='client.? 172.21.15.116:0/3021521758' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:44:14.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:14 smithi070 ceph-mon[30981]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:14.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:14 smithi116 ceph-mon[34332]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:14.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:14 smithi160 ceph-mon[33979]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:15.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:15 smithi070 ceph-mon[30981]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:15.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:15 smithi116 ceph-mon[34332]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:15.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:15 smithi160 ceph-mon[33979]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:17.663 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:17 smithi116 ceph-mon[34332]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:17.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:17 smithi070 ceph-mon[30981]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:17.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:17 smithi160 ceph-mon[33979]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:19.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:19 smithi070 ceph-mon[30981]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:19.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:19 smithi116 ceph-mon[34332]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:19.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:19 smithi160 ceph-mon[33979]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:20.735 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:20 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T05:44:20.735 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:20 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:20.735 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:20 smithi116 ceph-mon[34332]: Deploying daemon osd.7 on smithi116 2024-09-21T05:44:20.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:20 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T05:44:20.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:20 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:20.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:20 smithi070 ceph-mon[30981]: Deploying daemon osd.7 on smithi116 2024-09-21T05:44:20.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:20 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T05:44:20.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:20 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:20.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:20 smithi160 ceph-mon[33979]: Deploying daemon osd.7 on smithi116 2024-09-21T05:44:21.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:21 smithi070 ceph-mon[30981]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:21.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:21 smithi116 ceph-mon[34332]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:21.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:21 smithi160 ceph-mon[33979]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:23.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:23 smithi116 ceph-mon[34332]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:23.700 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:23 smithi160 ceph-mon[33979]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:23.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:23 smithi070 ceph-mon[30981]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:25.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:25 smithi070 ceph-mon[30981]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:25.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:25 smithi116 ceph-mon[34332]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:25.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:25 smithi160 ceph-mon[33979]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:26.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:26 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:26.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:26 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:26.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:26 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:26.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:26 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:26.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:26 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:26.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:26 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:26.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:26 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:26.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:26 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:26.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:26 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:27.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:27 smithi116 ceph-mon[34332]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:27.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:27 smithi070 ceph-mon[30981]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:27.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:27 smithi160 ceph-mon[33979]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:29.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:29 smithi116 ceph-mon[34332]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:29.620 INFO:teuthology.orchestra.run.smithi116.stdout:Created osd(s) 7 on host 'smithi116' 2024-09-21T05:44:29.620 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:29.617+0000 7f5431ffb640 1 -- 172.21.15.116:0/34571278 <== mgr.14150 v2:172.21.15.70:6800/1366013939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f54340fff20 con 0x7f54200b6510 2024-09-21T05:44:29.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:29.619+0000 7f543a8d8640 1 -- 172.21.15.116:0/34571278 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f54200b6510 msgr2=0x7f54200b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:29.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:29.619+0000 7f543a8d8640 1 --2- 172.21.15.116:0/34571278 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f54200b6510 0x7f54200b8a20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f541c009b50 tx=0x7f541c005f90 comp rx=0 tx=0).stop 2024-09-21T05:44:29.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:29.619+0000 7f543a8d8640 1 -- 172.21.15.116:0/34571278 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5434102640 msgr2=0x7f5434199f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:29.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:29.619+0000 7f543a8d8640 1 --2- 172.21.15.116:0/34571278 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5434102640 0x7f5434199f20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f542400c890 tx=0x7f542400cd50 comp rx=0 tx=0).stop 2024-09-21T05:44:29.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:29.619+0000 7f543a8d8640 1 -- 172.21.15.116:0/34571278 shutdown_connections 2024-09-21T05:44:29.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:29.619+0000 7f543a8d8640 1 --2- 172.21.15.116:0/34571278 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f54200b6510 0x7f54200b8a20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:29.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:29.619+0000 7f543a8d8640 1 --2- 172.21.15.116:0/34571278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5434104070 0x7f543419b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:29.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:29.619+0000 7f543a8d8640 1 --2- 172.21.15.116:0/34571278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54341036d0 0x7f543419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:29.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:29.619+0000 7f543a8d8640 1 --2- 172.21.15.116:0/34571278 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5434102640 0x7f5434199f20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:29.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:29.619+0000 7f543a8d8640 1 -- 172.21.15.116:0/34571278 >> 172.21.15.116:0/34571278 conn(0x7f54340fdfb0 msgr2=0x7f54340ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:29.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:29.619+0000 7f543a8d8640 1 -- 172.21.15.116:0/34571278 shutdown_connections 2024-09-21T05:44:29.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:44:29.620+0000 7f543a8d8640 1 -- 172.21.15.116:0/34571278 wait complete. 2024-09-21T05:44:29.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:29 smithi070 ceph-mon[30981]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:29.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:29 smithi160 ceph-mon[33979]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:30.205 DEBUG:teuthology.orchestra.run.smithi116:osd.7> sudo journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.7.service 2024-09-21T05:44:30.208 INFO:tasks.cephadm:Deploying osd.8 on smithi160 with /dev/vg_nvme/lv_2... 2024-09-21T05:44:30.208 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T05:44:30.465 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:44:30.839 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:30 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:30.839 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:30 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:30.839 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:30 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:30.839 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:30 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:30.946 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:30 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:30.947 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:30 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:30.947 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:30 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:30.947 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:30 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:30.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:30 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:30.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:30 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:30.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:30 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:30.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:30 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:31.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:31 smithi116 ceph-mon[34332]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:31.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:31 smithi160 ceph-mon[33979]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:31.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:31 smithi070 ceph-mon[30981]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:33.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:32 smithi116 ceph-mon[34332]: from='osd.7 [v2:172.21.15.116:6816/2034132009,v1:172.21.15.116:6817/2034132009]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T05:44:33.187 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:32 smithi116 ceph-mon[34332]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T05:44:33.187 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:44:32 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:44:32.886+0000 7fdda1dd4640 -1 osd.7 0 log_to_monitors true 2024-09-21T05:44:33.224 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:32 smithi160 ceph-mon[33979]: from='osd.7 [v2:172.21.15.116:6816/2034132009,v1:172.21.15.116:6817/2034132009]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T05:44:33.224 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:32 smithi160 ceph-mon[33979]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T05:44:33.226 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-21T05:44:33.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:32 smithi070 ceph-mon[30981]: from='osd.7 [v2:172.21.15.116:6816/2034132009,v1:172.21.15.116:6817/2034132009]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T05:44:33.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:32 smithi070 ceph-mon[30981]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T05:44:33.253 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi160:vg_nvme/lv_2 2024-09-21T05:44:33.515 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:44:34.048 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:33 smithi160 ceph-mon[33979]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T05:44:34.049 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:33 smithi160 ceph-mon[33979]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T05:44:34.049 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:33 smithi160 ceph-mon[33979]: from='osd.7 [v2:172.21.15.116:6816/2034132009,v1:172.21.15.116:6817/2034132009]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi116", "root=default"]} : dispatch 2024-09-21T05:44:34.049 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:33 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:44:34.049 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:33 smithi160 ceph-mon[33979]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi116", "root=default"]} : dispatch 2024-09-21T05:44:34.049 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:33 smithi160 ceph-mon[33979]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:34.049 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:33 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:34.049 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:33 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:34.049 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:33 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:34.049 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:33 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:34.050 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:33 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:34.050 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:33 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:34.050 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:33 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:34.050 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:33 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:34.050 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:33 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:34.050 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:33 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:34.050 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:33 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:34.050 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:33 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:34.050 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:33 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:34.050 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:33 smithi160 ceph-mon[33979]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-21T05:44:34.052 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.040+0000 7f71eaca1640 1 -- 172.21.15.160:0/4049792315 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71e41036d0 msgr2=0x7f71e4103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:34.052 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.040+0000 7f71eaca1640 1 --2- 172.21.15.160:0/4049792315 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71e41036d0 0x7f71e4103ae0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f71d8009900 tx=0x7f71d802a480 comp rx=0 tx=0).stop 2024-09-21T05:44:34.052 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.040+0000 7f71eaca1640 1 -- 172.21.15.160:0/4049792315 shutdown_connections 2024-09-21T05:44:34.052 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.040+0000 7f71eaca1640 1 --2- 172.21.15.160:0/4049792315 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71e41036d0 0x7f71e4103ae0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:34.052 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.040+0000 7f71eaca1640 1 --2- 172.21.15.160:0/4049792315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71e4104070 0x7f71e410aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:34.053 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.040+0000 7f71eaca1640 1 --2- 172.21.15.160:0/4049792315 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f71e4102640 0x7f71e4102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:34.053 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.040+0000 7f71eaca1640 1 -- 172.21.15.160:0/4049792315 >> 172.21.15.160:0/4049792315 conn(0x7f71e40fdfb0 msgr2=0x7f71e4100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:34.053 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.040+0000 7f71eaca1640 1 -- 172.21.15.160:0/4049792315 shutdown_connections 2024-09-21T05:44:34.053 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.040+0000 7f71eaca1640 1 -- 172.21.15.160:0/4049792315 wait complete. 2024-09-21T05:44:34.053 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.041+0000 7f71eaca1640 1 Processor -- start 2024-09-21T05:44:34.053 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.041+0000 7f71eaca1640 1 -- start start 2024-09-21T05:44:34.053 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.041+0000 7f71eaca1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f71e4102640 0x7f71e4198f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:34.053 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.041+0000 7f71eaca1640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71e41036d0 0x7f71e41995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:34.053 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.041+0000 7f71eaca1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71e4104070 0x7f71e419a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:34.053 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.041+0000 7f71eaca1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f71e410e270 con 0x7f71e4104070 2024-09-21T05:44:34.053 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.041+0000 7f71eaca1640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f71e410e0f0 con 0x7f71e4102640 2024-09-21T05:44:34.053 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.041+0000 7f71eaca1640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f71e410e3f0 con 0x7f71e41036d0 2024-09-21T05:44:34.053 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.041+0000 7f71e3fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71e41036d0 0x7f71e41995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:34.054 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.041+0000 7f71e3fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71e41036d0 0x7f71e41995c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:44592/0 (socket says 172.21.15.160:44592) 2024-09-21T05:44:34.054 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.041+0000 7f71e3fff640 1 -- 172.21.15.160:0/3622560008 learned_addr learned my addr 172.21.15.160:0/3622560008 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-09-21T05:44:34.054 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.041+0000 7f71e923e640 1 --2- 172.21.15.160:0/3622560008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71e4104070 0x7f71e419a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:34.054 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.041+0000 7f71e8a3d640 1 --2- 172.21.15.160:0/3622560008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f71e4102640 0x7f71e4198f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:34.054 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.041+0000 7f71e3fff640 1 -- 172.21.15.160:0/3622560008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f71e4102640 msgr2=0x7f71e4198f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:34.054 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.041+0000 7f71e3fff640 1 --2- 172.21.15.160:0/3622560008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f71e4102640 0x7f71e4198f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:34.054 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.041+0000 7f71e3fff640 1 -- 172.21.15.160:0/3622560008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71e4104070 msgr2=0x7f71e419a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:34.054 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.041+0000 7f71e3fff640 1 --2- 172.21.15.160:0/3622560008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71e4104070 0x7f71e419a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:34.054 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.041+0000 7f71e3fff640 1 -- 172.21.15.160:0/3622560008 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71e419a910 con 0x7f71e41036d0 2024-09-21T05:44:34.054 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.042+0000 7f71e3fff640 1 --2- 172.21.15.160:0/3622560008 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71e41036d0 0x7f71e41995c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f71d8005940 tx=0x7f71d80042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:34.054 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.042+0000 7f71e1ffb640 1 -- 172.21.15.160:0/3622560008 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d803f030 con 0x7f71e41036d0 2024-09-21T05:44:34.054 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.042+0000 7f71e1ffb640 1 -- 172.21.15.160:0/3622560008 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f71d8003cb0 con 0x7f71e41036d0 2024-09-21T05:44:34.054 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.042+0000 7f71e1ffb640 1 -- 172.21.15.160:0/3622560008 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d8035070 con 0x7f71e41036d0 2024-09-21T05:44:34.055 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.042+0000 7f71eaca1640 1 -- 172.21.15.160:0/3622560008 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71e419aba0 con 0x7f71e41036d0 2024-09-21T05:44:34.055 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.042+0000 7f71eaca1640 1 -- 172.21.15.160:0/3622560008 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71e41a1130 con 0x7f71e41036d0 2024-09-21T05:44:34.055 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.043+0000 7f71eaca1640 1 -- 172.21.15.160:0/3622560008 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71e4109820 con 0x7f71e41036d0 2024-09-21T05:44:34.055 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.045+0000 7f71e1ffb640 1 -- 172.21.15.160:0/3622560008 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f71d8042030 con 0x7f71e41036d0 2024-09-21T05:44:34.055 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.045+0000 7f71e1ffb640 1 --2- 172.21.15.160:0/3622560008 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f71cc0b6510 0x7f71cc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:34.055 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.046+0000 7f71e1ffb640 1 -- 172.21.15.160:0/3622560008 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5117+0+0 (secure 0 0 0) 0x7f71d8107120 con 0x7f71e41036d0 2024-09-21T05:44:34.055 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.046+0000 7f71e8a3d640 1 --2- 172.21.15.160:0/3622560008 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f71cc0b6510 0x7f71cc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:34.055 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.046+0000 7f71e8a3d640 1 --2- 172.21.15.160:0/3622560008 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f71cc0b6510 0x7f71cc0b8a20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f71d4005fd0 tx=0x7f71d4009870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:34.055 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.049+0000 7f71e1ffb640 1 -- 172.21.15.160:0/3622560008 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f71d80ce630 con 0x7f71e41036d0 2024-09-21T05:44:34.238 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:34.235+0000 7f71eaca1640 1 -- 172.21.15.160:0/3622560008 --> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f71e4063800 con 0x7f71cc0b6510 2024-09-21T05:44:34.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:33 smithi070 ceph-mon[30981]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T05:44:34.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:33 smithi070 ceph-mon[30981]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T05:44:34.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:33 smithi070 ceph-mon[30981]: from='osd.7 [v2:172.21.15.116:6816/2034132009,v1:172.21.15.116:6817/2034132009]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi116", "root=default"]} : dispatch 2024-09-21T05:44:34.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:33 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:44:34.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:33 smithi070 ceph-mon[30981]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi116", "root=default"]} : dispatch 2024-09-21T05:44:34.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:33 smithi070 ceph-mon[30981]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:34.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:33 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:34.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:33 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:34.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:33 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:34.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:33 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:34.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:33 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:34.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:33 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:34.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:33 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:34.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:33 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:34.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:33 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:34.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:33 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:34.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:33 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:34.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:33 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:34.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:33 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:34.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:33 smithi070 ceph-mon[30981]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-21T05:44:34.304 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:44:33 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:44:33.963+0000 7fdd9dd56640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T05:44:34.304 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:44:33 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:44:33.971+0000 7fdd99b54640 -1 osd.7 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:44:34.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:33 smithi116 ceph-mon[34332]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T05:44:34.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:33 smithi116 ceph-mon[34332]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T05:44:34.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:33 smithi116 ceph-mon[34332]: from='osd.7 [v2:172.21.15.116:6816/2034132009,v1:172.21.15.116:6817/2034132009]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi116", "root=default"]} : dispatch 2024-09-21T05:44:34.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:33 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:44:34.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:33 smithi116 ceph-mon[34332]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi116", "root=default"]} : dispatch 2024-09-21T05:44:34.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:33 smithi116 ceph-mon[34332]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:34.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:33 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:34.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:33 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:34.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:33 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:34.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:33 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:34.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:33 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:34.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:33 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:34.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:33 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:34.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:33 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:34.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:33 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:34.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:33 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:34.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:33 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:34.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:33 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:34.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:33 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:34.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:33 smithi116 ceph-mon[34332]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-21T05:44:35.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:34 smithi070 ceph-mon[30981]: Detected new or changed devices on smithi116 2024-09-21T05:44:35.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:34 smithi070 ceph-mon[30981]: Adjusting osd_memory_target on smithi116 to 5696M 2024-09-21T05:44:35.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:34 smithi070 ceph-mon[30981]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T05:44:35.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:34 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:44:35.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:34 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:44:35.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:34 smithi070 ceph-mon[30981]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:35.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:34 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:44:35.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:34 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:44:35.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:34 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:35.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:34 smithi116 ceph-mon[34332]: Detected new or changed devices on smithi116 2024-09-21T05:44:35.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:34 smithi116 ceph-mon[34332]: Adjusting osd_memory_target on smithi116 to 5696M 2024-09-21T05:44:35.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:34 smithi116 ceph-mon[34332]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T05:44:35.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:34 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:44:35.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:34 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:44:35.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:34 smithi116 ceph-mon[34332]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:35.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:34 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:44:35.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:34 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:44:35.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:34 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:35.342 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:34 smithi160 ceph-mon[33979]: Detected new or changed devices on smithi116 2024-09-21T05:44:35.342 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:34 smithi160 ceph-mon[33979]: Adjusting osd_memory_target on smithi116 to 5696M 2024-09-21T05:44:35.342 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:34 smithi160 ceph-mon[33979]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T05:44:35.343 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:34 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:44:35.343 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:34 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:44:35.343 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:34 smithi160 ceph-mon[33979]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:35.343 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:34 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:44:35.343 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:34 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:44:35.343 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:34 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:36.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:35 smithi070 ceph-mon[30981]: purged_snaps scrub starts 2024-09-21T05:44:36.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:35 smithi070 ceph-mon[30981]: purged_snaps scrub ok 2024-09-21T05:44:36.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:35 smithi070 ceph-mon[30981]: osd.7 [v2:172.21.15.116:6816/2034132009,v1:172.21.15.116:6817/2034132009] boot 2024-09-21T05:44:36.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:35 smithi070 ceph-mon[30981]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T05:44:36.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:35 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:44:36.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:35 smithi070 ceph-mon[30981]: pgmap v185: 1 pgs: 1 unknown; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:36.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:35 smithi070 ceph-mon[30981]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T05:44:36.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:35 smithi116 ceph-mon[34332]: purged_snaps scrub starts 2024-09-21T05:44:36.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:35 smithi116 ceph-mon[34332]: purged_snaps scrub ok 2024-09-21T05:44:36.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:35 smithi116 ceph-mon[34332]: osd.7 [v2:172.21.15.116:6816/2034132009,v1:172.21.15.116:6817/2034132009] boot 2024-09-21T05:44:36.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:35 smithi116 ceph-mon[34332]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T05:44:36.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:35 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:44:36.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:35 smithi116 ceph-mon[34332]: pgmap v185: 1 pgs: 1 unknown; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:36.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:35 smithi116 ceph-mon[34332]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T05:44:36.371 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:35 smithi160 ceph-mon[33979]: purged_snaps scrub starts 2024-09-21T05:44:36.371 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:35 smithi160 ceph-mon[33979]: purged_snaps scrub ok 2024-09-21T05:44:36.371 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:35 smithi160 ceph-mon[33979]: osd.7 [v2:172.21.15.116:6816/2034132009,v1:172.21.15.116:6817/2034132009] boot 2024-09-21T05:44:36.371 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:35 smithi160 ceph-mon[33979]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T05:44:36.371 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:35 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:44:36.371 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:35 smithi160 ceph-mon[33979]: pgmap v185: 1 pgs: 1 unknown; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:44:36.371 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:35 smithi160 ceph-mon[33979]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T05:44:37.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:36 smithi070 ceph-mon[30981]: from='client.? 172.21.15.160:0/2800370194' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "65dc02e7-0dcd-4fa7-955a-4d5c00fbe4cd"} : dispatch 2024-09-21T05:44:37.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:36 smithi070 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "65dc02e7-0dcd-4fa7-955a-4d5c00fbe4cd"} : dispatch 2024-09-21T05:44:37.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:36 smithi070 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65dc02e7-0dcd-4fa7-955a-4d5c00fbe4cd"}]': finished 2024-09-21T05:44:37.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:36 smithi070 ceph-mon[30981]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T05:44:37.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:36 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:44:37.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:36 smithi116 ceph-mon[34332]: from='client.? 172.21.15.160:0/2800370194' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "65dc02e7-0dcd-4fa7-955a-4d5c00fbe4cd"} : dispatch 2024-09-21T05:44:37.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:36 smithi116 ceph-mon[34332]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "65dc02e7-0dcd-4fa7-955a-4d5c00fbe4cd"} : dispatch 2024-09-21T05:44:37.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:36 smithi116 ceph-mon[34332]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65dc02e7-0dcd-4fa7-955a-4d5c00fbe4cd"}]': finished 2024-09-21T05:44:37.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:36 smithi116 ceph-mon[34332]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T05:44:37.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:36 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:44:37.349 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:36 smithi160 ceph-mon[33979]: from='client.? 172.21.15.160:0/2800370194' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "65dc02e7-0dcd-4fa7-955a-4d5c00fbe4cd"} : dispatch 2024-09-21T05:44:37.349 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:36 smithi160 ceph-mon[33979]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "65dc02e7-0dcd-4fa7-955a-4d5c00fbe4cd"} : dispatch 2024-09-21T05:44:37.349 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:36 smithi160 ceph-mon[33979]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65dc02e7-0dcd-4fa7-955a-4d5c00fbe4cd"}]': finished 2024-09-21T05:44:37.349 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:36 smithi160 ceph-mon[33979]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T05:44:37.349 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:36 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:44:38.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:37 smithi070 ceph-mon[30981]: from='client.? 172.21.15.160:0/3792136889' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:44:38.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:37 smithi070 ceph-mon[30981]: pgmap v188: 1 pgs: 1 unknown; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:44:38.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:37 smithi070 ceph-mon[30981]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T05:44:38.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:37 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:44:38.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:37 smithi116 ceph-mon[34332]: from='client.? 172.21.15.160:0/3792136889' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:44:38.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:37 smithi116 ceph-mon[34332]: pgmap v188: 1 pgs: 1 unknown; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:44:38.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:37 smithi116 ceph-mon[34332]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T05:44:38.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:37 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:44:38.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:37 smithi160 ceph-mon[33979]: from='client.? 172.21.15.160:0/3792136889' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:44:38.454 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:37 smithi160 ceph-mon[33979]: pgmap v188: 1 pgs: 1 unknown; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:44:38.454 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:37 smithi160 ceph-mon[33979]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T05:44:38.455 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:37 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:44:39.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:39 smithi070 ceph-mon[30981]: pgmap v190: 1 pgs: 1 unknown; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:44:39.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:39 smithi116 ceph-mon[34332]: pgmap v190: 1 pgs: 1 unknown; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:44:39.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:39 smithi160 ceph-mon[33979]: pgmap v190: 1 pgs: 1 unknown; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:44:41.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:41 smithi070 ceph-mon[30981]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-09-21T05:44:41.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:41 smithi116 ceph-mon[34332]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-09-21T05:44:41.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:41 smithi160 ceph-mon[33979]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-09-21T05:44:43.561 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:43 smithi160 ceph-mon[33979]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 156 KiB/s, 0 objects/s recovering 2024-09-21T05:44:43.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:43 smithi070 ceph-mon[30981]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 156 KiB/s, 0 objects/s recovering 2024-09-21T05:44:43.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:43 smithi116 ceph-mon[34332]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 156 KiB/s, 0 objects/s recovering 2024-09-21T05:44:45.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:45 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T05:44:45.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:45 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:45.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:45 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T05:44:45.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:45 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:45.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:45 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T05:44:45.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:45 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:46.650 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:46 smithi160 ceph-mon[33979]: Deploying daemon osd.8 on smithi160 2024-09-21T05:44:46.650 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:46 smithi160 ceph-mon[33979]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 134 KiB/s, 0 objects/s recovering 2024-09-21T05:44:46.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:46 smithi070 ceph-mon[30981]: Deploying daemon osd.8 on smithi160 2024-09-21T05:44:46.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:46 smithi070 ceph-mon[30981]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 134 KiB/s, 0 objects/s recovering 2024-09-21T05:44:46.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:46 smithi116 ceph-mon[34332]: Deploying daemon osd.8 on smithi160 2024-09-21T05:44:46.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:46 smithi116 ceph-mon[34332]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 134 KiB/s, 0 objects/s recovering 2024-09-21T05:44:48.659 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:48 smithi160 ceph-mon[33979]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-21T05:44:48.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:48 smithi070 ceph-mon[30981]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-21T05:44:48.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:48 smithi116 ceph-mon[34332]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-21T05:44:50.606 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:50 smithi160 ceph-mon[33979]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-21T05:44:50.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:50 smithi070 ceph-mon[30981]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-21T05:44:50.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:50 smithi116 ceph-mon[34332]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-21T05:44:52.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:52 smithi160 ceph-mon[33979]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T05:44:52.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:52 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:52.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:52 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:52.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:52 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:52.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:52 smithi070 ceph-mon[30981]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T05:44:52.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:52 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:52.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:52 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:52.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:52 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:52.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:52 smithi116 ceph-mon[34332]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T05:44:52.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:52 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:52.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:52 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:52.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:52 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:54.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:54 smithi160 ceph-mon[33979]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:44:54.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:54 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:54.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:54 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:54.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:54 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:54.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:54 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:54.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:54 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:54.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:54 smithi070 ceph-mon[30981]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:44:54.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:54 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:54.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:54 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:54.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:54 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:54.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:54 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:54.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:54 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:54.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:54 smithi116 ceph-mon[34332]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:44:54.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:54 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:54.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:54 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:54.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:54 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:54.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:54 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:54.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:54 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:55.425 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:55.423+0000 7f71e1ffb640 1 -- 172.21.15.160:0/3622560008 <== mgr.14150 v2:172.21.15.70:6800/1366013939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f71e4063800 con 0x7f71cc0b6510 2024-09-21T05:44:55.425 INFO:teuthology.orchestra.run.smithi160.stdout:Created osd(s) 8 on host 'smithi160' 2024-09-21T05:44:55.427 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:55.425+0000 7f71eaca1640 1 -- 172.21.15.160:0/3622560008 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f71cc0b6510 msgr2=0x7f71cc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:55.427 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:55.425+0000 7f71eaca1640 1 --2- 172.21.15.160:0/3622560008 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f71cc0b6510 0x7f71cc0b8a20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f71d4005fd0 tx=0x7f71d4009870 comp rx=0 tx=0).stop 2024-09-21T05:44:55.428 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:55.425+0000 7f71eaca1640 1 -- 172.21.15.160:0/3622560008 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71e41036d0 msgr2=0x7f71e41995c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:55.428 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:55.425+0000 7f71eaca1640 1 --2- 172.21.15.160:0/3622560008 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71e41036d0 0x7f71e41995c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f71d8005940 tx=0x7f71d80042f0 comp rx=0 tx=0).stop 2024-09-21T05:44:55.428 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:55.425+0000 7f71eaca1640 1 -- 172.21.15.160:0/3622560008 shutdown_connections 2024-09-21T05:44:55.428 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:55.425+0000 7f71eaca1640 1 --2- 172.21.15.160:0/3622560008 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f71cc0b6510 0x7f71cc0b8a20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:55.428 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:55.425+0000 7f71eaca1640 1 --2- 172.21.15.160:0/3622560008 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71e41036d0 0x7f71e41995c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:55.428 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:55.425+0000 7f71eaca1640 1 --2- 172.21.15.160:0/3622560008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71e4104070 0x7f71e419a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:55.428 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:55.425+0000 7f71eaca1640 1 --2- 172.21.15.160:0/3622560008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f71e4102640 0x7f71e4198f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:55.428 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:55.425+0000 7f71eaca1640 1 -- 172.21.15.160:0/3622560008 >> 172.21.15.160:0/3622560008 conn(0x7f71e40fdfb0 msgr2=0x7f71e41069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:55.428 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:55.425+0000 7f71eaca1640 1 -- 172.21.15.160:0/3622560008 shutdown_connections 2024-09-21T05:44:55.428 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:44:55.425+0000 7f71eaca1640 1 -- 172.21.15.160:0/3622560008 wait complete. 2024-09-21T05:44:56.147 DEBUG:teuthology.orchestra.run.smithi160:osd.8> sudo journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.8.service 2024-09-21T05:44:56.149 INFO:tasks.cephadm:Deploying osd.9 on smithi070 with /dev/vg_nvme/lv_1... 2024-09-21T05:44:56.149 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T05:44:56.406 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:44:56.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:56 smithi070 ceph-mon[30981]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:44:56.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:56 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:56.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:56 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:56.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:56 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:56.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:56 smithi160 ceph-mon[33979]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:44:56.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:56 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:56.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:56 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:56.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:56 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:56.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:56 smithi116 ceph-mon[34332]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:44:56.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:56 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:56.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:56 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:56.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:56 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:57.594 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:44:57 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:44:57.431+0000 7f553e3a5640 -1 osd.8 0 log_to_monitors true 2024-09-21T05:44:58.512 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:58 smithi070 ceph-mon[30981]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:44:58.513 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:58 smithi070 ceph-mon[30981]: from='osd.8 [v2:172.21.15.160:6816/3381625184,v1:172.21.15.160:6817/3381625184]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T05:44:58.513 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:58 smithi070 ceph-mon[30981]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T05:44:58.641 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:58 smithi160 ceph-mon[33979]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:44:58.641 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:58 smithi160 ceph-mon[33979]: from='osd.8 [v2:172.21.15.160:6816/3381625184,v1:172.21.15.160:6817/3381625184]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T05:44:58.641 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:58 smithi160 ceph-mon[33979]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T05:44:58.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:58 smithi116 ceph-mon[34332]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:44:58.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:58 smithi116 ceph-mon[34332]: from='osd.8 [v2:172.21.15.160:6816/3381625184,v1:172.21.15.160:6817/3381625184]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T05:44:58.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:58 smithi116 ceph-mon[34332]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T05:44:59.244 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:44:59.269 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi070:vg_nvme/lv_1 2024-09-21T05:44:59.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:59 smithi070 ceph-mon[30981]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T05:44:59.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:59 smithi070 ceph-mon[30981]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T05:44:59.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:59 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:44:59.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:59 smithi070 ceph-mon[30981]: from='osd.8 [v2:172.21.15.160:6816/3381625184,v1:172.21.15.160:6817/3381625184]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]} : dispatch 2024-09-21T05:44:59.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:59 smithi070 ceph-mon[30981]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]} : dispatch 2024-09-21T05:44:59.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:59 smithi070 ceph-mon[30981]: Detected new or changed devices on smithi160 2024-09-21T05:44:59.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:59 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:59.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:59 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:59.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:59 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:59.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:59 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:59.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:59 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:59.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:59 smithi070 ceph-mon[30981]: Adjusting osd_memory_target on smithi160 to 5696M 2024-09-21T05:44:59.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:59 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:59.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:59 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:59.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:59 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:59.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:59 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:59.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:44:59 smithi070 ceph-mon[30981]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:44:59.524 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:44:59.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:59 smithi116 ceph-mon[34332]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T05:44:59.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:59 smithi116 ceph-mon[34332]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T05:44:59.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:59 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:44:59.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:59 smithi116 ceph-mon[34332]: from='osd.8 [v2:172.21.15.160:6816/3381625184,v1:172.21.15.160:6817/3381625184]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]} : dispatch 2024-09-21T05:44:59.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:59 smithi116 ceph-mon[34332]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]} : dispatch 2024-09-21T05:44:59.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:59 smithi116 ceph-mon[34332]: Detected new or changed devices on smithi160 2024-09-21T05:44:59.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:59 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:59.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:59 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:59.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:59 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:59.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:59 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:59.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:59 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:59.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:59 smithi116 ceph-mon[34332]: Adjusting osd_memory_target on smithi160 to 5696M 2024-09-21T05:44:59.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:59 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:59.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:59 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:59.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:59 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:59.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:59 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:59.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:44:59 smithi116 ceph-mon[34332]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:44:59.829 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:59 smithi160 ceph-mon[33979]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T05:44:59.829 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:59 smithi160 ceph-mon[33979]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T05:44:59.829 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:59 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:44:59.829 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:59 smithi160 ceph-mon[33979]: from='osd.8 [v2:172.21.15.160:6816/3381625184,v1:172.21.15.160:6817/3381625184]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]} : dispatch 2024-09-21T05:44:59.829 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:59 smithi160 ceph-mon[33979]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]} : dispatch 2024-09-21T05:44:59.830 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:59 smithi160 ceph-mon[33979]: Detected new or changed devices on smithi160 2024-09-21T05:44:59.830 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:59 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:59.830 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:59 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:59.830 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:59 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:59.830 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:59 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:59.830 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:59 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:59.830 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:59 smithi160 ceph-mon[33979]: Adjusting osd_memory_target on smithi160 to 5696M 2024-09-21T05:44:59.831 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:59 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:59.831 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:59 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:59.831 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:59 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:59.831 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:59 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:44:59.831 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:44:59 smithi160 ceph-mon[33979]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:45:00.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.078+0000 7fe4cf72a640 1 -- 172.21.15.70:0/2993189836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4c8103700 msgr2=0x7fe4c8103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:00.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.078+0000 7fe4cf72a640 1 --2- 172.21.15.70:0/2993189836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4c8103700 0x7fe4c8103b10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8009900 tx=0x7fe4b802a480 comp rx=0 tx=0).stop 2024-09-21T05:45:00.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.079+0000 7fe4cf72a640 1 -- 172.21.15.70:0/2993189836 shutdown_connections 2024-09-21T05:45:00.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.079+0000 7fe4cf72a640 1 --2- 172.21.15.70:0/2993189836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4c81040a0 0x7fe4c810aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:00.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.079+0000 7fe4cf72a640 1 --2- 172.21.15.70:0/2993189836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4c8103700 0x7fe4c8103b10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:00.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.079+0000 7fe4cf72a640 1 --2- 172.21.15.70:0/2993189836 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe4c8102670 0x7fe4c8102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:00.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.079+0000 7fe4cf72a640 1 -- 172.21.15.70:0/2993189836 >> 172.21.15.70:0/2993189836 conn(0x7fe4c80fdfe0 msgr2=0x7fe4c8100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:00.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.079+0000 7fe4cf72a640 1 -- 172.21.15.70:0/2993189836 shutdown_connections 2024-09-21T05:45:00.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.079+0000 7fe4cf72a640 1 -- 172.21.15.70:0/2993189836 wait complete. 2024-09-21T05:45:00.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.079+0000 7fe4cf72a640 1 Processor -- start 2024-09-21T05:45:00.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.079+0000 7fe4cf72a640 1 -- start start 2024-09-21T05:45:00.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.080+0000 7fe4cf72a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4c8102670 0x7fe4c8199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:00.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.080+0000 7fe4cf72a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4c8103700 0x7fe4c819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:00.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.080+0000 7fe4cf72a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe4c81040a0 0x7fe4c819b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:00.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.080+0000 7fe4cf72a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c810e2a0 con 0x7fe4c8103700 2024-09-21T05:45:00.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.080+0000 7fe4cf72a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c810e120 con 0x7fe4c8102670 2024-09-21T05:45:00.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.080+0000 7fe4cf72a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c810e420 con 0x7fe4c81040a0 2024-09-21T05:45:00.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.080+0000 7fe4cccc5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4c8103700 0x7fe4c819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:00.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.080+0000 7fe4cccc5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4c8103700 0x7fe4c819a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39614/0 (socket says 172.21.15.70:39614) 2024-09-21T05:45:00.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.080+0000 7fe4cccc5640 1 -- 172.21.15.70:0/4054549494 learned_addr learned my addr 172.21.15.70:0/4054549494 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:45:00.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.080+0000 7fe4cd4c6640 1 --2- 172.21.15.70:0/4054549494 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4c8102670 0x7fe4c8199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:00.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.080+0000 7fe4cdcc7640 1 --2- 172.21.15.70:0/4054549494 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe4c81040a0 0x7fe4c819b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:00.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.080+0000 7fe4cccc5640 1 -- 172.21.15.70:0/4054549494 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe4c81040a0 msgr2=0x7fe4c819b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:00.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.080+0000 7fe4cccc5640 1 --2- 172.21.15.70:0/4054549494 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe4c81040a0 0x7fe4c819b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:00.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.080+0000 7fe4cccc5640 1 -- 172.21.15.70:0/4054549494 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4c8102670 msgr2=0x7fe4c8199fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:00.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.080+0000 7fe4cccc5640 1 --2- 172.21.15.70:0/4054549494 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4c8102670 0x7fe4c8199fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:00.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.080+0000 7fe4cccc5640 1 -- 172.21.15.70:0/4054549494 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c819b9d0 con 0x7fe4c8103700 2024-09-21T05:45:00.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.080+0000 7fe4cccc5640 1 --2- 172.21.15.70:0/4054549494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4c8103700 0x7fe4c819a610 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8005940 tx=0x7fe4b80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:00.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.080+0000 7fe4be7fc640 1 -- 172.21.15.70:0/4054549494 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b803f030 con 0x7fe4c8103700 2024-09-21T05:45:00.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.080+0000 7fe4cf72a640 1 -- 172.21.15.70:0/4054549494 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4c819bc60 con 0x7fe4c8103700 2024-09-21T05:45:00.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.080+0000 7fe4be7fc640 1 -- 172.21.15.70:0/4054549494 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fe4b8003cb0 con 0x7fe4c8103700 2024-09-21T05:45:00.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.080+0000 7fe4be7fc640 1 -- 172.21.15.70:0/4054549494 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8035070 con 0x7fe4c8103700 2024-09-21T05:45:00.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.080+0000 7fe4cf72a640 1 -- 172.21.15.70:0/4054549494 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4c81a21f0 con 0x7fe4c8103700 2024-09-21T05:45:00.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.082+0000 7fe4cf72a640 1 -- 172.21.15.70:0/4054549494 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4c81a2450 con 0x7fe4c8103700 2024-09-21T05:45:00.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.083+0000 7fe4be7fc640 1 -- 172.21.15.70:0/4054549494 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fe4b8042030 con 0x7fe4c8103700 2024-09-21T05:45:00.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.084+0000 7fe4be7fc640 1 --2- 172.21.15.70:0/4054549494 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe4b40b6510 0x7fe4b40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:00.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.084+0000 7fe4cd4c6640 1 --2- 172.21.15.70:0/4054549494 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe4b40b6510 0x7fe4b40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:00.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.084+0000 7fe4be7fc640 1 -- 172.21.15.70:0/4054549494 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5549+0+0 (secure 0 0 0) 0x7fe4b8107220 con 0x7fe4c8103700 2024-09-21T05:45:00.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.084+0000 7fe4cd4c6640 1 --2- 172.21.15.70:0/4054549494 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe4b40b6510 0x7fe4b40b8a20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4005d00 tx=0x7fe4c400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:00.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.087+0000 7fe4be7fc640 1 -- 172.21.15.70:0/4054549494 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe4b80d2960 con 0x7fe4c8103700 2024-09-21T05:45:00.148 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:44:59 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:44:59.826+0000 7f553a327640 -1 osd.8 0 waiting for initial osdmap 2024-09-21T05:45:00.148 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:44:59 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:44:59.835+0000 7f553211d640 -1 osd.8 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:45:00.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:00.275+0000 7fe4cf72a640 1 -- 172.21.15.70:0/4054549494 --> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fe4c80fffe0 con 0x7fe4b40b6510 2024-09-21T05:45:00.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:00 smithi070 ceph-mon[30981]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-09-21T05:45:00.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:00 smithi070 ceph-mon[30981]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T05:45:00.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:00 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:45:00.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:00 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:45:00.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:00 smithi070 ceph-mon[30981]: from='osd.8 ' entity='osd.8' 2024-09-21T05:45:00.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:00 smithi070 ceph-mon[30981]: from='client.14595 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:00.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:00 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:45:00.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:00 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:45:00.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:00 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:00.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:00 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:45:00.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:00 smithi116 ceph-mon[34332]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-09-21T05:45:00.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:00 smithi116 ceph-mon[34332]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T05:45:00.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:00 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:45:00.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:00 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:45:00.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:00 smithi116 ceph-mon[34332]: from='osd.8 ' entity='osd.8' 2024-09-21T05:45:00.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:00 smithi116 ceph-mon[34332]: from='client.14595 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:00.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:00 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:45:00.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:00 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:45:00.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:00 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:00.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:00 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:45:00.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:00 smithi160 ceph-mon[33979]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-09-21T05:45:00.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:00 smithi160 ceph-mon[33979]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T05:45:00.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:00 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:45:00.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:00 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:45:00.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:00 smithi160 ceph-mon[33979]: from='osd.8 ' entity='osd.8' 2024-09-21T05:45:00.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:00 smithi160 ceph-mon[33979]: from='client.14595 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:00.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:00 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:45:00.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:00 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:45:00.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:00 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:00.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:00 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:45:01.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:01 smithi070 ceph-mon[30981]: purged_snaps scrub starts 2024-09-21T05:45:01.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:01 smithi070 ceph-mon[30981]: purged_snaps scrub ok 2024-09-21T05:45:01.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:01 smithi070 ceph-mon[30981]: osd.8 [v2:172.21.15.160:6816/3381625184,v1:172.21.15.160:6817/3381625184] boot 2024-09-21T05:45:01.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:01 smithi070 ceph-mon[30981]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T05:45:01.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:01 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:45:01.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:01 smithi070 ceph-mon[30981]: pgmap v204: 1 pgs: 1 remapped+peering; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:45:01.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:01 smithi116 ceph-mon[34332]: purged_snaps scrub starts 2024-09-21T05:45:01.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:01 smithi116 ceph-mon[34332]: purged_snaps scrub ok 2024-09-21T05:45:01.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:01 smithi116 ceph-mon[34332]: osd.8 [v2:172.21.15.160:6816/3381625184,v1:172.21.15.160:6817/3381625184] boot 2024-09-21T05:45:01.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:01 smithi116 ceph-mon[34332]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T05:45:01.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:01 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:45:01.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:01 smithi116 ceph-mon[34332]: pgmap v204: 1 pgs: 1 remapped+peering; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:45:01.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:01 smithi160 ceph-mon[33979]: purged_snaps scrub starts 2024-09-21T05:45:01.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:01 smithi160 ceph-mon[33979]: purged_snaps scrub ok 2024-09-21T05:45:01.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:01 smithi160 ceph-mon[33979]: osd.8 [v2:172.21.15.160:6816/3381625184,v1:172.21.15.160:6817/3381625184] boot 2024-09-21T05:45:01.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:01 smithi160 ceph-mon[33979]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T05:45:01.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:01 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:45:01.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:01 smithi160 ceph-mon[33979]: pgmap v204: 1 pgs: 1 remapped+peering; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:45:02.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:02 smithi070 ceph-mon[30981]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T05:45:02.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:02 smithi116 ceph-mon[34332]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T05:45:02.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:02 smithi160 ceph-mon[33979]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T05:45:03.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:03 smithi070 ceph-mon[30981]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T05:45:03.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:03 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/904235383' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d8438a9c-012f-4082-be3f-9653cdfaac78"} : dispatch 2024-09-21T05:45:03.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:03 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/904235383' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d8438a9c-012f-4082-be3f-9653cdfaac78"}]': finished 2024-09-21T05:45:03.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:03 smithi070 ceph-mon[30981]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T05:45:03.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:03 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:45:03.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:03 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/248480955' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:45:03.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:03 smithi070 ceph-mon[30981]: pgmap v208: 1 pgs: 1 remapped+peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:45:03.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:03 smithi116 ceph-mon[34332]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T05:45:03.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:03 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/904235383' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d8438a9c-012f-4082-be3f-9653cdfaac78"} : dispatch 2024-09-21T05:45:03.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:03 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/904235383' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d8438a9c-012f-4082-be3f-9653cdfaac78"}]': finished 2024-09-21T05:45:03.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:03 smithi116 ceph-mon[34332]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T05:45:03.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:03 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:45:03.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:03 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/248480955' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:45:03.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:03 smithi116 ceph-mon[34332]: pgmap v208: 1 pgs: 1 remapped+peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:45:03.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:03 smithi160 ceph-mon[33979]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T05:45:03.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:03 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/904235383' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d8438a9c-012f-4082-be3f-9653cdfaac78"} : dispatch 2024-09-21T05:45:03.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:03 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/904235383' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d8438a9c-012f-4082-be3f-9653cdfaac78"}]': finished 2024-09-21T05:45:03.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:03 smithi160 ceph-mon[33979]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T05:45:03.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:03 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:45:03.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:03 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/248480955' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:45:03.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:03 smithi160 ceph-mon[33979]: pgmap v208: 1 pgs: 1 remapped+peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:45:05.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:05 smithi070 ceph-mon[30981]: pgmap v209: 1 pgs: 1 remapped+peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:45:05.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:05 smithi116 ceph-mon[34332]: pgmap v209: 1 pgs: 1 remapped+peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:45:05.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:05 smithi160 ceph-mon[33979]: pgmap v209: 1 pgs: 1 remapped+peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:45:07.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:07 smithi070 ceph-mon[30981]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T05:45:07.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:07 smithi116 ceph-mon[34332]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T05:45:07.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:07 smithi160 ceph-mon[33979]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T05:45:09.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:09 smithi070 ceph-mon[30981]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T05:45:09.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:09 smithi116 ceph-mon[34332]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T05:45:09.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:09 smithi160 ceph-mon[33979]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T05:45:11.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:11 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T05:45:11.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:11 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:11.654 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:11 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T05:45:11.654 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:11 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:11.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:11 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T05:45:11.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:11 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:12.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:12 smithi160 ceph-mon[33979]: Deploying daemon osd.9 on smithi070 2024-09-21T05:45:12.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:12 smithi160 ceph-mon[33979]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-21T05:45:12.719 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:12 smithi070 ceph-mon[30981]: Deploying daemon osd.9 on smithi070 2024-09-21T05:45:12.719 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:12 smithi070 ceph-mon[30981]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-21T05:45:12.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:12 smithi116 ceph-mon[34332]: Deploying daemon osd.9 on smithi070 2024-09-21T05:45:12.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:12 smithi116 ceph-mon[34332]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-21T05:45:13.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:13 smithi070 ceph-mon[30981]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T05:45:13.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:13 smithi116 ceph-mon[34332]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T05:45:13.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:13 smithi160 ceph-mon[33979]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T05:45:15.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:15 smithi070 ceph-mon[30981]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:45:15.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:15 smithi116 ceph-mon[34332]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:45:15.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:15 smithi160 ceph-mon[33979]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:45:17.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:17 smithi070 ceph-mon[30981]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:45:17.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:17 smithi116 ceph-mon[34332]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:45:17.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:17 smithi160 ceph-mon[33979]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:45:18.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:18 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:18.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:18 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:18.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:18 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:18.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:18 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:18.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:18 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:18.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:18 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:18.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:18 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:18.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:18 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:18.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:18 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:19.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:19 smithi070 ceph-mon[30981]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:45:19.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:19 smithi116 ceph-mon[34332]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:45:19.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:19 smithi160 ceph-mon[33979]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:45:20.846 INFO:teuthology.orchestra.run.smithi070.stdout:Created osd(s) 9 on host 'smithi070' 2024-09-21T05:45:20.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:20.843+0000 7fe4be7fc640 1 -- 172.21.15.70:0/4054549494 <== mgr.14150 v2:172.21.15.70:6800/1366013939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe4c80fffe0 con 0x7fe4b40b6510 2024-09-21T05:45:20.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:20.845+0000 7fe4cf72a640 1 -- 172.21.15.70:0/4054549494 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe4b40b6510 msgr2=0x7fe4b40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:20.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:20.845+0000 7fe4cf72a640 1 --2- 172.21.15.70:0/4054549494 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe4b40b6510 0x7fe4b40b8a20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4005d00 tx=0x7fe4c400b410 comp rx=0 tx=0).stop 2024-09-21T05:45:20.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:20.845+0000 7fe4cf72a640 1 -- 172.21.15.70:0/4054549494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4c8103700 msgr2=0x7fe4c819a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:20.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:20.845+0000 7fe4cf72a640 1 --2- 172.21.15.70:0/4054549494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4c8103700 0x7fe4c819a610 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8005940 tx=0x7fe4b80042f0 comp rx=0 tx=0).stop 2024-09-21T05:45:20.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:20.845+0000 7fe4cf72a640 1 -- 172.21.15.70:0/4054549494 shutdown_connections 2024-09-21T05:45:20.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:20.845+0000 7fe4cf72a640 1 --2- 172.21.15.70:0/4054549494 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe4b40b6510 0x7fe4b40b8a20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:20.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:20.845+0000 7fe4cf72a640 1 --2- 172.21.15.70:0/4054549494 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe4c81040a0 0x7fe4c819b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:20.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:20.845+0000 7fe4cf72a640 1 --2- 172.21.15.70:0/4054549494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4c8103700 0x7fe4c819a610 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:20.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:20.845+0000 7fe4cf72a640 1 --2- 172.21.15.70:0/4054549494 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4c8102670 0x7fe4c8199fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:20.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:20.845+0000 7fe4cf72a640 1 -- 172.21.15.70:0/4054549494 >> 172.21.15.70:0/4054549494 conn(0x7fe4c80fdfe0 msgr2=0x7fe4c80ff8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:20.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:20.846+0000 7fe4cf72a640 1 -- 172.21.15.70:0/4054549494 shutdown_connections 2024-09-21T05:45:20.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:45:20.846+0000 7fe4cf72a640 1 -- 172.21.15.70:0/4054549494 wait complete. 2024-09-21T05:45:21.526 DEBUG:teuthology.orchestra.run.smithi070:osd.9> sudo journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.9.service 2024-09-21T05:45:21.528 INFO:tasks.cephadm:Deploying osd.10 on smithi116 with /dev/vg_nvme/lv_1... 2024-09-21T05:45:21.528 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T05:45:21.783 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T05:45:22.121 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:21 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:22.121 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:21 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:22.121 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:21 smithi116 ceph-mon[34332]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:45:22.121 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:21 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:22.121 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:21 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:22.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:21 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:22.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:21 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:22.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:21 smithi160 ceph-mon[33979]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:45:22.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:21 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:22.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:21 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:22.150 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:21 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:22.150 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:21 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:22.150 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:21 smithi070 ceph-mon[30981]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:45:22.151 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:21 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:22.151 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:21 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:23.697 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:23 smithi116 ceph-mon[34332]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:45:23.725 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:23 smithi070 ceph-mon[30981]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:45:23.725 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:45:23 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:45:23.548+0000 7f0c763fa640 -1 osd.9 0 log_to_monitors true 2024-09-21T05:45:23.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:23 smithi160 ceph-mon[33979]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:45:24.312 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-21T05:45:24.338 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi116:vg_nvme/lv_1 2024-09-21T05:45:24.585 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T05:45:24.703 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:24 smithi070 ceph-mon[30981]: from='osd.9 [v2:172.21.15.70:6826/3555256209,v1:172.21.15.70:6827/3555256209]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T05:45:24.705 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:24 smithi116 ceph-mon[34332]: from='osd.9 [v2:172.21.15.70:6826/3555256209,v1:172.21.15.70:6827/3555256209]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T05:45:24.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:24 smithi160 ceph-mon[33979]: from='osd.9 [v2:172.21.15.70:6826/3555256209,v1:172.21.15.70:6827/3555256209]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T05:45:25.070 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.062+0000 7f99e2a68640 1 -- 172.21.15.116:0/618002500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99dc1036d0 msgr2=0x7f99dc103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:25.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.062+0000 7f99e2a68640 1 --2- 172.21.15.116:0/618002500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99dc1036d0 0x7f99dc103ae0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f99c8009900 tx=0x7f99c802a480 comp rx=0 tx=0).stop 2024-09-21T05:45:25.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.062+0000 7f99e2a68640 1 -- 172.21.15.116:0/618002500 shutdown_connections 2024-09-21T05:45:25.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.062+0000 7f99e2a68640 1 --2- 172.21.15.116:0/618002500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99dc104070 0x7f99dc10aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:25.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.062+0000 7f99e2a68640 1 --2- 172.21.15.116:0/618002500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99dc1036d0 0x7f99dc103ae0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:25.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.062+0000 7f99e2a68640 1 --2- 172.21.15.116:0/618002500 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99dc102640 0x7f99dc102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:25.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.062+0000 7f99e2a68640 1 -- 172.21.15.116:0/618002500 >> 172.21.15.116:0/618002500 conn(0x7f99dc0fdfb0 msgr2=0x7f99dc100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:25.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.062+0000 7f99e2a68640 1 -- 172.21.15.116:0/618002500 shutdown_connections 2024-09-21T05:45:25.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.062+0000 7f99e2a68640 1 -- 172.21.15.116:0/618002500 wait complete. 2024-09-21T05:45:25.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.063+0000 7f99e2a68640 1 Processor -- start 2024-09-21T05:45:25.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.063+0000 7f99e2a68640 1 -- start start 2024-09-21T05:45:25.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.063+0000 7f99e2a68640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99dc102640 0x7f99dc198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:25.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.063+0000 7f99e2a68640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99dc1036d0 0x7f99dc199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:25.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.063+0000 7f99e2a68640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99dc104070 0x7f99dc19a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:25.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.063+0000 7f99e2a68640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc10e270 con 0x7f99dc1036d0 2024-09-21T05:45:25.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.063+0000 7f99e2a68640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc10e0f0 con 0x7f99dc102640 2024-09-21T05:45:25.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.063+0000 7f99e2a68640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc10e3f0 con 0x7f99dc104070 2024-09-21T05:45:25.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.063+0000 7f99e0804640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99dc102640 0x7f99dc198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:25.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.063+0000 7f99e0804640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99dc102640 0x7f99dc198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:37422/0 (socket says 172.21.15.116:37422) 2024-09-21T05:45:25.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.063+0000 7f99e0804640 1 -- 172.21.15.116:0/2951137969 learned_addr learned my addr 172.21.15.116:0/2951137969 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-21T05:45:25.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.063+0000 7f99dbfff640 1 --2- 172.21.15.116:0/2951137969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99dc1036d0 0x7f99dc199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:25.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.063+0000 7f99e1005640 1 --2- 172.21.15.116:0/2951137969 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99dc104070 0x7f99dc19a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:25.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.064+0000 7f99e0804640 1 -- 172.21.15.116:0/2951137969 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99dc104070 msgr2=0x7f99dc19a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:25.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.064+0000 7f99e0804640 1 --2- 172.21.15.116:0/2951137969 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99dc104070 0x7f99dc19a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:25.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.064+0000 7f99e0804640 1 -- 172.21.15.116:0/2951137969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99dc1036d0 msgr2=0x7f99dc199520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:25.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.064+0000 7f99e0804640 1 --2- 172.21.15.116:0/2951137969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99dc1036d0 0x7f99dc199520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:25.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.064+0000 7f99e0804640 1 -- 172.21.15.116:0/2951137969 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99dc19a8e0 con 0x7f99dc102640 2024-09-21T05:45:25.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.064+0000 7f99e0804640 1 --2- 172.21.15.116:0/2951137969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99dc102640 0x7f99dc198eb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f99d000e9f0 tx=0x7f99d000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:25.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.067+0000 7f99d9ffb640 1 -- 172.21.15.116:0/2951137969 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d000cd80 con 0x7f99dc102640 2024-09-21T05:45:25.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.067+0000 7f99d9ffb640 1 -- 172.21.15.116:0/2951137969 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f99d00054d0 con 0x7f99dc102640 2024-09-21T05:45:25.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.067+0000 7f99d9ffb640 1 -- 172.21.15.116:0/2951137969 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d0010690 con 0x7f99dc102640 2024-09-21T05:45:25.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.067+0000 7f99e2a68640 1 -- 172.21.15.116:0/2951137969 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99dc19abd0 con 0x7f99dc102640 2024-09-21T05:45:25.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.067+0000 7f99e2a68640 1 -- 172.21.15.116:0/2951137969 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99dc06b030 con 0x7f99dc102640 2024-09-21T05:45:25.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.068+0000 7f99e2a68640 1 -- 172.21.15.116:0/2951137969 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99dc19ae30 con 0x7f99dc102640 2024-09-21T05:45:25.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.069+0000 7f99d9ffb640 1 -- 172.21.15.116:0/2951137969 <== mon.2 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f99d00046c0 con 0x7f99dc102640 2024-09-21T05:45:25.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.070+0000 7f99d9ffb640 1 --2- 172.21.15.116:0/2951137969 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f99cc0b6590 0x7f99cc0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:25.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.070+0000 7f99dbfff640 1 --2- 172.21.15.116:0/2951137969 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f99cc0b6590 0x7f99cc0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:25.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.070+0000 7f99d9ffb640 1 -- 172.21.15.116:0/2951137969 <== mon.2 v2:172.21.15.116:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5965+0+0 (secure 0 0 0) 0x7f99d00e6d20 con 0x7f99dc102640 2024-09-21T05:45:25.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.070+0000 7f99dbfff640 1 --2- 172.21.15.116:0/2951137969 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f99cc0b6590 0x7f99cc0b8aa0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f99c8006010 tx=0x7f99c8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:25.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.074+0000 7f99d9ffb640 1 -- 172.21.15.116:0/2951137969 <== mon.2 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f99d00adee0 con 0x7f99dc102640 2024-09-21T05:45:25.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:25.271+0000 7f99e2a68640 1 -- 172.21.15.116:0/2951137969 --> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f99dc109300 con 0x7f99cc0b6590 2024-09-21T05:45:25.465 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:25 smithi070 ceph-mon[30981]: from='osd.9 [v2:172.21.15.70:6826/3555256209,v1:172.21.15.70:6827/3555256209]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T05:45:25.465 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:25 smithi070 ceph-mon[30981]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T05:45:25.465 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:25 smithi070 ceph-mon[30981]: from='osd.9 [v2:172.21.15.70:6826/3555256209,v1:172.21.15.70:6827/3555256209]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-21T05:45:25.465 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:25 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:45:25.465 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:25 smithi070 ceph-mon[30981]: Detected new or changed devices on smithi070 2024-09-21T05:45:25.466 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:25 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:25.466 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:25 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:25.466 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:25 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:25.466 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:25 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:25.466 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:25 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:25.466 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:25 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:25.466 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:25 smithi070 ceph-mon[30981]: Adjusting osd_memory_target on smithi070 to 4272M 2024-09-21T05:45:25.466 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:25 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:25.466 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:25 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:25.466 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:25 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:25.466 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:25 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:25.467 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:25 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:25.467 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:25 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:25.467 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:25 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:25.467 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:25 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:25.467 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:25 smithi070 ceph-mon[30981]: from='client.24503 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:25.467 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:25 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:45:25.467 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:25 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:45:25.467 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:25 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:25.467 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:25 smithi070 ceph-mon[30981]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:45:25.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:25 smithi116 ceph-mon[34332]: from='osd.9 [v2:172.21.15.70:6826/3555256209,v1:172.21.15.70:6827/3555256209]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T05:45:25.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:25 smithi116 ceph-mon[34332]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T05:45:25.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:25 smithi116 ceph-mon[34332]: from='osd.9 [v2:172.21.15.70:6826/3555256209,v1:172.21.15.70:6827/3555256209]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-21T05:45:25.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:25 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:45:25.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:25 smithi116 ceph-mon[34332]: Detected new or changed devices on smithi070 2024-09-21T05:45:25.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:25 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:25.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:25 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:25.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:25 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:25.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:25 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:25.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:25 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:25.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:25 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:25.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:25 smithi116 ceph-mon[34332]: Adjusting osd_memory_target on smithi070 to 4272M 2024-09-21T05:45:25.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:25 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:25.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:25 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:25.556 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:25 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:25.556 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:25 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:25.556 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:25 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:25.556 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:25 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:25.556 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:25 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:25.556 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:25 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:25.556 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:25 smithi116 ceph-mon[34332]: from='client.24503 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:25.556 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:25 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:45:25.556 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:25 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:45:25.556 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:25 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:25.556 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:25 smithi116 ceph-mon[34332]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:45:25.745 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:45:25 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:45:25.460+0000 7f0c7237c640 -1 osd.9 0 waiting for initial osdmap 2024-09-21T05:45:25.745 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:45:25 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:45:25.471+0000 7f0c6e17a640 -1 osd.9 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:45:25.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:25 smithi160 ceph-mon[33979]: from='osd.9 [v2:172.21.15.70:6826/3555256209,v1:172.21.15.70:6827/3555256209]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T05:45:25.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:25 smithi160 ceph-mon[33979]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T05:45:25.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:25 smithi160 ceph-mon[33979]: from='osd.9 [v2:172.21.15.70:6826/3555256209,v1:172.21.15.70:6827/3555256209]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-09-21T05:45:25.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:25 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:45:25.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:25 smithi160 ceph-mon[33979]: Detected new or changed devices on smithi070 2024-09-21T05:45:25.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:25 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:25.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:25 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:25.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:25 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:25.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:25 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:25.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:25 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:25.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:25 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:25.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:25 smithi160 ceph-mon[33979]: Adjusting osd_memory_target on smithi070 to 4272M 2024-09-21T05:45:25.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:25 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:25.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:25 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:25.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:25 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:25.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:25 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:25.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:25 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:25.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:25 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:25.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:25 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:25.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:25 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:25.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:25 smithi160 ceph-mon[33979]: from='client.24503 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:25.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:25 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:45:25.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:25 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:45:25.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:25 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:25.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:25 smithi160 ceph-mon[33979]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:45:26.670 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:26 smithi116 ceph-mon[34332]: from='osd.9 [v2:172.21.15.70:6826/3555256209,v1:172.21.15.70:6827/3555256209]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-21T05:45:26.670 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:26 smithi116 ceph-mon[34332]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T05:45:26.670 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:26 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:45:26.670 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:26 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:45:26.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:26 smithi070 ceph-mon[30981]: from='osd.9 [v2:172.21.15.70:6826/3555256209,v1:172.21.15.70:6827/3555256209]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-21T05:45:26.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:26 smithi070 ceph-mon[30981]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T05:45:26.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:26 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:45:26.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:26 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:45:26.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:26 smithi160 ceph-mon[33979]: from='osd.9 [v2:172.21.15.70:6826/3555256209,v1:172.21.15.70:6827/3555256209]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-21T05:45:26.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:26 smithi160 ceph-mon[33979]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T05:45:26.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:26 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:45:26.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:26 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:45:27.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:27 smithi070 ceph-mon[30981]: purged_snaps scrub starts 2024-09-21T05:45:27.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:27 smithi070 ceph-mon[30981]: purged_snaps scrub ok 2024-09-21T05:45:27.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:27 smithi070 ceph-mon[30981]: osd.9 [v2:172.21.15.70:6826/3555256209,v1:172.21.15.70:6827/3555256209] boot 2024-09-21T05:45:27.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:27 smithi070 ceph-mon[30981]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T05:45:27.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:27 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:45:27.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:27 smithi070 ceph-mon[30981]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:45:27.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:27 smithi116 ceph-mon[34332]: purged_snaps scrub starts 2024-09-21T05:45:27.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:27 smithi116 ceph-mon[34332]: purged_snaps scrub ok 2024-09-21T05:45:27.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:27 smithi116 ceph-mon[34332]: osd.9 [v2:172.21.15.70:6826/3555256209,v1:172.21.15.70:6827/3555256209] boot 2024-09-21T05:45:27.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:27 smithi116 ceph-mon[34332]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T05:45:27.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:27 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:45:27.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:27 smithi116 ceph-mon[34332]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:45:27.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:27 smithi160 ceph-mon[33979]: purged_snaps scrub starts 2024-09-21T05:45:27.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:27 smithi160 ceph-mon[33979]: purged_snaps scrub ok 2024-09-21T05:45:27.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:27 smithi160 ceph-mon[33979]: osd.9 [v2:172.21.15.70:6826/3555256209,v1:172.21.15.70:6827/3555256209] boot 2024-09-21T05:45:27.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:27 smithi160 ceph-mon[33979]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T05:45:27.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:27 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:45:27.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:27 smithi160 ceph-mon[33979]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:45:28.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:28 smithi070 ceph-mon[30981]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T05:45:28.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:28 smithi070 ceph-mon[30981]: from='client.? 172.21.15.116:0/1832671277' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "871619b0-181e-4020-9511-2cec296bfe70"} : dispatch 2024-09-21T05:45:28.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:28 smithi070 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "871619b0-181e-4020-9511-2cec296bfe70"} : dispatch 2024-09-21T05:45:28.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:28 smithi070 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "871619b0-181e-4020-9511-2cec296bfe70"}]': finished 2024-09-21T05:45:28.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:28 smithi070 ceph-mon[30981]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T05:45:28.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:28 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:45:28.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:28 smithi070 ceph-mon[30981]: from='client.? 172.21.15.116:0/216807984' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:45:28.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:28 smithi116 ceph-mon[34332]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T05:45:28.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:28 smithi116 ceph-mon[34332]: from='client.? 172.21.15.116:0/1832671277' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "871619b0-181e-4020-9511-2cec296bfe70"} : dispatch 2024-09-21T05:45:28.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:28 smithi116 ceph-mon[34332]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "871619b0-181e-4020-9511-2cec296bfe70"} : dispatch 2024-09-21T05:45:28.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:28 smithi116 ceph-mon[34332]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "871619b0-181e-4020-9511-2cec296bfe70"}]': finished 2024-09-21T05:45:28.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:28 smithi116 ceph-mon[34332]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T05:45:28.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:28 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:45:28.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:28 smithi116 ceph-mon[34332]: from='client.? 172.21.15.116:0/216807984' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:45:28.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:28 smithi160 ceph-mon[33979]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T05:45:28.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:28 smithi160 ceph-mon[33979]: from='client.? 172.21.15.116:0/1832671277' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "871619b0-181e-4020-9511-2cec296bfe70"} : dispatch 2024-09-21T05:45:28.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:28 smithi160 ceph-mon[33979]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "871619b0-181e-4020-9511-2cec296bfe70"} : dispatch 2024-09-21T05:45:28.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:28 smithi160 ceph-mon[33979]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "871619b0-181e-4020-9511-2cec296bfe70"}]': finished 2024-09-21T05:45:28.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:28 smithi160 ceph-mon[33979]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T05:45:28.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:28 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:45:28.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:28 smithi160 ceph-mon[33979]: from='client.? 172.21.15.116:0/216807984' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:45:29.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:29 smithi070 ceph-mon[30981]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:29.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:29 smithi116 ceph-mon[34332]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:29.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:29 smithi160 ceph-mon[33979]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:31.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:31 smithi070 ceph-mon[30981]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:31.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:31 smithi116 ceph-mon[34332]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:31.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:31 smithi160 ceph-mon[33979]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:33.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:33 smithi070 ceph-mon[30981]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:33.755 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:33 smithi116 ceph-mon[34332]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:33.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:33 smithi160 ceph-mon[33979]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:35.517 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:35 smithi116 ceph-mon[34332]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:35.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:35 smithi070 ceph-mon[30981]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:35.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:35 smithi160 ceph-mon[33979]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:36.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:36 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T05:45:36.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:36 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:37.047 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:36 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T05:45:37.047 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:36 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:37.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:36 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T05:45:37.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:36 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:37.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:37 smithi070 ceph-mon[30981]: Deploying daemon osd.10 on smithi116 2024-09-21T05:45:37.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:37 smithi070 ceph-mon[30981]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:38.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:37 smithi116 ceph-mon[34332]: Deploying daemon osd.10 on smithi116 2024-09-21T05:45:38.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:37 smithi116 ceph-mon[34332]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:38.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:37 smithi160 ceph-mon[33979]: Deploying daemon osd.10 on smithi116 2024-09-21T05:45:38.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:37 smithi160 ceph-mon[33979]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:39.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:39 smithi070 ceph-mon[30981]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:39.761 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:39 smithi116 ceph-mon[34332]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:39.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:39 smithi160 ceph-mon[33979]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:41.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:41 smithi070 ceph-mon[30981]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:41.763 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:41 smithi116 ceph-mon[34332]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:41.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:41 smithi160 ceph-mon[33979]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:42.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:42 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:42.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:42 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:42.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:42 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:43.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:42 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:43.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:42 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:43.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:42 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:43.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:42 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:43.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:42 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:43.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:42 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:43.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:43 smithi070 ceph-mon[30981]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:44.026 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:43 smithi116 ceph-mon[34332]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:44.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:43 smithi160 ceph-mon[33979]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:45.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:45 smithi070 ceph-mon[30981]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:45.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:45 smithi116 ceph-mon[34332]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:45.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:45 smithi160 ceph-mon[33979]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:46.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:46.246+0000 7f99d9ffb640 1 -- 172.21.15.116:0/2951137969 <== mgr.14150 v2:172.21.15.70:6800/1366013939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f99dc109300 con 0x7f99cc0b6590 2024-09-21T05:45:46.248 INFO:teuthology.orchestra.run.smithi116.stdout:Created osd(s) 10 on host 'smithi116' 2024-09-21T05:45:46.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:46.248+0000 7f99e2a68640 1 -- 172.21.15.116:0/2951137969 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f99cc0b6590 msgr2=0x7f99cc0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:46.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:46.248+0000 7f99e2a68640 1 --2- 172.21.15.116:0/2951137969 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f99cc0b6590 0x7f99cc0b8aa0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f99c8006010 tx=0x7f99c8000bc0 comp rx=0 tx=0).stop 2024-09-21T05:45:46.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:46.248+0000 7f99e2a68640 1 -- 172.21.15.116:0/2951137969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99dc102640 msgr2=0x7f99dc198eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:46.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:46.248+0000 7f99e2a68640 1 --2- 172.21.15.116:0/2951137969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99dc102640 0x7f99dc198eb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f99d000e9f0 tx=0x7f99d000edf0 comp rx=0 tx=0).stop 2024-09-21T05:45:46.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:46.248+0000 7f99e2a68640 1 -- 172.21.15.116:0/2951137969 shutdown_connections 2024-09-21T05:45:46.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:46.248+0000 7f99e2a68640 1 --2- 172.21.15.116:0/2951137969 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f99cc0b6590 0x7f99cc0b8aa0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:46.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:46.248+0000 7f99e2a68640 1 --2- 172.21.15.116:0/2951137969 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99dc104070 0x7f99dc19a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:46.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:46.248+0000 7f99e2a68640 1 --2- 172.21.15.116:0/2951137969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99dc1036d0 0x7f99dc199520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:46.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:46.248+0000 7f99e2a68640 1 --2- 172.21.15.116:0/2951137969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99dc102640 0x7f99dc198eb0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:46.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:46.249+0000 7f99e2a68640 1 -- 172.21.15.116:0/2951137969 >> 172.21.15.116:0/2951137969 conn(0x7f99dc0fdfb0 msgr2=0x7f99dc1069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:46.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:46.249+0000 7f99e2a68640 1 -- 172.21.15.116:0/2951137969 shutdown_connections 2024-09-21T05:45:46.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-21T05:45:46.249+0000 7f99e2a68640 1 -- 172.21.15.116:0/2951137969 wait complete. 2024-09-21T05:45:46.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:46 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:46.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:46 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:46.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:46 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:46.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:46 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:46.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:46 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:46.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:46 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:46.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:46 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:46.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:46 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:46.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:46 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:46.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:46 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:46.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:46 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:46.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:46 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:46.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:46 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:46.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:46 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:46.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:46 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:46.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:46 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:46.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:46 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:46.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:46 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:46.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:46 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:46.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:46 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:46.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:46 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:46.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:46 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:46.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:46 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:46.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:46 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:46.963 DEBUG:teuthology.orchestra.run.smithi116:osd.10> sudo journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.10.service 2024-09-21T05:45:46.965 INFO:tasks.cephadm:Deploying osd.11 on smithi160 with /dev/vg_nvme/lv_1... 2024-09-21T05:45:46.965 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T05:45:47.223 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:45:47.627 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:47 smithi160 ceph-mon[33979]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:47.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:47 smithi070 ceph-mon[30981]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:47.791 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:47 smithi116 ceph-mon[34332]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:48.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:48 smithi160 ceph-mon[33979]: from='osd.10 [v2:172.21.15.116:6824/541280433,v1:172.21.15.116:6825/541280433]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T05:45:48.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:48 smithi160 ceph-mon[33979]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T05:45:48.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:48 smithi116 ceph-mon[34332]: from='osd.10 [v2:172.21.15.116:6824/541280433,v1:172.21.15.116:6825/541280433]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T05:45:48.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:48 smithi116 ceph-mon[34332]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T05:45:48.805 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:45:48 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:45:48.540+0000 7f6efc2a9640 -1 osd.10 0 log_to_monitors true 2024-09-21T05:45:48.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:48 smithi070 ceph-mon[30981]: from='osd.10 [v2:172.21.15.116:6824/541280433,v1:172.21.15.116:6825/541280433]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T05:45:48.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:48 smithi070 ceph-mon[30981]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T05:45:49.759 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:49 smithi116 ceph-mon[34332]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T05:45:49.759 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:49 smithi116 ceph-mon[34332]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T05:45:49.759 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:49 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:45:49.759 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:49 smithi116 ceph-mon[34332]: from='osd.10 [v2:172.21.15.116:6824/541280433,v1:172.21.15.116:6825/541280433]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi116", "root=default"]} : dispatch 2024-09-21T05:45:49.759 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:49 smithi116 ceph-mon[34332]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi116", "root=default"]} : dispatch 2024-09-21T05:45:49.759 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:49 smithi116 ceph-mon[34332]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:49.759 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:45:49 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:45:49.616+0000 7f6ef822b640 -1 osd.10 0 waiting for initial osdmap 2024-09-21T05:45:49.759 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:45:49 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:45:49.630+0000 7f6ef4029640 -1 osd.10 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:45:49.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:49 smithi160 ceph-mon[33979]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T05:45:49.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:49 smithi160 ceph-mon[33979]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T05:45:49.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:49 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:45:49.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:49 smithi160 ceph-mon[33979]: from='osd.10 [v2:172.21.15.116:6824/541280433,v1:172.21.15.116:6825/541280433]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi116", "root=default"]} : dispatch 2024-09-21T05:45:49.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:49 smithi160 ceph-mon[33979]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi116", "root=default"]} : dispatch 2024-09-21T05:45:49.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:49 smithi160 ceph-mon[33979]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:49.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:49 smithi070 ceph-mon[30981]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T05:45:49.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:49 smithi070 ceph-mon[30981]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T05:45:49.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:49 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:45:49.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:49 smithi070 ceph-mon[30981]: from='osd.10 [v2:172.21.15.116:6824/541280433,v1:172.21.15.116:6825/541280433]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi116", "root=default"]} : dispatch 2024-09-21T05:45:49.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:49 smithi070 ceph-mon[30981]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi116", "root=default"]} : dispatch 2024-09-21T05:45:49.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:49 smithi070 ceph-mon[30981]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:50.009 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-21T05:45:50.036 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi160:vg_nvme/lv_1 2024-09-21T05:45:50.301 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:45:50.738 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:50 smithi160 ceph-mon[33979]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-21T05:45:50.738 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:50 smithi160 ceph-mon[33979]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T05:45:50.738 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:50 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:45:50.738 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:50 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:45:50.738 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:50 smithi160 ceph-mon[33979]: Detected new or changed devices on smithi116 2024-09-21T05:45:50.738 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:50 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:50.738 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:50 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:50.739 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:50 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:50.739 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:50 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:50.739 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:50 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:50.739 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:50 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:50.739 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:50 smithi160 ceph-mon[33979]: Adjusting osd_memory_target on smithi116 to 4272M 2024-09-21T05:45:50.739 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:50 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:50.739 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:50 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:50.739 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:50 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:50.739 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:50 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:50.769 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.735+0000 7f94f15c0640 1 -- 172.21.15.160:0/2896881256 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94ec104070 msgr2=0x7f94ec10aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:50.770 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.735+0000 7f94f15c0640 1 --2- 172.21.15.160:0/2896881256 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94ec104070 0x7f94ec10aa10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f94dc009900 tx=0x7f94dc02a480 comp rx=0 tx=0).stop 2024-09-21T05:45:50.770 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.735+0000 7f94f15c0640 1 -- 172.21.15.160:0/2896881256 shutdown_connections 2024-09-21T05:45:50.770 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.735+0000 7f94f15c0640 1 --2- 172.21.15.160:0/2896881256 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94ec104070 0x7f94ec10aa10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:50.770 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.735+0000 7f94f15c0640 1 --2- 172.21.15.160:0/2896881256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94ec1036d0 0x7f94ec103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:50.770 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.735+0000 7f94f15c0640 1 --2- 172.21.15.160:0/2896881256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94ec102640 0x7f94ec102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:50.770 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.735+0000 7f94f15c0640 1 -- 172.21.15.160:0/2896881256 >> 172.21.15.160:0/2896881256 conn(0x7f94ec0fdfb0 msgr2=0x7f94ec100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:50.770 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.735+0000 7f94f15c0640 1 -- 172.21.15.160:0/2896881256 shutdown_connections 2024-09-21T05:45:50.770 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.735+0000 7f94f15c0640 1 -- 172.21.15.160:0/2896881256 wait complete. 2024-09-21T05:45:50.770 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.736+0000 7f94f15c0640 1 Processor -- start 2024-09-21T05:45:50.770 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.736+0000 7f94f15c0640 1 -- start start 2024-09-21T05:45:50.770 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.736+0000 7f94f15c0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94ec102640 0x7f94ec06b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:50.770 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.736+0000 7f94f15c0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94ec1036d0 0x7f94ec19ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:50.771 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.736+0000 7f94f15c0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94ec104070 0x7f94ec1a1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:50.771 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.736+0000 7f94f15c0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f94ec10e270 con 0x7f94ec104070 2024-09-21T05:45:50.771 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.736+0000 7f94f15c0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f94ec10e0f0 con 0x7f94ec1036d0 2024-09-21T05:45:50.771 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.736+0000 7f94f15c0640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f94ec10e3f0 con 0x7f94ec102640 2024-09-21T05:45:50.771 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.737+0000 7f94eaffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94ec102640 0x7f94ec06b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:50.771 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.737+0000 7f94eaffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94ec102640 0x7f94ec06b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:45192/0 (socket says 172.21.15.160:45192) 2024-09-21T05:45:50.771 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.737+0000 7f94eaffd640 1 -- 172.21.15.160:0/1645669736 learned_addr learned my addr 172.21.15.160:0/1645669736 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-09-21T05:45:50.771 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.737+0000 7f94ea7fc640 1 --2- 172.21.15.160:0/1645669736 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94ec1036d0 0x7f94ec19ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:50.771 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.737+0000 7f94eb7fe640 1 --2- 172.21.15.160:0/1645669736 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94ec104070 0x7f94ec1a1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:50.771 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.737+0000 7f94eaffd640 1 -- 172.21.15.160:0/1645669736 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94ec1036d0 msgr2=0x7f94ec19ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:50.771 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.737+0000 7f94eaffd640 1 --2- 172.21.15.160:0/1645669736 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94ec1036d0 0x7f94ec19ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:50.771 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.737+0000 7f94eaffd640 1 -- 172.21.15.160:0/1645669736 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94ec104070 msgr2=0x7f94ec1a1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:50.771 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.737+0000 7f94eaffd640 1 --2- 172.21.15.160:0/1645669736 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94ec104070 0x7f94ec1a1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:50.771 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.737+0000 7f94eaffd640 1 -- 172.21.15.160:0/1645669736 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94ec1a1a30 con 0x7f94ec102640 2024-09-21T05:45:50.771 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.737+0000 7f94eaffd640 1 --2- 172.21.15.160:0/1645669736 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94ec102640 0x7f94ec06b6a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f94e400ea80 tx=0x7f94e400ef40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:50.772 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.737+0000 7f94e3fff640 1 -- 172.21.15.160:0/1645669736 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e400ce40 con 0x7f94ec102640 2024-09-21T05:45:50.772 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.737+0000 7f94e3fff640 1 -- 172.21.15.160:0/1645669736 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f94e4005020 con 0x7f94ec102640 2024-09-21T05:45:50.772 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.737+0000 7f94f15c0640 1 -- 172.21.15.160:0/1645669736 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94ec1a1d20 con 0x7f94ec102640 2024-09-21T05:45:50.772 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.737+0000 7f94e3fff640 1 -- 172.21.15.160:0/1645669736 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e40116d0 con 0x7f94ec102640 2024-09-21T05:45:50.772 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.737+0000 7f94f15c0640 1 -- 172.21.15.160:0/1645669736 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94ec1a21b0 con 0x7f94ec102640 2024-09-21T05:45:50.772 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.738+0000 7f94f15c0640 1 -- 172.21.15.160:0/1645669736 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94ec109820 con 0x7f94ec102640 2024-09-21T05:45:50.772 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.740+0000 7f94e3fff640 1 -- 172.21.15.160:0/1645669736 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f94e4005560 con 0x7f94ec102640 2024-09-21T05:45:50.772 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.740+0000 7f94e3fff640 1 --2- 172.21.15.160:0/1645669736 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f94d80b6510 0x7f94d80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:50.772 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.741+0000 7f94e3fff640 1 -- 172.21.15.160:0/1645669736 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6727+0+0 (secure 0 0 0) 0x7f94e40e72c0 con 0x7f94ec102640 2024-09-21T05:45:50.772 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.741+0000 7f94ea7fc640 1 --2- 172.21.15.160:0/1645669736 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f94d80b6510 0x7f94d80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:50.772 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.742+0000 7f94ea7fc640 1 --2- 172.21.15.160:0/1645669736 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f94d80b6510 0x7f94d80b8a20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f94d40058c0 tx=0x7f94d400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:50.772 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.744+0000 7f94e3fff640 1 -- 172.21.15.160:0/1645669736 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f94e4016030 con 0x7f94ec102640 2024-09-21T05:45:50.934 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:45:50.932+0000 7f94f15c0640 1 -- 172.21.15.160:0/1645669736 --> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f94ec063800 con 0x7f94d80b6510 2024-09-21T05:45:50.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:50 smithi070 ceph-mon[30981]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-21T05:45:50.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:50 smithi070 ceph-mon[30981]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T05:45:50.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:50 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:45:50.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:50 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:45:50.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:50 smithi070 ceph-mon[30981]: Detected new or changed devices on smithi116 2024-09-21T05:45:50.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:50 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:50.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:50 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:50.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:50 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:50.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:50 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:50.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:50 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:50.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:50 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:50.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:50 smithi070 ceph-mon[30981]: Adjusting osd_memory_target on smithi116 to 4272M 2024-09-21T05:45:50.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:50 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:50.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:50 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:50.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:50 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:50.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:50 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:51.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:50 smithi116 ceph-mon[34332]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-21T05:45:51.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:50 smithi116 ceph-mon[34332]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T05:45:51.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:50 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:45:51.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:50 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:45:51.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:50 smithi116 ceph-mon[34332]: Detected new or changed devices on smithi116 2024-09-21T05:45:51.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:50 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:51.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:50 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:51.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:50 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:51.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:50 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:51.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:50 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:51.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:50 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:51.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:50 smithi116 ceph-mon[34332]: Adjusting osd_memory_target on smithi116 to 4272M 2024-09-21T05:45:51.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:50 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:51.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:50 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:51.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:50 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:51.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:50 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:45:51.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:51 smithi160 ceph-mon[33979]: purged_snaps scrub starts 2024-09-21T05:45:51.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:51 smithi160 ceph-mon[33979]: purged_snaps scrub ok 2024-09-21T05:45:51.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:51 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:45:51.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:51 smithi160 ceph-mon[33979]: osd.10 [v2:172.21.15.116:6824/541280433,v1:172.21.15.116:6825/541280433] boot 2024-09-21T05:45:51.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:51 smithi160 ceph-mon[33979]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T05:45:51.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:51 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:45:51.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:51 smithi160 ceph-mon[33979]: from='client.24505 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:51.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:51 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:45:51.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:51 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:45:51.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:51 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:51.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:51 smithi160 ceph-mon[33979]: pgmap v240: 1 pgs: 1 remapped+peering; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:51.956 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:51 smithi116 ceph-mon[34332]: purged_snaps scrub starts 2024-09-21T05:45:51.956 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:51 smithi116 ceph-mon[34332]: purged_snaps scrub ok 2024-09-21T05:45:51.956 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:51 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:45:51.956 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:51 smithi116 ceph-mon[34332]: osd.10 [v2:172.21.15.116:6824/541280433,v1:172.21.15.116:6825/541280433] boot 2024-09-21T05:45:51.956 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:51 smithi116 ceph-mon[34332]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T05:45:51.956 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:51 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:45:51.956 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:51 smithi116 ceph-mon[34332]: from='client.24505 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:51.956 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:51 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:45:51.956 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:51 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:45:51.956 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:51 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:51.956 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:51 smithi116 ceph-mon[34332]: pgmap v240: 1 pgs: 1 remapped+peering; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:51.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:51 smithi070 ceph-mon[30981]: purged_snaps scrub starts 2024-09-21T05:45:51.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:51 smithi070 ceph-mon[30981]: purged_snaps scrub ok 2024-09-21T05:45:51.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:51 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:45:51.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:51 smithi070 ceph-mon[30981]: osd.10 [v2:172.21.15.116:6824/541280433,v1:172.21.15.116:6825/541280433] boot 2024-09-21T05:45:51.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:51 smithi070 ceph-mon[30981]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T05:45:51.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:51 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:45:51.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:51 smithi070 ceph-mon[30981]: from='client.24505 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:51.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:51 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:45:51.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:51 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:45:51.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:51 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:51.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:51 smithi070 ceph-mon[30981]: pgmap v240: 1 pgs: 1 remapped+peering; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:45:52.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:52 smithi160 ceph-mon[33979]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T05:45:52.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:52 smithi070 ceph-mon[30981]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T05:45:53.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:52 smithi116 ceph-mon[34332]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T05:45:53.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:53 smithi160 ceph-mon[33979]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T05:45:53.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:53 smithi160 ceph-mon[33979]: pgmap v243: 1 pgs: 1 remapped+peering; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:45:53.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:53 smithi160 ceph-mon[33979]: from='client.? 172.21.15.160:0/1195049217' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "302da945-7929-4b0c-a20b-099175752c41"} : dispatch 2024-09-21T05:45:53.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:53 smithi160 ceph-mon[33979]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "302da945-7929-4b0c-a20b-099175752c41"} : dispatch 2024-09-21T05:45:53.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:53 smithi160 ceph-mon[33979]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "302da945-7929-4b0c-a20b-099175752c41"}]': finished 2024-09-21T05:45:53.650 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:53 smithi160 ceph-mon[33979]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T05:45:53.650 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:53 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:45:53.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:53 smithi070 ceph-mon[30981]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T05:45:53.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:53 smithi070 ceph-mon[30981]: pgmap v243: 1 pgs: 1 remapped+peering; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:45:53.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:53 smithi070 ceph-mon[30981]: from='client.? 172.21.15.160:0/1195049217' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "302da945-7929-4b0c-a20b-099175752c41"} : dispatch 2024-09-21T05:45:53.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:53 smithi070 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "302da945-7929-4b0c-a20b-099175752c41"} : dispatch 2024-09-21T05:45:53.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:53 smithi070 ceph-mon[30981]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "302da945-7929-4b0c-a20b-099175752c41"}]': finished 2024-09-21T05:45:53.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:53 smithi070 ceph-mon[30981]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T05:45:53.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:53 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:45:54.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:53 smithi116 ceph-mon[34332]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T05:45:54.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:53 smithi116 ceph-mon[34332]: pgmap v243: 1 pgs: 1 remapped+peering; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:45:54.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:53 smithi116 ceph-mon[34332]: from='client.? 172.21.15.160:0/1195049217' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "302da945-7929-4b0c-a20b-099175752c41"} : dispatch 2024-09-21T05:45:54.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:53 smithi116 ceph-mon[34332]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "302da945-7929-4b0c-a20b-099175752c41"} : dispatch 2024-09-21T05:45:54.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:53 smithi116 ceph-mon[34332]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "302da945-7929-4b0c-a20b-099175752c41"}]': finished 2024-09-21T05:45:54.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:53 smithi116 ceph-mon[34332]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T05:45:54.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:53 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:45:54.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:54 smithi160 ceph-mon[33979]: from='client.? 172.21.15.160:0/444531982' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:45:54.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:54 smithi070 ceph-mon[30981]: from='client.? 172.21.15.160:0/444531982' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:45:55.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:54 smithi116 ceph-mon[34332]: from='client.? 172.21.15.160:0/444531982' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:45:55.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:55 smithi070 ceph-mon[30981]: pgmap v245: 1 pgs: 1 remapped+peering; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:45:56.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:55 smithi116 ceph-mon[34332]: pgmap v245: 1 pgs: 1 remapped+peering; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:45:56.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:55 smithi160 ceph-mon[33979]: pgmap v245: 1 pgs: 1 remapped+peering; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:45:57.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:57 smithi070 ceph-mon[30981]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T05:45:57.783 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:57 smithi160 ceph-mon[33979]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T05:45:57.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:57 smithi116 ceph-mon[34332]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T05:45:59.463 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:45:59 smithi160 ceph-mon[33979]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T05:45:59.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:45:59 smithi070 ceph-mon[30981]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T05:45:59.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:45:59 smithi116 ceph-mon[34332]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T05:46:01.592 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:01 smithi160 ceph-mon[33979]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T05:46:01.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:01 smithi070 ceph-mon[30981]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T05:46:01.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:01 smithi116 ceph-mon[34332]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T05:46:02.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:02 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T05:46:02.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:02 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:02.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:02 smithi160 ceph-mon[33979]: Deploying daemon osd.11 on smithi160 2024-09-21T05:46:02.707 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:02 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T05:46:02.707 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:02 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:02.707 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:02 smithi116 ceph-mon[34332]: Deploying daemon osd.11 on smithi160 2024-09-21T05:46:02.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:02 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T05:46:02.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:02 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:02.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:02 smithi070 ceph-mon[30981]: Deploying daemon osd.11 on smithi160 2024-09-21T05:46:03.536 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:03 smithi160 ceph-mon[33979]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T05:46:03.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:03 smithi116 ceph-mon[34332]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T05:46:03.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:03 smithi070 ceph-mon[30981]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T05:46:05.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:05 smithi160 ceph-mon[33979]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:46:05.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:05 smithi070 ceph-mon[30981]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:46:05.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:05 smithi116 ceph-mon[34332]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:46:07.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:07 smithi160 ceph-mon[33979]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:46:07.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:07 smithi070 ceph-mon[30981]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:46:07.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:07 smithi116 ceph-mon[34332]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:46:08.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:08 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:08.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:08 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:08.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:08 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:08.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:08 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:08.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:08 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:08.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:08 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:08.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:08 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:08.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:08 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:08.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:08 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:09.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:09 smithi160 ceph-mon[33979]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:46:09.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:09 smithi070 ceph-mon[30981]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:46:09.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:09 smithi116 ceph-mon[34332]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:46:10.899 INFO:teuthology.orchestra.run.smithi160.stdout:Created osd(s) 11 on host 'smithi160' 2024-09-21T05:46:10.899 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:10.896+0000 7f94e3fff640 1 -- 172.21.15.160:0/1645669736 <== mgr.14150 v2:172.21.15.70:6800/1366013939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f94ec063800 con 0x7f94d80b6510 2024-09-21T05:46:10.901 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:10.899+0000 7f94f15c0640 1 -- 172.21.15.160:0/1645669736 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f94d80b6510 msgr2=0x7f94d80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:10.901 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:10.899+0000 7f94f15c0640 1 --2- 172.21.15.160:0/1645669736 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f94d80b6510 0x7f94d80b8a20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f94d40058c0 tx=0x7f94d400a2d0 comp rx=0 tx=0).stop 2024-09-21T05:46:10.901 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:10.899+0000 7f94f15c0640 1 -- 172.21.15.160:0/1645669736 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94ec102640 msgr2=0x7f94ec06b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:10.901 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:10.899+0000 7f94f15c0640 1 --2- 172.21.15.160:0/1645669736 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94ec102640 0x7f94ec06b6a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f94e400ea80 tx=0x7f94e400ef40 comp rx=0 tx=0).stop 2024-09-21T05:46:10.901 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:10.899+0000 7f94f15c0640 1 -- 172.21.15.160:0/1645669736 shutdown_connections 2024-09-21T05:46:10.901 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:10.899+0000 7f94f15c0640 1 --2- 172.21.15.160:0/1645669736 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f94d80b6510 0x7f94d80b8a20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:10.901 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:10.899+0000 7f94f15c0640 1 --2- 172.21.15.160:0/1645669736 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94ec104070 0x7f94ec1a1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:10.901 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:10.899+0000 7f94f15c0640 1 --2- 172.21.15.160:0/1645669736 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94ec1036d0 0x7f94ec19ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:10.901 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:10.899+0000 7f94f15c0640 1 --2- 172.21.15.160:0/1645669736 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94ec102640 0x7f94ec06b6a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:10.902 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:10.899+0000 7f94f15c0640 1 -- 172.21.15.160:0/1645669736 >> 172.21.15.160:0/1645669736 conn(0x7f94ec0fdfb0 msgr2=0x7f94ec1069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:10.902 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:10.899+0000 7f94f15c0640 1 -- 172.21.15.160:0/1645669736 shutdown_connections 2024-09-21T05:46:10.902 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:10.899+0000 7f94f15c0640 1 -- 172.21.15.160:0/1645669736 wait complete. 2024-09-21T05:46:11.590 DEBUG:teuthology.orchestra.run.smithi160:osd.11> sudo journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.11.service 2024-09-21T05:46:11.593 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-21T05:46:11.593 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T05:46:11.863 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:46:12.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:11 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:12.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:11 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:12.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:11 smithi160 ceph-mon[33979]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:46:12.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:11 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:12.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:11 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:12.242 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:11 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:12.242 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:11 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:12.242 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:11 smithi070 ceph-mon[30981]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:46:12.242 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:11 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:12.242 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:11 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:12.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:11 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:12.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:11 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:12.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:11 smithi116 ceph-mon[34332]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:46:12.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:11 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:12.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:11 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:12.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.449+0000 7f46e33a4640 1 -- 172.21.15.70:0/2313685539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f46dc109510 msgr2=0x7f46dc10b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:12.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.449+0000 7f46e33a4640 1 --2- 172.21.15.70:0/2313685539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f46dc109510 0x7f46dc10b990 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f46cc009900 tx=0x7f46cc02a410 comp rx=0 tx=0).stop 2024-09-21T05:46:12.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.449+0000 7f46e33a4640 1 -- 172.21.15.70:0/2313685539 shutdown_connections 2024-09-21T05:46:12.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.449+0000 7f46e33a4640 1 --2- 172.21.15.70:0/2313685539 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46dc106bb0 0x7f46dc108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:12.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.449+0000 7f46e33a4640 1 --2- 172.21.15.70:0/2313685539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f46dc109510 0x7f46dc10b990 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:12.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.449+0000 7f46e33a4640 1 --2- 172.21.15.70:0/2313685539 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46dc101b10 0x7f46dc101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:12.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.449+0000 7f46e33a4640 1 -- 172.21.15.70:0/2313685539 >> 172.21.15.70:0/2313685539 conn(0x7f46dc0fd740 msgr2=0x7f46dc0ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:12.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.449+0000 7f46e33a4640 1 -- 172.21.15.70:0/2313685539 shutdown_connections 2024-09-21T05:46:12.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.450+0000 7f46e33a4640 1 -- 172.21.15.70:0/2313685539 wait complete. 2024-09-21T05:46:12.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.450+0000 7f46e33a4640 1 Processor -- start 2024-09-21T05:46:12.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.450+0000 7f46e33a4640 1 -- start start 2024-09-21T05:46:12.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.450+0000 7f46e33a4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46dc101b10 0x7f46dc199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:12.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.450+0000 7f46e33a4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f46dc106bb0 0x7f46dc19a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:12.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.450+0000 7f46e33a4640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46dc109510 0x7f46dc19b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:12.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.450+0000 7f46e33a4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f46dc10f370 con 0x7f46dc106bb0 2024-09-21T05:46:12.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.450+0000 7f46e33a4640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f46dc10f1f0 con 0x7f46dc109510 2024-09-21T05:46:12.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.450+0000 7f46e33a4640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f46dc10f4f0 con 0x7f46dc101b10 2024-09-21T05:46:12.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.450+0000 7f46e093f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f46dc106bb0 0x7f46dc19a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:12.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.450+0000 7f46e093f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f46dc106bb0 0x7f46dc19a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54228/0 (socket says 172.21.15.70:54228) 2024-09-21T05:46:12.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.451+0000 7f46e093f640 1 -- 172.21.15.70:0/1284261570 learned_addr learned my addr 172.21.15.70:0/1284261570 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:46:12.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.451+0000 7f46e1140640 1 --2- 172.21.15.70:0/1284261570 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46dc101b10 0x7f46dc199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:12.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.451+0000 7f46e1941640 1 --2- 172.21.15.70:0/1284261570 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46dc109510 0x7f46dc19b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:12.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.451+0000 7f46e093f640 1 -- 172.21.15.70:0/1284261570 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46dc101b10 msgr2=0x7f46dc199f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:12.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.451+0000 7f46e093f640 1 --2- 172.21.15.70:0/1284261570 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46dc101b10 0x7f46dc199f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:12.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.451+0000 7f46e093f640 1 -- 172.21.15.70:0/1284261570 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46dc109510 msgr2=0x7f46dc19b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:12.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.451+0000 7f46e093f640 1 --2- 172.21.15.70:0/1284261570 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46dc109510 0x7f46dc19b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:12.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.451+0000 7f46e093f640 1 -- 172.21.15.70:0/1284261570 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46dc19b970 con 0x7f46dc106bb0 2024-09-21T05:46:12.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.451+0000 7f46e1941640 1 --2- 172.21.15.70:0/1284261570 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46dc109510 0x7f46dc19b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:46:12.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.451+0000 7f46e093f640 1 --2- 172.21.15.70:0/1284261570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f46dc106bb0 0x7f46dc19a5b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f46d000eab0 tx=0x7f46d000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:12.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.451+0000 7f46da7fc640 1 -- 172.21.15.70:0/1284261570 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d000ce40 con 0x7f46dc106bb0 2024-09-21T05:46:12.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.451+0000 7f46e33a4640 1 -- 172.21.15.70:0/1284261570 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46dc19bc60 con 0x7f46dc106bb0 2024-09-21T05:46:12.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.451+0000 7f46da7fc640 1 -- 172.21.15.70:0/1284261570 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f46d0011920 con 0x7f46dc106bb0 2024-09-21T05:46:12.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.451+0000 7f46da7fc640 1 -- 172.21.15.70:0/1284261570 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d00109e0 con 0x7f46dc106bb0 2024-09-21T05:46:12.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.451+0000 7f46e33a4640 1 -- 172.21.15.70:0/1284261570 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46dc1a2360 con 0x7f46dc106bb0 2024-09-21T05:46:12.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.452+0000 7f46e33a4640 1 -- 172.21.15.70:0/1284261570 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46dc0ff260 con 0x7f46dc106bb0 2024-09-21T05:46:12.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.454+0000 7f46da7fc640 1 -- 172.21.15.70:0/1284261570 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f46d0011ad0 con 0x7f46dc106bb0 2024-09-21T05:46:12.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.454+0000 7f46da7fc640 1 --2- 172.21.15.70:0/1284261570 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f46c40b6510 0x7f46c40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:12.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.454+0000 7f46e1140640 1 --2- 172.21.15.70:0/1284261570 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f46c40b6510 0x7f46c40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:12.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.455+0000 7f46da7fc640 1 -- 172.21.15.70:0/1284261570 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6809+0+0 (secure 0 0 0) 0x7f46d00e7340 con 0x7f46dc106bb0 2024-09-21T05:46:12.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.455+0000 7f46e1140640 1 --2- 172.21.15.70:0/1284261570 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f46c40b6510 0x7f46c40b8a20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f46d400bbe0 tx=0x7f46d400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:12.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.459+0000 7f46da7fc640 1 -- 172.21.15.70:0/1284261570 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f46d0016030 con 0x7f46dc106bb0 2024-09-21T05:46:12.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.641+0000 7f46e33a4640 1 -- 172.21.15.70:0/1284261570 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f46dc063fc0 con 0x7f46dc106bb0 2024-09-21T05:46:12.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.641+0000 7f46da7fc640 1 -- 172.21.15.70:0/1284261570 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v66) ==== 74+0+133 (secure 0 0 0) 0x7f46d00a9070 con 0x7f46dc106bb0 2024-09-21T05:46:12.643 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:46:12.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.643+0000 7f46e33a4640 1 -- 172.21.15.70:0/1284261570 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f46c40b6510 msgr2=0x7f46c40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:12.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.643+0000 7f46e33a4640 1 --2- 172.21.15.70:0/1284261570 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f46c40b6510 0x7f46c40b8a20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f46d400bbe0 tx=0x7f46d400b390 comp rx=0 tx=0).stop 2024-09-21T05:46:12.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.643+0000 7f46e33a4640 1 -- 172.21.15.70:0/1284261570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f46dc106bb0 msgr2=0x7f46dc19a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:12.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.643+0000 7f46e33a4640 1 --2- 172.21.15.70:0/1284261570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f46dc106bb0 0x7f46dc19a5b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f46d000eab0 tx=0x7f46d000ef70 comp rx=0 tx=0).stop 2024-09-21T05:46:12.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.643+0000 7f46e33a4640 1 -- 172.21.15.70:0/1284261570 shutdown_connections 2024-09-21T05:46:12.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.643+0000 7f46e33a4640 1 --2- 172.21.15.70:0/1284261570 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f46c40b6510 0x7f46c40b8a20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:12.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.643+0000 7f46e33a4640 1 --2- 172.21.15.70:0/1284261570 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46dc109510 0x7f46dc19b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:12.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.643+0000 7f46e33a4640 1 --2- 172.21.15.70:0/1284261570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f46dc106bb0 0x7f46dc19a5b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:12.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.643+0000 7f46e33a4640 1 --2- 172.21.15.70:0/1284261570 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46dc101b10 0x7f46dc199f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:12.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.643+0000 7f46e33a4640 1 -- 172.21.15.70:0/1284261570 >> 172.21.15.70:0/1284261570 conn(0x7f46dc0fd740 msgr2=0x7f46dc107980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:12.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.643+0000 7f46e33a4640 1 -- 172.21.15.70:0/1284261570 shutdown_connections 2024-09-21T05:46:12.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:12.643+0000 7f46e33a4640 1 -- 172.21.15.70:0/1284261570 wait complete. 2024-09-21T05:46:13.119 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:12 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1284261570' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T05:46:13.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:12 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1284261570' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T05:46:13.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:12 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1284261570' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T05:46:13.434 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":66,"num_osds":12,"num_up_osds":11,"osd_up_since":1726897550,"num_in_osds":12,"osd_in_since":1726897553,"num_remapped_pgs":0} 2024-09-21T05:46:13.698 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:46:13 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:46:13.673+0000 7f3f3f213640 -1 osd.11 0 log_to_monitors true 2024-09-21T05:46:14.129 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:13 smithi160 ceph-mon[33979]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:46:14.129 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:13 smithi160 ceph-mon[33979]: from='osd.11 [v2:172.21.15.160:6824/2632369083,v1:172.21.15.160:6825/2632369083]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T05:46:14.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:13 smithi070 ceph-mon[30981]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:46:14.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:13 smithi070 ceph-mon[30981]: from='osd.11 [v2:172.21.15.160:6824/2632369083,v1:172.21.15.160:6825/2632369083]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T05:46:14.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:13 smithi116 ceph-mon[34332]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:46:14.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:13 smithi116 ceph-mon[34332]: from='osd.11 [v2:172.21.15.160:6824/2632369083,v1:172.21.15.160:6825/2632369083]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T05:46:14.435 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T05:46:14.694 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:46:15.111 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:14 smithi070 ceph-mon[30981]: from='osd.11 [v2:172.21.15.160:6824/2632369083,v1:172.21.15.160:6825/2632369083]' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T05:46:15.111 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:14 smithi070 ceph-mon[30981]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T05:46:15.111 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:14 smithi070 ceph-mon[30981]: from='osd.11 [v2:172.21.15.160:6824/2632369083,v1:172.21.15.160:6825/2632369083]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]} : dispatch 2024-09-21T05:46:15.111 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:14 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:46:15.111 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:14 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:15.111 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:14 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:15.111 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:14 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:46:15.111 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:14 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T05:46:15.111 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:14 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T05:46:15.111 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:14 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T05:46:15.111 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:14 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:15.111 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:14 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:15.112 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:14 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:15.112 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:14 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:15.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:46:14 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:46:14.913+0000 7f3f3b195640 -1 osd.11 0 waiting for initial osdmap 2024-09-21T05:46:15.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:46:14 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:46:14.925+0000 7f3f36f93640 -1 osd.11 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:46:15.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:14 smithi160 ceph-mon[33979]: from='osd.11 [v2:172.21.15.160:6824/2632369083,v1:172.21.15.160:6825/2632369083]' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T05:46:15.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:14 smithi160 ceph-mon[33979]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T05:46:15.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:14 smithi160 ceph-mon[33979]: from='osd.11 [v2:172.21.15.160:6824/2632369083,v1:172.21.15.160:6825/2632369083]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]} : dispatch 2024-09-21T05:46:15.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:14 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:46:15.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:14 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:15.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:14 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:15.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:14 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:46:15.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:14 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T05:46:15.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:14 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T05:46:15.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:14 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T05:46:15.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:14 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:15.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:14 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:15.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:14 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:15.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:14 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:15.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.200+0000 7f0ff49de640 1 -- 172.21.15.70:0/3301918899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ff0103750 msgr2=0x7f0ff0103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:15.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.200+0000 7f0ff49de640 1 --2- 172.21.15.70:0/3301918899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ff0103750 0x7f0ff0103bc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0009900 tx=0x7f0fe002a480 comp rx=0 tx=0).stop 2024-09-21T05:46:15.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.200+0000 7f0ff49de640 1 -- 172.21.15.70:0/3301918899 shutdown_connections 2024-09-21T05:46:15.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.200+0000 7f0ff49de640 1 --2- 172.21.15.70:0/3301918899 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ff0105180 0x7f0ff010bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:15.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.200+0000 7f0ff49de640 1 --2- 172.21.15.70:0/3301918899 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ff01047e0 0x7f0ff0104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:15.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.200+0000 7f0ff49de640 1 --2- 172.21.15.70:0/3301918899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ff0103750 0x7f0ff0103bc0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:15.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.200+0000 7f0ff49de640 1 -- 172.21.15.70:0/3301918899 >> 172.21.15.70:0/3301918899 conn(0x7f0ff00ff0c0 msgr2=0x7f0ff0101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:15.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.200+0000 7f0ff49de640 1 -- 172.21.15.70:0/3301918899 shutdown_connections 2024-09-21T05:46:15.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.200+0000 7f0ff49de640 1 -- 172.21.15.70:0/3301918899 wait complete. 2024-09-21T05:46:15.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.201+0000 7f0ff49de640 1 Processor -- start 2024-09-21T05:46:15.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.201+0000 7f0ff49de640 1 -- start start 2024-09-21T05:46:15.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.202+0000 7f0ff49de640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ff0103750 0x7f0ff019a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:15.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.202+0000 7f0ff49de640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ff01047e0 0x7f0ff019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:15.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.202+0000 7f0ff49de640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ff0105180 0x7f0ff019b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:15.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.202+0000 7f0ff49de640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff010f400 con 0x7f0ff0105180 2024-09-21T05:46:15.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.202+0000 7f0ff49de640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff010f280 con 0x7f0ff01047e0 2024-09-21T05:46:15.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.202+0000 7f0ff49de640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff010f580 con 0x7f0ff0103750 2024-09-21T05:46:15.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.202+0000 7f0feed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ff0105180 0x7f0ff019b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:15.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.202+0000 7f0feed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ff0105180 0x7f0ff019b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54242/0 (socket says 172.21.15.70:54242) 2024-09-21T05:46:15.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.202+0000 7f0feed9d640 1 -- 172.21.15.70:0/3212467612 learned_addr learned my addr 172.21.15.70:0/3212467612 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:46:15.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.202+0000 7f0fee59c640 1 --2- 172.21.15.70:0/3212467612 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ff0103750 0x7f0ff019a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:15.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.202+0000 7f0fedd9b640 1 --2- 172.21.15.70:0/3212467612 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ff01047e0 0x7f0ff019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:15.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.202+0000 7f0feed9d640 1 -- 172.21.15.70:0/3212467612 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ff0103750 msgr2=0x7f0ff019a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:15.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.202+0000 7f0feed9d640 1 --2- 172.21.15.70:0/3212467612 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ff0103750 0x7f0ff019a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:15.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.202+0000 7f0feed9d640 1 -- 172.21.15.70:0/3212467612 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ff01047e0 msgr2=0x7f0ff019a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:15.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.202+0000 7f0feed9d640 1 --2- 172.21.15.70:0/3212467612 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ff01047e0 0x7f0ff019a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:15.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.202+0000 7f0feed9d640 1 -- 172.21.15.70:0/3212467612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff019ba30 con 0x7f0ff0105180 2024-09-21T05:46:15.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.202+0000 7f0fee59c640 1 --2- 172.21.15.70:0/3212467612 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ff0103750 0x7f0ff019a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:46:15.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.202+0000 7f0fedd9b640 1 --2- 172.21.15.70:0/3212467612 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ff01047e0 0x7f0ff019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:46:15.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.202+0000 7f0feed9d640 1 --2- 172.21.15.70:0/3212467612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ff0105180 0x7f0ff019b210 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0fe800eaa0 tx=0x7f0fe800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:15.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.202+0000 7f0fdf7fe640 1 -- 172.21.15.70:0/3212467612 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe800cdb0 con 0x7f0ff0105180 2024-09-21T05:46:15.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.203+0000 7f0fdf7fe640 1 -- 172.21.15.70:0/3212467612 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f0fe8005020 con 0x7f0ff0105180 2024-09-21T05:46:15.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.203+0000 7f0ff49de640 1 -- 172.21.15.70:0/3212467612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ff019bd20 con 0x7f0ff0105180 2024-09-21T05:46:15.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.203+0000 7f0fdf7fe640 1 -- 172.21.15.70:0/3212467612 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe80116d0 con 0x7f0ff0105180 2024-09-21T05:46:15.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.203+0000 7f0ff49de640 1 -- 172.21.15.70:0/3212467612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ff01a2420 con 0x7f0ff0105180 2024-09-21T05:46:15.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.204+0000 7f0ff49de640 1 -- 172.21.15.70:0/3212467612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ff010a930 con 0x7f0ff0105180 2024-09-21T05:46:15.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.205+0000 7f0fdf7fe640 1 -- 172.21.15.70:0/3212467612 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f0fe8005580 con 0x7f0ff0105180 2024-09-21T05:46:15.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.206+0000 7f0fdf7fe640 1 --2- 172.21.15.70:0/3212467612 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0fd80b6510 0x7f0fd80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:15.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.206+0000 7f0fee59c640 1 --2- 172.21.15.70:0/3212467612 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0fd80b6510 0x7f0fd80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:15.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.206+0000 7f0fdf7fe640 1 -- 172.21.15.70:0/3212467612 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6847+0+0 (secure 0 0 0) 0x7f0fe80e6fe0 con 0x7f0ff0105180 2024-09-21T05:46:15.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.206+0000 7f0fee59c640 1 --2- 172.21.15.70:0/3212467612 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0fd80b6510 0x7f0fd80b8a20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0005f70 tx=0x7f0fe0005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:15.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.210+0000 7f0fdf7fe640 1 -- 172.21.15.70:0/3212467612 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0fe8016030 con 0x7f0ff0105180 2024-09-21T05:46:15.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:14 smithi116 ceph-mon[34332]: from='osd.11 [v2:172.21.15.160:6824/2632369083,v1:172.21.15.160:6825/2632369083]' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T05:46:15.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:14 smithi116 ceph-mon[34332]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T05:46:15.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:14 smithi116 ceph-mon[34332]: from='osd.11 [v2:172.21.15.160:6824/2632369083,v1:172.21.15.160:6825/2632369083]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]} : dispatch 2024-09-21T05:46:15.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:14 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:46:15.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:14 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:15.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:14 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:15.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:14 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:46:15.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:14 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T05:46:15.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:14 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T05:46:15.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:14 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T05:46:15.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:14 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:15.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:14 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:15.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:14 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:15.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:14 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:15.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.388+0000 7f0ff49de640 1 -- 172.21.15.70:0/3212467612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f0ff0063fc0 con 0x7f0ff0105180 2024-09-21T05:46:15.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.389+0000 7f0fdf7fe640 1 -- 172.21.15.70:0/3212467612 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7f0fe80ade30 con 0x7f0ff0105180 2024-09-21T05:46:15.391 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:46:15.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.392+0000 7f0ff49de640 1 -- 172.21.15.70:0/3212467612 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0fd80b6510 msgr2=0x7f0fd80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:15.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.392+0000 7f0ff49de640 1 --2- 172.21.15.70:0/3212467612 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0fd80b6510 0x7f0fd80b8a20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0005f70 tx=0x7f0fe0005d50 comp rx=0 tx=0).stop 2024-09-21T05:46:15.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.392+0000 7f0ff49de640 1 -- 172.21.15.70:0/3212467612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ff0105180 msgr2=0x7f0ff019b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:15.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.392+0000 7f0ff49de640 1 --2- 172.21.15.70:0/3212467612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ff0105180 0x7f0ff019b210 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0fe800eaa0 tx=0x7f0fe800ef60 comp rx=0 tx=0).stop 2024-09-21T05:46:15.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.392+0000 7f0ff49de640 1 -- 172.21.15.70:0/3212467612 shutdown_connections 2024-09-21T05:46:15.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.392+0000 7f0ff49de640 1 --2- 172.21.15.70:0/3212467612 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0fd80b6510 0x7f0fd80b8a20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:15.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.392+0000 7f0ff49de640 1 --2- 172.21.15.70:0/3212467612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ff0105180 0x7f0ff019b210 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:15.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.392+0000 7f0ff49de640 1 --2- 172.21.15.70:0/3212467612 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ff01047e0 0x7f0ff019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:15.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.392+0000 7f0ff49de640 1 --2- 172.21.15.70:0/3212467612 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ff0103750 0x7f0ff019a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:15.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.392+0000 7f0ff49de640 1 -- 172.21.15.70:0/3212467612 >> 172.21.15.70:0/3212467612 conn(0x7f0ff00ff0c0 msgr2=0x7f0ff0107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:15.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.392+0000 7f0ff49de640 1 -- 172.21.15.70:0/3212467612 shutdown_connections 2024-09-21T05:46:15.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:15.392+0000 7f0ff49de640 1 -- 172.21.15.70:0/3212467612 wait complete. 2024-09-21T05:46:16.084 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":68,"num_osds":12,"num_up_osds":11,"osd_up_since":1726897550,"num_in_osds":12,"osd_in_since":1726897553,"num_remapped_pgs":0} 2024-09-21T05:46:16.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:15 smithi070 ceph-mon[30981]: Detected new or changed devices on smithi160 2024-09-21T05:46:16.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:15 smithi070 ceph-mon[30981]: Adjusting osd_memory_target on smithi160 to 4272M 2024-09-21T05:46:16.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:15 smithi070 ceph-mon[30981]: from='osd.11 [v2:172.21.15.160:6824/2632369083,v1:172.21.15.160:6825/2632369083]' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-09-21T05:46:16.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:15 smithi070 ceph-mon[30981]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T05:46:16.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:15 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:46:16.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:15 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:46:16.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:15 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:16.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:15 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:16.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:15 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:16.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:15 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:16.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:15 smithi070 ceph-mon[30981]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:46:16.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:15 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3212467612' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T05:46:16.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:15 smithi116 ceph-mon[34332]: Detected new or changed devices on smithi160 2024-09-21T05:46:16.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:15 smithi116 ceph-mon[34332]: Adjusting osd_memory_target on smithi160 to 4272M 2024-09-21T05:46:16.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:15 smithi116 ceph-mon[34332]: from='osd.11 [v2:172.21.15.160:6824/2632369083,v1:172.21.15.160:6825/2632369083]' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-09-21T05:46:16.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:15 smithi116 ceph-mon[34332]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T05:46:16.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:15 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:46:16.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:15 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:46:16.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:15 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:16.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:15 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:16.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:15 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:16.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:15 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:16.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:15 smithi116 ceph-mon[34332]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:46:16.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:15 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3212467612' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T05:46:16.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:15 smithi160 ceph-mon[33979]: Detected new or changed devices on smithi160 2024-09-21T05:46:16.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:15 smithi160 ceph-mon[33979]: Adjusting osd_memory_target on smithi160 to 4272M 2024-09-21T05:46:16.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:15 smithi160 ceph-mon[33979]: from='osd.11 [v2:172.21.15.160:6824/2632369083,v1:172.21.15.160:6825/2632369083]' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-09-21T05:46:16.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:15 smithi160 ceph-mon[33979]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T05:46:16.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:15 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:46:16.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:15 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:46:16.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:15 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:16.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:15 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:16.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:15 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:16.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:15 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:16.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:15 smithi160 ceph-mon[33979]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:46:16.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:15 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3212467612' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T05:46:17.086 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T05:46:17.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:16 smithi070 ceph-mon[30981]: purged_snaps scrub starts 2024-09-21T05:46:17.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:16 smithi070 ceph-mon[30981]: purged_snaps scrub ok 2024-09-21T05:46:17.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:16 smithi070 ceph-mon[30981]: osd.11 [v2:172.21.15.160:6824/2632369083,v1:172.21.15.160:6825/2632369083] boot 2024-09-21T05:46:17.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:16 smithi070 ceph-mon[30981]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T05:46:17.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:16 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:46:17.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:16 smithi116 ceph-mon[34332]: purged_snaps scrub starts 2024-09-21T05:46:17.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:16 smithi116 ceph-mon[34332]: purged_snaps scrub ok 2024-09-21T05:46:17.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:16 smithi116 ceph-mon[34332]: osd.11 [v2:172.21.15.160:6824/2632369083,v1:172.21.15.160:6825/2632369083] boot 2024-09-21T05:46:17.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:16 smithi116 ceph-mon[34332]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T05:46:17.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:16 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:46:17.341 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:46:17.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:16 smithi160 ceph-mon[33979]: purged_snaps scrub starts 2024-09-21T05:46:17.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:16 smithi160 ceph-mon[33979]: purged_snaps scrub ok 2024-09-21T05:46:17.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:16 smithi160 ceph-mon[33979]: osd.11 [v2:172.21.15.160:6824/2632369083,v1:172.21.15.160:6825/2632369083] boot 2024-09-21T05:46:17.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:16 smithi160 ceph-mon[33979]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T05:46:17.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:16 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:46:17.986 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:17 smithi070 ceph-mon[30981]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T05:46:17.986 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:17 smithi070 ceph-mon[30981]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.073+0000 7f0903467640 1 -- 172.21.15.70:0/1017661235 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08fc104080 msgr2=0x7f08fc10aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.073+0000 7f0903467640 1 --2- 172.21.15.70:0/1017661235 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08fc104080 0x7f08fc10aa20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f08f4009ca0 tx=0x7f08f402a950 comp rx=0 tx=0).stop 2024-09-21T05:46:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.073+0000 7f0903467640 1 -- 172.21.15.70:0/1017661235 shutdown_connections 2024-09-21T05:46:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.073+0000 7f0903467640 1 --2- 172.21.15.70:0/1017661235 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08fc1036e0 0x7f08fc103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.073+0000 7f0903467640 1 --2- 172.21.15.70:0/1017661235 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08fc104080 0x7f08fc10aa20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.073+0000 7f0903467640 1 --2- 172.21.15.70:0/1017661235 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08fc102650 0x7f08fc102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.073+0000 7f0903467640 1 -- 172.21.15.70:0/1017661235 >> 172.21.15.70:0/1017661235 conn(0x7f08fc0fdfe0 msgr2=0x7f08fc100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.073+0000 7f0903467640 1 -- 172.21.15.70:0/1017661235 shutdown_connections 2024-09-21T05:46:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.073+0000 7f0903467640 1 -- 172.21.15.70:0/1017661235 wait complete. 2024-09-21T05:46:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.074+0000 7f0903467640 1 Processor -- start 2024-09-21T05:46:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.074+0000 7f0903467640 1 -- start start 2024-09-21T05:46:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.074+0000 7f0903467640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08fc102650 0x7f08fc199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.074+0000 7f0903467640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08fc1036e0 0x7f08fc19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.074+0000 7f0903467640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08fc104080 0x7f08fc19b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.074+0000 7f0903467640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f08fc10e280 con 0x7f08fc1036e0 2024-09-21T05:46:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.074+0000 7f0903467640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f08fc10e100 con 0x7f08fc102650 2024-09-21T05:46:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.074+0000 7f0903467640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f08fc10e400 con 0x7f08fc104080 2024-09-21T05:46:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.074+0000 7f0900a02640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08fc1036e0 0x7f08fc19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.074+0000 7f0900a02640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08fc1036e0 0x7f08fc19a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54254/0 (socket says 172.21.15.70:54254) 2024-09-21T05:46:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.074+0000 7f0900a02640 1 -- 172.21.15.70:0/3965027442 learned_addr learned my addr 172.21.15.70:0/3965027442 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:46:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.075+0000 7f0901203640 1 --2- 172.21.15.70:0/3965027442 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08fc102650 0x7f08fc199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.075+0000 7f0900a02640 1 -- 172.21.15.70:0/3965027442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08fc104080 msgr2=0x7f08fc19b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.075+0000 7f0901a04640 1 --2- 172.21.15.70:0/3965027442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08fc104080 0x7f08fc19b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.075+0000 7f0900a02640 1 --2- 172.21.15.70:0/3965027442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08fc104080 0x7f08fc19b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.075+0000 7f0900a02640 1 -- 172.21.15.70:0/3965027442 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08fc102650 msgr2=0x7f08fc199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.075+0000 7f0900a02640 1 --2- 172.21.15.70:0/3965027442 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08fc102650 0x7f08fc199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.075+0000 7f0900a02640 1 -- 172.21.15.70:0/3965027442 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08fc19b9e0 con 0x7f08fc1036e0 2024-09-21T05:46:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.075+0000 7f0901203640 1 --2- 172.21.15.70:0/3965027442 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08fc102650 0x7f08fc199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:46:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.075+0000 7f0900a02640 1 --2- 172.21.15.70:0/3965027442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08fc1036e0 0x7f08fc19a620 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00d950 tx=0x7f08ec00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:18.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.075+0000 7f08f27fc640 1 -- 172.21.15.70:0/3965027442 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ec017030 con 0x7f08fc1036e0 2024-09-21T05:46:18.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.075+0000 7f0903467640 1 -- 172.21.15.70:0/3965027442 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08fc19bcd0 con 0x7f08fc1036e0 2024-09-21T05:46:18.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.075+0000 7f08f27fc640 1 -- 172.21.15.70:0/3965027442 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f08ec004020 con 0x7f08fc1036e0 2024-09-21T05:46:18.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.075+0000 7f08f27fc640 1 -- 172.21.15.70:0/3965027442 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ec0047a0 con 0x7f08fc1036e0 2024-09-21T05:46:18.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.075+0000 7f0903467640 1 -- 172.21.15.70:0/3965027442 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08fc1a23d0 con 0x7f08fc1036e0 2024-09-21T05:46:18.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.076+0000 7f0903467640 1 -- 172.21.15.70:0/3965027442 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08fc1a2600 con 0x7f08fc1036e0 2024-09-21T05:46:18.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.078+0000 7f08f27fc640 1 -- 172.21.15.70:0/3965027442 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f08ec0041d0 con 0x7f08fc1036e0 2024-09-21T05:46:18.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.078+0000 7f08f27fc640 1 --2- 172.21.15.70:0/3965027442 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f08e80b6510 0x7f08e80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:18.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.078+0000 7f0901203640 1 --2- 172.21.15.70:0/3965027442 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f08e80b6510 0x7f08e80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:18.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.079+0000 7f08f27fc640 1 -- 172.21.15.70:0/3965027442 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f08ec0e6f90 con 0x7f08fc1036e0 2024-09-21T05:46:18.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.079+0000 7f0901203640 1 --2- 172.21.15.70:0/3965027442 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f08e80b6510 0x7f08e80b8a20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f08f8009b40 tx=0x7f08f8005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:18.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.082+0000 7f08f27fc640 1 -- 172.21.15.70:0/3965027442 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f08ec0adcc0 con 0x7f08fc1036e0 2024-09-21T05:46:18.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.260+0000 7f0903467640 1 -- 172.21.15.70:0/3965027442 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f08fc1a2c30 con 0x7f08fc1036e0 2024-09-21T05:46:18.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.260+0000 7f08f27fc640 1 -- 172.21.15.70:0/3965027442 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7f08ec0b20a0 con 0x7f08fc1036e0 2024-09-21T05:46:18.263 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:46:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.262+0000 7f0903467640 1 -- 172.21.15.70:0/3965027442 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f08e80b6510 msgr2=0x7f08e80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.262+0000 7f0903467640 1 --2- 172.21.15.70:0/3965027442 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f08e80b6510 0x7f08e80b8a20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f08f8009b40 tx=0x7f08f8005e50 comp rx=0 tx=0).stop 2024-09-21T05:46:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.262+0000 7f0903467640 1 -- 172.21.15.70:0/3965027442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08fc1036e0 msgr2=0x7f08fc19a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.262+0000 7f0903467640 1 --2- 172.21.15.70:0/3965027442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08fc1036e0 0x7f08fc19a620 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00d950 tx=0x7f08ec00de10 comp rx=0 tx=0).stop 2024-09-21T05:46:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.262+0000 7f0903467640 1 -- 172.21.15.70:0/3965027442 shutdown_connections 2024-09-21T05:46:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.262+0000 7f0903467640 1 --2- 172.21.15.70:0/3965027442 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f08e80b6510 0x7f08e80b8a20 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.262+0000 7f0903467640 1 --2- 172.21.15.70:0/3965027442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08fc104080 0x7f08fc19b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.262+0000 7f0903467640 1 --2- 172.21.15.70:0/3965027442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08fc1036e0 0x7f08fc19a620 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.262+0000 7f0903467640 1 --2- 172.21.15.70:0/3965027442 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08fc102650 0x7f08fc199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.263+0000 7f0903467640 1 -- 172.21.15.70:0/3965027442 >> 172.21.15.70:0/3965027442 conn(0x7f08fc0fdfe0 msgr2=0x7f08fc0ff890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:18.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.263+0000 7f0903467640 1 -- 172.21.15.70:0/3965027442 shutdown_connections 2024-09-21T05:46:18.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:18.263+0000 7f0903467640 1 -- 172.21.15.70:0/3965027442 wait complete. 2024-09-21T05:46:18.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:17 smithi116 ceph-mon[34332]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T05:46:18.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:17 smithi116 ceph-mon[34332]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:18.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:17 smithi160 ceph-mon[33979]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T05:46:18.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:17 smithi160 ceph-mon[33979]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:18.953 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":70,"num_osds":12,"num_up_osds":12,"osd_up_since":1726897575,"num_in_osds":12,"osd_in_since":1726897553,"num_remapped_pgs":0} 2024-09-21T05:46:18.953 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:46:18.977 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:18 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3965027442' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T05:46:19.197 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:46:19.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:18 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3965027442' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T05:46:19.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:18 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3965027442' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T05:46:19.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.672+0000 7f6974f88640 1 -- 172.21.15.70:0/3333030248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f69701094a0 msgr2=0x7f69701098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:19.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.672+0000 7f6974f88640 1 --2- 172.21.15.70:0/3333030248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f69701094a0 0x7f69701098b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6958009900 tx=0x7f695802a410 comp rx=0 tx=0).stop 2024-09-21T05:46:19.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.672+0000 7f6974f88640 1 -- 172.21.15.70:0/3333030248 shutdown_connections 2024-09-21T05:46:19.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.672+0000 7f6974f88640 1 --2- 172.21.15.70:0/3333030248 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6970109df0 0x7f6970110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:19.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.672+0000 7f6974f88640 1 --2- 172.21.15.70:0/3333030248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f69701094a0 0x7f69701098b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:19.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.672+0000 7f6974f88640 1 --2- 172.21.15.70:0/3333030248 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6970103b60 0x7f6970103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:19.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.672+0000 7f6974f88640 1 -- 172.21.15.70:0/3333030248 >> 172.21.15.70:0/3333030248 conn(0x7f697007b850 msgr2=0x7f697007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:19.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.672+0000 7f6974f88640 1 -- 172.21.15.70:0/3333030248 shutdown_connections 2024-09-21T05:46:19.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.672+0000 7f6974f88640 1 -- 172.21.15.70:0/3333030248 wait complete. 2024-09-21T05:46:19.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.673+0000 7f6974f88640 1 Processor -- start 2024-09-21T05:46:19.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.673+0000 7f6974f88640 1 -- start start 2024-09-21T05:46:19.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.674+0000 7f6974f88640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6970103b60 0x7f697019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:19.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.674+0000 7f6974f88640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f69701094a0 0x7f697019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:19.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.674+0000 7f6974f88640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6970109df0 0x7f697019fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:19.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.674+0000 7f6974f88640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6970113b40 con 0x7f69701094a0 2024-09-21T05:46:19.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.674+0000 7f6974f88640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f69701139c0 con 0x7f6970109df0 2024-09-21T05:46:19.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.674+0000 7f6974f88640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6970113cc0 con 0x7f6970103b60 2024-09-21T05:46:19.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.674+0000 7f696dd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f69701094a0 0x7f697019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:19.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.674+0000 7f696dd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f69701094a0 0x7f697019abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54272/0 (socket says 172.21.15.70:54272) 2024-09-21T05:46:19.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.674+0000 7f696dd9b640 1 -- 172.21.15.70:0/1819685292 learned_addr learned my addr 172.21.15.70:0/1819685292 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:46:19.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.674+0000 7f696e59c640 1 --2- 172.21.15.70:0/1819685292 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6970103b60 0x7f697019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:19.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.674+0000 7f696dd9b640 1 -- 172.21.15.70:0/1819685292 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6970103b60 msgr2=0x7f697019a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:19.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.674+0000 7f696dd9b640 1 --2- 172.21.15.70:0/1819685292 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6970103b60 0x7f697019a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:19.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.674+0000 7f696ed9d640 1 --2- 172.21.15.70:0/1819685292 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6970109df0 0x7f697019fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:19.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.674+0000 7f696dd9b640 1 -- 172.21.15.70:0/1819685292 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6970109df0 msgr2=0x7f697019fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:19.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.674+0000 7f696dd9b640 1 --2- 172.21.15.70:0/1819685292 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6970109df0 0x7f697019fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:19.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.674+0000 7f696dd9b640 1 -- 172.21.15.70:0/1819685292 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69701a05a0 con 0x7f69701094a0 2024-09-21T05:46:19.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.674+0000 7f696e59c640 1 --2- 172.21.15.70:0/1819685292 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6970103b60 0x7f697019a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:46:19.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.674+0000 7f696ed9d640 1 --2- 172.21.15.70:0/1819685292 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6970109df0 0x7f697019fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:46:19.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.674+0000 7f696dd9b640 1 --2- 172.21.15.70:0/1819685292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f69701094a0 0x7f697019abd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f695802a930 tx=0x7f6958004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:19.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.675+0000 7f69677fe640 1 -- 172.21.15.70:0/1819685292 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695803f030 con 0x7f69701094a0 2024-09-21T05:46:19.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.675+0000 7f69677fe640 1 -- 172.21.15.70:0/1819685292 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f69580044d0 con 0x7f69701094a0 2024-09-21T05:46:19.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.675+0000 7f69677fe640 1 -- 172.21.15.70:0/1819685292 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6958035070 con 0x7f69701094a0 2024-09-21T05:46:19.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.675+0000 7f6974f88640 1 -- 172.21.15.70:0/1819685292 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69701a0830 con 0x7f69701094a0 2024-09-21T05:46:19.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.675+0000 7f6974f88640 1 -- 172.21.15.70:0/1819685292 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69701a6ff0 con 0x7f69701094a0 2024-09-21T05:46:19.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.676+0000 7f6974f88640 1 -- 172.21.15.70:0/1819685292 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6970103ff0 con 0x7f69701094a0 2024-09-21T05:46:19.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.677+0000 7f69677fe640 1 -- 172.21.15.70:0/1819685292 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f6958003ab0 con 0x7f69701094a0 2024-09-21T05:46:19.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.678+0000 7f69677fe640 1 --2- 172.21.15.70:0/1819685292 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f695c0b6510 0x7f695c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:19.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.678+0000 7f696e59c640 1 --2- 172.21.15.70:0/1819685292 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f695c0b6510 0x7f695c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:19.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.678+0000 7f69677fe640 1 -- 172.21.15.70:0/1819685292 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f6958107bb0 con 0x7f69701094a0 2024-09-21T05:46:19.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.678+0000 7f696e59c640 1 --2- 172.21.15.70:0/1819685292 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f695c0b6510 0x7f695c0b8a20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6968009930 tx=0x7f6968008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:19.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.681+0000 7f69677fe640 1 -- 172.21.15.70:0/1819685292 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f69580ce8e0 con 0x7f69701094a0 2024-09-21T05:46:19.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.860+0000 7f6974f88640 1 -- 172.21.15.70:0/1819685292 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f697019b760 con 0x7f69701094a0 2024-09-21T05:46:19.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.861+0000 7f69677fe640 1 -- 172.21.15.70:0/1819685292 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+18478 (secure 0 0 0) 0x7f697019b760 con 0x7f69701094a0 2024-09-21T05:46:19.864 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:46:19.864 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":70,"fsid":"96c6636e-77db-11ef-baf5-efdc52797490","created":"2024-09-21T05:38:42.297307+0000","modified":"2024-09-21T05:46:16.944638+0000","last_up_change":"2024-09-21T05:46:15.910344+0000","last_in_change":"2024-09-21T05:45:53.382766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:42:25.611590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00be8b82-7cb1-443f-ad18-02916f734df7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6803","nonce":1667051447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6805","nonce":1667051447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6809","nonce":1667051447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6807","nonce":1667051447}]},"public_addr":"172.21.15.70:6803/1667051447","cluster_addr":"172.21.15.70:6805/1667051447","heartbeat_back_addr":"172.21.15.70:6809/1667051447","heartbeat_front_addr":"172.21.15.70:6807/1667051447","state":["exists","up"]},{"osd":1,"uuid":"28ca8c5c-5e81-4e64-ac0e-3c8c3c2d3930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6801","nonce":1037621846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6803","nonce":1037621846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6807","nonce":1037621846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6805","nonce":1037621846}]},"public_addr":"172.21.15.116:6801/1037621846","cluster_addr":"172.21.15.116:6803/1037621846","heartbeat_back_addr":"172.21.15.116:6807/1037621846","heartbeat_front_addr":"172.21.15.116:6805/1037621846","state":["exists","up"]},{"osd":2,"uuid":"e9b42bf2-a38b-4cf9-8774-4950de12d0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6801","nonce":69260815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6803","nonce":69260815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6807","nonce":69260815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6805","nonce":69260815}]},"public_addr":"172.21.15.160:6801/69260815","cluster_addr":"172.21.15.160:6803/69260815","heartbeat_back_addr":"172.21.15.160:6807/69260815","heartbeat_front_addr":"172.21.15.160:6805/69260815","state":["exists","up"]},{"osd":3,"uuid":"25d8e9a8-3c14-43d6-9bb1-b44cd377133f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6811","nonce":3849416072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6813","nonce":3849416072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6817","nonce":3849416072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6815","nonce":3849416072}]},"public_addr":"172.21.15.70:6811/3849416072","cluster_addr":"172.21.15.70:6813/3849416072","heartbeat_back_addr":"172.21.15.70:6817/3849416072","heartbeat_front_addr":"172.21.15.70:6815/3849416072","state":["exists","up"]},{"osd":4,"uuid":"bdb84cbd-d718-4f69-90d0-2e732e580df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6809","nonce":3444857438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6811","nonce":3444857438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6815","nonce":3444857438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6813","nonce":3444857438}]},"public_addr":"172.21.15.116:6809/3444857438","cluster_addr":"172.21.15.116:6811/3444857438","heartbeat_back_addr":"172.21.15.116:6815/3444857438","heartbeat_front_addr":"172.21.15.116:6813/3444857438","state":["exists","up"]},{"osd":5,"uuid":"a490eeba-549f-4caa-8cd5-4168a23dafa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6809","nonce":3063220427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6811","nonce":3063220427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6815","nonce":3063220427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6813","nonce":3063220427}]},"public_addr":"172.21.15.160:6809/3063220427","cluster_addr":"172.21.15.160:6811/3063220427","heartbeat_back_addr":"172.21.15.160:6815/3063220427","heartbeat_front_addr":"172.21.15.160:6813/3063220427","state":["exists","up"]},{"osd":6,"uuid":"1bf22f48-c02f-4f09-b0fe-2597a55fd795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6819","nonce":3650315688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6821","nonce":3650315688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6825","nonce":3650315688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6823","nonce":3650315688}]},"public_addr":"172.21.15.70:6819/3650315688","cluster_addr":"172.21.15.70:6821/3650315688","heartbeat_back_addr":"172.21.15.70:6825/3650315688","heartbeat_front_addr":"172.21.15.70:6823/3650315688","state":["exists","up"]},{"osd":7,"uuid":"40d59744-4860-4a92-aa21-3f33e575e5b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6817","nonce":2034132009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6819","nonce":2034132009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6823","nonce":2034132009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6821","nonce":2034132009}]},"public_addr":"172.21.15.116:6817/2034132009","cluster_addr":"172.21.15.116:6819/2034132009","heartbeat_back_addr":"172.21.15.116:6823/2034132009","heartbeat_front_addr":"172.21.15.116:6821/2034132009","state":["exists","up"]},{"osd":8,"uuid":"65dc02e7-0dcd-4fa7-955a-4d5c00fbe4cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6817","nonce":3381625184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6819","nonce":3381625184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6823","nonce":3381625184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6821","nonce":3381625184}]},"public_addr":"172.21.15.160:6817/3381625184","cluster_addr":"172.21.15.160:6819/3381625184","heartbeat_back_addr":"172.21.15.160:6823/3381625184","heartbeat_front_addr":"172.21.15.160:6821/3381625184","state":["exists","up"]},{"osd":9,"uuid":"d8438a9c-012f-4082-be3f-9653cdfaac78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6827","nonce":3555256209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6829","nonce":3555256209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6833","nonce":3555256209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6831","nonce":3555256209}]},"public_addr":"172.21.15.70:6827/3555256209","cluster_addr":"172.21.15.70:6829/3555256209","heartbeat_back_addr":"172.21.15.70:6833/3555256209","heartbeat_front_addr":"172.21.15.70:6831/3555256209","state":["exists","up"]},{"osd":10,"uuid":"871619b0-181e-4020-9511-2cec296bfe70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6825","nonce":541280433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6827","nonce":541280433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6831","nonce":541280433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6829","nonce":541280433}]},"public_addr":"172.21.15.116:6825/541280433","cluster_addr":"172.21.15.116:6827/541280433","heartbeat_back_addr":"172.21.15.116:6831/541280433","heartbeat_front_addr":"172.21.15.116:6829/541280433","state":["exists","up"]},{"osd":11,"uuid":"302da945-7929-4b0c-a20b-099175752c41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6825","nonce":2632369083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6827","nonce":2632369083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6831","nonce":2632369083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6829","nonce":2632369083}]},"public_addr":"172.21.15.160:6825/2632369083","cluster_addr":"172.21.15.160:6827/2632369083","heartbeat_back_addr":"172.21.15.160:6831/2632369083","heartbeat_front_addr":"172.21.15.160:6829/2632369083","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:41:34.446744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:41:59.336955+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:42:23.958219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:42:49.396007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:43:15.325344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:43:41.923141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:07.873970+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:33.897951+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:58.397680+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:24.568406+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:49.504565+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:14.698577+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6800/605055695":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/897886925":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/1968357524":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/693721445":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/2810307308":"2024-09-22T05:39:12.492271+0000","172.21.15.70:6801/605055695":"2024-09-22T05:39:37.296630+0000","172.21.15.70:6801/1668927582":"2024-09-22T05:39:12.492271+0000","172.21.15.70:6800/1668927582":"2024-09-22T05:39:12.492271+0000","172.21.15.70:0/1979536420":"2024-09-22T05:39:12.492271+0000","172.21.15.70:0/2674019604":"2024-09-22T05:39:12.492271+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:46:19.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.864+0000 7f6974f88640 1 -- 172.21.15.70:0/1819685292 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f695c0b6510 msgr2=0x7f695c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:19.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.864+0000 7f6974f88640 1 --2- 172.21.15.70:0/1819685292 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f695c0b6510 0x7f695c0b8a20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6968009930 tx=0x7f6968008040 comp rx=0 tx=0).stop 2024-09-21T05:46:19.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.864+0000 7f6974f88640 1 -- 172.21.15.70:0/1819685292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f69701094a0 msgr2=0x7f697019abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:19.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.864+0000 7f6974f88640 1 --2- 172.21.15.70:0/1819685292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f69701094a0 0x7f697019abd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f695802a930 tx=0x7f6958004270 comp rx=0 tx=0).stop 2024-09-21T05:46:19.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.864+0000 7f6974f88640 1 -- 172.21.15.70:0/1819685292 shutdown_connections 2024-09-21T05:46:19.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.864+0000 7f6974f88640 1 --2- 172.21.15.70:0/1819685292 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f695c0b6510 0x7f695c0b8a20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:19.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.864+0000 7f6974f88640 1 --2- 172.21.15.70:0/1819685292 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6970109df0 0x7f697019fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:19.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.864+0000 7f6974f88640 1 --2- 172.21.15.70:0/1819685292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f69701094a0 0x7f697019abd0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:19.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.864+0000 7f6974f88640 1 --2- 172.21.15.70:0/1819685292 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6970103b60 0x7f697019a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:19.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.864+0000 7f6974f88640 1 -- 172.21.15.70:0/1819685292 >> 172.21.15.70:0/1819685292 conn(0x7f697007b850 msgr2=0x7f6970107640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:19.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.864+0000 7f6974f88640 1 -- 172.21.15.70:0/1819685292 shutdown_connections 2024-09-21T05:46:19.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:19.864+0000 7f6974f88640 1 -- 172.21.15.70:0/1819685292 wait complete. 2024-09-21T05:46:20.164 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:19 smithi070 ceph-mon[30981]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:20.164 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:19 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1819685292' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:46:20.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:19 smithi116 ceph-mon[34332]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:20.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:19 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1819685292' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:46:20.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:19 smithi160 ceph-mon[33979]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:20.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:19 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1819685292' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:46:20.628 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T05:42:25.611590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T05:46:20.628 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T05:46:20.909 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:46:21.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.374+0000 7f1c75755640 1 -- 172.21.15.70:0/1385396256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c70102a60 msgr2=0x7f1c70102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:21.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.374+0000 7f1c75755640 1 --2- 172.21.15.70:0/1385396256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c70102a60 0x7f1c70102e70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1c60009ca0 tx=0x7f1c6002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:46:21.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.374+0000 7f1c75755640 1 -- 172.21.15.70:0/1385396256 shutdown_connections 2024-09-21T05:46:21.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.374+0000 7f1c75755640 1 --2- 172.21.15.70:0/1385396256 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c701083a0 0x7f1c701087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:21.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.374+0000 7f1c75755640 1 --2- 172.21.15.70:0/1385396256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c70108cf0 0x7f1c7010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:21.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.374+0000 7f1c75755640 1 --2- 172.21.15.70:0/1385396256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c70102a60 0x7f1c70102e70 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:21.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.374+0000 7f1c75755640 1 -- 172.21.15.70:0/1385396256 >> 172.21.15.70:0/1385396256 conn(0x7f1c70079730 msgr2=0x7f1c70079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:21.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.374+0000 7f1c75755640 1 -- 172.21.15.70:0/1385396256 shutdown_connections 2024-09-21T05:46:21.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.374+0000 7f1c75755640 1 -- 172.21.15.70:0/1385396256 wait complete. 2024-09-21T05:46:21.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.374+0000 7f1c75755640 1 Processor -- start 2024-09-21T05:46:21.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.375+0000 7f1c75755640 1 -- start start 2024-09-21T05:46:21.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.375+0000 7f1c75755640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c70102a60 0x7f1c7019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:21.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.375+0000 7f1c75755640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c701083a0 0x7f1c7019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:21.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.375+0000 7f1c75755640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c70108cf0 0x7f1c7019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:21.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.375+0000 7f1c75755640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1c70113a50 con 0x7f1c70108cf0 2024-09-21T05:46:21.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.375+0000 7f1c75755640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1c701138d0 con 0x7f1c70102a60 2024-09-21T05:46:21.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.375+0000 7f1c75755640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1c70113bd0 con 0x7f1c701083a0 2024-09-21T05:46:21.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.375+0000 7f1c6f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c70108cf0 0x7f1c7019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:21.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.375+0000 7f1c6e7fc640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c701083a0 0x7f1c7019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:21.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.375+0000 7f1c6f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c70108cf0 0x7f1c7019fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60598/0 (socket says 172.21.15.70:60598) 2024-09-21T05:46:21.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.375+0000 7f1c6e7fc640 1 --2- 172.21.15.70:0/3970784892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c701083a0 0x7f1c7019aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.70:48824/0 (socket says 172.21.15.70:48824) 2024-09-21T05:46:21.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.375+0000 7f1c6f7fe640 1 -- 172.21.15.70:0/3970784892 learned_addr learned my addr 172.21.15.70:0/3970784892 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:46:21.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.375+0000 7f1c6effd640 1 --2- 172.21.15.70:0/3970784892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c70102a60 0x7f1c7019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:21.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.376+0000 7f1c6f7fe640 1 -- 172.21.15.70:0/3970784892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c701083a0 msgr2=0x7f1c7019aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:21.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.376+0000 7f1c6f7fe640 1 --2- 172.21.15.70:0/3970784892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c701083a0 0x7f1c7019aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:21.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.376+0000 7f1c6f7fe640 1 -- 172.21.15.70:0/3970784892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c70102a60 msgr2=0x7f1c7019a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:21.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.376+0000 7f1c6f7fe640 1 --2- 172.21.15.70:0/3970784892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c70102a60 0x7f1c7019a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:21.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.376+0000 7f1c6f7fe640 1 -- 172.21.15.70:0/3970784892 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c701a0410 con 0x7f1c70108cf0 2024-09-21T05:46:21.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.376+0000 7f1c6f7fe640 1 --2- 172.21.15.70:0/3970784892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c70108cf0 0x7f1c7019fce0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1c6800c970 tx=0x7f1c6800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:21.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.376+0000 7f1c67fff640 1 -- 172.21.15.70:0/3970784892 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c68007bb0 con 0x7f1c70108cf0 2024-09-21T05:46:21.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.376+0000 7f1c67fff640 1 -- 172.21.15.70:0/3970784892 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f1c68007d50 con 0x7f1c70108cf0 2024-09-21T05:46:21.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.376+0000 7f1c75755640 1 -- 172.21.15.70:0/3970784892 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c701a0700 con 0x7f1c70108cf0 2024-09-21T05:46:21.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.376+0000 7f1c67fff640 1 -- 172.21.15.70:0/3970784892 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c68004e10 con 0x7f1c70108cf0 2024-09-21T05:46:21.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.376+0000 7f1c75755640 1 -- 172.21.15.70:0/3970784892 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c701a6e60 con 0x7f1c70108cf0 2024-09-21T05:46:21.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.377+0000 7f1c75755640 1 -- 172.21.15.70:0/3970784892 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c70102e70 con 0x7f1c70108cf0 2024-09-21T05:46:21.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.378+0000 7f1c67fff640 1 -- 172.21.15.70:0/3970784892 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f1c68005020 con 0x7f1c70108cf0 2024-09-21T05:46:21.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.379+0000 7f1c67fff640 1 --2- 172.21.15.70:0/3970784892 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1c5c0b6590 0x7f1c5c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:21.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.379+0000 7f1c6effd640 1 --2- 172.21.15.70:0/3970784892 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1c5c0b6590 0x7f1c5c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:21.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.379+0000 7f1c67fff640 1 -- 172.21.15.70:0/3970784892 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f1c680e6a70 con 0x7f1c70108cf0 2024-09-21T05:46:21.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.380+0000 7f1c6effd640 1 --2- 172.21.15.70:0/3970784892 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1c5c0b6590 0x7f1c5c0b8aa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1c60005e30 tx=0x7f1c60031000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:21.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.384+0000 7f1c67fff640 1 -- 172.21.15.70:0/3970784892 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1c68014030 con 0x7f1c70108cf0 2024-09-21T05:46:21.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.563+0000 7f1c75755640 1 -- 172.21.15.70:0/3970784892 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1c7002e640 con 0x7f1c70108cf0 2024-09-21T05:46:21.565 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:21 smithi070 ceph-mon[30981]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:21.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.563+0000 7f1c67fff640 1 -- 172.21.15.70:0/3970784892 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) ==== 93+0+10 (secure 0 0 0) 0x7f1c680b1b80 con 0x7f1c70108cf0 2024-09-21T05:46:21.566 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-09-21T05:46:21.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.566+0000 7f1c75755640 1 -- 172.21.15.70:0/3970784892 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1c5c0b6590 msgr2=0x7f1c5c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:21.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.566+0000 7f1c75755640 1 --2- 172.21.15.70:0/3970784892 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1c5c0b6590 0x7f1c5c0b8aa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1c60005e30 tx=0x7f1c60031000 comp rx=0 tx=0).stop 2024-09-21T05:46:21.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.566+0000 7f1c75755640 1 -- 172.21.15.70:0/3970784892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c70108cf0 msgr2=0x7f1c7019fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:21.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.566+0000 7f1c75755640 1 --2- 172.21.15.70:0/3970784892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c70108cf0 0x7f1c7019fce0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1c6800c970 tx=0x7f1c6800ce30 comp rx=0 tx=0).stop 2024-09-21T05:46:21.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.566+0000 7f1c75755640 1 -- 172.21.15.70:0/3970784892 shutdown_connections 2024-09-21T05:46:21.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.566+0000 7f1c75755640 1 --2- 172.21.15.70:0/3970784892 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1c5c0b6590 0x7f1c5c0b8aa0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:21.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.566+0000 7f1c75755640 1 --2- 172.21.15.70:0/3970784892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c701083a0 0x7f1c7019aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:21.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.566+0000 7f1c75755640 1 --2- 172.21.15.70:0/3970784892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c70108cf0 0x7f1c7019fce0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:21.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.566+0000 7f1c75755640 1 --2- 172.21.15.70:0/3970784892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c70102a60 0x7f1c7019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:21.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.566+0000 7f1c75755640 1 -- 172.21.15.70:0/3970784892 >> 172.21.15.70:0/3970784892 conn(0x7f1c70079730 msgr2=0x7f1c701014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:21.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.566+0000 7f1c75755640 1 -- 172.21.15.70:0/3970784892 shutdown_connections 2024-09-21T05:46:21.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:21.566+0000 7f1c75755640 1 -- 172.21.15.70:0/3970784892 wait complete. 2024-09-21T05:46:21.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:21 smithi116 ceph-mon[34332]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:21.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:21 smithi160 ceph-mon[33979]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:22.404 INFO:tasks.cephadm:Adding mds.a on smithi070 2024-09-21T05:46:22.404 INFO:tasks.cephadm:Adding mds.d on smithi070 2024-09-21T05:46:22.405 INFO:tasks.cephadm:Adding mds.g on smithi070 2024-09-21T05:46:22.405 INFO:tasks.cephadm:Adding mds.j on smithi070 2024-09-21T05:46:22.405 INFO:tasks.cephadm:Adding mds.b on smithi116 2024-09-21T05:46:22.405 INFO:tasks.cephadm:Adding mds.e on smithi116 2024-09-21T05:46:22.405 INFO:tasks.cephadm:Adding mds.h on smithi116 2024-09-21T05:46:22.405 INFO:tasks.cephadm:Adding mds.k on smithi116 2024-09-21T05:46:22.405 INFO:tasks.cephadm:Adding mds.c on smithi160 2024-09-21T05:46:22.405 INFO:tasks.cephadm:Adding mds.f on smithi160 2024-09-21T05:46:22.405 INFO:tasks.cephadm:Adding mds.i on smithi160 2024-09-21T05:46:22.405 INFO:tasks.cephadm:Adding mds.l on smithi160 2024-09-21T05:46:22.405 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph orch apply mds all '12;smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi116=b;smithi116=e;smithi116=h;smithi116=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l' 2024-09-21T05:46:22.669 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:46:22.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:22 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3970784892' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T05:46:22.789 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:22 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3970784892' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T05:46:22.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:22 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3970784892' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T05:46:23.181 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.173+0000 7f261f3d5640 1 -- 172.21.15.160:0/1783844539 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2618103750 msgr2=0x7f2618103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:23.182 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.173+0000 7f261f3d5640 1 --2- 172.21.15.160:0/1783844539 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2618103750 0x7f2618103bc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2614009900 tx=0x7f261402a480 comp rx=0 tx=0).stop 2024-09-21T05:46:23.182 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.173+0000 7f261f3d5640 1 -- 172.21.15.160:0/1783844539 shutdown_connections 2024-09-21T05:46:23.182 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.173+0000 7f261f3d5640 1 --2- 172.21.15.160:0/1783844539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2618105180 0x7f261810bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:23.182 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.173+0000 7f261f3d5640 1 --2- 172.21.15.160:0/1783844539 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f26181047e0 0x7f2618104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:23.182 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.173+0000 7f261f3d5640 1 --2- 172.21.15.160:0/1783844539 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2618103750 0x7f2618103bc0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:23.182 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.173+0000 7f261f3d5640 1 -- 172.21.15.160:0/1783844539 >> 172.21.15.160:0/1783844539 conn(0x7f26180ff0c0 msgr2=0x7f2618101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:23.182 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.173+0000 7f261f3d5640 1 -- 172.21.15.160:0/1783844539 shutdown_connections 2024-09-21T05:46:23.182 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.173+0000 7f261f3d5640 1 -- 172.21.15.160:0/1783844539 wait complete. 2024-09-21T05:46:23.182 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.173+0000 7f261f3d5640 1 Processor -- start 2024-09-21T05:46:23.182 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.174+0000 7f261f3d5640 1 -- start start 2024-09-21T05:46:23.182 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.174+0000 7f261f3d5640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2618103750 0x7f2618076e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:23.182 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.174+0000 7f261f3d5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26181047e0 0x7f2618075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:23.183 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.174+0000 7f261f3d5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2618105180 0x7f2618075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:23.183 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.174+0000 7f261f3d5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f261810f380 con 0x7f26181047e0 2024-09-21T05:46:23.183 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.174+0000 7f261f3d5640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f261810f200 con 0x7f2618105180 2024-09-21T05:46:23.183 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.174+0000 7f261f3d5640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f261810f500 con 0x7f2618103750 2024-09-21T05:46:23.183 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.174+0000 7f261d171640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2618103750 0x7f2618076e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:23.183 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.174+0000 7f261d171640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2618103750 0x7f2618076e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:58172/0 (socket says 172.21.15.160:58172) 2024-09-21T05:46:23.183 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.174+0000 7f261d171640 1 -- 172.21.15.160:0/698548461 learned_addr learned my addr 172.21.15.160:0/698548461 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-09-21T05:46:23.183 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.174+0000 7f261d972640 1 --2- 172.21.15.160:0/698548461 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2618105180 0x7f2618075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:23.183 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.174+0000 7f261c970640 1 --2- 172.21.15.160:0/698548461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26181047e0 0x7f2618075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:23.183 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.174+0000 7f261d171640 1 -- 172.21.15.160:0/698548461 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2618105180 msgr2=0x7f2618075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:23.183 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.174+0000 7f261d171640 1 --2- 172.21.15.160:0/698548461 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2618105180 0x7f2618075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:23.183 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.174+0000 7f261d171640 1 -- 172.21.15.160:0/698548461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26181047e0 msgr2=0x7f2618075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:23.183 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.174+0000 7f261d171640 1 --2- 172.21.15.160:0/698548461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26181047e0 0x7f2618075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:23.183 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.174+0000 7f261d171640 1 -- 172.21.15.160:0/698548461 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2618076350 con 0x7f2618103750 2024-09-21T05:46:23.184 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.174+0000 7f261d171640 1 --2- 172.21.15.160:0/698548461 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2618103750 0x7f2618076e40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f26140314b0 tx=0x7f26140042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:23.184 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.175+0000 7f260e7fc640 1 -- 172.21.15.160:0/698548461 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f261403f030 con 0x7f2618103750 2024-09-21T05:46:23.184 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.175+0000 7f261f3d5640 1 -- 172.21.15.160:0/698548461 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26181a4020 con 0x7f2618103750 2024-09-21T05:46:23.184 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.175+0000 7f260e7fc640 1 -- 172.21.15.160:0/698548461 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f2614003cb0 con 0x7f2618103750 2024-09-21T05:46:23.184 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.175+0000 7f260e7fc640 1 -- 172.21.15.160:0/698548461 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2614035070 con 0x7f2618103750 2024-09-21T05:46:23.184 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.175+0000 7f261f3d5640 1 -- 172.21.15.160:0/698548461 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26181a43c0 con 0x7f2618103750 2024-09-21T05:46:23.184 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.176+0000 7f261f3d5640 1 -- 172.21.15.160:0/698548461 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f261810a930 con 0x7f2618103750 2024-09-21T05:46:23.184 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.177+0000 7f260e7fc640 1 -- 172.21.15.160:0/698548461 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f2614042030 con 0x7f2618103750 2024-09-21T05:46:23.184 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.178+0000 7f260e7fc640 1 --2- 172.21.15.160:0/698548461 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f26040b6510 0x7f26040b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:23.184 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.178+0000 7f260e7fc640 1 -- 172.21.15.160:0/698548461 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f26141077a0 con 0x7f2618103750 2024-09-21T05:46:23.184 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.178+0000 7f261c970640 1 --2- 172.21.15.160:0/698548461 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f26040b6510 0x7f26040b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:23.184 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.179+0000 7f261c970640 1 --2- 172.21.15.160:0/698548461 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f26040b6510 0x7f26040b8a20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2608009b60 tx=0x7f2608005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:23.185 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.182+0000 7f260e7fc640 1 -- 172.21.15.160:0/698548461 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f26140ce4d0 con 0x7f2618103750 2024-09-21T05:46:23.372 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.370+0000 7f261f3d5640 1 -- 172.21.15.160:0/698548461 --> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi116=b;smithi116=e;smithi116=h;smithi116=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l", "target": ["mon-mgr", ""]}) -- 0x7f26180639c0 con 0x7f26040b6510 2024-09-21T05:46:23.380 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.379+0000 7f260e7fc640 1 -- 172.21.15.160:0/698548461 <== mgr.14150 v2:172.21.15.70:6800/1366013939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f26180639c0 con 0x7f26040b6510 2024-09-21T05:46:23.381 INFO:teuthology.orchestra.run.smithi160.stdout:Scheduled mds.all update... 2024-09-21T05:46:23.383 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.381+0000 7f261f3d5640 1 -- 172.21.15.160:0/698548461 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f26040b6510 msgr2=0x7f26040b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:23.383 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.381+0000 7f261f3d5640 1 --2- 172.21.15.160:0/698548461 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f26040b6510 0x7f26040b8a20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2608009b60 tx=0x7f2608005f90 comp rx=0 tx=0).stop 2024-09-21T05:46:23.383 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.381+0000 7f261f3d5640 1 -- 172.21.15.160:0/698548461 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2618103750 msgr2=0x7f2618076e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:23.383 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.381+0000 7f261f3d5640 1 --2- 172.21.15.160:0/698548461 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2618103750 0x7f2618076e40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f26140314b0 tx=0x7f26140042f0 comp rx=0 tx=0).stop 2024-09-21T05:46:23.383 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.381+0000 7f261f3d5640 1 -- 172.21.15.160:0/698548461 shutdown_connections 2024-09-21T05:46:23.383 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.381+0000 7f261f3d5640 1 --2- 172.21.15.160:0/698548461 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f26040b6510 0x7f26040b8a20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:23.383 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.381+0000 7f261f3d5640 1 --2- 172.21.15.160:0/698548461 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2618105180 0x7f2618075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:23.383 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.381+0000 7f261f3d5640 1 --2- 172.21.15.160:0/698548461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26181047e0 0x7f2618075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:23.384 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.381+0000 7f261f3d5640 1 --2- 172.21.15.160:0/698548461 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2618103750 0x7f2618076e40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:23.384 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.381+0000 7f261f3d5640 1 -- 172.21.15.160:0/698548461 >> 172.21.15.160:0/698548461 conn(0x7f26180ff0c0 msgr2=0x7f2618107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:23.384 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.381+0000 7f261f3d5640 1 -- 172.21.15.160:0/698548461 shutdown_connections 2024-09-21T05:46:23.384 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-21T05:46:23.381+0000 7f261f3d5640 1 -- 172.21.15.160:0/698548461 wait complete. 2024-09-21T05:46:24.118 DEBUG:teuthology.orchestra.run.smithi070:mds.a> sudo journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.a.service 2024-09-21T05:46:24.122 DEBUG:teuthology.orchestra.run.smithi070:mds.d> sudo journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.d.service 2024-09-21T05:46:24.164 DEBUG:teuthology.orchestra.run.smithi070:mds.g> sudo journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.g.service 2024-09-21T05:46:24.209 DEBUG:teuthology.orchestra.run.smithi070:mds.j> sudo journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.j.service 2024-09-21T05:46:24.253 DEBUG:teuthology.orchestra.run.smithi116:mds.b> sudo journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.b.service 2024-09-21T05:46:24.255 DEBUG:teuthology.orchestra.run.smithi116:mds.e> sudo journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.e.service 2024-09-21T05:46:24.299 DEBUG:teuthology.orchestra.run.smithi116:mds.h> sudo journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.h.service 2024-09-21T05:46:24.342 DEBUG:teuthology.orchestra.run.smithi116:mds.k> sudo journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.k.service 2024-09-21T05:46:24.385 DEBUG:teuthology.orchestra.run.smithi160:mds.c> sudo journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.c.service 2024-09-21T05:46:24.387 DEBUG:teuthology.orchestra.run.smithi160:mds.f> sudo journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.f.service 2024-09-21T05:46:24.431 DEBUG:teuthology.orchestra.run.smithi160:mds.i> sudo journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.i.service 2024-09-21T05:46:24.474 DEBUG:teuthology.orchestra.run.smithi160:mds.l> sudo journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.l.service 2024-09-21T05:46:24.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:24 smithi070 ceph-mon[30981]: from='client.24556 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi116=b;smithi116=e;smithi116=h;smithi116=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:24.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:24 smithi070 ceph-mon[30981]: Saving service mds.all spec with placement smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi116=b;smithi116=e;smithi116=h;smithi116=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l;count:12 2024-09-21T05:46:24.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:24 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:24.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:24 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:24.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:24 smithi070 ceph-mon[30981]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:24.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:24 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:24.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:24 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:24.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:24 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:24.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:24 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:24.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:24 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:24.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:24 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:24.516 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-21T05:46:24.517 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:46:24.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:24 smithi160 ceph-mon[33979]: from='client.24556 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi116=b;smithi116=e;smithi116=h;smithi116=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:24.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:24 smithi160 ceph-mon[33979]: Saving service mds.all spec with placement smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi116=b;smithi116=e;smithi116=h;smithi116=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l;count:12 2024-09-21T05:46:24.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:24 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:24.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:24 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:24.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:24 smithi160 ceph-mon[33979]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:24.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:24 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:24.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:24 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:24.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:24 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:24.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:24 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:24.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:24 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:24.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:24 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:24.769 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:46:24.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:24 smithi116 ceph-mon[34332]: from='client.24556 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi116=b;smithi116=e;smithi116=h;smithi116=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:24.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:24 smithi116 ceph-mon[34332]: Saving service mds.all spec with placement smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi116=b;smithi116=e;smithi116=h;smithi116=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l;count:12 2024-09-21T05:46:24.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:24 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:24.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:24 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:24.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:24 smithi116 ceph-mon[34332]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:24.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:24 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:24.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:24 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:24.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:24 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:24.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:24 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:24.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:24 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:24.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:24 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:25.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.246+0000 7f5e6c477640 1 -- 172.21.15.70:0/4090674029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e641083a0 msgr2=0x7f5e641087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:25.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.246+0000 7f5e6c477640 1 --2- 172.21.15.70:0/4090674029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e641083a0 0x7f5e641087b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5e58009900 tx=0x7f5e5802a410 comp rx=0 tx=0).stop 2024-09-21T05:46:25.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.246+0000 7f5e6c477640 1 -- 172.21.15.70:0/4090674029 shutdown_connections 2024-09-21T05:46:25.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.246+0000 7f5e6c477640 1 --2- 172.21.15.70:0/4090674029 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5e64108cf0 0x7f5e6410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:25.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.246+0000 7f5e6c477640 1 --2- 172.21.15.70:0/4090674029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e641083a0 0x7f5e641087b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:25.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.246+0000 7f5e6c477640 1 --2- 172.21.15.70:0/4090674029 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e64102a60 0x7f5e64102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:25.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.246+0000 7f5e6c477640 1 -- 172.21.15.70:0/4090674029 >> 172.21.15.70:0/4090674029 conn(0x7f5e64079730 msgr2=0x7f5e64079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:25.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.246+0000 7f5e6c477640 1 -- 172.21.15.70:0/4090674029 shutdown_connections 2024-09-21T05:46:25.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.246+0000 7f5e6c477640 1 -- 172.21.15.70:0/4090674029 wait complete. 2024-09-21T05:46:25.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.247+0000 7f5e6c477640 1 Processor -- start 2024-09-21T05:46:25.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.247+0000 7f5e6c477640 1 -- start start 2024-09-21T05:46:25.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.247+0000 7f5e6c477640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e64102a60 0x7f5e6410ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:25.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.247+0000 7f5e6c477640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5e641083a0 0x7f5e641104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:25.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.247+0000 7f5e6c477640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e64108cf0 0x7f5e64110a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:25.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.247+0000 7f5e6c477640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5e64113a50 con 0x7f5e64108cf0 2024-09-21T05:46:25.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.247+0000 7f5e6c477640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f5e641138d0 con 0x7f5e641083a0 2024-09-21T05:46:25.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.247+0000 7f5e6c477640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5e64113bd0 con 0x7f5e64102a60 2024-09-21T05:46:25.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.247+0000 7f5e6aa14640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e64108cf0 0x7f5e64110a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:25.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.247+0000 7f5e6aa14640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e64108cf0 0x7f5e64110a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60616/0 (socket says 172.21.15.70:60616) 2024-09-21T05:46:25.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.247+0000 7f5e6aa14640 1 -- 172.21.15.70:0/833572506 learned_addr learned my addr 172.21.15.70:0/833572506 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:46:25.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.247+0000 7f5e69a12640 1 --2- 172.21.15.70:0/833572506 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5e641083a0 0x7f5e641104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:25.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.247+0000 7f5e6a213640 1 --2- 172.21.15.70:0/833572506 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e64102a60 0x7f5e6410ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:25.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.247+0000 7f5e6aa14640 1 -- 172.21.15.70:0/833572506 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e64102a60 msgr2=0x7f5e6410ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:25.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.247+0000 7f5e6aa14640 1 --2- 172.21.15.70:0/833572506 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e64102a60 0x7f5e6410ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:25.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.247+0000 7f5e6aa14640 1 -- 172.21.15.70:0/833572506 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5e641083a0 msgr2=0x7f5e641104f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:25.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.247+0000 7f5e6aa14640 1 --2- 172.21.15.70:0/833572506 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5e641083a0 0x7f5e641104f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:25.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.247+0000 7f5e6aa14640 1 -- 172.21.15.70:0/833572506 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e641a8740 con 0x7f5e64108cf0 2024-09-21T05:46:25.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.248+0000 7f5e6aa14640 1 --2- 172.21.15.70:0/833572506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e64108cf0 0x7f5e64110a30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c009fd0 tx=0x7f5e5c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:25.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.248+0000 7f5e577fe640 1 -- 172.21.15.70:0/833572506 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c017070 con 0x7f5e64108cf0 2024-09-21T05:46:25.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.248+0000 7f5e6c477640 1 -- 172.21.15.70:0/833572506 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e641a8a30 con 0x7f5e64108cf0 2024-09-21T05:46:25.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.248+0000 7f5e577fe640 1 -- 172.21.15.70:0/833572506 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f5e5c003e20 con 0x7f5e64108cf0 2024-09-21T05:46:25.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.248+0000 7f5e577fe640 1 -- 172.21.15.70:0/833572506 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c010460 con 0x7f5e64108cf0 2024-09-21T05:46:25.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.248+0000 7f5e6c477640 1 -- 172.21.15.70:0/833572506 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e641a8ef0 con 0x7f5e64108cf0 2024-09-21T05:46:25.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.249+0000 7f5e6c477640 1 -- 172.21.15.70:0/833572506 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e64102e70 con 0x7f5e64108cf0 2024-09-21T05:46:25.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.251+0000 7f5e577fe640 1 -- 172.21.15.70:0/833572506 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f5e5c003970 con 0x7f5e64108cf0 2024-09-21T05:46:25.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.251+0000 7f5e577fe640 1 --2- 172.21.15.70:0/833572506 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f5e500b6510 0x7f5e500b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:25.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.251+0000 7f5e6a213640 1 --2- 172.21.15.70:0/833572506 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f5e500b6510 0x7f5e500b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:25.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.252+0000 7f5e577fe640 1 -- 172.21.15.70:0/833572506 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f5e5c0e6b80 con 0x7f5e64108cf0 2024-09-21T05:46:25.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.252+0000 7f5e6a213640 1 --2- 172.21.15.70:0/833572506 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f5e500b6510 0x7f5e500b8a20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5e60005fd0 tx=0x7f5e60005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:25.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.254+0000 7f5e577fe640 1 -- 172.21.15.70:0/833572506 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5e5c0ad8b0 con 0x7f5e64108cf0 2024-09-21T05:46:25.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.472+0000 7f5e6c477640 1 -- 172.21.15.70:0/833572506 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e6402e640 con 0x7f5e64108cf0 2024-09-21T05:46:25.474 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:25 smithi070 ceph-mon[30981]: Deploying daemon mds.l on smithi160 2024-09-21T05:46:25.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.472+0000 7f5e577fe640 1 -- 172.21.15.70:0/833572506 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f5e5c0b1c90 con 0x7f5e64108cf0 2024-09-21T05:46:25.475 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:46:25.475 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":1,"btime":"2024-09-21T05:38:42:297125+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-21T05:46:25.475 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 1 2024-09-21T05:46:25.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.475+0000 7f5e6c477640 1 -- 172.21.15.70:0/833572506 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f5e500b6510 msgr2=0x7f5e500b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:25.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.475+0000 7f5e6c477640 1 --2- 172.21.15.70:0/833572506 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f5e500b6510 0x7f5e500b8a20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5e60005fd0 tx=0x7f5e60005850 comp rx=0 tx=0).stop 2024-09-21T05:46:25.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.475+0000 7f5e6c477640 1 -- 172.21.15.70:0/833572506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e64108cf0 msgr2=0x7f5e64110a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:25.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.475+0000 7f5e6c477640 1 --2- 172.21.15.70:0/833572506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e64108cf0 0x7f5e64110a30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c009fd0 tx=0x7f5e5c00b260 comp rx=0 tx=0).stop 2024-09-21T05:46:25.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.475+0000 7f5e6c477640 1 -- 172.21.15.70:0/833572506 shutdown_connections 2024-09-21T05:46:25.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.475+0000 7f5e6c477640 1 --2- 172.21.15.70:0/833572506 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f5e500b6510 0x7f5e500b8a20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:25.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.475+0000 7f5e6c477640 1 --2- 172.21.15.70:0/833572506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e64108cf0 0x7f5e64110a30 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:25.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.475+0000 7f5e6c477640 1 --2- 172.21.15.70:0/833572506 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5e641083a0 0x7f5e641104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:25.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.475+0000 7f5e6c477640 1 --2- 172.21.15.70:0/833572506 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e64102a60 0x7f5e6410ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:25.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.475+0000 7f5e6c477640 1 -- 172.21.15.70:0/833572506 >> 172.21.15.70:0/833572506 conn(0x7f5e64079730 msgr2=0x7f5e64101500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:25.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.475+0000 7f5e6c477640 1 -- 172.21.15.70:0/833572506 shutdown_connections 2024-09-21T05:46:25.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:25.475+0000 7f5e6c477640 1 -- 172.21.15.70:0/833572506 wait complete. 2024-09-21T05:46:25.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:25 smithi160 ceph-mon[33979]: Deploying daemon mds.l on smithi160 2024-09-21T05:46:25.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:25 smithi116 ceph-mon[34332]: Deploying daemon mds.l on smithi160 2024-09-21T05:46:26.049 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 21 05:46:25 smithi160 systemd[1]: Starting Ceph mds.l for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:46:26.308 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 21 05:46:26 smithi160 podman[61808]: 2024-09-21 05:46:25.94961389 +0000 UTC m=+0.016087938 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:46:26.309 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 21 05:46:26 smithi160 podman[61808]: 2024-09-21 05:46:26.079563443 +0000 UTC m=+0.146037498 container create a3579c252d71d6811f47ee3c058cfc611c34801bdefb9ca37d513d811888c664 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-l, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T05:46:26.309 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 21 05:46:26 smithi160 podman[61808]: 2024-09-21 05:46:26.307204219 +0000 UTC m=+0.373678286 container init a3579c252d71d6811f47ee3c058cfc611c34801bdefb9ca37d513d811888c664 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-l, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2) 2024-09-21T05:46:26.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:26 smithi160 ceph-mon[33979]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:26.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:26 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/833572506' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:46:26.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:26 smithi160 ceph-mon[33979]: mds.? [v2:172.21.15.160:6832/3543945704,v1:172.21.15.160:6833/3543945704] up:boot 2024-09-21T05:46:26.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:26 smithi160 ceph-mon[33979]: fsmap 1 up:standby 2024-09-21T05:46:26.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:26 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T05:46:26.649 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 21 05:46:26 smithi160 podman[61808]: 2024-09-21 05:46:26.31027229 +0000 UTC m=+0.376746348 container start a3579c252d71d6811f47ee3c058cfc611c34801bdefb9ca37d513d811888c664 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-l, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T05:46:26.649 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 21 05:46:26 smithi160 ceph-mds[61827]: -- 172.21.15.160:0/1682501703 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ace0077860 con 0x55ace421f180 2024-09-21T05:46:26.649 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 21 05:46:26 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-l[61823]: starting mds.l at 2024-09-21T05:46:26.649 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 21 05:46:26 smithi160 bash[61808]: a3579c252d71d6811f47ee3c058cfc611c34801bdefb9ca37d513d811888c664 2024-09-21T05:46:26.649 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 21 05:46:26 smithi160 systemd[1]: Started Ceph mds.l for 96c6636e-77db-11ef-baf5-efdc52797490. 2024-09-21T05:46:26.719 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:26 smithi116 ceph-mon[34332]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:26.719 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:26 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/833572506' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:46:26.719 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:26 smithi116 ceph-mon[34332]: mds.? [v2:172.21.15.160:6832/3543945704,v1:172.21.15.160:6833/3543945704] up:boot 2024-09-21T05:46:26.719 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:26 smithi116 ceph-mon[34332]: fsmap 1 up:standby 2024-09-21T05:46:26.719 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:26 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T05:46:26.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:26 smithi070 ceph-mon[30981]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:26.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:26 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/833572506' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:46:26.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:26 smithi070 ceph-mon[30981]: mds.? [v2:172.21.15.160:6832/3543945704,v1:172.21.15.160:6833/3543945704] up:boot 2024-09-21T05:46:26.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:26 smithi070 ceph-mon[30981]: fsmap 1 up:standby 2024-09-21T05:46:26.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:26 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T05:46:27.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:27 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:27.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:27 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:27.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:27 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:27.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:27 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:27.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:27 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:27.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:27 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:27.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:27 smithi070 ceph-mon[30981]: Deploying daemon mds.k on smithi116 2024-09-21T05:46:27.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:27 smithi070 ceph-mon[30981]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:27.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:27 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:27.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:27 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:27.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:27 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:27.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:27 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:27.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:27 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:27.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:27 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:27.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:27 smithi116 ceph-mon[34332]: Deploying daemon mds.k on smithi116 2024-09-21T05:46:27.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:27 smithi116 ceph-mon[34332]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:27.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:27 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:27.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:27 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:27.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:27 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:27.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:27 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:27.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:27 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:27.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:27 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:27.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:27 smithi160 ceph-mon[33979]: Deploying daemon mds.k on smithi116 2024-09-21T05:46:27.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:27 smithi160 ceph-mon[33979]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:28.284 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:46:28.541 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:46:28.554 INFO:journalctl@ceph.mds.k.smithi116.stdout:Sep 21 05:46:28 smithi116 systemd[1]: Starting Ceph mds.k for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:46:28.845 INFO:journalctl@ceph.mds.k.smithi116.stdout:Sep 21 05:46:28 smithi116 podman[61342]: 2024-09-21 05:46:28.487927879 +0000 UTC m=+0.015782999 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:46:28.845 INFO:journalctl@ceph.mds.k.smithi116.stdout:Sep 21 05:46:28 smithi116 podman[61342]: 2024-09-21 05:46:28.591770032 +0000 UTC m=+0.119625127 container create bec904e559070c591d9262d9ae772f9e9a7cc9b0cd23a8b0f3cdd131c442cf33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-k, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T05:46:28.846 INFO:journalctl@ceph.mds.k.smithi116.stdout:Sep 21 05:46:28 smithi116 podman[61342]: 2024-09-21 05:46:28.844273847 +0000 UTC m=+0.372128953 container init bec904e559070c591d9262d9ae772f9e9a7cc9b0cd23a8b0f3cdd131c442cf33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-k, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T05:46:29.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.069+0000 7fba76c6f640 1 -- 172.21.15.70:0/2454145194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba70102030 msgr2=0x7fba70102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:29.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.069+0000 7fba76c6f640 1 --2- 172.21.15.70:0/2454145194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba70102030 0x7fba70102440 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fba6c009900 tx=0x7fba6c02a410 comp rx=0 tx=0).stop 2024-09-21T05:46:29.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.069+0000 7fba76c6f640 1 -- 172.21.15.70:0/2454145194 shutdown_connections 2024-09-21T05:46:29.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.069+0000 7fba76c6f640 1 --2- 172.21.15.70:0/2454145194 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba70106280 0x7fba70106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:29.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.069+0000 7fba76c6f640 1 --2- 172.21.15.70:0/2454145194 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fba70106bd0 0x7fba70110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:29.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.069+0000 7fba76c6f640 1 --2- 172.21.15.70:0/2454145194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba70102030 0x7fba70102440 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:29.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.069+0000 7fba76c6f640 1 -- 172.21.15.70:0/2454145194 >> 172.21.15.70:0/2454145194 conn(0x7fba70077c60 msgr2=0x7fba700780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:29.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.069+0000 7fba76c6f640 1 -- 172.21.15.70:0/2454145194 shutdown_connections 2024-09-21T05:46:29.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.069+0000 7fba76c6f640 1 -- 172.21.15.70:0/2454145194 wait complete. 2024-09-21T05:46:29.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.069+0000 7fba76c6f640 1 Processor -- start 2024-09-21T05:46:29.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.069+0000 7fba76c6f640 1 -- start start 2024-09-21T05:46:29.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.070+0000 7fba76c6f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba70102030 0x7fba7019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:29.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.070+0000 7fba76c6f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba70106280 0x7fba7019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:29.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.070+0000 7fba76c6f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fba70106bd0 0x7fba7019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:29.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.070+0000 7fba76c6f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fba70113a90 con 0x7fba70102030 2024-09-21T05:46:29.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.070+0000 7fba76c6f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fba70113910 con 0x7fba70106bd0 2024-09-21T05:46:29.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.070+0000 7fba76c6f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fba70113c10 con 0x7fba70106280 2024-09-21T05:46:29.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.070+0000 7fba74a0b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba70102030 0x7fba7019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:29.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.070+0000 7fba74a0b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba70102030 0x7fba7019a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60636/0 (socket says 172.21.15.70:60636) 2024-09-21T05:46:29.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.070+0000 7fba74a0b640 1 -- 172.21.15.70:0/4205843416 learned_addr learned my addr 172.21.15.70:0/4205843416 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:46:29.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.070+0000 7fba7520c640 1 --2- 172.21.15.70:0/4205843416 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fba70106bd0 0x7fba7019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:29.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.070+0000 7fba67fff640 1 --2- 172.21.15.70:0/4205843416 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba70106280 0x7fba7019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:29.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.070+0000 7fba74a0b640 1 -- 172.21.15.70:0/4205843416 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba70106280 msgr2=0x7fba7019aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:29.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.070+0000 7fba74a0b640 1 --2- 172.21.15.70:0/4205843416 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba70106280 0x7fba7019aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:29.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.070+0000 7fba74a0b640 1 -- 172.21.15.70:0/4205843416 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fba70106bd0 msgr2=0x7fba7019fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:29.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.070+0000 7fba74a0b640 1 --2- 172.21.15.70:0/4205843416 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fba70106bd0 0x7fba7019fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:29.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.070+0000 7fba74a0b640 1 -- 172.21.15.70:0/4205843416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba701a0410 con 0x7fba70102030 2024-09-21T05:46:29.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.070+0000 7fba7520c640 1 --2- 172.21.15.70:0/4205843416 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fba70106bd0 0x7fba7019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:46:29.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.070+0000 7fba74a0b640 1 --2- 172.21.15.70:0/4205843416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba70102030 0x7fba7019a4a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fba6c005940 tx=0x7fba6c004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:29.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.071+0000 7fba65ffb640 1 -- 172.21.15.70:0/4205843416 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6c03f030 con 0x7fba70102030 2024-09-21T05:46:29.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.071+0000 7fba76c6f640 1 -- 172.21.15.70:0/4205843416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba701a06a0 con 0x7fba70102030 2024-09-21T05:46:29.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.071+0000 7fba65ffb640 1 -- 172.21.15.70:0/4205843416 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fba6c0054b0 con 0x7fba70102030 2024-09-21T05:46:29.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.071+0000 7fba65ffb640 1 -- 172.21.15.70:0/4205843416 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6c035070 con 0x7fba70102030 2024-09-21T05:46:29.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.071+0000 7fba76c6f640 1 -- 172.21.15.70:0/4205843416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba701a6e60 con 0x7fba70102030 2024-09-21T05:46:29.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.072+0000 7fba76c6f640 1 -- 172.21.15.70:0/4205843416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba7006ab90 con 0x7fba70102030 2024-09-21T05:46:29.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.073+0000 7fba65ffb640 1 -- 172.21.15.70:0/4205843416 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fba6c042030 con 0x7fba70102030 2024-09-21T05:46:29.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.074+0000 7fba65ffb640 1 --2- 172.21.15.70:0/4205843416 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fba580b6510 0x7fba580b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:29.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.074+0000 7fba67fff640 1 --2- 172.21.15.70:0/4205843416 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fba580b6510 0x7fba580b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:29.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.074+0000 7fba65ffb640 1 -- 172.21.15.70:0/4205843416 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7fba6c107380 con 0x7fba70102030 2024-09-21T05:46:29.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.075+0000 7fba67fff640 1 --2- 172.21.15.70:0/4205843416 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fba580b6510 0x7fba580b8a20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fba70109000 tx=0x7fba6000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:29.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.083+0000 7fba65ffb640 1 -- 172.21.15.70:0/4205843416 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fba6c0d2490 con 0x7fba70102030 2024-09-21T05:46:29.304 INFO:journalctl@ceph.mds.k.smithi116.stdout:Sep 21 05:46:28 smithi116 podman[61342]: 2024-09-21 05:46:28.847299438 +0000 UTC m=+0.375154536 container start bec904e559070c591d9262d9ae772f9e9a7cc9b0cd23a8b0f3cdd131c442cf33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-k, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T05:46:29.305 INFO:journalctl@ceph.mds.k.smithi116.stdout:Sep 21 05:46:28 smithi116 ceph-mds[61361]: -- 172.21.15.116:0/3326036348 <== mon.2 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a4ac8f9860 con 0x55a4b0aa1600 2024-09-21T05:46:29.305 INFO:journalctl@ceph.mds.k.smithi116.stdout:Sep 21 05:46:28 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-k[61357]: starting mds.k at 2024-09-21T05:46:29.305 INFO:journalctl@ceph.mds.k.smithi116.stdout:Sep 21 05:46:28 smithi116 bash[61342]: bec904e559070c591d9262d9ae772f9e9a7cc9b0cd23a8b0f3cdd131c442cf33 2024-09-21T05:46:29.305 INFO:journalctl@ceph.mds.k.smithi116.stdout:Sep 21 05:46:28 smithi116 systemd[1]: Started Ceph mds.k for 96c6636e-77db-11ef-baf5-efdc52797490. 2024-09-21T05:46:29.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.323+0000 7fba76c6f640 1 -- 172.21.15.70:0/4205843416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba7010bc60 con 0x7fba70102030 2024-09-21T05:46:29.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.323+0000 7fba65ffb640 1 -- 172.21.15.70:0/4205843416 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2263 (secure 0 0 0) 0x7fba6c0d73d0 con 0x7fba70102030 2024-09-21T05:46:29.326 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:46:29.327 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":3,"btime":"2024-09-21T05:46:28:936051+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24568,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3543945704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3543945704},{"type":"v1","addr":"172.21.15.160:6833","nonce":3543945704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/283778129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":283778129},{"type":"v1","addr":"172.21.15.116:6833","nonce":283778129}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-21T05:46:29.327 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 3 2024-09-21T05:46:29.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.325+0000 7fba76c6f640 1 -- 172.21.15.70:0/4205843416 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fba580b6510 msgr2=0x7fba580b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:29.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.325+0000 7fba76c6f640 1 --2- 172.21.15.70:0/4205843416 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fba580b6510 0x7fba580b8a20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fba70109000 tx=0x7fba6000b410 comp rx=0 tx=0).stop 2024-09-21T05:46:29.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.325+0000 7fba76c6f640 1 -- 172.21.15.70:0/4205843416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba70102030 msgr2=0x7fba7019a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:29.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.325+0000 7fba76c6f640 1 --2- 172.21.15.70:0/4205843416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba70102030 0x7fba7019a4a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fba6c005940 tx=0x7fba6c004c00 comp rx=0 tx=0).stop 2024-09-21T05:46:29.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.326+0000 7fba76c6f640 1 -- 172.21.15.70:0/4205843416 shutdown_connections 2024-09-21T05:46:29.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.326+0000 7fba76c6f640 1 --2- 172.21.15.70:0/4205843416 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fba580b6510 0x7fba580b8a20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:29.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.326+0000 7fba76c6f640 1 --2- 172.21.15.70:0/4205843416 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba70106280 0x7fba7019aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:29.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.326+0000 7fba76c6f640 1 --2- 172.21.15.70:0/4205843416 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fba70106bd0 0x7fba7019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:29.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.326+0000 7fba76c6f640 1 --2- 172.21.15.70:0/4205843416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba70102030 0x7fba7019a4a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:29.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.326+0000 7fba76c6f640 1 -- 172.21.15.70:0/4205843416 >> 172.21.15.70:0/4205843416 conn(0x7fba70077c60 msgr2=0x7fba70107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:29.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.326+0000 7fba76c6f640 1 -- 172.21.15.70:0/4205843416 shutdown_connections 2024-09-21T05:46:29.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:29.326+0000 7fba76c6f640 1 -- 172.21.15.70:0/4205843416 wait complete. 2024-09-21T05:46:30.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:29 smithi070 ceph-mon[30981]: mds.? [v2:172.21.15.116:6832/283778129,v1:172.21.15.116:6833/283778129] up:boot 2024-09-21T05:46:30.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:29 smithi070 ceph-mon[30981]: fsmap 2 up:standby 2024-09-21T05:46:30.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:29 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T05:46:30.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:29 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:30.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:29 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:30.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:29 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:30.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:29 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:30.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:29 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:30.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:29 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:30.247 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:29 smithi070 ceph-mon[30981]: Deploying daemon mds.j on smithi070 2024-09-21T05:46:30.247 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:29 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/4205843416' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:46:30.247 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:29 smithi070 ceph-mon[30981]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:30.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:29 smithi116 ceph-mon[34332]: mds.? [v2:172.21.15.116:6832/283778129,v1:172.21.15.116:6833/283778129] up:boot 2024-09-21T05:46:30.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:29 smithi116 ceph-mon[34332]: fsmap 2 up:standby 2024-09-21T05:46:30.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:29 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T05:46:30.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:29 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:30.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:29 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:30.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:29 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:30.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:29 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:30.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:29 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:30.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:29 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:30.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:29 smithi116 ceph-mon[34332]: Deploying daemon mds.j on smithi070 2024-09-21T05:46:30.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:29 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/4205843416' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:46:30.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:29 smithi116 ceph-mon[34332]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:30.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:29 smithi160 ceph-mon[33979]: mds.? [v2:172.21.15.116:6832/283778129,v1:172.21.15.116:6833/283778129] up:boot 2024-09-21T05:46:30.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:29 smithi160 ceph-mon[33979]: fsmap 2 up:standby 2024-09-21T05:46:30.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:29 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T05:46:30.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:29 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:30.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:29 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:30.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:29 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:30.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:29 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:30.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:29 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:30.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:29 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:30.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:29 smithi160 ceph-mon[33979]: Deploying daemon mds.j on smithi070 2024-09-21T05:46:30.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:29 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/4205843416' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:46:30.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:29 smithi160 ceph-mon[33979]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:31.245 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 21 05:46:31 smithi070 systemd[1]: Starting Ceph mds.j for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:46:31.668 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:31 smithi070 ceph-mon[30981]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:31.668 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 21 05:46:31 smithi070 podman[71186]: 2024-09-21 05:46:31.439108754 +0000 UTC m=+0.015784234 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:46:31.668 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 21 05:46:31 smithi070 podman[71186]: 2024-09-21 05:46:31.54850908 +0000 UTC m=+0.125184531 container create d3d484dad73275f08cc577db28536c7ae2b9b5b5c11781b94a7251d7d60a6524 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-j, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T05:46:31.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:31 smithi116 ceph-mon[34332]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:31.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:31 smithi160 ceph-mon[33979]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:32.245 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 21 05:46:31 smithi070 podman[71186]: 2024-09-21 05:46:31.792746369 +0000 UTC m=+0.369421839 container init d3d484dad73275f08cc577db28536c7ae2b9b5b5c11781b94a7251d7d60a6524 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-j, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2) 2024-09-21T05:46:32.245 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 21 05:46:31 smithi070 podman[71186]: 2024-09-21 05:46:31.795548705 +0000 UTC m=+0.372224166 container start d3d484dad73275f08cc577db28536c7ae2b9b5b5c11781b94a7251d7d60a6524 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T05:46:32.246 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 21 05:46:31 smithi070 ceph-mds[71204]: -- 172.21.15.70:0/380711508 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d27f55d860 con 0x55d283705a80 2024-09-21T05:46:32.246 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 21 05:46:31 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-j[71200]: starting mds.j at 2024-09-21T05:46:32.246 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 21 05:46:31 smithi070 bash[71186]: d3d484dad73275f08cc577db28536c7ae2b9b5b5c11781b94a7251d7d60a6524 2024-09-21T05:46:32.246 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 21 05:46:31 smithi070 systemd[1]: Started Ceph mds.j for 96c6636e-77db-11ef-baf5-efdc52797490. 2024-09-21T05:46:33.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:32 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:33.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:32 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:33.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:32 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:33.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:32 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:33.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:32 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:33.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:32 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:33.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:32 smithi070 ceph-mon[30981]: Deploying daemon mds.d on smithi070 2024-09-21T05:46:33.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:32 smithi070 ceph-mon[30981]: mds.? [v2:172.21.15.70:6834/3519318330,v1:172.21.15.70:6835/3519318330] up:boot 2024-09-21T05:46:33.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:32 smithi070 ceph-mon[30981]: fsmap 3 up:standby 2024-09-21T05:46:33.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:32 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T05:46:33.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:32 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:33.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:32 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:33.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:32 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:33.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:32 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:33.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:32 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:33.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:32 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:33.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:32 smithi116 ceph-mon[34332]: Deploying daemon mds.d on smithi070 2024-09-21T05:46:33.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:32 smithi116 ceph-mon[34332]: mds.? [v2:172.21.15.70:6834/3519318330,v1:172.21.15.70:6835/3519318330] up:boot 2024-09-21T05:46:33.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:32 smithi116 ceph-mon[34332]: fsmap 3 up:standby 2024-09-21T05:46:33.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:32 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T05:46:33.383 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:46:33.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:32 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:33.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:32 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:33.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:32 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:33.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:32 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:33.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:32 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:33.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:32 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:33.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:32 smithi160 ceph-mon[33979]: Deploying daemon mds.d on smithi070 2024-09-21T05:46:33.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:32 smithi160 ceph-mon[33979]: mds.? [v2:172.21.15.70:6834/3519318330,v1:172.21.15.70:6835/3519318330] up:boot 2024-09-21T05:46:33.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:32 smithi160 ceph-mon[33979]: fsmap 3 up:standby 2024-09-21T05:46:33.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:32 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T05:46:33.635 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:46:34.030 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:33 smithi070 ceph-mon[30981]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:34.205 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:33 smithi160 ceph-mon[33979]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:34.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.223+0000 7f7ca1424640 1 -- 172.21.15.70:0/2618703258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c9c1083a0 msgr2=0x7f7c9c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:34.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.223+0000 7f7ca1424640 1 --2- 172.21.15.70:0/2618703258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c9c1083a0 0x7f7c9c1087b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7c84009900 tx=0x7f7c8402a410 comp rx=0 tx=0).stop 2024-09-21T05:46:34.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.223+0000 7f7ca1424640 1 -- 172.21.15.70:0/2618703258 shutdown_connections 2024-09-21T05:46:34.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.223+0000 7f7ca1424640 1 --2- 172.21.15.70:0/2618703258 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7c9c108cf0 0x7f7c9c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:34.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.223+0000 7f7ca1424640 1 --2- 172.21.15.70:0/2618703258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c9c1083a0 0x7f7c9c1087b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:34.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.223+0000 7f7ca1424640 1 --2- 172.21.15.70:0/2618703258 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c9c102a60 0x7f7c9c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:34.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.223+0000 7f7ca1424640 1 -- 172.21.15.70:0/2618703258 >> 172.21.15.70:0/2618703258 conn(0x7f7c9c079730 msgr2=0x7f7c9c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:34.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.223+0000 7f7ca1424640 1 -- 172.21.15.70:0/2618703258 shutdown_connections 2024-09-21T05:46:34.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.223+0000 7f7ca1424640 1 -- 172.21.15.70:0/2618703258 wait complete. 2024-09-21T05:46:34.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.224+0000 7f7ca1424640 1 Processor -- start 2024-09-21T05:46:34.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.224+0000 7f7ca1424640 1 -- start start 2024-09-21T05:46:34.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.224+0000 7f7ca1424640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c9c102a60 0x7f7c9c104250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:34.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.224+0000 7f7ca1424640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c9c1083a0 0x7f7c9c104790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:34.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.224+0000 7f7ca1424640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7c9c108cf0 0x7f7c9c104cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:34.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.224+0000 7f7ca1424640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c112930 con 0x7f7c9c102a60 2024-09-21T05:46:34.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.224+0000 7f7ca1424640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c1127b0 con 0x7f7c9c108cf0 2024-09-21T05:46:34.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.224+0000 7f7ca1424640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c112ab0 con 0x7f7c9c1083a0 2024-09-21T05:46:34.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.224+0000 7f7c9affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c9c102a60 0x7f7c9c104250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:34.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.224+0000 7f7c9affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c9c102a60 0x7f7c9c104250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35924/0 (socket says 172.21.15.70:35924) 2024-09-21T05:46:34.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.224+0000 7f7c9affd640 1 -- 172.21.15.70:0/1037368991 learned_addr learned my addr 172.21.15.70:0/1037368991 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:46:34.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.224+0000 7f7c9affd640 1 -- 172.21.15.70:0/1037368991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c9c1083a0 msgr2=0x7f7c9c104790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:34.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.224+0000 7f7c93fff640 1 --2- 172.21.15.70:0/1037368991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c9c1083a0 0x7f7c9c104790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:34.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.224+0000 7f7c9b7fe640 1 --2- 172.21.15.70:0/1037368991 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7c9c108cf0 0x7f7c9c104cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:34.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.224+0000 7f7c9affd640 1 --2- 172.21.15.70:0/1037368991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c9c1083a0 0x7f7c9c104790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:34.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.224+0000 7f7c9affd640 1 -- 172.21.15.70:0/1037368991 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7c9c108cf0 msgr2=0x7f7c9c104cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:34.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.224+0000 7f7c9affd640 1 --2- 172.21.15.70:0/1037368991 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7c9c108cf0 0x7f7c9c104cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:34.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.224+0000 7f7c9affd640 1 -- 172.21.15.70:0/1037368991 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c9c1a8730 con 0x7f7c9c102a60 2024-09-21T05:46:34.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.224+0000 7f7c93fff640 1 --2- 172.21.15.70:0/1037368991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c9c1083a0 0x7f7c9c104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:46:34.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.225+0000 7f7c9affd640 1 --2- 172.21.15.70:0/1037368991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c9c102a60 0x7f7c9c104250 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c00e9f0 tx=0x7f7c8c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:34.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.225+0000 7f7c98ff9640 1 -- 172.21.15.70:0/1037368991 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c00cd80 con 0x7f7c9c102a60 2024-09-21T05:46:34.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.225+0000 7f7c98ff9640 1 -- 172.21.15.70:0/1037368991 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f7c8c0054d0 con 0x7f7c9c102a60 2024-09-21T05:46:34.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.225+0000 7f7ca1424640 1 -- 172.21.15.70:0/1037368991 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c9c1a8a20 con 0x7f7c9c102a60 2024-09-21T05:46:34.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.225+0000 7f7c98ff9640 1 -- 172.21.15.70:0/1037368991 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c010690 con 0x7f7c9c102a60 2024-09-21T05:46:34.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.225+0000 7f7ca1424640 1 -- 172.21.15.70:0/1037368991 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c9c1a8f10 con 0x7f7c9c102a60 2024-09-21T05:46:34.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.226+0000 7f7ca1424640 1 -- 172.21.15.70:0/1037368991 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c9c102e70 con 0x7f7c9c102a60 2024-09-21T05:46:34.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.228+0000 7f7c98ff9640 1 -- 172.21.15.70:0/1037368991 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f7c8c0046c0 con 0x7f7c9c102a60 2024-09-21T05:46:34.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.229+0000 7f7c98ff9640 1 --2- 172.21.15.70:0/1037368991 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7c880b6510 0x7f7c880b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:34.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.229+0000 7f7c93fff640 1 --2- 172.21.15.70:0/1037368991 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7c880b6510 0x7f7c880b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:34.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.229+0000 7f7c98ff9640 1 -- 172.21.15.70:0/1037368991 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f7c8c0e74f0 con 0x7f7c9c102a60 2024-09-21T05:46:34.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.230+0000 7f7c93fff640 1 --2- 172.21.15.70:0/1037368991 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7c880b6510 0x7f7c880b8a20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7c840096c0 tx=0x7f7c84005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:34.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.232+0000 7f7c98ff9640 1 -- 172.21.15.70:0/1037368991 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7c8c056710 con 0x7f7c9c102a60 2024-09-21T05:46:34.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:33 smithi116 ceph-mon[34332]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:34.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.464+0000 7f7ca1424640 1 -- 172.21.15.70:0/1037368991 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c9c105550 con 0x7f7c9c102a60 2024-09-21T05:46:34.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.465+0000 7f7c98ff9640 1 -- 172.21.15.70:0/1037368991 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3088 (secure 0 0 0) 0x7f7c8c0ae220 con 0x7f7c9c102a60 2024-09-21T05:46:34.467 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:46:34.467 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":4,"btime":"2024-09-21T05:46:32:455883+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3519318330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3519318330},{"type":"v1","addr":"172.21.15.70:6835","nonce":3519318330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24568,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3543945704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3543945704},{"type":"v1","addr":"172.21.15.160:6833","nonce":3543945704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/283778129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":283778129},{"type":"v1","addr":"172.21.15.116:6833","nonce":283778129}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-21T05:46:34.468 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 4 2024-09-21T05:46:34.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.467+0000 7f7ca1424640 1 -- 172.21.15.70:0/1037368991 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7c880b6510 msgr2=0x7f7c880b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:34.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.467+0000 7f7ca1424640 1 --2- 172.21.15.70:0/1037368991 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7c880b6510 0x7f7c880b8a20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7c840096c0 tx=0x7f7c84005d50 comp rx=0 tx=0).stop 2024-09-21T05:46:34.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.467+0000 7f7ca1424640 1 -- 172.21.15.70:0/1037368991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c9c102a60 msgr2=0x7f7c9c104250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:34.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.467+0000 7f7ca1424640 1 --2- 172.21.15.70:0/1037368991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c9c102a60 0x7f7c9c104250 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c00e9f0 tx=0x7f7c8c00edf0 comp rx=0 tx=0).stop 2024-09-21T05:46:34.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.467+0000 7f7ca1424640 1 -- 172.21.15.70:0/1037368991 shutdown_connections 2024-09-21T05:46:34.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.467+0000 7f7ca1424640 1 --2- 172.21.15.70:0/1037368991 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7c880b6510 0x7f7c880b8a20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:34.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.467+0000 7f7ca1424640 1 --2- 172.21.15.70:0/1037368991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c9c1083a0 0x7f7c9c104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:34.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.467+0000 7f7ca1424640 1 --2- 172.21.15.70:0/1037368991 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7c9c108cf0 0x7f7c9c104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:34.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.467+0000 7f7ca1424640 1 --2- 172.21.15.70:0/1037368991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c9c102a60 0x7f7c9c104250 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:34.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.467+0000 7f7ca1424640 1 -- 172.21.15.70:0/1037368991 >> 172.21.15.70:0/1037368991 conn(0x7f7c9c079730 msgr2=0x7f7c9c101b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:34.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.467+0000 7f7ca1424640 1 -- 172.21.15.70:0/1037368991 shutdown_connections 2024-09-21T05:46:34.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:34.467+0000 7f7ca1424640 1 -- 172.21.15.70:0/1037368991 wait complete. 2024-09-21T05:46:35.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:34 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1037368991' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:46:35.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:34 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:35.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:34 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:35.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:34 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:35.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:34 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:35.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:34 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:35.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:34 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:35.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:34 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1037368991' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:46:35.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:34 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:35.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:34 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:35.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:34 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:35.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:34 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:35.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:34 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:35.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:34 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:35.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:34 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1037368991' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:46:35.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:34 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:35.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:34 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:35.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:34 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:35.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:34 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:35.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:34 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:35.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:34 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:36.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:35 smithi070 ceph-mon[30981]: Deploying daemon mds.e on smithi116 2024-09-21T05:46:36.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:35 smithi070 ceph-mon[30981]: mds.? [v2:172.21.15.70:6836/2706663460,v1:172.21.15.70:6837/2706663460] up:boot 2024-09-21T05:46:36.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:35 smithi070 ceph-mon[30981]: fsmap 4 up:standby 2024-09-21T05:46:36.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:35 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T05:46:36.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:35 smithi070 ceph-mon[30981]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:36.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:35 smithi116 ceph-mon[34332]: Deploying daemon mds.e on smithi116 2024-09-21T05:46:36.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:35 smithi116 ceph-mon[34332]: mds.? [v2:172.21.15.70:6836/2706663460,v1:172.21.15.70:6837/2706663460] up:boot 2024-09-21T05:46:36.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:35 smithi116 ceph-mon[34332]: fsmap 4 up:standby 2024-09-21T05:46:36.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:35 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T05:46:36.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:35 smithi116 ceph-mon[34332]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:36.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:35 smithi160 ceph-mon[33979]: Deploying daemon mds.e on smithi116 2024-09-21T05:46:36.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:35 smithi160 ceph-mon[33979]: mds.? [v2:172.21.15.70:6836/2706663460,v1:172.21.15.70:6837/2706663460] up:boot 2024-09-21T05:46:36.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:35 smithi160 ceph-mon[33979]: fsmap 4 up:standby 2024-09-21T05:46:36.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:35 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T05:46:36.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:35 smithi160 ceph-mon[33979]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:37.023 INFO:journalctl@ceph.mds.e.smithi116.stdout:Sep 21 05:46:36 smithi116 systemd[1]: Starting Ceph mds.e for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:46:37.301 INFO:journalctl@ceph.mds.e.smithi116.stdout:Sep 21 05:46:37 smithi116 podman[61609]: 2024-09-21 05:46:36.92415173 +0000 UTC m=+0.015607768 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:46:37.301 INFO:journalctl@ceph.mds.e.smithi116.stdout:Sep 21 05:46:37 smithi116 podman[61609]: 2024-09-21 05:46:37.05545588 +0000 UTC m=+0.146911905 container create 73c2382a2ce9858266b447743ac6f3157fa912da6057dcb5dd48798320aa732f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-e, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T05:46:37.301 INFO:journalctl@ceph.mds.e.smithi116.stdout:Sep 21 05:46:37 smithi116 podman[61609]: 2024-09-21 05:46:37.299654724 +0000 UTC m=+0.391110764 container init 73c2382a2ce9858266b447743ac6f3157fa912da6057dcb5dd48798320aa732f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-e, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T05:46:37.554 INFO:journalctl@ceph.mds.e.smithi116.stdout:Sep 21 05:46:37 smithi116 podman[61609]: 2024-09-21 05:46:37.302368821 +0000 UTC m=+0.393824845 container start 73c2382a2ce9858266b447743ac6f3157fa912da6057dcb5dd48798320aa732f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-21T05:46:37.554 INFO:journalctl@ceph.mds.e.smithi116.stdout:Sep 21 05:46:37 smithi116 ceph-mds[61628]: -- 172.21.15.116:0/3896406400 <== mon.2 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a8b76c7860 con 0x55a8bb86f180 2024-09-21T05:46:37.554 INFO:journalctl@ceph.mds.e.smithi116.stdout:Sep 21 05:46:37 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-e[61624]: starting mds.e at 2024-09-21T05:46:37.554 INFO:journalctl@ceph.mds.e.smithi116.stdout:Sep 21 05:46:37 smithi116 bash[61609]: 73c2382a2ce9858266b447743ac6f3157fa912da6057dcb5dd48798320aa732f 2024-09-21T05:46:37.554 INFO:journalctl@ceph.mds.e.smithi116.stdout:Sep 21 05:46:37 smithi116 systemd[1]: Started Ceph mds.e for 96c6636e-77db-11ef-baf5-efdc52797490. 2024-09-21T05:46:37.603 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:46:37.862 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:46:38.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.323+0000 7f7d38f40640 1 -- 172.21.15.70:0/3923036951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d341094a0 msgr2=0x7f7d341098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:38.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.323+0000 7f7d38f40640 1 --2- 172.21.15.70:0/3923036951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d341094a0 0x7f7d341098b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c009900 tx=0x7f7d1c02a410 comp rx=0 tx=0).stop 2024-09-21T05:46:38.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.323+0000 7f7d38f40640 1 -- 172.21.15.70:0/3923036951 shutdown_connections 2024-09-21T05:46:38.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.323+0000 7f7d38f40640 1 --2- 172.21.15.70:0/3923036951 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d34109df0 0x7f7d34110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:38.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.323+0000 7f7d38f40640 1 --2- 172.21.15.70:0/3923036951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d341094a0 0x7f7d341098b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:38.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.323+0000 7f7d38f40640 1 --2- 172.21.15.70:0/3923036951 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7d34103b60 0x7f7d34103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:38.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.323+0000 7f7d38f40640 1 -- 172.21.15.70:0/3923036951 >> 172.21.15.70:0/3923036951 conn(0x7f7d3407b850 msgr2=0x7f7d3407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:38.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.323+0000 7f7d38f40640 1 -- 172.21.15.70:0/3923036951 shutdown_connections 2024-09-21T05:46:38.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.324+0000 7f7d38f40640 1 -- 172.21.15.70:0/3923036951 wait complete. 2024-09-21T05:46:38.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.324+0000 7f7d38f40640 1 Processor -- start 2024-09-21T05:46:38.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.325+0000 7f7d38f40640 1 -- start start 2024-09-21T05:46:38.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.325+0000 7f7d38f40640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d34103b60 0x7f7d34075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:38.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.325+0000 7f7d38f40640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7d341094a0 0x7f7d34075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:38.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.325+0000 7f7d38f40640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d34109df0 0x7f7d34076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:38.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.325+0000 7f7d38f40640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7d34113a80 con 0x7f7d34109df0 2024-09-21T05:46:38.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.325+0000 7f7d38f40640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f7d34113900 con 0x7f7d341094a0 2024-09-21T05:46:38.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.325+0000 7f7d38f40640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7d34113c00 con 0x7f7d34103b60 2024-09-21T05:46:38.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.325+0000 7f7d32d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d34109df0 0x7f7d34076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:38.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.325+0000 7f7d32d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d34109df0 0x7f7d34076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35960/0 (socket says 172.21.15.70:35960) 2024-09-21T05:46:38.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.325+0000 7f7d32d9d640 1 -- 172.21.15.70:0/2215595892 learned_addr learned my addr 172.21.15.70:0/2215595892 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:46:38.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.325+0000 7f7d29d9b640 1 --2- 172.21.15.70:0/2215595892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7d341094a0 0x7f7d34075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:38.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.325+0000 7f7d3259c640 1 --2- 172.21.15.70:0/2215595892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d34103b60 0x7f7d34075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:38.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.326+0000 7f7d32d9d640 1 -- 172.21.15.70:0/2215595892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d34103b60 msgr2=0x7f7d34075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:38.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.326+0000 7f7d32d9d640 1 --2- 172.21.15.70:0/2215595892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d34103b60 0x7f7d34075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:38.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.326+0000 7f7d32d9d640 1 -- 172.21.15.70:0/2215595892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7d341094a0 msgr2=0x7f7d34075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:38.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.326+0000 7f7d32d9d640 1 --2- 172.21.15.70:0/2215595892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7d341094a0 0x7f7d34075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:38.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.326+0000 7f7d32d9d640 1 -- 172.21.15.70:0/2215595892 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d341a8750 con 0x7f7d34109df0 2024-09-21T05:46:38.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.326+0000 7f7d32d9d640 1 --2- 172.21.15.70:0/2215595892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d34109df0 0x7f7d34076190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c00eaa0 tx=0x7f7d2c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:38.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.326+0000 7f7d2bfff640 1 -- 172.21.15.70:0/2215595892 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c00cdb0 con 0x7f7d34109df0 2024-09-21T05:46:38.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.326+0000 7f7d38f40640 1 -- 172.21.15.70:0/2215595892 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d341a8a40 con 0x7f7d34109df0 2024-09-21T05:46:38.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.326+0000 7f7d38f40640 1 -- 172.21.15.70:0/2215595892 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d341a8fa0 con 0x7f7d34109df0 2024-09-21T05:46:38.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.326+0000 7f7d2bfff640 1 -- 172.21.15.70:0/2215595892 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f7d2c005020 con 0x7f7d34109df0 2024-09-21T05:46:38.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.326+0000 7f7d2bfff640 1 -- 172.21.15.70:0/2215595892 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c0116d0 con 0x7f7d34109df0 2024-09-21T05:46:38.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.327+0000 7f7d38f40640 1 -- 172.21.15.70:0/2215595892 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d14005290 con 0x7f7d34109df0 2024-09-21T05:46:38.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.329+0000 7f7d2bfff640 1 -- 172.21.15.70:0/2215595892 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f7d2c004a40 con 0x7f7d34109df0 2024-09-21T05:46:38.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.329+0000 7f7d2bfff640 1 --2- 172.21.15.70:0/2215595892 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7d200b6590 0x7f7d200b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:38.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.330+0000 7f7d3259c640 1 --2- 172.21.15.70:0/2215595892 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7d200b6590 0x7f7d200b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:38.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.330+0000 7f7d2bfff640 1 -- 172.21.15.70:0/2215595892 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f7d2c0e7170 con 0x7f7d34109df0 2024-09-21T05:46:38.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.330+0000 7f7d3259c640 1 --2- 172.21.15.70:0/2215595892 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7d200b6590 0x7f7d200b8aa0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7d24005fd0 tx=0x7f7d24005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:38.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.333+0000 7f7d2bfff640 1 -- 172.21.15.70:0/2215595892 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7d2c016030 con 0x7f7d34109df0 2024-09-21T05:46:38.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:38 smithi070 ceph-mon[30981]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:38.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:38 smithi070 ceph-mon[30981]: mds.? [v2:172.21.15.116:6834/3787256790,v1:172.21.15.116:6835/3787256790] up:boot 2024-09-21T05:46:38.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:38 smithi070 ceph-mon[30981]: fsmap 5 up:standby 2024-09-21T05:46:38.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:38 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T05:46:38.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:38 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:38.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:38 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:38.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:38 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:38.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:38 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:38.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:38 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:38.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:38 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:38.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.553+0000 7f7d38f40640 1 -- 172.21.15.70:0/2215595892 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d14005580 con 0x7f7d34109df0 2024-09-21T05:46:38.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.553+0000 7f7d2bfff640 1 -- 172.21.15.70:0/2215595892 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4741 (secure 0 0 0) 0x7f7d2c0adf20 con 0x7f7d34109df0 2024-09-21T05:46:38.555 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:46:38.556 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":6,"btime":"2024-09-21T05:46:37:392024+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3519318330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3519318330},{"type":"v1","addr":"172.21.15.70:6835","nonce":3519318330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2706663460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2706663460},{"type":"v1","addr":"172.21.15.70:6837","nonce":2706663460}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24568,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3543945704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3543945704},{"type":"v1","addr":"172.21.15.160:6833","nonce":3543945704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/283778129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":283778129},{"type":"v1","addr":"172.21.15.116:6833","nonce":283778129}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24590,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3787256790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3787256790},{"type":"v1","addr":"172.21.15.116:6835","nonce":3787256790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-21T05:46:38.556 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 6 2024-09-21T05:46:38.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.555+0000 7f7d38f40640 1 -- 172.21.15.70:0/2215595892 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7d200b6590 msgr2=0x7f7d200b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:38.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.555+0000 7f7d38f40640 1 --2- 172.21.15.70:0/2215595892 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7d200b6590 0x7f7d200b8aa0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7d24005fd0 tx=0x7f7d24005850 comp rx=0 tx=0).stop 2024-09-21T05:46:38.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.555+0000 7f7d38f40640 1 -- 172.21.15.70:0/2215595892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d34109df0 msgr2=0x7f7d34076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:38.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.555+0000 7f7d38f40640 1 --2- 172.21.15.70:0/2215595892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d34109df0 0x7f7d34076190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c00eaa0 tx=0x7f7d2c00ef60 comp rx=0 tx=0).stop 2024-09-21T05:46:38.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.556+0000 7f7d38f40640 1 -- 172.21.15.70:0/2215595892 shutdown_connections 2024-09-21T05:46:38.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.556+0000 7f7d38f40640 1 --2- 172.21.15.70:0/2215595892 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7d200b6590 0x7f7d200b8aa0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:38.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.556+0000 7f7d38f40640 1 --2- 172.21.15.70:0/2215595892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d34109df0 0x7f7d34076190 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:38.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.556+0000 7f7d38f40640 1 --2- 172.21.15.70:0/2215595892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7d341094a0 0x7f7d34075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:38.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.556+0000 7f7d38f40640 1 --2- 172.21.15.70:0/2215595892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d34103b60 0x7f7d34075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:38.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.556+0000 7f7d38f40640 1 -- 172.21.15.70:0/2215595892 >> 172.21.15.70:0/2215595892 conn(0x7f7d3407b850 msgr2=0x7f7d34107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:38.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.556+0000 7f7d38f40640 1 -- 172.21.15.70:0/2215595892 shutdown_connections 2024-09-21T05:46:38.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:38.556+0000 7f7d38f40640 1 -- 172.21.15.70:0/2215595892 wait complete. 2024-09-21T05:46:38.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:38 smithi160 ceph-mon[33979]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:38.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:38 smithi160 ceph-mon[33979]: mds.? [v2:172.21.15.116:6834/3787256790,v1:172.21.15.116:6835/3787256790] up:boot 2024-09-21T05:46:38.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:38 smithi160 ceph-mon[33979]: fsmap 5 up:standby 2024-09-21T05:46:38.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:38 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T05:46:38.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:38 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:38.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:38 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:38.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:38 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:38.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:38 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:38.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:38 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:38.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:38 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:38.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:38 smithi116 ceph-mon[34332]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:38.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:38 smithi116 ceph-mon[34332]: mds.? [v2:172.21.15.116:6834/3787256790,v1:172.21.15.116:6835/3787256790] up:boot 2024-09-21T05:46:38.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:38 smithi116 ceph-mon[34332]: fsmap 5 up:standby 2024-09-21T05:46:38.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:38 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T05:46:38.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:38 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:38.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:38 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:38.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:38 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:38.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:38 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:38.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:38 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:38.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:38 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:39.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:39 smithi070 ceph-mon[30981]: Deploying daemon mds.f on smithi160 2024-09-21T05:46:39.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:39 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2215595892' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:46:39.562 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:39 smithi160 ceph-mon[33979]: Deploying daemon mds.f on smithi160 2024-09-21T05:46:39.562 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:39 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2215595892' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:46:39.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:39 smithi116 ceph-mon[34332]: Deploying daemon mds.f on smithi160 2024-09-21T05:46:39.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:39 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2215595892' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:46:40.148 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 21 05:46:39 smithi160 systemd[1]: Started Ceph mds.f for 96c6636e-77db-11ef-baf5-efdc52797490. 2024-09-21T05:46:40.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:40 smithi160 ceph-mon[33979]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:40.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:40 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:40.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:40 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:40.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:40 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:40.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:40 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:40.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:40 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:40.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:40 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:40.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:40 smithi070 ceph-mon[30981]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:40.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:40 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:40.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:40 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:40.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:40 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:40.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:40 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:40.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:40 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:40.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:40 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:40.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:40 smithi116 ceph-mon[34332]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:40.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:40 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:40.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:40 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:40.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:40 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:40.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:40 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:40.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:40 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:40.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:40 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:41.235 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:46:41.498 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:46:41.618 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:41 smithi070 ceph-mon[30981]: Deploying daemon mds.c on smithi160 2024-09-21T05:46:41.618 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:41 smithi070 ceph-mon[30981]: mds.? [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] up:boot 2024-09-21T05:46:41.618 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:41 smithi070 ceph-mon[30981]: fsmap 6 up:standby 2024-09-21T05:46:41.618 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:41 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T05:46:41.618 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:41 smithi070 ceph-mon[30981]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:41.771 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:41 smithi160 ceph-mon[33979]: Deploying daemon mds.c on smithi160 2024-09-21T05:46:41.772 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:41 smithi160 ceph-mon[33979]: mds.? [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] up:boot 2024-09-21T05:46:41.772 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:41 smithi160 ceph-mon[33979]: fsmap 6 up:standby 2024-09-21T05:46:41.772 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:41 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T05:46:41.772 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:41 smithi160 ceph-mon[33979]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:41.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:41 smithi116 ceph-mon[34332]: Deploying daemon mds.c on smithi160 2024-09-21T05:46:41.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:41 smithi116 ceph-mon[34332]: mds.? [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] up:boot 2024-09-21T05:46:41.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:41 smithi116 ceph-mon[34332]: fsmap 6 up:standby 2024-09-21T05:46:41.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:41 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T05:46:41.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:41 smithi116 ceph-mon[34332]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:41.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.974+0000 7f2a50213640 1 -- 172.21.15.70:0/841773578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a481083d0 msgr2=0x7f2a481087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:41.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.974+0000 7f2a50213640 1 --2- 172.21.15.70:0/841773578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a481083d0 0x7f2a481087e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c009900 tx=0x7f2a3c02a410 comp rx=0 tx=0).stop 2024-09-21T05:46:41.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.974+0000 7f2a50213640 1 -- 172.21.15.70:0/841773578 shutdown_connections 2024-09-21T05:46:41.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.974+0000 7f2a50213640 1 --2- 172.21.15.70:0/841773578 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a48108d20 0x7f2a4810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:41.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.974+0000 7f2a50213640 1 --2- 172.21.15.70:0/841773578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a481083d0 0x7f2a481087e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:41.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.974+0000 7f2a50213640 1 --2- 172.21.15.70:0/841773578 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a48102ae0 0x7f2a48102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:41.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.974+0000 7f2a50213640 1 -- 172.21.15.70:0/841773578 >> 172.21.15.70:0/841773578 conn(0x7f2a48079790 msgr2=0x7f2a48079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:41.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.974+0000 7f2a50213640 1 -- 172.21.15.70:0/841773578 shutdown_connections 2024-09-21T05:46:41.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.974+0000 7f2a50213640 1 -- 172.21.15.70:0/841773578 wait complete. 2024-09-21T05:46:41.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.975+0000 7f2a50213640 1 Processor -- start 2024-09-21T05:46:41.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.975+0000 7f2a50213640 1 -- start start 2024-09-21T05:46:41.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.975+0000 7f2a50213640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a48102ae0 0x7f2a4819a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:41.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.975+0000 7f2a50213640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a481083d0 0x7f2a4819aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:41.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.975+0000 7f2a50213640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a48108d20 0x7f2a4819fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:41.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.975+0000 7f2a50213640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2a481129b0 con 0x7f2a481083d0 2024-09-21T05:46:41.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.975+0000 7f2a50213640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2a48112830 con 0x7f2a48108d20 2024-09-21T05:46:41.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.975+0000 7f2a50213640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2a48112b30 con 0x7f2a48102ae0 2024-09-21T05:46:41.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.975+0000 7f2a4d7ae640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a481083d0 0x7f2a4819aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:41.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.975+0000 7f2a4d7ae640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a481083d0 0x7f2a4819aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41712/0 (socket says 172.21.15.70:41712) 2024-09-21T05:46:41.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.975+0000 7f2a4d7ae640 1 -- 172.21.15.70:0/89080679 learned_addr learned my addr 172.21.15.70:0/89080679 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:46:41.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.975+0000 7f2a4dfaf640 1 --2- 172.21.15.70:0/89080679 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a48102ae0 0x7f2a4819a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:41.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.975+0000 7f2a4d7ae640 1 -- 172.21.15.70:0/89080679 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a48102ae0 msgr2=0x7f2a4819a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:41.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.975+0000 7f2a4d7ae640 1 --2- 172.21.15.70:0/89080679 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a48102ae0 0x7f2a4819a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:41.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.975+0000 7f2a4d7ae640 1 -- 172.21.15.70:0/89080679 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a48108d20 msgr2=0x7f2a4819fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:41.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.975+0000 7f2a4e7b0640 1 --2- 172.21.15.70:0/89080679 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a48108d20 0x7f2a4819fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:41.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.975+0000 7f2a4d7ae640 1 --2- 172.21.15.70:0/89080679 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a48108d20 0x7f2a4819fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:41.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.975+0000 7f2a4d7ae640 1 -- 172.21.15.70:0/89080679 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a481a04a0 con 0x7f2a481083d0 2024-09-21T05:46:41.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.976+0000 7f2a4d7ae640 1 --2- 172.21.15.70:0/89080679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a481083d0 0x7f2a4819aad0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c006010 tx=0x7f2a3c0319c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:41.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.976+0000 7f2a46ffd640 1 -- 172.21.15.70:0/89080679 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c03f030 con 0x7f2a481083d0 2024-09-21T05:46:41.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.976+0000 7f2a46ffd640 1 -- 172.21.15.70:0/89080679 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f2a3c004490 con 0x7f2a481083d0 2024-09-21T05:46:41.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.976+0000 7f2a50213640 1 -- 172.21.15.70:0/89080679 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a481a0730 con 0x7f2a481083d0 2024-09-21T05:46:41.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.976+0000 7f2a46ffd640 1 -- 172.21.15.70:0/89080679 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c035070 con 0x7f2a481083d0 2024-09-21T05:46:41.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.976+0000 7f2a50213640 1 -- 172.21.15.70:0/89080679 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a481a6ef0 con 0x7f2a481083d0 2024-09-21T05:46:41.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.977+0000 7f2a50213640 1 -- 172.21.15.70:0/89080679 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a48102ef0 con 0x7f2a481083d0 2024-09-21T05:46:41.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.978+0000 7f2a46ffd640 1 -- 172.21.15.70:0/89080679 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f2a3c042030 con 0x7f2a481083d0 2024-09-21T05:46:41.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.979+0000 7f2a46ffd640 1 --2- 172.21.15.70:0/89080679 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f2a300b6590 0x7f2a300b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:41.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.979+0000 7f2a4dfaf640 1 --2- 172.21.15.70:0/89080679 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f2a300b6590 0x7f2a300b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:41.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.980+0000 7f2a46ffd640 1 -- 172.21.15.70:0/89080679 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f2a3c107280 con 0x7f2a481083d0 2024-09-21T05:46:41.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.980+0000 7f2a4dfaf640 1 --2- 172.21.15.70:0/89080679 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f2a300b6590 0x7f2a300b8aa0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2a38005fd0 tx=0x7f2a38009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:41.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:41.984+0000 7f2a46ffd640 1 -- 172.21.15.70:0/89080679 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2a3c0cdfb0 con 0x7f2a481083d0 2024-09-21T05:46:42.149 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 21 05:46:41 smithi160 systemd[1]: Starting Ceph mds.c for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:46:42.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:42.195+0000 7f2a50213640 1 -- 172.21.15.70:0/89080679 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a4810bb30 con 0x7f2a481083d0 2024-09-21T05:46:42.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:42.196+0000 7f2a46ffd640 1 -- 172.21.15.70:0/89080679 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5569 (secure 0 0 0) 0x7f2a3c0d2390 con 0x7f2a481083d0 2024-09-21T05:46:42.198 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:46:42.198 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":7,"btime":"2024-09-21T05:46:40:400859+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3519318330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3519318330},{"type":"v1","addr":"172.21.15.70:6835","nonce":3519318330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2706663460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2706663460},{"type":"v1","addr":"172.21.15.70:6837","nonce":2706663460}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24568,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3543945704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3543945704},{"type":"v1","addr":"172.21.15.160:6833","nonce":3543945704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/283778129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":283778129},{"type":"v1","addr":"172.21.15.116:6833","nonce":283778129}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24590,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3787256790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3787256790},{"type":"v1","addr":"172.21.15.116:6835","nonce":3787256790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24598,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2001692372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2001692372},{"type":"v1","addr":"172.21.15.160:6835","nonce":2001692372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-21T05:46:42.199 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 7 2024-09-21T05:46:42.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:42.199+0000 7f2a50213640 1 -- 172.21.15.70:0/89080679 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f2a300b6590 msgr2=0x7f2a300b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:42.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:42.199+0000 7f2a50213640 1 --2- 172.21.15.70:0/89080679 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f2a300b6590 0x7f2a300b8aa0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2a38005fd0 tx=0x7f2a38009500 comp rx=0 tx=0).stop 2024-09-21T05:46:42.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:42.199+0000 7f2a50213640 1 -- 172.21.15.70:0/89080679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a481083d0 msgr2=0x7f2a4819aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:42.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:42.199+0000 7f2a50213640 1 --2- 172.21.15.70:0/89080679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a481083d0 0x7f2a4819aad0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c006010 tx=0x7f2a3c0319c0 comp rx=0 tx=0).stop 2024-09-21T05:46:42.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:42.199+0000 7f2a50213640 1 -- 172.21.15.70:0/89080679 shutdown_connections 2024-09-21T05:46:42.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:42.199+0000 7f2a50213640 1 --2- 172.21.15.70:0/89080679 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f2a300b6590 0x7f2a300b8aa0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:42.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:42.199+0000 7f2a50213640 1 --2- 172.21.15.70:0/89080679 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a48108d20 0x7f2a4819fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:42.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:42.199+0000 7f2a50213640 1 --2- 172.21.15.70:0/89080679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a481083d0 0x7f2a4819aad0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:42.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:42.199+0000 7f2a50213640 1 --2- 172.21.15.70:0/89080679 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a48102ae0 0x7f2a4819a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:42.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:42.199+0000 7f2a50213640 1 -- 172.21.15.70:0/89080679 >> 172.21.15.70:0/89080679 conn(0x7f2a48079790 msgr2=0x7f2a48101ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:42.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:42.199+0000 7f2a50213640 1 -- 172.21.15.70:0/89080679 shutdown_connections 2024-09-21T05:46:42.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:42.199+0000 7f2a50213640 1 -- 172.21.15.70:0/89080679 wait complete. 2024-09-21T05:46:42.418 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 21 05:46:42 smithi160 podman[62354]: 2024-09-21 05:46:42.06197676 +0000 UTC m=+0.016379737 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:46:42.418 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 21 05:46:42 smithi160 podman[62354]: 2024-09-21 05:46:42.180085255 +0000 UTC m=+0.134488267 container create 25de6995acab2550442c802609249206b0d35c3a268c588c504b2bbe05d4f56e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-c, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-21T05:46:42.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:42 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/89080679' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:46:42.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:42 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/89080679' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:46:42.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:42 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/89080679' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:46:42.899 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 21 05:46:42 smithi160 podman[62354]: 2024-09-21 05:46:42.441061537 +0000 UTC m=+0.395464506 container init 25de6995acab2550442c802609249206b0d35c3a268c588c504b2bbe05d4f56e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-c, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T05:46:42.899 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 21 05:46:42 smithi160 podman[62354]: 2024-09-21 05:46:42.44417062 +0000 UTC m=+0.398573596 container start 25de6995acab2550442c802609249206b0d35c3a268c588c504b2bbe05d4f56e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T05:46:42.899 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 21 05:46:42 smithi160 ceph-mds[62373]: -- 172.21.15.160:0/327708803 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560594f5b860 con 0x560599103600 2024-09-21T05:46:42.899 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 21 05:46:42 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-c[62369]: starting mds.c at 2024-09-21T05:46:42.899 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 21 05:46:42 smithi160 bash[62354]: 25de6995acab2550442c802609249206b0d35c3a268c588c504b2bbe05d4f56e 2024-09-21T05:46:42.899 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 21 05:46:42 smithi160 systemd[1]: Started Ceph mds.c for 96c6636e-77db-11ef-baf5-efdc52797490. 2024-09-21T05:46:43.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:43 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:43.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:43 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:43.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:43 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:43.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:43 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:43.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:43 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:43.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:43 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:43.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:43 smithi160 ceph-mon[33979]: Deploying daemon mds.h on smithi116 2024-09-21T05:46:43.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:43 smithi160 ceph-mon[33979]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:43.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:43 smithi160 ceph-mon[33979]: mds.? [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] up:boot 2024-09-21T05:46:43.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:43 smithi160 ceph-mon[33979]: fsmap 7 up:standby 2024-09-21T05:46:43.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:43 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T05:46:43.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:43 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:43.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:43 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:43.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:43 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:43.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:43 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:43.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:43 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:43.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:43 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:43.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:43 smithi070 ceph-mon[30981]: Deploying daemon mds.h on smithi116 2024-09-21T05:46:43.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:43 smithi070 ceph-mon[30981]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:43.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:43 smithi070 ceph-mon[30981]: mds.? [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] up:boot 2024-09-21T05:46:43.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:43 smithi070 ceph-mon[30981]: fsmap 7 up:standby 2024-09-21T05:46:43.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:43 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T05:46:44.021 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:43 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:44.021 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:43 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:44.021 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:43 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:44.021 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:43 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:44.021 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:43 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:44.021 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:43 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:44.021 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:43 smithi116 ceph-mon[34332]: Deploying daemon mds.h on smithi116 2024-09-21T05:46:44.022 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:43 smithi116 ceph-mon[34332]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:44.022 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:43 smithi116 ceph-mon[34332]: mds.? [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] up:boot 2024-09-21T05:46:44.022 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:43 smithi116 ceph-mon[34332]: fsmap 7 up:standby 2024-09-21T05:46:44.022 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:43 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T05:46:44.793 INFO:journalctl@ceph.mds.h.smithi116.stdout:Sep 21 05:46:44 smithi116 systemd[1]: Starting Ceph mds.h for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:46:45.054 INFO:journalctl@ceph.mds.h.smithi116.stdout:Sep 21 05:46:44 smithi116 podman[61878]: 2024-09-21 05:46:44.693528531 +0000 UTC m=+0.015627619 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:46:45.054 INFO:journalctl@ceph.mds.h.smithi116.stdout:Sep 21 05:46:44 smithi116 podman[61878]: 2024-09-21 05:46:44.810765334 +0000 UTC m=+0.132864457 container create 3a5bcda9a7b1dbb0fb15793d0b8be73109a8ceb28c695f9672d6247658d55835 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-h, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T05:46:45.072 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:46:45.332 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:46:45.554 INFO:journalctl@ceph.mds.h.smithi116.stdout:Sep 21 05:46:45 smithi116 podman[61878]: 2024-09-21 05:46:45.072022559 +0000 UTC m=+0.394121645 container init 3a5bcda9a7b1dbb0fb15793d0b8be73109a8ceb28c695f9672d6247658d55835 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-h, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-21T05:46:45.554 INFO:journalctl@ceph.mds.h.smithi116.stdout:Sep 21 05:46:45 smithi116 podman[61878]: 2024-09-21 05:46:45.074808526 +0000 UTC m=+0.396907603 container start 3a5bcda9a7b1dbb0fb15793d0b8be73109a8ceb28c695f9672d6247658d55835 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-h, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-21T05:46:45.554 INFO:journalctl@ceph.mds.h.smithi116.stdout:Sep 21 05:46:45 smithi116 ceph-mds[61897]: -- 172.21.15.116:0/3552437899 <== mon.2 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55812c8a3860 con 0x558130a4b600 2024-09-21T05:46:45.555 INFO:journalctl@ceph.mds.h.smithi116.stdout:Sep 21 05:46:45 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-h[61893]: starting mds.h at 2024-09-21T05:46:45.555 INFO:journalctl@ceph.mds.h.smithi116.stdout:Sep 21 05:46:45 smithi116 bash[61878]: 3a5bcda9a7b1dbb0fb15793d0b8be73109a8ceb28c695f9672d6247658d55835 2024-09-21T05:46:45.555 INFO:journalctl@ceph.mds.h.smithi116.stdout:Sep 21 05:46:45 smithi116 systemd[1]: Started Ceph mds.h for 96c6636e-77db-11ef-baf5-efdc52797490. 2024-09-21T05:46:45.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.828+0000 7fdc0a6cb640 1 -- 172.21.15.70:0/3645519184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc04102a70 msgr2=0x7fdc04102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:45.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.828+0000 7fdc0a6cb640 1 --2- 172.21.15.70:0/3645519184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc04102a70 0x7fdc04102e80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4009900 tx=0x7fdbf402a410 comp rx=0 tx=0).stop 2024-09-21T05:46:45.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.828+0000 7fdc0a6cb640 1 -- 172.21.15.70:0/3645519184 shutdown_connections 2024-09-21T05:46:45.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.828+0000 7fdc0a6cb640 1 --2- 172.21.15.70:0/3645519184 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc04108d00 0x7fdc0410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:45.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.828+0000 7fdc0a6cb640 1 --2- 172.21.15.70:0/3645519184 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc041083b0 0x7fdc041087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:45.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.828+0000 7fdc0a6cb640 1 --2- 172.21.15.70:0/3645519184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc04102a70 0x7fdc04102e80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:45.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.828+0000 7fdc0a6cb640 1 -- 172.21.15.70:0/3645519184 >> 172.21.15.70:0/3645519184 conn(0x7fdc04079730 msgr2=0x7fdc04079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:45.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.828+0000 7fdc0a6cb640 1 -- 172.21.15.70:0/3645519184 shutdown_connections 2024-09-21T05:46:45.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.828+0000 7fdc0a6cb640 1 -- 172.21.15.70:0/3645519184 wait complete. 2024-09-21T05:46:45.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.829+0000 7fdc0a6cb640 1 Processor -- start 2024-09-21T05:46:45.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.829+0000 7fdc0a6cb640 1 -- start start 2024-09-21T05:46:45.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.829+0000 7fdc0a6cb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc04102a70 0x7fdc04199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:45.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.829+0000 7fdc0a6cb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc041083b0 0x7fdc041998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:45.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.829+0000 7fdc0a6cb640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc04108d00 0x7fdc0419eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:45.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.829+0000 7fdc0a6cb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdc04112940 con 0x7fdc041083b0 2024-09-21T05:46:45.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.829+0000 7fdc0a6cb640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fdc041127c0 con 0x7fdc04102a70 2024-09-21T05:46:45.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.829+0000 7fdc0a6cb640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fdc04112ac0 con 0x7fdc04108d00 2024-09-21T05:46:45.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.829+0000 7fdc037fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc041083b0 0x7fdc041998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:45.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.829+0000 7fdc037fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc041083b0 0x7fdc041998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41736/0 (socket says 172.21.15.70:41736) 2024-09-21T05:46:45.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.829+0000 7fdc037fe640 1 -- 172.21.15.70:0/1180368782 learned_addr learned my addr 172.21.15.70:0/1180368782 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:46:45.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.830+0000 7fdc08c68640 1 --2- 172.21.15.70:0/1180368782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc04108d00 0x7fdc0419eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:45.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.830+0000 7fdc03fff640 1 --2- 172.21.15.70:0/1180368782 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc04102a70 0x7fdc04199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:45.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.830+0000 7fdc037fe640 1 -- 172.21.15.70:0/1180368782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc04108d00 msgr2=0x7fdc0419eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:45.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.830+0000 7fdc037fe640 1 --2- 172.21.15.70:0/1180368782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc04108d00 0x7fdc0419eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:45.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.830+0000 7fdc037fe640 1 -- 172.21.15.70:0/1180368782 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc04102a70 msgr2=0x7fdc04199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:45.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.830+0000 7fdc037fe640 1 --2- 172.21.15.70:0/1180368782 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc04102a70 0x7fdc04199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:45.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.830+0000 7fdc037fe640 1 -- 172.21.15.70:0/1180368782 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc0419f280 con 0x7fdc041083b0 2024-09-21T05:46:45.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.830+0000 7fdc08c68640 1 --2- 172.21.15.70:0/1180368782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc04108d00 0x7fdc0419eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:46:45.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.830+0000 7fdc037fe640 1 --2- 172.21.15.70:0/1180368782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc041083b0 0x7fdc041998b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800c970 tx=0x7fdbf800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:45.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.830+0000 7fdc017fa640 1 -- 172.21.15.70:0/1180368782 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8007bb0 con 0x7fdc041083b0 2024-09-21T05:46:45.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.830+0000 7fdc0a6cb640 1 -- 172.21.15.70:0/1180368782 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc0419f570 con 0x7fdc041083b0 2024-09-21T05:46:45.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.830+0000 7fdc017fa640 1 -- 172.21.15.70:0/1180368782 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fdbf8007d50 con 0x7fdc041083b0 2024-09-21T05:46:45.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.830+0000 7fdc017fa640 1 -- 172.21.15.70:0/1180368782 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf800f450 con 0x7fdc041083b0 2024-09-21T05:46:45.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.830+0000 7fdc0a6cb640 1 -- 172.21.15.70:0/1180368782 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc041a5cd0 con 0x7fdc041083b0 2024-09-21T05:46:45.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.832+0000 7fdc0a6cb640 1 -- 172.21.15.70:0/1180368782 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc04103cf0 con 0x7fdc041083b0 2024-09-21T05:46:45.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.833+0000 7fdc017fa640 1 -- 172.21.15.70:0/1180368782 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fdbf8005020 con 0x7fdc041083b0 2024-09-21T05:46:45.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.833+0000 7fdc017fa640 1 --2- 172.21.15.70:0/1180368782 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdbec0b6590 0x7fdbec0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:45.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.834+0000 7fdc03fff640 1 --2- 172.21.15.70:0/1180368782 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdbec0b6590 0x7fdbec0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:45.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.834+0000 7fdc017fa640 1 -- 172.21.15.70:0/1180368782 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7fdbf80e6d30 con 0x7fdc041083b0 2024-09-21T05:46:45.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.834+0000 7fdc03fff640 1 --2- 172.21.15.70:0/1180368782 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdbec0b6590 0x7fdbec0b8aa0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4005d90 tx=0x7fdbf4005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:45.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:45.838+0000 7fdc017fa640 1 -- 172.21.15.70:0/1180368782 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdbf8014030 con 0x7fdc041083b0 2024-09-21T05:46:46.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:46.060+0000 7fdc0a6cb640 1 -- 172.21.15.70:0/1180368782 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc0419a440 con 0x7fdc041083b0 2024-09-21T05:46:46.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:46.061+0000 7fdc017fa640 1 -- 172.21.15.70:0/1180368782 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7222 (secure 0 0 0) 0x7fdbf80b1e40 con 0x7fdc041083b0 2024-09-21T05:46:46.063 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:46:46.063 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":9,"btime":"2024-09-21T05:46:45:163388+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3519318330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3519318330},{"type":"v1","addr":"172.21.15.70:6835","nonce":3519318330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2706663460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2706663460},{"type":"v1","addr":"172.21.15.70:6837","nonce":2706663460}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24568,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3543945704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3543945704},{"type":"v1","addr":"172.21.15.160:6833","nonce":3543945704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/283778129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":283778129},{"type":"v1","addr":"172.21.15.116:6833","nonce":283778129}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24590,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3787256790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3787256790},{"type":"v1","addr":"172.21.15.116:6835","nonce":3787256790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24598,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2001692372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2001692372},{"type":"v1","addr":"172.21.15.160:6835","nonce":2001692372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24610,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/2558120045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2558120045},{"type":"v1","addr":"172.21.15.160:6837","nonce":2558120045}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24611,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/444312934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":444312934},{"type":"v1","addr":"172.21.15.116:6837","nonce":444312934}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-21T05:46:46.063 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 9 2024-09-21T05:46:46.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:46.064+0000 7fdc0a6cb640 1 -- 172.21.15.70:0/1180368782 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdbec0b6590 msgr2=0x7fdbec0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:46.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:46.064+0000 7fdc0a6cb640 1 --2- 172.21.15.70:0/1180368782 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdbec0b6590 0x7fdbec0b8aa0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4005d90 tx=0x7fdbf4005e50 comp rx=0 tx=0).stop 2024-09-21T05:46:46.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:46.064+0000 7fdc0a6cb640 1 -- 172.21.15.70:0/1180368782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc041083b0 msgr2=0x7fdc041998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:46.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:46.064+0000 7fdc0a6cb640 1 --2- 172.21.15.70:0/1180368782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc041083b0 0x7fdc041998b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800c970 tx=0x7fdbf800ce30 comp rx=0 tx=0).stop 2024-09-21T05:46:46.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:46.065+0000 7fdc0a6cb640 1 -- 172.21.15.70:0/1180368782 shutdown_connections 2024-09-21T05:46:46.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:46.065+0000 7fdc0a6cb640 1 --2- 172.21.15.70:0/1180368782 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdbec0b6590 0x7fdbec0b8aa0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:46.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:46.065+0000 7fdc0a6cb640 1 --2- 172.21.15.70:0/1180368782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc04108d00 0x7fdc0419eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:46.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:46.065+0000 7fdc0a6cb640 1 --2- 172.21.15.70:0/1180368782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc041083b0 0x7fdc041998b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:46.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:46.065+0000 7fdc0a6cb640 1 --2- 172.21.15.70:0/1180368782 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc04102a70 0x7fdc04199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:46.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:46.065+0000 7fdc0a6cb640 1 -- 172.21.15.70:0/1180368782 >> 172.21.15.70:0/1180368782 conn(0x7fdc04079730 msgr2=0x7fdc041014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:46.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:46.065+0000 7fdc0a6cb640 1 -- 172.21.15.70:0/1180368782 shutdown_connections 2024-09-21T05:46:46.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:46.065+0000 7fdc0a6cb640 1 -- 172.21.15.70:0/1180368782 wait complete. 2024-09-21T05:46:46.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:46 smithi160 ceph-mon[33979]: mds.? [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] up:boot 2024-09-21T05:46:46.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:46 smithi160 ceph-mon[33979]: fsmap 8 up:standby 2024-09-21T05:46:46.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:46 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T05:46:46.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:46 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:46.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:46 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:46.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:46 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:46.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:46 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:46.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:46 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:46.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:46 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:46.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:46 smithi160 ceph-mon[33979]: Deploying daemon mds.i on smithi160 2024-09-21T05:46:46.400 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:46 smithi160 ceph-mon[33979]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:46.400 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:46 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1180368782' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:46:46.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:46 smithi070 ceph-mon[30981]: mds.? [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] up:boot 2024-09-21T05:46:46.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:46 smithi070 ceph-mon[30981]: fsmap 8 up:standby 2024-09-21T05:46:46.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:46 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T05:46:46.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:46 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:46.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:46 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:46.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:46 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:46.489 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:46 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:46.489 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:46 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:46.489 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:46 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:46.489 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:46 smithi070 ceph-mon[30981]: Deploying daemon mds.i on smithi160 2024-09-21T05:46:46.489 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:46 smithi070 ceph-mon[30981]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:46.489 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:46 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1180368782' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:46:46.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:46 smithi116 ceph-mon[34332]: mds.? [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] up:boot 2024-09-21T05:46:46.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:46 smithi116 ceph-mon[34332]: fsmap 8 up:standby 2024-09-21T05:46:46.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:46 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T05:46:46.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:46 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:46.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:46 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:46.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:46 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:46.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:46 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:46.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:46 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:46.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:46 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:46.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:46 smithi116 ceph-mon[34332]: Deploying daemon mds.i on smithi160 2024-09-21T05:46:46.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:46 smithi116 ceph-mon[34332]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:46.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:46 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1180368782' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:46:47.311 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 05:46:47 smithi160 systemd[1]: Starting Ceph mds.i for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:46:47.623 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:47 smithi160 ceph-mon[33979]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:47.623 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 05:46:47 smithi160 podman[62625]: 2024-09-21 05:46:47.212113812 +0000 UTC m=+0.015941909 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:46:47.623 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 05:46:47 smithi160 podman[62625]: 2024-09-21 05:46:47.335242511 +0000 UTC m=+0.139070601 container create 08c3ec97d5723a8d1bc3480d3df1a59bec54c32248ffbb3a4dcafad15c29b6d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-i, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T05:46:47.623 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 05:46:47 smithi160 podman[62625]: 2024-09-21 05:46:47.62155613 +0000 UTC m=+0.425384227 container init 08c3ec97d5723a8d1bc3480d3df1a59bec54c32248ffbb3a4dcafad15c29b6d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-i, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T05:46:47.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:47 smithi070 ceph-mon[30981]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:47.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:47 smithi116 ceph-mon[34332]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:47.898 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 05:46:47 smithi160 podman[62625]: 2024-09-21 05:46:47.624491593 +0000 UTC m=+0.428319683 container start 08c3ec97d5723a8d1bc3480d3df1a59bec54c32248ffbb3a4dcafad15c29b6d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-i, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T05:46:47.899 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 05:46:47 smithi160 ceph-mds[62644]: -- 172.21.15.160:0/654794331 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5573d7c1dc20 con 0x5573dbdc5a80 2024-09-21T05:46:47.899 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 05:46:47 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-i[62640]: starting mds.i at 2024-09-21T05:46:47.899 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 05:46:47 smithi160 bash[62625]: 08c3ec97d5723a8d1bc3480d3df1a59bec54c32248ffbb3a4dcafad15c29b6d3 2024-09-21T05:46:47.899 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 05:46:47 smithi160 systemd[1]: Started Ceph mds.i for 96c6636e-77db-11ef-baf5-efdc52797490. 2024-09-21T05:46:48.730 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:46:49.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:48 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:49.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:48 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:49.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:48 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:49.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:48 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:49.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:48 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:49.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:48 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:49.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:48 smithi116 ceph-mon[34332]: Deploying daemon mds.g on smithi070 2024-09-21T05:46:49.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:48 smithi116 ceph-mon[34332]: mds.? [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] up:boot 2024-09-21T05:46:49.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:48 smithi116 ceph-mon[34332]: fsmap 9 up:standby 2024-09-21T05:46:49.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:48 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T05:46:49.126 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:48 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:49.126 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:48 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:49.126 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:48 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:49.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:48 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:49.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:48 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:49.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:48 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:49.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:48 smithi070 ceph-mon[30981]: Deploying daemon mds.g on smithi070 2024-09-21T05:46:49.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:48 smithi070 ceph-mon[30981]: mds.? [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] up:boot 2024-09-21T05:46:49.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:48 smithi070 ceph-mon[30981]: fsmap 9 up:standby 2024-09-21T05:46:49.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:48 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T05:46:49.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:48 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:49.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:48 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:49.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:48 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:49.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:48 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:49.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:48 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:49.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:48 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:49.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:48 smithi160 ceph-mon[33979]: Deploying daemon mds.g on smithi070 2024-09-21T05:46:49.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:48 smithi160 ceph-mon[33979]: mds.? [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] up:boot 2024-09-21T05:46:49.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:48 smithi160 ceph-mon[33979]: fsmap 9 up:standby 2024-09-21T05:46:49.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:48 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T05:46:49.206 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:46:49.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.833+0000 7fefae4e1640 1 -- 172.21.15.70:0/1607831939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefa8109e10 msgr2=0x7fefa8110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:49.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.833+0000 7fefae4e1640 1 --2- 172.21.15.70:0/1607831939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefa8109e10 0x7fefa8110640 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fefa0009ca0 tx=0x7fefa002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:46:49.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.833+0000 7fefae4e1640 1 -- 172.21.15.70:0/1607831939 shutdown_connections 2024-09-21T05:46:49.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.833+0000 7fefae4e1640 1 --2- 172.21.15.70:0/1607831939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefa8109e10 0x7fefa8110640 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:49.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.833+0000 7fefae4e1640 1 --2- 172.21.15.70:0/1607831939 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fefa81094c0 0x7fefa81098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:49.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.833+0000 7fefae4e1640 1 --2- 172.21.15.70:0/1607831939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fefa8103b80 0x7fefa8103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:49.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.833+0000 7fefae4e1640 1 -- 172.21.15.70:0/1607831939 >> 172.21.15.70:0/1607831939 conn(0x7fefa80ff5d0 msgr2=0x7fefa8101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:49.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.833+0000 7fefae4e1640 1 -- 172.21.15.70:0/1607831939 shutdown_connections 2024-09-21T05:46:49.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.833+0000 7fefae4e1640 1 -- 172.21.15.70:0/1607831939 wait complete. 2024-09-21T05:46:49.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.833+0000 7fefae4e1640 1 Processor -- start 2024-09-21T05:46:49.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.833+0000 7fefae4e1640 1 -- start start 2024-09-21T05:46:49.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.834+0000 7fefae4e1640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fefa8103b80 0x7fefa819a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:49.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.834+0000 7fefae4e1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefa81094c0 0x7fefa819a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:49.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.834+0000 7fefae4e1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fefa8109e10 0x7fefa819fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:49.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.834+0000 7fefae4e1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fefa8113aa0 con 0x7fefa81094c0 2024-09-21T05:46:49.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.834+0000 7fefae4e1640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fefa8113920 con 0x7fefa8109e10 2024-09-21T05:46:49.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.834+0000 7fefae4e1640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fefa8113c20 con 0x7fefa8103b80 2024-09-21T05:46:49.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.834+0000 7fefa77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefa81094c0 0x7fefa819a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:49.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.834+0000 7fefa77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefa81094c0 0x7fefa819a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41754/0 (socket says 172.21.15.70:41754) 2024-09-21T05:46:49.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.834+0000 7fefa77fe640 1 -- 172.21.15.70:0/2126346601 learned_addr learned my addr 172.21.15.70:0/2126346601 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:46:49.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.834+0000 7fefa7fff640 1 --2- 172.21.15.70:0/2126346601 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fefa8103b80 0x7fefa819a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:49.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.834+0000 7fefaca7e640 1 --2- 172.21.15.70:0/2126346601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fefa8109e10 0x7fefa819fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:49.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.834+0000 7fefa77fe640 1 -- 172.21.15.70:0/2126346601 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fefa8103b80 msgr2=0x7fefa819a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:49.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.834+0000 7fefa77fe640 1 --2- 172.21.15.70:0/2126346601 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fefa8103b80 0x7fefa819a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:49.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.834+0000 7fefa77fe640 1 -- 172.21.15.70:0/2126346601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fefa8109e10 msgr2=0x7fefa819fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:49.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.834+0000 7fefa77fe640 1 --2- 172.21.15.70:0/2126346601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fefa8109e10 0x7fefa819fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:49.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.834+0000 7fefa77fe640 1 -- 172.21.15.70:0/2126346601 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa81a0300 con 0x7fefa81094c0 2024-09-21T05:46:49.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.834+0000 7fefa7fff640 1 --2- 172.21.15.70:0/2126346601 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fefa8103b80 0x7fefa819a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:46:49.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.834+0000 7fefaca7e640 1 --2- 172.21.15.70:0/2126346601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fefa8109e10 0x7fefa819fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:46:49.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.835+0000 7fefa77fe640 1 --2- 172.21.15.70:0/2126346601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefa81094c0 0x7fefa819a9f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fef9c00d740 tx=0x7fef9c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:49.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.835+0000 7fefa57fa640 1 -- 172.21.15.70:0/2126346601 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9c017070 con 0x7fefa81094c0 2024-09-21T05:46:49.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.835+0000 7fefae4e1640 1 -- 172.21.15.70:0/2126346601 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefa81a05f0 con 0x7fefa81094c0 2024-09-21T05:46:49.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.835+0000 7fefa57fa640 1 -- 172.21.15.70:0/2126346601 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fef9c00de50 con 0x7fefa81094c0 2024-09-21T05:46:49.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.835+0000 7fefa57fa640 1 -- 172.21.15.70:0/2126346601 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9c00f620 con 0x7fefa81094c0 2024-09-21T05:46:49.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.835+0000 7fefae4e1640 1 -- 172.21.15.70:0/2126346601 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefa81a6e10 con 0x7fefa81094c0 2024-09-21T05:46:49.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.836+0000 7fefae4e1640 1 -- 172.21.15.70:0/2126346601 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefa8103f90 con 0x7fefa81094c0 2024-09-21T05:46:49.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.838+0000 7fefa57fa640 1 -- 172.21.15.70:0/2126346601 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fef9c01a070 con 0x7fefa81094c0 2024-09-21T05:46:49.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.838+0000 7fefa57fa640 1 --2- 172.21.15.70:0/2126346601 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fef900b6540 0x7fef900b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:49.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.838+0000 7fefa7fff640 1 --2- 172.21.15.70:0/2126346601 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fef900b6540 0x7fef900b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:49.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.838+0000 7fefa57fa640 1 -- 172.21.15.70:0/2126346601 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7fef9c0e6850 con 0x7fefa81094c0 2024-09-21T05:46:49.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.839+0000 7fefa7fff640 1 --2- 172.21.15.70:0/2126346601 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fef900b6540 0x7fef900b8a50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fef9800baa0 tx=0x7fef98005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:49.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:49.842+0000 7fefa57fa640 1 -- 172.21.15.70:0/2126346601 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fef9c0ad580 con 0x7fefa81094c0 2024-09-21T05:46:49.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:49 smithi070 ceph-mon[30981]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:50.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:49 smithi116 ceph-mon[34332]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:50.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:50.079+0000 7fefae4e1640 1 -- 172.21.15.70:0/2126346601 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fefa819b580 con 0x7fefa81094c0 2024-09-21T05:46:50.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:50.080+0000 7fefa57fa640 1 -- 172.21.15.70:0/2126346601 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8052 (secure 0 0 0) 0x7fef9c0b0f90 con 0x7fefa81094c0 2024-09-21T05:46:50.082 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:46:50.082 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":10,"btime":"2024-09-21T05:46:48:458478+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3519318330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3519318330},{"type":"v1","addr":"172.21.15.70:6835","nonce":3519318330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2706663460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2706663460},{"type":"v1","addr":"172.21.15.70:6837","nonce":2706663460}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24568,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3543945704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3543945704},{"type":"v1","addr":"172.21.15.160:6833","nonce":3543945704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/283778129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":283778129},{"type":"v1","addr":"172.21.15.116:6833","nonce":283778129}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24590,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3787256790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3787256790},{"type":"v1","addr":"172.21.15.116:6835","nonce":3787256790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24598,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2001692372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2001692372},{"type":"v1","addr":"172.21.15.160:6835","nonce":2001692372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24610,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/2558120045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2558120045},{"type":"v1","addr":"172.21.15.160:6837","nonce":2558120045}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24611,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/444312934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":444312934},{"type":"v1","addr":"172.21.15.116:6837","nonce":444312934}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24628,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6839/1339744282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1339744282},{"type":"v1","addr":"172.21.15.160:6839","nonce":1339744282}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T05:46:50.082 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 10 2024-09-21T05:46:50.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:50.082+0000 7fefae4e1640 1 -- 172.21.15.70:0/2126346601 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fef900b6540 msgr2=0x7fef900b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:50.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:50.082+0000 7fefae4e1640 1 --2- 172.21.15.70:0/2126346601 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fef900b6540 0x7fef900b8a50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fef9800baa0 tx=0x7fef98005d90 comp rx=0 tx=0).stop 2024-09-21T05:46:50.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:50.082+0000 7fefae4e1640 1 -- 172.21.15.70:0/2126346601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefa81094c0 msgr2=0x7fefa819a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:50.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:50.082+0000 7fefae4e1640 1 --2- 172.21.15.70:0/2126346601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefa81094c0 0x7fefa819a9f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fef9c00d740 tx=0x7fef9c00dc00 comp rx=0 tx=0).stop 2024-09-21T05:46:50.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:50.082+0000 7fefae4e1640 1 -- 172.21.15.70:0/2126346601 shutdown_connections 2024-09-21T05:46:50.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:50.082+0000 7fefae4e1640 1 --2- 172.21.15.70:0/2126346601 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fef900b6540 0x7fef900b8a50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:50.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:50.082+0000 7fefae4e1640 1 --2- 172.21.15.70:0/2126346601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fefa8109e10 0x7fefa819fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:50.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:50.082+0000 7fefae4e1640 1 --2- 172.21.15.70:0/2126346601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefa81094c0 0x7fefa819a9f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:50.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:50.082+0000 7fefae4e1640 1 --2- 172.21.15.70:0/2126346601 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fefa8103b80 0x7fefa819a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:50.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:50.082+0000 7fefae4e1640 1 -- 172.21.15.70:0/2126346601 >> 172.21.15.70:0/2126346601 conn(0x7fefa80ff5d0 msgr2=0x7fefa81019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:50.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:50.082+0000 7fefae4e1640 1 -- 172.21.15.70:0/2126346601 shutdown_connections 2024-09-21T05:46:50.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:50.082+0000 7fefae4e1640 1 -- 172.21.15.70:0/2126346601 wait complete. 2024-09-21T05:46:50.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:49 smithi160 ceph-mon[33979]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:50.847 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:50 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2126346601' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:46:51.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:50 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2126346601' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:46:51.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:50 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2126346601' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:46:51.246 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 21 05:46:51 smithi070 systemd[1]: Started Ceph mds.g for 96c6636e-77db-11ef-baf5-efdc52797490. 2024-09-21T05:46:52.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:52 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:52.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:52 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:52.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:52 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:52.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:52 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:52.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:52 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:52.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:52 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:52.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:52 smithi160 ceph-mon[33979]: Deploying daemon mds.a on smithi070 2024-09-21T05:46:52.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:52 smithi160 ceph-mon[33979]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:52.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:52 smithi160 ceph-mon[33979]: mds.? [v2:172.21.15.70:6838/1914209867,v1:172.21.15.70:6839/1914209867] up:boot 2024-09-21T05:46:52.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:52 smithi160 ceph-mon[33979]: fsmap 10 up:standby 2024-09-21T05:46:52.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:52 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T05:46:52.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:52 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:52.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:52 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:52.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:52 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:52.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:52 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:52.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:52 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:52.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:52 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:52.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:52 smithi070 ceph-mon[30981]: Deploying daemon mds.a on smithi070 2024-09-21T05:46:52.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:52 smithi070 ceph-mon[30981]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:52.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:52 smithi070 ceph-mon[30981]: mds.? [v2:172.21.15.70:6838/1914209867,v1:172.21.15.70:6839/1914209867] up:boot 2024-09-21T05:46:52.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:52 smithi070 ceph-mon[30981]: fsmap 10 up:standby 2024-09-21T05:46:52.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:52 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T05:46:52.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:52 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:52.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:52 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:52.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:52 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:52.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:52 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:52.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:52 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:52.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:52 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:52.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:52 smithi116 ceph-mon[34332]: Deploying daemon mds.a on smithi070 2024-09-21T05:46:52.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:52 smithi116 ceph-mon[34332]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:52.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:52 smithi116 ceph-mon[34332]: mds.? [v2:172.21.15.70:6838/1914209867,v1:172.21.15.70:6839/1914209867] up:boot 2024-09-21T05:46:52.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:52 smithi116 ceph-mon[34332]: fsmap 10 up:standby 2024-09-21T05:46:52.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:52 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T05:46:52.877 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:46:53.195 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 21 05:46:52 smithi070 systemd[1]: Starting Ceph mds.a for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:46:53.461 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 21 05:46:53 smithi070 podman[72594]: 2024-09-21 05:46:53.09673844 +0000 UTC m=+0.022964411 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:46:53.461 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 21 05:46:53 smithi070 podman[72594]: 2024-09-21 05:46:53.224145656 +0000 UTC m=+0.150371617 container create 95b517185a7a9bd7a296d1302c191f8349b8e4daaca7e5aca882713a35ecca91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-a, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T05:46:53.662 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:46:53.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:53 smithi070 ceph-mon[30981]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:53.745 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 21 05:46:53 smithi070 podman[72594]: 2024-09-21 05:46:53.468563174 +0000 UTC m=+0.394789147 container init 95b517185a7a9bd7a296d1302c191f8349b8e4daaca7e5aca882713a35ecca91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-a, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T05:46:53.745 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 21 05:46:53 smithi070 podman[72594]: 2024-09-21 05:46:53.471411773 +0000 UTC m=+0.397637742 container start 95b517185a7a9bd7a296d1302c191f8349b8e4daaca7e5aca882713a35ecca91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-a, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-21T05:46:53.745 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 21 05:46:53 smithi070 ceph-mds[72636]: -- 172.21.15.70:0/557810334 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5595fef95860 con 0x55960313d600 2024-09-21T05:46:53.745 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 21 05:46:53 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-a[72620]: starting mds.a at 2024-09-21T05:46:53.745 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 21 05:46:53 smithi070 bash[72594]: 95b517185a7a9bd7a296d1302c191f8349b8e4daaca7e5aca882713a35ecca91 2024-09-21T05:46:53.745 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 21 05:46:53 smithi070 systemd[1]: Started Ceph mds.a for 96c6636e-77db-11ef-baf5-efdc52797490. 2024-09-21T05:46:53.792 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:53 smithi116 ceph-mon[34332]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:53.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:53 smithi160 ceph-mon[33979]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:54.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.153+0000 7f01d1266640 1 -- 172.21.15.70:0/2211997862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01cc108d00 msgr2=0x7f01cc10f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:54.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.153+0000 7f01d1266640 1 --2- 172.21.15.70:0/2211997862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01cc108d00 0x7f01cc10f530 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f01c4009ca0 tx=0x7f01c402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:46:54.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.153+0000 7f01d1266640 1 -- 172.21.15.70:0/2211997862 shutdown_connections 2024-09-21T05:46:54.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.153+0000 7f01d1266640 1 --2- 172.21.15.70:0/2211997862 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01cc1083b0 0x7f01cc1087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:54.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.153+0000 7f01d1266640 1 --2- 172.21.15.70:0/2211997862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01cc108d00 0x7f01cc10f530 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:54.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.153+0000 7f01d1266640 1 --2- 172.21.15.70:0/2211997862 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01cc102ac0 0x7f01cc102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:54.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.153+0000 7f01d1266640 1 -- 172.21.15.70:0/2211997862 >> 172.21.15.70:0/2211997862 conn(0x7f01cc079720 msgr2=0x7f01cc079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:54.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.153+0000 7f01d1266640 1 -- 172.21.15.70:0/2211997862 shutdown_connections 2024-09-21T05:46:54.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.153+0000 7f01d1266640 1 -- 172.21.15.70:0/2211997862 wait complete. 2024-09-21T05:46:54.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.154+0000 7f01d1266640 1 Processor -- start 2024-09-21T05:46:54.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.155+0000 7f01d1266640 1 -- start start 2024-09-21T05:46:54.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.155+0000 7f01d1266640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01cc102ac0 0x7f01cc199050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:54.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.155+0000 7f01d1266640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01cc1083b0 0x7f01cc199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:54.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.155+0000 7f01d1266640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01cc108d00 0x7f01cc199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:54.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.155+0000 7f01d1266640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f01cc1129b0 con 0x7f01cc102ac0 2024-09-21T05:46:54.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.155+0000 7f01d1266640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f01cc112830 con 0x7f01cc108d00 2024-09-21T05:46:54.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.155+0000 7f01d1266640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f01cc112b30 con 0x7f01cc1083b0 2024-09-21T05:46:54.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.155+0000 7f01caffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01cc102ac0 0x7f01cc199050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:54.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.155+0000 7f01caffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01cc102ac0 0x7f01cc199050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40468/0 (socket says 172.21.15.70:40468) 2024-09-21T05:46:54.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.155+0000 7f01caffd640 1 -- 172.21.15.70:0/4031159273 learned_addr learned my addr 172.21.15.70:0/4031159273 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:46:54.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.155+0000 7f01ca7fc640 1 --2- 172.21.15.70:0/4031159273 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01cc1083b0 0x7f01cc199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:54.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.156+0000 7f01cb7fe640 1 --2- 172.21.15.70:0/4031159273 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01cc108d00 0x7f01cc199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:54.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.156+0000 7f01caffd640 1 -- 172.21.15.70:0/4031159273 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01cc1083b0 msgr2=0x7f01cc199590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:54.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.156+0000 7f01caffd640 1 --2- 172.21.15.70:0/4031159273 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01cc1083b0 0x7f01cc199590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:54.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.156+0000 7f01caffd640 1 -- 172.21.15.70:0/4031159273 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01cc108d00 msgr2=0x7f01cc199ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:54.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.156+0000 7f01caffd640 1 --2- 172.21.15.70:0/4031159273 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01cc108d00 0x7f01cc199ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:54.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.156+0000 7f01caffd640 1 -- 172.21.15.70:0/4031159273 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01cc1a8700 con 0x7f01cc102ac0 2024-09-21T05:46:54.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.156+0000 7f01caffd640 1 --2- 172.21.15.70:0/4031159273 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01cc102ac0 0x7f01cc199050 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f01bc00d950 tx=0x7f01bc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:54.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.156+0000 7f01b3fff640 1 -- 172.21.15.70:0/4031159273 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01bc017070 con 0x7f01cc102ac0 2024-09-21T05:46:54.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.156+0000 7f01b3fff640 1 -- 172.21.15.70:0/4031159273 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f01bc009c30 con 0x7f01cc102ac0 2024-09-21T05:46:54.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.156+0000 7f01d1266640 1 -- 172.21.15.70:0/4031159273 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01cc1a89f0 con 0x7f01cc102ac0 2024-09-21T05:46:54.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.156+0000 7f01b3fff640 1 -- 172.21.15.70:0/4031159273 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01bc00f620 con 0x7f01cc102ac0 2024-09-21T05:46:54.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.156+0000 7f01d1266640 1 -- 172.21.15.70:0/4031159273 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01cc1a8f30 con 0x7f01cc102ac0 2024-09-21T05:46:54.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.158+0000 7f01d1266640 1 -- 172.21.15.70:0/4031159273 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01cc102ed0 con 0x7f01cc102ac0 2024-09-21T05:46:54.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.159+0000 7f01b3fff640 1 -- 172.21.15.70:0/4031159273 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f01bc0109a0 con 0x7f01cc102ac0 2024-09-21T05:46:54.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.160+0000 7f01b3fff640 1 --2- 172.21.15.70:0/4031159273 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f01b40b6510 0x7f01b40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:54.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.160+0000 7f01ca7fc640 1 --2- 172.21.15.70:0/4031159273 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f01b40b6510 0x7f01b40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:54.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.160+0000 7f01b3fff640 1 -- 172.21.15.70:0/4031159273 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f01bc0e6990 con 0x7f01cc102ac0 2024-09-21T05:46:54.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.160+0000 7f01ca7fc640 1 --2- 172.21.15.70:0/4031159273 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f01b40b6510 0x7f01b40b8a20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f01cc107ed0 tx=0x7f01c000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:54.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.163+0000 7f01b3fff640 1 -- 172.21.15.70:0/4031159273 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f01bc009de0 con 0x7f01cc102ac0 2024-09-21T05:46:54.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.378+0000 7f01d1266640 1 -- 172.21.15.70:0/4031159273 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f01cc06bc30 con 0x7f01cc102ac0 2024-09-21T05:46:54.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.379+0000 7f01b3fff640 1 -- 172.21.15.70:0/4031159273 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8878 (secure 0 0 0) 0x7f01bc0b4e20 con 0x7f01cc102ac0 2024-09-21T05:46:54.381 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:46:54.381 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":11,"btime":"2024-09-21T05:46:51:762707+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3519318330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3519318330},{"type":"v1","addr":"172.21.15.70:6835","nonce":3519318330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2706663460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2706663460},{"type":"v1","addr":"172.21.15.70:6837","nonce":2706663460}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1914209867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1914209867},{"type":"v1","addr":"172.21.15.70:6839","nonce":1914209867}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24568,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3543945704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3543945704},{"type":"v1","addr":"172.21.15.160:6833","nonce":3543945704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/283778129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":283778129},{"type":"v1","addr":"172.21.15.116:6833","nonce":283778129}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24590,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3787256790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3787256790},{"type":"v1","addr":"172.21.15.116:6835","nonce":3787256790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24598,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2001692372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2001692372},{"type":"v1","addr":"172.21.15.160:6835","nonce":2001692372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24610,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/2558120045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2558120045},{"type":"v1","addr":"172.21.15.160:6837","nonce":2558120045}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24611,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/444312934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":444312934},{"type":"v1","addr":"172.21.15.116:6837","nonce":444312934}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24628,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6839/1339744282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1339744282},{"type":"v1","addr":"172.21.15.160:6839","nonce":1339744282}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T05:46:54.381 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 11 2024-09-21T05:46:54.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.381+0000 7f01d1266640 1 -- 172.21.15.70:0/4031159273 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f01b40b6510 msgr2=0x7f01b40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:54.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.381+0000 7f01d1266640 1 --2- 172.21.15.70:0/4031159273 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f01b40b6510 0x7f01b40b8a20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f01cc107ed0 tx=0x7f01c000b390 comp rx=0 tx=0).stop 2024-09-21T05:46:54.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.381+0000 7f01d1266640 1 -- 172.21.15.70:0/4031159273 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01cc102ac0 msgr2=0x7f01cc199050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:54.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.381+0000 7f01d1266640 1 --2- 172.21.15.70:0/4031159273 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01cc102ac0 0x7f01cc199050 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f01bc00d950 tx=0x7f01bc00de10 comp rx=0 tx=0).stop 2024-09-21T05:46:54.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.381+0000 7f01d1266640 1 -- 172.21.15.70:0/4031159273 shutdown_connections 2024-09-21T05:46:54.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.381+0000 7f01d1266640 1 --2- 172.21.15.70:0/4031159273 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f01b40b6510 0x7f01b40b8a20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:54.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.381+0000 7f01d1266640 1 --2- 172.21.15.70:0/4031159273 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01cc1083b0 0x7f01cc199590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:54.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.381+0000 7f01d1266640 1 --2- 172.21.15.70:0/4031159273 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01cc108d00 0x7f01cc199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:54.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.381+0000 7f01d1266640 1 --2- 172.21.15.70:0/4031159273 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01cc102ac0 0x7f01cc199050 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:54.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.381+0000 7f01d1266640 1 -- 172.21.15.70:0/4031159273 >> 172.21.15.70:0/4031159273 conn(0x7f01cc079720 msgr2=0x7f01cc1063a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:54.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.381+0000 7f01d1266640 1 -- 172.21.15.70:0/4031159273 shutdown_connections 2024-09-21T05:46:54.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:54.381+0000 7f01d1266640 1 -- 172.21.15.70:0/4031159273 wait complete. 2024-09-21T05:46:54.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:54 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:54.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:54 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:54.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:54 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:54.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:54 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:54.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:54 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:54.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:54 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:54.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:54 smithi070 ceph-mon[30981]: Deploying daemon mds.b on smithi116 2024-09-21T05:46:54.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:54 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/4031159273' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:46:54.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:54 smithi070 ceph-mon[30981]: mds.? [v2:172.21.15.70:6840/3392175775,v1:172.21.15.70:6841/3392175775] up:boot 2024-09-21T05:46:54.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:54 smithi070 ceph-mon[30981]: fsmap 11 up:standby 2024-09-21T05:46:54.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:54 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T05:46:54.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:54 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:54.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:54 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:54.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:54 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:54.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:54 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:54.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:54 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:54.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:54 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:54.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:54 smithi160 ceph-mon[33979]: Deploying daemon mds.b on smithi116 2024-09-21T05:46:54.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:54 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/4031159273' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:46:54.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:54 smithi160 ceph-mon[33979]: mds.? [v2:172.21.15.70:6840/3392175775,v1:172.21.15.70:6841/3392175775] up:boot 2024-09-21T05:46:54.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:54 smithi160 ceph-mon[33979]: fsmap 11 up:standby 2024-09-21T05:46:54.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:54 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T05:46:55.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:54 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:55.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:54 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:55.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:54 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:55.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:54 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:46:55.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:54 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:46:55.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:54 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:55.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:54 smithi116 ceph-mon[34332]: Deploying daemon mds.b on smithi116 2024-09-21T05:46:55.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:54 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/4031159273' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:46:55.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:54 smithi116 ceph-mon[34332]: mds.? [v2:172.21.15.70:6840/3392175775,v1:172.21.15.70:6841/3392175775] up:boot 2024-09-21T05:46:55.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:54 smithi116 ceph-mon[34332]: fsmap 11 up:standby 2024-09-21T05:46:55.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:54 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T05:46:55.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:55 smithi116 ceph-mon[34332]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:55.805 INFO:journalctl@ceph.mds.b.smithi116.stdout:Sep 21 05:46:55 smithi116 systemd[1]: Starting Ceph mds.b for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:46:55.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:55 smithi160 ceph-mon[33979]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:55.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:55 smithi070 ceph-mon[30981]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:56.123 INFO:journalctl@ceph.mds.b.smithi116.stdout:Sep 21 05:46:55 smithi116 podman[62157]: 2024-09-21 05:46:55.760211732 +0000 UTC m=+0.015785479 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:46:56.123 INFO:journalctl@ceph.mds.b.smithi116.stdout:Sep 21 05:46:55 smithi116 podman[62157]: 2024-09-21 05:46:55.865976373 +0000 UTC m=+0.121550107 container create 2940e2ad1cf7b98b5251954dacfa703418b3205cd40633e301053d7f2efe0f30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T05:46:56.123 INFO:journalctl@ceph.mds.b.smithi116.stdout:Sep 21 05:46:56 smithi116 podman[62157]: 2024-09-21 05:46:56.085621146 +0000 UTC m=+0.341194888 container init 2940e2ad1cf7b98b5251954dacfa703418b3205cd40633e301053d7f2efe0f30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=) 2024-09-21T05:46:56.123 INFO:journalctl@ceph.mds.b.smithi116.stdout:Sep 21 05:46:56 smithi116 podman[62157]: 2024-09-21 05:46:56.088590519 +0000 UTC m=+0.344164254 container start 2940e2ad1cf7b98b5251954dacfa703418b3205cd40633e301053d7f2efe0f30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T05:46:56.554 INFO:journalctl@ceph.mds.b.smithi116.stdout:Sep 21 05:46:56 smithi116 ceph-mds[62176]: -- 172.21.15.116:0/2163954226 <== mon.2 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c8354d1860 con 0x55c839679a80 2024-09-21T05:46:56.554 INFO:journalctl@ceph.mds.b.smithi116.stdout:Sep 21 05:46:56 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-b[62172]: starting mds.b at 2024-09-21T05:46:56.554 INFO:journalctl@ceph.mds.b.smithi116.stdout:Sep 21 05:46:56 smithi116 bash[62157]: 2940e2ad1cf7b98b5251954dacfa703418b3205cd40633e301053d7f2efe0f30 2024-09-21T05:46:56.554 INFO:journalctl@ceph.mds.b.smithi116.stdout:Sep 21 05:46:56 smithi116 systemd[1]: Started Ceph mds.b for 96c6636e-77db-11ef-baf5-efdc52797490. 2024-09-21T05:46:57.123 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:46:57.457 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:46:57.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:57 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:57.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:57 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:57.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:57 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:57.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:57 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:57.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:57 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:57.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:57 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:57.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:57 smithi070 ceph-mon[30981]: mds.? [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] up:boot 2024-09-21T05:46:57.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:57 smithi070 ceph-mon[30981]: fsmap 12 up:standby 2024-09-21T05:46:57.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:57 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T05:46:57.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:57 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:57.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:57 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:57.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:57 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:57.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:57 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:57.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:57 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:57.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:57 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:57.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:57 smithi116 ceph-mon[34332]: mds.? [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] up:boot 2024-09-21T05:46:57.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:57 smithi116 ceph-mon[34332]: fsmap 12 up:standby 2024-09-21T05:46:57.555 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:57 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T05:46:57.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:57 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:57.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:57 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:57.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:57 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:57.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:57 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:57.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:57 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:57.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:57 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:57.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:57 smithi160 ceph-mon[33979]: mds.? [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] up:boot 2024-09-21T05:46:57.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:57 smithi160 ceph-mon[33979]: fsmap 12 up:standby 2024-09-21T05:46:57.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:57 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T05:46:57.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.958+0000 7f2acd09d640 1 -- 172.21.15.70:0/3149652608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ac8109ec0 msgr2=0x7f2ac81106f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:57.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.958+0000 7f2acd09d640 1 --2- 172.21.15.70:0/3149652608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ac8109ec0 0x7f2ac81106f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0009ca0 tx=0x7f2ac002a8e0 comp rx=0 tx=0).stop 2024-09-21T05:46:57.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.959+0000 7f2acd09d640 1 -- 172.21.15.70:0/3149652608 shutdown_connections 2024-09-21T05:46:57.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.959+0000 7f2acd09d640 1 --2- 172.21.15.70:0/3149652608 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2ac8109570 0x7f2ac8109980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:57.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.959+0000 7f2acd09d640 1 --2- 172.21.15.70:0/3149652608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ac8109ec0 0x7f2ac81106f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:57.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.959+0000 7f2acd09d640 1 --2- 172.21.15.70:0/3149652608 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ac8103c30 0x7f2ac8104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:57.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.959+0000 7f2acd09d640 1 -- 172.21.15.70:0/3149652608 >> 172.21.15.70:0/3149652608 conn(0x7f2ac807b8d0 msgr2=0x7f2ac807bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:57.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.959+0000 7f2acd09d640 1 -- 172.21.15.70:0/3149652608 shutdown_connections 2024-09-21T05:46:57.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.959+0000 7f2acd09d640 1 -- 172.21.15.70:0/3149652608 wait complete. 2024-09-21T05:46:57.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.959+0000 7f2acd09d640 1 Processor -- start 2024-09-21T05:46:57.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.960+0000 7f2acd09d640 1 -- start start 2024-09-21T05:46:57.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.960+0000 7f2acd09d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ac8103c30 0x7f2ac819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:57.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.960+0000 7f2acd09d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ac8109570 0x7f2ac819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:57.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.960+0000 7f2acd09d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2ac8109ec0 0x7f2ac819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:57.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.960+0000 7f2acd09d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac8113b10 con 0x7f2ac8103c30 2024-09-21T05:46:57.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.960+0000 7f2acd09d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac8113990 con 0x7f2ac8109570 2024-09-21T05:46:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.960+0000 7f2acd09d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac8113c90 con 0x7f2ac8109ec0 2024-09-21T05:46:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.960+0000 7f2ac6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ac8103c30 0x7f2ac819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.960+0000 7f2ac6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ac8103c30 0x7f2ac819a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40488/0 (socket says 172.21.15.70:40488) 2024-09-21T05:46:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.960+0000 7f2ac6d9d640 1 -- 172.21.15.70:0/245271558 learned_addr learned my addr 172.21.15.70:0/245271558 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:46:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.960+0000 7f2ac659c640 1 --2- 172.21.15.70:0/245271558 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ac8109570 0x7f2ac819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.960+0000 7f2ac759e640 1 --2- 172.21.15.70:0/245271558 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2ac8109ec0 0x7f2ac819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.960+0000 7f2ac6d9d640 1 -- 172.21.15.70:0/245271558 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2ac8109ec0 msgr2=0x7f2ac819fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.960+0000 7f2ac6d9d640 1 --2- 172.21.15.70:0/245271558 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2ac8109ec0 0x7f2ac819fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.960+0000 7f2ac6d9d640 1 -- 172.21.15.70:0/245271558 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ac8109570 msgr2=0x7f2ac819aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.960+0000 7f2ac6d9d640 1 --2- 172.21.15.70:0/245271558 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ac8109570 0x7f2ac819aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.960+0000 7f2ac6d9d640 1 -- 172.21.15.70:0/245271558 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ac81a03f0 con 0x7f2ac8103c30 2024-09-21T05:46:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.960+0000 7f2ac759e640 1 --2- 172.21.15.70:0/245271558 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2ac8109ec0 0x7f2ac819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:46:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.961+0000 7f2ac6d9d640 1 --2- 172.21.15.70:0/245271558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ac8103c30 0x7f2ac819a480 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2ab800d950 tx=0x7f2ab800dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.961+0000 7f2aaffff640 1 -- 172.21.15.70:0/245271558 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab8017070 con 0x7f2ac8103c30 2024-09-21T05:46:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.961+0000 7f2acd09d640 1 -- 172.21.15.70:0/245271558 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ac81a06e0 con 0x7f2ac8103c30 2024-09-21T05:46:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.961+0000 7f2aaffff640 1 -- 172.21.15.70:0/245271558 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f2ab800de80 con 0x7f2ac8103c30 2024-09-21T05:46:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.961+0000 7f2aaffff640 1 -- 172.21.15.70:0/245271558 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab800f620 con 0x7f2ac8103c30 2024-09-21T05:46:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.961+0000 7f2acd09d640 1 -- 172.21.15.70:0/245271558 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ac81a6ec0 con 0x7f2ac8103c30 2024-09-21T05:46:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.962+0000 7f2acd09d640 1 -- 172.21.15.70:0/245271558 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ac8104040 con 0x7f2ac8103c30 2024-09-21T05:46:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.964+0000 7f2aaffff640 1 -- 172.21.15.70:0/245271558 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f2ab8009c30 con 0x7f2ac8103c30 2024-09-21T05:46:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.965+0000 7f2aaffff640 1 --2- 172.21.15.70:0/245271558 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f2ab00b6510 0x7f2ab00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.965+0000 7f2ac659c640 1 --2- 172.21.15.70:0/245271558 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f2ab00b6510 0x7f2ab00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.965+0000 7f2aaffff640 1 -- 172.21.15.70:0/245271558 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f2ab80e6af0 con 0x7f2ac8103c30 2024-09-21T05:46:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.966+0000 7f2ac659c640 1 --2- 172.21.15.70:0/245271558 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f2ab00b6510 0x7f2ab00b8a20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8108500 tx=0x7f2abc009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:57.969+0000 7f2aaffff640 1 -- 172.21.15.70:0/245271558 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2ab80ad780 con 0x7f2ac8103c30 2024-09-21T05:46:58.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:58.238+0000 7f2acd09d640 1 -- 172.21.15.70:0/245271558 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ac819b5b0 con 0x7f2ac8103c30 2024-09-21T05:46:58.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:58.239+0000 7f2aaffff640 1 -- 172.21.15.70:0/245271558 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10533 (secure 0 0 0) 0x7f2ab80b1b60 con 0x7f2ac8103c30 2024-09-21T05:46:58.241 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:46:58.241 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":13,"btime":"2024-09-21T05:46:56:622640+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3519318330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3519318330},{"type":"v1","addr":"172.21.15.70:6835","nonce":3519318330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2706663460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2706663460},{"type":"v1","addr":"172.21.15.70:6837","nonce":2706663460}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1914209867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1914209867},{"type":"v1","addr":"172.21.15.70:6839","nonce":1914209867}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3392175775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3392175775},{"type":"v1","addr":"172.21.15.70:6841","nonce":3392175775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24568,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3543945704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3543945704},{"type":"v1","addr":"172.21.15.160:6833","nonce":3543945704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/283778129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":283778129},{"type":"v1","addr":"172.21.15.116:6833","nonce":283778129}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24590,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3787256790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3787256790},{"type":"v1","addr":"172.21.15.116:6835","nonce":3787256790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24598,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2001692372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2001692372},{"type":"v1","addr":"172.21.15.160:6835","nonce":2001692372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24610,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/2558120045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2558120045},{"type":"v1","addr":"172.21.15.160:6837","nonce":2558120045}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24611,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/444312934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":444312934},{"type":"v1","addr":"172.21.15.116:6837","nonce":444312934}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24628,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6839/1339744282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1339744282},{"type":"v1","addr":"172.21.15.160:6839","nonce":1339744282}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24641,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6839/3952175670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3952175670},{"type":"v1","addr":"172.21.15.116:6839","nonce":3952175670}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-21T05:46:58.241 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 13 2024-09-21T05:46:58.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:58.241+0000 7f2acd09d640 1 -- 172.21.15.70:0/245271558 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f2ab00b6510 msgr2=0x7f2ab00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:58.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:58.241+0000 7f2acd09d640 1 --2- 172.21.15.70:0/245271558 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f2ab00b6510 0x7f2ab00b8a20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8108500 tx=0x7f2abc009110 comp rx=0 tx=0).stop 2024-09-21T05:46:58.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:58.241+0000 7f2acd09d640 1 -- 172.21.15.70:0/245271558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ac8103c30 msgr2=0x7f2ac819a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:58.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:58.241+0000 7f2acd09d640 1 --2- 172.21.15.70:0/245271558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ac8103c30 0x7f2ac819a480 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2ab800d950 tx=0x7f2ab800dd50 comp rx=0 tx=0).stop 2024-09-21T05:46:58.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:58.241+0000 7f2acd09d640 1 -- 172.21.15.70:0/245271558 shutdown_connections 2024-09-21T05:46:58.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:58.241+0000 7f2acd09d640 1 --2- 172.21.15.70:0/245271558 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f2ab00b6510 0x7f2ab00b8a20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:58.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:58.241+0000 7f2acd09d640 1 --2- 172.21.15.70:0/245271558 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2ac8109ec0 0x7f2ac819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:58.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:58.241+0000 7f2acd09d640 1 --2- 172.21.15.70:0/245271558 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ac8109570 0x7f2ac819aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:58.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:58.241+0000 7f2acd09d640 1 --2- 172.21.15.70:0/245271558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ac8103c30 0x7f2ac819a480 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:58.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:58.241+0000 7f2acd09d640 1 -- 172.21.15.70:0/245271558 >> 172.21.15.70:0/245271558 conn(0x7f2ac807b8d0 msgr2=0x7f2ac81054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:58.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:58.242+0000 7f2acd09d640 1 -- 172.21.15.70:0/245271558 shutdown_connections 2024-09-21T05:46:58.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:58.242+0000 7f2acd09d640 1 -- 172.21.15.70:0/245271558 wait complete. 2024-09-21T05:46:58.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:58 smithi070 ceph-mon[30981]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:58.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:58 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:58.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:58 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:58.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:58 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:58.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:58 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:58.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:58 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:58.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:58 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/245271558' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:46:58.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:58 smithi116 ceph-mon[34332]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:58.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:58 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:58.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:58 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:58.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:58 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:58.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:58 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:58.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:58 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:58.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:58 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/245271558' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:46:58.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:58 smithi160 ceph-mon[33979]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:58.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:58 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:58.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:58 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:58.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:58 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:58.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:58 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:58.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:58 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:58.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:58 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/245271558' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:46:58.918 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph --format=json-pretty osd lspools 2024-09-21T05:46:59.188 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:46:59.577 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:59 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:59.578 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:59 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:59.578 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:59 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:59.578 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:59 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:59.578 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:59 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:59.578 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:59 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:59.578 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:46:59 smithi070 ceph-mon[30981]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:59.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.664+0000 7f274464b640 1 -- 172.21.15.70:0/3125375620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f273c108cf0 msgr2=0x7f273c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:59.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.664+0000 7f274464b640 1 --2- 172.21.15.70:0/3125375620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f273c108cf0 0x7f273c10f520 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2734009ca0 tx=0x7f273402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:46:59.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.664+0000 7f274464b640 1 -- 172.21.15.70:0/3125375620 shutdown_connections 2024-09-21T05:46:59.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.664+0000 7f274464b640 1 --2- 172.21.15.70:0/3125375620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f273c108cf0 0x7f273c10f520 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:59.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.664+0000 7f274464b640 1 --2- 172.21.15.70:0/3125375620 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f273c1083a0 0x7f273c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:59.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.664+0000 7f274464b640 1 --2- 172.21.15.70:0/3125375620 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f273c102a60 0x7f273c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:59.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.664+0000 7f274464b640 1 -- 172.21.15.70:0/3125375620 >> 172.21.15.70:0/3125375620 conn(0x7f273c079730 msgr2=0x7f273c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:59.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.664+0000 7f274464b640 1 -- 172.21.15.70:0/3125375620 shutdown_connections 2024-09-21T05:46:59.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.664+0000 7f274464b640 1 -- 172.21.15.70:0/3125375620 wait complete. 2024-09-21T05:46:59.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.665+0000 7f274464b640 1 Processor -- start 2024-09-21T05:46:59.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.665+0000 7f274464b640 1 -- start start 2024-09-21T05:46:59.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.665+0000 7f274464b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f273c102a60 0x7f273c10fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:59.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.665+0000 7f274464b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f273c1083a0 0x7f273c1102f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:59.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.665+0000 7f274464b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f273c108cf0 0x7f273c110830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:59.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.665+0000 7f274464b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f273c113a40 con 0x7f273c108cf0 2024-09-21T05:46:59.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.665+0000 7f274464b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f273c1138c0 con 0x7f273c1083a0 2024-09-21T05:46:59.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.665+0000 7f274464b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f273c113bc0 con 0x7f273c102a60 2024-09-21T05:46:59.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.666+0000 7f2742be8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f273c108cf0 0x7f273c110830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:59.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.666+0000 7f2742be8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f273c108cf0 0x7f273c110830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40506/0 (socket says 172.21.15.70:40506) 2024-09-21T05:46:59.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.666+0000 7f2741be6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f273c1083a0 0x7f273c1102f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:59.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.666+0000 7f2742be8640 1 -- 172.21.15.70:0/3858963263 learned_addr learned my addr 172.21.15.70:0/3858963263 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:46:59.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.666+0000 7f27423e7640 1 --2- 172.21.15.70:0/3858963263 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f273c102a60 0x7f273c10fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:59.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.666+0000 7f2742be8640 1 -- 172.21.15.70:0/3858963263 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f273c102a60 msgr2=0x7f273c10fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:59.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.666+0000 7f2742be8640 1 --2- 172.21.15.70:0/3858963263 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f273c102a60 0x7f273c10fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:59.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.666+0000 7f2742be8640 1 -- 172.21.15.70:0/3858963263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f273c1083a0 msgr2=0x7f273c1102f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:59.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.666+0000 7f2742be8640 1 --2- 172.21.15.70:0/3858963263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f273c1083a0 0x7f273c1102f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:59.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.666+0000 7f2742be8640 1 -- 172.21.15.70:0/3858963263 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f273c1a87b0 con 0x7f273c108cf0 2024-09-21T05:46:59.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.666+0000 7f27423e7640 1 --2- 172.21.15.70:0/3858963263 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f273c102a60 0x7f273c10fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:46:59.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.666+0000 7f2742be8640 1 --2- 172.21.15.70:0/3858963263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f273c108cf0 0x7f273c110830 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f27340097b0 tx=0x7f2734032fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:59.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.666+0000 7f272f7fe640 1 -- 172.21.15.70:0/3858963263 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2734003cf0 con 0x7f273c108cf0 2024-09-21T05:46:59.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.666+0000 7f274464b640 1 -- 172.21.15.70:0/3858963263 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f273c1a8a40 con 0x7f273c108cf0 2024-09-21T05:46:59.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.666+0000 7f272f7fe640 1 -- 172.21.15.70:0/3858963263 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f27340044f0 con 0x7f273c108cf0 2024-09-21T05:46:59.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.666+0000 7f272f7fe640 1 -- 172.21.15.70:0/3858963263 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2734030c30 con 0x7f273c108cf0 2024-09-21T05:46:59.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.666+0000 7f274464b640 1 -- 172.21.15.70:0/3858963263 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f273c1a8fd0 con 0x7f273c108cf0 2024-09-21T05:46:59.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.667+0000 7f274464b640 1 -- 172.21.15.70:0/3858963263 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f273c102e70 con 0x7f273c108cf0 2024-09-21T05:46:59.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.669+0000 7f272f7fe640 1 -- 172.21.15.70:0/3858963263 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f27340046a0 con 0x7f273c108cf0 2024-09-21T05:46:59.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.670+0000 7f272f7fe640 1 --2- 172.21.15.70:0/3858963263 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f27280b6510 0x7f27280b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:59.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.670+0000 7f27423e7640 1 --2- 172.21.15.70:0/3858963263 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f27280b6510 0x7f27280b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:59.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.670+0000 7f272f7fe640 1 -- 172.21.15.70:0/3858963263 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f27341083c0 con 0x7f273c108cf0 2024-09-21T05:46:59.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.670+0000 7f27423e7640 1 --2- 172.21.15.70:0/3858963263 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f27280b6510 0x7f27280b8a20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2730005fd0 tx=0x7f2730005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:59.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.673+0000 7f272f7fe640 1 -- 172.21.15.70:0/3858963263 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f27340cf0f0 con 0x7f273c108cf0 2024-09-21T05:46:59.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:59 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:59.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:59 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:59.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:59 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:59.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:59 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:59.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:59 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:59.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:59 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:59.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:46:59 smithi116 ceph-mon[34332]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:59.861 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:59 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:59.861 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:59 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:59.861 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:59 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:59.861 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:59 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:59.861 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:59 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:46:59.862 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:59 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:59.862 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:46:59 smithi160 ceph-mon[33979]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:46:59.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.882+0000 7f274464b640 1 -- 172.21.15.70:0/3858963263 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f273c10ab10 con 0x7f273c108cf0 2024-09-21T05:46:59.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.883+0000 7f272f7fe640 1 -- 172.21.15.70:0/3858963263 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v70) ==== 84+0+65 (secure 0 0 0) 0x7f27340d34d0 con 0x7f273c108cf0 2024-09-21T05:46:59.885 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:46:59.885 INFO:teuthology.orchestra.run.smithi070.stdout:[ 2024-09-21T05:46:59.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:46:59.885 INFO:teuthology.orchestra.run.smithi070.stdout: "poolnum": 1, 2024-09-21T05:46:59.886 INFO:teuthology.orchestra.run.smithi070.stdout: "poolname": ".mgr" 2024-09-21T05:46:59.886 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:46:59.886 INFO:teuthology.orchestra.run.smithi070.stdout:] 2024-09-21T05:46:59.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.885+0000 7f274464b640 1 -- 172.21.15.70:0/3858963263 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f27280b6510 msgr2=0x7f27280b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:59.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.885+0000 7f274464b640 1 --2- 172.21.15.70:0/3858963263 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f27280b6510 0x7f27280b8a20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2730005fd0 tx=0x7f2730005ec0 comp rx=0 tx=0).stop 2024-09-21T05:46:59.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.885+0000 7f274464b640 1 -- 172.21.15.70:0/3858963263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f273c108cf0 msgr2=0x7f273c110830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:59.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.885+0000 7f274464b640 1 --2- 172.21.15.70:0/3858963263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f273c108cf0 0x7f273c110830 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f27340097b0 tx=0x7f2734032fe0 comp rx=0 tx=0).stop 2024-09-21T05:46:59.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.885+0000 7f274464b640 1 -- 172.21.15.70:0/3858963263 shutdown_connections 2024-09-21T05:46:59.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.885+0000 7f274464b640 1 --2- 172.21.15.70:0/3858963263 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f27280b6510 0x7f27280b8a20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:59.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.885+0000 7f274464b640 1 --2- 172.21.15.70:0/3858963263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f273c108cf0 0x7f273c110830 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:59.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.885+0000 7f274464b640 1 --2- 172.21.15.70:0/3858963263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f273c1083a0 0x7f273c1102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:59.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.885+0000 7f274464b640 1 --2- 172.21.15.70:0/3858963263 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f273c102a60 0x7f273c10fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:59.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.885+0000 7f274464b640 1 -- 172.21.15.70:0/3858963263 >> 172.21.15.70:0/3858963263 conn(0x7f273c079730 msgr2=0x7f273c104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:59.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.885+0000 7f274464b640 1 -- 172.21.15.70:0/3858963263 shutdown_connections 2024-09-21T05:46:59.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:46:59.885+0000 7f274464b640 1 -- 172.21.15.70:0/3858963263 wait complete. 2024-09-21T05:47:00.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:00 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3858963263' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T05:47:00.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:00 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:47:00.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:00 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:47:00.833 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:00 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3858963263' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T05:47:00.834 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:00 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:47:00.834 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:00 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:47:00.861 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T05:47:00.861 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T05:47:00.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:00 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3858963263' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T05:47:00.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:00 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:47:00.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:00 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:47:01.293 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:47:01.673 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:01 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:47:01.673 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:01 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:47:01.673 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:01 smithi070 ceph-mon[30981]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:01.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.766+0000 7fdccaa6e640 1 -- 172.21.15.70:0/424303789 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcc4103ba0 msgr2=0x7fdcc4103fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:01.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.766+0000 7fdccaa6e640 1 --2- 172.21.15.70:0/424303789 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcc4103ba0 0x7fdcc4103fb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4009900 tx=0x7fdcb402a410 comp rx=0 tx=0).stop 2024-09-21T05:47:01.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.766+0000 7fdccaa6e640 1 -- 172.21.15.70:0/424303789 shutdown_connections 2024-09-21T05:47:01.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.766+0000 7fdccaa6e640 1 --2- 172.21.15.70:0/424303789 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdcc41094e0 0x7fdcc41098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:01.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.766+0000 7fdccaa6e640 1 --2- 172.21.15.70:0/424303789 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdcc4109e30 0x7fdcc4110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:01.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.766+0000 7fdccaa6e640 1 --2- 172.21.15.70:0/424303789 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcc4103ba0 0x7fdcc4103fb0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:01.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.766+0000 7fdccaa6e640 1 -- 172.21.15.70:0/424303789 >> 172.21.15.70:0/424303789 conn(0x7fdcc40ff630 msgr2=0x7fdcc4101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:01.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.766+0000 7fdccaa6e640 1 -- 172.21.15.70:0/424303789 shutdown_connections 2024-09-21T05:47:01.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.766+0000 7fdccaa6e640 1 -- 172.21.15.70:0/424303789 wait complete. 2024-09-21T05:47:01.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.766+0000 7fdccaa6e640 1 Processor -- start 2024-09-21T05:47:01.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.767+0000 7fdccaa6e640 1 -- start start 2024-09-21T05:47:01.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.767+0000 7fdccaa6e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdcc4103ba0 0x7fdcc419a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:01.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.767+0000 7fdccaa6e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcc41094e0 0x7fdcc419aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:01.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.767+0000 7fdccaa6e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdcc4109e30 0x7fdcc419fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:01.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.767+0000 7fdccaa6e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc4113b20 con 0x7fdcc41094e0 2024-09-21T05:47:01.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.767+0000 7fdccaa6e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc41139a0 con 0x7fdcc4109e30 2024-09-21T05:47:01.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.767+0000 7fdccaa6e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc4113ca0 con 0x7fdcc4103ba0 2024-09-21T05:47:01.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.767+0000 7fdcc3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcc41094e0 0x7fdcc419aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:01.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.767+0000 7fdcc3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcc41094e0 0x7fdcc419aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33788/0 (socket says 172.21.15.70:33788) 2024-09-21T05:47:01.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.767+0000 7fdcc3fff640 1 -- 172.21.15.70:0/2996750083 learned_addr learned my addr 172.21.15.70:0/2996750083 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:47:01.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.767+0000 7fdcc3fff640 1 -- 172.21.15.70:0/2996750083 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdcc4103ba0 msgr2=0x7fdcc419a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:01.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.767+0000 7fdcc880a640 1 --2- 172.21.15.70:0/2996750083 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdcc4103ba0 0x7fdcc419a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:01.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.767+0000 7fdcc900b640 1 --2- 172.21.15.70:0/2996750083 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdcc4109e30 0x7fdcc419fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:01.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.767+0000 7fdcc3fff640 1 --2- 172.21.15.70:0/2996750083 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdcc4103ba0 0x7fdcc419a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:01.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.767+0000 7fdcc3fff640 1 -- 172.21.15.70:0/2996750083 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdcc4109e30 msgr2=0x7fdcc419fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:01.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.767+0000 7fdcc3fff640 1 --2- 172.21.15.70:0/2996750083 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdcc4109e30 0x7fdcc419fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:01.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.767+0000 7fdcc3fff640 1 -- 172.21.15.70:0/2996750083 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc41a03e0 con 0x7fdcc41094e0 2024-09-21T05:47:01.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.767+0000 7fdcc3fff640 1 --2- 172.21.15.70:0/2996750083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcc41094e0 0x7fdcc419aad0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8006fd0 tx=0x7fdcb800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:01.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.768+0000 7fdcc1ffb640 1 -- 172.21.15.70:0/2996750083 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8011830 con 0x7fdcc41094e0 2024-09-21T05:47:01.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.768+0000 7fdcc1ffb640 1 -- 172.21.15.70:0/2996750083 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fdcb8016070 con 0x7fdcc41094e0 2024-09-21T05:47:01.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.768+0000 7fdcc1ffb640 1 -- 172.21.15.70:0/2996750083 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8010df0 con 0x7fdcc41094e0 2024-09-21T05:47:01.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.768+0000 7fdccaa6e640 1 -- 172.21.15.70:0/2996750083 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcc41a06d0 con 0x7fdcc41094e0 2024-09-21T05:47:01.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.768+0000 7fdccaa6e640 1 -- 172.21.15.70:0/2996750083 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcc41a6ef0 con 0x7fdcc41094e0 2024-09-21T05:47:01.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.769+0000 7fdccaa6e640 1 -- 172.21.15.70:0/2996750083 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcc4103fb0 con 0x7fdcc41094e0 2024-09-21T05:47:01.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.770+0000 7fdcc1ffb640 1 -- 172.21.15.70:0/2996750083 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fdcb801b460 con 0x7fdcc41094e0 2024-09-21T05:47:01.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.771+0000 7fdcc1ffb640 1 --2- 172.21.15.70:0/2996750083 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdcac0b6540 0x7fdcac0b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:01.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.771+0000 7fdcc880a640 1 --2- 172.21.15.70:0/2996750083 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdcac0b6540 0x7fdcac0b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:01.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.771+0000 7fdcc1ffb640 1 -- 172.21.15.70:0/2996750083 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7fdcb80e63d0 con 0x7fdcc41094e0 2024-09-21T05:47:01.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.772+0000 7fdcc880a640 1 --2- 172.21.15.70:0/2996750083 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdcac0b6540 0x7fdcac0b8a50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdcb402a930 tx=0x7fdcb4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:01.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.776+0000 7fdcc1ffb640 1 -- 172.21.15.70:0/2996750083 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdcb8021250 con 0x7fdcc41094e0 2024-09-21T05:47:01.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:01 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:47:01.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:01 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:47:01.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:01 smithi160 ceph-mon[33979]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:01.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:01.982+0000 7fdccaa6e640 1 -- 172.21.15.70:0/2996750083 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fdcc402e640 con 0x7fdcc41094e0 2024-09-21T05:47:02.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:01 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:47:02.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:01 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:47:02.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:01 smithi116 ceph-mon[34332]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:02.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:02.594+0000 7fdcc1ffb640 1 -- 172.21.15.70:0/2996750083 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v71) ==== 138+0+0 (secure 0 0 0) 0x7fdcb80ad100 con 0x7fdcc41094e0 2024-09-21T05:47:02.598 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_metadata' created 2024-09-21T05:47:02.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:02.597+0000 7fdccaa6e640 1 -- 172.21.15.70:0/2996750083 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdcac0b6540 msgr2=0x7fdcac0b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:02.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:02.597+0000 7fdccaa6e640 1 --2- 172.21.15.70:0/2996750083 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdcac0b6540 0x7fdcac0b8a50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdcb402a930 tx=0x7fdcb4000bc0 comp rx=0 tx=0).stop 2024-09-21T05:47:02.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:02.597+0000 7fdccaa6e640 1 -- 172.21.15.70:0/2996750083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcc41094e0 msgr2=0x7fdcc419aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:02.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:02.597+0000 7fdccaa6e640 1 --2- 172.21.15.70:0/2996750083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcc41094e0 0x7fdcc419aad0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8006fd0 tx=0x7fdcb800b8e0 comp rx=0 tx=0).stop 2024-09-21T05:47:02.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:02.597+0000 7fdccaa6e640 1 -- 172.21.15.70:0/2996750083 shutdown_connections 2024-09-21T05:47:02.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:02.597+0000 7fdccaa6e640 1 --2- 172.21.15.70:0/2996750083 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdcac0b6540 0x7fdcac0b8a50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:02.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:02.597+0000 7fdccaa6e640 1 --2- 172.21.15.70:0/2996750083 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdcc4109e30 0x7fdcc419fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:02.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:02.597+0000 7fdccaa6e640 1 --2- 172.21.15.70:0/2996750083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcc41094e0 0x7fdcc419aad0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:02.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:02.597+0000 7fdccaa6e640 1 --2- 172.21.15.70:0/2996750083 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdcc4103ba0 0x7fdcc419a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:02.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:02.597+0000 7fdccaa6e640 1 -- 172.21.15.70:0/2996750083 >> 172.21.15.70:0/2996750083 conn(0x7fdcc40ff630 msgr2=0x7fdcc4101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:02.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:02.597+0000 7fdccaa6e640 1 -- 172.21.15.70:0/2996750083 shutdown_connections 2024-09-21T05:47:02.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:02.598+0000 7fdccaa6e640 1 -- 172.21.15.70:0/2996750083 wait complete. 2024-09-21T05:47:02.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:02 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2996750083' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T05:47:02.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:02 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:47:02.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:02 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:47:02.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:02 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:02.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:02 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:47:02.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:02 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:47:02.968 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:02 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2996750083' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T05:47:02.969 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:02 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:47:02.969 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:02 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:47:02.969 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:02 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:02.969 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:02 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:47:02.969 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:02 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:47:03.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:02 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2996750083' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T05:47:03.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:02 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:47:03.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:02 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:47:03.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:02 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:03.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:02 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:47:03.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:02 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:47:03.460 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-21T05:47:03.719 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:47:03.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:03 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2996750083' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T05:47:03.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:03 smithi070 ceph-mon[30981]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T05:47:03.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:03 smithi070 ceph-mon[30981]: pgmap v284: 33 pgs: 3 creating+peering, 29 unknown, 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:03.867 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:03 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2996750083' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T05:47:03.867 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:03 smithi116 ceph-mon[34332]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T05:47:03.867 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:03 smithi116 ceph-mon[34332]: pgmap v284: 33 pgs: 3 creating+peering, 29 unknown, 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:03.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:03 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2996750083' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T05:47:03.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:03 smithi160 ceph-mon[33979]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T05:47:03.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:03 smithi160 ceph-mon[33979]: pgmap v284: 33 pgs: 3 creating+peering, 29 unknown, 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:04.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.194+0000 7f08a15d8640 1 -- 172.21.15.70:0/980798720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f089c1083f0 msgr2=0x7f089c108800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:04.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.194+0000 7f08a15d8640 1 --2- 172.21.15.70:0/980798720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f089c1083f0 0x7f089c108800 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0884009900 tx=0x7f088402a410 comp rx=0 tx=0).stop 2024-09-21T05:47:04.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.194+0000 7f08a15d8640 1 -- 172.21.15.70:0/980798720 shutdown_connections 2024-09-21T05:47:04.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.194+0000 7f08a15d8640 1 --2- 172.21.15.70:0/980798720 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f089c108d40 0x7f089c10f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:04.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.194+0000 7f08a15d8640 1 --2- 172.21.15.70:0/980798720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f089c1083f0 0x7f089c108800 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:04.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.194+0000 7f08a15d8640 1 --2- 172.21.15.70:0/980798720 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f089c102ab0 0x7f089c102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:04.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.194+0000 7f08a15d8640 1 -- 172.21.15.70:0/980798720 >> 172.21.15.70:0/980798720 conn(0x7f089c0796b0 msgr2=0x7f089c079ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:04.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.194+0000 7f08a15d8640 1 -- 172.21.15.70:0/980798720 shutdown_connections 2024-09-21T05:47:04.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.194+0000 7f08a15d8640 1 -- 172.21.15.70:0/980798720 wait complete. 2024-09-21T05:47:04.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.194+0000 7f08a15d8640 1 Processor -- start 2024-09-21T05:47:04.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.195+0000 7f08a15d8640 1 -- start start 2024-09-21T05:47:04.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.195+0000 7f08a15d8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f089c102ab0 0x7f089c19b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:04.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.195+0000 7f08a15d8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f089c1083f0 0x7f089c19b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:04.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.195+0000 7f08a15d8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f089c108d40 0x7f089c19be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:04.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.195+0000 7f08a15d8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f089c112a30 con 0x7f089c108d40 2024-09-21T05:47:04.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.195+0000 7f08a15d8640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f089c1128b0 con 0x7f089c1083f0 2024-09-21T05:47:04.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.195+0000 7f08a15d8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f089c112bb0 con 0x7f089c102ab0 2024-09-21T05:47:04.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.195+0000 7f089b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f089c108d40 0x7f089c19be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:04.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.195+0000 7f089b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f089c108d40 0x7f089c19be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33800/0 (socket says 172.21.15.70:33800) 2024-09-21T05:47:04.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.195+0000 7f089b7fe640 1 -- 172.21.15.70:0/2744533412 learned_addr learned my addr 172.21.15.70:0/2744533412 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:47:04.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.195+0000 7f089affd640 1 --2- 172.21.15.70:0/2744533412 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f089c102ab0 0x7f089c19b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:04.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.195+0000 7f08927fc640 1 --2- 172.21.15.70:0/2744533412 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f089c1083f0 0x7f089c19b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:04.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.195+0000 7f089b7fe640 1 -- 172.21.15.70:0/2744533412 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f089c102ab0 msgr2=0x7f089c19b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:04.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.195+0000 7f089b7fe640 1 --2- 172.21.15.70:0/2744533412 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f089c102ab0 0x7f089c19b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:04.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.195+0000 7f089b7fe640 1 -- 172.21.15.70:0/2744533412 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f089c1083f0 msgr2=0x7f089c19b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:04.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.195+0000 7f089b7fe640 1 --2- 172.21.15.70:0/2744533412 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f089c1083f0 0x7f089c19b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:04.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.195+0000 7f089b7fe640 1 -- 172.21.15.70:0/2744533412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f089c1a6680 con 0x7f089c108d40 2024-09-21T05:47:04.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.195+0000 7f08927fc640 1 --2- 172.21.15.70:0/2744533412 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f089c1083f0 0x7f089c19b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:47:04.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.196+0000 7f089b7fe640 1 --2- 172.21.15.70:0/2744533412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f089c108d40 0x7f089c19be40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f089400b970 tx=0x7f089400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:04.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.196+0000 7f0898ff9640 1 -- 172.21.15.70:0/2744533412 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0894019070 con 0x7f089c108d40 2024-09-21T05:47:04.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.196+0000 7f0898ff9640 1 -- 172.21.15.70:0/2744533412 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f0894014440 con 0x7f089c108d40 2024-09-21T05:47:04.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.196+0000 7f08a15d8640 1 -- 172.21.15.70:0/2744533412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f089c1a6970 con 0x7f089c108d40 2024-09-21T05:47:04.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.196+0000 7f0898ff9640 1 -- 172.21.15.70:0/2744533412 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08940075d0 con 0x7f089c108d40 2024-09-21T05:47:04.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.196+0000 7f08a15d8640 1 -- 172.21.15.70:0/2744533412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f089c1a6e60 con 0x7f089c108d40 2024-09-21T05:47:04.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.197+0000 7f08a15d8640 1 -- 172.21.15.70:0/2744533412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f089c102ec0 con 0x7f089c108d40 2024-09-21T05:47:04.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.199+0000 7f0898ff9640 1 -- 172.21.15.70:0/2744533412 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f089401c070 con 0x7f089c108d40 2024-09-21T05:47:04.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.200+0000 7f0898ff9640 1 --2- 172.21.15.70:0/2744533412 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f08880b6510 0x7f08880b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:04.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.200+0000 7f089affd640 1 --2- 172.21.15.70:0/2744533412 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f08880b6510 0x7f08880b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:04.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.200+0000 7f0898ff9640 1 -- 172.21.15.70:0/2744533412 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7497+0+0 (secure 0 0 0) 0x7f08940e69d0 con 0x7f089c108d40 2024-09-21T05:47:04.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.201+0000 7f089affd640 1 --2- 172.21.15.70:0/2744533412 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f08880b6510 0x7f08880b8a20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f088c005fd0 tx=0x7f088c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:04.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.203+0000 7f0898ff9640 1 -- 172.21.15.70:0/2744533412 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f08940ad590 con 0x7f089c108d40 2024-09-21T05:47:04.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.382+0000 7f08a15d8640 1 -- 172.21.15.70:0/2744533412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f089c06bf90 con 0x7f089c108d40 2024-09-21T05:47:04.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.606+0000 7f0898ff9640 1 -- 172.21.15.70:0/2744533412 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v73) ==== 171+0+0 (secure 0 0 0) 0x7f089c06bf90 con 0x7f089c108d40 2024-09-21T05:47:04.609 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data' created 2024-09-21T05:47:04.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.609+0000 7f08a15d8640 1 -- 172.21.15.70:0/2744533412 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f08880b6510 msgr2=0x7f08880b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:04.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.609+0000 7f08a15d8640 1 --2- 172.21.15.70:0/2744533412 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f08880b6510 0x7f08880b8a20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f088c005fd0 tx=0x7f088c005850 comp rx=0 tx=0).stop 2024-09-21T05:47:04.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.609+0000 7f08a15d8640 1 -- 172.21.15.70:0/2744533412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f089c108d40 msgr2=0x7f089c19be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:04.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.609+0000 7f08a15d8640 1 --2- 172.21.15.70:0/2744533412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f089c108d40 0x7f089c19be40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f089400b970 tx=0x7f089400be30 comp rx=0 tx=0).stop 2024-09-21T05:47:04.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.609+0000 7f08a15d8640 1 -- 172.21.15.70:0/2744533412 shutdown_connections 2024-09-21T05:47:04.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.609+0000 7f08a15d8640 1 --2- 172.21.15.70:0/2744533412 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f08880b6510 0x7f08880b8a20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:04.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.609+0000 7f08a15d8640 1 --2- 172.21.15.70:0/2744533412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f089c108d40 0x7f089c19be40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:04.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.609+0000 7f08a15d8640 1 --2- 172.21.15.70:0/2744533412 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f089c1083f0 0x7f089c19b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:04.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.609+0000 7f08a15d8640 1 --2- 172.21.15.70:0/2744533412 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f089c102ab0 0x7f089c19b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:04.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.609+0000 7f08a15d8640 1 -- 172.21.15.70:0/2744533412 >> 172.21.15.70:0/2744533412 conn(0x7f089c0796b0 msgr2=0x7f089c104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:04.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.609+0000 7f08a15d8640 1 -- 172.21.15.70:0/2744533412 shutdown_connections 2024-09-21T05:47:04.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:04.609+0000 7f08a15d8640 1 -- 172.21.15.70:0/2744533412 wait complete. 2024-09-21T05:47:04.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:04 smithi070 ceph-mon[30981]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T05:47:04.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:04 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2744533412' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T05:47:04.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:04 smithi160 ceph-mon[33979]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T05:47:04.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:04 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2744533412' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T05:47:05.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:04 smithi116 ceph-mon[34332]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T05:47:05.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:04 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2744533412' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T05:47:05.301 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T05:47:05.547 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:47:05.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:05 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2744533412' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T05:47:05.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:05 smithi160 ceph-mon[33979]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T05:47:05.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:05 smithi160 ceph-mon[33979]: pgmap v287: 97 pgs: 7 creating+peering, 78 unknown, 12 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:05.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:05 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2744533412' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T05:47:05.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:05 smithi070 ceph-mon[30981]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T05:47:05.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:05 smithi070 ceph-mon[30981]: pgmap v287: 97 pgs: 7 creating+peering, 78 unknown, 12 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:06.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.023+0000 7f6860ceb640 1 -- 172.21.15.70:0/1037654554 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f685c105d90 msgr2=0x7f685c1061a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:06.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.023+0000 7f6860ceb640 1 --2- 172.21.15.70:0/1037654554 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f685c105d90 0x7f685c1061a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f684c009900 tx=0x7f684c02a410 comp rx=0 tx=0).stop 2024-09-21T05:47:06.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.023+0000 7f6860ceb640 1 -- 172.21.15.70:0/1037654554 shutdown_connections 2024-09-21T05:47:06.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.023+0000 7f6860ceb640 1 --2- 172.21.15.70:0/1037654554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f685c10c020 0x7f685c112850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:06.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.023+0000 7f6860ceb640 1 --2- 172.21.15.70:0/1037654554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f685c10b6d0 0x7f685c10bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:06.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.023+0000 7f6860ceb640 1 --2- 172.21.15.70:0/1037654554 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f685c105d90 0x7f685c1061a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:06.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.023+0000 7f6860ceb640 1 -- 172.21.15.70:0/1037654554 >> 172.21.15.70:0/1037654554 conn(0x7f685c101800 msgr2=0x7f685c103c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:06.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.023+0000 7f6860ceb640 1 -- 172.21.15.70:0/1037654554 shutdown_connections 2024-09-21T05:47:06.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.023+0000 7f6860ceb640 1 -- 172.21.15.70:0/1037654554 wait complete. 2024-09-21T05:47:06.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.023+0000 7f6860ceb640 1 Processor -- start 2024-09-21T05:47:06.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.024+0000 7f6860ceb640 1 -- start start 2024-09-21T05:47:06.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.024+0000 7f6860ceb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f685c105d90 0x7f685c19c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:06.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.024+0000 7f6860ceb640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f685c10b6d0 0x7f685c19cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:06.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.024+0000 7f6860ceb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f685c10c020 0x7f685c1a1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:06.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.024+0000 7f6860ceb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f685c115cd0 con 0x7f685c105d90 2024-09-21T05:47:06.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.024+0000 7f6860ceb640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f685c115b50 con 0x7f685c10c020 2024-09-21T05:47:06.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.024+0000 7f6860ceb640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f685c115e50 con 0x7f685c10b6d0 2024-09-21T05:47:06.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.024+0000 7f685a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f685c105d90 0x7f685c19c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:06.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.024+0000 7f685a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f685c105d90 0x7f685c19c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33816/0 (socket says 172.21.15.70:33816) 2024-09-21T05:47:06.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.024+0000 7f685a59c640 1 -- 172.21.15.70:0/624176779 learned_addr learned my addr 172.21.15.70:0/624176779 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:47:06.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.024+0000 7f685ad9d640 1 --2- 172.21.15.70:0/624176779 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f685c10c020 0x7f685c1a1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:06.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.024+0000 7f6851d9b640 1 --2- 172.21.15.70:0/624176779 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f685c10b6d0 0x7f685c19cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:06.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.024+0000 7f685a59c640 1 -- 172.21.15.70:0/624176779 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f685c10b6d0 msgr2=0x7f685c19cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:06.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.024+0000 7f685a59c640 1 --2- 172.21.15.70:0/624176779 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f685c10b6d0 0x7f685c19cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:06.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.024+0000 7f685a59c640 1 -- 172.21.15.70:0/624176779 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f685c10c020 msgr2=0x7f685c1a1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:06.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.024+0000 7f685a59c640 1 --2- 172.21.15.70:0/624176779 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f685c10c020 0x7f685c1a1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:06.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.024+0000 7f685a59c640 1 -- 172.21.15.70:0/624176779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f685c1a2610 con 0x7f685c105d90 2024-09-21T05:47:06.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.025+0000 7f685a59c640 1 --2- 172.21.15.70:0/624176779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f685c105d90 0x7f685c19c6a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f684c005940 tx=0x7f684c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:06.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.025+0000 7f6853fff640 1 -- 172.21.15.70:0/624176779 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f684c03f030 con 0x7f685c105d90 2024-09-21T05:47:06.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.025+0000 7f6853fff640 1 -- 172.21.15.70:0/624176779 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f684c003cb0 con 0x7f685c105d90 2024-09-21T05:47:06.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.025+0000 7f6860ceb640 1 -- 172.21.15.70:0/624176779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f685c1a28a0 con 0x7f685c105d90 2024-09-21T05:47:06.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.025+0000 7f6853fff640 1 -- 172.21.15.70:0/624176779 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f684c035070 con 0x7f685c105d90 2024-09-21T05:47:06.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.025+0000 7f6860ceb640 1 -- 172.21.15.70:0/624176779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f685c1a9060 con 0x7f685c105d90 2024-09-21T05:47:06.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.026+0000 7f6860ceb640 1 -- 172.21.15.70:0/624176779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f685c1061a0 con 0x7f685c105d90 2024-09-21T05:47:06.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.028+0000 7f6853fff640 1 -- 172.21.15.70:0/624176779 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f684c042030 con 0x7f685c105d90 2024-09-21T05:47:06.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.028+0000 7f6853fff640 1 --2- 172.21.15.70:0/624176779 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f68480b6510 0x7f68480b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:06.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.028+0000 7f6851d9b640 1 --2- 172.21.15.70:0/624176779 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f68480b6510 0x7f68480b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:06.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.029+0000 7f6853fff640 1 -- 172.21.15.70:0/624176779 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7879+0+0 (secure 0 0 0) 0x7f684c107c10 con 0x7f685c105d90 2024-09-21T05:47:06.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.029+0000 7f6851d9b640 1 --2- 172.21.15.70:0/624176779 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f68480b6510 0x7f68480b8a20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f685c10b1d0 tx=0x7f684400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:06.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.032+0000 7f6853fff640 1 -- 172.21.15.70:0/624176779 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f684c0d2a30 con 0x7f685c105d90 2024-09-21T05:47:06.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:05 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2744533412' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T05:47:06.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:05 smithi116 ceph-mon[34332]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T05:47:06.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:05 smithi116 ceph-mon[34332]: pgmap v287: 97 pgs: 7 creating+peering, 78 unknown, 12 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:06.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.245+0000 7f6860ceb640 1 -- 172.21.15.70:0/624176779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f685c19d7d0 con 0x7f685c105d90 2024-09-21T05:47:06.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.615+0000 7f6853fff640 1 -- 172.21.15.70:0/624176779 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f684c0b3e20 con 0x7f685c105d90 2024-09-21T05:47:06.617 INFO:teuthology.orchestra.run.smithi070.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T05:47:06.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.618+0000 7f6860ceb640 1 -- 172.21.15.70:0/624176779 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f68480b6510 msgr2=0x7f68480b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:06.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.618+0000 7f6860ceb640 1 --2- 172.21.15.70:0/624176779 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f68480b6510 0x7f68480b8a20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f685c10b1d0 tx=0x7f684400b390 comp rx=0 tx=0).stop 2024-09-21T05:47:06.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.618+0000 7f6860ceb640 1 -- 172.21.15.70:0/624176779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f685c105d90 msgr2=0x7f685c19c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:06.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.618+0000 7f6860ceb640 1 --2- 172.21.15.70:0/624176779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f685c105d90 0x7f685c19c6a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f684c005940 tx=0x7f684c0042f0 comp rx=0 tx=0).stop 2024-09-21T05:47:06.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.618+0000 7f6860ceb640 1 -- 172.21.15.70:0/624176779 shutdown_connections 2024-09-21T05:47:06.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.618+0000 7f6860ceb640 1 --2- 172.21.15.70:0/624176779 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f68480b6510 0x7f68480b8a20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:06.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.618+0000 7f6860ceb640 1 --2- 172.21.15.70:0/624176779 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f685c10b6d0 0x7f685c19cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:06.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.618+0000 7f6860ceb640 1 --2- 172.21.15.70:0/624176779 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f685c10c020 0x7f685c1a1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:06.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.618+0000 7f6860ceb640 1 --2- 172.21.15.70:0/624176779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f685c105d90 0x7f685c19c6a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:06.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.618+0000 7f6860ceb640 1 -- 172.21.15.70:0/624176779 >> 172.21.15.70:0/624176779 conn(0x7f685c101800 msgr2=0x7f685c103c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:06.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.618+0000 7f6860ceb640 1 -- 172.21.15.70:0/624176779 shutdown_connections 2024-09-21T05:47:06.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:06.618+0000 7f6860ceb640 1 -- 172.21.15.70:0/624176779 wait complete. 2024-09-21T05:47:06.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:06 smithi160 ceph-mon[33979]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T05:47:06.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:06 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/624176779' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T05:47:06.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:06 smithi160 ceph-mon[33979]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T05:47:06.926 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:06 smithi070 ceph-mon[30981]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T05:47:06.926 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:06 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/624176779' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T05:47:06.927 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:06 smithi070 ceph-mon[30981]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T05:47:07.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:06 smithi116 ceph-mon[34332]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T05:47:07.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:06 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/624176779' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T05:47:07.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:06 smithi116 ceph-mon[34332]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T05:47:07.266 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-21T05:47:07.266 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-21T05:47:07.515 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:47:07.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:07 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/624176779' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T05:47:07.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:07 smithi160 ceph-mon[33979]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T05:47:07.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:07 smithi160 ceph-mon[33979]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T05:47:07.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:07 smithi160 ceph-mon[33979]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T05:47:07.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:07 smithi160 ceph-mon[33979]: pgmap v290: 97 pgs: 3 creating+activating, 7 creating+peering, 26 unknown, 61 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:07.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:07 smithi160 ceph-mon[33979]: mds.? [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] up:active 2024-09-21T05:47:07.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:07 smithi160 ceph-mon[33979]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T05:47:07.899 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:07 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/624176779' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T05:47:07.899 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:07 smithi070 ceph-mon[30981]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T05:47:07.899 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:07 smithi070 ceph-mon[30981]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T05:47:07.899 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:07 smithi070 ceph-mon[30981]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T05:47:07.899 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:07 smithi070 ceph-mon[30981]: pgmap v290: 97 pgs: 3 creating+activating, 7 creating+peering, 26 unknown, 61 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:07.899 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:07 smithi070 ceph-mon[30981]: mds.? [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] up:active 2024-09-21T05:47:07.899 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:07 smithi070 ceph-mon[30981]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T05:47:07.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.991+0000 7ff161194640 1 -- 172.21.15.70:0/3034045196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff15c102ae0 msgr2=0x7ff15c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:07.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.991+0000 7ff161194640 1 --2- 172.21.15.70:0/3034045196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff15c102ae0 0x7ff15c102ef0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff14c009900 tx=0x7ff14c02a410 comp rx=0 tx=0).stop 2024-09-21T05:47:07.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.991+0000 7ff161194640 1 -- 172.21.15.70:0/3034045196 shutdown_connections 2024-09-21T05:47:07.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.991+0000 7ff161194640 1 --2- 172.21.15.70:0/3034045196 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff15c108d20 0x7ff15c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:07.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.991+0000 7ff161194640 1 --2- 172.21.15.70:0/3034045196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff15c1083d0 0x7ff15c1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:07.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.991+0000 7ff161194640 1 --2- 172.21.15.70:0/3034045196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff15c102ae0 0x7ff15c102ef0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:07.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.991+0000 7ff161194640 1 -- 172.21.15.70:0/3034045196 >> 172.21.15.70:0/3034045196 conn(0x7ff15c0797b0 msgr2=0x7ff15c079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:07.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.991+0000 7ff161194640 1 -- 172.21.15.70:0/3034045196 shutdown_connections 2024-09-21T05:47:07.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.991+0000 7ff161194640 1 -- 172.21.15.70:0/3034045196 wait complete. 2024-09-21T05:47:07.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.992+0000 7ff161194640 1 Processor -- start 2024-09-21T05:47:07.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.992+0000 7ff161194640 1 -- start start 2024-09-21T05:47:07.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.992+0000 7ff161194640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff15c102ae0 0x7ff15c1991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:07.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.992+0000 7ff161194640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff15c1083d0 0x7ff15c199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:07.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.992+0000 7ff161194640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff15c108d20 0x7ff15c199c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:07.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.992+0000 7ff161194640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff15c1129d0 con 0x7ff15c102ae0 2024-09-21T05:47:07.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.992+0000 7ff161194640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff15c112850 con 0x7ff15c108d20 2024-09-21T05:47:07.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.992+0000 7ff161194640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff15c112b50 con 0x7ff15c1083d0 2024-09-21T05:47:07.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.992+0000 7ff15ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff15c102ae0 0x7ff15c1991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:07.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.992+0000 7ff15ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff15c102ae0 0x7ff15c1991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33828/0 (socket says 172.21.15.70:33828) 2024-09-21T05:47:07.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.993+0000 7ff15ad9d640 1 -- 172.21.15.70:0/3888252950 learned_addr learned my addr 172.21.15.70:0/3888252950 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:47:07.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.993+0000 7ff15a59c640 1 --2- 172.21.15.70:0/3888252950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff15c1083d0 0x7ff15c199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:07.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.993+0000 7ff15b59e640 1 --2- 172.21.15.70:0/3888252950 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff15c108d20 0x7ff15c199c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:07.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.993+0000 7ff15ad9d640 1 -- 172.21.15.70:0/3888252950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff15c1083d0 msgr2=0x7ff15c199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:07.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.993+0000 7ff15ad9d640 1 --2- 172.21.15.70:0/3888252950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff15c1083d0 0x7ff15c199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:07.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.993+0000 7ff15ad9d640 1 -- 172.21.15.70:0/3888252950 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff15c108d20 msgr2=0x7ff15c199c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:07.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.993+0000 7ff15ad9d640 1 --2- 172.21.15.70:0/3888252950 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff15c108d20 0x7ff15c199c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:07.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.993+0000 7ff15ad9d640 1 -- 172.21.15.70:0/3888252950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff15c1a88a0 con 0x7ff15c102ae0 2024-09-21T05:47:07.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.993+0000 7ff15ad9d640 1 --2- 172.21.15.70:0/3888252950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff15c102ae0 0x7ff15c1991f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff14c005940 tx=0x7ff14c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:07.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.993+0000 7ff153fff640 1 -- 172.21.15.70:0/3888252950 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14c03f030 con 0x7ff15c102ae0 2024-09-21T05:47:07.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.993+0000 7ff161194640 1 -- 172.21.15.70:0/3888252950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff15c1a8b30 con 0x7ff15c102ae0 2024-09-21T05:47:07.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.993+0000 7ff153fff640 1 -- 172.21.15.70:0/3888252950 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7ff14c003aa0 con 0x7ff15c102ae0 2024-09-21T05:47:07.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.993+0000 7ff153fff640 1 -- 172.21.15.70:0/3888252950 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14c035070 con 0x7ff15c102ae0 2024-09-21T05:47:07.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.993+0000 7ff161194640 1 -- 172.21.15.70:0/3888252950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff15c1a9060 con 0x7ff15c102ae0 2024-09-21T05:47:07.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.994+0000 7ff161194640 1 -- 172.21.15.70:0/3888252950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff15c102ef0 con 0x7ff15c102ae0 2024-09-21T05:47:07.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.996+0000 7ff153fff640 1 -- 172.21.15.70:0/3888252950 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7ff14c042030 con 0x7ff15c102ae0 2024-09-21T05:47:07.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.997+0000 7ff153fff640 1 --2- 172.21.15.70:0/3888252950 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7ff1480b6510 0x7ff1480b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:07.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.997+0000 7ff15a59c640 1 --2- 172.21.15.70:0/3888252950 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7ff1480b6510 0x7ff1480b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:07.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.997+0000 7ff153fff640 1 -- 172.21.15.70:0/3888252950 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7ff14c107a20 con 0x7ff15c102ae0 2024-09-21T05:47:07.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:07.997+0000 7ff15a59c640 1 --2- 172.21.15.70:0/3888252950 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7ff1480b6510 0x7ff1480b8a20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff15c079cd0 tx=0x7ff14400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:08.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:08.000+0000 7ff153fff640 1 -- 172.21.15.70:0/3888252950 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff14c0d27e0 con 0x7ff15c102ae0 2024-09-21T05:47:08.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:07 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/624176779' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T05:47:08.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:07 smithi116 ceph-mon[34332]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T05:47:08.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:07 smithi116 ceph-mon[34332]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T05:47:08.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:07 smithi116 ceph-mon[34332]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T05:47:08.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:07 smithi116 ceph-mon[34332]: pgmap v290: 97 pgs: 3 creating+activating, 7 creating+peering, 26 unknown, 61 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:08.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:07 smithi116 ceph-mon[34332]: mds.? [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] up:active 2024-09-21T05:47:08.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:07 smithi116 ceph-mon[34332]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T05:47:08.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:08.185+0000 7ff161194640 1 -- 172.21.15.70:0/3888252950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7ff15c10ab20 con 0x7ff15c102ae0 2024-09-21T05:47:08.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:08.632+0000 7ff153fff640 1 -- 172.21.15.70:0/3888252950 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v76) ==== 157+0+0 (secure 0 0 0) 0x7ff14c0d7720 con 0x7ff15c102ae0 2024-09-21T05:47:08.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:08.635+0000 7ff161194640 1 -- 172.21.15.70:0/3888252950 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7ff1480b6510 msgr2=0x7ff1480b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:08.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:08.635+0000 7ff161194640 1 --2- 172.21.15.70:0/3888252950 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7ff1480b6510 0x7ff1480b8a20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff15c079cd0 tx=0x7ff14400b390 comp rx=0 tx=0).stop 2024-09-21T05:47:08.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:08.635+0000 7ff161194640 1 -- 172.21.15.70:0/3888252950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff15c102ae0 msgr2=0x7ff15c1991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:08.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:08.635+0000 7ff161194640 1 --2- 172.21.15.70:0/3888252950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff15c102ae0 0x7ff15c1991f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff14c005940 tx=0x7ff14c004270 comp rx=0 tx=0).stop 2024-09-21T05:47:08.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:08.635+0000 7ff161194640 1 -- 172.21.15.70:0/3888252950 shutdown_connections 2024-09-21T05:47:08.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:08.635+0000 7ff161194640 1 --2- 172.21.15.70:0/3888252950 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7ff1480b6510 0x7ff1480b8a20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:08.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:08.635+0000 7ff161194640 1 --2- 172.21.15.70:0/3888252950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff15c1083d0 0x7ff15c199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:08.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:08.635+0000 7ff161194640 1 --2- 172.21.15.70:0/3888252950 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff15c108d20 0x7ff15c199c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:08.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:08.635+0000 7ff161194640 1 --2- 172.21.15.70:0/3888252950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff15c102ae0 0x7ff15c1991f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:08.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:08.635+0000 7ff161194640 1 -- 172.21.15.70:0/3888252950 >> 172.21.15.70:0/3888252950 conn(0x7ff15c0797b0 msgr2=0x7ff15c1065c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:08.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:08.635+0000 7ff161194640 1 -- 172.21.15.70:0/3888252950 shutdown_connections 2024-09-21T05:47:08.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:08.635+0000 7ff161194640 1 -- 172.21.15.70:0/3888252950 wait complete. 2024-09-21T05:47:08.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:08 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3888252950' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T05:47:08.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:08 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3888252950' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T05:47:09.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:08 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3888252950' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T05:47:09.286 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T05:47:09.531 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:47:09.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:09 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3888252950' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T05:47:09.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:09 smithi160 ceph-mon[33979]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T05:47:09.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:09 smithi160 ceph-mon[33979]: pgmap v292: 97 pgs: 3 creating+activating, 4 creating+peering, 90 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail; 642 B/s wr, 3 op/s 2024-09-21T05:47:09.929 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:09 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3888252950' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T05:47:09.929 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:09 smithi070 ceph-mon[30981]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T05:47:09.929 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:09 smithi070 ceph-mon[30981]: pgmap v292: 97 pgs: 3 creating+activating, 4 creating+peering, 90 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail; 642 B/s wr, 3 op/s 2024-09-21T05:47:10.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.026+0000 7ff5e3066640 1 -- 172.21.15.70:0/2451240922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5dc102a80 msgr2=0x7ff5dc102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:10.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.026+0000 7ff5e3066640 1 --2- 172.21.15.70:0/2451240922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5dc102a80 0x7ff5dc102e90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0009900 tx=0x7ff5d002a410 comp rx=0 tx=0).stop 2024-09-21T05:47:10.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.026+0000 7ff5e3066640 1 -- 172.21.15.70:0/2451240922 shutdown_connections 2024-09-21T05:47:10.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.026+0000 7ff5e3066640 1 --2- 172.21.15.70:0/2451240922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5dc1083c0 0x7ff5dc1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:10.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.026+0000 7ff5e3066640 1 --2- 172.21.15.70:0/2451240922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5dc108d10 0x7ff5dc10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:10.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.026+0000 7ff5e3066640 1 --2- 172.21.15.70:0/2451240922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5dc102a80 0x7ff5dc102e90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:10.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.026+0000 7ff5e3066640 1 -- 172.21.15.70:0/2451240922 >> 172.21.15.70:0/2451240922 conn(0x7ff5dc0797e0 msgr2=0x7ff5dc079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:10.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.026+0000 7ff5e3066640 1 -- 172.21.15.70:0/2451240922 shutdown_connections 2024-09-21T05:47:10.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.026+0000 7ff5e3066640 1 -- 172.21.15.70:0/2451240922 wait complete. 2024-09-21T05:47:10.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.027+0000 7ff5e3066640 1 Processor -- start 2024-09-21T05:47:10.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.027+0000 7ff5e3066640 1 -- start start 2024-09-21T05:47:10.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.027+0000 7ff5e3066640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5dc102a80 0x7ff5dc19a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:10.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.027+0000 7ff5e3066640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5dc1083c0 0x7ff5dc19aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:10.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.027+0000 7ff5e3066640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5dc108d10 0x7ff5dc19fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:10.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.027+0000 7ff5e3066640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc1129a0 con 0x7ff5dc1083c0 2024-09-21T05:47:10.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.027+0000 7ff5e3066640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc112820 con 0x7ff5dc102a80 2024-09-21T05:47:10.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.027+0000 7ff5e3066640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc112b20 con 0x7ff5dc108d10 2024-09-21T05:47:10.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.027+0000 7ff5dbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5dc1083c0 0x7ff5dc19aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:10.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.027+0000 7ff5dbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5dc1083c0 0x7ff5dc19aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33840/0 (socket says 172.21.15.70:33840) 2024-09-21T05:47:10.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.027+0000 7ff5dbfff640 1 -- 172.21.15.70:0/192000276 learned_addr learned my addr 172.21.15.70:0/192000276 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:47:10.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.027+0000 7ff5e1603640 1 --2- 172.21.15.70:0/192000276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5dc108d10 0x7ff5dc19fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:10.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.027+0000 7ff5dbfff640 1 -- 172.21.15.70:0/192000276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5dc108d10 msgr2=0x7ff5dc19fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:10.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.027+0000 7ff5dbfff640 1 --2- 172.21.15.70:0/192000276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5dc108d10 0x7ff5dc19fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:10.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.027+0000 7ff5dbfff640 1 -- 172.21.15.70:0/192000276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5dc102a80 msgr2=0x7ff5dc19a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:10.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.027+0000 7ff5e0e02640 1 --2- 172.21.15.70:0/192000276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5dc102a80 0x7ff5dc19a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:10.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.027+0000 7ff5dbfff640 1 --2- 172.21.15.70:0/192000276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5dc102a80 0x7ff5dc19a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:10.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.027+0000 7ff5dbfff640 1 -- 172.21.15.70:0/192000276 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5dc1a04b0 con 0x7ff5dc1083c0 2024-09-21T05:47:10.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.027+0000 7ff5e1603640 1 --2- 172.21.15.70:0/192000276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5dc108d10 0x7ff5dc19fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:47:10.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.027+0000 7ff5dbfff640 1 --2- 172.21.15.70:0/192000276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5dc1083c0 0x7ff5dc19aae0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff5c800d950 tx=0x7ff5c800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:10.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.028+0000 7ff5d9ffb640 1 -- 172.21.15.70:0/192000276 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8017070 con 0x7ff5dc1083c0 2024-09-21T05:47:10.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.028+0000 7ff5d9ffb640 1 -- 172.21.15.70:0/192000276 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7ff5c8009c30 con 0x7ff5dc1083c0 2024-09-21T05:47:10.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.028+0000 7ff5e3066640 1 -- 172.21.15.70:0/192000276 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5dc1a07a0 con 0x7ff5dc1083c0 2024-09-21T05:47:10.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.028+0000 7ff5d9ffb640 1 -- 172.21.15.70:0/192000276 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c80047a0 con 0x7ff5dc1083c0 2024-09-21T05:47:10.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.028+0000 7ff5e3066640 1 -- 172.21.15.70:0/192000276 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5dc1a6f00 con 0x7ff5dc1083c0 2024-09-21T05:47:10.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.029+0000 7ff5e3066640 1 -- 172.21.15.70:0/192000276 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5dc103d00 con 0x7ff5dc1083c0 2024-09-21T05:47:10.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.030+0000 7ff5d9ffb640 1 -- 172.21.15.70:0/192000276 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7ff5c8004020 con 0x7ff5dc1083c0 2024-09-21T05:47:10.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.031+0000 7ff5d9ffb640 1 --2- 172.21.15.70:0/192000276 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7ff5cc0b6510 0x7ff5cc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:10.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.031+0000 7ff5e0e02640 1 --2- 172.21.15.70:0/192000276 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7ff5cc0b6510 0x7ff5cc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:10.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.031+0000 7ff5d9ffb640 1 -- 172.21.15.70:0/192000276 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8277+0+0 (secure 0 0 0) 0x7ff5c80e7450 con 0x7ff5dc1083c0 2024-09-21T05:47:10.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.032+0000 7ff5e0e02640 1 --2- 172.21.15.70:0/192000276 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7ff5cc0b6510 0x7ff5cc0b8a20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff5d002a930 tx=0x7ff5d0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:10.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.034+0000 7ff5d9ffb640 1 -- 172.21.15.70:0/192000276 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff5c8020020 con 0x7ff5dc1083c0 2024-09-21T05:47:10.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:09 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3888252950' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T05:47:10.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:09 smithi116 ceph-mon[34332]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T05:47:10.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:09 smithi116 ceph-mon[34332]: pgmap v292: 97 pgs: 3 creating+activating, 4 creating+peering, 90 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail; 642 B/s wr, 3 op/s 2024-09-21T05:47:10.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:10.214+0000 7ff5e3066640 1 -- 172.21.15.70:0/192000276 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff5dc1a71b0 con 0x7ff5dc1083c0 2024-09-21T05:47:10.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:10 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/192000276' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T05:47:10.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:10 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/192000276' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T05:47:11.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:10 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/192000276' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T05:47:11.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:11.651+0000 7ff5d9ffb640 1 -- 172.21.15.70:0/192000276 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v78) ==== 228+0+0 (secure 0 0 0) 0x7ff5c80adcb0 con 0x7ff5dc1083c0 2024-09-21T05:47:11.653 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data_ec' created 2024-09-21T05:47:11.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:11.655+0000 7ff5e3066640 1 -- 172.21.15.70:0/192000276 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7ff5cc0b6510 msgr2=0x7ff5cc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:11.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:11.655+0000 7ff5e3066640 1 --2- 172.21.15.70:0/192000276 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7ff5cc0b6510 0x7ff5cc0b8a20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff5d002a930 tx=0x7ff5d0000bc0 comp rx=0 tx=0).stop 2024-09-21T05:47:11.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:11.655+0000 7ff5e3066640 1 -- 172.21.15.70:0/192000276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5dc1083c0 msgr2=0x7ff5dc19aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:11.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:11.655+0000 7ff5e3066640 1 --2- 172.21.15.70:0/192000276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5dc1083c0 0x7ff5dc19aae0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff5c800d950 tx=0x7ff5c800de10 comp rx=0 tx=0).stop 2024-09-21T05:47:11.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:11.655+0000 7ff5e3066640 1 -- 172.21.15.70:0/192000276 shutdown_connections 2024-09-21T05:47:11.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:11.655+0000 7ff5e3066640 1 --2- 172.21.15.70:0/192000276 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7ff5cc0b6510 0x7ff5cc0b8a20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:11.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:11.655+0000 7ff5e3066640 1 --2- 172.21.15.70:0/192000276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5dc108d10 0x7ff5dc19fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:11.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:11.655+0000 7ff5e3066640 1 --2- 172.21.15.70:0/192000276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5dc1083c0 0x7ff5dc19aae0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:11.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:11.655+0000 7ff5e3066640 1 --2- 172.21.15.70:0/192000276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5dc102a80 0x7ff5dc19a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:11.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:11.655+0000 7ff5e3066640 1 -- 172.21.15.70:0/192000276 >> 172.21.15.70:0/192000276 conn(0x7ff5dc0797e0 msgr2=0x7ff5dc101870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:11.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:11.655+0000 7ff5e3066640 1 -- 172.21.15.70:0/192000276 shutdown_connections 2024-09-21T05:47:11.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:11.655+0000 7ff5e3066640 1 -- 172.21.15.70:0/192000276 wait complete. 2024-09-21T05:47:11.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:11 smithi070 ceph-mon[30981]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T05:47:11.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:11 smithi070 ceph-mon[30981]: pgmap v294: 97 pgs: 97 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 3 op/s 2024-09-21T05:47:12.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:11 smithi116 ceph-mon[34332]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T05:47:12.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:11 smithi116 ceph-mon[34332]: pgmap v294: 97 pgs: 97 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 3 op/s 2024-09-21T05:47:12.054 INFO:journalctl@ceph.mds.b.smithi116.stdout:Sep 21 05:47:11 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-b[62172]: 2024-09-21T05:47:11.632+0000 7f0c3ec80640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T05:47:12.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:11 smithi160 ceph-mon[33979]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T05:47:12.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:11 smithi160 ceph-mon[33979]: pgmap v294: 97 pgs: 97 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 3 op/s 2024-09-21T05:47:12.375 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-21T05:47:12.624 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:47:12.662 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:12 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/192000276' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T05:47:12.662 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:12 smithi070 ceph-mon[30981]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T05:47:13.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:12 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/192000276' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T05:47:13.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:12 smithi116 ceph-mon[34332]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T05:47:13.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.088+0000 7f6ff2edf640 1 -- 172.21.15.70:0/4245242641 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6fec105300 msgr2=0x7f6fec10d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:13.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.088+0000 7f6ff2edf640 1 --2- 172.21.15.70:0/4245242641 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6fec105300 0x7f6fec10d850 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4009900 tx=0x7f6fd402a410 comp rx=0 tx=0).stop 2024-09-21T05:47:13.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.088+0000 7f6ff2edf640 1 -- 172.21.15.70:0/4245242641 shutdown_connections 2024-09-21T05:47:13.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.088+0000 7f6ff2edf640 1 --2- 172.21.15.70:0/4245242641 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6fec10de10 0x7f6fec110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:13.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.088+0000 7f6ff2edf640 1 --2- 172.21.15.70:0/4245242641 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6fec105300 0x7f6fec10d850 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:13.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.088+0000 7f6ff2edf640 1 --2- 172.21.15.70:0/4245242641 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fec1049b0 0x7f6fec104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:13.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.088+0000 7f6ff2edf640 1 -- 172.21.15.70:0/4245242641 >> 172.21.15.70:0/4245242641 conn(0x7f6fec079730 msgr2=0x7f6fec079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:13.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.088+0000 7f6ff2edf640 1 -- 172.21.15.70:0/4245242641 shutdown_connections 2024-09-21T05:47:13.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.088+0000 7f6ff2edf640 1 -- 172.21.15.70:0/4245242641 wait complete. 2024-09-21T05:47:13.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.089+0000 7f6ff2edf640 1 Processor -- start 2024-09-21T05:47:13.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.089+0000 7f6ff2edf640 1 -- start start 2024-09-21T05:47:13.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.089+0000 7f6ff2edf640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6fec1049b0 0x7f6fec19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:13.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.089+0000 7f6ff2edf640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fec105300 0x7f6fec19aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:13.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.089+0000 7f6ff2edf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6fec10de10 0x7f6fec19fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:13.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.089+0000 7f6ff2edf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec113a40 con 0x7f6fec10de10 2024-09-21T05:47:13.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.089+0000 7f6ff2edf640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec1138c0 con 0x7f6fec105300 2024-09-21T05:47:13.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.089+0000 7f6ff2edf640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec113bc0 con 0x7f6fec1049b0 2024-09-21T05:47:13.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.089+0000 7f6ff147c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6fec10de10 0x7f6fec19fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:13.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.089+0000 7f6ff147c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6fec10de10 0x7f6fec19fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56944/0 (socket says 172.21.15.70:56944) 2024-09-21T05:47:13.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.089+0000 7f6ff147c640 1 -- 172.21.15.70:0/986153740 learned_addr learned my addr 172.21.15.70:0/986153740 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:47:13.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.089+0000 7f6ff0c7b640 1 --2- 172.21.15.70:0/986153740 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6fec1049b0 0x7f6fec19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:13.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.089+0000 7f6febfff640 1 --2- 172.21.15.70:0/986153740 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fec105300 0x7f6fec19aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:13.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.089+0000 7f6ff147c640 1 -- 172.21.15.70:0/986153740 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6fec1049b0 msgr2=0x7f6fec19a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:13.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.089+0000 7f6ff147c640 1 --2- 172.21.15.70:0/986153740 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6fec1049b0 0x7f6fec19a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:13.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.089+0000 7f6ff147c640 1 -- 172.21.15.70:0/986153740 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fec105300 msgr2=0x7f6fec19aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:13.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.089+0000 7f6ff147c640 1 --2- 172.21.15.70:0/986153740 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fec105300 0x7f6fec19aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:13.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.089+0000 7f6ff147c640 1 -- 172.21.15.70:0/986153740 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fec1a0340 con 0x7f6fec10de10 2024-09-21T05:47:13.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.089+0000 7f6febfff640 1 --2- 172.21.15.70:0/986153740 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fec105300 0x7f6fec19aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:47:13.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.090+0000 7f6ff147c640 1 --2- 172.21.15.70:0/986153740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6fec10de10 0x7f6fec19fcd0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400c970 tx=0x7f6fe400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:13.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.090+0000 7f6fe9ffb640 1 -- 172.21.15.70:0/986153740 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4007bb0 con 0x7f6fec10de10 2024-09-21T05:47:13.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.090+0000 7f6ff2edf640 1 -- 172.21.15.70:0/986153740 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fec1a0630 con 0x7f6fec10de10 2024-09-21T05:47:13.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.090+0000 7f6fe9ffb640 1 -- 172.21.15.70:0/986153740 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f6fe4007d50 con 0x7f6fec10de10 2024-09-21T05:47:13.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.090+0000 7f6fe9ffb640 1 -- 172.21.15.70:0/986153740 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4018700 con 0x7f6fec10de10 2024-09-21T05:47:13.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.090+0000 7f6ff2edf640 1 -- 172.21.15.70:0/986153740 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fec1a6e50 con 0x7f6fec10de10 2024-09-21T05:47:13.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.091+0000 7f6ff2edf640 1 -- 172.21.15.70:0/986153740 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fec104dc0 con 0x7f6fec10de10 2024-09-21T05:47:13.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.093+0000 7f6fe9ffb640 1 -- 172.21.15.70:0/986153740 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f6fe400fa20 con 0x7f6fec10de10 2024-09-21T05:47:13.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.093+0000 7f6fe9ffb640 1 --2- 172.21.15.70:0/986153740 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f6fd80b6540 0x7f6fd80b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:13.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.093+0000 7f6ff0c7b640 1 --2- 172.21.15.70:0/986153740 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f6fd80b6540 0x7f6fd80b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:13.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.093+0000 7f6fe9ffb640 1 -- 172.21.15.70:0/986153740 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8770+0+0 (secure 0 0 0) 0x7f6fe40e76f0 con 0x7f6fec10de10 2024-09-21T05:47:13.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.094+0000 7f6ff0c7b640 1 --2- 172.21.15.70:0/986153740 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f6fd80b6540 0x7f6fd80b8a50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6fec06bc60 tx=0x7f6fdc009870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:13.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.097+0000 7f6fe9ffb640 1 -- 172.21.15.70:0/986153740 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6fe4014030 con 0x7f6fec10de10 2024-09-21T05:47:13.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:12 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/192000276' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T05:47:13.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:12 smithi160 ceph-mon[33979]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T05:47:13.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.272+0000 7f6ff2edf640 1 -- 172.21.15.70:0/986153740 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f6fec19b5c0 con 0x7f6fec10de10 2024-09-21T05:47:13.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.665+0000 7f6fe9ffb640 1 -- 172.21.15.70:0/986153740 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v80) ==== 169+0+0 (secure 0 0 0) 0x7f6fe40addf0 con 0x7f6fec10de10 2024-09-21T05:47:13.668 INFO:teuthology.orchestra.run.smithi070.stderr:set pool 4 allow_ec_overwrites to true 2024-09-21T05:47:13.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.668+0000 7f6ff2edf640 1 -- 172.21.15.70:0/986153740 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f6fd80b6540 msgr2=0x7f6fd80b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:13.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.668+0000 7f6ff2edf640 1 --2- 172.21.15.70:0/986153740 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f6fd80b6540 0x7f6fd80b8a50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6fec06bc60 tx=0x7f6fdc009870 comp rx=0 tx=0).stop 2024-09-21T05:47:13.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.668+0000 7f6ff2edf640 1 -- 172.21.15.70:0/986153740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6fec10de10 msgr2=0x7f6fec19fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:13.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.668+0000 7f6ff2edf640 1 --2- 172.21.15.70:0/986153740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6fec10de10 0x7f6fec19fcd0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400c970 tx=0x7f6fe400ce30 comp rx=0 tx=0).stop 2024-09-21T05:47:13.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.668+0000 7f6ff2edf640 1 -- 172.21.15.70:0/986153740 shutdown_connections 2024-09-21T05:47:13.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.668+0000 7f6ff2edf640 1 --2- 172.21.15.70:0/986153740 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f6fd80b6540 0x7f6fd80b8a50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:13.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.668+0000 7f6ff2edf640 1 --2- 172.21.15.70:0/986153740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6fec10de10 0x7f6fec19fcd0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:13.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.668+0000 7f6ff2edf640 1 --2- 172.21.15.70:0/986153740 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fec105300 0x7f6fec19aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:13.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.668+0000 7f6ff2edf640 1 --2- 172.21.15.70:0/986153740 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6fec1049b0 0x7f6fec19a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:13.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.668+0000 7f6ff2edf640 1 -- 172.21.15.70:0/986153740 >> 172.21.15.70:0/986153740 conn(0x7f6fec079730 msgr2=0x7f6fec1008c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:13.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.668+0000 7f6ff2edf640 1 -- 172.21.15.70:0/986153740 shutdown_connections 2024-09-21T05:47:13.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:13.668+0000 7f6ff2edf640 1 -- 172.21.15.70:0/986153740 wait complete. 2024-09-21T05:47:13.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:13 smithi070 ceph-mon[30981]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T05:47:13.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:13 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/986153740' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T05:47:13.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:13 smithi070 ceph-mon[30981]: pgmap v297: 129 pgs: 2 creating+activating, 9 creating+peering, 16 unknown, 102 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 7 op/s 2024-09-21T05:47:14.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:13 smithi116 ceph-mon[34332]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T05:47:14.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:13 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/986153740' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T05:47:14.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:13 smithi116 ceph-mon[34332]: pgmap v297: 129 pgs: 2 creating+activating, 9 creating+peering, 16 unknown, 102 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 7 op/s 2024-09-21T05:47:14.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:13 smithi160 ceph-mon[33979]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T05:47:14.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:13 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/986153740' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T05:47:14.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:13 smithi160 ceph-mon[33979]: pgmap v297: 129 pgs: 2 creating+activating, 9 creating+peering, 16 unknown, 102 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 7 op/s 2024-09-21T05:47:14.330 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-21T05:47:14.574 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:47:14.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:14 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/986153740' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T05:47:14.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:14 smithi070 ceph-mon[30981]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T05:47:15.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:14 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/986153740' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T05:47:15.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:14 smithi116 ceph-mon[34332]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T05:47:15.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.091+0000 7f74909b1640 1 -- 172.21.15.70:0/764052703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f748c103950 msgr2=0x7f748c10f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:15.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.091+0000 7f74909b1640 1 --2- 172.21.15.70:0/764052703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f748c103950 0x7f748c10f500 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7484009ca0 tx=0x7f748402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:47:15.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.091+0000 7f74909b1640 1 -- 172.21.15.70:0/764052703 shutdown_connections 2024-09-21T05:47:15.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.091+0000 7f74909b1640 1 --2- 172.21.15.70:0/764052703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f748c103950 0x7f748c10f500 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:15.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.091+0000 7f74909b1640 1 --2- 172.21.15.70:0/764052703 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f748c103000 0x7f748c103410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:15.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.091+0000 7f74909b1640 1 --2- 172.21.15.70:0/764052703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f748c107690 0x7f748c107aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:15.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.091+0000 7f74909b1640 1 -- 172.21.15.70:0/764052703 >> 172.21.15.70:0/764052703 conn(0x7f748c079ea0 msgr2=0x7f748c07a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:15.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.091+0000 7f74909b1640 1 -- 172.21.15.70:0/764052703 shutdown_connections 2024-09-21T05:47:15.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.091+0000 7f74909b1640 1 -- 172.21.15.70:0/764052703 wait complete. 2024-09-21T05:47:15.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.092+0000 7f74909b1640 1 Processor -- start 2024-09-21T05:47:15.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.092+0000 7f74909b1640 1 -- start start 2024-09-21T05:47:15.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.092+0000 7f74909b1640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f748c103000 0x7f748c19a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:15.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.092+0000 7f74909b1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f748c103950 0x7f748c19aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:15.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.092+0000 7f74909b1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f748c107690 0x7f748c19fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:15.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.092+0000 7f74909b1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f748c113b90 con 0x7f748c103950 2024-09-21T05:47:15.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.092+0000 7f74909b1640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f748c113a10 con 0x7f748c107690 2024-09-21T05:47:15.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.092+0000 7f74909b1640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f748c113d10 con 0x7f748c103000 2024-09-21T05:47:15.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.092+0000 7f7489d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f748c103950 0x7f748c19aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:15.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.092+0000 7f7489d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f748c103950 0x7f748c19aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56972/0 (socket says 172.21.15.70:56972) 2024-09-21T05:47:15.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.093+0000 7f7489d9b640 1 -- 172.21.15.70:0/1197190060 learned_addr learned my addr 172.21.15.70:0/1197190060 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:47:15.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.093+0000 7f748a59c640 1 --2- 172.21.15.70:0/1197190060 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f748c103000 0x7f748c19a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:15.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.093+0000 7f748ad9d640 1 --2- 172.21.15.70:0/1197190060 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f748c107690 0x7f748c19fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:15.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.093+0000 7f7489d9b640 1 -- 172.21.15.70:0/1197190060 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f748c103000 msgr2=0x7f748c19a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:15.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.093+0000 7f7489d9b640 1 --2- 172.21.15.70:0/1197190060 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f748c103000 0x7f748c19a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:15.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.093+0000 7f7489d9b640 1 -- 172.21.15.70:0/1197190060 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f748c107690 msgr2=0x7f748c19fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:15.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.093+0000 7f7489d9b640 1 --2- 172.21.15.70:0/1197190060 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f748c107690 0x7f748c19fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:15.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.093+0000 7f7489d9b640 1 -- 172.21.15.70:0/1197190060 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f748c1a04b0 con 0x7f748c103950 2024-09-21T05:47:15.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.093+0000 7f748ad9d640 1 --2- 172.21.15.70:0/1197190060 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f748c107690 0x7f748c19fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:47:15.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.093+0000 7f7489d9b640 1 --2- 172.21.15.70:0/1197190060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f748c103950 0x7f748c19aae0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f747400c970 tx=0x7f747400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:15.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.093+0000 7f74837fe640 1 -- 172.21.15.70:0/1197190060 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7474004220 con 0x7f748c103950 2024-09-21T05:47:15.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.093+0000 7f74837fe640 1 -- 172.21.15.70:0/1197190060 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f74740043c0 con 0x7f748c103950 2024-09-21T05:47:15.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.093+0000 7f74909b1640 1 -- 172.21.15.70:0/1197190060 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f748c1a07a0 con 0x7f748c103950 2024-09-21T05:47:15.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.093+0000 7f74837fe640 1 -- 172.21.15.70:0/1197190060 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747400f450 con 0x7f748c103950 2024-09-21T05:47:15.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.093+0000 7f74909b1640 1 -- 172.21.15.70:0/1197190060 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f748c1a6f00 con 0x7f748c103950 2024-09-21T05:47:15.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.094+0000 7f74909b1640 1 -- 172.21.15.70:0/1197190060 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f748c103410 con 0x7f748c103950 2024-09-21T05:47:15.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.096+0000 7f74837fe640 1 -- 172.21.15.70:0/1197190060 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f7474003610 con 0x7f748c103950 2024-09-21T05:47:15.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.097+0000 7f74837fe640 1 --2- 172.21.15.70:0/1197190060 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f74780b6510 0x7f74780b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:15.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.097+0000 7f748a59c640 1 --2- 172.21.15.70:0/1197190060 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f74780b6510 0x7f74780b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:15.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.097+0000 7f74837fe640 1 -- 172.21.15.70:0/1197190060 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8770+0+0 (secure 0 0 0) 0x7f74740e7610 con 0x7f748c103950 2024-09-21T05:47:15.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.097+0000 7f748a59c640 1 --2- 172.21.15.70:0/1197190060 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f74780b6510 0x7f74780b8a20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f747c009890 tx=0x7f747c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:15.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.100+0000 7f74837fe640 1 -- 172.21.15.70:0/1197190060 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7474014030 con 0x7f748c103950 2024-09-21T05:47:15.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:14 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/986153740' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T05:47:15.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:14 smithi160 ceph-mon[33979]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T05:47:15.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.316+0000 7f74909b1640 1 -- 172.21.15.70:0/1197190060 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f748c19b670 con 0x7f748c103950 2024-09-21T05:47:15.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.675+0000 7f74837fe640 1 -- 172.21.15.70:0/1197190060 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v16) ==== 137+0+0 (secure 0 0 0) 0x7f74740adc80 con 0x7f748c103950 2024-09-21T05:47:15.678 INFO:teuthology.orchestra.run.smithi070.stderr:added data pool 4 to fsmap 2024-09-21T05:47:15.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.678+0000 7f74909b1640 1 -- 172.21.15.70:0/1197190060 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f74780b6510 msgr2=0x7f74780b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:15.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.678+0000 7f74909b1640 1 --2- 172.21.15.70:0/1197190060 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f74780b6510 0x7f74780b8a20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f747c009890 tx=0x7f747c008040 comp rx=0 tx=0).stop 2024-09-21T05:47:15.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.678+0000 7f74909b1640 1 -- 172.21.15.70:0/1197190060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f748c103950 msgr2=0x7f748c19aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:15.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.678+0000 7f74909b1640 1 --2- 172.21.15.70:0/1197190060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f748c103950 0x7f748c19aae0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f747400c970 tx=0x7f747400ce30 comp rx=0 tx=0).stop 2024-09-21T05:47:15.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.678+0000 7f74909b1640 1 -- 172.21.15.70:0/1197190060 shutdown_connections 2024-09-21T05:47:15.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.678+0000 7f74909b1640 1 --2- 172.21.15.70:0/1197190060 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f74780b6510 0x7f74780b8a20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:15.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.678+0000 7f74909b1640 1 --2- 172.21.15.70:0/1197190060 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f748c107690 0x7f748c19fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:15.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.678+0000 7f74909b1640 1 --2- 172.21.15.70:0/1197190060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f748c103950 0x7f748c19aae0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:15.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.678+0000 7f74909b1640 1 --2- 172.21.15.70:0/1197190060 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f748c103000 0x7f748c19a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:15.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.678+0000 7f74909b1640 1 -- 172.21.15.70:0/1197190060 >> 172.21.15.70:0/1197190060 conn(0x7f748c079ea0 msgr2=0x7f748c104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:15.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.678+0000 7f74909b1640 1 -- 172.21.15.70:0/1197190060 shutdown_connections 2024-09-21T05:47:15.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:15.678+0000 7f74909b1640 1 -- 172.21.15.70:0/1197190060 wait complete. 2024-09-21T05:47:15.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:15 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1197190060' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T05:47:15.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:15 smithi070 ceph-mon[30981]: pgmap v299: 129 pgs: 2 creating+activating, 9 creating+peering, 5 unknown, 113 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 862 B/s wr, 5 op/s 2024-09-21T05:47:16.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:15 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1197190060' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T05:47:16.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:15 smithi116 ceph-mon[34332]: pgmap v299: 129 pgs: 2 creating+activating, 9 creating+peering, 5 unknown, 113 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 862 B/s wr, 5 op/s 2024-09-21T05:47:16.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:15 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1197190060' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T05:47:16.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:15 smithi160 ceph-mon[33979]: pgmap v299: 129 pgs: 2 creating+activating, 9 creating+peering, 5 unknown, 113 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 862 B/s wr, 5 op/s 2024-09-21T05:47:16.349 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:47:16.594 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:47:16.972 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:16 smithi070 ceph-mon[30981]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T05:47:16.972 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:16 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1197190060' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T05:47:16.972 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:16 smithi070 ceph-mon[30981]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T05:47:17.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:16 smithi116 ceph-mon[34332]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T05:47:17.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:16 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1197190060' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T05:47:17.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:16 smithi116 ceph-mon[34332]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T05:47:17.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.059+0000 7fd45a9ee640 1 -- 172.21.15.70:0/44662028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd454103b60 msgr2=0x7fd454103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:17.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.059+0000 7fd45a9ee640 1 --2- 172.21.15.70:0/44662028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd454103b60 0x7fd454103f70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd444009900 tx=0x7fd44402a410 comp rx=0 tx=0).stop 2024-09-21T05:47:17.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.059+0000 7fd45a9ee640 1 -- 172.21.15.70:0/44662028 shutdown_connections 2024-09-21T05:47:17.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.059+0000 7fd45a9ee640 1 --2- 172.21.15.70:0/44662028 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd454109df0 0x7fd454110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:17.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.059+0000 7fd45a9ee640 1 --2- 172.21.15.70:0/44662028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4541094a0 0x7fd4541098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:17.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.059+0000 7fd45a9ee640 1 --2- 172.21.15.70:0/44662028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd454103b60 0x7fd454103f70 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:17.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.059+0000 7fd45a9ee640 1 -- 172.21.15.70:0/44662028 >> 172.21.15.70:0/44662028 conn(0x7fd45407b850 msgr2=0x7fd45407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:17.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.059+0000 7fd45a9ee640 1 -- 172.21.15.70:0/44662028 shutdown_connections 2024-09-21T05:47:17.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.059+0000 7fd45a9ee640 1 -- 172.21.15.70:0/44662028 wait complete. 2024-09-21T05:47:17.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.059+0000 7fd45a9ee640 1 Processor -- start 2024-09-21T05:47:17.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.059+0000 7fd45a9ee640 1 -- start start 2024-09-21T05:47:17.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.060+0000 7fd45a9ee640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd454103b60 0x7fd45419a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:17.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.060+0000 7fd45a9ee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4541094a0 0x7fd45419ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:17.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.060+0000 7fd45a9ee640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd454109df0 0x7fd45419fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:17.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.060+0000 7fd45a9ee640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd454113b00 con 0x7fd4541094a0 2024-09-21T05:47:17.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.060+0000 7fd45a9ee640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd454113980 con 0x7fd454103b60 2024-09-21T05:47:17.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.060+0000 7fd45a9ee640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd454113c80 con 0x7fd454109df0 2024-09-21T05:47:17.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.060+0000 7fd44bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4541094a0 0x7fd45419ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:17.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.060+0000 7fd44bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4541094a0 0x7fd45419ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57004/0 (socket says 172.21.15.70:57004) 2024-09-21T05:47:17.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.060+0000 7fd44bfff640 1 -- 172.21.15.70:0/3319178545 learned_addr learned my addr 172.21.15.70:0/3319178545 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:47:17.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.060+0000 7fd453fff640 1 --2- 172.21.15.70:0/3319178545 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd454103b60 0x7fd45419a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:17.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.060+0000 7fd458f8b640 1 --2- 172.21.15.70:0/3319178545 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd454109df0 0x7fd45419fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:17.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.060+0000 7fd44bfff640 1 -- 172.21.15.70:0/3319178545 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd454109df0 msgr2=0x7fd45419fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:17.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.060+0000 7fd44bfff640 1 --2- 172.21.15.70:0/3319178545 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd454109df0 0x7fd45419fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:17.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.060+0000 7fd44bfff640 1 -- 172.21.15.70:0/3319178545 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd454103b60 msgr2=0x7fd45419a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:17.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.060+0000 7fd44bfff640 1 --2- 172.21.15.70:0/3319178545 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd454103b60 0x7fd45419a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:17.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.060+0000 7fd44bfff640 1 -- 172.21.15.70:0/3319178545 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4541a04e0 con 0x7fd4541094a0 2024-09-21T05:47:17.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.060+0000 7fd458f8b640 1 --2- 172.21.15.70:0/3319178545 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd454109df0 0x7fd45419fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:47:17.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.060+0000 7fd44bfff640 1 --2- 172.21.15.70:0/3319178545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4541094a0 0x7fd45419ab10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00d950 tx=0x7fd43c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:17.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.060+0000 7fd451ffb640 1 -- 172.21.15.70:0/3319178545 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43c017070 con 0x7fd4541094a0 2024-09-21T05:47:17.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.061+0000 7fd451ffb640 1 -- 172.21.15.70:0/3319178545 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fd43c009c30 con 0x7fd4541094a0 2024-09-21T05:47:17.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.061+0000 7fd45a9ee640 1 -- 172.21.15.70:0/3319178545 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4541a07d0 con 0x7fd4541094a0 2024-09-21T05:47:17.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.061+0000 7fd451ffb640 1 -- 172.21.15.70:0/3319178545 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43c0047a0 con 0x7fd4541094a0 2024-09-21T05:47:17.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.061+0000 7fd45a9ee640 1 -- 172.21.15.70:0/3319178545 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4541a6f30 con 0x7fd4541094a0 2024-09-21T05:47:17.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.062+0000 7fd45a9ee640 1 -- 172.21.15.70:0/3319178545 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd454103f70 con 0x7fd4541094a0 2024-09-21T05:47:17.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.063+0000 7fd451ffb640 1 -- 172.21.15.70:0/3319178545 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fd43c004020 con 0x7fd4541094a0 2024-09-21T05:47:17.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.064+0000 7fd451ffb640 1 --2- 172.21.15.70:0/3319178545 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd4400b6590 0x7fd4400b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:17.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.064+0000 7fd453fff640 1 --2- 172.21.15.70:0/3319178545 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd4400b6590 0x7fd4400b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:17.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.064+0000 7fd451ffb640 1 -- 172.21.15.70:0/3319178545 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8802+0+0 (secure 0 0 0) 0x7fd43c0e71c0 con 0x7fd4541094a0 2024-09-21T05:47:17.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.064+0000 7fd453fff640 1 --2- 172.21.15.70:0/3319178545 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd4400b6590 0x7fd4400b8aa0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd444005d90 tx=0x7fd444005df0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:17.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.068+0000 7fd451ffb640 1 -- 172.21.15.70:0/3319178545 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd43c020020 con 0x7fd4541094a0 2024-09-21T05:47:17.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:16 smithi160 ceph-mon[33979]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T05:47:17.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:16 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1197190060' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T05:47:17.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:16 smithi160 ceph-mon[33979]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T05:47:17.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.283+0000 7fd45a9ee640 1 -- 172.21.15.70:0/3319178545 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd45410b630 con 0x7fd4541094a0 2024-09-21T05:47:17.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.283+0000 7fd451ffb640 1 -- 172.21.15.70:0/3319178545 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+11851 (secure 0 0 0) 0x7fd43c0ad810 con 0x7fd4541094a0 2024-09-21T05:47:17.286 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:47:17.287 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":16,"btime":"2024-09-21T05:47:15:668046+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3519318330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3519318330},{"type":"v1","addr":"172.21.15.70:6835","nonce":3519318330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2706663460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2706663460},{"type":"v1","addr":"172.21.15.70:6837","nonce":2706663460}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1914209867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1914209867},{"type":"v1","addr":"172.21.15.70:6839","nonce":1914209867}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3392175775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3392175775},{"type":"v1","addr":"172.21.15.70:6841","nonce":3392175775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24568,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3543945704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3543945704},{"type":"v1","addr":"172.21.15.160:6833","nonce":3543945704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/283778129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":283778129},{"type":"v1","addr":"172.21.15.116:6833","nonce":283778129}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24590,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3787256790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3787256790},{"type":"v1","addr":"172.21.15.116:6835","nonce":3787256790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24598,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2001692372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2001692372},{"type":"v1","addr":"172.21.15.160:6835","nonce":2001692372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24610,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/2558120045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2558120045},{"type":"v1","addr":"172.21.15.160:6837","nonce":2558120045}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24611,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/444312934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":444312934},{"type":"v1","addr":"172.21.15.116:6837","nonce":444312934}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24628,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6839/1339744282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1339744282},{"type":"v1","addr":"172.21.15.160:6839","nonce":1339744282}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T05:47:06.246985+0000","modified":"2024-09-21T05:47:15.318000+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/3952175670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3952175670},{"type":"v1","addr":"172.21.15.116:6839","nonce":3952175670}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24641,"qdb_cluster":[24641]},"id":1}]} 2024-09-21T05:47:17.287 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 16 2024-09-21T05:47:17.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.285+0000 7fd45a9ee640 1 -- 172.21.15.70:0/3319178545 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd4400b6590 msgr2=0x7fd4400b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:17.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.285+0000 7fd45a9ee640 1 --2- 172.21.15.70:0/3319178545 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd4400b6590 0x7fd4400b8aa0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd444005d90 tx=0x7fd444005df0 comp rx=0 tx=0).stop 2024-09-21T05:47:17.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.285+0000 7fd45a9ee640 1 -- 172.21.15.70:0/3319178545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4541094a0 msgr2=0x7fd45419ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:17.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.285+0000 7fd45a9ee640 1 --2- 172.21.15.70:0/3319178545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4541094a0 0x7fd45419ab10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00d950 tx=0x7fd43c00de10 comp rx=0 tx=0).stop 2024-09-21T05:47:17.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.285+0000 7fd45a9ee640 1 -- 172.21.15.70:0/3319178545 shutdown_connections 2024-09-21T05:47:17.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.285+0000 7fd45a9ee640 1 --2- 172.21.15.70:0/3319178545 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd4400b6590 0x7fd4400b8aa0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:17.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.285+0000 7fd45a9ee640 1 --2- 172.21.15.70:0/3319178545 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd454109df0 0x7fd45419fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:17.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.285+0000 7fd45a9ee640 1 --2- 172.21.15.70:0/3319178545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4541094a0 0x7fd45419ab10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:17.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.285+0000 7fd45a9ee640 1 --2- 172.21.15.70:0/3319178545 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd454103b60 0x7fd45419a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:17.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.285+0000 7fd45a9ee640 1 -- 172.21.15.70:0/3319178545 >> 172.21.15.70:0/3319178545 conn(0x7fd45407b850 msgr2=0x7fd4541075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:17.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.286+0000 7fd45a9ee640 1 -- 172.21.15.70:0/3319178545 shutdown_connections 2024-09-21T05:47:17.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:17.286+0000 7fd45a9ee640 1 -- 172.21.15.70:0/3319178545 wait complete. 2024-09-21T05:47:17.912 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:17 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3319178545' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:47:17.912 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:17 smithi070 ceph-mon[30981]: pgmap v301: 129 pgs: 2 creating+activating, 6 creating+peering, 121 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T05:47:17.939 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:47:18.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:17 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3319178545' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:47:18.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:17 smithi116 ceph-mon[34332]: pgmap v301: 129 pgs: 2 creating+activating, 6 creating+peering, 121 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T05:47:18.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:17 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3319178545' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:47:18.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:17 smithi160 ceph-mon[33979]: pgmap v301: 129 pgs: 2 creating+activating, 6 creating+peering, 121 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T05:47:18.201 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:47:18.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.670+0000 7f7c49ebe640 1 -- 172.21.15.70:0/1265379164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c44102ae0 msgr2=0x7f7c44102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:18.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.670+0000 7f7c49ebe640 1 --2- 172.21.15.70:0/1265379164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c44102ae0 0x7f7c44102ef0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7c34009900 tx=0x7f7c3402a410 comp rx=0 tx=0).stop 2024-09-21T05:47:18.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.670+0000 7f7c49ebe640 1 -- 172.21.15.70:0/1265379164 shutdown_connections 2024-09-21T05:47:18.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.670+0000 7f7c49ebe640 1 --2- 172.21.15.70:0/1265379164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c44108420 0x7f7c44108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:18.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.670+0000 7f7c49ebe640 1 --2- 172.21.15.70:0/1265379164 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7c44108d70 0x7f7c4410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:18.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.670+0000 7f7c49ebe640 1 --2- 172.21.15.70:0/1265379164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c44102ae0 0x7f7c44102ef0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:18.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.670+0000 7f7c49ebe640 1 -- 172.21.15.70:0/1265379164 >> 172.21.15.70:0/1265379164 conn(0x7f7c44079770 msgr2=0x7f7c44079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:18.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.670+0000 7f7c49ebe640 1 -- 172.21.15.70:0/1265379164 shutdown_connections 2024-09-21T05:47:18.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.670+0000 7f7c49ebe640 1 -- 172.21.15.70:0/1265379164 wait complete. 2024-09-21T05:47:18.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.670+0000 7f7c49ebe640 1 Processor -- start 2024-09-21T05:47:18.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.671+0000 7f7c49ebe640 1 -- start start 2024-09-21T05:47:18.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.671+0000 7f7c49ebe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c44102ae0 0x7f7c441993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:18.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.671+0000 7f7c49ebe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c44108420 0x7f7c44199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:18.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.671+0000 7f7c49ebe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7c44108d70 0x7f7c4419ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:18.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.671+0000 7f7c49ebe640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7c44112a00 con 0x7f7c44102ae0 2024-09-21T05:47:18.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.671+0000 7f7c49ebe640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f7c44112880 con 0x7f7c44108d70 2024-09-21T05:47:18.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.671+0000 7f7c49ebe640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7c44112b80 con 0x7f7c44108420 2024-09-21T05:47:18.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.671+0000 7f7c437fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c44102ae0 0x7f7c441993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:18.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.671+0000 7f7c437fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c44102ae0 0x7f7c441993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57036/0 (socket says 172.21.15.70:57036) 2024-09-21T05:47:18.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.671+0000 7f7c437fe640 1 -- 172.21.15.70:0/3487222537 learned_addr learned my addr 172.21.15.70:0/3487222537 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:47:18.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.671+0000 7f7c43fff640 1 --2- 172.21.15.70:0/3487222537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7c44108d70 0x7f7c4419ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:18.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.671+0000 7f7c42ffd640 1 --2- 172.21.15.70:0/3487222537 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c44108420 0x7f7c44199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:18.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.671+0000 7f7c437fe640 1 -- 172.21.15.70:0/3487222537 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c44108420 msgr2=0x7f7c44199990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:18.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.671+0000 7f7c437fe640 1 --2- 172.21.15.70:0/3487222537 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c44108420 0x7f7c44199990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:18.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.671+0000 7f7c437fe640 1 -- 172.21.15.70:0/3487222537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7c44108d70 msgr2=0x7f7c4419ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:18.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.671+0000 7f7c437fe640 1 --2- 172.21.15.70:0/3487222537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7c44108d70 0x7f7c4419ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:18.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.671+0000 7f7c437fe640 1 -- 172.21.15.70:0/3487222537 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c4419f360 con 0x7f7c44102ae0 2024-09-21T05:47:18.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.671+0000 7f7c42ffd640 1 --2- 172.21.15.70:0/3487222537 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c44108420 0x7f7c44199990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:47:18.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.671+0000 7f7c43fff640 1 --2- 172.21.15.70:0/3487222537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7c44108d70 0x7f7c4419ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:47:18.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.672+0000 7f7c437fe640 1 --2- 172.21.15.70:0/3487222537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c44102ae0 0x7f7c441993f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7c34005940 tx=0x7f7c34004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:18.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.672+0000 7f7c40ff9640 1 -- 172.21.15.70:0/3487222537 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3403f030 con 0x7f7c44102ae0 2024-09-21T05:47:18.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.672+0000 7f7c49ebe640 1 -- 172.21.15.70:0/3487222537 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c4419f5f0 con 0x7f7c44102ae0 2024-09-21T05:47:18.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.672+0000 7f7c40ff9640 1 -- 172.21.15.70:0/3487222537 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f7c34003aa0 con 0x7f7c44102ae0 2024-09-21T05:47:18.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.672+0000 7f7c40ff9640 1 -- 172.21.15.70:0/3487222537 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c34035070 con 0x7f7c44102ae0 2024-09-21T05:47:18.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.672+0000 7f7c49ebe640 1 -- 172.21.15.70:0/3487222537 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c4406bb60 con 0x7f7c44102ae0 2024-09-21T05:47:18.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.673+0000 7f7c49ebe640 1 -- 172.21.15.70:0/3487222537 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c44103d60 con 0x7f7c44102ae0 2024-09-21T05:47:18.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.674+0000 7f7c40ff9640 1 -- 172.21.15.70:0/3487222537 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f7c34042030 con 0x7f7c44102ae0 2024-09-21T05:47:18.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.675+0000 7f7c40ff9640 1 --2- 172.21.15.70:0/3487222537 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7c2c0b8720 0x7f7c2c0bac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:18.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.675+0000 7f7c42ffd640 1 --2- 172.21.15.70:0/3487222537 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7c2c0b8720 0x7f7c2c0bac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:18.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.675+0000 7f7c40ff9640 1 -- 172.21.15.70:0/3487222537 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8802+0+0 (secure 0 0 0) 0x7f7c34108010 con 0x7f7c44102ae0 2024-09-21T05:47:18.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.676+0000 7f7c42ffd640 1 --2- 172.21.15.70:0/3487222537 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7c2c0b8720 0x7f7c2c0bac30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7c441053e0 tx=0x7f7c38005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:18.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.678+0000 7f7c40ff9640 1 -- 172.21.15.70:0/3487222537 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7c340ce660 con 0x7f7c44102ae0 2024-09-21T05:47:18.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.858+0000 7f7c49ebe640 1 -- 172.21.15.70:0/3487222537 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7c4406c580 con 0x7f7c44102ae0 2024-09-21T05:47:18.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.859+0000 7f7c40ff9640 1 -- 172.21.15.70:0/3487222537 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+24222 (secure 0 0 0) 0x7f7c340d2a40 con 0x7f7c44102ae0 2024-09-21T05:47:18.862 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:47:18.862 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":81,"fsid":"96c6636e-77db-11ef-baf5-efdc52797490","created":"2024-09-21T05:38:42.297307+0000","modified":"2024-09-21T05:47:15.317810+0000","last_up_change":"2024-09-21T05:46:15.910344+0000","last_in_change":"2024-09-21T05:45:53.382766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:42:25.611590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:47:01.987981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:47:04.388107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T05:47:10.651871+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00be8b82-7cb1-443f-ad18-02916f734df7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6803","nonce":1667051447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6805","nonce":1667051447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6809","nonce":1667051447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6807","nonce":1667051447}]},"public_addr":"172.21.15.70:6803/1667051447","cluster_addr":"172.21.15.70:6805/1667051447","heartbeat_back_addr":"172.21.15.70:6809/1667051447","heartbeat_front_addr":"172.21.15.70:6807/1667051447","state":["exists","up"]},{"osd":1,"uuid":"28ca8c5c-5e81-4e64-ac0e-3c8c3c2d3930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6801","nonce":1037621846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6803","nonce":1037621846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6807","nonce":1037621846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6805","nonce":1037621846}]},"public_addr":"172.21.15.116:6801/1037621846","cluster_addr":"172.21.15.116:6803/1037621846","heartbeat_back_addr":"172.21.15.116:6807/1037621846","heartbeat_front_addr":"172.21.15.116:6805/1037621846","state":["exists","up"]},{"osd":2,"uuid":"e9b42bf2-a38b-4cf9-8774-4950de12d0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6801","nonce":69260815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6803","nonce":69260815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6807","nonce":69260815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6805","nonce":69260815}]},"public_addr":"172.21.15.160:6801/69260815","cluster_addr":"172.21.15.160:6803/69260815","heartbeat_back_addr":"172.21.15.160:6807/69260815","heartbeat_front_addr":"172.21.15.160:6805/69260815","state":["exists","up"]},{"osd":3,"uuid":"25d8e9a8-3c14-43d6-9bb1-b44cd377133f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6811","nonce":3849416072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6813","nonce":3849416072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6817","nonce":3849416072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6815","nonce":3849416072}]},"public_addr":"172.21.15.70:6811/3849416072","cluster_addr":"172.21.15.70:6813/3849416072","heartbeat_back_addr":"172.21.15.70:6817/3849416072","heartbeat_front_addr":"172.21.15.70:6815/3849416072","state":["exists","up"]},{"osd":4,"uuid":"bdb84cbd-d718-4f69-90d0-2e732e580df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6809","nonce":3444857438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6811","nonce":3444857438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6815","nonce":3444857438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6813","nonce":3444857438}]},"public_addr":"172.21.15.116:6809/3444857438","cluster_addr":"172.21.15.116:6811/3444857438","heartbeat_back_addr":"172.21.15.116:6815/3444857438","heartbeat_front_addr":"172.21.15.116:6813/3444857438","state":["exists","up"]},{"osd":5,"uuid":"a490eeba-549f-4caa-8cd5-4168a23dafa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6809","nonce":3063220427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6811","nonce":3063220427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6815","nonce":3063220427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6813","nonce":3063220427}]},"public_addr":"172.21.15.160:6809/3063220427","cluster_addr":"172.21.15.160:6811/3063220427","heartbeat_back_addr":"172.21.15.160:6815/3063220427","heartbeat_front_addr":"172.21.15.160:6813/3063220427","state":["exists","up"]},{"osd":6,"uuid":"1bf22f48-c02f-4f09-b0fe-2597a55fd795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6819","nonce":3650315688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6821","nonce":3650315688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6825","nonce":3650315688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6823","nonce":3650315688}]},"public_addr":"172.21.15.70:6819/3650315688","cluster_addr":"172.21.15.70:6821/3650315688","heartbeat_back_addr":"172.21.15.70:6825/3650315688","heartbeat_front_addr":"172.21.15.70:6823/3650315688","state":["exists","up"]},{"osd":7,"uuid":"40d59744-4860-4a92-aa21-3f33e575e5b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6817","nonce":2034132009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6819","nonce":2034132009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6823","nonce":2034132009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6821","nonce":2034132009}]},"public_addr":"172.21.15.116:6817/2034132009","cluster_addr":"172.21.15.116:6819/2034132009","heartbeat_back_addr":"172.21.15.116:6823/2034132009","heartbeat_front_addr":"172.21.15.116:6821/2034132009","state":["exists","up"]},{"osd":8,"uuid":"65dc02e7-0dcd-4fa7-955a-4d5c00fbe4cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6817","nonce":3381625184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6819","nonce":3381625184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6823","nonce":3381625184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6821","nonce":3381625184}]},"public_addr":"172.21.15.160:6817/3381625184","cluster_addr":"172.21.15.160:6819/3381625184","heartbeat_back_addr":"172.21.15.160:6823/3381625184","heartbeat_front_addr":"172.21.15.160:6821/3381625184","state":["exists","up"]},{"osd":9,"uuid":"d8438a9c-012f-4082-be3f-9653cdfaac78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6827","nonce":3555256209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6829","nonce":3555256209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6833","nonce":3555256209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6831","nonce":3555256209}]},"public_addr":"172.21.15.70:6827/3555256209","cluster_addr":"172.21.15.70:6829/3555256209","heartbeat_back_addr":"172.21.15.70:6833/3555256209","heartbeat_front_addr":"172.21.15.70:6831/3555256209","state":["exists","up"]},{"osd":10,"uuid":"871619b0-181e-4020-9511-2cec296bfe70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6825","nonce":541280433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6827","nonce":541280433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6831","nonce":541280433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6829","nonce":541280433}]},"public_addr":"172.21.15.116:6825/541280433","cluster_addr":"172.21.15.116:6827/541280433","heartbeat_back_addr":"172.21.15.116:6831/541280433","heartbeat_front_addr":"172.21.15.116:6829/541280433","state":["exists","up"]},{"osd":11,"uuid":"302da945-7929-4b0c-a20b-099175752c41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6825","nonce":2632369083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6827","nonce":2632369083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6831","nonce":2632369083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6829","nonce":2632369083}]},"public_addr":"172.21.15.160:6825/2632369083","cluster_addr":"172.21.15.160:6827/2632369083","heartbeat_back_addr":"172.21.15.160:6831/2632369083","heartbeat_front_addr":"172.21.15.160:6829/2632369083","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:41:34.446744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:41:59.336955+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:42:23.958219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:42:49.396007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:43:15.325344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:43:41.923141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:07.873970+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:33.897951+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:58.397680+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:24.568406+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:49.504565+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:14.698577+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6800/605055695":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/897886925":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/1968357524":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/693721445":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/2810307308":"2024-09-22T05:39:12.492271+0000","172.21.15.70:6801/605055695":"2024-09-22T05:39:37.296630+0000","172.21.15.70:6801/1668927582":"2024-09-22T05:39:12.492271+0000","172.21.15.70:6800/1668927582":"2024-09-22T05:39:12.492271+0000","172.21.15.70:0/1979536420":"2024-09-22T05:39:12.492271+0000","172.21.15.70:0/2674019604":"2024-09-22T05:39:12.492271+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:47:18.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.862+0000 7f7c49ebe640 1 -- 172.21.15.70:0/3487222537 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7c2c0b8720 msgr2=0x7f7c2c0bac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:18.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.862+0000 7f7c49ebe640 1 --2- 172.21.15.70:0/3487222537 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7c2c0b8720 0x7f7c2c0bac30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7c441053e0 tx=0x7f7c38005e50 comp rx=0 tx=0).stop 2024-09-21T05:47:18.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.862+0000 7f7c49ebe640 1 -- 172.21.15.70:0/3487222537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c44102ae0 msgr2=0x7f7c441993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:18.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.862+0000 7f7c49ebe640 1 --2- 172.21.15.70:0/3487222537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c44102ae0 0x7f7c441993f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7c34005940 tx=0x7f7c34004270 comp rx=0 tx=0).stop 2024-09-21T05:47:18.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.862+0000 7f7c49ebe640 1 -- 172.21.15.70:0/3487222537 shutdown_connections 2024-09-21T05:47:18.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.862+0000 7f7c49ebe640 1 --2- 172.21.15.70:0/3487222537 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7c2c0b8720 0x7f7c2c0bac30 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:18.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.862+0000 7f7c49ebe640 1 --2- 172.21.15.70:0/3487222537 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c44108420 0x7f7c44199990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:18.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.862+0000 7f7c49ebe640 1 --2- 172.21.15.70:0/3487222537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7c44108d70 0x7f7c4419ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:18.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.862+0000 7f7c49ebe640 1 --2- 172.21.15.70:0/3487222537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c44102ae0 0x7f7c441993f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:18.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.862+0000 7f7c49ebe640 1 -- 172.21.15.70:0/3487222537 >> 172.21.15.70:0/3487222537 conn(0x7f7c44079770 msgr2=0x7f7c44106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:18.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.862+0000 7f7c49ebe640 1 -- 172.21.15.70:0/3487222537 shutdown_connections 2024-09-21T05:47:18.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:18.862+0000 7f7c49ebe640 1 -- 172.21.15.70:0/3487222537 wait complete. 2024-09-21T05:47:19.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:18 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3487222537' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:47:19.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:18 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3487222537' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:47:19.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:18 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3487222537' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:47:19.505 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:47:19.751 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:47:20.139 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:19 smithi070 ceph-mon[30981]: pgmap v302: 129 pgs: 129 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:20.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.226+0000 7f8fb6b2b640 1 -- 172.21.15.70:0/1030766368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fb01094b0 msgr2=0x7f8fb01098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:20.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.226+0000 7f8fb6b2b640 1 --2- 172.21.15.70:0/1030766368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fb01094b0 0x7f8fb01098c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0009ca0 tx=0x7f8fa002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:47:20.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.226+0000 7f8fb6b2b640 1 -- 172.21.15.70:0/1030766368 shutdown_connections 2024-09-21T05:47:20.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.226+0000 7f8fb6b2b640 1 --2- 172.21.15.70:0/1030766368 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8fb0109e00 0x7f8fb0110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:20.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.226+0000 7f8fb6b2b640 1 --2- 172.21.15.70:0/1030766368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fb01094b0 0x7f8fb01098c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:20.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.226+0000 7f8fb6b2b640 1 --2- 172.21.15.70:0/1030766368 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8fb0101f70 0x7f8fb0102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:20.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.226+0000 7f8fb6b2b640 1 -- 172.21.15.70:0/1030766368 >> 172.21.15.70:0/1030766368 conn(0x7f8fb0077c60 msgr2=0x7f8fb00780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:20.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.226+0000 7f8fb6b2b640 1 -- 172.21.15.70:0/1030766368 shutdown_connections 2024-09-21T05:47:20.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.226+0000 7f8fb6b2b640 1 -- 172.21.15.70:0/1030766368 wait complete. 2024-09-21T05:47:20.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.227+0000 7f8fb6b2b640 1 Processor -- start 2024-09-21T05:47:20.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.227+0000 7f8fb6b2b640 1 -- start start 2024-09-21T05:47:20.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.227+0000 7f8fb6b2b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fb0101f70 0x7f8fb019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:20.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.227+0000 7f8fb6b2b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8fb01094b0 0x7f8fb019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:20.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.227+0000 7f8fb6b2b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8fb0109e00 0x7f8fb019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:20.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.227+0000 7f8fb6b2b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb0113a90 con 0x7f8fb0101f70 2024-09-21T05:47:20.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.227+0000 7f8fb6b2b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb0113910 con 0x7f8fb0109e00 2024-09-21T05:47:20.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.227+0000 7f8fb6b2b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb0113c10 con 0x7f8fb01094b0 2024-09-21T05:47:20.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.227+0000 7f8fb48c7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fb0101f70 0x7f8fb019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:20.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.227+0000 7f8fb48c7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fb0101f70 0x7f8fb019a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57052/0 (socket says 172.21.15.70:57052) 2024-09-21T05:47:20.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.227+0000 7f8fb48c7640 1 -- 172.21.15.70:0/1814277658 learned_addr learned my addr 172.21.15.70:0/1814277658 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:47:20.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.227+0000 7f8fb50c8640 1 --2- 172.21.15.70:0/1814277658 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8fb0109e00 0x7f8fb019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:20.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.227+0000 7f8faffff640 1 --2- 172.21.15.70:0/1814277658 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8fb01094b0 0x7f8fb019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:20.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.228+0000 7f8fb48c7640 1 -- 172.21.15.70:0/1814277658 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8fb01094b0 msgr2=0x7f8fb019aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:20.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.228+0000 7f8fb48c7640 1 --2- 172.21.15.70:0/1814277658 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8fb01094b0 0x7f8fb019aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:20.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.228+0000 7f8fb48c7640 1 -- 172.21.15.70:0/1814277658 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8fb0109e00 msgr2=0x7f8fb019fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:20.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.228+0000 7f8fb48c7640 1 --2- 172.21.15.70:0/1814277658 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8fb0109e00 0x7f8fb019fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:20.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.228+0000 7f8fb48c7640 1 -- 172.21.15.70:0/1814277658 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb01a0410 con 0x7f8fb0101f70 2024-09-21T05:47:20.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.228+0000 7f8faffff640 1 --2- 172.21.15.70:0/1814277658 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8fb01094b0 0x7f8fb019aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:47:20.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.228+0000 7f8fb48c7640 1 --2- 172.21.15.70:0/1814277658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fb0101f70 0x7f8fb019a4a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8fa800e9f0 tx=0x7f8fa800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:20.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.228+0000 7f8fadffb640 1 -- 172.21.15.70:0/1814277658 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa800cd80 con 0x7f8fb0101f70 2024-09-21T05:47:20.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.228+0000 7f8fb6b2b640 1 -- 172.21.15.70:0/1814277658 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fb01a0700 con 0x7f8fb0101f70 2024-09-21T05:47:20.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.228+0000 7f8fadffb640 1 -- 172.21.15.70:0/1814277658 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f8fa80108e0 con 0x7f8fb0101f70 2024-09-21T05:47:20.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.228+0000 7f8fadffb640 1 -- 172.21.15.70:0/1814277658 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8018810 con 0x7f8fb0101f70 2024-09-21T05:47:20.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.228+0000 7f8fb6b2b640 1 -- 172.21.15.70:0/1814277658 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fb01a6e60 con 0x7f8fb0101f70 2024-09-21T05:47:20.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.229+0000 7f8fb6b2b640 1 -- 172.21.15.70:0/1814277658 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fb0102380 con 0x7f8fb0101f70 2024-09-21T05:47:20.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.231+0000 7f8fadffb640 1 -- 172.21.15.70:0/1814277658 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f8fa8010a90 con 0x7f8fb0101f70 2024-09-21T05:47:20.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.231+0000 7f8fadffb640 1 --2- 172.21.15.70:0/1814277658 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f8f9c0b6510 0x7f8f9c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:20.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.231+0000 7f8faffff640 1 --2- 172.21.15.70:0/1814277658 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f8f9c0b6510 0x7f8f9c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:20.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.231+0000 7f8fadffb640 1 -- 172.21.15.70:0/1814277658 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8802+0+0 (secure 0 0 0) 0x7f8fa80e7940 con 0x7f8fb0101f70 2024-09-21T05:47:20.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.232+0000 7f8faffff640 1 --2- 172.21.15.70:0/1814277658 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f8f9c0b6510 0x7f8f9c0b8a20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0006010 tx=0x7f8fa0000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:20.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.236+0000 7f8fadffb640 1 -- 172.21.15.70:0/1814277658 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8fa80adf90 con 0x7f8fb0101f70 2024-09-21T05:47:20.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:19 smithi116 ceph-mon[34332]: pgmap v302: 129 pgs: 129 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:20.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:19 smithi160 ceph-mon[33979]: pgmap v302: 129 pgs: 129 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:20.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.414+0000 7f8fb6b2b640 1 -- 172.21.15.70:0/1814277658 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8fb002e640 con 0x7f8fb0101f70 2024-09-21T05:47:20.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.416+0000 7f8fadffb640 1 -- 172.21.15.70:0/1814277658 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+24222 (secure 0 0 0) 0x7f8fa80b2370 con 0x7f8fb0101f70 2024-09-21T05:47:20.418 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:47:20.418 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":81,"fsid":"96c6636e-77db-11ef-baf5-efdc52797490","created":"2024-09-21T05:38:42.297307+0000","modified":"2024-09-21T05:47:15.317810+0000","last_up_change":"2024-09-21T05:46:15.910344+0000","last_in_change":"2024-09-21T05:45:53.382766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:42:25.611590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:47:01.987981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:47:04.388107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T05:47:10.651871+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00be8b82-7cb1-443f-ad18-02916f734df7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6803","nonce":1667051447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6805","nonce":1667051447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6809","nonce":1667051447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6807","nonce":1667051447}]},"public_addr":"172.21.15.70:6803/1667051447","cluster_addr":"172.21.15.70:6805/1667051447","heartbeat_back_addr":"172.21.15.70:6809/1667051447","heartbeat_front_addr":"172.21.15.70:6807/1667051447","state":["exists","up"]},{"osd":1,"uuid":"28ca8c5c-5e81-4e64-ac0e-3c8c3c2d3930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6801","nonce":1037621846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6803","nonce":1037621846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6807","nonce":1037621846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6805","nonce":1037621846}]},"public_addr":"172.21.15.116:6801/1037621846","cluster_addr":"172.21.15.116:6803/1037621846","heartbeat_back_addr":"172.21.15.116:6807/1037621846","heartbeat_front_addr":"172.21.15.116:6805/1037621846","state":["exists","up"]},{"osd":2,"uuid":"e9b42bf2-a38b-4cf9-8774-4950de12d0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6801","nonce":69260815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6803","nonce":69260815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6807","nonce":69260815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6805","nonce":69260815}]},"public_addr":"172.21.15.160:6801/69260815","cluster_addr":"172.21.15.160:6803/69260815","heartbeat_back_addr":"172.21.15.160:6807/69260815","heartbeat_front_addr":"172.21.15.160:6805/69260815","state":["exists","up"]},{"osd":3,"uuid":"25d8e9a8-3c14-43d6-9bb1-b44cd377133f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6811","nonce":3849416072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6813","nonce":3849416072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6817","nonce":3849416072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6815","nonce":3849416072}]},"public_addr":"172.21.15.70:6811/3849416072","cluster_addr":"172.21.15.70:6813/3849416072","heartbeat_back_addr":"172.21.15.70:6817/3849416072","heartbeat_front_addr":"172.21.15.70:6815/3849416072","state":["exists","up"]},{"osd":4,"uuid":"bdb84cbd-d718-4f69-90d0-2e732e580df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6809","nonce":3444857438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6811","nonce":3444857438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6815","nonce":3444857438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6813","nonce":3444857438}]},"public_addr":"172.21.15.116:6809/3444857438","cluster_addr":"172.21.15.116:6811/3444857438","heartbeat_back_addr":"172.21.15.116:6815/3444857438","heartbeat_front_addr":"172.21.15.116:6813/3444857438","state":["exists","up"]},{"osd":5,"uuid":"a490eeba-549f-4caa-8cd5-4168a23dafa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6809","nonce":3063220427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6811","nonce":3063220427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6815","nonce":3063220427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6813","nonce":3063220427}]},"public_addr":"172.21.15.160:6809/3063220427","cluster_addr":"172.21.15.160:6811/3063220427","heartbeat_back_addr":"172.21.15.160:6815/3063220427","heartbeat_front_addr":"172.21.15.160:6813/3063220427","state":["exists","up"]},{"osd":6,"uuid":"1bf22f48-c02f-4f09-b0fe-2597a55fd795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6819","nonce":3650315688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6821","nonce":3650315688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6825","nonce":3650315688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6823","nonce":3650315688}]},"public_addr":"172.21.15.70:6819/3650315688","cluster_addr":"172.21.15.70:6821/3650315688","heartbeat_back_addr":"172.21.15.70:6825/3650315688","heartbeat_front_addr":"172.21.15.70:6823/3650315688","state":["exists","up"]},{"osd":7,"uuid":"40d59744-4860-4a92-aa21-3f33e575e5b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6817","nonce":2034132009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6819","nonce":2034132009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6823","nonce":2034132009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6821","nonce":2034132009}]},"public_addr":"172.21.15.116:6817/2034132009","cluster_addr":"172.21.15.116:6819/2034132009","heartbeat_back_addr":"172.21.15.116:6823/2034132009","heartbeat_front_addr":"172.21.15.116:6821/2034132009","state":["exists","up"]},{"osd":8,"uuid":"65dc02e7-0dcd-4fa7-955a-4d5c00fbe4cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6817","nonce":3381625184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6819","nonce":3381625184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6823","nonce":3381625184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6821","nonce":3381625184}]},"public_addr":"172.21.15.160:6817/3381625184","cluster_addr":"172.21.15.160:6819/3381625184","heartbeat_back_addr":"172.21.15.160:6823/3381625184","heartbeat_front_addr":"172.21.15.160:6821/3381625184","state":["exists","up"]},{"osd":9,"uuid":"d8438a9c-012f-4082-be3f-9653cdfaac78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6827","nonce":3555256209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6829","nonce":3555256209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6833","nonce":3555256209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6831","nonce":3555256209}]},"public_addr":"172.21.15.70:6827/3555256209","cluster_addr":"172.21.15.70:6829/3555256209","heartbeat_back_addr":"172.21.15.70:6833/3555256209","heartbeat_front_addr":"172.21.15.70:6831/3555256209","state":["exists","up"]},{"osd":10,"uuid":"871619b0-181e-4020-9511-2cec296bfe70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6825","nonce":541280433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6827","nonce":541280433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6831","nonce":541280433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6829","nonce":541280433}]},"public_addr":"172.21.15.116:6825/541280433","cluster_addr":"172.21.15.116:6827/541280433","heartbeat_back_addr":"172.21.15.116:6831/541280433","heartbeat_front_addr":"172.21.15.116:6829/541280433","state":["exists","up"]},{"osd":11,"uuid":"302da945-7929-4b0c-a20b-099175752c41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6825","nonce":2632369083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6827","nonce":2632369083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6831","nonce":2632369083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6829","nonce":2632369083}]},"public_addr":"172.21.15.160:6825/2632369083","cluster_addr":"172.21.15.160:6827/2632369083","heartbeat_back_addr":"172.21.15.160:6831/2632369083","heartbeat_front_addr":"172.21.15.160:6829/2632369083","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:41:34.446744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:41:59.336955+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:42:23.958219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:42:49.396007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:43:15.325344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:43:41.923141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:07.873970+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:33.897951+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:58.397680+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:24.568406+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:49.504565+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:14.698577+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6800/605055695":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/897886925":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/1968357524":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/693721445":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/2810307308":"2024-09-22T05:39:12.492271+0000","172.21.15.70:6801/605055695":"2024-09-22T05:39:37.296630+0000","172.21.15.70:6801/1668927582":"2024-09-22T05:39:12.492271+0000","172.21.15.70:6800/1668927582":"2024-09-22T05:39:12.492271+0000","172.21.15.70:0/1979536420":"2024-09-22T05:39:12.492271+0000","172.21.15.70:0/2674019604":"2024-09-22T05:39:12.492271+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:47:20.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.418+0000 7f8fb6b2b640 1 -- 172.21.15.70:0/1814277658 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f8f9c0b6510 msgr2=0x7f8f9c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:20.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.418+0000 7f8fb6b2b640 1 --2- 172.21.15.70:0/1814277658 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f8f9c0b6510 0x7f8f9c0b8a20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0006010 tx=0x7f8fa0000f40 comp rx=0 tx=0).stop 2024-09-21T05:47:20.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.418+0000 7f8fb6b2b640 1 -- 172.21.15.70:0/1814277658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fb0101f70 msgr2=0x7f8fb019a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:20.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.418+0000 7f8fb6b2b640 1 --2- 172.21.15.70:0/1814277658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fb0101f70 0x7f8fb019a4a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8fa800e9f0 tx=0x7f8fa800eeb0 comp rx=0 tx=0).stop 2024-09-21T05:47:20.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.418+0000 7f8fb6b2b640 1 -- 172.21.15.70:0/1814277658 shutdown_connections 2024-09-21T05:47:20.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.418+0000 7f8fb6b2b640 1 --2- 172.21.15.70:0/1814277658 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f8f9c0b6510 0x7f8f9c0b8a20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:20.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.418+0000 7f8fb6b2b640 1 --2- 172.21.15.70:0/1814277658 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8fb01094b0 0x7f8fb019aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:20.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.418+0000 7f8fb6b2b640 1 --2- 172.21.15.70:0/1814277658 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8fb0109e00 0x7f8fb019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:20.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.418+0000 7f8fb6b2b640 1 --2- 172.21.15.70:0/1814277658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fb0101f70 0x7f8fb019a4a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:20.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.418+0000 7f8fb6b2b640 1 -- 172.21.15.70:0/1814277658 >> 172.21.15.70:0/1814277658 conn(0x7f8fb0077c60 msgr2=0x7f8fb0107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:20.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.418+0000 7f8fb6b2b640 1 -- 172.21.15.70:0/1814277658 shutdown_connections 2024-09-21T05:47:20.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:20.418+0000 7f8fb6b2b640 1 -- 172.21.15.70:0/1814277658 wait complete. 2024-09-21T05:47:21.186 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:20 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1814277658' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:47:21.229 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:47:21.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:20 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1814277658' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:47:21.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:20 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1814277658' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:47:21.475 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:47:21.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.929+0000 7f0b5266f640 1 -- 172.21.15.70:0/1602059026 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b4c1083a0 msgr2=0x7f0b4c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:21.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.929+0000 7f0b5266f640 1 --2- 172.21.15.70:0/1602059026 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b4c1083a0 0x7f0b4c1087b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0b34009900 tx=0x7f0b3402a410 comp rx=0 tx=0).stop 2024-09-21T05:47:21.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.929+0000 7f0b5266f640 1 -- 172.21.15.70:0/1602059026 shutdown_connections 2024-09-21T05:47:21.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.929+0000 7f0b5266f640 1 --2- 172.21.15.70:0/1602059026 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b4c108cf0 0x7f0b4c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:21.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.929+0000 7f0b5266f640 1 --2- 172.21.15.70:0/1602059026 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b4c1083a0 0x7f0b4c1087b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:21.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.929+0000 7f0b5266f640 1 --2- 172.21.15.70:0/1602059026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b4c102a60 0x7f0b4c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:21.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.929+0000 7f0b5266f640 1 -- 172.21.15.70:0/1602059026 >> 172.21.15.70:0/1602059026 conn(0x7f0b4c079720 msgr2=0x7f0b4c079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:21.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.929+0000 7f0b5266f640 1 -- 172.21.15.70:0/1602059026 shutdown_connections 2024-09-21T05:47:21.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.929+0000 7f0b5266f640 1 -- 172.21.15.70:0/1602059026 wait complete. 2024-09-21T05:47:21.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.929+0000 7f0b5266f640 1 Processor -- start 2024-09-21T05:47:21.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.929+0000 7f0b5266f640 1 -- start start 2024-09-21T05:47:21.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.930+0000 7f0b5266f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b4c102a60 0x7f0b4c19a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:21.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.930+0000 7f0b5266f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b4c1083a0 0x7f0b4c19aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:21.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.930+0000 7f0b5266f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b4c108cf0 0x7f0b4c19fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:21.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.930+0000 7f0b5266f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4c1129a0 con 0x7f0b4c1083a0 2024-09-21T05:47:21.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.930+0000 7f0b5266f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4c112820 con 0x7f0b4c108cf0 2024-09-21T05:47:21.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.930+0000 7f0b5266f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4c112b20 con 0x7f0b4c102a60 2024-09-21T05:47:21.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.930+0000 7f0b43fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b4c1083a0 0x7f0b4c19aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:21.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.930+0000 7f0b43fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b4c1083a0 0x7f0b4c19aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54752/0 (socket says 172.21.15.70:54752) 2024-09-21T05:47:21.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.930+0000 7f0b43fff640 1 -- 172.21.15.70:0/535529058 learned_addr learned my addr 172.21.15.70:0/535529058 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:47:21.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.930+0000 7f0b4bfff640 1 --2- 172.21.15.70:0/535529058 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b4c102a60 0x7f0b4c19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:21.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.930+0000 7f0b50c0c640 1 --2- 172.21.15.70:0/535529058 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b4c108cf0 0x7f0b4c19fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:21.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.930+0000 7f0b43fff640 1 -- 172.21.15.70:0/535529058 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b4c102a60 msgr2=0x7f0b4c19a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:21.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.930+0000 7f0b43fff640 1 --2- 172.21.15.70:0/535529058 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b4c102a60 0x7f0b4c19a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:21.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.930+0000 7f0b43fff640 1 -- 172.21.15.70:0/535529058 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b4c108cf0 msgr2=0x7f0b4c19fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:21.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.930+0000 7f0b43fff640 1 --2- 172.21.15.70:0/535529058 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b4c108cf0 0x7f0b4c19fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:21.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.930+0000 7f0b43fff640 1 -- 172.21.15.70:0/535529058 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b4c1a0490 con 0x7f0b4c1083a0 2024-09-21T05:47:21.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.930+0000 7f0b4bfff640 1 --2- 172.21.15.70:0/535529058 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b4c102a60 0x7f0b4c19a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:47:21.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.930+0000 7f0b50c0c640 1 --2- 172.21.15.70:0/535529058 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b4c108cf0 0x7f0b4c19fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:47:21.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.930+0000 7f0b43fff640 1 --2- 172.21.15.70:0/535529058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b4c1083a0 0x7f0b4c19aac0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0b34005ab0 tx=0x7f0b34003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:21.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.930+0000 7f0b49ffb640 1 -- 172.21.15.70:0/535529058 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3403f070 con 0x7f0b4c1083a0 2024-09-21T05:47:21.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.931+0000 7f0b49ffb640 1 -- 172.21.15.70:0/535529058 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f0b3403bb20 con 0x7f0b4c1083a0 2024-09-21T05:47:21.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.931+0000 7f0b5266f640 1 -- 172.21.15.70:0/535529058 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b4c1a0720 con 0x7f0b4c1083a0 2024-09-21T05:47:21.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.931+0000 7f0b49ffb640 1 -- 172.21.15.70:0/535529058 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b34035030 con 0x7f0b4c1083a0 2024-09-21T05:47:21.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.931+0000 7f0b5266f640 1 -- 172.21.15.70:0/535529058 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b4c1a6ee0 con 0x7f0b4c1083a0 2024-09-21T05:47:21.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.932+0000 7f0b5266f640 1 -- 172.21.15.70:0/535529058 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b4c103ce0 con 0x7f0b4c1083a0 2024-09-21T05:47:21.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.933+0000 7f0b49ffb640 1 -- 172.21.15.70:0/535529058 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f0b34042070 con 0x7f0b4c1083a0 2024-09-21T05:47:21.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.934+0000 7f0b49ffb640 1 --2- 172.21.15.70:0/535529058 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0b380b6510 0x7f0b380b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:21.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.934+0000 7f0b4bfff640 1 --2- 172.21.15.70:0/535529058 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0b380b6510 0x7f0b380b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:21.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.934+0000 7f0b49ffb640 1 -- 172.21.15.70:0/535529058 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8802+0+0 (secure 0 0 0) 0x7f0b34108040 con 0x7f0b4c1083a0 2024-09-21T05:47:21.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.934+0000 7f0b4bfff640 1 --2- 172.21.15.70:0/535529058 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0b380b6510 0x7f0b380b8a20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c009c20 tx=0x7f0b3c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:21.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:21.937+0000 7f0b49ffb640 1 -- 172.21.15.70:0/535529058 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0b340ce690 con 0x7f0b4c1083a0 2024-09-21T05:47:22.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:22.153+0000 7f0b5266f640 1 -- 172.21.15.70:0/535529058 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b4c102e70 con 0x7f0b4c1083a0 2024-09-21T05:47:22.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:22.154+0000 7f0b49ffb640 1 -- 172.21.15.70:0/535529058 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+11851 (secure 0 0 0) 0x7f0b4c102e70 con 0x7f0b4c1083a0 2024-09-21T05:47:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:47:22.157 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":16,"btime":"2024-09-21T05:47:15:668046+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3519318330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3519318330},{"type":"v1","addr":"172.21.15.70:6835","nonce":3519318330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2706663460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2706663460},{"type":"v1","addr":"172.21.15.70:6837","nonce":2706663460}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1914209867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1914209867},{"type":"v1","addr":"172.21.15.70:6839","nonce":1914209867}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3392175775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3392175775},{"type":"v1","addr":"172.21.15.70:6841","nonce":3392175775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24568,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3543945704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3543945704},{"type":"v1","addr":"172.21.15.160:6833","nonce":3543945704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/283778129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":283778129},{"type":"v1","addr":"172.21.15.116:6833","nonce":283778129}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24590,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3787256790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3787256790},{"type":"v1","addr":"172.21.15.116:6835","nonce":3787256790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24598,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2001692372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2001692372},{"type":"v1","addr":"172.21.15.160:6835","nonce":2001692372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24610,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/2558120045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2558120045},{"type":"v1","addr":"172.21.15.160:6837","nonce":2558120045}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24611,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/444312934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":444312934},{"type":"v1","addr":"172.21.15.116:6837","nonce":444312934}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24628,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6839/1339744282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1339744282},{"type":"v1","addr":"172.21.15.160:6839","nonce":1339744282}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T05:47:06.246985+0000","modified":"2024-09-21T05:47:15.318000+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/3952175670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3952175670},{"type":"v1","addr":"172.21.15.116:6839","nonce":3952175670}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24641,"qdb_cluster":[24641]},"id":1}]} 2024-09-21T05:47:22.157 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 16 2024-09-21T05:47:22.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:22.156+0000 7f0b5266f640 1 -- 172.21.15.70:0/535529058 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0b380b6510 msgr2=0x7f0b380b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:22.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:22.156+0000 7f0b5266f640 1 --2- 172.21.15.70:0/535529058 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0b380b6510 0x7f0b380b8a20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c009c20 tx=0x7f0b3c005f90 comp rx=0 tx=0).stop 2024-09-21T05:47:22.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:22.156+0000 7f0b5266f640 1 -- 172.21.15.70:0/535529058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b4c1083a0 msgr2=0x7f0b4c19aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:22.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:22.156+0000 7f0b5266f640 1 --2- 172.21.15.70:0/535529058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b4c1083a0 0x7f0b4c19aac0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0b34005ab0 tx=0x7f0b34003c10 comp rx=0 tx=0).stop 2024-09-21T05:47:22.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:22.157+0000 7f0b5266f640 1 -- 172.21.15.70:0/535529058 shutdown_connections 2024-09-21T05:47:22.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:22.157+0000 7f0b5266f640 1 --2- 172.21.15.70:0/535529058 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0b380b6510 0x7f0b380b8a20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:22.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:22.157+0000 7f0b5266f640 1 --2- 172.21.15.70:0/535529058 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b4c108cf0 0x7f0b4c19fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:22.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:22.157+0000 7f0b5266f640 1 --2- 172.21.15.70:0/535529058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b4c1083a0 0x7f0b4c19aac0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:22.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:22.157+0000 7f0b5266f640 1 --2- 172.21.15.70:0/535529058 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b4c102a60 0x7f0b4c19a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:22.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:22.157+0000 7f0b5266f640 1 -- 172.21.15.70:0/535529058 >> 172.21.15.70:0/535529058 conn(0x7f0b4c079720 msgr2=0x7f0b4c101ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:22.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:22.157+0000 7f0b5266f640 1 -- 172.21.15.70:0/535529058 shutdown_connections 2024-09-21T05:47:22.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:22.157+0000 7f0b5266f640 1 -- 172.21.15.70:0/535529058 wait complete. 2024-09-21T05:47:22.205 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:21 smithi116 ceph-mon[34332]: pgmap v303: 129 pgs: 129 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:22.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:21 smithi070 ceph-mon[30981]: pgmap v303: 129 pgs: 129 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:22.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:21 smithi160 ceph-mon[33979]: pgmap v303: 129 pgs: 129 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:22.981 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:47:23.227 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:47:23.244 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:22 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/535529058' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:47:23.299 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:22 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/535529058' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:47:23.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:22 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/535529058' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:47:23.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.712+0000 7f4ccf454640 1 -- 172.21.15.70:0/888339714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cc8103b90 msgr2=0x7f4cc8103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:23.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.712+0000 7f4ccf454640 1 --2- 172.21.15.70:0/888339714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cc8103b90 0x7f4cc8103fa0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4009900 tx=0x7f4cc402a410 comp rx=0 tx=0).stop 2024-09-21T05:47:23.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.713+0000 7f4ccf454640 1 -- 172.21.15.70:0/888339714 shutdown_connections 2024-09-21T05:47:23.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.713+0000 7f4ccf454640 1 --2- 172.21.15.70:0/888339714 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cc81094d0 0x7f4cc81098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:23.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.713+0000 7f4ccf454640 1 --2- 172.21.15.70:0/888339714 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cc8109e20 0x7f4cc8110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:23.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.713+0000 7f4ccf454640 1 --2- 172.21.15.70:0/888339714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cc8103b90 0x7f4cc8103fa0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:23.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.713+0000 7f4ccf454640 1 -- 172.21.15.70:0/888339714 >> 172.21.15.70:0/888339714 conn(0x7f4cc80ff620 msgr2=0x7f4cc8101a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:23.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.713+0000 7f4ccf454640 1 -- 172.21.15.70:0/888339714 shutdown_connections 2024-09-21T05:47:23.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.713+0000 7f4ccf454640 1 -- 172.21.15.70:0/888339714 wait complete. 2024-09-21T05:47:23.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.713+0000 7f4ccf454640 1 Processor -- start 2024-09-21T05:47:23.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.713+0000 7f4ccf454640 1 -- start start 2024-09-21T05:47:23.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.714+0000 7f4ccf454640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cc8103b90 0x7f4cc819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:23.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.714+0000 7f4ccf454640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cc81094d0 0x7f4cc819aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:23.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.714+0000 7f4ccf454640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cc8109e20 0x7f4cc819fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:23.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.714+0000 7f4ccf454640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc8113ab0 con 0x7f4cc8103b90 2024-09-21T05:47:23.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.714+0000 7f4ccf454640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc8113930 con 0x7f4cc8109e20 2024-09-21T05:47:23.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.714+0000 7f4ccf454640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc8113c30 con 0x7f4cc81094d0 2024-09-21T05:47:23.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.714+0000 7f4ccd1f0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cc8103b90 0x7f4cc819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:23.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.714+0000 7f4ccd1f0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cc8103b90 0x7f4cc819a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54780/0 (socket says 172.21.15.70:54780) 2024-09-21T05:47:23.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.714+0000 7f4ccd1f0640 1 -- 172.21.15.70:0/2112316748 learned_addr learned my addr 172.21.15.70:0/2112316748 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:47:23.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.714+0000 7f4ccd9f1640 1 --2- 172.21.15.70:0/2112316748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cc8109e20 0x7f4cc819fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:23.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.714+0000 7f4ccc9ef640 1 --2- 172.21.15.70:0/2112316748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cc81094d0 0x7f4cc819aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:23.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.714+0000 7f4ccd1f0640 1 -- 172.21.15.70:0/2112316748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cc81094d0 msgr2=0x7f4cc819aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:23.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.714+0000 7f4ccd1f0640 1 --2- 172.21.15.70:0/2112316748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cc81094d0 0x7f4cc819aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:23.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.714+0000 7f4ccd1f0640 1 -- 172.21.15.70:0/2112316748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cc8109e20 msgr2=0x7f4cc819fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:23.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.714+0000 7f4ccd1f0640 1 --2- 172.21.15.70:0/2112316748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cc8109e20 0x7f4cc819fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:23.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.714+0000 7f4ccd1f0640 1 -- 172.21.15.70:0/2112316748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc81a0350 con 0x7f4cc8103b90 2024-09-21T05:47:23.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.714+0000 7f4ccc9ef640 1 --2- 172.21.15.70:0/2112316748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cc81094d0 0x7f4cc819aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:47:23.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.714+0000 7f4ccd1f0640 1 --2- 172.21.15.70:0/2112316748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cc8103b90 0x7f4cc819a4a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4005940 tx=0x7f4cc40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:23.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.714+0000 7f4cbe7fc640 1 -- 172.21.15.70:0/2112316748 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc403f030 con 0x7f4cc8103b90 2024-09-21T05:47:23.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.715+0000 7f4cbe7fc640 1 -- 172.21.15.70:0/2112316748 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f4cc4003cb0 con 0x7f4cc8103b90 2024-09-21T05:47:23.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.715+0000 7f4ccf454640 1 -- 172.21.15.70:0/2112316748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc81a05e0 con 0x7f4cc8103b90 2024-09-21T05:47:23.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.715+0000 7f4cbe7fc640 1 -- 172.21.15.70:0/2112316748 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc4035070 con 0x7f4cc8103b90 2024-09-21T05:47:23.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.715+0000 7f4ccf454640 1 -- 172.21.15.70:0/2112316748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc81a0ac0 con 0x7f4cc8103b90 2024-09-21T05:47:23.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.716+0000 7f4ccf454640 1 -- 172.21.15.70:0/2112316748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc8103fa0 con 0x7f4cc8103b90 2024-09-21T05:47:23.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.717+0000 7f4cbe7fc640 1 -- 172.21.15.70:0/2112316748 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f4cc4042030 con 0x7f4cc8103b90 2024-09-21T05:47:23.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.718+0000 7f4cbe7fc640 1 --2- 172.21.15.70:0/2112316748 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4cb40b6540 0x7f4cb40b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:23.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.718+0000 7f4ccc9ef640 1 --2- 172.21.15.70:0/2112316748 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4cb40b6540 0x7f4cb40b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:23.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.718+0000 7f4cbe7fc640 1 -- 172.21.15.70:0/2112316748 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8802+0+0 (secure 0 0 0) 0x7f4cc4107e00 con 0x7f4cc8103b90 2024-09-21T05:47:23.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.719+0000 7f4ccc9ef640 1 --2- 172.21.15.70:0/2112316748 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4cb40b6540 0x7f4cb40b8a50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8108f60 tx=0x7f4cb800a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:23.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.722+0000 7f4cbe7fc640 1 -- 172.21.15.70:0/2112316748 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4cc40ce3f0 con 0x7f4cc8103b90 2024-09-21T05:47:23.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.899+0000 7f4ccf454640 1 -- 172.21.15.70:0/2112316748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4cc819b5d0 con 0x7f4cc8103b90 2024-09-21T05:47:23.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.901+0000 7f4cbe7fc640 1 -- 172.21.15.70:0/2112316748 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+24222 (secure 0 0 0) 0x7f4cc40d27d0 con 0x7f4cc8103b90 2024-09-21T05:47:23.904 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:47:23.904 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":81,"fsid":"96c6636e-77db-11ef-baf5-efdc52797490","created":"2024-09-21T05:38:42.297307+0000","modified":"2024-09-21T05:47:15.317810+0000","last_up_change":"2024-09-21T05:46:15.910344+0000","last_in_change":"2024-09-21T05:45:53.382766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:42:25.611590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:47:01.987981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:47:04.388107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T05:47:10.651871+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00be8b82-7cb1-443f-ad18-02916f734df7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6803","nonce":1667051447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6805","nonce":1667051447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6809","nonce":1667051447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6807","nonce":1667051447}]},"public_addr":"172.21.15.70:6803/1667051447","cluster_addr":"172.21.15.70:6805/1667051447","heartbeat_back_addr":"172.21.15.70:6809/1667051447","heartbeat_front_addr":"172.21.15.70:6807/1667051447","state":["exists","up"]},{"osd":1,"uuid":"28ca8c5c-5e81-4e64-ac0e-3c8c3c2d3930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6801","nonce":1037621846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6803","nonce":1037621846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6807","nonce":1037621846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6805","nonce":1037621846}]},"public_addr":"172.21.15.116:6801/1037621846","cluster_addr":"172.21.15.116:6803/1037621846","heartbeat_back_addr":"172.21.15.116:6807/1037621846","heartbeat_front_addr":"172.21.15.116:6805/1037621846","state":["exists","up"]},{"osd":2,"uuid":"e9b42bf2-a38b-4cf9-8774-4950de12d0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6801","nonce":69260815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6803","nonce":69260815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6807","nonce":69260815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6805","nonce":69260815}]},"public_addr":"172.21.15.160:6801/69260815","cluster_addr":"172.21.15.160:6803/69260815","heartbeat_back_addr":"172.21.15.160:6807/69260815","heartbeat_front_addr":"172.21.15.160:6805/69260815","state":["exists","up"]},{"osd":3,"uuid":"25d8e9a8-3c14-43d6-9bb1-b44cd377133f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6811","nonce":3849416072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6813","nonce":3849416072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6817","nonce":3849416072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6815","nonce":3849416072}]},"public_addr":"172.21.15.70:6811/3849416072","cluster_addr":"172.21.15.70:6813/3849416072","heartbeat_back_addr":"172.21.15.70:6817/3849416072","heartbeat_front_addr":"172.21.15.70:6815/3849416072","state":["exists","up"]},{"osd":4,"uuid":"bdb84cbd-d718-4f69-90d0-2e732e580df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6809","nonce":3444857438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6811","nonce":3444857438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6815","nonce":3444857438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6813","nonce":3444857438}]},"public_addr":"172.21.15.116:6809/3444857438","cluster_addr":"172.21.15.116:6811/3444857438","heartbeat_back_addr":"172.21.15.116:6815/3444857438","heartbeat_front_addr":"172.21.15.116:6813/3444857438","state":["exists","up"]},{"osd":5,"uuid":"a490eeba-549f-4caa-8cd5-4168a23dafa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6809","nonce":3063220427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6811","nonce":3063220427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6815","nonce":3063220427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6813","nonce":3063220427}]},"public_addr":"172.21.15.160:6809/3063220427","cluster_addr":"172.21.15.160:6811/3063220427","heartbeat_back_addr":"172.21.15.160:6815/3063220427","heartbeat_front_addr":"172.21.15.160:6813/3063220427","state":["exists","up"]},{"osd":6,"uuid":"1bf22f48-c02f-4f09-b0fe-2597a55fd795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6819","nonce":3650315688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6821","nonce":3650315688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6825","nonce":3650315688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6823","nonce":3650315688}]},"public_addr":"172.21.15.70:6819/3650315688","cluster_addr":"172.21.15.70:6821/3650315688","heartbeat_back_addr":"172.21.15.70:6825/3650315688","heartbeat_front_addr":"172.21.15.70:6823/3650315688","state":["exists","up"]},{"osd":7,"uuid":"40d59744-4860-4a92-aa21-3f33e575e5b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6817","nonce":2034132009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6819","nonce":2034132009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6823","nonce":2034132009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6821","nonce":2034132009}]},"public_addr":"172.21.15.116:6817/2034132009","cluster_addr":"172.21.15.116:6819/2034132009","heartbeat_back_addr":"172.21.15.116:6823/2034132009","heartbeat_front_addr":"172.21.15.116:6821/2034132009","state":["exists","up"]},{"osd":8,"uuid":"65dc02e7-0dcd-4fa7-955a-4d5c00fbe4cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6817","nonce":3381625184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6819","nonce":3381625184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6823","nonce":3381625184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6821","nonce":3381625184}]},"public_addr":"172.21.15.160:6817/3381625184","cluster_addr":"172.21.15.160:6819/3381625184","heartbeat_back_addr":"172.21.15.160:6823/3381625184","heartbeat_front_addr":"172.21.15.160:6821/3381625184","state":["exists","up"]},{"osd":9,"uuid":"d8438a9c-012f-4082-be3f-9653cdfaac78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6827","nonce":3555256209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6829","nonce":3555256209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6833","nonce":3555256209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6831","nonce":3555256209}]},"public_addr":"172.21.15.70:6827/3555256209","cluster_addr":"172.21.15.70:6829/3555256209","heartbeat_back_addr":"172.21.15.70:6833/3555256209","heartbeat_front_addr":"172.21.15.70:6831/3555256209","state":["exists","up"]},{"osd":10,"uuid":"871619b0-181e-4020-9511-2cec296bfe70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6825","nonce":541280433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6827","nonce":541280433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6831","nonce":541280433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6829","nonce":541280433}]},"public_addr":"172.21.15.116:6825/541280433","cluster_addr":"172.21.15.116:6827/541280433","heartbeat_back_addr":"172.21.15.116:6831/541280433","heartbeat_front_addr":"172.21.15.116:6829/541280433","state":["exists","up"]},{"osd":11,"uuid":"302da945-7929-4b0c-a20b-099175752c41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6825","nonce":2632369083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6827","nonce":2632369083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6831","nonce":2632369083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6829","nonce":2632369083}]},"public_addr":"172.21.15.160:6825/2632369083","cluster_addr":"172.21.15.160:6827/2632369083","heartbeat_back_addr":"172.21.15.160:6831/2632369083","heartbeat_front_addr":"172.21.15.160:6829/2632369083","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:41:34.446744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:41:59.336955+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:42:23.958219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:42:49.396007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:43:15.325344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:43:41.923141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:07.873970+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:33.897951+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:58.397680+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:24.568406+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:49.504565+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:14.698577+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6800/605055695":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/897886925":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/1968357524":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/693721445":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/2810307308":"2024-09-22T05:39:12.492271+0000","172.21.15.70:6801/605055695":"2024-09-22T05:39:37.296630+0000","172.21.15.70:6801/1668927582":"2024-09-22T05:39:12.492271+0000","172.21.15.70:6800/1668927582":"2024-09-22T05:39:12.492271+0000","172.21.15.70:0/1979536420":"2024-09-22T05:39:12.492271+0000","172.21.15.70:0/2674019604":"2024-09-22T05:39:12.492271+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:47:23.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.904+0000 7f4ccf454640 1 -- 172.21.15.70:0/2112316748 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4cb40b6540 msgr2=0x7f4cb40b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:23.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.904+0000 7f4ccf454640 1 --2- 172.21.15.70:0/2112316748 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4cb40b6540 0x7f4cb40b8a50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8108f60 tx=0x7f4cb800a5c0 comp rx=0 tx=0).stop 2024-09-21T05:47:23.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.904+0000 7f4ccf454640 1 -- 172.21.15.70:0/2112316748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cc8103b90 msgr2=0x7f4cc819a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:23.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.904+0000 7f4ccf454640 1 --2- 172.21.15.70:0/2112316748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cc8103b90 0x7f4cc819a4a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4005940 tx=0x7f4cc40042f0 comp rx=0 tx=0).stop 2024-09-21T05:47:23.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.904+0000 7f4ccf454640 1 -- 172.21.15.70:0/2112316748 shutdown_connections 2024-09-21T05:47:23.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.904+0000 7f4ccf454640 1 --2- 172.21.15.70:0/2112316748 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4cb40b6540 0x7f4cb40b8a50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:23.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.904+0000 7f4ccf454640 1 --2- 172.21.15.70:0/2112316748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cc81094d0 0x7f4cc819aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:23.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.904+0000 7f4ccf454640 1 --2- 172.21.15.70:0/2112316748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cc8109e20 0x7f4cc819fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:23.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.904+0000 7f4ccf454640 1 --2- 172.21.15.70:0/2112316748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cc8103b90 0x7f4cc819a4a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:23.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.904+0000 7f4ccf454640 1 -- 172.21.15.70:0/2112316748 >> 172.21.15.70:0/2112316748 conn(0x7f4cc80ff620 msgr2=0x7f4cc8101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:23.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.904+0000 7f4ccf454640 1 -- 172.21.15.70:0/2112316748 shutdown_connections 2024-09-21T05:47:23.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:23.904+0000 7f4ccf454640 1 -- 172.21.15.70:0/2112316748 wait complete. 2024-09-21T05:47:24.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:23 smithi070 ceph-mon[30981]: pgmap v304: 129 pgs: 129 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:24.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:23 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2112316748' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:47:24.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:23 smithi116 ceph-mon[34332]: pgmap v304: 129 pgs: 129 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:24.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:23 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2112316748' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:47:24.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:23 smithi160 ceph-mon[33979]: pgmap v304: 129 pgs: 129 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:24.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:23 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2112316748' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:47:24.700 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T05:47:06.246985+0000', 'modified': '2024-09-21T05:47:15.318000+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24641}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24641': {'gid': 24641, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.116:6839/3952175670', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6838', 'nonce': 3952175670}, {'type': 'v1', 'addr': '172.21.15.116:6839', 'nonce': 3952175670}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24641, 'qdb_cluster': [24641]} 2024-09-21T05:47:24.700 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T05:47:24.700 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T05:47:24.943 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:47:25.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.421+0000 7f8acccfa640 1 -- 172.21.15.70:0/504949539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ac8110140 msgr2=0x7f8ac8112560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:25.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.421+0000 7f8acccfa640 1 --2- 172.21.15.70:0/504949539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ac8110140 0x7f8ac8112560 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0009900 tx=0x7f8ac002a410 comp rx=0 tx=0).stop 2024-09-21T05:47:25.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.421+0000 7f8acccfa640 1 -- 172.21.15.70:0/504949539 shutdown_connections 2024-09-21T05:47:25.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.421+0000 7f8acccfa640 1 --2- 172.21.15.70:0/504949539 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ac8076080 0x7f8ac810fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:25.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.421+0000 7f8acccfa640 1 --2- 172.21.15.70:0/504949539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ac8110140 0x7f8ac8112560 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:25.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.421+0000 7f8acccfa640 1 --2- 172.21.15.70:0/504949539 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ac8075730 0x7f8ac8075b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:25.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.421+0000 7f8acccfa640 1 -- 172.21.15.70:0/504949539 >> 172.21.15.70:0/504949539 conn(0x7f8ac80ff5d0 msgr2=0x7f8ac8101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:25.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.421+0000 7f8acccfa640 1 -- 172.21.15.70:0/504949539 shutdown_connections 2024-09-21T05:47:25.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.421+0000 7f8acccfa640 1 -- 172.21.15.70:0/504949539 wait complete. 2024-09-21T05:47:25.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.422+0000 7f8acccfa640 1 Processor -- start 2024-09-21T05:47:25.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.422+0000 7f8acccfa640 1 -- start start 2024-09-21T05:47:25.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.422+0000 7f8acccfa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ac8075730 0x7f8ac819c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:25.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.422+0000 7f8acccfa640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ac8076080 0x7f8ac819ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:25.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.422+0000 7f8acccfa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ac8110140 0x7f8ac81a20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:25.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.422+0000 7f8acccfa640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac8115d50 con 0x7f8ac8075730 2024-09-21T05:47:25.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.422+0000 7f8acccfa640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac8115bd0 con 0x7f8ac8110140 2024-09-21T05:47:25.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.422+0000 7f8acccfa640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac8115ed0 con 0x7f8ac8076080 2024-09-21T05:47:25.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.422+0000 7f8ac659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ac8075730 0x7f8ac819c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:25.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.422+0000 7f8ac659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ac8075730 0x7f8ac819c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54798/0 (socket says 172.21.15.70:54798) 2024-09-21T05:47:25.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.422+0000 7f8ac659c640 1 -- 172.21.15.70:0/2760502858 learned_addr learned my addr 172.21.15.70:0/2760502858 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:47:25.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.422+0000 7f8ac6d9d640 1 --2- 172.21.15.70:0/2760502858 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ac8110140 0x7f8ac81a20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:25.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.422+0000 7f8ac659c640 1 -- 172.21.15.70:0/2760502858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ac8076080 msgr2=0x7f8ac819ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:25.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.422+0000 7f8ac5d9b640 1 --2- 172.21.15.70:0/2760502858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ac8076080 0x7f8ac819ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:25.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.422+0000 7f8ac659c640 1 --2- 172.21.15.70:0/2760502858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ac8076080 0x7f8ac819ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:25.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.422+0000 7f8ac659c640 1 -- 172.21.15.70:0/2760502858 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ac8110140 msgr2=0x7f8ac81a20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:25.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.422+0000 7f8ac659c640 1 --2- 172.21.15.70:0/2760502858 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ac8110140 0x7f8ac81a20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:25.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.423+0000 7f8ac659c640 1 -- 172.21.15.70:0/2760502858 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac81a27f0 con 0x7f8ac8075730 2024-09-21T05:47:25.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.423+0000 7f8ac6d9d640 1 --2- 172.21.15.70:0/2760502858 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ac8110140 0x7f8ac81a20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:47:25.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.423+0000 7f8ac659c640 1 --2- 172.21.15.70:0/2760502858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ac8075730 0x7f8ac819c880 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800ba50 tx=0x7f8ab800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:25.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.423+0000 7f8ab77fe640 1 -- 172.21.15.70:0/2760502858 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8019070 con 0x7f8ac8075730 2024-09-21T05:47:25.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.423+0000 7f8ab77fe640 1 -- 172.21.15.70:0/2760502858 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f8ab800cbe0 con 0x7f8ac8075730 2024-09-21T05:47:25.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.423+0000 7f8acccfa640 1 -- 172.21.15.70:0/2760502858 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ac81a2ae0 con 0x7f8ac8075730 2024-09-21T05:47:25.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.423+0000 7f8ab77fe640 1 -- 172.21.15.70:0/2760502858 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab80075d0 con 0x7f8ac8075730 2024-09-21T05:47:25.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.423+0000 7f8acccfa640 1 -- 172.21.15.70:0/2760502858 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ac81a9240 con 0x7f8ac8075730 2024-09-21T05:47:25.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.426+0000 7f8ad326e740 1 Processor -- start 2024-09-21T05:47:25.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.426+0000 7f8ab77fe640 1 -- 172.21.15.70:0/2760502858 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f8ab801c070 con 0x7f8ac8075730 2024-09-21T05:47:25.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.426+0000 7f8ad326e740 1 -- start start 2024-09-21T05:47:25.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.426+0000 7f8ad326e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b3246aaf60 0x55b324a50f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:25.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.426+0000 7f8ad326e740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b3246820a0 0x55b324a51440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:25.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.426+0000 7f8ad326e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b32468a280 0x55b324a51980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:25.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.426+0000 7f8ad326e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b3249c8c10 con 0x55b32468a280 2024-09-21T05:47:25.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.426+0000 7f8ad326e740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b3249b8040 con 0x55b3246820a0 2024-09-21T05:47:25.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.426+0000 7f8ad326e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55b3249bbe50 con 0x55b3246aaf60 2024-09-21T05:47:25.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.426+0000 7f8ac5d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b32468a280 0x55b324a51980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:25.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.426+0000 7f8ac5d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b32468a280 0x55b324a51980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54804/0 (socket says 172.21.15.70:54804) 2024-09-21T05:47:25.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.426+0000 7f8ac5d9b640 1 -- 172.21.15.70:0/1294383650 learned_addr learned my addr 172.21.15.70:0/1294383650 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:47:25.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.426+0000 7f8ac6d9d640 1 --2- 172.21.15.70:0/1294383650 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b3246aaf60 0x55b324a50f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:25.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.427+0000 7f8ac659c640 1 --2- 172.21.15.70:0/1294383650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b3246820a0 0x55b324a51440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:25.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.427+0000 7f8ac5d9b640 1 -- 172.21.15.70:0/1294383650 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b3246aaf60 msgr2=0x55b324a50f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:47:25.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.427+0000 7f8ac5d9b640 1 --2- 172.21.15.70:0/1294383650 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b3246aaf60 0x55b324a50f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:25.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.427+0000 7f8ac5d9b640 1 -- 172.21.15.70:0/1294383650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b3246820a0 msgr2=0x55b324a51440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:47:25.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.427+0000 7f8ac5d9b640 1 --2- 172.21.15.70:0/1294383650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b3246820a0 0x55b324a51440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:25.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.427+0000 7f8ac5d9b640 1 -- 172.21.15.70:0/1294383650 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b324716540 con 0x55b32468a280 2024-09-21T05:47:25.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.427+0000 7f8ab77fe640 1 --2- 172.21.15.70:0/2760502858 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f8ab00b6510 0x7f8ab00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:25.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.427+0000 7f8ac5d9b640 1 --2- 172.21.15.70:0/1294383650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b32468a280 0x55b324a51980 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8abc00a880 tx=0x7f8abc00ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8b5e395b810914 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:25.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.427+0000 7f8ac6d9d640 1 --2- 172.21.15.70:0/2760502858 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f8ab00b6510 0x7f8ab00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:25.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.427+0000 7f8ab77fe640 1 -- 172.21.15.70:0/2760502858 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8802+0+0 (secure 0 0 0) 0x7f8ab80e6aa0 con 0x7f8ac8075730 2024-09-21T05:47:25.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.427+0000 7f8ab4ff9640 1 -- 172.21.15.70:0/1294383650 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8abc015070 con 0x55b32468a280 2024-09-21T05:47:25.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.427+0000 7f8ab4ff9640 1 -- 172.21.15.70:0/1294383650 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f8abc0113f0 con 0x55b32468a280 2024-09-21T05:47:25.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.427+0000 7f8ab4ff9640 1 -- 172.21.15.70:0/1294383650 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8abc0185c0 con 0x55b32468a280 2024-09-21T05:47:25.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.428+0000 7f8ad326e740 1 -- 172.21.15.70:0/1294383650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b32468a280 msgr2=0x55b324a51980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:25.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.428+0000 7f8ad326e740 1 --2- 172.21.15.70:0/1294383650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b32468a280 0x55b324a51980 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8abc00a880 tx=0x7f8abc00ad40 comp rx=0 tx=0).stop 2024-09-21T05:47:25.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.428+0000 7f8ac6d9d640 1 --2- 172.21.15.70:0/2760502858 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f8ab00b6510 0x7f8ab00b8a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0005d90 tx=0x7f8ac0009640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:25.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.428+0000 7f8ad326e740 1 -- 172.21.15.70:0/1294383650 shutdown_connections 2024-09-21T05:47:25.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.428+0000 7f8ad326e740 1 --2- 172.21.15.70:0/1294383650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b32468a280 0x55b324a51980 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:25.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.428+0000 7f8ad326e740 1 --2- 172.21.15.70:0/1294383650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b3246820a0 0x55b324a51440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:25.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.428+0000 7f8ad326e740 1 --2- 172.21.15.70:0/1294383650 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b3246aaf60 0x55b324a50f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:25.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.428+0000 7f8ad326e740 1 -- 172.21.15.70:0/1294383650 >> 172.21.15.70:0/1294383650 conn(0x55b32469f350 msgr2=0x55b324a4edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:25.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.428+0000 7f8ad326e740 1 -- 172.21.15.70:0/1294383650 shutdown_connections 2024-09-21T05:47:25.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.428+0000 7f8ad326e740 1 -- 172.21.15.70:0/1294383650 wait complete. 2024-09-21T05:47:25.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.429+0000 7f8ad326e740 1 -- start start 2024-09-21T05:47:25.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.429+0000 7f8ad326e740 1 Processor -- start 2024-09-21T05:47:25.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.429+0000 7f8ad326e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3246820a0 0x55b324a5c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:25.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.429+0000 7f8ad326e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b32468a280 0x55b324a5cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:25.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.429+0000 7f8ad326e740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b3246aaf60 0x55b324a68a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:25.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.429+0000 7f8ad326e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b3248195f0 con 0x55b3246820a0 2024-09-21T05:47:25.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.429+0000 7f8ad326e740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b324953010 con 0x55b3246aaf60 2024-09-21T05:47:25.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.429+0000 7f8ad326e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55b324a5f6e0 con 0x55b32468a280 2024-09-21T05:47:25.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.429+0000 7f8ad326e740 10 client.0 _ll_register_callbacks cb 0x55b3249b2340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:47:25.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.429+0000 7f8ac659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3246820a0 0x55b324a5c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:25.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.429+0000 7f8ac659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3246820a0 0x55b324a5c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54818/0 (socket says 172.21.15.70:54818) 2024-09-21T05:47:25.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.429+0000 7f8ac659c640 1 -- 172.21.15.70:0/3367583544 learned_addr learned my addr 172.21.15.70:0/3367583544 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:47:25.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.430+0000 7f8ac5d9b640 1 --2- 172.21.15.70:0/3367583544 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b32468a280 0x55b324a5cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:25.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.430+0000 7f8ac6d9d640 1 --2- 172.21.15.70:0/3367583544 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b3246aaf60 0x55b324a68a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:25.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.430+0000 7f8ac659c640 1 -- 172.21.15.70:0/3367583544 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b32468a280 msgr2=0x55b324a5cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:47:25.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.430+0000 7f8ac659c640 1 --2- 172.21.15.70:0/3367583544 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b32468a280 0x55b324a5cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:25.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.430+0000 7f8ac659c640 1 -- 172.21.15.70:0/3367583544 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b3246aaf60 msgr2=0x55b324a68a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:47:25.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.430+0000 7f8ac659c640 1 --2- 172.21.15.70:0/3367583544 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b3246aaf60 0x55b324a68a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:25.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.430+0000 7f8ac659c640 1 -- 172.21.15.70:0/3367583544 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b324980a00 con 0x55b3246820a0 2024-09-21T05:47:25.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.430+0000 7f8ac5d9b640 1 --2- 172.21.15.70:0/3367583544 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b32468a280 0x55b324a5cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:47:25.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.430+0000 7f8ac659c640 1 --2- 172.21.15.70:0/3367583544 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3246820a0 0x55b324a5c770 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009fd0 tx=0x7f8ab80a8890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf9b375a50342164 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:25.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.430+0000 7f8aadffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:47:25.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.430+0000 7f8aadffb640 1 -- 172.21.15.70:0/3367583544 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab80ac160 con 0x55b3246820a0 2024-09-21T05:47:25.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.430+0000 7f8aadffb640 1 -- 172.21.15.70:0/3367583544 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8802+0+0 (secure 0 0 0) 0x7f8ab80abe50 con 0x55b3246820a0 2024-09-21T05:47:25.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.430+0000 7f8ad326e740 1 -- 172.21.15.70:0/3367583544 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8abc0113f0 con 0x55b3246820a0 2024-09-21T05:47:25.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.430+0000 7f8aadffb640 1 -- 172.21.15.70:0/3367583544 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f8ab80d00b0 con 0x55b3246820a0 2024-09-21T05:47:25.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.430+0000 7f8ad326e740 10 client.14895 fetch_fsmap learned FSMap version 16 2024-09-21T05:47:25.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.430+0000 7f8ad326e740 1 -- 172.21.15.70:0/3367583544 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=4+}) -- 0x55b324a6b660 con 0x55b3246820a0 2024-09-21T05:47:25.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.430+0000 7f8aadffb640 1 -- 172.21.15.70:0/3367583544 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f8abc0113f0 con 0x55b3246820a0 2024-09-21T05:47:25.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.431+0000 7f8aadffb640 1 -- 172.21.15.70:0/3367583544 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 16) ==== 8350+0+0 (secure 0 0 0) 0x7f8ab80b1080 con 0x55b3246820a0 2024-09-21T05:47:25.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.431+0000 7f8ad326e740 10 client.14895 fetch_fsmap finished waiting for FSMap version 16 2024-09-21T05:47:25.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.431+0000 7f8ad326e740 10 client.14895 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T05:47:25.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.431+0000 7f8ad326e740 20 client.14895 populate_metadata read hostname 'smithi070' 2024-09-21T05:47:25.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.431+0000 7f8ad326e740 1 --2- 172.21.15.70:0/3367583544 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55b3246698e0 0x55b324a6f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:25.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.431+0000 7f8ad326e740 4 client.14895 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:47:25.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.431+0000 7f8ad326e740 1 -- 172.21.15.70:0/3367583544 --> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3249cab60 con 0x55b3246698e0 2024-09-21T05:47:25.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.431+0000 7f8ac5d9b640 1 --2- 172.21.15.70:0/3367583544 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55b3246698e0 0x55b324a6f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:25.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.431+0000 7f8ac5d9b640 1 --2- 172.21.15.70:0/3367583544 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55b3246698e0 0x55b324a6f0e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=203ac2fae2c33044 server_cookie=31dd12398a3b6791 in_seq=0 out_seq=0 2024-09-21T05:47:25.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.431+0000 7f8aadffb640 10 client.14895 ms_handle_connect on v2:172.21.15.116:6838/3952175670 2024-09-21T05:47:25.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.432+0000 7f8aadffb640 1 -- 172.21.15.70:0/3367583544 <== mds.0 v2:172.21.15.116:6838/3952175670 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b3249cab60 con 0x55b3246698e0 2024-09-21T05:47:25.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.432+0000 7f8aadffb640 10 client.14895 handle_command_reply: tid=0 2024-09-21T05:47:25.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.432+0000 7f8ad326e740 1 client.14895 shutdown 2024-09-21T05:47:25.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.432+0000 7f8ad326e740 1 -- 172.21.15.70:0/3367583544 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3246820a0 msgr2=0x55b324a5c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:25.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.432+0000 7f8ad326e740 1 --2- 172.21.15.70:0/3367583544 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3246820a0 0x55b324a5c770 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009fd0 tx=0x7f8ab80a8890 comp rx=0 tx=0).stop 2024-09-21T05:47:25.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.432+0000 7f8ad326e740 1 -- 172.21.15.70:0/3367583544 shutdown_connections 2024-09-21T05:47:25.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.433+0000 7f8ad326e740 1 --2- 172.21.15.70:0/3367583544 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55b3246698e0 0x55b324a6f0e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:25.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.433+0000 7f8ad326e740 1 --2- 172.21.15.70:0/3367583544 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b32468a280 0x55b324a5cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:25.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.433+0000 7f8ad326e740 1 --2- 172.21.15.70:0/3367583544 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b3246aaf60 0x55b324a68a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:25.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.433+0000 7f8aadffb640 0 client.14895 ms_handle_reset on v2:172.21.15.116:6838/3952175670 2024-09-21T05:47:25.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.433+0000 7f8ad326e740 1 --2- 172.21.15.70:0/3367583544 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3246820a0 0x55b324a5c770 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:25.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.433+0000 7f8ad326e740 1 -- 172.21.15.70:0/3367583544 >> 172.21.15.70:0/3367583544 conn(0x55b32469f350 msgr2=0x55b324a54090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:25.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.433+0000 7f8ad326e740 1 -- 172.21.15.70:0/3367583544 shutdown_connections 2024-09-21T05:47:25.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.433+0000 7f8ad326e740 1 -- 172.21.15.70:0/3367583544 wait complete. 2024-09-21T05:47:25.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.433+0000 7f8ad326e740 20 client.14895 trim_cache size 0 max 16384 2024-09-21T05:47:25.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.451+0000 7f8ad326e740 1 Processor -- start 2024-09-21T05:47:25.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.451+0000 7f8ad326e740 1 -- start start 2024-09-21T05:47:25.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.451+0000 7f8ad326e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b3246820a0 0x55b324a49ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:25.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.451+0000 7f8ad326e740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b32468a280 0x55b324a57920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:25.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.451+0000 7f8ad326e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3246aaf60 0x55b324a57e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:25.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.451+0000 7f8ad326e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b324a6d420 con 0x55b3246aaf60 2024-09-21T05:47:25.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.451+0000 7f8ad326e740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b324a6daf0 con 0x55b32468a280 2024-09-21T05:47:25.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.451+0000 7f8ad326e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55b324a6e1c0 con 0x55b3246820a0 2024-09-21T05:47:25.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.451+0000 7f8ac6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3246aaf60 0x55b324a57e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:25.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.451+0000 7f8ac6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3246aaf60 0x55b324a57e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54830/0 (socket says 172.21.15.70:54830) 2024-09-21T05:47:25.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.451+0000 7f8ac6d9d640 1 -- 172.21.15.70:0/3255576381 learned_addr learned my addr 172.21.15.70:0/3255576381 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:47:25.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.451+0000 7f8ac5d9b640 1 --2- 172.21.15.70:0/3255576381 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b32468a280 0x55b324a57920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:25.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.451+0000 7f8ac659c640 1 --2- 172.21.15.70:0/3255576381 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b3246820a0 0x55b324a49ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:25.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.452+0000 7f8ac6d9d640 1 -- 172.21.15.70:0/3255576381 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b3246820a0 msgr2=0x55b324a49ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:47:25.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.452+0000 7f8ac6d9d640 1 --2- 172.21.15.70:0/3255576381 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b3246820a0 0x55b324a49ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:25.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.452+0000 7f8ac6d9d640 1 -- 172.21.15.70:0/3255576381 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b32468a280 msgr2=0x55b324a57920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:47:25.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.452+0000 7f8ac6d9d640 1 --2- 172.21.15.70:0/3255576381 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b32468a280 0x55b324a57920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:25.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.452+0000 7f8ac6d9d640 1 -- 172.21.15.70:0/3255576381 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b324a531f0 con 0x55b3246aaf60 2024-09-21T05:47:25.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.452+0000 7f8ac6d9d640 1 --2- 172.21.15.70:0/3255576381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3246aaf60 0x55b324a57e60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0033000 tx=0x7f8ac003d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32f7c5cf8603e76 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:25.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.452+0000 7f8aaffff640 1 -- 172.21.15.70:0/3255576381 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac0035040 con 0x55b3246aaf60 2024-09-21T05:47:25.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.452+0000 7f8aaffff640 1 -- 172.21.15.70:0/3255576381 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f8ac004e070 con 0x55b3246aaf60 2024-09-21T05:47:25.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.452+0000 7f8aaffff640 1 -- 172.21.15.70:0/3255576381 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac0004b20 con 0x55b3246aaf60 2024-09-21T05:47:25.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.453+0000 7f8ad326e740 1 -- 172.21.15.70:0/3255576381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3246aaf60 msgr2=0x55b324a57e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:25.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.453+0000 7f8ad326e740 1 --2- 172.21.15.70:0/3255576381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3246aaf60 0x55b324a57e60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0033000 tx=0x7f8ac003d000 comp rx=0 tx=0).stop 2024-09-21T05:47:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.453+0000 7f8ad326e740 1 -- 172.21.15.70:0/3255576381 shutdown_connections 2024-09-21T05:47:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.453+0000 7f8ad326e740 1 --2- 172.21.15.70:0/3255576381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3246aaf60 0x55b324a57e60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.453+0000 7f8ad326e740 1 --2- 172.21.15.70:0/3255576381 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b32468a280 0x55b324a57920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.453+0000 7f8ad326e740 1 --2- 172.21.15.70:0/3255576381 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b3246820a0 0x55b324a49ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.453+0000 7f8ad326e740 1 -- 172.21.15.70:0/3255576381 >> 172.21.15.70:0/3255576381 conn(0x55b32469f350 msgr2=0x55b324a6cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.453+0000 7f8ad326e740 1 -- 172.21.15.70:0/3255576381 shutdown_connections 2024-09-21T05:47:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.453+0000 7f8ad326e740 1 -- 172.21.15.70:0/3255576381 wait complete. 2024-09-21T05:47:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.453+0000 7f8ad326e740 1 -- start start 2024-09-21T05:47:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.453+0000 7f8ad326e740 1 Processor -- start 2024-09-21T05:47:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.454+0000 7f8ad326e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b3246820a0 0x55b324a719d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.454+0000 7f8ad326e740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b32468a280 0x55b324a71f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.454+0000 7f8ad326e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3246aaf60 0x55b324a76820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.454+0000 7f8ad326e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b324a6ef60 con 0x55b3246aaf60 2024-09-21T05:47:25.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.454+0000 7f8ad326e740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b324a6e890 con 0x55b32468a280 2024-09-21T05:47:25.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.454+0000 7f8ad326e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55b324a6f630 con 0x55b3246820a0 2024-09-21T05:47:25.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.454+0000 7f8ad326e740 10 client.0 _ll_register_callbacks cb 0x7f8ab80a9040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:47:25.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.454+0000 7f8ac6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3246aaf60 0x55b324a76820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:25.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.454+0000 7f8ac6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3246aaf60 0x55b324a76820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54838/0 (socket says 172.21.15.70:54838) 2024-09-21T05:47:25.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.454+0000 7f8ac6d9d640 1 -- 172.21.15.70:0/2210253057 learned_addr learned my addr 172.21.15.70:0/2210253057 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:47:25.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.454+0000 7f8ac659c640 1 --2- 172.21.15.70:0/2210253057 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b3246820a0 0x55b324a719d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:25.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.454+0000 7f8ac5d9b640 1 --2- 172.21.15.70:0/2210253057 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b32468a280 0x55b324a71f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:25.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.454+0000 7f8ac6d9d640 1 -- 172.21.15.70:0/2210253057 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b3246820a0 msgr2=0x55b324a719d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:47:25.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.454+0000 7f8ac6d9d640 1 --2- 172.21.15.70:0/2210253057 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b3246820a0 0x55b324a719d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:25.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.454+0000 7f8ac6d9d640 1 -- 172.21.15.70:0/2210253057 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b32468a280 msgr2=0x55b324a71f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:47:25.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.454+0000 7f8ac6d9d640 1 --2- 172.21.15.70:0/2210253057 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b32468a280 0x55b324a71f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:25.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.454+0000 7f8ac6d9d640 1 -- 172.21.15.70:0/2210253057 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b324a76e90 con 0x55b3246aaf60 2024-09-21T05:47:25.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.454+0000 7f8ac5d9b640 1 --2- 172.21.15.70:0/2210253057 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b32468a280 0x55b324a71f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:47:25.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.454+0000 7f8ac6d9d640 1 --2- 172.21.15.70:0/2210253057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3246aaf60 0x55b324a76820 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0006010 tx=0x7f8ac0031500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c09b8809439b6b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:25.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.454+0000 7f8aadffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:47:25.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.455+0000 7f8aadffb640 1 -- 172.21.15.70:0/2210253057 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac0035040 con 0x55b3246aaf60 2024-09-21T05:47:25.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.455+0000 7f8aadffb640 1 -- 172.21.15.70:0/2210253057 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8802+0+0 (secure 0 0 0) 0x7f8ac0004cf0 con 0x55b3246aaf60 2024-09-21T05:47:25.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.455+0000 7f8ad326e740 1 -- 172.21.15.70:0/2210253057 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ac004e070 con 0x55b3246aaf60 2024-09-21T05:47:25.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.455+0000 7f8aadffb640 1 -- 172.21.15.70:0/2210253057 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f8ac0005040 con 0x55b3246aaf60 2024-09-21T05:47:25.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.455+0000 7f8ad326e740 10 client.14901 fetch_fsmap learned FSMap version 16 2024-09-21T05:47:25.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.455+0000 7f8ad326e740 1 -- 172.21.15.70:0/2210253057 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=4+}) -- 0x55b324a780f0 con 0x55b3246aaf60 2024-09-21T05:47:25.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.455+0000 7f8aadffb640 1 -- 172.21.15.70:0/2210253057 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f8ac004e070 con 0x55b3246aaf60 2024-09-21T05:47:25.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.455+0000 7f8aadffb640 1 -- 172.21.15.70:0/2210253057 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 16) ==== 8350+0+0 (secure 0 0 0) 0x7f8ac0049b10 con 0x55b3246aaf60 2024-09-21T05:47:25.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.455+0000 7f8ad326e740 10 client.14901 fetch_fsmap finished waiting for FSMap version 16 2024-09-21T05:47:25.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.455+0000 7f8ad326e740 10 client.14901 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T05:47:25.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.455+0000 7f8ad326e740 20 client.14901 populate_metadata read hostname 'smithi070' 2024-09-21T05:47:25.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.455+0000 7f8ad326e740 1 --2- 172.21.15.70:0/2210253057 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55b32463ec90 0x55b324add850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:25.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.455+0000 7f8ad326e740 4 client.14901 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T05:47:25.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.455+0000 7f8ad326e740 1 -- 172.21.15.70:0/2210253057 --> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] -- command(tid 0: {"prefix": "status"}) -- 0x55b3249c6610 con 0x55b32463ec90 2024-09-21T05:47:25.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.456+0000 7f8ac659c640 1 --2- 172.21.15.70:0/2210253057 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55b32463ec90 0x55b324add850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:25.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.456+0000 7f8ac659c640 1 --2- 172.21.15.70:0/2210253057 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55b32463ec90 0x55b324add850 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa94f1b206beaf9e server_cookie=ea229ca0e42b6bd7 in_seq=0 out_seq=0 2024-09-21T05:47:25.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.456+0000 7f8aadffb640 10 client.14901 ms_handle_connect on v2:172.21.15.116:6838/3952175670 2024-09-21T05:47:25.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.456+0000 7f8aadffb640 1 -- 172.21.15.70:0/2210253057 <== mds.0 v2:172.21.15.116:6838/3952175670 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55b3249c6610 con 0x55b32463ec90 2024-09-21T05:47:25.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.456+0000 7f8aadffb640 10 client.14901 handle_command_reply: tid=0 2024-09-21T05:47:25.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.456+0000 7f8ad326e740 1 client.14901 shutdown 2024-09-21T05:47:25.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.456+0000 7f8ad326e740 1 -- 172.21.15.70:0/2210253057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3246aaf60 msgr2=0x55b324a76820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:25.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.456+0000 7f8ad326e740 1 --2- 172.21.15.70:0/2210253057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3246aaf60 0x55b324a76820 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0006010 tx=0x7f8ac0031500 comp rx=0 tx=0).stop 2024-09-21T05:47:25.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.457+0000 7f8ad326e740 1 -- 172.21.15.70:0/2210253057 shutdown_connections 2024-09-21T05:47:25.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.457+0000 7f8ad326e740 1 --2- 172.21.15.70:0/2210253057 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55b32463ec90 0x55b324add850 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:25.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.457+0000 7f8aadffb640 0 client.14901 ms_handle_reset on v2:172.21.15.116:6838/3952175670 2024-09-21T05:47:25.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.457+0000 7f8ad326e740 1 --2- 172.21.15.70:0/2210253057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3246aaf60 0x55b324a76820 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:25.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.457+0000 7f8ad326e740 1 --2- 172.21.15.70:0/2210253057 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b32468a280 0x55b324a71f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:25.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.457+0000 7f8ad326e740 1 --2- 172.21.15.70:0/2210253057 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b3246820a0 0x55b324a719d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:25.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.457+0000 7f8ad326e740 1 -- 172.21.15.70:0/2210253057 >> 172.21.15.70:0/2210253057 conn(0x55b32469f350 msgr2=0x55b324a68bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:25.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.457+0000 7f8ad326e740 1 -- 172.21.15.70:0/2210253057 shutdown_connections 2024-09-21T05:47:25.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.457+0000 7f8ad326e740 1 -- 172.21.15.70:0/2210253057 wait complete. 2024-09-21T05:47:25.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.457+0000 7f8ad326e740 20 client.14901 trim_cache size 0 max 16384 2024-09-21T05:47:25.464 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:47:25.464 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "96c6636e-77db-11ef-baf5-efdc52797490", 2024-09-21T05:47:25.465 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 0, 2024-09-21T05:47:25.465 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24641, 2024-09-21T05:47:25.465 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-21T05:47:25.465 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-21T05:47:25.465 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-21T05:47:25.465 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 18.840173804999999, 2024-09-21T05:47:25.465 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 16, 2024-09-21T05:47:25.465 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 81, 2024-09-21T05:47:25.465 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 81, 2024-09-21T05:47:25.465 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 29.332868319999999 2024-09-21T05:47:25.465 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:47:25.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.457+0000 7f8acccfa640 1 -- 172.21.15.70:0/2760502858 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f8ab00b6510 msgr2=0x7f8ab00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:25.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.457+0000 7f8acccfa640 1 --2- 172.21.15.70:0/2760502858 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f8ab00b6510 0x7f8ab00b8a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0005d90 tx=0x7f8ac0009640 comp rx=0 tx=0).stop 2024-09-21T05:47:25.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.457+0000 7f8acccfa640 1 -- 172.21.15.70:0/2760502858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ac8075730 msgr2=0x7f8ac819c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:25.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.457+0000 7f8acccfa640 1 --2- 172.21.15.70:0/2760502858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ac8075730 0x7f8ac819c880 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800ba50 tx=0x7f8ab800bf10 comp rx=0 tx=0).stop 2024-09-21T05:47:25.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.457+0000 7f8acccfa640 1 -- 172.21.15.70:0/2760502858 shutdown_connections 2024-09-21T05:47:25.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.457+0000 7f8acccfa640 1 --2- 172.21.15.70:0/2760502858 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f8ab00b6510 0x7f8ab00b8a20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:25.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.457+0000 7f8acccfa640 1 --2- 172.21.15.70:0/2760502858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ac8076080 0x7f8ac819ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:25.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.457+0000 7f8acccfa640 1 --2- 172.21.15.70:0/2760502858 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ac8110140 0x7f8ac81a20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:25.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.457+0000 7f8acccfa640 1 --2- 172.21.15.70:0/2760502858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ac8075730 0x7f8ac819c880 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:25.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.457+0000 7f8acccfa640 1 -- 172.21.15.70:0/2760502858 >> 172.21.15.70:0/2760502858 conn(0x7f8ac80ff5d0 msgr2=0x7f8ac8109d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:25.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.457+0000 7f8acccfa640 1 -- 172.21.15.70:0/2760502858 shutdown_connections 2024-09-21T05:47:25.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:25.457+0000 7f8acccfa640 1 -- 172.21.15.70:0/2760502858 wait complete. 2024-09-21T05:47:25.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:25 smithi070 ceph-mon[30981]: pgmap v305: 129 pgs: 129 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:25.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:25 smithi116 ceph-mon[34332]: pgmap v305: 129 pgs: 129 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:25.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:25 smithi160 ceph-mon[33979]: pgmap v305: 129 pgs: 129 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:26.177 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T05:47:26.177 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-21T05:47:26.177 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T05:47:26.423 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:47:26.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.854+0000 7fbd3dcd8640 1 -- 172.21.15.70:0/4270761347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd38108d70 msgr2=0x7fbd3810f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:26.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.854+0000 7fbd3dcd8640 1 --2- 172.21.15.70:0/4270761347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd38108d70 0x7fbd3810f5a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbd30009ca0 tx=0x7fbd3002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:47:26.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.854+0000 7fbd3dcd8640 1 -- 172.21.15.70:0/4270761347 shutdown_connections 2024-09-21T05:47:26.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.854+0000 7fbd3dcd8640 1 --2- 172.21.15.70:0/4270761347 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd38108420 0x7fbd38108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:26.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.854+0000 7fbd3dcd8640 1 --2- 172.21.15.70:0/4270761347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd38108d70 0x7fbd3810f5a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:26.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.854+0000 7fbd3dcd8640 1 --2- 172.21.15.70:0/4270761347 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd38102ae0 0x7fbd38102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:26.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.854+0000 7fbd3dcd8640 1 -- 172.21.15.70:0/4270761347 >> 172.21.15.70:0/4270761347 conn(0x7fbd38079770 msgr2=0x7fbd38079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:26.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.854+0000 7fbd3dcd8640 1 -- 172.21.15.70:0/4270761347 shutdown_connections 2024-09-21T05:47:26.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.854+0000 7fbd3dcd8640 1 -- 172.21.15.70:0/4270761347 wait complete. 2024-09-21T05:47:26.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.855+0000 7fbd3dcd8640 1 Processor -- start 2024-09-21T05:47:26.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.855+0000 7fbd3dcd8640 1 -- start start 2024-09-21T05:47:26.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.855+0000 7fbd3dcd8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd38102ae0 0x7fbd3819a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:26.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.855+0000 7fbd3dcd8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd38108420 0x7fbd3819aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:26.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.855+0000 7fbd3dcd8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd38108d70 0x7fbd3819fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:26.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.855+0000 7fbd3dcd8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbd38112a80 con 0x7fbd38108420 2024-09-21T05:47:26.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.855+0000 7fbd3dcd8640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fbd38112900 con 0x7fbd38108d70 2024-09-21T05:47:26.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.855+0000 7fbd3dcd8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbd38112c00 con 0x7fbd38102ae0 2024-09-21T05:47:26.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.856+0000 7fbd2ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd38108420 0x7fbd3819aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:26.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.856+0000 7fbd2ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd38108420 0x7fbd3819aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54860/0 (socket says 172.21.15.70:54860) 2024-09-21T05:47:26.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.856+0000 7fbd2ffff640 1 -- 172.21.15.70:0/2853558772 learned_addr learned my addr 172.21.15.70:0/2853558772 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:47:26.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.856+0000 7fbd37fff640 1 --2- 172.21.15.70:0/2853558772 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd38108d70 0x7fbd3819fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:26.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.856+0000 7fbd377fe640 1 --2- 172.21.15.70:0/2853558772 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd38102ae0 0x7fbd3819a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:26.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.856+0000 7fbd2ffff640 1 -- 172.21.15.70:0/2853558772 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd38102ae0 msgr2=0x7fbd3819a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:26.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.856+0000 7fbd2ffff640 1 --2- 172.21.15.70:0/2853558772 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd38102ae0 0x7fbd3819a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:26.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.856+0000 7fbd2ffff640 1 -- 172.21.15.70:0/2853558772 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd38108d70 msgr2=0x7fbd3819fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:26.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.856+0000 7fbd2ffff640 1 --2- 172.21.15.70:0/2853558772 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd38108d70 0x7fbd3819fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:26.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.856+0000 7fbd2ffff640 1 -- 172.21.15.70:0/2853558772 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd381a0490 con 0x7fbd38108420 2024-09-21T05:47:26.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.856+0000 7fbd377fe640 1 --2- 172.21.15.70:0/2853558772 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd38102ae0 0x7fbd3819a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:47:26.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.856+0000 7fbd2ffff640 1 --2- 172.21.15.70:0/2853558772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd38108420 0x7fbd3819aac0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000c970 tx=0x7fbd2000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:26.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.856+0000 7fbd357fa640 1 -- 172.21.15.70:0/2853558772 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd20007bb0 con 0x7fbd38108420 2024-09-21T05:47:26.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.856+0000 7fbd3dcd8640 1 -- 172.21.15.70:0/2853558772 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd381a0780 con 0x7fbd38108420 2024-09-21T05:47:26.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.856+0000 7fbd357fa640 1 -- 172.21.15.70:0/2853558772 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fbd20007d50 con 0x7fbd38108420 2024-09-21T05:47:26.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.856+0000 7fbd357fa640 1 -- 172.21.15.70:0/2853558772 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd20004e50 con 0x7fbd38108420 2024-09-21T05:47:26.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.856+0000 7fbd3dcd8640 1 -- 172.21.15.70:0/2853558772 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd381a6ee0 con 0x7fbd38108420 2024-09-21T05:47:26.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.857+0000 7fbd3dcd8640 1 -- 172.21.15.70:0/2853558772 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd38103d60 con 0x7fbd38108420 2024-09-21T05:47:26.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.859+0000 7fbd357fa640 1 -- 172.21.15.70:0/2853558772 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fbd20005000 con 0x7fbd38108420 2024-09-21T05:47:26.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.859+0000 7fbd357fa640 1 --2- 172.21.15.70:0/2853558772 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fbd180b66b0 0x7fbd180b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:26.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.860+0000 7fbd377fe640 1 --2- 172.21.15.70:0/2853558772 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fbd180b66b0 0x7fbd180b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:26.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.860+0000 7fbd357fa640 1 -- 172.21.15.70:0/2853558772 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8802+0+0 (secure 0 0 0) 0x7fbd200e76c0 con 0x7fbd38108420 2024-09-21T05:47:26.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.860+0000 7fbd377fe640 1 --2- 172.21.15.70:0/2853558772 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fbd180b66b0 0x7fbd180b8bc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbd28006fd0 tx=0x7fbd28008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:26.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:26.864+0000 7fbd357fa640 1 -- 172.21.15.70:0/2853558772 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbd20014030 con 0x7fbd38108420 2024-09-21T05:47:27.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:27.078+0000 7fbd3dcd8640 1 -- 172.21.15.70:0/2853558772 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbd38102ef0 con 0x7fbd38108420 2024-09-21T05:47:27.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:27.078+0000 7fbd357fa640 1 -- 172.21.15.70:0/2853558772 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+88 (secure 0 0 0) 0x7fbd38102ef0 con 0x7fbd38108420 2024-09-21T05:47:27.081 INFO:teuthology.orchestra.run.smithi070.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T05:47:27.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:27.080+0000 7fbd3dcd8640 1 -- 172.21.15.70:0/2853558772 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fbd180b66b0 msgr2=0x7fbd180b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:27.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:27.080+0000 7fbd3dcd8640 1 --2- 172.21.15.70:0/2853558772 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fbd180b66b0 0x7fbd180b8bc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbd28006fd0 tx=0x7fbd28008040 comp rx=0 tx=0).stop 2024-09-21T05:47:27.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:27.080+0000 7fbd3dcd8640 1 -- 172.21.15.70:0/2853558772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd38108420 msgr2=0x7fbd3819aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:27.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:27.080+0000 7fbd3dcd8640 1 --2- 172.21.15.70:0/2853558772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd38108420 0x7fbd3819aac0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000c970 tx=0x7fbd2000ce30 comp rx=0 tx=0).stop 2024-09-21T05:47:27.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:27.080+0000 7fbd3dcd8640 1 -- 172.21.15.70:0/2853558772 shutdown_connections 2024-09-21T05:47:27.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:27.080+0000 7fbd3dcd8640 1 --2- 172.21.15.70:0/2853558772 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fbd180b66b0 0x7fbd180b8bc0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:27.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:27.080+0000 7fbd3dcd8640 1 --2- 172.21.15.70:0/2853558772 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd38108d70 0x7fbd3819fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:27.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:27.080+0000 7fbd3dcd8640 1 --2- 172.21.15.70:0/2853558772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd38108420 0x7fbd3819aac0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:27.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:27.080+0000 7fbd3dcd8640 1 --2- 172.21.15.70:0/2853558772 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd38102ae0 0x7fbd3819a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:27.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:27.080+0000 7fbd3dcd8640 1 -- 172.21.15.70:0/2853558772 >> 172.21.15.70:0/2853558772 conn(0x7fbd38079770 msgr2=0x7fbd38101940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:27.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:27.081+0000 7fbd3dcd8640 1 -- 172.21.15.70:0/2853558772 shutdown_connections 2024-09-21T05:47:27.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:27.081+0000 7fbd3dcd8640 1 -- 172.21.15.70:0/2853558772 wait complete. 2024-09-21T05:47:27.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:27 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2853558772' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T05:47:27.448 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:27 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2853558772' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T05:47:27.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:27 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2853558772' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T05:47:27.826 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T05:47:27.826 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T05:47:27.826 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi070.front.sepia.ceph.com 2024-09-21T05:47:27.826 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-21T05:47:27.826 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-21T05:47:27.826 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T05:47:27.826 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T05:47:27.826 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T05:47:27.827 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-21T05:47:27.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:47:27.827 DEBUG:teuthology.orchestra.run.smithi070:> ip addr 2024-09-21T05:47:27.843 INFO:teuthology.orchestra.run.smithi070.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T05:47:27.843 INFO:teuthology.orchestra.run.smithi070.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T05:47:27.843 INFO:teuthology.orchestra.run.smithi070.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T05:47:27.843 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-21T05:47:27.844 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 ::1/128 scope host 2024-09-21T05:47:27.844 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-21T05:47:27.844 INFO:teuthology.orchestra.run.smithi070.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T05:47:27.844 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b2 brd ff:ff:ff:ff:ff:ff 2024-09-21T05:47:27.844 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f0 2024-09-21T05:47:27.844 INFO:teuthology.orchestra.run.smithi070.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T05:47:27.844 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b3 brd ff:ff:ff:ff:ff:ff 2024-09-21T05:47:27.844 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f1 2024-09-21T05:47:27.844 INFO:teuthology.orchestra.run.smithi070.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T05:47:27.844 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e6 brd ff:ff:ff:ff:ff:ff 2024-09-21T05:47:27.844 INFO:teuthology.orchestra.run.smithi070.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T05:47:27.844 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e7 brd ff:ff:ff:ff:ff:ff 2024-09-21T05:47:27.844 INFO:teuthology.orchestra.run.smithi070.stdout: inet 172.21.15.70/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T05:47:27.845 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft 42246sec preferred_lft 42246sec 2024-09-21T05:47:27.845 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::ec4:7aff:fe8f:d3e7/64 scope link noprefixroute 2024-09-21T05:47:27.845 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-21T05:47:27.845 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T05:47:27.845 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T05:47:27.846 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-21T05:47:27.846 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link add name ceph-brx type bridge 2024-09-21T05:47:27.846 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip addr flush dev ceph-brx 2024-09-21T05:47:27.846 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set ceph-brx up 2024-09-21T05:47:27.846 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T05:47:27.846 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-21T05:47:27.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T05:47:28.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:47:28.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:47:28.052 DEBUG:teuthology.orchestra.run.smithi070:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T05:47:28.076 INFO:teuthology.orchestra.run.smithi070.stdout:1 2024-09-21T05:47:28.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:47:28.078 DEBUG:teuthology.orchestra.run.smithi070:> route 2024-09-21T05:47:28.157 INFO:teuthology.orchestra.run.smithi070.stdout:Kernel IP routing table 2024-09-21T05:47:28.157 INFO:teuthology.orchestra.run.smithi070.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T05:47:28.157 INFO:teuthology.orchestra.run.smithi070.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T05:47:28.157 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T05:47:28.158 INFO:teuthology.orchestra.run.smithi070.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T05:47:28.158 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T05:47:28.158 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-21T05:47:28.158 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T05:47:28.158 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T05:47:28.158 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T05:47:28.158 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-21T05:47:28.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T05:47:28.351 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:28 smithi070 ceph-mon[30981]: pgmap v306: 129 pgs: 129 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:28.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:28 smithi160 ceph-mon[33979]: pgmap v306: 129 pgs: 129 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:28.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:47:28.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:47:28.442 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2024-09-21T05:47:28.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:47:28.458 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list-id 2024-09-21T05:47:28.514 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T05:47:28.514 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-21T05:47:28.515 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T05:47:28.515 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-21T05:47:28.515 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-21T05:47:28.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:28 smithi116 ceph-mon[34332]: pgmap v306: 129 pgs: 129 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:28.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T05:47:28.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:47:28.636 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-21T05:47:28.636 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T05:47:28.636 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-21T05:47:28.637 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-21T05:47:28.637 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T05:47:28.637 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-21T05:47:28.637 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-21T05:47:28.637 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-21T05:47:28.637 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-21T05:47:28.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T05:47:28.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:47:28.769 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T05:47:28.769 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-21T05:47:28.769 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set brx.0 up 2024-09-21T05:47:28.769 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T05:47:28.769 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-21T05:47:28.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T05:47:28.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:47:28.845 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-21T05:47:28.845 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T05:47:28.845 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-21T05:47:28.860 INFO:teuthology.orchestra.run.smithi070.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-21T05:47:28.860 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T05:47:28.862 DEBUG:teuthology.orchestra.run.smithi070:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-21T05:47:28.915 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2024-09-21T05:47:28.981 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T05:47:29.038 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2024-09-21T05:47:29.039 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2024-09-21T05:47:29.039 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2024-09-21T05:47:29.039 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2024-09-21T05:47:29.039 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2024-09-21T05:47:29.039 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2024-09-21T05:47:29.039 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2024-09-21T05:47:29.039 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2024-09-21T05:47:29.039 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2024-09-21T05:47:29.039 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2024-09-21T05:47:29.039 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2024-09-21T05:47:29.039 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/selinux 2024-09-21T05:47:29.039 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T05:47:29.040 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2024-09-21T05:47:29.040 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2024-09-21T05:47:29.040 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2024-09-21T05:47:29.040 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2024-09-21T05:47:29.040 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2024-09-21T05:47:29.040 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2024-09-21T05:47:29.040 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T05:47:29.040 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T05:47:29.040 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T05:47:29.040 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T05:47:29.040 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2024-09-21T05:47:29.041 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2024-09-21T05:47:29.041 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay 2024-09-21T05:47:29.041 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/fad86dacc6d81e2357a9d7fbf94f31c7906a85205450ddb070b2817c1d7a3c72/merged 2024-09-21T05:47:29.041 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/112c94bd545f83607f3a398b0c853adfb16870b0d6bb5e01da09816b76ec01f1/merged 2024-09-21T05:47:29.041 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/0 2024-09-21T05:47:29.041 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T05:47:29.041 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/3158184ff0d6b360edd4efc8679c0d6388e07c805bad49a2044f743b33bc9efb/merged 2024-09-21T05:47:29.041 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/8dc3c8a75edc2930af19d1a338106e6b7e5d400a87e3a3f2a8a92bdd0b303d50/merged 2024-09-21T05:47:29.041 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/2e0400c7ff3f3fbfb1aebf6fdc32885b2ad1b6d971c63ad1a2b83a8635a43b98/merged 2024-09-21T05:47:29.041 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/f734a5f5a5d834c755088a682ffe36a348fb2c4371bf5b6f3cab5cd1178571b8/merged 2024-09-21T05:47:29.041 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/2f06906d75765921aaf9c4c634f9269b62a5d0a0b007e5a8d35e6565a148c04e/merged 2024-09-21T05:47:29.042 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/f29e6e8ce35c8597744acf71b29cb2d214c2b00c0811d3265f871088d506645d/merged 2024-09-21T05:47:29.042 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/6ef259590ae4201710d8bc97d43061915d15b22719b0dd82c5c2a93b437111ca/merged 2024-09-21T05:47:29.042 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/b13634ff1d7eb232a4dc652289147809920c7b2d2b16f7909befaafa0d523336/merged 2024-09-21T05:47:29.042 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2024-09-21T05:47:29.042 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T05:47:29.042 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T05:47:29.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:47:29.043 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2024-09-21T05:47:29.095 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-21T05:47:29.096 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-21T05:47:29.138 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2024-09-21T05:47:29.162 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T05:47:29.219 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2024-09-21T05:47:29.219 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2024-09-21T05:47:29.219 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2024-09-21T05:47:29.219 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2024-09-21T05:47:29.220 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2024-09-21T05:47:29.220 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2024-09-21T05:47:29.220 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2024-09-21T05:47:29.220 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2024-09-21T05:47:29.220 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2024-09-21T05:47:29.220 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2024-09-21T05:47:29.220 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2024-09-21T05:47:29.221 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/selinux 2024-09-21T05:47:29.221 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T05:47:29.221 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2024-09-21T05:47:29.221 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2024-09-21T05:47:29.221 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2024-09-21T05:47:29.221 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2024-09-21T05:47:29.221 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2024-09-21T05:47:29.222 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2024-09-21T05:47:29.222 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T05:47:29.222 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T05:47:29.222 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T05:47:29.222 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T05:47:29.222 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2024-09-21T05:47:29.222 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2024-09-21T05:47:29.222 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay 2024-09-21T05:47:29.223 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/fad86dacc6d81e2357a9d7fbf94f31c7906a85205450ddb070b2817c1d7a3c72/merged 2024-09-21T05:47:29.223 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/112c94bd545f83607f3a398b0c853adfb16870b0d6bb5e01da09816b76ec01f1/merged 2024-09-21T05:47:29.223 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/0 2024-09-21T05:47:29.223 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T05:47:29.223 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/3158184ff0d6b360edd4efc8679c0d6388e07c805bad49a2044f743b33bc9efb/merged 2024-09-21T05:47:29.223 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/8dc3c8a75edc2930af19d1a338106e6b7e5d400a87e3a3f2a8a92bdd0b303d50/merged 2024-09-21T05:47:29.224 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/2e0400c7ff3f3fbfb1aebf6fdc32885b2ad1b6d971c63ad1a2b83a8635a43b98/merged 2024-09-21T05:47:29.224 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/f734a5f5a5d834c755088a682ffe36a348fb2c4371bf5b6f3cab5cd1178571b8/merged 2024-09-21T05:47:29.224 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/2f06906d75765921aaf9c4c634f9269b62a5d0a0b007e5a8d35e6565a148c04e/merged 2024-09-21T05:47:29.224 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/f29e6e8ce35c8597744acf71b29cb2d214c2b00c0811d3265f871088d506645d/merged 2024-09-21T05:47:29.224 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/6ef259590ae4201710d8bc97d43061915d15b22719b0dd82c5c2a93b437111ca/merged 2024-09-21T05:47:29.224 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/b13634ff1d7eb232a4dc652289147809920c7b2d2b16f7909befaafa0d523336/merged 2024-09-21T05:47:29.224 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2024-09-21T05:47:29.224 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T05:47:29.224 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T05:47:29.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:47:29.224 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2024-09-21T05:47:29.255 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi070.stderr:2024-09-21T05:47:29.253+0000 7fdf6f269480 -1 init, newargv = 0x7fdf54054370 newargc=15 2024-09-21T05:47:29.255 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi070.stderr:ceph-fuse[75721]: starting ceph client 2024-09-21T05:47:29.261 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi070.stderr:ceph-fuse[75721]: starting fuse 2024-09-21T05:47:29.270 INFO:teuthology.orchestra.run.smithi070.stdout:120 2024-09-21T05:47:29.271 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-21T05:47:29.271 DEBUG:teuthology.orchestra.run.smithi070:> sudo stdin-killer -- python3 -c ' 2024-09-21T05:47:29.271 DEBUG:teuthology.orchestra.run.smithi070:> import glob 2024-09-21T05:47:29.271 DEBUG:teuthology.orchestra.run.smithi070:> import re 2024-09-21T05:47:29.271 DEBUG:teuthology.orchestra.run.smithi070:> import os 2024-09-21T05:47:29.271 DEBUG:teuthology.orchestra.run.smithi070:> import subprocess 2024-09-21T05:47:29.271 DEBUG:teuthology.orchestra.run.smithi070:> 2024-09-21T05:47:29.271 DEBUG:teuthology.orchestra.run.smithi070:> def _find_admin_socket(client_name): 2024-09-21T05:47:29.271 DEBUG:teuthology.orchestra.run.smithi070:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-21T05:47:29.271 DEBUG:teuthology.orchestra.run.smithi070:> files = glob.glob(asok_path) 2024-09-21T05:47:29.271 DEBUG:teuthology.orchestra.run.smithi070:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-21T05:47:29.271 DEBUG:teuthology.orchestra.run.smithi070:> 2024-09-21T05:47:29.271 DEBUG:teuthology.orchestra.run.smithi070:> # Given a non-glob path, it better be there 2024-09-21T05:47:29.272 DEBUG:teuthology.orchestra.run.smithi070:> if "*" not in asok_path: 2024-09-21T05:47:29.272 DEBUG:teuthology.orchestra.run.smithi070:> assert(len(files) == 1) 2024-09-21T05:47:29.272 DEBUG:teuthology.orchestra.run.smithi070:> return files[0] 2024-09-21T05:47:29.272 DEBUG:teuthology.orchestra.run.smithi070:> 2024-09-21T05:47:29.272 DEBUG:teuthology.orchestra.run.smithi070:> for f in files: 2024-09-21T05:47:29.272 DEBUG:teuthology.orchestra.run.smithi070:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-21T05:47:29.272 DEBUG:teuthology.orchestra.run.smithi070:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-21T05:47:29.272 DEBUG:teuthology.orchestra.run.smithi070:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-21T05:47:29.272 DEBUG:teuthology.orchestra.run.smithi070:> contents = proc_f.read() 2024-09-21T05:47:29.272 DEBUG:teuthology.orchestra.run.smithi070:> if mountpoint in contents: 2024-09-21T05:47:29.272 DEBUG:teuthology.orchestra.run.smithi070:> return f 2024-09-21T05:47:29.272 DEBUG:teuthology.orchestra.run.smithi070:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-21T05:47:29.272 DEBUG:teuthology.orchestra.run.smithi070:> 2024-09-21T05:47:29.272 DEBUG:teuthology.orchestra.run.smithi070:> print(_find_admin_socket("client.admin")) 2024-09-21T05:47:29.272 DEBUG:teuthology.orchestra.run.smithi070:> ' 2024-09-21T05:47:29.390 INFO:teuthology.orchestra.run.smithi070.stdout:/var/run/ceph/ceph-client.admin.75721.asok 2024-09-21T05:47:29.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:47:29.401 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.75721.asok 2024-09-21T05:47:29.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:47:29.401 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.75721.asok status 2024-09-21T05:47:29.557 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:47:29.557 INFO:teuthology.orchestra.run.smithi070.stdout: "metadata": { 2024-09-21T05:47:29.557 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_sha1": "1843221895adccfb3b692060251dd6a0183bc410", 2024-09-21T05:47:29.557 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T05:47:29.557 INFO:teuthology.orchestra.run.smithi070.stdout: "entity_id": "admin", 2024-09-21T05:47:29.557 INFO:teuthology.orchestra.run.smithi070.stdout: "hostname": "smithi070", 2024-09-21T05:47:29.557 INFO:teuthology.orchestra.run.smithi070.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-21T05:47:29.557 INFO:teuthology.orchestra.run.smithi070.stdout: "pid": "75721", 2024-09-21T05:47:29.557 INFO:teuthology.orchestra.run.smithi070.stdout: "root": "/" 2024-09-21T05:47:29.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:47:29.558 INFO:teuthology.orchestra.run.smithi070.stdout: "dentry_count": 0, 2024-09-21T05:47:29.558 INFO:teuthology.orchestra.run.smithi070.stdout: "dentry_pinned_count": 0, 2024-09-21T05:47:29.558 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 14913, 2024-09-21T05:47:29.558 INFO:teuthology.orchestra.run.smithi070.stdout: "inst": { 2024-09-21T05:47:29.558 INFO:teuthology.orchestra.run.smithi070.stdout: "name": { 2024-09-21T05:47:29.558 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "client", 2024-09-21T05:47:29.558 INFO:teuthology.orchestra.run.smithi070.stdout: "num": 14913 2024-09-21T05:47:29.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:47:29.558 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": { 2024-09-21T05:47:29.558 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-21T05:47:29.558 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "192.168.0.1:0", 2024-09-21T05:47:29.558 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 804622541 2024-09-21T05:47:29.558 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:47:29.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:47:29.558 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": { 2024-09-21T05:47:29.559 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-21T05:47:29.559 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "192.168.0.1:0", 2024-09-21T05:47:29.559 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 804622541 2024-09-21T05:47:29.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:47:29.559 INFO:teuthology.orchestra.run.smithi070.stdout: "inst_str": "client.14913 192.168.0.1:0/804622541", 2024-09-21T05:47:29.559 INFO:teuthology.orchestra.run.smithi070.stdout: "addr_str": "192.168.0.1:0/804622541", 2024-09-21T05:47:29.559 INFO:teuthology.orchestra.run.smithi070.stdout: "inode_count": 1, 2024-09-21T05:47:29.559 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_epoch": 16, 2024-09-21T05:47:29.559 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_epoch": 81, 2024-09-21T05:47:29.559 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_epoch_barrier": 0, 2024-09-21T05:47:29.559 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklisted": false, 2024-09-21T05:47:29.559 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs" 2024-09-21T05:47:29.559 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:47:29.565 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:29 smithi070 ceph-mon[30981]: pgmap v307: 129 pgs: 129 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:29.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:47:29.567 DEBUG:teuthology.orchestra.run.smithi070:> stat --file-system '--printf=%T 2024-09-21T05:47:29.567 DEBUG:teuthology.orchestra.run.smithi070:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-21T05:47:29.582 INFO:teuthology.orchestra.run.smithi070.stdout:fuseblk 2024-09-21T05:47:29.582 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-21T05:47:29.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:47:29.583 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-21T05:47:29.651 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-21T05:47:29.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T05:47:29.764 INFO:teuthology.orchestra.run.smithi070.stdout:# file: . 2024-09-21T05:47:29.764 INFO:teuthology.orchestra.run.smithi070.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-21T05:47:29.764 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:47:29.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:47:29.771 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-21T05:47:29.771 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T05:47:29.787 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T05:47:29.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:29 smithi116 ceph-mon[34332]: pgmap v307: 129 pgs: 129 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:29.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:29 smithi160 ceph-mon[33979]: pgmap v307: 129 pgs: 129 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:30.080 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:47:30.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.577+0000 7f0c2cba6640 1 -- 172.21.15.70:0/2366999024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c28108cf0 msgr2=0x7f0c2810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:30.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.577+0000 7f0c2cba6640 1 --2- 172.21.15.70:0/2366999024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c28108cf0 0x7f0c2810f520 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0c20009ca0 tx=0x7f0c2002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:47:30.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.578+0000 7f0c2cba6640 1 -- 172.21.15.70:0/2366999024 shutdown_connections 2024-09-21T05:47:30.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.578+0000 7f0c2cba6640 1 --2- 172.21.15.70:0/2366999024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c28108cf0 0x7f0c2810f520 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:30.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.578+0000 7f0c2cba6640 1 --2- 172.21.15.70:0/2366999024 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0c281083a0 0x7f0c281087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:30.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.578+0000 7f0c2cba6640 1 --2- 172.21.15.70:0/2366999024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0c28102a60 0x7f0c28102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:30.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.578+0000 7f0c2cba6640 1 -- 172.21.15.70:0/2366999024 >> 172.21.15.70:0/2366999024 conn(0x7f0c28079730 msgr2=0x7f0c28079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:30.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.578+0000 7f0c2cba6640 1 -- 172.21.15.70:0/2366999024 shutdown_connections 2024-09-21T05:47:30.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.578+0000 7f0c2cba6640 1 -- 172.21.15.70:0/2366999024 wait complete. 2024-09-21T05:47:30.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.578+0000 7f0c2cba6640 1 Processor -- start 2024-09-21T05:47:30.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.578+0000 7f0c2cba6640 1 -- start start 2024-09-21T05:47:30.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.579+0000 7f0c2cba6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0c28102a60 0x7f0c2819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:30.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.579+0000 7f0c2cba6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c281083a0 0x7f0c2819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:30.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.579+0000 7f0c2cba6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0c28108cf0 0x7f0c2819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:30.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.579+0000 7f0c2cba6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0c28113a50 con 0x7f0c281083a0 2024-09-21T05:47:30.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.579+0000 7f0c2cba6640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0c281138d0 con 0x7f0c28108cf0 2024-09-21T05:47:30.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.579+0000 7f0c2cba6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0c28113bd0 con 0x7f0c28102a60 2024-09-21T05:47:30.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.579+0000 7f0c1ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c281083a0 0x7f0c2819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:30.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.579+0000 7f0c1ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c281083a0 0x7f0c2819aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58604/0 (socket says 172.21.15.70:58604) 2024-09-21T05:47:30.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.579+0000 7f0c1ffff640 1 -- 172.21.15.70:0/4027845958 learned_addr learned my addr 172.21.15.70:0/4027845958 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:47:30.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.579+0000 7f0c26d9d640 1 --2- 172.21.15.70:0/4027845958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0c28108cf0 0x7f0c2819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:30.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.579+0000 7f0c2659c640 1 --2- 172.21.15.70:0/4027845958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0c28102a60 0x7f0c2819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:30.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.579+0000 7f0c1ffff640 1 -- 172.21.15.70:0/4027845958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0c28102a60 msgr2=0x7f0c2819a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:30.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.579+0000 7f0c1ffff640 1 --2- 172.21.15.70:0/4027845958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0c28102a60 0x7f0c2819a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:30.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.579+0000 7f0c1ffff640 1 -- 172.21.15.70:0/4027845958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0c28108cf0 msgr2=0x7f0c2819fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:30.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.579+0000 7f0c1ffff640 1 --2- 172.21.15.70:0/4027845958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0c28108cf0 0x7f0c2819fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:30.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.579+0000 7f0c1ffff640 1 -- 172.21.15.70:0/4027845958 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c281a03f0 con 0x7f0c281083a0 2024-09-21T05:47:30.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.579+0000 7f0c1ffff640 1 --2- 172.21.15.70:0/4027845958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c281083a0 0x7f0c2819aa20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0c1000d770 tx=0x7f0c1000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:30.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.580+0000 7f0c1f7fe640 1 -- 172.21.15.70:0/4027845958 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c10017070 con 0x7f0c281083a0 2024-09-21T05:47:30.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.580+0000 7f0c1f7fe640 1 -- 172.21.15.70:0/4027845958 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f0c10009c30 con 0x7f0c281083a0 2024-09-21T05:47:30.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.580+0000 7f0c1f7fe640 1 -- 172.21.15.70:0/4027845958 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1000f620 con 0x7f0c281083a0 2024-09-21T05:47:30.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.580+0000 7f0c2cba6640 1 -- 172.21.15.70:0/4027845958 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c281a06e0 con 0x7f0c281083a0 2024-09-21T05:47:30.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.580+0000 7f0c2cba6640 1 -- 172.21.15.70:0/4027845958 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c281a6e40 con 0x7f0c281083a0 2024-09-21T05:47:30.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.581+0000 7f0c2cba6640 1 -- 172.21.15.70:0/4027845958 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c28102e70 con 0x7f0c281083a0 2024-09-21T05:47:30.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.583+0000 7f0c1f7fe640 1 -- 172.21.15.70:0/4027845958 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f0c1001a070 con 0x7f0c281083a0 2024-09-21T05:47:30.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.584+0000 7f0c1f7fe640 1 --2- 172.21.15.70:0/4027845958 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0c140b6510 0x7f0c140b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:30.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.584+0000 7f0c2659c640 1 --2- 172.21.15.70:0/4027845958 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0c140b6510 0x7f0c140b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:30.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.584+0000 7f0c1f7fe640 1 -- 172.21.15.70:0/4027845958 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8802+0+0 (secure 0 0 0) 0x7f0c100e6f40 con 0x7f0c281083a0 2024-09-21T05:47:30.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.585+0000 7f0c2659c640 1 --2- 172.21.15.70:0/4027845958 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0c140b6510 0x7f0c140b8a20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0c18005fd0 tx=0x7f0c18005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:30.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.588+0000 7f0c1f7fe640 1 -- 172.21.15.70:0/4027845958 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0c10009de0 con 0x7f0c281083a0 2024-09-21T05:47:30.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.779+0000 7f0c2cba6640 1 -- 172.21.15.70:0/4027845958 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0c2819b5b0 con 0x7f0c281083a0 2024-09-21T05:47:30.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.779+0000 7f0c1f7fe640 1 -- 172.21.15.70:0/4027845958 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v81) ==== 81+0+588 (secure 0 0 0) 0x7f0c2819b5b0 con 0x7f0c281083a0 2024-09-21T05:47:30.782 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/605055695 2024-09-22T05:39:37.296630+0000 2024-09-21T05:47:30.782 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/897886925 2024-09-22T05:39:37.296630+0000 2024-09-21T05:47:30.782 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/1968357524 2024-09-22T05:39:37.296630+0000 2024-09-21T05:47:30.782 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/693721445 2024-09-22T05:39:37.296630+0000 2024-09-21T05:47:30.782 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/2810307308 2024-09-22T05:39:12.492271+0000 2024-09-21T05:47:30.782 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/605055695 2024-09-22T05:39:37.296630+0000 2024-09-21T05:47:30.782 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/1668927582 2024-09-22T05:39:12.492271+0000 2024-09-21T05:47:30.782 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/1668927582 2024-09-22T05:39:12.492271+0000 2024-09-21T05:47:30.782 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/1979536420 2024-09-22T05:39:12.492271+0000 2024-09-21T05:47:30.782 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/2674019604 2024-09-22T05:39:12.492271+0000 2024-09-21T05:47:30.783 INFO:teuthology.orchestra.run.smithi070.stderr:listed 10 entries 2024-09-21T05:47:30.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.782+0000 7f0c2cba6640 1 -- 172.21.15.70:0/4027845958 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0c140b6510 msgr2=0x7f0c140b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:30.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.782+0000 7f0c2cba6640 1 --2- 172.21.15.70:0/4027845958 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0c140b6510 0x7f0c140b8a20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0c18005fd0 tx=0x7f0c18005850 comp rx=0 tx=0).stop 2024-09-21T05:47:30.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.782+0000 7f0c2cba6640 1 -- 172.21.15.70:0/4027845958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c281083a0 msgr2=0x7f0c2819aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:30.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.782+0000 7f0c2cba6640 1 --2- 172.21.15.70:0/4027845958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c281083a0 0x7f0c2819aa20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0c1000d770 tx=0x7f0c1000dc30 comp rx=0 tx=0).stop 2024-09-21T05:47:30.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.782+0000 7f0c2cba6640 1 -- 172.21.15.70:0/4027845958 shutdown_connections 2024-09-21T05:47:30.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.782+0000 7f0c2cba6640 1 --2- 172.21.15.70:0/4027845958 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0c140b6510 0x7f0c140b8a20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:30.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.782+0000 7f0c2cba6640 1 --2- 172.21.15.70:0/4027845958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0c28108cf0 0x7f0c2819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:30.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.782+0000 7f0c2cba6640 1 --2- 172.21.15.70:0/4027845958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c281083a0 0x7f0c2819aa20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:30.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.782+0000 7f0c2cba6640 1 --2- 172.21.15.70:0/4027845958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0c28102a60 0x7f0c2819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:30.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.782+0000 7f0c2cba6640 1 -- 172.21.15.70:0/4027845958 >> 172.21.15.70:0/4027845958 conn(0x7f0c28079730 msgr2=0x7f0c28104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:30.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.782+0000 7f0c2cba6640 1 -- 172.21.15.70:0/4027845958 shutdown_connections 2024-09-21T05:47:30.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:30.782+0000 7f0c2cba6640 1 -- 172.21.15.70:0/4027845958 wait complete. 2024-09-21T05:47:31.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:30 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/4027845958' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T05:47:31.197 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:30 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/4027845958' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T05:47:31.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:30 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/4027845958' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T05:47:31.499 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-21T05:47:31.499 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T05:47:31.517 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T05:47:31.804 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:47:32.090 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:31 smithi070 ceph-mon[30981]: pgmap v308: 129 pgs: 129 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:32.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:31 smithi160 ceph-mon[33979]: pgmap v308: 129 pgs: 129 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:32.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.294+0000 7ff460571640 1 -- 172.21.15.70:0/2785037565 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4581048c0 msgr2=0x7ff458104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:32.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.294+0000 7ff460571640 1 --2- 172.21.15.70:0/2785037565 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4581048c0 0x7ff458104cd0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff448009ca0 tx=0x7ff44802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:47:32.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.294+0000 7ff460571640 1 -- 172.21.15.70:0/2785037565 shutdown_connections 2024-09-21T05:47:32.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.294+0000 7ff460571640 1 --2- 172.21.15.70:0/2785037565 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff45810de70 0x7ff458110380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:32.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.294+0000 7ff460571640 1 --2- 172.21.15.70:0/2785037565 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4581052f0 0x7ff45810d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:32.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.294+0000 7ff460571640 1 --2- 172.21.15.70:0/2785037565 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4581048c0 0x7ff458104cd0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:32.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.294+0000 7ff460571640 1 -- 172.21.15.70:0/2785037565 >> 172.21.15.70:0/2785037565 conn(0x7ff458079770 msgr2=0x7ff458079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:32.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.294+0000 7ff460571640 1 -- 172.21.15.70:0/2785037565 shutdown_connections 2024-09-21T05:47:32.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.294+0000 7ff460571640 1 -- 172.21.15.70:0/2785037565 wait complete. 2024-09-21T05:47:32.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.294+0000 7ff460571640 1 Processor -- start 2024-09-21T05:47:32.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.294+0000 7ff460571640 1 -- start start 2024-09-21T05:47:32.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.295+0000 7ff460571640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4581048c0 0x7ff45819a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:32.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.295+0000 7ff460571640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4581052f0 0x7ff45819ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:32.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.295+0000 7ff460571640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff45810de70 0x7ff45819fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:32.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.295+0000 7ff460571640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff458113b60 con 0x7ff45810de70 2024-09-21T05:47:32.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.295+0000 7ff460571640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff4581139e0 con 0x7ff4581048c0 2024-09-21T05:47:32.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.295+0000 7ff460571640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff458113ce0 con 0x7ff4581052f0 2024-09-21T05:47:32.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.295+0000 7ff45eb0e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff45810de70 0x7ff45819fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:32.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.295+0000 7ff45eb0e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff45810de70 0x7ff45819fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58634/0 (socket says 172.21.15.70:58634) 2024-09-21T05:47:32.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.295+0000 7ff45eb0e640 1 -- 172.21.15.70:0/1857130988 learned_addr learned my addr 172.21.15.70:0/1857130988 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:47:32.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.295+0000 7ff45e30d640 1 --2- 172.21.15.70:0/1857130988 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4581048c0 0x7ff45819a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:32.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.295+0000 7ff45db0c640 1 --2- 172.21.15.70:0/1857130988 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4581052f0 0x7ff45819ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:32.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.295+0000 7ff45eb0e640 1 -- 172.21.15.70:0/1857130988 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4581052f0 msgr2=0x7ff45819ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:32.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.295+0000 7ff45eb0e640 1 --2- 172.21.15.70:0/1857130988 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4581052f0 0x7ff45819ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:32.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.295+0000 7ff45eb0e640 1 -- 172.21.15.70:0/1857130988 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4581048c0 msgr2=0x7ff45819a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:32.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.295+0000 7ff45eb0e640 1 --2- 172.21.15.70:0/1857130988 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4581048c0 0x7ff45819a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:32.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.295+0000 7ff45eb0e640 1 -- 172.21.15.70:0/1857130988 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4581a0540 con 0x7ff45810de70 2024-09-21T05:47:32.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.295+0000 7ff45eb0e640 1 --2- 172.21.15.70:0/1857130988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff45810de70 0x7ff45819fe10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff450009fd0 tx=0x7ff45000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:32.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.295+0000 7ff4577fe640 1 -- 172.21.15.70:0/1857130988 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff450011830 con 0x7ff45810de70 2024-09-21T05:47:32.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.296+0000 7ff4577fe640 1 -- 172.21.15.70:0/1857130988 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7ff450016070 con 0x7ff45810de70 2024-09-21T05:47:32.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.296+0000 7ff460571640 1 -- 172.21.15.70:0/1857130988 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4581a0830 con 0x7ff45810de70 2024-09-21T05:47:32.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.296+0000 7ff4577fe640 1 -- 172.21.15.70:0/1857130988 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff450010dd0 con 0x7ff45810de70 2024-09-21T05:47:32.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.296+0000 7ff460571640 1 -- 172.21.15.70:0/1857130988 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4581a6f90 con 0x7ff45810de70 2024-09-21T05:47:32.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.297+0000 7ff460571640 1 -- 172.21.15.70:0/1857130988 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff45806c200 con 0x7ff45810de70 2024-09-21T05:47:32.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.298+0000 7ff4577fe640 1 -- 172.21.15.70:0/1857130988 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7ff4500119d0 con 0x7ff45810de70 2024-09-21T05:47:32.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.299+0000 7ff4577fe640 1 --2- 172.21.15.70:0/1857130988 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7ff4400b6510 0x7ff4400b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:32.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.299+0000 7ff45e30d640 1 --2- 172.21.15.70:0/1857130988 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7ff4400b6510 0x7ff4400b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:32.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.299+0000 7ff4577fe640 1 -- 172.21.15.70:0/1857130988 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8802+0+0 (secure 0 0 0) 0x7ff4500e71c0 con 0x7ff45810de70 2024-09-21T05:47:32.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.299+0000 7ff45e30d640 1 --2- 172.21.15.70:0/1857130988 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7ff4400b6510 0x7ff4400b8a20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff448005e30 tx=0x7ff448031000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:32.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.302+0000 7ff4577fe640 1 -- 172.21.15.70:0/1857130988 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff4500ad810 con 0x7ff45810de70 2024-09-21T05:47:32.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:31 smithi116 ceph-mon[34332]: pgmap v308: 129 pgs: 129 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:32.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.493+0000 7ff460571640 1 -- 172.21.15.70:0/1857130988 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff45819b700 con 0x7ff45810de70 2024-09-21T05:47:32.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.495+0000 7ff4577fe640 1 -- 172.21.15.70:0/1857130988 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v81) ==== 81+0+588 (secure 0 0 0) 0x7ff45819b700 con 0x7ff45810de70 2024-09-21T05:47:32.499 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/605055695 2024-09-22T05:39:37.296630+0000 2024-09-21T05:47:32.499 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/897886925 2024-09-22T05:39:37.296630+0000 2024-09-21T05:47:32.499 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/1968357524 2024-09-22T05:39:37.296630+0000 2024-09-21T05:47:32.499 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/693721445 2024-09-22T05:39:37.296630+0000 2024-09-21T05:47:32.500 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/2810307308 2024-09-22T05:39:12.492271+0000 2024-09-21T05:47:32.500 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/605055695 2024-09-22T05:39:37.296630+0000 2024-09-21T05:47:32.500 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/1668927582 2024-09-22T05:39:12.492271+0000 2024-09-21T05:47:32.500 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/1668927582 2024-09-22T05:39:12.492271+0000 2024-09-21T05:47:32.500 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/1979536420 2024-09-22T05:39:12.492271+0000 2024-09-21T05:47:32.500 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/2674019604 2024-09-22T05:39:12.492271+0000 2024-09-21T05:47:32.501 INFO:teuthology.orchestra.run.smithi070.stderr:listed 10 entries 2024-09-21T05:47:32.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.498+0000 7ff460571640 1 -- 172.21.15.70:0/1857130988 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7ff4400b6510 msgr2=0x7ff4400b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:32.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.498+0000 7ff460571640 1 --2- 172.21.15.70:0/1857130988 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7ff4400b6510 0x7ff4400b8a20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff448005e30 tx=0x7ff448031000 comp rx=0 tx=0).stop 2024-09-21T05:47:32.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.498+0000 7ff460571640 1 -- 172.21.15.70:0/1857130988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff45810de70 msgr2=0x7ff45819fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:32.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.498+0000 7ff460571640 1 --2- 172.21.15.70:0/1857130988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff45810de70 0x7ff45819fe10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff450009fd0 tx=0x7ff45000b8e0 comp rx=0 tx=0).stop 2024-09-21T05:47:32.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.498+0000 7ff460571640 1 -- 172.21.15.70:0/1857130988 shutdown_connections 2024-09-21T05:47:32.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.498+0000 7ff460571640 1 --2- 172.21.15.70:0/1857130988 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7ff4400b6510 0x7ff4400b8a20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:32.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.498+0000 7ff460571640 1 --2- 172.21.15.70:0/1857130988 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4581052f0 0x7ff45819ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:32.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.498+0000 7ff460571640 1 --2- 172.21.15.70:0/1857130988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff45810de70 0x7ff45819fe10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:32.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.498+0000 7ff460571640 1 --2- 172.21.15.70:0/1857130988 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4581048c0 0x7ff45819a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:32.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.498+0000 7ff460571640 1 -- 172.21.15.70:0/1857130988 >> 172.21.15.70:0/1857130988 conn(0x7ff458079770 msgr2=0x7ff458106970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:32.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.498+0000 7ff460571640 1 -- 172.21.15.70:0/1857130988 shutdown_connections 2024-09-21T05:47:32.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:32.498+0000 7ff460571640 1 -- 172.21.15.70:0/1857130988 wait complete. 2024-09-21T05:47:33.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:32 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1857130988' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T05:47:33.235 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:32 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1857130988' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T05:47:33.267 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi070.front.sepia.ceph.com... 2024-09-21T05:47:33.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:47:33.267 DEBUG:teuthology.orchestra.run.smithi070:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-21T05:47:33.293 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi070.stderr:ceph-fuse[75721]: fuse finished with error 0 and tester_r 0 2024-09-21T05:47:33.295 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T05:47:33.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:32 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1857130988' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T05:47:34.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:33 smithi160 ceph-mon[33979]: pgmap v309: 129 pgs: 129 active+clean; 581 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T05:47:34.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:33 smithi070 ceph-mon[30981]: pgmap v309: 129 pgs: 129 active+clean; 581 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T05:47:34.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:33 smithi116 ceph-mon[34332]: pgmap v309: 129 pgs: 129 active+clean; 581 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T05:47:35.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:35 smithi070 ceph-mon[30981]: pgmap v310: 129 pgs: 129 active+clean; 581 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T05:47:35.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:35 smithi116 ceph-mon[34332]: pgmap v310: 129 pgs: 129 active+clean; 581 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T05:47:35.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:35 smithi160 ceph-mon[33979]: pgmap v310: 129 pgs: 129 active+clean; 581 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T05:47:37.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:37 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]} : dispatch 2024-09-21T05:47:37.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:37 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]} : dispatch 2024-09-21T05:47:37.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:37 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]} : dispatch 2024-09-21T05:47:37.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:37 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]} : dispatch 2024-09-21T05:47:37.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:37 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]} : dispatch 2024-09-21T05:47:37.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:37 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]} : dispatch 2024-09-21T05:47:37.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:37 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]} : dispatch 2024-09-21T05:47:37.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:37 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]} : dispatch 2024-09-21T05:47:37.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:37 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]} : dispatch 2024-09-21T05:47:37.649 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:37 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 8]} : dispatch 2024-09-21T05:47:37.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:37 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]} : dispatch 2024-09-21T05:47:37.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:37 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]} : dispatch 2024-09-21T05:47:37.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:37 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]} : dispatch 2024-09-21T05:47:37.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:37 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]} : dispatch 2024-09-21T05:47:37.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:37 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]} : dispatch 2024-09-21T05:47:37.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:37 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]} : dispatch 2024-09-21T05:47:37.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:37 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]} : dispatch 2024-09-21T05:47:37.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:37 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]} : dispatch 2024-09-21T05:47:37.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:37 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]} : dispatch 2024-09-21T05:47:37.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:37 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 8]} : dispatch 2024-09-21T05:47:37.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:37 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]} : dispatch 2024-09-21T05:47:37.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:37 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]} : dispatch 2024-09-21T05:47:37.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:37 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]} : dispatch 2024-09-21T05:47:37.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:37 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]} : dispatch 2024-09-21T05:47:37.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:37 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]} : dispatch 2024-09-21T05:47:37.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:37 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]} : dispatch 2024-09-21T05:47:37.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:37 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]} : dispatch 2024-09-21T05:47:37.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:37 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]} : dispatch 2024-09-21T05:47:37.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:37 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]} : dispatch 2024-09-21T05:47:37.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:37 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 8]} : dispatch 2024-09-21T05:47:38.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:38 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-09-21T05:47:38.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:38 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-09-21T05:47:38.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:38 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-09-21T05:47:38.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:38 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-09-21T05:47:38.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:38 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]}]': finished 2024-09-21T05:47:38.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:38 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-09-21T05:47:38.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:38 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-21T05:47:38.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:38 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2024-09-21T05:47:38.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:38 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2024-09-21T05:47:38.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:38 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 8]}]': finished 2024-09-21T05:47:38.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:38 smithi070 ceph-mon[30981]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T05:47:38.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:38 smithi070 ceph-mon[30981]: pgmap v312: 129 pgs: 129 active+clean; 581 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-09-21T05:47:38.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:38 smithi070 ceph-mon[30981]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T05:47:38.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:38 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-09-21T05:47:38.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:38 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-09-21T05:47:38.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:38 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-09-21T05:47:38.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:38 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-09-21T05:47:38.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:38 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]}]': finished 2024-09-21T05:47:38.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:38 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-09-21T05:47:38.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:38 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-21T05:47:38.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:38 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2024-09-21T05:47:38.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:38 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2024-09-21T05:47:38.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:38 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 8]}]': finished 2024-09-21T05:47:38.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:38 smithi116 ceph-mon[34332]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T05:47:38.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:38 smithi116 ceph-mon[34332]: pgmap v312: 129 pgs: 129 active+clean; 581 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-09-21T05:47:38.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:38 smithi116 ceph-mon[34332]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T05:47:38.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:38 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-09-21T05:47:38.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:38 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-09-21T05:47:38.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:38 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-09-21T05:47:38.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:38 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-09-21T05:47:38.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:38 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]}]': finished 2024-09-21T05:47:38.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:38 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-09-21T05:47:38.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:38 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-21T05:47:38.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:38 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2024-09-21T05:47:38.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:38 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2024-09-21T05:47:38.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:38 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 8]}]': finished 2024-09-21T05:47:38.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:38 smithi160 ceph-mon[33979]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T05:47:38.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:38 smithi160 ceph-mon[33979]: pgmap v312: 129 pgs: 129 active+clean; 581 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-09-21T05:47:38.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:38 smithi160 ceph-mon[33979]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T05:47:39.397 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi070.front.sepia.ceph.com 2024-09-21T05:47:39.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:47:39.397 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-21T05:47:39.428 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:47:39.724 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:47:39.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:39 smithi070 ceph-mon[30981]: pgmap v314: 129 pgs: 5 peering, 124 active+clean; 581 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s 2024-09-21T05:47:39.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:39 smithi116 ceph-mon[34332]: pgmap v314: 129 pgs: 5 peering, 124 active+clean; 581 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s 2024-09-21T05:47:39.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:39 smithi160 ceph-mon[33979]: pgmap v314: 129 pgs: 5 peering, 124 active+clean; 581 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s 2024-09-21T05:47:40.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.191+0000 7f0e64c6e640 1 -- 172.21.15.70:0/1794740543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e601083c0 msgr2=0x7f0e601087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:40.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.191+0000 7f0e64c6e640 1 --2- 172.21.15.70:0/1794740543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e601083c0 0x7f0e601087d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0e54009900 tx=0x7f0e5402a410 comp rx=0 tx=0).stop 2024-09-21T05:47:40.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.191+0000 7f0e64c6e640 1 -- 172.21.15.70:0/1794740543 shutdown_connections 2024-09-21T05:47:40.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.191+0000 7f0e64c6e640 1 --2- 172.21.15.70:0/1794740543 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e60108d10 0x7f0e6010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:40.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.191+0000 7f0e64c6e640 1 --2- 172.21.15.70:0/1794740543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e601083c0 0x7f0e601087d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:40.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.191+0000 7f0e64c6e640 1 --2- 172.21.15.70:0/1794740543 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e60102a80 0x7f0e60102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:40.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.191+0000 7f0e64c6e640 1 -- 172.21.15.70:0/1794740543 >> 172.21.15.70:0/1794740543 conn(0x7f0e60079740 msgr2=0x7f0e60079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:40.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.191+0000 7f0e64c6e640 1 -- 172.21.15.70:0/1794740543 shutdown_connections 2024-09-21T05:47:40.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.191+0000 7f0e64c6e640 1 -- 172.21.15.70:0/1794740543 wait complete. 2024-09-21T05:47:40.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.192+0000 7f0e64c6e640 1 Processor -- start 2024-09-21T05:47:40.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.192+0000 7f0e64c6e640 1 -- start start 2024-09-21T05:47:40.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.192+0000 7f0e64c6e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e60102a80 0x7f0e601993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:40.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.192+0000 7f0e64c6e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e601083c0 0x7f0e60199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:40.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.192+0000 7f0e64c6e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e60108d10 0x7f0e6019ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:40.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.192+0000 7f0e64c6e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0e60112950 con 0x7f0e60102a80 2024-09-21T05:47:40.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.192+0000 7f0e64c6e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0e601127d0 con 0x7f0e601083c0 2024-09-21T05:47:40.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.192+0000 7f0e64c6e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0e60112ad0 con 0x7f0e60108d10 2024-09-21T05:47:40.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.192+0000 7f0e5e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e60102a80 0x7f0e601993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:40.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.192+0000 7f0e5e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e60102a80 0x7f0e601993e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58656/0 (socket says 172.21.15.70:58656) 2024-09-21T05:47:40.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.192+0000 7f0e5e59c640 1 -- 172.21.15.70:0/2063230639 learned_addr learned my addr 172.21.15.70:0/2063230639 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:47:40.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.193+0000 7f0e5dd9b640 1 --2- 172.21.15.70:0/2063230639 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e601083c0 0x7f0e60199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:40.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.193+0000 7f0e5ed9d640 1 --2- 172.21.15.70:0/2063230639 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e60108d10 0x7f0e6019ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:40.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.193+0000 7f0e5e59c640 1 -- 172.21.15.70:0/2063230639 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e60108d10 msgr2=0x7f0e6019ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:40.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.193+0000 7f0e5e59c640 1 --2- 172.21.15.70:0/2063230639 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e60108d10 0x7f0e6019ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:40.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.193+0000 7f0e5e59c640 1 -- 172.21.15.70:0/2063230639 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e601083c0 msgr2=0x7f0e60199980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:40.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.193+0000 7f0e5e59c640 1 --2- 172.21.15.70:0/2063230639 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e601083c0 0x7f0e60199980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:40.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.193+0000 7f0e5e59c640 1 -- 172.21.15.70:0/2063230639 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e6019f290 con 0x7f0e60102a80 2024-09-21T05:47:40.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.193+0000 7f0e5dd9b640 1 --2- 172.21.15.70:0/2063230639 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e601083c0 0x7f0e60199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:47:40.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.193+0000 7f0e5e59c640 1 --2- 172.21.15.70:0/2063230639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e60102a80 0x7f0e601993e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000ebc0 tx=0x7f0e50007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:40.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.193+0000 7f0e4f7fe640 1 -- 172.21.15.70:0/2063230639 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5001c070 con 0x7f0e60102a80 2024-09-21T05:47:40.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.193+0000 7f0e4f7fe640 1 -- 172.21.15.70:0/2063230639 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f0e50007ca0 con 0x7f0e60102a80 2024-09-21T05:47:40.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.193+0000 7f0e64c6e640 1 -- 172.21.15.70:0/2063230639 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e6019f580 con 0x7f0e60102a80 2024-09-21T05:47:40.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.193+0000 7f0e4f7fe640 1 -- 172.21.15.70:0/2063230639 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e50017410 con 0x7f0e60102a80 2024-09-21T05:47:40.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.193+0000 7f0e64c6e640 1 -- 172.21.15.70:0/2063230639 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e6006b820 con 0x7f0e60102a80 2024-09-21T05:47:40.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.194+0000 7f0e64c6e640 1 -- 172.21.15.70:0/2063230639 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e60103d00 con 0x7f0e60102a80 2024-09-21T05:47:40.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.196+0000 7f0e4f7fe640 1 -- 172.21.15.70:0/2063230639 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f0e5001f070 con 0x7f0e60102a80 2024-09-21T05:47:40.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.197+0000 7f0e4f7fe640 1 --2- 172.21.15.70:0/2063230639 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0e480b6540 0x7f0e480b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:40.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.197+0000 7f0e5dd9b640 1 --2- 172.21.15.70:0/2063230639 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0e480b6540 0x7f0e480b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:40.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.197+0000 7f0e4f7fe640 1 -- 172.21.15.70:0/2063230639 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f0e500e8980 con 0x7f0e60102a80 2024-09-21T05:47:40.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.197+0000 7f0e5dd9b640 1 --2- 172.21.15.70:0/2063230639 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0e480b6540 0x7f0e480b8a50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0e54000c00 tx=0x7f0e54032db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:40.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.200+0000 7f0e4f7fe640 1 -- 172.21.15.70:0/2063230639 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0e500aeeb0 con 0x7f0e60102a80 2024-09-21T05:47:40.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.408+0000 7f0e64c6e640 1 -- 172.21.15.70:0/2063230639 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0e6006c330 con 0x7f0e60102a80 2024-09-21T05:47:40.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.410+0000 7f0e4f7fe640 1 -- 172.21.15.70:0/2063230639 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+24691 (secure 0 0 0) 0x7f0e500b3290 con 0x7f0e60102a80 2024-09-21T05:47:40.412 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:47:40.412 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":83,"fsid":"96c6636e-77db-11ef-baf5-efdc52797490","created":"2024-09-21T05:38:42.297307+0000","modified":"2024-09-21T05:47:38.383182+0000","last_up_change":"2024-09-21T05:46:15.910344+0000","last_in_change":"2024-09-21T05:45:53.382766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:42:25.611590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:47:01.987981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:47:04.388107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T05:47:10.651871+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00be8b82-7cb1-443f-ad18-02916f734df7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6803","nonce":1667051447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6805","nonce":1667051447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6809","nonce":1667051447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6807","nonce":1667051447}]},"public_addr":"172.21.15.70:6803/1667051447","cluster_addr":"172.21.15.70:6805/1667051447","heartbeat_back_addr":"172.21.15.70:6809/1667051447","heartbeat_front_addr":"172.21.15.70:6807/1667051447","state":["exists","up"]},{"osd":1,"uuid":"28ca8c5c-5e81-4e64-ac0e-3c8c3c2d3930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6801","nonce":1037621846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6803","nonce":1037621846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6807","nonce":1037621846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6805","nonce":1037621846}]},"public_addr":"172.21.15.116:6801/1037621846","cluster_addr":"172.21.15.116:6803/1037621846","heartbeat_back_addr":"172.21.15.116:6807/1037621846","heartbeat_front_addr":"172.21.15.116:6805/1037621846","state":["exists","up"]},{"osd":2,"uuid":"e9b42bf2-a38b-4cf9-8774-4950de12d0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6801","nonce":69260815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6803","nonce":69260815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6807","nonce":69260815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6805","nonce":69260815}]},"public_addr":"172.21.15.160:6801/69260815","cluster_addr":"172.21.15.160:6803/69260815","heartbeat_back_addr":"172.21.15.160:6807/69260815","heartbeat_front_addr":"172.21.15.160:6805/69260815","state":["exists","up"]},{"osd":3,"uuid":"25d8e9a8-3c14-43d6-9bb1-b44cd377133f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6811","nonce":3849416072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6813","nonce":3849416072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6817","nonce":3849416072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6815","nonce":3849416072}]},"public_addr":"172.21.15.70:6811/3849416072","cluster_addr":"172.21.15.70:6813/3849416072","heartbeat_back_addr":"172.21.15.70:6817/3849416072","heartbeat_front_addr":"172.21.15.70:6815/3849416072","state":["exists","up"]},{"osd":4,"uuid":"bdb84cbd-d718-4f69-90d0-2e732e580df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6809","nonce":3444857438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6811","nonce":3444857438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6815","nonce":3444857438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6813","nonce":3444857438}]},"public_addr":"172.21.15.116:6809/3444857438","cluster_addr":"172.21.15.116:6811/3444857438","heartbeat_back_addr":"172.21.15.116:6815/3444857438","heartbeat_front_addr":"172.21.15.116:6813/3444857438","state":["exists","up"]},{"osd":5,"uuid":"a490eeba-549f-4caa-8cd5-4168a23dafa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6809","nonce":3063220427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6811","nonce":3063220427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6815","nonce":3063220427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6813","nonce":3063220427}]},"public_addr":"172.21.15.160:6809/3063220427","cluster_addr":"172.21.15.160:6811/3063220427","heartbeat_back_addr":"172.21.15.160:6815/3063220427","heartbeat_front_addr":"172.21.15.160:6813/3063220427","state":["exists","up"]},{"osd":6,"uuid":"1bf22f48-c02f-4f09-b0fe-2597a55fd795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6819","nonce":3650315688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6821","nonce":3650315688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6825","nonce":3650315688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6823","nonce":3650315688}]},"public_addr":"172.21.15.70:6819/3650315688","cluster_addr":"172.21.15.70:6821/3650315688","heartbeat_back_addr":"172.21.15.70:6825/3650315688","heartbeat_front_addr":"172.21.15.70:6823/3650315688","state":["exists","up"]},{"osd":7,"uuid":"40d59744-4860-4a92-aa21-3f33e575e5b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6817","nonce":2034132009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6819","nonce":2034132009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6823","nonce":2034132009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6821","nonce":2034132009}]},"public_addr":"172.21.15.116:6817/2034132009","cluster_addr":"172.21.15.116:6819/2034132009","heartbeat_back_addr":"172.21.15.116:6823/2034132009","heartbeat_front_addr":"172.21.15.116:6821/2034132009","state":["exists","up"]},{"osd":8,"uuid":"65dc02e7-0dcd-4fa7-955a-4d5c00fbe4cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6817","nonce":3381625184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6819","nonce":3381625184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6823","nonce":3381625184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6821","nonce":3381625184}]},"public_addr":"172.21.15.160:6817/3381625184","cluster_addr":"172.21.15.160:6819/3381625184","heartbeat_back_addr":"172.21.15.160:6823/3381625184","heartbeat_front_addr":"172.21.15.160:6821/3381625184","state":["exists","up"]},{"osd":9,"uuid":"d8438a9c-012f-4082-be3f-9653cdfaac78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6827","nonce":3555256209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6829","nonce":3555256209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6833","nonce":3555256209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6831","nonce":3555256209}]},"public_addr":"172.21.15.70:6827/3555256209","cluster_addr":"172.21.15.70:6829/3555256209","heartbeat_back_addr":"172.21.15.70:6833/3555256209","heartbeat_front_addr":"172.21.15.70:6831/3555256209","state":["exists","up"]},{"osd":10,"uuid":"871619b0-181e-4020-9511-2cec296bfe70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6825","nonce":541280433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6827","nonce":541280433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6831","nonce":541280433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6829","nonce":541280433}]},"public_addr":"172.21.15.116:6825/541280433","cluster_addr":"172.21.15.116:6827/541280433","heartbeat_back_addr":"172.21.15.116:6831/541280433","heartbeat_front_addr":"172.21.15.116:6829/541280433","state":["exists","up"]},{"osd":11,"uuid":"302da945-7929-4b0c-a20b-099175752c41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6825","nonce":2632369083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6827","nonce":2632369083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6831","nonce":2632369083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6829","nonce":2632369083}]},"public_addr":"172.21.15.160:6825/2632369083","cluster_addr":"172.21.15.160:6827/2632369083","heartbeat_back_addr":"172.21.15.160:6831/2632369083","heartbeat_front_addr":"172.21.15.160:6829/2632369083","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:41:34.446744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:41:59.336955+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:42:23.958219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:42:49.396007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:43:15.325344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:43:41.923141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:07.873970+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:33.897951+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:58.397680+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:24.568406+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:49.504565+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:14.698577+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.e","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6800/605055695":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/897886925":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/1968357524":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/693721445":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/2810307308":"2024-09-22T05:39:12.492271+0000","172.21.15.70:6801/605055695":"2024-09-22T05:39:37.296630+0000","172.21.15.70:6801/1668927582":"2024-09-22T05:39:12.492271+0000","172.21.15.70:6800/1668927582":"2024-09-22T05:39:12.492271+0000","172.21.15.70:0/1979536420":"2024-09-22T05:39:12.492271+0000","172.21.15.70:0/2674019604":"2024-09-22T05:39:12.492271+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:47:40.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.412+0000 7f0e64c6e640 1 -- 172.21.15.70:0/2063230639 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0e480b6540 msgr2=0x7f0e480b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:40.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.412+0000 7f0e64c6e640 1 --2- 172.21.15.70:0/2063230639 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0e480b6540 0x7f0e480b8a50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0e54000c00 tx=0x7f0e54032db0 comp rx=0 tx=0).stop 2024-09-21T05:47:40.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.412+0000 7f0e64c6e640 1 -- 172.21.15.70:0/2063230639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e60102a80 msgr2=0x7f0e601993e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:40.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.412+0000 7f0e64c6e640 1 --2- 172.21.15.70:0/2063230639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e60102a80 0x7f0e601993e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000ebc0 tx=0x7f0e50007590 comp rx=0 tx=0).stop 2024-09-21T05:47:40.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.412+0000 7f0e64c6e640 1 -- 172.21.15.70:0/2063230639 shutdown_connections 2024-09-21T05:47:40.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.412+0000 7f0e64c6e640 1 --2- 172.21.15.70:0/2063230639 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0e480b6540 0x7f0e480b8a50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:40.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.412+0000 7f0e64c6e640 1 --2- 172.21.15.70:0/2063230639 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e60108d10 0x7f0e6019ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:40.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.412+0000 7f0e64c6e640 1 --2- 172.21.15.70:0/2063230639 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e601083c0 0x7f0e60199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:40.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.412+0000 7f0e64c6e640 1 --2- 172.21.15.70:0/2063230639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e60102a80 0x7f0e601993e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:40.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.412+0000 7f0e64c6e640 1 -- 172.21.15.70:0/2063230639 >> 172.21.15.70:0/2063230639 conn(0x7f0e60079740 msgr2=0x7f0e601014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:40.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.412+0000 7f0e64c6e640 1 -- 172.21.15.70:0/2063230639 shutdown_connections 2024-09-21T05:47:40.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:40.412+0000 7f0e64c6e640 1 -- 172.21.15.70:0/2063230639 wait complete. 2024-09-21T05:47:40.735 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:40 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2063230639' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:47:40.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:40 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2063230639' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:47:40.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:40 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2063230639' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:47:41.235 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:47:41.487 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:47:41.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:41 smithi070 ceph-mon[30981]: pgmap v315: 129 pgs: 5 peering, 124 active+clean; 581 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-09-21T05:47:41.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:41 smithi116 ceph-mon[34332]: pgmap v315: 129 pgs: 5 peering, 124 active+clean; 581 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-09-21T05:47:41.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:41 smithi160 ceph-mon[33979]: pgmap v315: 129 pgs: 5 peering, 124 active+clean; 581 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-09-21T05:47:41.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.985+0000 7f53cf315640 1 -- 172.21.15.70:0/1194632488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53c81083a0 msgr2=0x7f53c81087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:41.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.985+0000 7f53cf315640 1 --2- 172.21.15.70:0/1194632488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53c81083a0 0x7f53c81087b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009900 tx=0x7f53c402a410 comp rx=0 tx=0).stop 2024-09-21T05:47:41.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.985+0000 7f53cf315640 1 -- 172.21.15.70:0/1194632488 shutdown_connections 2024-09-21T05:47:41.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.985+0000 7f53cf315640 1 --2- 172.21.15.70:0/1194632488 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53c8108cf0 0x7f53c810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:41.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.985+0000 7f53cf315640 1 --2- 172.21.15.70:0/1194632488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53c81083a0 0x7f53c81087b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:41.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.985+0000 7f53cf315640 1 --2- 172.21.15.70:0/1194632488 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53c8102a60 0x7f53c8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:41.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.985+0000 7f53cf315640 1 -- 172.21.15.70:0/1194632488 >> 172.21.15.70:0/1194632488 conn(0x7f53c8079730 msgr2=0x7f53c8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:41.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.985+0000 7f53cf315640 1 -- 172.21.15.70:0/1194632488 shutdown_connections 2024-09-21T05:47:41.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.985+0000 7f53cf315640 1 -- 172.21.15.70:0/1194632488 wait complete. 2024-09-21T05:47:41.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.985+0000 7f53cf315640 1 Processor -- start 2024-09-21T05:47:41.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.986+0000 7f53cf315640 1 -- start start 2024-09-21T05:47:41.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.986+0000 7f53cf315640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53c8102a60 0x7f53c819a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:41.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.986+0000 7f53cf315640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53c81083a0 0x7f53c819aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:41.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.986+0000 7f53cf315640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53c8108cf0 0x7f53c819fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:41.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.986+0000 7f53cf315640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f53c8112930 con 0x7f53c8102a60 2024-09-21T05:47:41.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.986+0000 7f53cf315640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f53c81127b0 con 0x7f53c81083a0 2024-09-21T05:47:41.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.986+0000 7f53cf315640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f53c8112ab0 con 0x7f53c8108cf0 2024-09-21T05:47:41.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.986+0000 7f53cd0b1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53c8102a60 0x7f53c819a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:41.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.986+0000 7f53cd0b1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53c8102a60 0x7f53c819a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35598/0 (socket says 172.21.15.70:35598) 2024-09-21T05:47:41.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.986+0000 7f53cd0b1640 1 -- 172.21.15.70:0/3912326866 learned_addr learned my addr 172.21.15.70:0/3912326866 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:47:41.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.986+0000 7f53cc8b0640 1 --2- 172.21.15.70:0/3912326866 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53c81083a0 0x7f53c819aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:41.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.986+0000 7f53cd8b2640 1 --2- 172.21.15.70:0/3912326866 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53c8108cf0 0x7f53c819fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:41.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.986+0000 7f53cd0b1640 1 -- 172.21.15.70:0/3912326866 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53c8108cf0 msgr2=0x7f53c819fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:41.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.986+0000 7f53cd0b1640 1 --2- 172.21.15.70:0/3912326866 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53c8108cf0 0x7f53c819fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:41.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.986+0000 7f53cd0b1640 1 -- 172.21.15.70:0/3912326866 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53c81083a0 msgr2=0x7f53c819aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:41.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.986+0000 7f53cd0b1640 1 --2- 172.21.15.70:0/3912326866 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53c81083a0 0x7f53c819aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:41.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.986+0000 7f53cd0b1640 1 -- 172.21.15.70:0/3912326866 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c81a04a0 con 0x7f53c8102a60 2024-09-21T05:47:41.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.986+0000 7f53cd8b2640 1 --2- 172.21.15.70:0/3912326866 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53c8108cf0 0x7f53c819fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:47:41.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.987+0000 7f53cd0b1640 1 --2- 172.21.15.70:0/3912326866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53c8102a60 0x7f53c819a530 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00d950 tx=0x7f53bc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:41.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.987+0000 7f53ba7fc640 1 -- 172.21.15.70:0/3912326866 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc017070 con 0x7f53c8102a60 2024-09-21T05:47:41.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.987+0000 7f53ba7fc640 1 -- 172.21.15.70:0/3912326866 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f53bc009c30 con 0x7f53c8102a60 2024-09-21T05:47:41.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.987+0000 7f53ba7fc640 1 -- 172.21.15.70:0/3912326866 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc00f620 con 0x7f53c8102a60 2024-09-21T05:47:41.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.987+0000 7f53cf315640 1 -- 172.21.15.70:0/3912326866 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53c81a0790 con 0x7f53c8102a60 2024-09-21T05:47:41.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.987+0000 7f53cf315640 1 -- 172.21.15.70:0/3912326866 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53c81a6ef0 con 0x7f53c8102a60 2024-09-21T05:47:41.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.988+0000 7f53cf315640 1 -- 172.21.15.70:0/3912326866 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53c8103ce0 con 0x7f53c8102a60 2024-09-21T05:47:41.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.989+0000 7f53ba7fc640 1 -- 172.21.15.70:0/3912326866 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f53bc0109a0 con 0x7f53c8102a60 2024-09-21T05:47:41.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.990+0000 7f53ba7fc640 1 --2- 172.21.15.70:0/3912326866 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f53b40b6510 0x7f53b40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:41.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.990+0000 7f53cc8b0640 1 --2- 172.21.15.70:0/3912326866 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f53b40b6510 0x7f53b40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:41.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.990+0000 7f53ba7fc640 1 -- 172.21.15.70:0/3912326866 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f53bc0e7240 con 0x7f53c8102a60 2024-09-21T05:47:41.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.991+0000 7f53cc8b0640 1 --2- 172.21.15.70:0/3912326866 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f53b40b6510 0x7f53b40b8a20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f53c4000c00 tx=0x7f53c4005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:41.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:41.993+0000 7f53ba7fc640 1 -- 172.21.15.70:0/3912326866 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f53bc009de0 con 0x7f53c8102a60 2024-09-21T05:47:42.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:42.169+0000 7f53cf315640 1 -- 172.21.15.70:0/3912326866 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f53c819b660 con 0x7f53c8102a60 2024-09-21T05:47:42.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:42.171+0000 7f53ba7fc640 1 -- 172.21.15.70:0/3912326866 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+24691 (secure 0 0 0) 0x7f53c819b660 con 0x7f53c8102a60 2024-09-21T05:47:42.175 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:47:42.175 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":83,"fsid":"96c6636e-77db-11ef-baf5-efdc52797490","created":"2024-09-21T05:38:42.297307+0000","modified":"2024-09-21T05:47:38.383182+0000","last_up_change":"2024-09-21T05:46:15.910344+0000","last_in_change":"2024-09-21T05:45:53.382766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:42:25.611590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:47:01.987981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:47:04.388107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T05:47:10.651871+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00be8b82-7cb1-443f-ad18-02916f734df7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6803","nonce":1667051447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6805","nonce":1667051447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6809","nonce":1667051447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6807","nonce":1667051447}]},"public_addr":"172.21.15.70:6803/1667051447","cluster_addr":"172.21.15.70:6805/1667051447","heartbeat_back_addr":"172.21.15.70:6809/1667051447","heartbeat_front_addr":"172.21.15.70:6807/1667051447","state":["exists","up"]},{"osd":1,"uuid":"28ca8c5c-5e81-4e64-ac0e-3c8c3c2d3930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6801","nonce":1037621846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6803","nonce":1037621846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6807","nonce":1037621846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6805","nonce":1037621846}]},"public_addr":"172.21.15.116:6801/1037621846","cluster_addr":"172.21.15.116:6803/1037621846","heartbeat_back_addr":"172.21.15.116:6807/1037621846","heartbeat_front_addr":"172.21.15.116:6805/1037621846","state":["exists","up"]},{"osd":2,"uuid":"e9b42bf2-a38b-4cf9-8774-4950de12d0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6801","nonce":69260815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6803","nonce":69260815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6807","nonce":69260815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6805","nonce":69260815}]},"public_addr":"172.21.15.160:6801/69260815","cluster_addr":"172.21.15.160:6803/69260815","heartbeat_back_addr":"172.21.15.160:6807/69260815","heartbeat_front_addr":"172.21.15.160:6805/69260815","state":["exists","up"]},{"osd":3,"uuid":"25d8e9a8-3c14-43d6-9bb1-b44cd377133f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6811","nonce":3849416072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6813","nonce":3849416072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6817","nonce":3849416072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6815","nonce":3849416072}]},"public_addr":"172.21.15.70:6811/3849416072","cluster_addr":"172.21.15.70:6813/3849416072","heartbeat_back_addr":"172.21.15.70:6817/3849416072","heartbeat_front_addr":"172.21.15.70:6815/3849416072","state":["exists","up"]},{"osd":4,"uuid":"bdb84cbd-d718-4f69-90d0-2e732e580df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6809","nonce":3444857438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6811","nonce":3444857438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6815","nonce":3444857438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6813","nonce":3444857438}]},"public_addr":"172.21.15.116:6809/3444857438","cluster_addr":"172.21.15.116:6811/3444857438","heartbeat_back_addr":"172.21.15.116:6815/3444857438","heartbeat_front_addr":"172.21.15.116:6813/3444857438","state":["exists","up"]},{"osd":5,"uuid":"a490eeba-549f-4caa-8cd5-4168a23dafa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6809","nonce":3063220427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6811","nonce":3063220427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6815","nonce":3063220427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6813","nonce":3063220427}]},"public_addr":"172.21.15.160:6809/3063220427","cluster_addr":"172.21.15.160:6811/3063220427","heartbeat_back_addr":"172.21.15.160:6815/3063220427","heartbeat_front_addr":"172.21.15.160:6813/3063220427","state":["exists","up"]},{"osd":6,"uuid":"1bf22f48-c02f-4f09-b0fe-2597a55fd795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6819","nonce":3650315688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6821","nonce":3650315688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6825","nonce":3650315688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6823","nonce":3650315688}]},"public_addr":"172.21.15.70:6819/3650315688","cluster_addr":"172.21.15.70:6821/3650315688","heartbeat_back_addr":"172.21.15.70:6825/3650315688","heartbeat_front_addr":"172.21.15.70:6823/3650315688","state":["exists","up"]},{"osd":7,"uuid":"40d59744-4860-4a92-aa21-3f33e575e5b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6817","nonce":2034132009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6819","nonce":2034132009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6823","nonce":2034132009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6821","nonce":2034132009}]},"public_addr":"172.21.15.116:6817/2034132009","cluster_addr":"172.21.15.116:6819/2034132009","heartbeat_back_addr":"172.21.15.116:6823/2034132009","heartbeat_front_addr":"172.21.15.116:6821/2034132009","state":["exists","up"]},{"osd":8,"uuid":"65dc02e7-0dcd-4fa7-955a-4d5c00fbe4cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6817","nonce":3381625184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6819","nonce":3381625184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6823","nonce":3381625184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6821","nonce":3381625184}]},"public_addr":"172.21.15.160:6817/3381625184","cluster_addr":"172.21.15.160:6819/3381625184","heartbeat_back_addr":"172.21.15.160:6823/3381625184","heartbeat_front_addr":"172.21.15.160:6821/3381625184","state":["exists","up"]},{"osd":9,"uuid":"d8438a9c-012f-4082-be3f-9653cdfaac78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6827","nonce":3555256209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6829","nonce":3555256209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6833","nonce":3555256209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6831","nonce":3555256209}]},"public_addr":"172.21.15.70:6827/3555256209","cluster_addr":"172.21.15.70:6829/3555256209","heartbeat_back_addr":"172.21.15.70:6833/3555256209","heartbeat_front_addr":"172.21.15.70:6831/3555256209","state":["exists","up"]},{"osd":10,"uuid":"871619b0-181e-4020-9511-2cec296bfe70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6825","nonce":541280433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6827","nonce":541280433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6831","nonce":541280433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6829","nonce":541280433}]},"public_addr":"172.21.15.116:6825/541280433","cluster_addr":"172.21.15.116:6827/541280433","heartbeat_back_addr":"172.21.15.116:6831/541280433","heartbeat_front_addr":"172.21.15.116:6829/541280433","state":["exists","up"]},{"osd":11,"uuid":"302da945-7929-4b0c-a20b-099175752c41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6825","nonce":2632369083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6827","nonce":2632369083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6831","nonce":2632369083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6829","nonce":2632369083}]},"public_addr":"172.21.15.160:6825/2632369083","cluster_addr":"172.21.15.160:6827/2632369083","heartbeat_back_addr":"172.21.15.160:6831/2632369083","heartbeat_front_addr":"172.21.15.160:6829/2632369083","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:41:34.446744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:41:59.336955+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:42:23.958219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:42:49.396007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:43:15.325344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:43:41.923141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:07.873970+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:33.897951+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:58.397680+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:24.568406+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:49.504565+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:14.698577+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.e","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6800/605055695":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/897886925":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/1968357524":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/693721445":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/2810307308":"2024-09-22T05:39:12.492271+0000","172.21.15.70:6801/605055695":"2024-09-22T05:39:37.296630+0000","172.21.15.70:6801/1668927582":"2024-09-22T05:39:12.492271+0000","172.21.15.70:6800/1668927582":"2024-09-22T05:39:12.492271+0000","172.21.15.70:0/1979536420":"2024-09-22T05:39:12.492271+0000","172.21.15.70:0/2674019604":"2024-09-22T05:39:12.492271+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:47:42.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:42.174+0000 7f53cf315640 1 -- 172.21.15.70:0/3912326866 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f53b40b6510 msgr2=0x7f53b40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:42.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:42.174+0000 7f53cf315640 1 --2- 172.21.15.70:0/3912326866 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f53b40b6510 0x7f53b40b8a20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f53c4000c00 tx=0x7f53c4005d50 comp rx=0 tx=0).stop 2024-09-21T05:47:42.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:42.174+0000 7f53cf315640 1 -- 172.21.15.70:0/3912326866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53c8102a60 msgr2=0x7f53c819a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:42.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:42.174+0000 7f53cf315640 1 --2- 172.21.15.70:0/3912326866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53c8102a60 0x7f53c819a530 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00d950 tx=0x7f53bc00de10 comp rx=0 tx=0).stop 2024-09-21T05:47:42.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:42.174+0000 7f53cf315640 1 -- 172.21.15.70:0/3912326866 shutdown_connections 2024-09-21T05:47:42.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:42.174+0000 7f53cf315640 1 --2- 172.21.15.70:0/3912326866 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f53b40b6510 0x7f53b40b8a20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:42.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:42.174+0000 7f53cf315640 1 --2- 172.21.15.70:0/3912326866 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53c8108cf0 0x7f53c819fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:42.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:42.174+0000 7f53cf315640 1 --2- 172.21.15.70:0/3912326866 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53c81083a0 0x7f53c819aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:42.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:42.174+0000 7f53cf315640 1 --2- 172.21.15.70:0/3912326866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53c8102a60 0x7f53c819a530 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:42.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:42.174+0000 7f53cf315640 1 -- 172.21.15.70:0/3912326866 >> 172.21.15.70:0/3912326866 conn(0x7f53c8079730 msgr2=0x7f53c806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:42.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:42.174+0000 7f53cf315640 1 -- 172.21.15.70:0/3912326866 shutdown_connections 2024-09-21T05:47:42.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:42.174+0000 7f53cf315640 1 -- 172.21.15.70:0/3912326866 wait complete. 2024-09-21T05:47:42.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:42 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3912326866' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:47:42.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:42 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3912326866' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:47:42.888 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs set cephfs standby_count_wanted 0 2024-09-21T05:47:42.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:42 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3912326866' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:47:43.133 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:47:43.513 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:43 smithi070 ceph-mon[30981]: pgmap v316: 129 pgs: 129 active+clean; 581 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-09-21T05:47:43.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.603+0000 7fc882b7c640 1 -- 172.21.15.70:0/1238350988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc87c1083d0 msgr2=0x7fc87c1087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:43.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.603+0000 7fc882b7c640 1 --2- 172.21.15.70:0/1238350988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc87c1083d0 0x7fc87c1087e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc868009900 tx=0x7fc86802a410 comp rx=0 tx=0).stop 2024-09-21T05:47:43.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.604+0000 7fc882b7c640 1 -- 172.21.15.70:0/1238350988 shutdown_connections 2024-09-21T05:47:43.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.604+0000 7fc882b7c640 1 --2- 172.21.15.70:0/1238350988 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc87c108d20 0x7fc87c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:43.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.604+0000 7fc882b7c640 1 --2- 172.21.15.70:0/1238350988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc87c1083d0 0x7fc87c1087e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:43.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.604+0000 7fc882b7c640 1 --2- 172.21.15.70:0/1238350988 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc87c102ae0 0x7fc87c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:43.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.604+0000 7fc882b7c640 1 -- 172.21.15.70:0/1238350988 >> 172.21.15.70:0/1238350988 conn(0x7fc87c079760 msgr2=0x7fc87c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:43.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.604+0000 7fc882b7c640 1 -- 172.21.15.70:0/1238350988 shutdown_connections 2024-09-21T05:47:43.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.604+0000 7fc882b7c640 1 -- 172.21.15.70:0/1238350988 wait complete. 2024-09-21T05:47:43.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.604+0000 7fc882b7c640 1 Processor -- start 2024-09-21T05:47:43.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.604+0000 7fc882b7c640 1 -- start start 2024-09-21T05:47:43.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.605+0000 7fc882b7c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc87c102ae0 0x7fc87c19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:43.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.605+0000 7fc882b7c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc87c1083d0 0x7fc87c19aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:43.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.605+0000 7fc882b7c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc87c108d20 0x7fc87c19fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:43.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.605+0000 7fc882b7c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc87c113a80 con 0x7fc87c1083d0 2024-09-21T05:47:43.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.605+0000 7fc882b7c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc87c113900 con 0x7fc87c108d20 2024-09-21T05:47:43.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.605+0000 7fc882b7c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc87c113c00 con 0x7fc87c102ae0 2024-09-21T05:47:43.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.605+0000 7fc87bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc87c1083d0 0x7fc87c19aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:43.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.605+0000 7fc87bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc87c1083d0 0x7fc87c19aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35616/0 (socket says 172.21.15.70:35616) 2024-09-21T05:47:43.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.605+0000 7fc87bfff640 1 -- 172.21.15.70:0/3698448962 learned_addr learned my addr 172.21.15.70:0/3698448962 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:47:43.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.605+0000 7fc881119640 1 --2- 172.21.15.70:0/3698448962 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc87c108d20 0x7fc87c19fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:43.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.605+0000 7fc880918640 1 --2- 172.21.15.70:0/3698448962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc87c102ae0 0x7fc87c19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:43.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.605+0000 7fc87bfff640 1 -- 172.21.15.70:0/3698448962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc87c102ae0 msgr2=0x7fc87c19a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:43.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.605+0000 7fc87bfff640 1 --2- 172.21.15.70:0/3698448962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc87c102ae0 0x7fc87c19a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:43.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.605+0000 7fc87bfff640 1 -- 172.21.15.70:0/3698448962 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc87c108d20 msgr2=0x7fc87c19fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:43.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.605+0000 7fc87bfff640 1 --2- 172.21.15.70:0/3698448962 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc87c108d20 0x7fc87c19fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:43.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.605+0000 7fc87bfff640 1 -- 172.21.15.70:0/3698448962 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc87c1a03e0 con 0x7fc87c1083d0 2024-09-21T05:47:43.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.605+0000 7fc880918640 1 --2- 172.21.15.70:0/3698448962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc87c102ae0 0x7fc87c19a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:47:43.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.605+0000 7fc87bfff640 1 --2- 172.21.15.70:0/3698448962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc87c1083d0 0x7fc87c19aa10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc868004270 tx=0x7fc8680042a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:43.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.605+0000 7fc879ffb640 1 -- 172.21.15.70:0/3698448962 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86803f030 con 0x7fc87c1083d0 2024-09-21T05:47:43.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.605+0000 7fc879ffb640 1 -- 172.21.15.70:0/3698448962 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fc8680044c0 con 0x7fc87c1083d0 2024-09-21T05:47:43.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.605+0000 7fc879ffb640 1 -- 172.21.15.70:0/3698448962 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc868035070 con 0x7fc87c1083d0 2024-09-21T05:47:43.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.606+0000 7fc882b7c640 1 -- 172.21.15.70:0/3698448962 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc87c1a0670 con 0x7fc87c1083d0 2024-09-21T05:47:43.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.606+0000 7fc882b7c640 1 -- 172.21.15.70:0/3698448962 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc87c1a6e30 con 0x7fc87c1083d0 2024-09-21T05:47:43.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.607+0000 7fc882b7c640 1 -- 172.21.15.70:0/3698448962 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc87c103d10 con 0x7fc87c1083d0 2024-09-21T05:47:43.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.608+0000 7fc879ffb640 1 -- 172.21.15.70:0/3698448962 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fc868042030 con 0x7fc87c1083d0 2024-09-21T05:47:43.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.609+0000 7fc879ffb640 1 --2- 172.21.15.70:0/3698448962 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc86c0b6510 0x7fc86c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:43.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.609+0000 7fc880918640 1 --2- 172.21.15.70:0/3698448962 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc86c0b6510 0x7fc86c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:43.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.609+0000 7fc879ffb640 1 -- 172.21.15.70:0/3698448962 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7fc868107f40 con 0x7fc87c1083d0 2024-09-21T05:47:43.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.609+0000 7fc880918640 1 --2- 172.21.15.70:0/3698448962 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc86c0b6510 0x7fc86c0b8a20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc8700058c0 tx=0x7fc870005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:43.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.612+0000 7fc879ffb640 1 -- 172.21.15.70:0/3698448962 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc8680ce470 con 0x7fc87c1083d0 2024-09-21T05:47:43.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:43 smithi116 ceph-mon[34332]: pgmap v316: 129 pgs: 129 active+clean; 581 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-09-21T05:47:43.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:43.829+0000 7fc882b7c640 1 -- 172.21.15.70:0/3698448962 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc87c10aaf0 con 0x7fc87c1083d0 2024-09-21T05:47:43.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:43 smithi160 ceph-mon[33979]: pgmap v316: 129 pgs: 129 active+clean; 581 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-09-21T05:47:44.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:44.486+0000 7fc879ffb640 1 -- 172.21.15.70:0/3698448962 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fc8680d2850 con 0x7fc87c1083d0 2024-09-21T05:47:44.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:44.488+0000 7fc882b7c640 1 -- 172.21.15.70:0/3698448962 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc86c0b6510 msgr2=0x7fc86c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:44.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:44.488+0000 7fc882b7c640 1 --2- 172.21.15.70:0/3698448962 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc86c0b6510 0x7fc86c0b8a20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc8700058c0 tx=0x7fc870005850 comp rx=0 tx=0).stop 2024-09-21T05:47:44.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:44.488+0000 7fc882b7c640 1 -- 172.21.15.70:0/3698448962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc87c1083d0 msgr2=0x7fc87c19aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:44.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:44.488+0000 7fc882b7c640 1 --2- 172.21.15.70:0/3698448962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc87c1083d0 0x7fc87c19aa10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc868004270 tx=0x7fc8680042a0 comp rx=0 tx=0).stop 2024-09-21T05:47:44.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:44.488+0000 7fc882b7c640 1 -- 172.21.15.70:0/3698448962 shutdown_connections 2024-09-21T05:47:44.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:44.488+0000 7fc882b7c640 1 --2- 172.21.15.70:0/3698448962 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc86c0b6510 0x7fc86c0b8a20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:44.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:44.488+0000 7fc882b7c640 1 --2- 172.21.15.70:0/3698448962 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc87c108d20 0x7fc87c19fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:44.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:44.488+0000 7fc882b7c640 1 --2- 172.21.15.70:0/3698448962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc87c1083d0 0x7fc87c19aa10 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:44.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:44.488+0000 7fc882b7c640 1 --2- 172.21.15.70:0/3698448962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc87c102ae0 0x7fc87c19a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:44.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:44.488+0000 7fc882b7c640 1 -- 172.21.15.70:0/3698448962 >> 172.21.15.70:0/3698448962 conn(0x7fc87c079760 msgr2=0x7fc87c1044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:44.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:44.488+0000 7fc882b7c640 1 -- 172.21.15.70:0/3698448962 shutdown_connections 2024-09-21T05:47:44.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:44.488+0000 7fc882b7c640 1 -- 172.21.15.70:0/3698448962 wait complete. 2024-09-21T05:47:44.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:44 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3698448962' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T05:47:44.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:44 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3698448962' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T05:47:44.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:44 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3698448962' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T05:47:45.300 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-21T05:47:45.301 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs set cephfs max_mds 5 2024-09-21T05:47:45.551 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:47:45.671 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:45 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3698448962' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T05:47:45.671 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:45 smithi070 ceph-mon[30981]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T05:47:45.671 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:45 smithi070 ceph-mon[30981]: pgmap v317: 129 pgs: 129 active+clean; 581 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:45.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:45 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3698448962' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T05:47:45.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:45 smithi116 ceph-mon[34332]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T05:47:45.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:45 smithi116 ceph-mon[34332]: pgmap v317: 129 pgs: 129 active+clean; 581 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:45.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:45 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3698448962' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T05:47:45.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:45 smithi160 ceph-mon[33979]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T05:47:45.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:45 smithi160 ceph-mon[33979]: pgmap v317: 129 pgs: 129 active+clean; 581 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:47:46.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.059+0000 7fd440392640 1 -- 172.21.15.70:0/927778455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd438108d20 msgr2=0x7fd43810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:46.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.059+0000 7fd440392640 1 --2- 172.21.15.70:0/927778455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd438108d20 0x7fd43810f550 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd430009ca0 tx=0x7fd43002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:47:46.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.060+0000 7fd440392640 1 -- 172.21.15.70:0/927778455 shutdown_connections 2024-09-21T05:47:46.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.060+0000 7fd440392640 1 --2- 172.21.15.70:0/927778455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4381083d0 0x7fd4381087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:46.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.060+0000 7fd440392640 1 --2- 172.21.15.70:0/927778455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd438108d20 0x7fd43810f550 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:46.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.060+0000 7fd440392640 1 --2- 172.21.15.70:0/927778455 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd438102ae0 0x7fd438102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:46.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.060+0000 7fd440392640 1 -- 172.21.15.70:0/927778455 >> 172.21.15.70:0/927778455 conn(0x7fd438079760 msgr2=0x7fd438079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:46.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.060+0000 7fd440392640 1 -- 172.21.15.70:0/927778455 shutdown_connections 2024-09-21T05:47:46.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.060+0000 7fd440392640 1 -- 172.21.15.70:0/927778455 wait complete. 2024-09-21T05:47:46.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.060+0000 7fd440392640 1 Processor -- start 2024-09-21T05:47:46.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.060+0000 7fd440392640 1 -- start start 2024-09-21T05:47:46.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.060+0000 7fd440392640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd438102ae0 0x7fd43810ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:46.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.060+0000 7fd440392640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4381083d0 0x7fd438110520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:46.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.061+0000 7fd440392640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd438108d20 0x7fd438110a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:46.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.061+0000 7fd440392640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd438113a80 con 0x7fd4381083d0 2024-09-21T05:47:46.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.061+0000 7fd440392640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd438113900 con 0x7fd438108d20 2024-09-21T05:47:46.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.061+0000 7fd440392640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd438113c00 con 0x7fd438102ae0 2024-09-21T05:47:46.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.061+0000 7fd43d92d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4381083d0 0x7fd438110520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:46.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.061+0000 7fd43d92d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4381083d0 0x7fd438110520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35642/0 (socket says 172.21.15.70:35642) 2024-09-21T05:47:46.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.061+0000 7fd43d92d640 1 -- 172.21.15.70:0/1894624328 learned_addr learned my addr 172.21.15.70:0/1894624328 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:47:46.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.061+0000 7fd43e12e640 1 --2- 172.21.15.70:0/1894624328 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd438102ae0 0x7fd43810ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:46.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.061+0000 7fd43e92f640 1 --2- 172.21.15.70:0/1894624328 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd438108d20 0x7fd438110a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:46.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.061+0000 7fd43d92d640 1 -- 172.21.15.70:0/1894624328 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd438102ae0 msgr2=0x7fd43810ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:46.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.061+0000 7fd43d92d640 1 --2- 172.21.15.70:0/1894624328 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd438102ae0 0x7fd43810ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:46.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.061+0000 7fd43d92d640 1 -- 172.21.15.70:0/1894624328 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd438108d20 msgr2=0x7fd438110a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:46.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.061+0000 7fd43d92d640 1 --2- 172.21.15.70:0/1894624328 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd438108d20 0x7fd438110a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:46.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.061+0000 7fd43d92d640 1 -- 172.21.15.70:0/1894624328 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4381a8640 con 0x7fd4381083d0 2024-09-21T05:47:46.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.061+0000 7fd43d92d640 1 --2- 172.21.15.70:0/1894624328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4381083d0 0x7fd438110520 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd43400c970 tx=0x7fd43400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:46.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.061+0000 7fd42b7fe640 1 -- 172.21.15.70:0/1894624328 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd434014070 con 0x7fd4381083d0 2024-09-21T05:47:46.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.061+0000 7fd42b7fe640 1 -- 172.21.15.70:0/1894624328 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fd434004440 con 0x7fd4381083d0 2024-09-21T05:47:46.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.061+0000 7fd440392640 1 -- 172.21.15.70:0/1894624328 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4381a8930 con 0x7fd4381083d0 2024-09-21T05:47:46.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.061+0000 7fd42b7fe640 1 -- 172.21.15.70:0/1894624328 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd434003cc0 con 0x7fd4381083d0 2024-09-21T05:47:46.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.061+0000 7fd440392640 1 -- 172.21.15.70:0/1894624328 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4381a8e70 con 0x7fd4381083d0 2024-09-21T05:47:46.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.062+0000 7fd440392640 1 -- 172.21.15.70:0/1894624328 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd438103d10 con 0x7fd4381083d0 2024-09-21T05:47:46.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.064+0000 7fd42b7fe640 1 -- 172.21.15.70:0/1894624328 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fd434017070 con 0x7fd4381083d0 2024-09-21T05:47:46.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.064+0000 7fd42b7fe640 1 --2- 172.21.15.70:0/1894624328 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd4240b6510 0x7fd4240b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:46.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.065+0000 7fd43e12e640 1 --2- 172.21.15.70:0/1894624328 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd4240b6510 0x7fd4240b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:46.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.065+0000 7fd42b7fe640 1 -- 172.21.15.70:0/1894624328 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7fd4340e77d0 con 0x7fd4381083d0 2024-09-21T05:47:46.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.065+0000 7fd43e12e640 1 --2- 172.21.15.70:0/1894624328 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd4240b6510 0x7fd4240b8a20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd438111a30 tx=0x7fd42c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:46.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.068+0000 7fd42b7fe640 1 -- 172.21.15.70:0/1894624328 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd43401e030 con 0x7fd4381083d0 2024-09-21T05:47:46.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.286+0000 7fd440392640 1 -- 172.21.15.70:0/1894624328 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7fd43802e640 con 0x7fd4381083d0 2024-09-21T05:47:46.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.498+0000 7fd42b7fe640 1 -- 172.21.15.70:0/1894624328 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7fd4340add00 con 0x7fd4381083d0 2024-09-21T05:47:46.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.501+0000 7fd440392640 1 -- 172.21.15.70:0/1894624328 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd4240b6510 msgr2=0x7fd4240b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:46.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.501+0000 7fd440392640 1 --2- 172.21.15.70:0/1894624328 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd4240b6510 0x7fd4240b8a20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd438111a30 tx=0x7fd42c00a2d0 comp rx=0 tx=0).stop 2024-09-21T05:47:46.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.501+0000 7fd440392640 1 -- 172.21.15.70:0/1894624328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4381083d0 msgr2=0x7fd438110520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:46.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.501+0000 7fd440392640 1 --2- 172.21.15.70:0/1894624328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4381083d0 0x7fd438110520 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd43400c970 tx=0x7fd43400cd70 comp rx=0 tx=0).stop 2024-09-21T05:47:46.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.501+0000 7fd440392640 1 -- 172.21.15.70:0/1894624328 shutdown_connections 2024-09-21T05:47:46.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.501+0000 7fd440392640 1 --2- 172.21.15.70:0/1894624328 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd4240b6510 0x7fd4240b8a20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:46.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.501+0000 7fd440392640 1 --2- 172.21.15.70:0/1894624328 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd438108d20 0x7fd438110a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:46.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.501+0000 7fd440392640 1 --2- 172.21.15.70:0/1894624328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4381083d0 0x7fd438110520 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:46.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.501+0000 7fd440392640 1 --2- 172.21.15.70:0/1894624328 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd438102ae0 0x7fd43810ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:46.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.501+0000 7fd440392640 1 -- 172.21.15.70:0/1894624328 >> 172.21.15.70:0/1894624328 conn(0x7fd438079760 msgr2=0x7fd438105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:46.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.501+0000 7fd440392640 1 -- 172.21.15.70:0/1894624328 shutdown_connections 2024-09-21T05:47:46.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:46.501+0000 7fd440392640 1 -- 172.21.15.70:0/1894624328 wait complete. 2024-09-21T05:47:46.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:46 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1894624328' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-21T05:47:46.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:46 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1894624328' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-21T05:47:46.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:46 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1894624328' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-21T05:47:47.178 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs set cephfs allow_standby_replay true 2024-09-21T05:47:47.422 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:47:47.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:47 smithi116 ceph-mon[34332]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T05:47:47.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:47 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1894624328' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-21T05:47:47.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:47 smithi116 ceph-mon[34332]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T05:47:47.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:47 smithi116 ceph-mon[34332]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T05:47:47.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:47 smithi116 ceph-mon[34332]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T05:47:47.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:47 smithi116 ceph-mon[34332]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T05:47:47.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:47 smithi116 ceph-mon[34332]: pgmap v318: 129 pgs: 129 active+clean; 581 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 102 B/s wr, 0 op/s 2024-09-21T05:47:47.820 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:47 smithi070 ceph-mon[30981]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T05:47:47.820 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:47 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1894624328' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-21T05:47:47.820 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:47 smithi070 ceph-mon[30981]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T05:47:47.820 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:47 smithi070 ceph-mon[30981]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T05:47:47.820 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:47 smithi070 ceph-mon[30981]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T05:47:47.820 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:47 smithi070 ceph-mon[30981]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T05:47:47.820 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:47 smithi070 ceph-mon[30981]: pgmap v318: 129 pgs: 129 active+clean; 581 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 102 B/s wr, 0 op/s 2024-09-21T05:47:47.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:47 smithi160 ceph-mon[33979]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T05:47:47.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:47 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1894624328' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-21T05:47:47.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:47 smithi160 ceph-mon[33979]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T05:47:47.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:47 smithi160 ceph-mon[33979]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T05:47:47.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:47 smithi160 ceph-mon[33979]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T05:47:47.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:47 smithi160 ceph-mon[33979]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T05:47:47.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:47 smithi160 ceph-mon[33979]: pgmap v318: 129 pgs: 129 active+clean; 581 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 102 B/s wr, 0 op/s 2024-09-21T05:47:47.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.910+0000 7f26115ba640 1 -- 172.21.15.70:0/3186907690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f260c102a90 msgr2=0x7f260c102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:47.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.910+0000 7f26115ba640 1 --2- 172.21.15.70:0/3186907690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f260c102a90 0x7f260c102ea0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f25fc009900 tx=0x7f25fc02a410 comp rx=0 tx=0).stop 2024-09-21T05:47:47.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.910+0000 7f26115ba640 1 -- 172.21.15.70:0/3186907690 shutdown_connections 2024-09-21T05:47:47.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.910+0000 7f26115ba640 1 --2- 172.21.15.70:0/3186907690 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f260c1083d0 0x7f260c1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:47.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.910+0000 7f26115ba640 1 --2- 172.21.15.70:0/3186907690 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f260c108d20 0x7f260c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:47.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.910+0000 7f26115ba640 1 --2- 172.21.15.70:0/3186907690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f260c102a90 0x7f260c102ea0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:47.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.910+0000 7f26115ba640 1 -- 172.21.15.70:0/3186907690 >> 172.21.15.70:0/3186907690 conn(0x7f260c079750 msgr2=0x7f260c079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:47.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.910+0000 7f26115ba640 1 -- 172.21.15.70:0/3186907690 shutdown_connections 2024-09-21T05:47:47.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.910+0000 7f26115ba640 1 -- 172.21.15.70:0/3186907690 wait complete. 2024-09-21T05:47:47.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.911+0000 7f26115ba640 1 Processor -- start 2024-09-21T05:47:47.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.911+0000 7f26115ba640 1 -- start start 2024-09-21T05:47:47.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.911+0000 7f26115ba640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f260c102a90 0x7f260c19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:47.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.911+0000 7f26115ba640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f260c1083d0 0x7f260c19aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:47.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.911+0000 7f26115ba640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f260c108d20 0x7f260c19fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:47.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.911+0000 7f26115ba640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f260c113a80 con 0x7f260c1083d0 2024-09-21T05:47:47.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.911+0000 7f26115ba640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f260c113900 con 0x7f260c108d20 2024-09-21T05:47:47.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.912+0000 7f26115ba640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f260c113c00 con 0x7f260c102a90 2024-09-21T05:47:47.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.912+0000 7f260a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f260c1083d0 0x7f260c19aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:47.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.912+0000 7f260a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f260c1083d0 0x7f260c19aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35666/0 (socket says 172.21.15.70:35666) 2024-09-21T05:47:47.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.912+0000 7f260a7fc640 1 -- 172.21.15.70:0/3634174485 learned_addr learned my addr 172.21.15.70:0/3634174485 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:47:47.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.912+0000 7f260b7fe640 1 --2- 172.21.15.70:0/3634174485 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f260c108d20 0x7f260c19fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:47.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.912+0000 7f260affd640 1 --2- 172.21.15.70:0/3634174485 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f260c102a90 0x7f260c19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:47.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.912+0000 7f260a7fc640 1 -- 172.21.15.70:0/3634174485 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f260c102a90 msgr2=0x7f260c19a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:47.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.912+0000 7f260a7fc640 1 --2- 172.21.15.70:0/3634174485 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f260c102a90 0x7f260c19a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:47.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.912+0000 7f260a7fc640 1 -- 172.21.15.70:0/3634174485 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f260c108d20 msgr2=0x7f260c19fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:47.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.912+0000 7f260a7fc640 1 --2- 172.21.15.70:0/3634174485 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f260c108d20 0x7f260c19fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:47.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.912+0000 7f260a7fc640 1 -- 172.21.15.70:0/3634174485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f260c1a03e0 con 0x7f260c1083d0 2024-09-21T05:47:47.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.912+0000 7f260a7fc640 1 --2- 172.21.15.70:0/3634174485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f260c1083d0 0x7f260c19aa10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f25f400d740 tx=0x7f25f400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:47.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.912+0000 7f2603fff640 1 -- 172.21.15.70:0/3634174485 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f4017070 con 0x7f260c1083d0 2024-09-21T05:47:47.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.912+0000 7f26115ba640 1 -- 172.21.15.70:0/3634174485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f260c1a06d0 con 0x7f260c1083d0 2024-09-21T05:47:47.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.912+0000 7f2603fff640 1 -- 172.21.15.70:0/3634174485 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f25f400de50 con 0x7f260c1083d0 2024-09-21T05:47:47.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.912+0000 7f2603fff640 1 -- 172.21.15.70:0/3634174485 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f4004cd0 con 0x7f260c1083d0 2024-09-21T05:47:47.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.912+0000 7f26115ba640 1 -- 172.21.15.70:0/3634174485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f260c1a6e30 con 0x7f260c1083d0 2024-09-21T05:47:47.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.913+0000 7f26115ba640 1 -- 172.21.15.70:0/3634174485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f260c103d10 con 0x7f260c1083d0 2024-09-21T05:47:47.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.915+0000 7f2603fff640 1 -- 172.21.15.70:0/3634174485 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f25f4009c30 con 0x7f260c1083d0 2024-09-21T05:47:47.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.916+0000 7f2603fff640 1 --2- 172.21.15.70:0/3634174485 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f25f80b6510 0x7f25f80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:47.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.916+0000 7f260affd640 1 --2- 172.21.15.70:0/3634174485 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f25f80b6510 0x7f25f80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:47.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.916+0000 7f2603fff640 1 -- 172.21.15.70:0/3634174485 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f25f40e73b0 con 0x7f260c1083d0 2024-09-21T05:47:47.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.917+0000 7f260affd640 1 --2- 172.21.15.70:0/3634174485 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f25f80b6510 0x7f25f80b8a20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f25fc005d90 tx=0x7f25fc005df0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:47.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:47.920+0000 7f2603fff640 1 -- 172.21.15.70:0/3634174485 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f25f40ad920 con 0x7f260c1083d0 2024-09-21T05:47:48.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:48.135+0000 7f26115ba640 1 -- 172.21.15.70:0/3634174485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f260c19b5a0 con 0x7f260c1083d0 2024-09-21T05:47:48.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:48.519+0000 7f2603fff640 1 -- 172.21.15.70:0/3634174485 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f260c19b5a0 con 0x7f260c1083d0 2024-09-21T05:47:48.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:48.521+0000 7f26115ba640 1 -- 172.21.15.70:0/3634174485 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f25f80b6510 msgr2=0x7f25f80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:48.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:48.521+0000 7f26115ba640 1 --2- 172.21.15.70:0/3634174485 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f25f80b6510 0x7f25f80b8a20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f25fc005d90 tx=0x7f25fc005df0 comp rx=0 tx=0).stop 2024-09-21T05:47:48.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:48.521+0000 7f26115ba640 1 -- 172.21.15.70:0/3634174485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f260c1083d0 msgr2=0x7f260c19aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:48.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:48.521+0000 7f26115ba640 1 --2- 172.21.15.70:0/3634174485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f260c1083d0 0x7f260c19aa10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f25f400d740 tx=0x7f25f400dc00 comp rx=0 tx=0).stop 2024-09-21T05:47:48.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:48.521+0000 7f26115ba640 1 -- 172.21.15.70:0/3634174485 shutdown_connections 2024-09-21T05:47:48.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:48.521+0000 7f26115ba640 1 --2- 172.21.15.70:0/3634174485 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f25f80b6510 0x7f25f80b8a20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:48.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:48.521+0000 7f26115ba640 1 --2- 172.21.15.70:0/3634174485 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f260c108d20 0x7f260c19fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:48.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:48.521+0000 7f26115ba640 1 --2- 172.21.15.70:0/3634174485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f260c1083d0 0x7f260c19aa10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:48.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:48.521+0000 7f26115ba640 1 --2- 172.21.15.70:0/3634174485 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f260c102a90 0x7f260c19a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:48.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:48.521+0000 7f26115ba640 1 -- 172.21.15.70:0/3634174485 >> 172.21.15.70:0/3634174485 conn(0x7f260c079750 msgr2=0x7f260c101480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:48.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:48.521+0000 7f26115ba640 1 -- 172.21.15.70:0/3634174485 shutdown_connections 2024-09-21T05:47:48.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:48.521+0000 7f26115ba640 1 -- 172.21.15.70:0/3634174485 wait complete. 2024-09-21T05:47:48.804 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:48 smithi070 ceph-mon[30981]: mds.? [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] up:active 2024-09-21T05:47:48.804 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:48 smithi070 ceph-mon[30981]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T05:47:48.804 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:48 smithi070 ceph-mon[30981]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T05:47:48.804 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:48 smithi070 ceph-mon[30981]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-21T05:47:48.804 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:48 smithi070 ceph-mon[30981]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-21T05:47:48.804 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:48 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3634174485' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T05:47:48.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:48 smithi116 ceph-mon[34332]: mds.? [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] up:active 2024-09-21T05:47:48.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:48 smithi116 ceph-mon[34332]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T05:47:48.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:48 smithi116 ceph-mon[34332]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T05:47:48.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:48 smithi116 ceph-mon[34332]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-21T05:47:48.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:48 smithi116 ceph-mon[34332]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-21T05:47:48.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:48 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3634174485' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T05:47:48.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:48 smithi160 ceph-mon[33979]: mds.? [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] up:active 2024-09-21T05:47:48.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:48 smithi160 ceph-mon[33979]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T05:47:48.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:48 smithi160 ceph-mon[33979]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T05:47:48.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:48 smithi160 ceph-mon[33979]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-21T05:47:48.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:48 smithi160 ceph-mon[33979]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-21T05:47:48.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:48 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3634174485' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T05:47:49.303 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs set cephfs session_timeout 300 2024-09-21T05:47:49.556 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:47:49.675 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:49 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3634174485' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T05:47:49.675 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:49 smithi070 ceph-mon[30981]: mds.? [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] up:active 2024-09-21T05:47:49.675 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:49 smithi070 ceph-mon[30981]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-21T05:47:49.675 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:49 smithi070 ceph-mon[30981]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-21T05:47:49.675 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:49 smithi070 ceph-mon[30981]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-21T05:47:49.675 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:49 smithi070 ceph-mon[30981]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-21T05:47:49.675 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:49 smithi070 ceph-mon[30981]: pgmap v319: 129 pgs: 129 active+clean; 584 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 2 op/s 2024-09-21T05:47:49.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:49 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3634174485' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T05:47:49.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:49 smithi116 ceph-mon[34332]: mds.? [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] up:active 2024-09-21T05:47:49.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:49 smithi116 ceph-mon[34332]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-21T05:47:49.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:49 smithi116 ceph-mon[34332]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-21T05:47:49.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:49 smithi116 ceph-mon[34332]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-21T05:47:49.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:49 smithi116 ceph-mon[34332]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-21T05:47:49.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:49 smithi116 ceph-mon[34332]: pgmap v319: 129 pgs: 129 active+clean; 584 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 2 op/s 2024-09-21T05:47:49.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:49 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3634174485' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T05:47:49.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:49 smithi160 ceph-mon[33979]: mds.? [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] up:active 2024-09-21T05:47:49.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:49 smithi160 ceph-mon[33979]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-21T05:47:49.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:49 smithi160 ceph-mon[33979]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-21T05:47:49.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:49 smithi160 ceph-mon[33979]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-21T05:47:49.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:49 smithi160 ceph-mon[33979]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-21T05:47:49.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:49 smithi160 ceph-mon[33979]: pgmap v319: 129 pgs: 129 active+clean; 584 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 2 op/s 2024-09-21T05:47:50.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.011+0000 7f626d50d640 1 -- 172.21.15.70:0/89382760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6268108cf0 msgr2=0x7f626810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:50.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.011+0000 7f626d50d640 1 --2- 172.21.15.70:0/89382760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6268108cf0 0x7f626810f520 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6260009ca0 tx=0x7f626002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:47:50.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.011+0000 7f626d50d640 1 -- 172.21.15.70:0/89382760 shutdown_connections 2024-09-21T05:47:50.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.011+0000 7f626d50d640 1 --2- 172.21.15.70:0/89382760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6268108cf0 0x7f626810f520 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:50.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.011+0000 7f626d50d640 1 --2- 172.21.15.70:0/89382760 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62681083a0 0x7f62681087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:50.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.011+0000 7f626d50d640 1 --2- 172.21.15.70:0/89382760 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6268102a60 0x7f6268102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:50.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.011+0000 7f626d50d640 1 -- 172.21.15.70:0/89382760 >> 172.21.15.70:0/89382760 conn(0x7f6268079730 msgr2=0x7f6268079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:50.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.011+0000 7f626d50d640 1 -- 172.21.15.70:0/89382760 shutdown_connections 2024-09-21T05:47:50.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.011+0000 7f626d50d640 1 -- 172.21.15.70:0/89382760 wait complete. 2024-09-21T05:47:50.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.012+0000 7f626d50d640 1 Processor -- start 2024-09-21T05:47:50.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.012+0000 7f626d50d640 1 -- start start 2024-09-21T05:47:50.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.012+0000 7f626d50d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6268102a60 0x7f62680ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:50.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.012+0000 7f626d50d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62681083a0 0x7f62680ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:50.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.012+0000 7f626d50d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6268108cf0 0x7f62681000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:50.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.012+0000 7f626d50d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6268112930 con 0x7f6268102a60 2024-09-21T05:47:50.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.012+0000 7f626d50d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f62681127b0 con 0x7f6268108cf0 2024-09-21T05:47:50.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.012+0000 7f626d50d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6268112ab0 con 0x7f62681083a0 2024-09-21T05:47:50.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.013+0000 7f6266ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6268102a60 0x7f62680ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:50.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.013+0000 7f6266ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6268102a60 0x7f62680ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35686/0 (socket says 172.21.15.70:35686) 2024-09-21T05:47:50.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.013+0000 7f6266ffd640 1 -- 172.21.15.70:0/3414513643 learned_addr learned my addr 172.21.15.70:0/3414513643 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:47:50.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.013+0000 7f62677fe640 1 --2- 172.21.15.70:0/3414513643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6268108cf0 0x7f62681000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:50.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.013+0000 7f62667fc640 1 --2- 172.21.15.70:0/3414513643 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62681083a0 0x7f62680ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:50.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.013+0000 7f6266ffd640 1 -- 172.21.15.70:0/3414513643 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62681083a0 msgr2=0x7f62680ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:50.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.013+0000 7f6266ffd640 1 --2- 172.21.15.70:0/3414513643 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62681083a0 0x7f62680ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:50.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.013+0000 7f6266ffd640 1 -- 172.21.15.70:0/3414513643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6268108cf0 msgr2=0x7f62681000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:50.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.013+0000 7f6266ffd640 1 --2- 172.21.15.70:0/3414513643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6268108cf0 0x7f62681000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:50.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.013+0000 7f6266ffd640 1 -- 172.21.15.70:0/3414513643 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62681a8710 con 0x7f6268102a60 2024-09-21T05:47:50.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.013+0000 7f6266ffd640 1 --2- 172.21.15.70:0/3414513643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6268102a60 0x7f62680ff670 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f625800d950 tx=0x7f625800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:50.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.013+0000 7f625ffff640 1 -- 172.21.15.70:0/3414513643 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6258017070 con 0x7f6268102a60 2024-09-21T05:47:50.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.013+0000 7f626d50d640 1 -- 172.21.15.70:0/3414513643 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62681a8a00 con 0x7f6268102a60 2024-09-21T05:47:50.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.013+0000 7f625ffff640 1 -- 172.21.15.70:0/3414513643 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f6258009c30 con 0x7f6268102a60 2024-09-21T05:47:50.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.013+0000 7f625ffff640 1 -- 172.21.15.70:0/3414513643 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625800f620 con 0x7f6268102a60 2024-09-21T05:47:50.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.013+0000 7f626d50d640 1 -- 172.21.15.70:0/3414513643 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62681a8f90 con 0x7f6268102a60 2024-09-21T05:47:50.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.014+0000 7f626d50d640 1 -- 172.21.15.70:0/3414513643 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6268102e70 con 0x7f6268102a60 2024-09-21T05:47:50.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.017+0000 7f625ffff640 1 -- 172.21.15.70:0/3414513643 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f62580109a0 con 0x7f6268102a60 2024-09-21T05:47:50.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.017+0000 7f625ffff640 1 --2- 172.21.15.70:0/3414513643 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f62540b6510 0x7f62540b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:50.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.018+0000 7f62667fc640 1 --2- 172.21.15.70:0/3414513643 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f62540b6510 0x7f62540b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:50.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.018+0000 7f625ffff640 1 -- 172.21.15.70:0/3414513643 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f62580e72a0 con 0x7f6268102a60 2024-09-21T05:47:50.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.018+0000 7f62667fc640 1 --2- 172.21.15.70:0/3414513643 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f62540b6510 0x7f62540b8a20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6250005fd0 tx=0x7f6250005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:50.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.021+0000 7f625ffff640 1 -- 172.21.15.70:0/3414513643 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6258009de0 con 0x7f6268102a60 2024-09-21T05:47:50.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.235+0000 7f626d50d640 1 -- 172.21.15.70:0/3414513643 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f626802e640 con 0x7f6268102a60 2024-09-21T05:47:50.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.533+0000 7f625ffff640 1 -- 172.21.15.70:0/3414513643 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7f62580ad7d0 con 0x7f6268102a60 2024-09-21T05:47:50.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.536+0000 7f626d50d640 1 -- 172.21.15.70:0/3414513643 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f62540b6510 msgr2=0x7f62540b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:50.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.536+0000 7f626d50d640 1 --2- 172.21.15.70:0/3414513643 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f62540b6510 0x7f62540b8a20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6250005fd0 tx=0x7f6250005850 comp rx=0 tx=0).stop 2024-09-21T05:47:50.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.536+0000 7f626d50d640 1 -- 172.21.15.70:0/3414513643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6268102a60 msgr2=0x7f62680ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:50.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.536+0000 7f626d50d640 1 --2- 172.21.15.70:0/3414513643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6268102a60 0x7f62680ff670 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f625800d950 tx=0x7f625800de10 comp rx=0 tx=0).stop 2024-09-21T05:47:50.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.536+0000 7f626d50d640 1 -- 172.21.15.70:0/3414513643 shutdown_connections 2024-09-21T05:47:50.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.536+0000 7f626d50d640 1 --2- 172.21.15.70:0/3414513643 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f62540b6510 0x7f62540b8a20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:50.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.536+0000 7f626d50d640 1 --2- 172.21.15.70:0/3414513643 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62681083a0 0x7f62680ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:50.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.536+0000 7f626d50d640 1 --2- 172.21.15.70:0/3414513643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6268108cf0 0x7f62681000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:50.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.536+0000 7f626d50d640 1 --2- 172.21.15.70:0/3414513643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6268102a60 0x7f62680ff670 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:50.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.536+0000 7f626d50d640 1 -- 172.21.15.70:0/3414513643 >> 172.21.15.70:0/3414513643 conn(0x7f6268079730 msgr2=0x7f626806b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:50.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.536+0000 7f626d50d640 1 -- 172.21.15.70:0/3414513643 shutdown_connections 2024-09-21T05:47:50.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:50.536+0000 7f626d50d640 1 -- 172.21.15.70:0/3414513643 wait complete. 2024-09-21T05:47:50.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:50 smithi116 ceph-mon[34332]: mds.? [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] up:active 2024-09-21T05:47:50.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:50 smithi116 ceph-mon[34332]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-21T05:47:50.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:50 smithi116 ceph-mon[34332]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T05:47:50.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:50 smithi116 ceph-mon[34332]: Cluster is now healthy 2024-09-21T05:47:50.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:50 smithi116 ceph-mon[34332]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-21T05:47:50.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:50 smithi116 ceph-mon[34332]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-21T05:47:50.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:50 smithi116 ceph-mon[34332]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-21T05:47:50.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:50 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3414513643' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T05:47:50.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:50 smithi160 ceph-mon[33979]: mds.? [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] up:active 2024-09-21T05:47:50.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:50 smithi160 ceph-mon[33979]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-21T05:47:50.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:50 smithi160 ceph-mon[33979]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T05:47:50.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:50 smithi160 ceph-mon[33979]: Cluster is now healthy 2024-09-21T05:47:50.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:50 smithi160 ceph-mon[33979]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-21T05:47:50.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:50 smithi160 ceph-mon[33979]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-21T05:47:50.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:50 smithi160 ceph-mon[33979]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-21T05:47:50.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:50 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3414513643' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T05:47:50.914 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:50 smithi070 ceph-mon[30981]: mds.? [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] up:active 2024-09-21T05:47:50.914 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:50 smithi070 ceph-mon[30981]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-21T05:47:50.914 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:50 smithi070 ceph-mon[30981]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T05:47:50.914 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:50 smithi070 ceph-mon[30981]: Cluster is now healthy 2024-09-21T05:47:50.914 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:50 smithi070 ceph-mon[30981]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-21T05:47:50.915 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:50 smithi070 ceph-mon[30981]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-21T05:47:50.915 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:50 smithi070 ceph-mon[30981]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-21T05:47:50.915 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:50 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3414513643' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T05:47:51.420 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-09-21T05:47:51.420 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs subvolumegroup create cephfs qa 2024-09-21T05:47:51.672 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:47:51.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:51 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3414513643' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T05:47:51.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:51 smithi070 ceph-mon[30981]: mds.? [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] up:active 2024-09-21T05:47:51.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:51 smithi070 ceph-mon[30981]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-21T05:47:51.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:51 smithi070 ceph-mon[30981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:47:51.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:51 smithi070 ceph-mon[30981]: pgmap v320: 129 pgs: 129 active+clean; 586 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 2.2 KiB/s wr, 6 op/s 2024-09-21T05:47:51.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:51 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3414513643' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T05:47:51.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:51 smithi116 ceph-mon[34332]: mds.? [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] up:active 2024-09-21T05:47:51.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:51 smithi116 ceph-mon[34332]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-21T05:47:51.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:51 smithi116 ceph-mon[34332]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:47:51.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:51 smithi116 ceph-mon[34332]: pgmap v320: 129 pgs: 129 active+clean; 586 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 2.2 KiB/s wr, 6 op/s 2024-09-21T05:47:51.805 INFO:journalctl@ceph.mds.b.smithi116.stdout:Sep 21 05:47:51 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-b[62172]: 2024-09-21T05:47:51.634+0000 7f0c3ec80640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-21T05:47:51.805 INFO:journalctl@ceph.mds.b.smithi116.stdout:Sep 21 05:47:51 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-b[62172]: 2024-09-21T05:47:51.634+0000 7f0c3ec80640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-21T05:47:51.805 INFO:journalctl@ceph.mds.b.smithi116.stdout:Sep 21 05:47:51 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-b[62172]: 2024-09-21T05:47:51.634+0000 7f0c3ec80640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-09-21T05:47:51.805 INFO:journalctl@ceph.mds.b.smithi116.stdout:Sep 21 05:47:51 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-b[62172]: 2024-09-21T05:47:51.634+0000 7f0c3ec80640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-21T05:47:51.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:51 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3414513643' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T05:47:51.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:51 smithi160 ceph-mon[33979]: mds.? [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] up:active 2024-09-21T05:47:51.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:51 smithi160 ceph-mon[33979]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-21T05:47:51.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:51 smithi160 ceph-mon[33979]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:47:51.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:51 smithi160 ceph-mon[33979]: pgmap v320: 129 pgs: 129 active+clean; 586 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 2.2 KiB/s wr, 6 op/s 2024-09-21T05:47:52.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.126+0000 7fdb56adf640 1 -- 172.21.15.70:0/537407543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb501083a0 msgr2=0x7fdb501087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:52.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.126+0000 7fdb56adf640 1 --2- 172.21.15.70:0/537407543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb501083a0 0x7fdb501087b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c009860 tx=0x7fdb3c02a340 comp rx=0 tx=0).stop 2024-09-21T05:47:52.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.126+0000 7fdb56adf640 1 -- 172.21.15.70:0/537407543 shutdown_connections 2024-09-21T05:47:52.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.126+0000 7fdb56adf640 1 --2- 172.21.15.70:0/537407543 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb50108cf0 0x7fdb5010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:52.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.126+0000 7fdb56adf640 1 --2- 172.21.15.70:0/537407543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb501083a0 0x7fdb501087b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:52.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.126+0000 7fdb56adf640 1 --2- 172.21.15.70:0/537407543 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb50102a60 0x7fdb50102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:52.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.126+0000 7fdb56adf640 1 -- 172.21.15.70:0/537407543 >> 172.21.15.70:0/537407543 conn(0x7fdb50079730 msgr2=0x7fdb50079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:52.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.126+0000 7fdb56adf640 1 -- 172.21.15.70:0/537407543 shutdown_connections 2024-09-21T05:47:52.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.126+0000 7fdb56adf640 1 -- 172.21.15.70:0/537407543 wait complete. 2024-09-21T05:47:52.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.127+0000 7fdb56adf640 1 Processor -- start 2024-09-21T05:47:52.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.127+0000 7fdb56adf640 1 -- start start 2024-09-21T05:47:52.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.127+0000 7fdb56adf640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb50102a60 0x7fdb50199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:52.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.127+0000 7fdb56adf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb501083a0 0x7fdb50199a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:52.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.127+0000 7fdb56adf640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb50108cf0 0x7fdb5019ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:52.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.127+0000 7fdb56adf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdb50112930 con 0x7fdb501083a0 2024-09-21T05:47:52.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.127+0000 7fdb56adf640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fdb501127b0 con 0x7fdb50102a60 2024-09-21T05:47:52.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.127+0000 7fdb56adf640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fdb50112ab0 con 0x7fdb50108cf0 2024-09-21T05:47:52.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.127+0000 7fdb4ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb501083a0 0x7fdb50199a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:52.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.127+0000 7fdb4ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb501083a0 0x7fdb50199a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46448/0 (socket says 172.21.15.70:46448) 2024-09-21T05:47:52.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.127+0000 7fdb4ffff640 1 -- 172.21.15.70:0/2410556739 learned_addr learned my addr 172.21.15.70:0/2410556739 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:47:52.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.127+0000 7fdb5487b640 1 --2- 172.21.15.70:0/2410556739 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb50102a60 0x7fdb50199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:52.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.127+0000 7fdb5507c640 1 --2- 172.21.15.70:0/2410556739 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb50108cf0 0x7fdb5019ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:52.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.127+0000 7fdb4ffff640 1 -- 172.21.15.70:0/2410556739 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb50108cf0 msgr2=0x7fdb5019ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:52.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.127+0000 7fdb4ffff640 1 --2- 172.21.15.70:0/2410556739 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb50108cf0 0x7fdb5019ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:52.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.127+0000 7fdb4ffff640 1 -- 172.21.15.70:0/2410556739 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb50102a60 msgr2=0x7fdb50199480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:52.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.127+0000 7fdb4ffff640 1 --2- 172.21.15.70:0/2410556739 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb50102a60 0x7fdb50199480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:52.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.127+0000 7fdb4ffff640 1 -- 172.21.15.70:0/2410556739 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5019f3f0 con 0x7fdb501083a0 2024-09-21T05:47:52.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.127+0000 7fdb5487b640 1 --2- 172.21.15.70:0/2410556739 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb50102a60 0x7fdb50199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:47:52.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.128+0000 7fdb4ffff640 1 --2- 172.21.15.70:0/2410556739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb501083a0 0x7fdb50199a20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c005940 tx=0x7fdb3c032780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:52.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.128+0000 7fdb4dffb640 1 -- 172.21.15.70:0/2410556739 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c03f020 con 0x7fdb501083a0 2024-09-21T05:47:52.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.128+0000 7fdb4dffb640 1 -- 172.21.15.70:0/2410556739 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fdb3c033df0 con 0x7fdb501083a0 2024-09-21T05:47:52.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.128+0000 7fdb4dffb640 1 -- 172.21.15.70:0/2410556739 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c037040 con 0x7fdb501083a0 2024-09-21T05:47:52.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.128+0000 7fdb56adf640 1 -- 172.21.15.70:0/2410556739 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb5019f680 con 0x7fdb501083a0 2024-09-21T05:47:52.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.128+0000 7fdb56adf640 1 -- 172.21.15.70:0/2410556739 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb501a5e40 con 0x7fdb501083a0 2024-09-21T05:47:52.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.129+0000 7fdb56adf640 1 -- 172.21.15.70:0/2410556739 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb50103ce0 con 0x7fdb501083a0 2024-09-21T05:47:52.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.131+0000 7fdb4dffb640 1 -- 172.21.15.70:0/2410556739 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fdb3c042020 con 0x7fdb501083a0 2024-09-21T05:47:52.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.131+0000 7fdb4dffb640 1 --2- 172.21.15.70:0/2410556739 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdb400b6590 0x7fdb400b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:52.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.131+0000 7fdb5487b640 1 --2- 172.21.15.70:0/2410556739 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdb400b6590 0x7fdb400b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:52.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.131+0000 7fdb4dffb640 1 -- 172.21.15.70:0/2410556739 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7fdb3c107380 con 0x7fdb501083a0 2024-09-21T05:47:52.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.132+0000 7fdb5487b640 1 --2- 172.21.15.70:0/2410556739 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdb400b6590 0x7fdb400b8aa0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdb44009c20 tx=0x7fdb44005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:52.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.136+0000 7fdb4dffb640 1 -- 172.21.15.70:0/2410556739 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdb3c049020 con 0x7fdb501083a0 2024-09-21T05:47:52.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.339+0000 7fdb56adf640 1 -- 172.21.15.70:0/2410556739 --> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fdb50063800 con 0x7fdb400b6590 2024-09-21T05:47:52.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.364+0000 7fdb4dffb640 1 -- 172.21.15.70:0/2410556739 <== mgr.14150 v2:172.21.15.70:6800/1366013939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fdb50063800 con 0x7fdb400b6590 2024-09-21T05:47:52.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.366+0000 7fdb56adf640 1 -- 172.21.15.70:0/2410556739 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdb400b6590 msgr2=0x7fdb400b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:52.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.366+0000 7fdb56adf640 1 --2- 172.21.15.70:0/2410556739 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdb400b6590 0x7fdb400b8aa0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdb44009c20 tx=0x7fdb44005f90 comp rx=0 tx=0).stop 2024-09-21T05:47:52.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.366+0000 7fdb56adf640 1 -- 172.21.15.70:0/2410556739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb501083a0 msgr2=0x7fdb50199a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:52.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.366+0000 7fdb56adf640 1 --2- 172.21.15.70:0/2410556739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb501083a0 0x7fdb50199a20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c005940 tx=0x7fdb3c032780 comp rx=0 tx=0).stop 2024-09-21T05:47:52.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.367+0000 7fdb56adf640 1 -- 172.21.15.70:0/2410556739 shutdown_connections 2024-09-21T05:47:52.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.367+0000 7fdb56adf640 1 --2- 172.21.15.70:0/2410556739 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdb400b6590 0x7fdb400b8aa0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:52.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.367+0000 7fdb56adf640 1 --2- 172.21.15.70:0/2410556739 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb50108cf0 0x7fdb5019ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:52.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.367+0000 7fdb56adf640 1 --2- 172.21.15.70:0/2410556739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb501083a0 0x7fdb50199a20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:52.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.367+0000 7fdb56adf640 1 --2- 172.21.15.70:0/2410556739 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb50102a60 0x7fdb50199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:52.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.367+0000 7fdb56adf640 1 -- 172.21.15.70:0/2410556739 >> 172.21.15.70:0/2410556739 conn(0x7fdb50079730 msgr2=0x7fdb501044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:52.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.367+0000 7fdb56adf640 1 -- 172.21.15.70:0/2410556739 shutdown_connections 2024-09-21T05:47:52.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:52.367+0000 7fdb56adf640 1 -- 172.21.15.70:0/2410556739 wait complete. 2024-09-21T05:47:52.379 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:47:52 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T05:47:52.344+0000 7f996f119640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T05:47:52.379 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:47:52 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T05:47:52.344+0000 7f996f119640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T05:47:52.379 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:47:52 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T05:47:52.344+0000 7f996f119640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T05:47:52.379 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:47:52 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T05:47:52.344+0000 7f996f119640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T05:47:52.379 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:47:52 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T05:47:52.344+0000 7f996f119640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T05:47:52.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:52 smithi070 ceph-mon[30981]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:52.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:52 smithi116 ceph-mon[34332]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:52.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:52 smithi160 ceph-mon[33979]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:53.101 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-21T05:47:53.347 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:47:53.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:53 smithi070 ceph-mon[30981]: pgmap v321: 129 pgs: 129 active+clean; 587 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 3.5 KiB/s wr, 15 op/s 2024-09-21T05:47:53.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:53 smithi116 ceph-mon[34332]: pgmap v321: 129 pgs: 129 active+clean; 587 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 3.5 KiB/s wr, 15 op/s 2024-09-21T05:47:53.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.802+0000 7f1aed1ae640 1 -- 172.21.15.70:0/3044613050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ae8103b60 msgr2=0x7f1ae8103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:53.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.802+0000 7f1aed1ae640 1 --2- 172.21.15.70:0/3044613050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ae8103b60 0x7f1ae8103f70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8009900 tx=0x7f1ad802a410 comp rx=0 tx=0).stop 2024-09-21T05:47:53.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.802+0000 7f1aed1ae640 1 -- 172.21.15.70:0/3044613050 shutdown_connections 2024-09-21T05:47:53.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.802+0000 7f1aed1ae640 1 --2- 172.21.15.70:0/3044613050 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ae8109df0 0x7f1ae8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:53.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.802+0000 7f1aed1ae640 1 --2- 172.21.15.70:0/3044613050 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1ae81094a0 0x7f1ae81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:53.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.802+0000 7f1aed1ae640 1 --2- 172.21.15.70:0/3044613050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ae8103b60 0x7f1ae8103f70 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:53.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.802+0000 7f1aed1ae640 1 -- 172.21.15.70:0/3044613050 >> 172.21.15.70:0/3044613050 conn(0x7f1ae807b850 msgr2=0x7f1ae807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:53.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.802+0000 7f1aed1ae640 1 -- 172.21.15.70:0/3044613050 shutdown_connections 2024-09-21T05:47:53.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.802+0000 7f1aed1ae640 1 -- 172.21.15.70:0/3044613050 wait complete. 2024-09-21T05:47:53.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.803+0000 7f1aed1ae640 1 Processor -- start 2024-09-21T05:47:53.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.803+0000 7f1aed1ae640 1 -- start start 2024-09-21T05:47:53.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.803+0000 7f1aed1ae640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ae8103b60 0x7f1ae819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:53.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.803+0000 7f1aed1ae640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ae81094a0 0x7f1ae819aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:53.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.803+0000 7f1aed1ae640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1ae8109df0 0x7f1ae819fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:53.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.803+0000 7f1aed1ae640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae8113aa0 con 0x7f1ae8103b60 2024-09-21T05:47:53.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.803+0000 7f1aed1ae640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae8113920 con 0x7f1ae8109df0 2024-09-21T05:47:53.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.803+0000 7f1aed1ae640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae8113c20 con 0x7f1ae81094a0 2024-09-21T05:47:53.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.803+0000 7f1ae6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ae8103b60 0x7f1ae819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:53.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.804+0000 7f1ae6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ae8103b60 0x7f1ae819a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46484/0 (socket says 172.21.15.70:46484) 2024-09-21T05:47:53.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.804+0000 7f1ae6d9d640 1 -- 172.21.15.70:0/725069611 learned_addr learned my addr 172.21.15.70:0/725069611 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:47:53.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.804+0000 7f1ae759e640 1 --2- 172.21.15.70:0/725069611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1ae8109df0 0x7f1ae819fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:53.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.804+0000 7f1ae659c640 1 --2- 172.21.15.70:0/725069611 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ae81094a0 0x7f1ae819aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:53.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.804+0000 7f1ae6d9d640 1 -- 172.21.15.70:0/725069611 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ae81094a0 msgr2=0x7f1ae819aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:53.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.804+0000 7f1ae6d9d640 1 --2- 172.21.15.70:0/725069611 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ae81094a0 0x7f1ae819aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:53.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.804+0000 7f1ae6d9d640 1 -- 172.21.15.70:0/725069611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1ae8109df0 msgr2=0x7f1ae819fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:53.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.804+0000 7f1ae6d9d640 1 --2- 172.21.15.70:0/725069611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1ae8109df0 0x7f1ae819fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:53.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.804+0000 7f1ae6d9d640 1 -- 172.21.15.70:0/725069611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ae81a0420 con 0x7f1ae8103b60 2024-09-21T05:47:53.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.804+0000 7f1ae6d9d640 1 --2- 172.21.15.70:0/725069611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ae8103b60 0x7f1ae819a4b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8005940 tx=0x7f1ad80040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:53.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.804+0000 7f1acffff640 1 -- 172.21.15.70:0/725069611 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad803f030 con 0x7f1ae8103b60 2024-09-21T05:47:53.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.804+0000 7f1aed1ae640 1 -- 172.21.15.70:0/725069611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ae81a06b0 con 0x7f1ae8103b60 2024-09-21T05:47:53.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.804+0000 7f1acffff640 1 -- 172.21.15.70:0/725069611 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f1ad80044c0 con 0x7f1ae8103b60 2024-09-21T05:47:53.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.804+0000 7f1acffff640 1 -- 172.21.15.70:0/725069611 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8035070 con 0x7f1ae8103b60 2024-09-21T05:47:53.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.804+0000 7f1aed1ae640 1 -- 172.21.15.70:0/725069611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ae81a6e70 con 0x7f1ae8103b60 2024-09-21T05:47:53.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.805+0000 7f1aed1ae640 1 -- 172.21.15.70:0/725069611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ae8104de0 con 0x7f1ae8103b60 2024-09-21T05:47:53.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.807+0000 7f1acffff640 1 -- 172.21.15.70:0/725069611 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f1ad8042030 con 0x7f1ae8103b60 2024-09-21T05:47:53.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.808+0000 7f1acffff640 1 --2- 172.21.15.70:0/725069611 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1ad00b65a0 0x7f1ad00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:53.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.808+0000 7f1ae659c640 1 --2- 172.21.15.70:0/725069611 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1ad00b65a0 0x7f1ad00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:53.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.808+0000 7f1acffff640 1 -- 172.21.15.70:0/725069611 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f1ad8107e70 con 0x7f1ae8103b60 2024-09-21T05:47:53.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.808+0000 7f1ae659c640 1 --2- 172.21.15.70:0/725069611 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1ad00b65a0 0x7f1ad00b8ab0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8109010 tx=0x7f1adc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:53.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:53.811+0000 7f1acffff640 1 -- 172.21.15.70:0/725069611 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1ad80ce240 con 0x7f1ae8103b60 2024-09-21T05:47:53.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:53 smithi160 ceph-mon[33979]: pgmap v321: 129 pgs: 129 active+clean; 587 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 3.5 KiB/s wr, 15 op/s 2024-09-21T05:47:54.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:54.015+0000 7f1aed1ae640 1 -- 172.21.15.70:0/725069611 --> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f1ae8063800 con 0x7f1ad00b65a0 2024-09-21T05:47:54.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:54.044+0000 7f1acffff640 1 -- 172.21.15.70:0/725069611 <== mgr.14150 v2:172.21.15.70:6800/1366013939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1ae8063800 con 0x7f1ad00b65a0 2024-09-21T05:47:54.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:54.047+0000 7f1aed1ae640 1 -- 172.21.15.70:0/725069611 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1ad00b65a0 msgr2=0x7f1ad00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:54.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:54.047+0000 7f1aed1ae640 1 --2- 172.21.15.70:0/725069611 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1ad00b65a0 0x7f1ad00b8ab0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8109010 tx=0x7f1adc005f90 comp rx=0 tx=0).stop 2024-09-21T05:47:54.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:54.047+0000 7f1aed1ae640 1 -- 172.21.15.70:0/725069611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ae8103b60 msgr2=0x7f1ae819a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:54.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:54.047+0000 7f1aed1ae640 1 --2- 172.21.15.70:0/725069611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ae8103b60 0x7f1ae819a4b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8005940 tx=0x7f1ad80040c0 comp rx=0 tx=0).stop 2024-09-21T05:47:54.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:54.047+0000 7f1aed1ae640 1 -- 172.21.15.70:0/725069611 shutdown_connections 2024-09-21T05:47:54.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:54.047+0000 7f1aed1ae640 1 --2- 172.21.15.70:0/725069611 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1ad00b65a0 0x7f1ad00b8ab0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:54.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:54.047+0000 7f1aed1ae640 1 --2- 172.21.15.70:0/725069611 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ae81094a0 0x7f1ae819aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:54.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:54.047+0000 7f1aed1ae640 1 --2- 172.21.15.70:0/725069611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1ae8109df0 0x7f1ae819fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:54.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:54.047+0000 7f1aed1ae640 1 --2- 172.21.15.70:0/725069611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ae8103b60 0x7f1ae819a4b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:54.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:54.047+0000 7f1aed1ae640 1 -- 172.21.15.70:0/725069611 >> 172.21.15.70:0/725069611 conn(0x7f1ae807b850 msgr2=0x7f1ae8107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:54.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:54.047+0000 7f1aed1ae640 1 -- 172.21.15.70:0/725069611 shutdown_connections 2024-09-21T05:47:54.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:54.047+0000 7f1aed1ae640 1 -- 172.21.15.70:0/725069611 wait complete. 2024-09-21T05:47:54.706 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:54 smithi070 ceph-mon[30981]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-21T05:47:54.706 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:54 smithi070 ceph-mon[30981]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:54.735 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-21T05:47:54.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:54 smithi116 ceph-mon[34332]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-21T05:47:54.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:54 smithi116 ceph-mon[34332]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:54.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:54 smithi160 ceph-mon[33979]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-21T05:47:54.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:54 smithi160 ceph-mon[33979]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:54.981 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:47:55.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.459+0000 7fbe852cf640 1 -- 172.21.15.70:0/1966555957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe80105300 msgr2=0x7fbe8010d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:55.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.459+0000 7fbe852cf640 1 --2- 172.21.15.70:0/1966555957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe80105300 0x7fbe8010d850 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbe68009900 tx=0x7fbe6802a410 comp rx=0 tx=0).stop 2024-09-21T05:47:55.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.459+0000 7fbe852cf640 1 -- 172.21.15.70:0/1966555957 shutdown_connections 2024-09-21T05:47:55.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.459+0000 7fbe852cf640 1 --2- 172.21.15.70:0/1966555957 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe8010de10 0x7fbe80110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:55.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.459+0000 7fbe852cf640 1 --2- 172.21.15.70:0/1966555957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe80105300 0x7fbe8010d850 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:55.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.459+0000 7fbe852cf640 1 --2- 172.21.15.70:0/1966555957 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe801049b0 0x7fbe80104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:55.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.459+0000 7fbe852cf640 1 -- 172.21.15.70:0/1966555957 >> 172.21.15.70:0/1966555957 conn(0x7fbe80079730 msgr2=0x7fbe80079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:55.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.459+0000 7fbe852cf640 1 -- 172.21.15.70:0/1966555957 shutdown_connections 2024-09-21T05:47:55.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.459+0000 7fbe852cf640 1 -- 172.21.15.70:0/1966555957 wait complete. 2024-09-21T05:47:55.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.459+0000 7fbe852cf640 1 Processor -- start 2024-09-21T05:47:55.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.460+0000 7fbe852cf640 1 -- start start 2024-09-21T05:47:55.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.460+0000 7fbe852cf640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe801049b0 0x7fbe8019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:55.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.460+0000 7fbe852cf640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe80105300 0x7fbe8019aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:55.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.460+0000 7fbe852cf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe8010de10 0x7fbe8019fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:55.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.460+0000 7fbe852cf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbe80113a40 con 0x7fbe8010de10 2024-09-21T05:47:55.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.460+0000 7fbe852cf640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fbe801138c0 con 0x7fbe80105300 2024-09-21T05:47:55.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.460+0000 7fbe852cf640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbe80113bc0 con 0x7fbe801049b0 2024-09-21T05:47:55.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.460+0000 7fbe7f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe8010de10 0x7fbe8019fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:55.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.460+0000 7fbe7f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe8010de10 0x7fbe8019fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46504/0 (socket says 172.21.15.70:46504) 2024-09-21T05:47:55.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.460+0000 7fbe7f7fe640 1 -- 172.21.15.70:0/2131025910 learned_addr learned my addr 172.21.15.70:0/2131025910 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:47:55.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.460+0000 7fbe7e7fc640 1 --2- 172.21.15.70:0/2131025910 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe80105300 0x7fbe8019aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:55.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.460+0000 7fbe7effd640 1 --2- 172.21.15.70:0/2131025910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe801049b0 0x7fbe8019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:55.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.460+0000 7fbe7f7fe640 1 -- 172.21.15.70:0/2131025910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe801049b0 msgr2=0x7fbe8019a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:55.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.460+0000 7fbe7f7fe640 1 --2- 172.21.15.70:0/2131025910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe801049b0 0x7fbe8019a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:55.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.460+0000 7fbe7f7fe640 1 -- 172.21.15.70:0/2131025910 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe80105300 msgr2=0x7fbe8019aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:55.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.460+0000 7fbe7f7fe640 1 --2- 172.21.15.70:0/2131025910 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe80105300 0x7fbe8019aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:55.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.460+0000 7fbe7f7fe640 1 -- 172.21.15.70:0/2131025910 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe801a0420 con 0x7fbe8010de10 2024-09-21T05:47:55.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.460+0000 7fbe7effd640 1 --2- 172.21.15.70:0/2131025910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe801049b0 0x7fbe8019a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:47:55.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.460+0000 7fbe7f7fe640 1 --2- 172.21.15.70:0/2131025910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe8010de10 0x7fbe8019fcf0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800c970 tx=0x7fbe7800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:55.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.461+0000 7fbe77fff640 1 -- 172.21.15.70:0/2131025910 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe78007bb0 con 0x7fbe8010de10 2024-09-21T05:47:55.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.461+0000 7fbe77fff640 1 -- 172.21.15.70:0/2131025910 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fbe78007d50 con 0x7fbe8010de10 2024-09-21T05:47:55.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.461+0000 7fbe852cf640 1 -- 172.21.15.70:0/2131025910 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe801a0710 con 0x7fbe8010de10 2024-09-21T05:47:55.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.461+0000 7fbe77fff640 1 -- 172.21.15.70:0/2131025910 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe78004e10 con 0x7fbe8010de10 2024-09-21T05:47:55.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.461+0000 7fbe852cf640 1 -- 172.21.15.70:0/2131025910 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe801a6e70 con 0x7fbe8010de10 2024-09-21T05:47:55.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.462+0000 7fbe852cf640 1 -- 172.21.15.70:0/2131025910 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe80104dc0 con 0x7fbe8010de10 2024-09-21T05:47:55.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.463+0000 7fbe77fff640 1 -- 172.21.15.70:0/2131025910 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fbe78004fb0 con 0x7fbe8010de10 2024-09-21T05:47:55.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.464+0000 7fbe77fff640 1 --2- 172.21.15.70:0/2131025910 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fbe6c0b65a0 0x7fbe6c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:55.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.464+0000 7fbe7effd640 1 --2- 172.21.15.70:0/2131025910 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fbe6c0b65a0 0x7fbe6c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:55.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.464+0000 7fbe77fff640 1 -- 172.21.15.70:0/2131025910 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7fbe780e78d0 con 0x7fbe8010de10 2024-09-21T05:47:55.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.464+0000 7fbe7effd640 1 --2- 172.21.15.70:0/2131025910 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fbe6c0b65a0 0x7fbe6c0b8ab0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbe8006bc60 tx=0x7fbe70009400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:55.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.467+0000 7fbe77fff640 1 -- 172.21.15.70:0/2131025910 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbe78014030 con 0x7fbe8010de10 2024-09-21T05:47:55.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.675+0000 7fbe852cf640 1 -- 172.21.15.70:0/2131025910 --> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fbe80063800 con 0x7fbe6c0b65a0 2024-09-21T05:47:55.677 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:55 smithi070 ceph-mon[30981]: pgmap v322: 129 pgs: 129 active+clean; 587 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 4.1 KiB/s wr, 18 op/s 2024-09-21T05:47:55.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.681+0000 7fbe77fff640 1 -- 172.21.15.70:0/2131025910 <== mgr.14150 v2:172.21.15.70:6800/1366013939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fbe80063800 con 0x7fbe6c0b65a0 2024-09-21T05:47:55.683 INFO:teuthology.orchestra.run.smithi070.stdout:/volumes/qa/sv_0/0289a4fa-d155-4080-a593-4fa6d2bff74b 2024-09-21T05:47:55.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.683+0000 7fbe852cf640 1 -- 172.21.15.70:0/2131025910 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fbe6c0b65a0 msgr2=0x7fbe6c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:55.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.683+0000 7fbe852cf640 1 --2- 172.21.15.70:0/2131025910 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fbe6c0b65a0 0x7fbe6c0b8ab0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbe8006bc60 tx=0x7fbe70009400 comp rx=0 tx=0).stop 2024-09-21T05:47:55.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.683+0000 7fbe852cf640 1 -- 172.21.15.70:0/2131025910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe8010de10 msgr2=0x7fbe8019fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:55.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.683+0000 7fbe852cf640 1 --2- 172.21.15.70:0/2131025910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe8010de10 0x7fbe8019fcf0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800c970 tx=0x7fbe7800ce30 comp rx=0 tx=0).stop 2024-09-21T05:47:55.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.683+0000 7fbe852cf640 1 -- 172.21.15.70:0/2131025910 shutdown_connections 2024-09-21T05:47:55.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.683+0000 7fbe852cf640 1 --2- 172.21.15.70:0/2131025910 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fbe6c0b65a0 0x7fbe6c0b8ab0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:55.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.683+0000 7fbe852cf640 1 --2- 172.21.15.70:0/2131025910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe8010de10 0x7fbe8019fcf0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:55.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.683+0000 7fbe852cf640 1 --2- 172.21.15.70:0/2131025910 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe80105300 0x7fbe8019aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:55.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.683+0000 7fbe852cf640 1 --2- 172.21.15.70:0/2131025910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe801049b0 0x7fbe8019a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:55.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.683+0000 7fbe852cf640 1 -- 172.21.15.70:0/2131025910 >> 172.21.15.70:0/2131025910 conn(0x7fbe80079730 msgr2=0x7fbe801008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:55.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.683+0000 7fbe852cf640 1 -- 172.21.15.70:0/2131025910 shutdown_connections 2024-09-21T05:47:55.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:55.683+0000 7fbe852cf640 1 -- 172.21.15.70:0/2131025910 wait complete. 2024-09-21T05:47:55.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:55 smithi160 ceph-mon[33979]: pgmap v322: 129 pgs: 129 active+clean; 587 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 4.1 KiB/s wr, 18 op/s 2024-09-21T05:47:56.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:55 smithi116 ceph-mon[34332]: pgmap v322: 129 pgs: 129 active+clean; 587 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 4.1 KiB/s wr, 18 op/s 2024-09-21T05:47:56.365 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-21T05:47:56.611 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:47:56.732 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:56 smithi070 ceph-mon[30981]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:56.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:56 smithi160 ceph-mon[33979]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:57.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:56 smithi116 ceph-mon[34332]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:57.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.121+0000 7f2716989640 1 -- 172.21.15.70:0/405923897 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2710103bc0 msgr2=0x7f2710103fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:57.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.121+0000 7f2716989640 1 --2- 172.21.15.70:0/405923897 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2710103bc0 0x7f2710103fd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2700009900 tx=0x7f270002a410 comp rx=0 tx=0).stop 2024-09-21T05:47:57.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.121+0000 7f2716989640 1 -- 172.21.15.70:0/405923897 shutdown_connections 2024-09-21T05:47:57.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.121+0000 7f2716989640 1 --2- 172.21.15.70:0/405923897 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27101094b0 0x7f27101098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:57.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.121+0000 7f2716989640 1 --2- 172.21.15.70:0/405923897 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2710109e00 0x7f2710110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:57.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.121+0000 7f2716989640 1 --2- 172.21.15.70:0/405923897 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2710103bc0 0x7f2710103fd0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:57.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.121+0000 7f2716989640 1 -- 172.21.15.70:0/405923897 >> 172.21.15.70:0/405923897 conn(0x7f271007b910 msgr2=0x7f271007bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:57.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.121+0000 7f2716989640 1 -- 172.21.15.70:0/405923897 shutdown_connections 2024-09-21T05:47:57.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.121+0000 7f2716989640 1 -- 172.21.15.70:0/405923897 wait complete. 2024-09-21T05:47:57.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.122+0000 7f2716989640 1 Processor -- start 2024-09-21T05:47:57.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.122+0000 7f2716989640 1 -- start start 2024-09-21T05:47:57.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.122+0000 7f2716989640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2710103bc0 0x7f271019a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:57.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.122+0000 7f2716989640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27101094b0 0x7f271019aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:57.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.122+0000 7f2716989640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2710109e00 0x7f271019fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:57.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.122+0000 7f2716989640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2710113af0 con 0x7f2710109e00 2024-09-21T05:47:57.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.122+0000 7f2716989640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2710113970 con 0x7f2710103bc0 2024-09-21T05:47:57.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.122+0000 7f2716989640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2710113c70 con 0x7f27101094b0 2024-09-21T05:47:57.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.122+0000 7f2714f26640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2710109e00 0x7f271019fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:57.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.122+0000 7f2714f26640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2710109e00 0x7f271019fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46516/0 (socket says 172.21.15.70:46516) 2024-09-21T05:47:57.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.122+0000 7f2714f26640 1 -- 172.21.15.70:0/3008353958 learned_addr learned my addr 172.21.15.70:0/3008353958 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:47:57.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.122+0000 7f270ffff640 1 --2- 172.21.15.70:0/3008353958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2710103bc0 0x7f271019a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:57.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.122+0000 7f2707fff640 1 --2- 172.21.15.70:0/3008353958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27101094b0 0x7f271019aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:57.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.122+0000 7f2714f26640 1 -- 172.21.15.70:0/3008353958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27101094b0 msgr2=0x7f271019aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:57.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.122+0000 7f2714f26640 1 --2- 172.21.15.70:0/3008353958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27101094b0 0x7f271019aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:57.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.122+0000 7f2714f26640 1 -- 172.21.15.70:0/3008353958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2710103bc0 msgr2=0x7f271019a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:57.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.122+0000 7f2714f26640 1 --2- 172.21.15.70:0/3008353958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2710103bc0 0x7f271019a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:57.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.122+0000 7f2714f26640 1 -- 172.21.15.70:0/3008353958 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27101a0490 con 0x7f2710109e00 2024-09-21T05:47:57.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.123+0000 7f270ffff640 1 --2- 172.21.15.70:0/3008353958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2710103bc0 0x7f271019a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:47:57.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.123+0000 7f2707fff640 1 --2- 172.21.15.70:0/3008353958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27101094b0 0x7f271019aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:47:57.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.123+0000 7f2714f26640 1 --2- 172.21.15.70:0/3008353958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2710109e00 0x7f271019fd60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f270800cad0 tx=0x7f270800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:57.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.123+0000 7f270dffb640 1 -- 172.21.15.70:0/3008353958 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f270800ae20 con 0x7f2710109e00 2024-09-21T05:47:57.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.123+0000 7f270dffb640 1 -- 172.21.15.70:0/3008353958 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f2708005020 con 0x7f2710109e00 2024-09-21T05:47:57.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.123+0000 7f2716989640 1 -- 172.21.15.70:0/3008353958 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27101a0780 con 0x7f2710109e00 2024-09-21T05:47:57.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.123+0000 7f270dffb640 1 -- 172.21.15.70:0/3008353958 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f270800f6b0 con 0x7f2710109e00 2024-09-21T05:47:57.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.123+0000 7f2716989640 1 -- 172.21.15.70:0/3008353958 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27101a6ee0 con 0x7f2710109e00 2024-09-21T05:47:57.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.124+0000 7f2716989640 1 -- 172.21.15.70:0/3008353958 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2710103fd0 con 0x7f2710109e00 2024-09-21T05:47:57.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.125+0000 7f270dffb640 1 -- 172.21.15.70:0/3008353958 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f2708005580 con 0x7f2710109e00 2024-09-21T05:47:57.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.126+0000 7f270dffb640 1 --2- 172.21.15.70:0/3008353958 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f26fc0b6620 0x7f26fc0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:57.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.126+0000 7f270ffff640 1 --2- 172.21.15.70:0/3008353958 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f26fc0b6620 0x7f26fc0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:57.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.126+0000 7f270dffb640 1 -- 172.21.15.70:0/3008353958 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f27080e7cb0 con 0x7f2710109e00 2024-09-21T05:47:57.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.127+0000 7f270ffff640 1 --2- 172.21.15.70:0/3008353958 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f26fc0b6620 0x7f26fc0b8b30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2700005d90 tx=0x7f2700005df0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:57.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.129+0000 7f270dffb640 1 -- 172.21.15.70:0/3008353958 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2708014030 con 0x7f2710109e00 2024-09-21T05:47:57.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.332+0000 7f2716989640 1 -- 172.21.15.70:0/3008353958 --> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f2710063800 con 0x7f26fc0b6620 2024-09-21T05:47:57.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.361+0000 7f270dffb640 1 -- 172.21.15.70:0/3008353958 <== mgr.14150 v2:172.21.15.70:6800/1366013939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2710063800 con 0x7f26fc0b6620 2024-09-21T05:47:57.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.363+0000 7f2716989640 1 -- 172.21.15.70:0/3008353958 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f26fc0b6620 msgr2=0x7f26fc0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:57.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.363+0000 7f2716989640 1 --2- 172.21.15.70:0/3008353958 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f26fc0b6620 0x7f26fc0b8b30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2700005d90 tx=0x7f2700005df0 comp rx=0 tx=0).stop 2024-09-21T05:47:57.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.363+0000 7f2716989640 1 -- 172.21.15.70:0/3008353958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2710109e00 msgr2=0x7f271019fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:57.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.363+0000 7f2716989640 1 --2- 172.21.15.70:0/3008353958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2710109e00 0x7f271019fd60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f270800cad0 tx=0x7f270800cf90 comp rx=0 tx=0).stop 2024-09-21T05:47:57.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.363+0000 7f2716989640 1 -- 172.21.15.70:0/3008353958 shutdown_connections 2024-09-21T05:47:57.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.363+0000 7f2716989640 1 --2- 172.21.15.70:0/3008353958 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f26fc0b6620 0x7f26fc0b8b30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:57.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.363+0000 7f2716989640 1 --2- 172.21.15.70:0/3008353958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27101094b0 0x7f271019aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:57.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.363+0000 7f2716989640 1 --2- 172.21.15.70:0/3008353958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2710109e00 0x7f271019fd60 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:57.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.363+0000 7f2716989640 1 --2- 172.21.15.70:0/3008353958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2710103bc0 0x7f271019a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:57.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.363+0000 7f2716989640 1 -- 172.21.15.70:0/3008353958 >> 172.21.15.70:0/3008353958 conn(0x7f271007b910 msgr2=0x7f27101075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:57.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.363+0000 7f2716989640 1 -- 172.21.15.70:0/3008353958 shutdown_connections 2024-09-21T05:47:57.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:57.363+0000 7f2716989640 1 -- 172.21.15.70:0/3008353958 wait complete. 2024-09-21T05:47:57.740 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:57 smithi070 ceph-mon[30981]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:57.741 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:57 smithi070 ceph-mon[30981]: pgmap v323: 129 pgs: 129 active+clean; 614 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.7 KiB/s wr, 21 op/s 2024-09-21T05:47:57.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:57 smithi160 ceph-mon[33979]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:57.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:57 smithi160 ceph-mon[33979]: pgmap v323: 129 pgs: 129 active+clean; 614 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.7 KiB/s wr, 21 op/s 2024-09-21T05:47:58.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:57 smithi116 ceph-mon[34332]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:58.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:57 smithi116 ceph-mon[34332]: pgmap v323: 129 pgs: 129 active+clean; 614 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.7 KiB/s wr, 21 op/s 2024-09-21T05:47:58.065 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-21T05:47:58.460 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:47:58.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.908+0000 7fb693285640 1 -- 172.21.15.70:0/99138551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb68c1094c0 msgr2=0x7fb68c1098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:58.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.908+0000 7fb693285640 1 --2- 172.21.15.70:0/99138551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb68c1094c0 0x7fb68c1098d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb67c009900 tx=0x7fb67c02a410 comp rx=0 tx=0).stop 2024-09-21T05:47:58.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.909+0000 7fb693285640 1 -- 172.21.15.70:0/99138551 shutdown_connections 2024-09-21T05:47:58.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.909+0000 7fb693285640 1 --2- 172.21.15.70:0/99138551 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb68c109e10 0x7fb68c110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.909+0000 7fb693285640 1 --2- 172.21.15.70:0/99138551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb68c1094c0 0x7fb68c1098d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.909+0000 7fb693285640 1 --2- 172.21.15.70:0/99138551 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb68c103b80 0x7fb68c103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.909+0000 7fb693285640 1 -- 172.21.15.70:0/99138551 >> 172.21.15.70:0/99138551 conn(0x7fb68c0ff610 msgr2=0x7fb68c101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.909+0000 7fb693285640 1 -- 172.21.15.70:0/99138551 shutdown_connections 2024-09-21T05:47:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.909+0000 7fb693285640 1 -- 172.21.15.70:0/99138551 wait complete. 2024-09-21T05:47:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.909+0000 7fb693285640 1 Processor -- start 2024-09-21T05:47:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.909+0000 7fb693285640 1 -- start start 2024-09-21T05:47:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.910+0000 7fb693285640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb68c103b80 0x7fb68c19a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.910+0000 7fb693285640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb68c1094c0 0x7fb68c19aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.910+0000 7fb693285640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb68c109e10 0x7fb68c19fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.910+0000 7fb693285640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb68c113aa0 con 0x7fb68c109e10 2024-09-21T05:47:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.910+0000 7fb693285640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb68c113920 con 0x7fb68c1094c0 2024-09-21T05:47:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.910+0000 7fb693285640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb68c113c20 con 0x7fb68c103b80 2024-09-21T05:47:58.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.910+0000 7fb691822640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb68c109e10 0x7fb68c19fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:58.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.910+0000 7fb691822640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb68c109e10 0x7fb68c19fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46524/0 (socket says 172.21.15.70:46524) 2024-09-21T05:47:58.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.910+0000 7fb691822640 1 -- 172.21.15.70:0/31564611 learned_addr learned my addr 172.21.15.70:0/31564611 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:47:58.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.910+0000 7fb690820640 1 --2- 172.21.15.70:0/31564611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb68c1094c0 0x7fb68c19aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:58.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.910+0000 7fb691822640 1 -- 172.21.15.70:0/31564611 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb68c103b80 msgr2=0x7fb68c19a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:58.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.910+0000 7fb691021640 1 --2- 172.21.15.70:0/31564611 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb68c103b80 0x7fb68c19a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:58.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.910+0000 7fb691822640 1 --2- 172.21.15.70:0/31564611 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb68c103b80 0x7fb68c19a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:58.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.910+0000 7fb691822640 1 -- 172.21.15.70:0/31564611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb68c1094c0 msgr2=0x7fb68c19aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:58.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.910+0000 7fb691822640 1 --2- 172.21.15.70:0/31564611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb68c1094c0 0x7fb68c19aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:58.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.910+0000 7fb691822640 1 -- 172.21.15.70:0/31564611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb68c1a0440 con 0x7fb68c109e10 2024-09-21T05:47:58.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.910+0000 7fb690820640 1 --2- 172.21.15.70:0/31564611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb68c1094c0 0x7fb68c19aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:47:58.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.910+0000 7fb691822640 1 --2- 172.21.15.70:0/31564611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb68c109e10 0x7fb68c19fd10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb68400cad0 tx=0x7fb68400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:58.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.911+0000 7fb6827fc640 1 -- 172.21.15.70:0/31564611 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68400ae20 con 0x7fb68c109e10 2024-09-21T05:47:58.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.911+0000 7fb6827fc640 1 -- 172.21.15.70:0/31564611 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fb684005020 con 0x7fb68c109e10 2024-09-21T05:47:58.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.911+0000 7fb693285640 1 -- 172.21.15.70:0/31564611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb68c1a0730 con 0x7fb68c109e10 2024-09-21T05:47:58.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.911+0000 7fb6827fc640 1 -- 172.21.15.70:0/31564611 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68400f6b0 con 0x7fb68c109e10 2024-09-21T05:47:58.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.911+0000 7fb693285640 1 -- 172.21.15.70:0/31564611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb68c1a6e90 con 0x7fb68c109e10 2024-09-21T05:47:58.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.912+0000 7fb693285640 1 -- 172.21.15.70:0/31564611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb68c103f90 con 0x7fb68c109e10 2024-09-21T05:47:58.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.913+0000 7fb6827fc640 1 -- 172.21.15.70:0/31564611 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fb684005580 con 0x7fb68c109e10 2024-09-21T05:47:58.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.914+0000 7fb6827fc640 1 --2- 172.21.15.70:0/31564611 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb6780b65a0 0x7fb6780b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:58.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.914+0000 7fb691021640 1 --2- 172.21.15.70:0/31564611 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb6780b65a0 0x7fb6780b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:58.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.914+0000 7fb6827fc640 1 -- 172.21.15.70:0/31564611 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7fb6840e7cc0 con 0x7fb68c109e10 2024-09-21T05:47:58.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.915+0000 7fb691021640 1 --2- 172.21.15.70:0/31564611 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb6780b65a0 0x7fb6780b8ab0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb688005fd0 tx=0x7fb688005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:58.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:58.917+0000 7fb6827fc640 1 -- 172.21.15.70:0/31564611 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb684014030 con 0x7fb68c109e10 2024-09-21T05:47:59.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:59.125+0000 7fb693285640 1 -- 172.21.15.70:0/31564611 --> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fb68c063800 con 0x7fb6780b65a0 2024-09-21T05:47:59.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:59.129+0000 7fb6827fc640 1 -- 172.21.15.70:0/31564611 <== mgr.14150 v2:172.21.15.70:6800/1366013939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fb68c063800 con 0x7fb6780b65a0 2024-09-21T05:47:59.131 INFO:teuthology.orchestra.run.smithi070.stdout:/volumes/qa/sv_1/4a7ceb30-60e6-49de-83e7-0661d2ffae2f 2024-09-21T05:47:59.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:59.131+0000 7fb693285640 1 -- 172.21.15.70:0/31564611 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb6780b65a0 msgr2=0x7fb6780b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:59.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:59.132+0000 7fb693285640 1 --2- 172.21.15.70:0/31564611 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb6780b65a0 0x7fb6780b8ab0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb688005fd0 tx=0x7fb688005c70 comp rx=0 tx=0).stop 2024-09-21T05:47:59.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:59.132+0000 7fb693285640 1 -- 172.21.15.70:0/31564611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb68c109e10 msgr2=0x7fb68c19fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:59.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:59.132+0000 7fb693285640 1 --2- 172.21.15.70:0/31564611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb68c109e10 0x7fb68c19fd10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb68400cad0 tx=0x7fb68400cf90 comp rx=0 tx=0).stop 2024-09-21T05:47:59.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:59.132+0000 7fb693285640 1 -- 172.21.15.70:0/31564611 shutdown_connections 2024-09-21T05:47:59.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:59.132+0000 7fb693285640 1 --2- 172.21.15.70:0/31564611 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb6780b65a0 0x7fb6780b8ab0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:59.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:59.132+0000 7fb693285640 1 --2- 172.21.15.70:0/31564611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb68c109e10 0x7fb68c19fd10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:59.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:59.132+0000 7fb693285640 1 --2- 172.21.15.70:0/31564611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb68c1094c0 0x7fb68c19aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:59.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:59.132+0000 7fb693285640 1 --2- 172.21.15.70:0/31564611 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb68c103b80 0x7fb68c19a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:59.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:59.132+0000 7fb693285640 1 -- 172.21.15.70:0/31564611 >> 172.21.15.70:0/31564611 conn(0x7fb68c0ff610 msgr2=0x7fb68c101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:59.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:59.132+0000 7fb693285640 1 -- 172.21.15.70:0/31564611 shutdown_connections 2024-09-21T05:47:59.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:47:59.132+0000 7fb693285640 1 -- 172.21.15.70:0/31564611 wait complete. 2024-09-21T05:47:59.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:59 smithi070 ceph-mon[30981]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:59.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:47:59 smithi070 ceph-mon[30981]: pgmap v324: 129 pgs: 129 active+clean; 614 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.0 KiB/s wr, 23 op/s 2024-09-21T05:47:59.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:59 smithi116 ceph-mon[34332]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:59.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:47:59 smithi116 ceph-mon[34332]: pgmap v324: 129 pgs: 129 active+clean; 614 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.0 KiB/s wr, 23 op/s 2024-09-21T05:47:59.847 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:47:59.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:59 smithi160 ceph-mon[33979]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:59.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:47:59 smithi160 ceph-mon[33979]: pgmap v324: 129 pgs: 129 active+clean; 614 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.0 KiB/s wr, 23 op/s 2024-09-21T05:48:00.091 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:00.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.584+0000 7f32ce740640 1 -- 172.21.15.70:0/3648609789 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32c8109e10 msgr2=0x7f32c8110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:00.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.584+0000 7f32ce740640 1 --2- 172.21.15.70:0/3648609789 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32c8109e10 0x7f32c8110640 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f32c0009ca0 tx=0x7f32c002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:48:00.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.584+0000 7f32ce740640 1 -- 172.21.15.70:0/3648609789 shutdown_connections 2024-09-21T05:48:00.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.584+0000 7f32ce740640 1 --2- 172.21.15.70:0/3648609789 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32c8109e10 0x7f32c8110640 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:00.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.584+0000 7f32ce740640 1 --2- 172.21.15.70:0/3648609789 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32c81094c0 0x7f32c81098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:00.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.584+0000 7f32ce740640 1 --2- 172.21.15.70:0/3648609789 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32c8103b80 0x7f32c8103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:00.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.584+0000 7f32ce740640 1 -- 172.21.15.70:0/3648609789 >> 172.21.15.70:0/3648609789 conn(0x7f32c80ff5d0 msgr2=0x7f32c8101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:00.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.585+0000 7f32ce740640 1 -- 172.21.15.70:0/3648609789 shutdown_connections 2024-09-21T05:48:00.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.585+0000 7f32ce740640 1 -- 172.21.15.70:0/3648609789 wait complete. 2024-09-21T05:48:00.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.585+0000 7f32ce740640 1 Processor -- start 2024-09-21T05:48:00.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.585+0000 7f32ce740640 1 -- start start 2024-09-21T05:48:00.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.586+0000 7f32ce740640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32c8103b80 0x7f32c819a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:00.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.586+0000 7f32ce740640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32c81094c0 0x7f32c819a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:00.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.586+0000 7f32ce740640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32c8109e10 0x7f32c819fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:00.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.586+0000 7f32ce740640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f32c8113ac0 con 0x7f32c8109e10 2024-09-21T05:48:00.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.586+0000 7f32ce740640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f32c8113940 con 0x7f32c81094c0 2024-09-21T05:48:00.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.586+0000 7f32ce740640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f32c8113c40 con 0x7f32c8103b80 2024-09-21T05:48:00.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.586+0000 7f32cccdd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32c8109e10 0x7f32c819fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:00.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.586+0000 7f32cccdd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32c8109e10 0x7f32c819fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46556/0 (socket says 172.21.15.70:46556) 2024-09-21T05:48:00.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.586+0000 7f32cccdd640 1 -- 172.21.15.70:0/4063167797 learned_addr learned my addr 172.21.15.70:0/4063167797 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:00.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.586+0000 7f32c77fe640 1 --2- 172.21.15.70:0/4063167797 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32c81094c0 0x7f32c819a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:00.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.586+0000 7f32c7fff640 1 --2- 172.21.15.70:0/4063167797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32c8103b80 0x7f32c819a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:00.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.586+0000 7f32cccdd640 1 -- 172.21.15.70:0/4063167797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32c8103b80 msgr2=0x7f32c819a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:00.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.586+0000 7f32cccdd640 1 --2- 172.21.15.70:0/4063167797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32c8103b80 0x7f32c819a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:00.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.586+0000 7f32cccdd640 1 -- 172.21.15.70:0/4063167797 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32c81094c0 msgr2=0x7f32c819a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:00.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.586+0000 7f32cccdd640 1 --2- 172.21.15.70:0/4063167797 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32c81094c0 0x7f32c819a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:00.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.586+0000 7f32cccdd640 1 -- 172.21.15.70:0/4063167797 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c81a03c0 con 0x7f32c8109e10 2024-09-21T05:48:00.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.586+0000 7f32c7fff640 1 --2- 172.21.15.70:0/4063167797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32c8103b80 0x7f32c819a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:48:00.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.586+0000 7f32cccdd640 1 --2- 172.21.15.70:0/4063167797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32c8109e10 0x7f32c819fc90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f32c00097b0 tx=0x7f32c0032fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:00.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.586+0000 7f32c57fa640 1 -- 172.21.15.70:0/4063167797 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c0003cf0 con 0x7f32c8109e10 2024-09-21T05:48:00.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.586+0000 7f32c57fa640 1 -- 172.21.15.70:0/4063167797 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f32c00044f0 con 0x7f32c8109e10 2024-09-21T05:48:00.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.586+0000 7f32c57fa640 1 -- 172.21.15.70:0/4063167797 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c0030c30 con 0x7f32c8109e10 2024-09-21T05:48:00.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.587+0000 7f32ce740640 1 -- 172.21.15.70:0/4063167797 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32c81a0650 con 0x7f32c8109e10 2024-09-21T05:48:00.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.587+0000 7f32ce740640 1 -- 172.21.15.70:0/4063167797 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32c81a6e10 con 0x7f32c8109e10 2024-09-21T05:48:00.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.588+0000 7f32ce740640 1 -- 172.21.15.70:0/4063167797 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32c8104e00 con 0x7f32c8109e10 2024-09-21T05:48:00.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.590+0000 7f32c57fa640 1 -- 172.21.15.70:0/4063167797 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f32c00046a0 con 0x7f32c8109e10 2024-09-21T05:48:00.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.590+0000 7f32c57fa640 1 --2- 172.21.15.70:0/4063167797 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f32b00b6620 0x7f32b00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:00.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.591+0000 7f32c57fa640 1 -- 172.21.15.70:0/4063167797 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f32c0108d30 con 0x7f32c8109e10 2024-09-21T05:48:00.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.591+0000 7f32c7fff640 1 --2- 172.21.15.70:0/4063167797 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f32b00b6620 0x7f32b00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:00.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.591+0000 7f32c7fff640 1 --2- 172.21.15.70:0/4063167797 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f32b00b6620 0x7f32b00b8b30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f32b8005fd0 tx=0x7f32b8005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:00.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.594+0000 7f32c57fa640 1 -- 172.21.15.70:0/4063167797 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f32c00cf100 con 0x7f32c8109e10 2024-09-21T05:48:00.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.811+0000 7f32ce740640 1 -- 172.21.15.70:0/4063167797 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32c8103f90 con 0x7f32c8109e10 2024-09-21T05:48:00.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.812+0000 7f32c57fa640 1 -- 172.21.15.70:0/4063167797 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11986 (secure 0 0 0) 0x7f32c8103f90 con 0x7f32c8109e10 2024-09-21T05:48:00.814 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:48:00.814 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":27,"btime":"2024-09-21T05:47:50:538503+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3519318330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3519318330},{"type":"v1","addr":"172.21.15.70:6835","nonce":3519318330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2706663460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2706663460},{"type":"v1","addr":"172.21.15.70:6837","nonce":2706663460}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:47:06.246985+0000","modified":"2024-09-21T05:47:50.538486+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24628,"mds_2":24611,"mds_3":24610,"mds_4":24598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/1914209867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1914209867},{"type":"v1","addr":"172.21.15.70:6839","nonce":1914209867}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3392175775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3392175775},{"type":"v1","addr":"172.21.15.70:6841","nonce":3392175775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/3543945704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3543945704},{"type":"v1","addr":"172.21.15.160:6833","nonce":3543945704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6833/283778129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":283778129},{"type":"v1","addr":"172.21.15.116:6833","nonce":283778129}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/3787256790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3787256790},{"type":"v1","addr":"172.21.15.116:6835","nonce":3787256790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.160:6835/2001692372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2001692372},{"type":"v1","addr":"172.21.15.160:6835","nonce":2001692372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.160:6837/2558120045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2558120045},{"type":"v1","addr":"172.21.15.160:6837","nonce":2558120045}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24611":{"gid":24611,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/444312934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":444312934},{"type":"v1","addr":"172.21.15.116:6837","nonce":444312934}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.160:6839/1339744282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1339744282},{"type":"v1","addr":"172.21.15.160:6839","nonce":1339744282}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/3952175670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3952175670},{"type":"v1","addr":"172.21.15.116:6839","nonce":3952175670}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24641,"qdb_cluster":[24641,24628,24610,24611,24598]},"id":1}]} 2024-09-21T05:48:00.814 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 27 2024-09-21T05:48:00.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.814+0000 7f32ce740640 1 -- 172.21.15.70:0/4063167797 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f32b00b6620 msgr2=0x7f32b00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:00.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.814+0000 7f32ce740640 1 --2- 172.21.15.70:0/4063167797 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f32b00b6620 0x7f32b00b8b30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f32b8005fd0 tx=0x7f32b8005ea0 comp rx=0 tx=0).stop 2024-09-21T05:48:00.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.814+0000 7f32ce740640 1 -- 172.21.15.70:0/4063167797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32c8109e10 msgr2=0x7f32c819fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:00.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.814+0000 7f32ce740640 1 --2- 172.21.15.70:0/4063167797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32c8109e10 0x7f32c819fc90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f32c00097b0 tx=0x7f32c0032fe0 comp rx=0 tx=0).stop 2024-09-21T05:48:00.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.814+0000 7f32ce740640 1 -- 172.21.15.70:0/4063167797 shutdown_connections 2024-09-21T05:48:00.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.814+0000 7f32ce740640 1 --2- 172.21.15.70:0/4063167797 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f32b00b6620 0x7f32b00b8b30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:00.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.814+0000 7f32ce740640 1 --2- 172.21.15.70:0/4063167797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32c8109e10 0x7f32c819fc90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:00.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.814+0000 7f32ce740640 1 --2- 172.21.15.70:0/4063167797 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32c81094c0 0x7f32c819a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:00.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.814+0000 7f32ce740640 1 --2- 172.21.15.70:0/4063167797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32c8103b80 0x7f32c819a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:00.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.814+0000 7f32ce740640 1 -- 172.21.15.70:0/4063167797 >> 172.21.15.70:0/4063167797 conn(0x7f32c80ff5d0 msgr2=0x7f32c81019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:00.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.814+0000 7f32ce740640 1 -- 172.21.15.70:0/4063167797 shutdown_connections 2024-09-21T05:48:00.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:00.814+0000 7f32ce740640 1 -- 172.21.15.70:0/4063167797 wait complete. 2024-09-21T05:48:01.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:00 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/4063167797' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:48:01.231 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:00 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/4063167797' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:48:01.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:00 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/4063167797' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:48:01.448 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:48:01.696 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:02.147 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:01 smithi070 ceph-mon[30981]: pgmap v325: 129 pgs: 129 active+clean; 614 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.3 KiB/s wr, 21 op/s 2024-09-21T05:48:02.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:01 smithi160 ceph-mon[33979]: pgmap v325: 129 pgs: 129 active+clean; 614 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.3 KiB/s wr, 21 op/s 2024-09-21T05:48:02.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.237+0000 7f6f1e874640 1 -- 172.21.15.70:0/2486542307 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f181083a0 msgr2=0x7f6f181087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:02.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.237+0000 7f6f1e874640 1 --2- 172.21.15.70:0/2486542307 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f181083a0 0x7f6f181087b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6f00009900 tx=0x7f6f0002a410 comp rx=0 tx=0).stop 2024-09-21T05:48:02.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.237+0000 7f6f1e874640 1 -- 172.21.15.70:0/2486542307 shutdown_connections 2024-09-21T05:48:02.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.237+0000 7f6f1e874640 1 --2- 172.21.15.70:0/2486542307 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f18108cf0 0x7f6f1810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:02.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.237+0000 7f6f1e874640 1 --2- 172.21.15.70:0/2486542307 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f181083a0 0x7f6f181087b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:02.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.237+0000 7f6f1e874640 1 --2- 172.21.15.70:0/2486542307 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f18102a60 0x7f6f18102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:02.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.237+0000 7f6f1e874640 1 -- 172.21.15.70:0/2486542307 >> 172.21.15.70:0/2486542307 conn(0x7f6f18079730 msgr2=0x7f6f18079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:02.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.237+0000 7f6f1e874640 1 -- 172.21.15.70:0/2486542307 shutdown_connections 2024-09-21T05:48:02.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.237+0000 7f6f1e874640 1 -- 172.21.15.70:0/2486542307 wait complete. 2024-09-21T05:48:02.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.238+0000 7f6f1e874640 1 Processor -- start 2024-09-21T05:48:02.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.238+0000 7f6f1e874640 1 -- start start 2024-09-21T05:48:02.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.238+0000 7f6f1e874640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f18102a60 0x7f6f1819b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:02.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.238+0000 7f6f1e874640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f181083a0 0x7f6f1819b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:02.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.238+0000 7f6f1e874640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f18108cf0 0x7f6f1819bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:02.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.238+0000 7f6f1e874640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6f18112930 con 0x7f6f18102a60 2024-09-21T05:48:02.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.238+0000 7f6f1e874640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6f181127b0 con 0x7f6f18108cf0 2024-09-21T05:48:02.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.238+0000 7f6f1e874640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6f18112ab0 con 0x7f6f181083a0 2024-09-21T05:48:02.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.239+0000 7f6f17fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f18102a60 0x7f6f1819b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:02.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.239+0000 7f6f17fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f18102a60 0x7f6f1819b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46574/0 (socket says 172.21.15.70:46574) 2024-09-21T05:48:02.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.239+0000 7f6f17fff640 1 -- 172.21.15.70:0/1547600590 learned_addr learned my addr 172.21.15.70:0/1547600590 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:02.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.239+0000 7f6f1ce11640 1 --2- 172.21.15.70:0/1547600590 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f18108cf0 0x7f6f1819bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:02.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.239+0000 7f6f177fe640 1 --2- 172.21.15.70:0/1547600590 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f181083a0 0x7f6f1819b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:02.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.239+0000 7f6f17fff640 1 -- 172.21.15.70:0/1547600590 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f181083a0 msgr2=0x7f6f1819b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:02.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.239+0000 7f6f17fff640 1 --2- 172.21.15.70:0/1547600590 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f181083a0 0x7f6f1819b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:02.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.239+0000 7f6f17fff640 1 -- 172.21.15.70:0/1547600590 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f18108cf0 msgr2=0x7f6f1819bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:02.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.239+0000 7f6f17fff640 1 --2- 172.21.15.70:0/1547600590 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f18108cf0 0x7f6f1819bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:02.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.239+0000 7f6f17fff640 1 -- 172.21.15.70:0/1547600590 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f181a65d0 con 0x7f6f18102a60 2024-09-21T05:48:02.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.239+0000 7f6f17fff640 1 --2- 172.21.15.70:0/1547600590 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f18102a60 0x7f6f1819b2c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6f0800d950 tx=0x7f6f0800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:02.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.239+0000 7f6f157fa640 1 -- 172.21.15.70:0/1547600590 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f08017070 con 0x7f6f18102a60 2024-09-21T05:48:02.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.239+0000 7f6f1e874640 1 -- 172.21.15.70:0/1547600590 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f181a68c0 con 0x7f6f18102a60 2024-09-21T05:48:02.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.239+0000 7f6f157fa640 1 -- 172.21.15.70:0/1547600590 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f6f08009c30 con 0x7f6f18102a60 2024-09-21T05:48:02.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.239+0000 7f6f157fa640 1 -- 172.21.15.70:0/1547600590 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0800f620 con 0x7f6f18102a60 2024-09-21T05:48:02.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.239+0000 7f6f1e874640 1 -- 172.21.15.70:0/1547600590 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f181a6e20 con 0x7f6f18102a60 2024-09-21T05:48:02.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.240+0000 7f6f1e874640 1 -- 172.21.15.70:0/1547600590 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f18102e70 con 0x7f6f18102a60 2024-09-21T05:48:02.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.242+0000 7f6f157fa640 1 -- 172.21.15.70:0/1547600590 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f6f080109a0 con 0x7f6f18102a60 2024-09-21T05:48:02.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.243+0000 7f6f157fa640 1 --2- 172.21.15.70:0/1547600590 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f6f040b65a0 0x7f6f040b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:02.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.243+0000 7f6f177fe640 1 --2- 172.21.15.70:0/1547600590 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f6f040b65a0 0x7f6f040b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:02.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.243+0000 7f6f157fa640 1 -- 172.21.15.70:0/1547600590 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f6f080e7330 con 0x7f6f18102a60 2024-09-21T05:48:02.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.243+0000 7f6f177fe640 1 --2- 172.21.15.70:0/1547600590 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f6f040b65a0 0x7f6f040b8ab0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6f00000c00 tx=0x7f6f00005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:02.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.250+0000 7f6f157fa640 1 -- 172.21.15.70:0/1547600590 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6f08009de0 con 0x7f6f18102a60 2024-09-21T05:48:02.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:01 smithi116 ceph-mon[34332]: pgmap v325: 129 pgs: 129 active+clean; 614 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.3 KiB/s wr, 21 op/s 2024-09-21T05:48:02.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.446+0000 7f6f1e874640 1 -- 172.21.15.70:0/1547600590 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6f1802e640 con 0x7f6f18102a60 2024-09-21T05:48:02.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.447+0000 7f6f157fa640 1 -- 172.21.15.70:0/1547600590 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+24691 (secure 0 0 0) 0x7f6f080b1ae0 con 0x7f6f18102a60 2024-09-21T05:48:02.449 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:48:02.450 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":83,"fsid":"96c6636e-77db-11ef-baf5-efdc52797490","created":"2024-09-21T05:38:42.297307+0000","modified":"2024-09-21T05:47:38.383182+0000","last_up_change":"2024-09-21T05:46:15.910344+0000","last_in_change":"2024-09-21T05:45:53.382766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:42:25.611590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:47:01.987981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:47:04.388107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T05:47:10.651871+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00be8b82-7cb1-443f-ad18-02916f734df7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6803","nonce":1667051447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6805","nonce":1667051447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6809","nonce":1667051447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6807","nonce":1667051447}]},"public_addr":"172.21.15.70:6803/1667051447","cluster_addr":"172.21.15.70:6805/1667051447","heartbeat_back_addr":"172.21.15.70:6809/1667051447","heartbeat_front_addr":"172.21.15.70:6807/1667051447","state":["exists","up"]},{"osd":1,"uuid":"28ca8c5c-5e81-4e64-ac0e-3c8c3c2d3930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6801","nonce":1037621846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6803","nonce":1037621846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6807","nonce":1037621846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6805","nonce":1037621846}]},"public_addr":"172.21.15.116:6801/1037621846","cluster_addr":"172.21.15.116:6803/1037621846","heartbeat_back_addr":"172.21.15.116:6807/1037621846","heartbeat_front_addr":"172.21.15.116:6805/1037621846","state":["exists","up"]},{"osd":2,"uuid":"e9b42bf2-a38b-4cf9-8774-4950de12d0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6801","nonce":69260815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6803","nonce":69260815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6807","nonce":69260815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6805","nonce":69260815}]},"public_addr":"172.21.15.160:6801/69260815","cluster_addr":"172.21.15.160:6803/69260815","heartbeat_back_addr":"172.21.15.160:6807/69260815","heartbeat_front_addr":"172.21.15.160:6805/69260815","state":["exists","up"]},{"osd":3,"uuid":"25d8e9a8-3c14-43d6-9bb1-b44cd377133f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6811","nonce":3849416072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6813","nonce":3849416072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6817","nonce":3849416072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6815","nonce":3849416072}]},"public_addr":"172.21.15.70:6811/3849416072","cluster_addr":"172.21.15.70:6813/3849416072","heartbeat_back_addr":"172.21.15.70:6817/3849416072","heartbeat_front_addr":"172.21.15.70:6815/3849416072","state":["exists","up"]},{"osd":4,"uuid":"bdb84cbd-d718-4f69-90d0-2e732e580df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6809","nonce":3444857438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6811","nonce":3444857438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6815","nonce":3444857438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6813","nonce":3444857438}]},"public_addr":"172.21.15.116:6809/3444857438","cluster_addr":"172.21.15.116:6811/3444857438","heartbeat_back_addr":"172.21.15.116:6815/3444857438","heartbeat_front_addr":"172.21.15.116:6813/3444857438","state":["exists","up"]},{"osd":5,"uuid":"a490eeba-549f-4caa-8cd5-4168a23dafa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6809","nonce":3063220427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6811","nonce":3063220427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6815","nonce":3063220427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6813","nonce":3063220427}]},"public_addr":"172.21.15.160:6809/3063220427","cluster_addr":"172.21.15.160:6811/3063220427","heartbeat_back_addr":"172.21.15.160:6815/3063220427","heartbeat_front_addr":"172.21.15.160:6813/3063220427","state":["exists","up"]},{"osd":6,"uuid":"1bf22f48-c02f-4f09-b0fe-2597a55fd795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6819","nonce":3650315688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6821","nonce":3650315688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6825","nonce":3650315688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6823","nonce":3650315688}]},"public_addr":"172.21.15.70:6819/3650315688","cluster_addr":"172.21.15.70:6821/3650315688","heartbeat_back_addr":"172.21.15.70:6825/3650315688","heartbeat_front_addr":"172.21.15.70:6823/3650315688","state":["exists","up"]},{"osd":7,"uuid":"40d59744-4860-4a92-aa21-3f33e575e5b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6817","nonce":2034132009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6819","nonce":2034132009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6823","nonce":2034132009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6821","nonce":2034132009}]},"public_addr":"172.21.15.116:6817/2034132009","cluster_addr":"172.21.15.116:6819/2034132009","heartbeat_back_addr":"172.21.15.116:6823/2034132009","heartbeat_front_addr":"172.21.15.116:6821/2034132009","state":["exists","up"]},{"osd":8,"uuid":"65dc02e7-0dcd-4fa7-955a-4d5c00fbe4cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6817","nonce":3381625184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6819","nonce":3381625184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6823","nonce":3381625184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6821","nonce":3381625184}]},"public_addr":"172.21.15.160:6817/3381625184","cluster_addr":"172.21.15.160:6819/3381625184","heartbeat_back_addr":"172.21.15.160:6823/3381625184","heartbeat_front_addr":"172.21.15.160:6821/3381625184","state":["exists","up"]},{"osd":9,"uuid":"d8438a9c-012f-4082-be3f-9653cdfaac78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6827","nonce":3555256209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6829","nonce":3555256209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6833","nonce":3555256209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6831","nonce":3555256209}]},"public_addr":"172.21.15.70:6827/3555256209","cluster_addr":"172.21.15.70:6829/3555256209","heartbeat_back_addr":"172.21.15.70:6833/3555256209","heartbeat_front_addr":"172.21.15.70:6831/3555256209","state":["exists","up"]},{"osd":10,"uuid":"871619b0-181e-4020-9511-2cec296bfe70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6825","nonce":541280433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6827","nonce":541280433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6831","nonce":541280433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6829","nonce":541280433}]},"public_addr":"172.21.15.116:6825/541280433","cluster_addr":"172.21.15.116:6827/541280433","heartbeat_back_addr":"172.21.15.116:6831/541280433","heartbeat_front_addr":"172.21.15.116:6829/541280433","state":["exists","up"]},{"osd":11,"uuid":"302da945-7929-4b0c-a20b-099175752c41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6825","nonce":2632369083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6827","nonce":2632369083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6831","nonce":2632369083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6829","nonce":2632369083}]},"public_addr":"172.21.15.160:6825/2632369083","cluster_addr":"172.21.15.160:6827/2632369083","heartbeat_back_addr":"172.21.15.160:6831/2632369083","heartbeat_front_addr":"172.21.15.160:6829/2632369083","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:41:34.446744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:41:59.336955+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:42:23.958219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:42:49.396007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:43:15.325344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:43:41.923141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:07.873970+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:33.897951+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:58.397680+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:24.568406+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:49.504565+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:14.698577+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.e","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6800/605055695":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/897886925":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/1968357524":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/693721445":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/2810307308":"2024-09-22T05:39:12.492271+0000","172.21.15.70:6801/605055695":"2024-09-22T05:39:37.296630+0000","172.21.15.70:6801/1668927582":"2024-09-22T05:39:12.492271+0000","172.21.15.70:6800/1668927582":"2024-09-22T05:39:12.492271+0000","172.21.15.70:0/1979536420":"2024-09-22T05:39:12.492271+0000","172.21.15.70:0/2674019604":"2024-09-22T05:39:12.492271+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:48:02.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.450+0000 7f6f1e874640 1 -- 172.21.15.70:0/1547600590 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f6f040b65a0 msgr2=0x7f6f040b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:02.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.450+0000 7f6f1e874640 1 --2- 172.21.15.70:0/1547600590 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f6f040b65a0 0x7f6f040b8ab0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6f00000c00 tx=0x7f6f00005d50 comp rx=0 tx=0).stop 2024-09-21T05:48:02.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.450+0000 7f6f1e874640 1 -- 172.21.15.70:0/1547600590 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f18102a60 msgr2=0x7f6f1819b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:02.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.450+0000 7f6f1e874640 1 --2- 172.21.15.70:0/1547600590 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f18102a60 0x7f6f1819b2c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6f0800d950 tx=0x7f6f0800de10 comp rx=0 tx=0).stop 2024-09-21T05:48:02.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.450+0000 7f6f1e874640 1 -- 172.21.15.70:0/1547600590 shutdown_connections 2024-09-21T05:48:02.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.450+0000 7f6f1e874640 1 --2- 172.21.15.70:0/1547600590 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f6f040b65a0 0x7f6f040b8ab0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:02.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.450+0000 7f6f1e874640 1 --2- 172.21.15.70:0/1547600590 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f181083a0 0x7f6f1819b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:02.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.450+0000 7f6f1e874640 1 --2- 172.21.15.70:0/1547600590 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f18108cf0 0x7f6f1819bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:02.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.450+0000 7f6f1e874640 1 --2- 172.21.15.70:0/1547600590 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f18102a60 0x7f6f1819b2c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:02.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.450+0000 7f6f1e874640 1 -- 172.21.15.70:0/1547600590 >> 172.21.15.70:0/1547600590 conn(0x7f6f18079730 msgr2=0x7f6f181044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:02.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.450+0000 7f6f1e874640 1 -- 172.21.15.70:0/1547600590 shutdown_connections 2024-09-21T05:48:02.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:02.450+0000 7f6f1e874640 1 -- 172.21.15.70:0/1547600590 wait complete. 2024-09-21T05:48:02.895 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:02 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:02.895 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:02 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1547600590' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:48:03.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:02 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:03.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:02 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1547600590' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:48:03.228 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:02 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:03.228 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:02 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1547600590' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:48:03.256 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T05:48:03.257 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T05:48:03.845 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:04.134 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:03 smithi070 ceph-mon[30981]: pgmap v326: 129 pgs: 129 active+clean; 639 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.4 KiB/s wr, 22 op/s 2024-09-21T05:48:04.134 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:03 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:48:04.134 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:03 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:48:04.135 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:03 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:48:04.135 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:03 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:48:04.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:03 smithi160 ceph-mon[33979]: pgmap v326: 129 pgs: 129 active+clean; 639 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.4 KiB/s wr, 22 op/s 2024-09-21T05:48:04.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:03 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:48:04.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:03 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:48:04.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:03 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:48:04.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:03 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:48:04.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:03 smithi116 ceph-mon[34332]: pgmap v326: 129 pgs: 129 active+clean; 639 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.4 KiB/s wr, 22 op/s 2024-09-21T05:48:04.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:03 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:48:04.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:03 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:48:04.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:03 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:48:04.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:03 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:48:04.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.337+0000 7f55bc548640 1 -- 172.21.15.70:0/1345326690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55b4102ae0 msgr2=0x7f55b4102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:04.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.337+0000 7f55bc548640 1 --2- 172.21.15.70:0/1345326690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55b4102ae0 0x7f55b4102ef0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f55b0009900 tx=0x7f55b002a410 comp rx=0 tx=0).stop 2024-09-21T05:48:04.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.338+0000 7f55bc548640 1 -- 172.21.15.70:0/1345326690 shutdown_connections 2024-09-21T05:48:04.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.338+0000 7f55bc548640 1 --2- 172.21.15.70:0/1345326690 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f55b4108d70 0x7f55b410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:04.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.338+0000 7f55bc548640 1 --2- 172.21.15.70:0/1345326690 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f55b4108420 0x7f55b4108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:04.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.338+0000 7f55bc548640 1 --2- 172.21.15.70:0/1345326690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55b4102ae0 0x7f55b4102ef0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:04.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.338+0000 7f55bc548640 1 -- 172.21.15.70:0/1345326690 >> 172.21.15.70:0/1345326690 conn(0x7f55b4079770 msgr2=0x7f55b4079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:04.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.338+0000 7f55bc548640 1 -- 172.21.15.70:0/1345326690 shutdown_connections 2024-09-21T05:48:04.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.338+0000 7f55bc548640 1 -- 172.21.15.70:0/1345326690 wait complete. 2024-09-21T05:48:04.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.338+0000 7f55bc548640 1 Processor -- start 2024-09-21T05:48:04.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.338+0000 7f55bc548640 1 -- start start 2024-09-21T05:48:04.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.339+0000 7f55bc548640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55b4102ae0 0x7f55b419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:04.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.339+0000 7f55bc548640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f55b4108420 0x7f55b419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:04.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.339+0000 7f55bc548640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f55b4108d70 0x7f55b419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:04.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.339+0000 7f55bc548640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f55b4113b20 con 0x7f55b4102ae0 2024-09-21T05:48:04.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.339+0000 7f55bc548640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f55b41139a0 con 0x7f55b4108d70 2024-09-21T05:48:04.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.339+0000 7f55bc548640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f55b4113ca0 con 0x7f55b4108420 2024-09-21T05:48:04.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.339+0000 7f55ba2e4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55b4102ae0 0x7f55b419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:04.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.339+0000 7f55ba2e4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55b4102ae0 0x7f55b419a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46582/0 (socket says 172.21.15.70:46582) 2024-09-21T05:48:04.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.339+0000 7f55ba2e4640 1 -- 172.21.15.70:0/1644522222 learned_addr learned my addr 172.21.15.70:0/1644522222 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:04.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.339+0000 7f55b9ae3640 1 --2- 172.21.15.70:0/1644522222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f55b4108420 0x7f55b419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:04.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.339+0000 7f55baae5640 1 --2- 172.21.15.70:0/1644522222 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f55b4108d70 0x7f55b419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:04.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.339+0000 7f55ba2e4640 1 -- 172.21.15.70:0/1644522222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f55b4108420 msgr2=0x7f55b419aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:04.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.339+0000 7f55ba2e4640 1 --2- 172.21.15.70:0/1644522222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f55b4108420 0x7f55b419aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:04.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.339+0000 7f55ba2e4640 1 -- 172.21.15.70:0/1644522222 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f55b4108d70 msgr2=0x7f55b419fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:04.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.339+0000 7f55ba2e4640 1 --2- 172.21.15.70:0/1644522222 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f55b4108d70 0x7f55b419fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:04.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.339+0000 7f55ba2e4640 1 -- 172.21.15.70:0/1644522222 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55b41a03a0 con 0x7f55b4102ae0 2024-09-21T05:48:04.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.339+0000 7f55ba2e4640 1 --2- 172.21.15.70:0/1644522222 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55b4102ae0 0x7f55b419a4f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f55b0005940 tx=0x7f55b00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:04.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.339+0000 7f55ab7fe640 1 -- 172.21.15.70:0/1644522222 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b003f030 con 0x7f55b4102ae0 2024-09-21T05:48:04.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.339+0000 7f55ab7fe640 1 -- 172.21.15.70:0/1644522222 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f55b0003cb0 con 0x7f55b4102ae0 2024-09-21T05:48:04.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.339+0000 7f55bc548640 1 -- 172.21.15.70:0/1644522222 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55b41a0630 con 0x7f55b4102ae0 2024-09-21T05:48:04.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.339+0000 7f55ab7fe640 1 -- 172.21.15.70:0/1644522222 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b0035070 con 0x7f55b4102ae0 2024-09-21T05:48:04.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.340+0000 7f55bc548640 1 -- 172.21.15.70:0/1644522222 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55b41a0b10 con 0x7f55b4102ae0 2024-09-21T05:48:04.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.341+0000 7f55bc548640 1 -- 172.21.15.70:0/1644522222 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55b4103d60 con 0x7f55b4102ae0 2024-09-21T05:48:04.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.342+0000 7f55ab7fe640 1 -- 172.21.15.70:0/1644522222 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f55b0042030 con 0x7f55b4102ae0 2024-09-21T05:48:04.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.343+0000 7f55ab7fe640 1 --2- 172.21.15.70:0/1644522222 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f55a00b65d0 0x7f55a00b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:04.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.343+0000 7f55b9ae3640 1 --2- 172.21.15.70:0/1644522222 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f55a00b65d0 0x7f55a00b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:04.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.343+0000 7f55ab7fe640 1 -- 172.21.15.70:0/1644522222 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f55b0107fa0 con 0x7f55b4102ae0 2024-09-21T05:48:04.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.343+0000 7f55b9ae3640 1 --2- 172.21.15.70:0/1644522222 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f55a00b65d0 0x7f55a00b8ae0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f55b41053d0 tx=0x7f55a400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:04.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.346+0000 7f55ab7fe640 1 -- 172.21.15.70:0/1644522222 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f55b00ce370 con 0x7f55b4102ae0 2024-09-21T05:48:04.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.553+0000 7f55bc548640 1 -- 172.21.15.70:0/1644522222 --> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f55b4063800 con 0x7f55a00b65d0 2024-09-21T05:48:04.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.564+0000 7f55ab7fe640 1 -- 172.21.15.70:0/1644522222 <== mgr.14150 v2:172.21.15.70:6800/1366013939 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340635 (secure 0 0 0) 0x7f55b4063800 con 0x7f55a00b65d0 2024-09-21T05:48:04.569 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:48:04.571 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-21T05:48:04.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.568+0000 7f55bc548640 1 -- 172.21.15.70:0/1644522222 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f55a00b65d0 msgr2=0x7f55a00b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:04.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.568+0000 7f55bc548640 1 --2- 172.21.15.70:0/1644522222 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f55a00b65d0 0x7f55a00b8ae0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f55b41053d0 tx=0x7f55a400a2d0 comp rx=0 tx=0).stop 2024-09-21T05:48:04.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.568+0000 7f55bc548640 1 -- 172.21.15.70:0/1644522222 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55b4102ae0 msgr2=0x7f55b419a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:04.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.568+0000 7f55bc548640 1 --2- 172.21.15.70:0/1644522222 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55b4102ae0 0x7f55b419a4f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f55b0005940 tx=0x7f55b00042f0 comp rx=0 tx=0).stop 2024-09-21T05:48:04.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.568+0000 7f55bc548640 1 -- 172.21.15.70:0/1644522222 shutdown_connections 2024-09-21T05:48:04.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.568+0000 7f55bc548640 1 --2- 172.21.15.70:0/1644522222 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f55a00b65d0 0x7f55a00b8ae0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:04.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.568+0000 7f55bc548640 1 --2- 172.21.15.70:0/1644522222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f55b4108420 0x7f55b419aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:04.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.568+0000 7f55bc548640 1 --2- 172.21.15.70:0/1644522222 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f55b4108d70 0x7f55b419fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:04.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.568+0000 7f55bc548640 1 --2- 172.21.15.70:0/1644522222 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55b4102ae0 0x7f55b419a4f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:04.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.568+0000 7f55bc548640 1 -- 172.21.15.70:0/1644522222 >> 172.21.15.70:0/1644522222 conn(0x7f55b4079770 msgr2=0x7f55b41064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:04.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.568+0000 7f55bc548640 1 -- 172.21.15.70:0/1644522222 shutdown_connections 2024-09-21T05:48:04.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:04.568+0000 7f55bc548640 1 -- 172.21.15.70:0/1644522222 wait complete. 2024-09-21T05:48:05.299 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2024-09-21T05:48:03.407991+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653959,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":226,"num_read_kb":210,"num_write":365,"num_write_kb":2284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":301,"ondisk_log_size":301,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":348076,"kb_used_data":11308,"kb_used_omap":18,"kb_used_meta":336557,"kb_avail":1124593748,"statfs":{"total":1151940427776,"available":1151583997952,"internally_reserved":0,"allocated":11579392,"data_stored":7559285,"data_compressed":390438,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19143,"internal_metadata":344634681},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":54391,"num_objects":40,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":148,"num_read_kb":145,"num_write":117,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003659"},"pg_stats":[{"pgid":"2.1f","version":"83'13","reported_seq":60,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:48:00.565556+0000","last_change":"2024-09-21T05:47:03.620705+0000","last_active":"2024-09-21T05:48:00.565556+0000","last_peered":"2024-09-21T05:48:00.565556+0000","last_clean":"2024-09-21T05:48:00.565556+0000","last_became_active":"2024-09-21T05:47:03.620320+0000","last_became_peered":"2024-09-21T05:47:03.620320+0000","last_unstale":"2024-09-21T05:48:00.565556+0000","last_undegraded":"2024-09-21T05:48:00.565556+0000","last_fullsized":"2024-09-21T05:48:00.565556+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:31.684225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.388569+0000","last_change":"2024-09-21T05:47:05.637251+0000","last_active":"2024-09-21T05:47:38.388569+0000","last_peered":"2024-09-21T05:47:38.388569+0000","last_clean":"2024-09-21T05:47:38.388569+0000","last_became_active":"2024-09-21T05:47:05.636867+0000","last_became_peered":"2024-09-21T05:47:05.636867+0000","last_unstale":"2024-09-21T05:47:38.388569+0000","last_undegraded":"2024-09-21T05:47:38.388569+0000","last_fullsized":"2024-09-21T05:47:38.388569+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:08.538209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.388057+0000","last_change":"2024-09-21T05:47:12.676224+0000","last_active":"2024-09-21T05:47:38.388057+0000","last_peered":"2024-09-21T05:47:38.388057+0000","last_clean":"2024-09-21T05:47:38.388057+0000","last_became_active":"2024-09-21T05:47:12.675565+0000","last_became_peered":"2024-09-21T05:47:12.675565+0000","last_unstale":"2024-09-21T05:47:38.388057+0000","last_undegraded":"2024-09-21T05:47:38.388057+0000","last_fullsized":"2024-09-21T05:47:38.388057+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:37.684953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.388803+0000","last_change":"2024-09-21T05:47:03.670289+0000","last_active":"2024-09-21T05:47:38.388803+0000","last_peered":"2024-09-21T05:47:38.388803+0000","last_clean":"2024-09-21T05:47:38.388803+0000","last_became_active":"2024-09-21T05:47:03.669881+0000","last_became_peered":"2024-09-21T05:47:03.669881+0000","last_unstale":"2024-09-21T05:47:38.388803+0000","last_undegraded":"2024-09-21T05:47:38.388803+0000","last_fullsized":"2024-09-21T05:47:38.388803+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:12.597766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.391933+0000","last_change":"2024-09-21T05:47:05.640826+0000","last_active":"2024-09-21T05:47:38.391933+0000","last_peered":"2024-09-21T05:47:38.391933+0000","last_clean":"2024-09-21T05:47:38.391933+0000","last_became_active":"2024-09-21T05:47:05.640357+0000","last_became_peered":"2024-09-21T05:47:05.640357+0000","last_unstale":"2024-09-21T05:47:38.391933+0000","last_undegraded":"2024-09-21T05:47:38.391933+0000","last_fullsized":"2024-09-21T05:47:38.391933+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:16.434030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.393211+0000","last_change":"2024-09-21T05:47:12.677260+0000","last_active":"2024-09-21T05:47:38.393211+0000","last_peered":"2024-09-21T05:47:38.393211+0000","last_clean":"2024-09-21T05:47:38.393211+0000","last_became_active":"2024-09-21T05:47:12.676599+0000","last_became_peered":"2024-09-21T05:47:12.676599+0000","last_unstale":"2024-09-21T05:47:38.393211+0000","last_undegraded":"2024-09-21T05:47:38.393211+0000","last_fullsized":"2024-09-21T05:47:38.393211+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:10.644801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":48,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:50.539541+0000","last_change":"2024-09-21T05:47:03.619903+0000","last_active":"2024-09-21T05:47:50.539541+0000","last_peered":"2024-09-21T05:47:50.539541+0000","last_clean":"2024-09-21T05:47:50.539541+0000","last_became_active":"2024-09-21T05:47:03.619476+0000","last_became_peered":"2024-09-21T05:47:03.619476+0000","last_unstale":"2024-09-21T05:47:50.539541+0000","last_undegraded":"2024-09-21T05:47:50.539541+0000","last_fullsized":"2024-09-21T05:47:50.539541+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:09.717552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.388708+0000","last_change":"2024-09-21T05:47:05.646017+0000","last_active":"2024-09-21T05:47:38.388708+0000","last_peered":"2024-09-21T05:47:38.388708+0000","last_clean":"2024-09-21T05:47:38.388708+0000","last_became_active":"2024-09-21T05:47:05.644118+0000","last_became_peered":"2024-09-21T05:47:05.644118+0000","last_unstale":"2024-09-21T05:47:38.388708+0000","last_undegraded":"2024-09-21T05:47:38.388708+0000","last_fullsized":"2024-09-21T05:47:38.388708+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:52.908664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.394481+0000","last_change":"2024-09-21T05:47:12.677555+0000","last_active":"2024-09-21T05:47:38.394481+0000","last_peered":"2024-09-21T05:47:38.394481+0000","last_clean":"2024-09-21T05:47:38.394481+0000","last_became_active":"2024-09-21T05:47:12.676886+0000","last_became_peered":"2024-09-21T05:47:12.676886+0000","last_unstale":"2024-09-21T05:47:38.394481+0000","last_undegraded":"2024-09-21T05:47:38.394481+0000","last_fullsized":"2024-09-21T05:47:38.394481+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:10:24.516641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:49.546553+0000","last_change":"2024-09-21T05:47:03.621556+0000","last_active":"2024-09-21T05:47:49.546553+0000","last_peered":"2024-09-21T05:47:49.546553+0000","last_clean":"2024-09-21T05:47:49.546553+0000","last_became_active":"2024-09-21T05:47:03.621101+0000","last_became_peered":"2024-09-21T05:47:03.621101+0000","last_unstale":"2024-09-21T05:47:49.546553+0000","last_undegraded":"2024-09-21T05:47:49.546553+0000","last_fullsized":"2024-09-21T05:47:49.546553+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:39:23.639431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.391588+0000","last_change":"2024-09-21T05:47:05.646328+0000","last_active":"2024-09-21T05:47:38.391588+0000","last_peered":"2024-09-21T05:47:38.391588+0000","last_clean":"2024-09-21T05:47:38.391588+0000","last_became_active":"2024-09-21T05:47:05.645922+0000","last_became_peered":"2024-09-21T05:47:05.645922+0000","last_unstale":"2024-09-21T05:47:38.391588+0000","last_undegraded":"2024-09-21T05:47:38.391588+0000","last_fullsized":"2024-09-21T05:47:38.391588+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:43.801707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.393850+0000","last_change":"2024-09-21T05:47:12.673555+0000","last_active":"2024-09-21T05:47:38.393850+0000","last_peered":"2024-09-21T05:47:38.393850+0000","last_clean":"2024-09-21T05:47:38.393850+0000","last_became_active":"2024-09-21T05:47:12.673065+0000","last_became_peered":"2024-09-21T05:47:12.673065+0000","last_unstale":"2024-09-21T05:47:38.393850+0000","last_undegraded":"2024-09-21T05:47:38.393850+0000","last_fullsized":"2024-09-21T05:47:38.393850+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:53.548779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.731161+0000","last_change":"2024-09-21T05:47:05.645376+0000","last_active":"2024-09-21T05:47:38.731161+0000","last_peered":"2024-09-21T05:47:38.731161+0000","last_clean":"2024-09-21T05:47:38.731161+0000","last_became_active":"2024-09-21T05:47:05.644800+0000","last_became_peered":"2024-09-21T05:47:05.644800+0000","last_unstale":"2024-09-21T05:47:38.731161+0000","last_undegraded":"2024-09-21T05:47:38.731161+0000","last_fullsized":"2024-09-21T05:47:38.731161+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:10.460407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:46.518325+0000","last_change":"2024-09-21T05:47:03.619926+0000","last_active":"2024-09-21T05:47:46.518325+0000","last_peered":"2024-09-21T05:47:46.518325+0000","last_clean":"2024-09-21T05:47:46.518325+0000","last_became_active":"2024-09-21T05:47:03.619433+0000","last_became_peered":"2024-09-21T05:47:03.619433+0000","last_unstale":"2024-09-21T05:47:46.518325+0000","last_undegraded":"2024-09-21T05:47:46.518325+0000","last_fullsized":"2024-09-21T05:47:46.518325+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:33.792874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.395697+0000","last_change":"2024-09-21T05:47:12.874200+0000","last_active":"2024-09-21T05:47:38.395697+0000","last_peered":"2024-09-21T05:47:38.395697+0000","last_clean":"2024-09-21T05:47:38.395697+0000","last_became_active":"2024-09-21T05:47:12.873563+0000","last_became_peered":"2024-09-21T05:47:12.873563+0000","last_unstale":"2024-09-21T05:47:38.395697+0000","last_undegraded":"2024-09-21T05:47:38.395697+0000","last_fullsized":"2024-09-21T05:47:38.395697+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:34.839934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.388118+0000","last_change":"2024-09-21T05:47:05.639033+0000","last_active":"2024-09-21T05:47:38.388118+0000","last_peered":"2024-09-21T05:47:38.388118+0000","last_clean":"2024-09-21T05:47:38.388118+0000","last_became_active":"2024-09-21T05:47:05.637433+0000","last_became_peered":"2024-09-21T05:47:05.637433+0000","last_unstale":"2024-09-21T05:47:38.388118+0000","last_undegraded":"2024-09-21T05:47:38.388118+0000","last_fullsized":"2024-09-21T05:47:38.388118+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:55.181025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:48.536185+0000","last_change":"2024-09-21T05:47:03.614460+0000","last_active":"2024-09-21T05:47:48.536185+0000","last_peered":"2024-09-21T05:47:48.536185+0000","last_clean":"2024-09-21T05:47:48.536185+0000","last_became_active":"2024-09-21T05:47:03.613975+0000","last_became_peered":"2024-09-21T05:47:03.613975+0000","last_unstale":"2024-09-21T05:47:48.536185+0000","last_undegraded":"2024-09-21T05:47:48.536185+0000","last_fullsized":"2024-09-21T05:47:48.536185+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:26.838907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.733785+0000","last_change":"2024-09-21T05:47:38.733044+0000","last_active":"2024-09-21T05:47:38.733785+0000","last_peered":"2024-09-21T05:47:38.733785+0000","last_clean":"2024-09-21T05:47:38.733785+0000","last_became_active":"2024-09-21T05:47:38.732327+0000","last_became_peered":"2024-09-21T05:47:38.732327+0000","last_unstale":"2024-09-21T05:47:38.733785+0000","last_undegraded":"2024-09-21T05:47:38.733785+0000","last_fullsized":"2024-09-21T05:47:38.733785+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:59.462529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.393398+0000","last_change":"2024-09-21T05:47:05.631831+0000","last_active":"2024-09-21T05:47:38.393398+0000","last_peered":"2024-09-21T05:47:38.393398+0000","last_clean":"2024-09-21T05:47:38.393398+0000","last_became_active":"2024-09-21T05:47:05.630403+0000","last_became_peered":"2024-09-21T05:47:05.630403+0000","last_unstale":"2024-09-21T05:47:38.393398+0000","last_undegraded":"2024-09-21T05:47:38.393398+0000","last_fullsized":"2024-09-21T05:47:38.393398+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:21.163262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:49.545344+0000","last_change":"2024-09-21T05:47:03.618888+0000","last_active":"2024-09-21T05:47:49.545344+0000","last_peered":"2024-09-21T05:47:49.545344+0000","last_clean":"2024-09-21T05:47:49.545344+0000","last_became_active":"2024-09-21T05:47:03.618506+0000","last_became_peered":"2024-09-21T05:47:03.618506+0000","last_unstale":"2024-09-21T05:47:49.545344+0000","last_undegraded":"2024-09-21T05:47:49.545344+0000","last_fullsized":"2024-09-21T05:47:49.545344+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:52.711976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.392444+0000","last_change":"2024-09-21T05:47:12.675649+0000","last_active":"2024-09-21T05:47:38.392444+0000","last_peered":"2024-09-21T05:47:38.392444+0000","last_clean":"2024-09-21T05:47:38.392444+0000","last_became_active":"2024-09-21T05:47:12.675268+0000","last_became_peered":"2024-09-21T05:47:12.675268+0000","last_unstale":"2024-09-21T05:47:38.392444+0000","last_undegraded":"2024-09-21T05:47:38.392444+0000","last_fullsized":"2024-09-21T05:47:38.392444+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:48:31.481292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.394026+0000","last_change":"2024-09-21T05:47:05.622838+0000","last_active":"2024-09-21T05:47:38.394026+0000","last_peered":"2024-09-21T05:47:38.394026+0000","last_clean":"2024-09-21T05:47:38.394026+0000","last_became_active":"2024-09-21T05:47:05.622216+0000","last_became_peered":"2024-09-21T05:47:05.622216+0000","last_unstale":"2024-09-21T05:47:38.394026+0000","last_undegraded":"2024-09-21T05:47:38.394026+0000","last_fullsized":"2024-09-21T05:47:38.394026+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:55.446747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:46.516723+0000","last_change":"2024-09-21T05:47:03.670405+0000","last_active":"2024-09-21T05:47:46.516723+0000","last_peered":"2024-09-21T05:47:46.516723+0000","last_clean":"2024-09-21T05:47:46.516723+0000","last_became_active":"2024-09-21T05:47:03.669958+0000","last_became_peered":"2024-09-21T05:47:03.669958+0000","last_unstale":"2024-09-21T05:47:46.516723+0000","last_undegraded":"2024-09-21T05:47:46.516723+0000","last_fullsized":"2024-09-21T05:47:46.516723+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:25.702903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.399170+0000","last_change":"2024-09-21T05:47:38.399039+0000","last_active":"2024-09-21T05:47:38.399170+0000","last_peered":"2024-09-21T05:47:38.399170+0000","last_clean":"2024-09-21T05:47:38.399170+0000","last_became_active":"2024-09-21T05:47:38.398441+0000","last_became_peered":"2024-09-21T05:47:38.398441+0000","last_unstale":"2024-09-21T05:47:38.399170+0000","last_undegraded":"2024-09-21T05:47:38.399170+0000","last_fullsized":"2024-09-21T05:47:38.399170+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:11.095516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,8],"acting":[4,5,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.392217+0000","last_change":"2024-09-21T05:47:05.632911+0000","last_active":"2024-09-21T05:47:38.392217+0000","last_peered":"2024-09-21T05:47:38.392217+0000","last_clean":"2024-09-21T05:47:38.392217+0000","last_became_active":"2024-09-21T05:47:05.632256+0000","last_became_peered":"2024-09-21T05:47:05.632256+0000","last_unstale":"2024-09-21T05:47:38.392217+0000","last_undegraded":"2024-09-21T05:47:38.392217+0000","last_fullsized":"2024-09-21T05:47:38.392217+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:41.014253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:49.545014+0000","last_change":"2024-09-21T05:47:04.411753+0000","last_active":"2024-09-21T05:47:49.545014+0000","last_peered":"2024-09-21T05:47:49.545014+0000","last_clean":"2024-09-21T05:47:49.545014+0000","last_became_active":"2024-09-21T05:47:04.411225+0000","last_became_peered":"2024-09-21T05:47:04.411225+0000","last_unstale":"2024-09-21T05:47:49.545014+0000","last_undegraded":"2024-09-21T05:47:49.545014+0000","last_fullsized":"2024-09-21T05:47:49.545014+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:07.964184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.388266+0000","last_change":"2024-09-21T05:47:12.670157+0000","last_active":"2024-09-21T05:47:38.388266+0000","last_peered":"2024-09-21T05:47:38.388266+0000","last_clean":"2024-09-21T05:47:38.388266+0000","last_became_active":"2024-09-21T05:47:12.669710+0000","last_became_peered":"2024-09-21T05:47:12.669710+0000","last_unstale":"2024-09-21T05:47:38.388266+0000","last_undegraded":"2024-09-21T05:47:38.388266+0000","last_fullsized":"2024-09-21T05:47:38.388266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:31.023624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.388647+0000","last_change":"2024-09-21T05:47:05.637982+0000","last_active":"2024-09-21T05:47:38.388647+0000","last_peered":"2024-09-21T05:47:38.388647+0000","last_clean":"2024-09-21T05:47:38.388647+0000","last_became_active":"2024-09-21T05:47:05.637357+0000","last_became_peered":"2024-09-21T05:47:05.637357+0000","last_unstale":"2024-09-21T05:47:38.388647+0000","last_undegraded":"2024-09-21T05:47:38.388647+0000","last_fullsized":"2024-09-21T05:47:38.388647+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:41:12.986231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"83'13","reported_seq":47,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:59.631753+0000","last_change":"2024-09-21T05:47:03.611556+0000","last_active":"2024-09-21T05:47:59.631753+0000","last_peered":"2024-09-21T05:47:59.631753+0000","last_clean":"2024-09-21T05:47:59.631753+0000","last_became_active":"2024-09-21T05:47:03.611192+0000","last_became_peered":"2024-09-21T05:47:03.611192+0000","last_unstale":"2024-09-21T05:47:59.631753+0000","last_undegraded":"2024-09-21T05:47:59.631753+0000","last_fullsized":"2024-09-21T05:47:59.631753+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:20.047405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.387623+0000","last_change":"2024-09-21T05:47:12.874796+0000","last_active":"2024-09-21T05:47:38.387623+0000","last_peered":"2024-09-21T05:47:38.387623+0000","last_clean":"2024-09-21T05:47:38.387623+0000","last_became_active":"2024-09-21T05:47:12.873648+0000","last_became_peered":"2024-09-21T05:47:12.873648+0000","last_unstale":"2024-09-21T05:47:38.387623+0000","last_undegraded":"2024-09-21T05:47:38.387623+0000","last_fullsized":"2024-09-21T05:47:38.387623+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:50.591584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.730746+0000","last_change":"2024-09-21T05:47:05.634289+0000","last_active":"2024-09-21T05:47:38.730746+0000","last_peered":"2024-09-21T05:47:38.730746+0000","last_clean":"2024-09-21T05:47:38.730746+0000","last_became_active":"2024-09-21T05:47:05.633971+0000","last_became_peered":"2024-09-21T05:47:05.633971+0000","last_unstale":"2024-09-21T05:47:38.730746+0000","last_undegraded":"2024-09-21T05:47:38.730746+0000","last_fullsized":"2024-09-21T05:47:38.730746+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:53.819753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:49.546325+0000","last_change":"2024-09-21T05:47:03.671877+0000","last_active":"2024-09-21T05:47:49.546325+0000","last_peered":"2024-09-21T05:47:49.546325+0000","last_clean":"2024-09-21T05:47:49.546325+0000","last_became_active":"2024-09-21T05:47:03.671443+0000","last_became_peered":"2024-09-21T05:47:03.671443+0000","last_unstale":"2024-09-21T05:47:49.546325+0000","last_undegraded":"2024-09-21T05:47:49.546325+0000","last_fullsized":"2024-09-21T05:47:49.546325+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:00.114953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.393293+0000","last_change":"2024-09-21T05:47:12.673004+0000","last_active":"2024-09-21T05:47:38.393293+0000","last_peered":"2024-09-21T05:47:38.393293+0000","last_clean":"2024-09-21T05:47:38.393293+0000","last_became_active":"2024-09-21T05:47:12.671784+0000","last_became_peered":"2024-09-21T05:47:12.671784+0000","last_unstale":"2024-09-21T05:47:38.393293+0000","last_undegraded":"2024-09-21T05:47:38.393293+0000","last_fullsized":"2024-09-21T05:47:38.393293+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:38.672438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.394216+0000","last_change":"2024-09-21T05:47:05.635204+0000","last_active":"2024-09-21T05:47:38.394216+0000","last_peered":"2024-09-21T05:47:38.394216+0000","last_clean":"2024-09-21T05:47:38.394216+0000","last_became_active":"2024-09-21T05:47:05.634794+0000","last_became_peered":"2024-09-21T05:47:05.634794+0000","last_unstale":"2024-09-21T05:47:38.394216+0000","last_undegraded":"2024-09-21T05:47:38.394216+0000","last_fullsized":"2024-09-21T05:47:38.394216+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:08.208843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.391949+0000","last_change":"2024-09-21T05:47:03.671864+0000","last_active":"2024-09-21T05:47:38.391949+0000","last_peered":"2024-09-21T05:47:38.391949+0000","last_clean":"2024-09-21T05:47:38.391949+0000","last_became_active":"2024-09-21T05:47:03.671510+0000","last_became_peered":"2024-09-21T05:47:03.671510+0000","last_unstale":"2024-09-21T05:47:38.391949+0000","last_undegraded":"2024-09-21T05:47:38.391949+0000","last_fullsized":"2024-09-21T05:47:38.391949+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:12.831235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.398832+0000","last_change":"2024-09-21T05:47:38.398708+0000","last_active":"2024-09-21T05:47:38.398832+0000","last_peered":"2024-09-21T05:47:38.398832+0000","last_clean":"2024-09-21T05:47:38.398832+0000","last_became_active":"2024-09-21T05:47:38.398211+0000","last_became_peered":"2024-09-21T05:47:38.398211+0000","last_unstale":"2024-09-21T05:47:38.398832+0000","last_undegraded":"2024-09-21T05:47:38.398832+0000","last_fullsized":"2024-09-21T05:47:38.398832+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:29.250191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.395121+0000","last_change":"2024-09-21T05:47:05.633069+0000","last_active":"2024-09-21T05:47:38.395121+0000","last_peered":"2024-09-21T05:47:38.395121+0000","last_clean":"2024-09-21T05:47:38.395121+0000","last_became_active":"2024-09-21T05:47:05.632698+0000","last_became_peered":"2024-09-21T05:47:05.632698+0000","last_unstale":"2024-09-21T05:47:38.395121+0000","last_undegraded":"2024-09-21T05:47:38.395121+0000","last_fullsized":"2024-09-21T05:47:38.395121+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:04.081062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'5","reported_seq":52,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:59.564733+0000","last_change":"2024-09-21T05:47:03.622490+0000","last_active":"2024-09-21T05:47:59.564733+0000","last_peered":"2024-09-21T05:47:59.564733+0000","last_clean":"2024-09-21T05:47:59.564733+0000","last_became_active":"2024-09-21T05:47:03.622093+0000","last_became_peered":"2024-09-21T05:47:03.622093+0000","last_unstale":"2024-09-21T05:47:59.564733+0000","last_undegraded":"2024-09-21T05:47:59.564733+0000","last_fullsized":"2024-09-21T05:47:59.564733+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:40.500152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.730583+0000","last_change":"2024-09-21T05:47:12.670060+0000","last_active":"2024-09-21T05:47:38.730583+0000","last_peered":"2024-09-21T05:47:38.730583+0000","last_clean":"2024-09-21T05:47:38.730583+0000","last_became_active":"2024-09-21T05:47:12.669635+0000","last_became_peered":"2024-09-21T05:47:12.669635+0000","last_unstale":"2024-09-21T05:47:38.730583+0000","last_undegraded":"2024-09-21T05:47:38.730583+0000","last_fullsized":"2024-09-21T05:47:38.730583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:14.786984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.390489+0000","last_change":"2024-09-21T05:47:05.640553+0000","last_active":"2024-09-21T05:47:38.390489+0000","last_peered":"2024-09-21T05:47:38.390489+0000","last_clean":"2024-09-21T05:47:38.390489+0000","last_became_active":"2024-09-21T05:47:05.640151+0000","last_became_peered":"2024-09-21T05:47:05.640151+0000","last_unstale":"2024-09-21T05:47:38.390489+0000","last_undegraded":"2024-09-21T05:47:38.390489+0000","last_fullsized":"2024-09-21T05:47:38.390489+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:39.904129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":50,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:57.563858+0000","last_change":"2024-09-21T05:47:03.670178+0000","last_active":"2024-09-21T05:47:57.563858+0000","last_peered":"2024-09-21T05:47:57.563858+0000","last_clean":"2024-09-21T05:47:57.563858+0000","last_became_active":"2024-09-21T05:47:03.669715+0000","last_became_peered":"2024-09-21T05:47:03.669715+0000","last_unstale":"2024-09-21T05:47:57.563858+0000","last_undegraded":"2024-09-21T05:47:57.563858+0000","last_fullsized":"2024-09-21T05:47:57.563858+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:31.457820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.731258+0000","last_change":"2024-09-21T05:47:12.875173+0000","last_active":"2024-09-21T05:47:38.731258+0000","last_peered":"2024-09-21T05:47:38.731258+0000","last_clean":"2024-09-21T05:47:38.731258+0000","last_became_active":"2024-09-21T05:47:12.873749+0000","last_became_peered":"2024-09-21T05:47:12.873749+0000","last_unstale":"2024-09-21T05:47:38.731258+0000","last_undegraded":"2024-09-21T05:47:38.731258+0000","last_fullsized":"2024-09-21T05:47:38.731258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:33.473645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.730016+0000","last_change":"2024-09-21T05:47:05.634346+0000","last_active":"2024-09-21T05:47:38.730016+0000","last_peered":"2024-09-21T05:47:38.730016+0000","last_clean":"2024-09-21T05:47:38.730016+0000","last_became_active":"2024-09-21T05:47:05.634004+0000","last_became_peered":"2024-09-21T05:47:05.634004+0000","last_unstale":"2024-09-21T05:47:38.730016+0000","last_undegraded":"2024-09-21T05:47:38.730016+0000","last_fullsized":"2024-09-21T05:47:38.730016+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:16.328729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:47.529024+0000","last_change":"2024-09-21T05:47:03.619472+0000","last_active":"2024-09-21T05:47:47.529024+0000","last_peered":"2024-09-21T05:47:47.529024+0000","last_clean":"2024-09-21T05:47:47.529024+0000","last_became_active":"2024-09-21T05:47:03.619077+0000","last_became_peered":"2024-09-21T05:47:03.619077+0000","last_unstale":"2024-09-21T05:47:47.529024+0000","last_undegraded":"2024-09-21T05:47:47.529024+0000","last_fullsized":"2024-09-21T05:47:47.529024+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:17.774462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.731291+0000","last_change":"2024-09-21T05:47:38.730714+0000","last_active":"2024-09-21T05:47:38.731291+0000","last_peered":"2024-09-21T05:47:38.731291+0000","last_clean":"2024-09-21T05:47:38.731291+0000","last_became_active":"2024-09-21T05:47:38.730271+0000","last_became_peered":"2024-09-21T05:47:38.730271+0000","last_unstale":"2024-09-21T05:47:38.731291+0000","last_undegraded":"2024-09-21T05:47:38.731291+0000","last_fullsized":"2024-09-21T05:47:38.731291+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:53.391967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.387996+0000","last_change":"2024-09-21T05:47:05.642487+0000","last_active":"2024-09-21T05:47:38.387996+0000","last_peered":"2024-09-21T05:47:38.387996+0000","last_clean":"2024-09-21T05:47:38.387996+0000","last_became_active":"2024-09-21T05:47:05.642022+0000","last_became_peered":"2024-09-21T05:47:05.642022+0000","last_unstale":"2024-09-21T05:47:38.387996+0000","last_undegraded":"2024-09-21T05:47:38.387996+0000","last_fullsized":"2024-09-21T05:47:38.387996+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:50:38.435444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:50.546973+0000","last_change":"2024-09-21T05:47:03.618333+0000","last_active":"2024-09-21T05:47:50.546973+0000","last_peered":"2024-09-21T05:47:50.546973+0000","last_clean":"2024-09-21T05:47:50.546973+0000","last_became_active":"2024-09-21T05:47:03.617843+0000","last_became_peered":"2024-09-21T05:47:03.617843+0000","last_unstale":"2024-09-21T05:47:50.546973+0000","last_undegraded":"2024-09-21T05:47:50.546973+0000","last_fullsized":"2024-09-21T05:47:50.546973+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:01.647913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":110,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.730988+0000","last_change":"2024-09-21T05:45:52.661435+0000","last_active":"2024-09-21T05:47:38.730988+0000","last_peered":"2024-09-21T05:47:38.730988+0000","last_clean":"2024-09-21T05:47:38.730988+0000","last_became_active":"2024-09-21T05:45:52.656767+0000","last_became_peered":"2024-09-21T05:45:52.656767+0000","last_unstale":"2024-09-21T05:47:38.730988+0000","last_undegraded":"2024-09-21T05:47:38.730988+0000","last_fullsized":"2024-09-21T05:47:38.730988+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:42:26.045146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:42:26.045146+0000","last_clean_scrub_stamp":"2024-09-21T05:42:26.045146+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:40:12.152499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.731030+0000","last_change":"2024-09-21T05:47:12.675435+0000","last_active":"2024-09-21T05:47:38.731030+0000","last_peered":"2024-09-21T05:47:38.731030+0000","last_clean":"2024-09-21T05:47:38.731030+0000","last_became_active":"2024-09-21T05:47:12.674955+0000","last_became_peered":"2024-09-21T05:47:12.674955+0000","last_unstale":"2024-09-21T05:47:38.731030+0000","last_undegraded":"2024-09-21T05:47:38.731030+0000","last_fullsized":"2024-09-21T05:47:38.731030+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:18.758498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.731436+0000","last_change":"2024-09-21T05:47:05.640952+0000","last_active":"2024-09-21T05:47:38.731436+0000","last_peered":"2024-09-21T05:47:38.731436+0000","last_clean":"2024-09-21T05:47:38.731436+0000","last_became_active":"2024-09-21T05:47:05.640554+0000","last_became_peered":"2024-09-21T05:47:05.640554+0000","last_unstale":"2024-09-21T05:47:38.731436+0000","last_undegraded":"2024-09-21T05:47:38.731436+0000","last_fullsized":"2024-09-21T05:47:38.731436+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:15:08.553651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'5","reported_seq":51,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:58.564696+0000","last_change":"2024-09-21T05:47:04.411605+0000","last_active":"2024-09-21T05:47:58.564696+0000","last_peered":"2024-09-21T05:47:58.564696+0000","last_clean":"2024-09-21T05:47:58.564696+0000","last_became_active":"2024-09-21T05:47:04.411129+0000","last_became_peered":"2024-09-21T05:47:04.411129+0000","last_unstale":"2024-09-21T05:47:58.564696+0000","last_undegraded":"2024-09-21T05:47:58.564696+0000","last_fullsized":"2024-09-21T05:47:58.564696+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:25.469148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.388557+0000","last_change":"2024-09-21T05:47:12.670479+0000","last_active":"2024-09-21T05:47:38.388557+0000","last_peered":"2024-09-21T05:47:38.388557+0000","last_clean":"2024-09-21T05:47:38.388557+0000","last_became_active":"2024-09-21T05:47:12.669925+0000","last_became_peered":"2024-09-21T05:47:12.669925+0000","last_unstale":"2024-09-21T05:47:38.388557+0000","last_undegraded":"2024-09-21T05:47:38.388557+0000","last_fullsized":"2024-09-21T05:47:38.388557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:50.506063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.731196+0000","last_change":"2024-09-21T05:47:05.634519+0000","last_active":"2024-09-21T05:47:38.731196+0000","last_peered":"2024-09-21T05:47:38.731196+0000","last_clean":"2024-09-21T05:47:38.731196+0000","last_became_active":"2024-09-21T05:47:05.634134+0000","last_became_peered":"2024-09-21T05:47:05.634134+0000","last_unstale":"2024-09-21T05:47:38.731196+0000","last_undegraded":"2024-09-21T05:47:38.731196+0000","last_fullsized":"2024-09-21T05:47:38.731196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:57.464884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:49.545372+0000","last_change":"2024-09-21T05:47:03.622860+0000","last_active":"2024-09-21T05:47:49.545372+0000","last_peered":"2024-09-21T05:47:49.545372+0000","last_clean":"2024-09-21T05:47:49.545372+0000","last_became_active":"2024-09-21T05:47:03.622435+0000","last_became_peered":"2024-09-21T05:47:03.622435+0000","last_unstale":"2024-09-21T05:47:49.545372+0000","last_undegraded":"2024-09-21T05:47:49.545372+0000","last_fullsized":"2024-09-21T05:47:49.545372+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:03.352140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.392040+0000","last_change":"2024-09-21T05:47:12.673518+0000","last_active":"2024-09-21T05:47:38.392040+0000","last_peered":"2024-09-21T05:47:38.392040+0000","last_clean":"2024-09-21T05:47:38.392040+0000","last_became_active":"2024-09-21T05:47:12.673000+0000","last_became_peered":"2024-09-21T05:47:12.673000+0000","last_unstale":"2024-09-21T05:47:38.392040+0000","last_undegraded":"2024-09-21T05:47:38.392040+0000","last_fullsized":"2024-09-21T05:47:38.392040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:37.859801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.731674+0000","last_change":"2024-09-21T05:47:05.625144+0000","last_active":"2024-09-21T05:47:38.731674+0000","last_peered":"2024-09-21T05:47:38.731674+0000","last_clean":"2024-09-21T05:47:38.731674+0000","last_became_active":"2024-09-21T05:47:05.624593+0000","last_became_peered":"2024-09-21T05:47:05.624593+0000","last_unstale":"2024-09-21T05:47:38.731674+0000","last_undegraded":"2024-09-21T05:47:38.731674+0000","last_fullsized":"2024-09-21T05:47:38.731674+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:04.332686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:49.545189+0000","last_change":"2024-09-21T05:47:03.612389+0000","last_active":"2024-09-21T05:47:49.545189+0000","last_peered":"2024-09-21T05:47:49.545189+0000","last_clean":"2024-09-21T05:47:49.545189+0000","last_became_active":"2024-09-21T05:47:03.612023+0000","last_became_peered":"2024-09-21T05:47:03.612023+0000","last_unstale":"2024-09-21T05:47:49.545189+0000","last_undegraded":"2024-09-21T05:47:49.545189+0000","last_fullsized":"2024-09-21T05:47:49.545189+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:32.571903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.390278+0000","last_change":"2024-09-21T05:47:12.674963+0000","last_active":"2024-09-21T05:47:38.390278+0000","last_peered":"2024-09-21T05:47:38.390278+0000","last_clean":"2024-09-21T05:47:38.390278+0000","last_became_active":"2024-09-21T05:47:12.673883+0000","last_became_peered":"2024-09-21T05:47:12.673883+0000","last_unstale":"2024-09-21T05:47:38.390278+0000","last_undegraded":"2024-09-21T05:47:38.390278+0000","last_fullsized":"2024-09-21T05:47:38.390278+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:29.843443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.394407+0000","last_change":"2024-09-21T05:47:05.638440+0000","last_active":"2024-09-21T05:47:38.394407+0000","last_peered":"2024-09-21T05:47:38.394407+0000","last_clean":"2024-09-21T05:47:38.394407+0000","last_became_active":"2024-09-21T05:47:05.638010+0000","last_became_peered":"2024-09-21T05:47:05.638010+0000","last_unstale":"2024-09-21T05:47:38.394407+0000","last_undegraded":"2024-09-21T05:47:38.394407+0000","last_fullsized":"2024-09-21T05:47:38.394407+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:47.921461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:49.522786+0000","last_change":"2024-09-21T05:47:03.613800+0000","last_active":"2024-09-21T05:47:49.522786+0000","last_peered":"2024-09-21T05:47:49.522786+0000","last_clean":"2024-09-21T05:47:49.522786+0000","last_became_active":"2024-09-21T05:47:03.613377+0000","last_became_peered":"2024-09-21T05:47:03.613377+0000","last_unstale":"2024-09-21T05:47:49.522786+0000","last_undegraded":"2024-09-21T05:47:49.522786+0000","last_fullsized":"2024-09-21T05:47:49.522786+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:25.467703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.390473+0000","last_change":"2024-09-21T05:47:12.675362+0000","last_active":"2024-09-21T05:47:38.390473+0000","last_peered":"2024-09-21T05:47:38.390473+0000","last_clean":"2024-09-21T05:47:38.390473+0000","last_became_active":"2024-09-21T05:47:12.674578+0000","last_became_peered":"2024-09-21T05:47:12.674578+0000","last_unstale":"2024-09-21T05:47:38.390473+0000","last_undegraded":"2024-09-21T05:47:38.390473+0000","last_fullsized":"2024-09-21T05:47:38.390473+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:56.654323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.390703+0000","last_change":"2024-09-21T05:47:05.641130+0000","last_active":"2024-09-21T05:47:38.390703+0000","last_peered":"2024-09-21T05:47:38.390703+0000","last_clean":"2024-09-21T05:47:38.390703+0000","last_became_active":"2024-09-21T05:47:05.640794+0000","last_became_peered":"2024-09-21T05:47:05.640794+0000","last_unstale":"2024-09-21T05:47:38.390703+0000","last_undegraded":"2024-09-21T05:47:38.390703+0000","last_fullsized":"2024-09-21T05:47:38.390703+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:29:18.243240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:49.546100+0000","last_change":"2024-09-21T05:47:03.671834+0000","last_active":"2024-09-21T05:47:49.546100+0000","last_peered":"2024-09-21T05:47:49.546100+0000","last_clean":"2024-09-21T05:47:49.546100+0000","last_became_active":"2024-09-21T05:47:03.671437+0000","last_became_peered":"2024-09-21T05:47:03.671437+0000","last_unstale":"2024-09-21T05:47:49.546100+0000","last_undegraded":"2024-09-21T05:47:49.546100+0000","last_fullsized":"2024-09-21T05:47:49.546100+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:40.362718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.731182+0000","last_change":"2024-09-21T05:47:12.671181+0000","last_active":"2024-09-21T05:47:38.731182+0000","last_peered":"2024-09-21T05:47:38.731182+0000","last_clean":"2024-09-21T05:47:38.731182+0000","last_became_active":"2024-09-21T05:47:12.670522+0000","last_became_peered":"2024-09-21T05:47:12.670522+0000","last_unstale":"2024-09-21T05:47:38.731182+0000","last_undegraded":"2024-09-21T05:47:38.731182+0000","last_fullsized":"2024-09-21T05:47:38.731182+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:52.165812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.730644+0000","last_change":"2024-09-21T05:47:05.629167+0000","last_active":"2024-09-21T05:47:38.730644+0000","last_peered":"2024-09-21T05:47:38.730644+0000","last_clean":"2024-09-21T05:47:38.730644+0000","last_became_active":"2024-09-21T05:47:05.628794+0000","last_became_peered":"2024-09-21T05:47:05.628794+0000","last_unstale":"2024-09-21T05:47:38.730644+0000","last_undegraded":"2024-09-21T05:47:38.730644+0000","last_fullsized":"2024-09-21T05:47:38.730644+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:51.469247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'6","reported_seq":57,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:48:01.569813+0000","last_change":"2024-09-21T05:47:03.621479+0000","last_active":"2024-09-21T05:48:01.569813+0000","last_peered":"2024-09-21T05:48:01.569813+0000","last_clean":"2024-09-21T05:48:01.569813+0000","last_became_active":"2024-09-21T05:47:03.621041+0000","last_became_peered":"2024-09-21T05:47:03.621041+0000","last_unstale":"2024-09-21T05:48:01.569813+0000","last_undegraded":"2024-09-21T05:48:01.569813+0000","last_fullsized":"2024-09-21T05:48:01.569813+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:33.092750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.392577+0000","last_change":"2024-09-21T05:47:12.669821+0000","last_active":"2024-09-21T05:47:38.392577+0000","last_peered":"2024-09-21T05:47:38.392577+0000","last_clean":"2024-09-21T05:47:38.392577+0000","last_became_active":"2024-09-21T05:47:12.669418+0000","last_became_peered":"2024-09-21T05:47:12.669418+0000","last_unstale":"2024-09-21T05:47:38.392577+0000","last_undegraded":"2024-09-21T05:47:38.392577+0000","last_fullsized":"2024-09-21T05:47:38.392577+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:57.082509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.731241+0000","last_change":"2024-09-21T05:47:05.631182+0000","last_active":"2024-09-21T05:47:38.731241+0000","last_peered":"2024-09-21T05:47:38.731241+0000","last_clean":"2024-09-21T05:47:38.731241+0000","last_became_active":"2024-09-21T05:47:05.630716+0000","last_became_peered":"2024-09-21T05:47:05.630716+0000","last_unstale":"2024-09-21T05:47:38.731241+0000","last_undegraded":"2024-09-21T05:47:38.731241+0000","last_fullsized":"2024-09-21T05:47:38.731241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:17.946858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:49.545807+0000","last_change":"2024-09-21T05:47:03.620897+0000","last_active":"2024-09-21T05:47:49.545807+0000","last_peered":"2024-09-21T05:47:49.545807+0000","last_clean":"2024-09-21T05:47:49.545807+0000","last_became_active":"2024-09-21T05:47:03.620003+0000","last_became_peered":"2024-09-21T05:47:03.620003+0000","last_unstale":"2024-09-21T05:47:49.545807+0000","last_undegraded":"2024-09-21T05:47:49.545807+0000","last_fullsized":"2024-09-21T05:47:49.545807+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:51:07.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.393910+0000","last_change":"2024-09-21T05:47:12.675320+0000","last_active":"2024-09-21T05:47:38.393910+0000","last_peered":"2024-09-21T05:47:38.393910+0000","last_clean":"2024-09-21T05:47:38.393910+0000","last_became_active":"2024-09-21T05:47:12.674715+0000","last_became_peered":"2024-09-21T05:47:12.674715+0000","last_unstale":"2024-09-21T05:47:38.393910+0000","last_undegraded":"2024-09-21T05:47:38.393910+0000","last_fullsized":"2024-09-21T05:47:38.393910+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:28.151947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.730262+0000","last_change":"2024-09-21T05:47:05.630786+0000","last_active":"2024-09-21T05:47:38.730262+0000","last_peered":"2024-09-21T05:47:38.730262+0000","last_clean":"2024-09-21T05:47:38.730262+0000","last_became_active":"2024-09-21T05:47:05.630433+0000","last_became_peered":"2024-09-21T05:47:05.630433+0000","last_unstale":"2024-09-21T05:47:38.730262+0000","last_undegraded":"2024-09-21T05:47:38.730262+0000","last_fullsized":"2024-09-21T05:47:38.730262+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:54.481462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":45,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:50.546432+0000","last_change":"2024-09-21T05:47:03.618990+0000","last_active":"2024-09-21T05:47:50.546432+0000","last_peered":"2024-09-21T05:47:50.546432+0000","last_clean":"2024-09-21T05:47:50.546432+0000","last_became_active":"2024-09-21T05:47:03.618679+0000","last_became_peered":"2024-09-21T05:47:03.618679+0000","last_unstale":"2024-09-21T05:47:50.546432+0000","last_undegraded":"2024-09-21T05:47:50.546432+0000","last_fullsized":"2024-09-21T05:47:50.546432+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:10.193233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.391491+0000","last_change":"2024-09-21T05:47:12.675012+0000","last_active":"2024-09-21T05:47:38.391491+0000","last_peered":"2024-09-21T05:47:38.391491+0000","last_clean":"2024-09-21T05:47:38.391491+0000","last_became_active":"2024-09-21T05:47:12.674266+0000","last_became_peered":"2024-09-21T05:47:12.674266+0000","last_unstale":"2024-09-21T05:47:38.391491+0000","last_undegraded":"2024-09-21T05:47:38.391491+0000","last_fullsized":"2024-09-21T05:47:38.391491+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:43.525084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.395330+0000","last_change":"2024-09-21T05:47:05.625457+0000","last_active":"2024-09-21T05:47:38.395330+0000","last_peered":"2024-09-21T05:47:38.395330+0000","last_clean":"2024-09-21T05:47:38.395330+0000","last_became_active":"2024-09-21T05:47:05.625058+0000","last_became_peered":"2024-09-21T05:47:05.625058+0000","last_unstale":"2024-09-21T05:47:38.395330+0000","last_undegraded":"2024-09-21T05:47:38.395330+0000","last_fullsized":"2024-09-21T05:47:38.395330+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:29:09.352152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"83'31","reported_seq":96,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:48:01.574905+0000","last_change":"2024-09-21T05:47:03.621535+0000","last_active":"2024-09-21T05:48:01.574905+0000","last_peered":"2024-09-21T05:48:01.574905+0000","last_clean":"2024-09-21T05:48:01.574905+0000","last_became_active":"2024-09-21T05:47:03.621109+0000","last_became_peered":"2024-09-21T05:47:03.621109+0000","last_unstale":"2024-09-21T05:48:01.574905+0000","last_undegraded":"2024-09-21T05:48:01.574905+0000","last_fullsized":"2024-09-21T05:48:01.574905+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:31:12.135760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56544,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":31,"num_read_kb":70,"num_write":33,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.391728+0000","last_change":"2024-09-21T05:47:12.676827+0000","last_active":"2024-09-21T05:47:38.391728+0000","last_peered":"2024-09-21T05:47:38.391728+0000","last_clean":"2024-09-21T05:47:38.391728+0000","last_became_active":"2024-09-21T05:47:12.676256+0000","last_became_peered":"2024-09-21T05:47:12.676256+0000","last_unstale":"2024-09-21T05:47:38.391728+0000","last_undegraded":"2024-09-21T05:47:38.391728+0000","last_fullsized":"2024-09-21T05:47:38.391728+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:40.932328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.388793+0000","last_change":"2024-09-21T05:47:05.636507+0000","last_active":"2024-09-21T05:47:38.388793+0000","last_peered":"2024-09-21T05:47:38.388793+0000","last_clean":"2024-09-21T05:47:38.388793+0000","last_became_active":"2024-09-21T05:47:05.636140+0000","last_became_peered":"2024-09-21T05:47:05.636140+0000","last_unstale":"2024-09-21T05:47:38.388793+0000","last_undegraded":"2024-09-21T05:47:38.388793+0000","last_fullsized":"2024-09-21T05:47:38.388793+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:16.879274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:48.538065+0000","last_change":"2024-09-21T05:47:03.670425+0000","last_active":"2024-09-21T05:47:48.538065+0000","last_peered":"2024-09-21T05:47:48.538065+0000","last_clean":"2024-09-21T05:47:48.538065+0000","last_became_active":"2024-09-21T05:47:03.669973+0000","last_became_peered":"2024-09-21T05:47:03.669973+0000","last_unstale":"2024-09-21T05:47:48.538065+0000","last_undegraded":"2024-09-21T05:47:48.538065+0000","last_fullsized":"2024-09-21T05:47:48.538065+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:04.212044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.394015+0000","last_change":"2024-09-21T05:47:12.677600+0000","last_active":"2024-09-21T05:47:38.394015+0000","last_peered":"2024-09-21T05:47:38.394015+0000","last_clean":"2024-09-21T05:47:38.394015+0000","last_became_active":"2024-09-21T05:47:12.677037+0000","last_became_peered":"2024-09-21T05:47:12.677037+0000","last_unstale":"2024-09-21T05:47:38.394015+0000","last_undegraded":"2024-09-21T05:47:38.394015+0000","last_fullsized":"2024-09-21T05:47:38.394015+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:36.502821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.398486+0000","last_change":"2024-09-21T05:47:38.398403+0000","last_active":"2024-09-21T05:47:38.398486+0000","last_peered":"2024-09-21T05:47:38.398486+0000","last_clean":"2024-09-21T05:47:38.398486+0000","last_became_active":"2024-09-21T05:47:38.397953+0000","last_became_peered":"2024-09-21T05:47:38.397953+0000","last_unstale":"2024-09-21T05:47:38.398486+0000","last_undegraded":"2024-09-21T05:47:38.398486+0000","last_fullsized":"2024-09-21T05:47:38.398486+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:01.550222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:49.546201+0000","last_change":"2024-09-21T05:47:03.622681+0000","last_active":"2024-09-21T05:47:49.546201+0000","last_peered":"2024-09-21T05:47:49.546201+0000","last_clean":"2024-09-21T05:47:49.546201+0000","last_became_active":"2024-09-21T05:47:03.622139+0000","last_became_peered":"2024-09-21T05:47:03.622139+0000","last_unstale":"2024-09-21T05:47:49.546201+0000","last_undegraded":"2024-09-21T05:47:49.546201+0000","last_fullsized":"2024-09-21T05:47:49.546201+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:25.678388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.390593+0000","last_change":"2024-09-21T05:47:12.670466+0000","last_active":"2024-09-21T05:47:38.390593+0000","last_peered":"2024-09-21T05:47:38.390593+0000","last_clean":"2024-09-21T05:47:38.390593+0000","last_became_active":"2024-09-21T05:47:12.670032+0000","last_became_peered":"2024-09-21T05:47:12.670032+0000","last_unstale":"2024-09-21T05:47:38.390593+0000","last_undegraded":"2024-09-21T05:47:38.390593+0000","last_fullsized":"2024-09-21T05:47:38.390593+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:18.860347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.389110+0000","last_change":"2024-09-21T05:47:05.645093+0000","last_active":"2024-09-21T05:47:38.389110+0000","last_peered":"2024-09-21T05:47:38.389110+0000","last_clean":"2024-09-21T05:47:38.389110+0000","last_became_active":"2024-09-21T05:47:05.644739+0000","last_became_peered":"2024-09-21T05:47:05.644739+0000","last_unstale":"2024-09-21T05:47:38.389110+0000","last_undegraded":"2024-09-21T05:47:38.389110+0000","last_fullsized":"2024-09-21T05:47:38.389110+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:43.895574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":62,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:48:01.568698+0000","last_change":"2024-09-21T05:47:03.619070+0000","last_active":"2024-09-21T05:48:01.568698+0000","last_peered":"2024-09-21T05:48:01.568698+0000","last_clean":"2024-09-21T05:48:01.568698+0000","last_became_active":"2024-09-21T05:47:03.618655+0000","last_became_peered":"2024-09-21T05:47:03.618655+0000","last_unstale":"2024-09-21T05:48:01.568698+0000","last_undegraded":"2024-09-21T05:48:01.568698+0000","last_fullsized":"2024-09-21T05:48:01.568698+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:29.206109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.387832+0000","last_change":"2024-09-21T05:47:12.672677+0000","last_active":"2024-09-21T05:47:38.387832+0000","last_peered":"2024-09-21T05:47:38.387832+0000","last_clean":"2024-09-21T05:47:38.387832+0000","last_became_active":"2024-09-21T05:47:12.672264+0000","last_became_peered":"2024-09-21T05:47:12.672264+0000","last_unstale":"2024-09-21T05:47:38.387832+0000","last_undegraded":"2024-09-21T05:47:38.387832+0000","last_fullsized":"2024-09-21T05:47:38.387832+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:31.680678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.391999+0000","last_change":"2024-09-21T05:47:12.672702+0000","last_active":"2024-09-21T05:47:38.391999+0000","last_peered":"2024-09-21T05:47:38.391999+0000","last_clean":"2024-09-21T05:47:38.391999+0000","last_became_active":"2024-09-21T05:47:12.672233+0000","last_became_peered":"2024-09-21T05:47:12.672233+0000","last_unstale":"2024-09-21T05:47:38.391999+0000","last_undegraded":"2024-09-21T05:47:38.391999+0000","last_fullsized":"2024-09-21T05:47:38.391999+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:04.235603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.391077+0000","last_change":"2024-09-21T05:47:05.633566+0000","last_active":"2024-09-21T05:47:38.391077+0000","last_peered":"2024-09-21T05:47:38.391077+0000","last_clean":"2024-09-21T05:47:38.391077+0000","last_became_active":"2024-09-21T05:47:05.633240+0000","last_became_peered":"2024-09-21T05:47:05.633240+0000","last_unstale":"2024-09-21T05:47:38.391077+0000","last_undegraded":"2024-09-21T05:47:38.391077+0000","last_fullsized":"2024-09-21T05:47:38.391077+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:10.106647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:49.546244+0000","last_change":"2024-09-21T05:47:03.621788+0000","last_active":"2024-09-21T05:47:49.546244+0000","last_peered":"2024-09-21T05:47:49.546244+0000","last_clean":"2024-09-21T05:47:49.546244+0000","last_became_active":"2024-09-21T05:47:03.621425+0000","last_became_peered":"2024-09-21T05:47:03.621425+0000","last_unstale":"2024-09-21T05:47:49.546244+0000","last_undegraded":"2024-09-21T05:47:49.546244+0000","last_fullsized":"2024-09-21T05:47:49.546244+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:51.069361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.393402+0000","last_change":"2024-09-21T05:47:12.670670+0000","last_active":"2024-09-21T05:47:38.393402+0000","last_peered":"2024-09-21T05:47:38.393402+0000","last_clean":"2024-09-21T05:47:38.393402+0000","last_became_active":"2024-09-21T05:47:12.670192+0000","last_became_peered":"2024-09-21T05:47:12.670192+0000","last_unstale":"2024-09-21T05:47:38.393402+0000","last_undegraded":"2024-09-21T05:47:38.393402+0000","last_fullsized":"2024-09-21T05:47:38.393402+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:59.430991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.387853+0000","last_change":"2024-09-21T05:47:05.637775+0000","last_active":"2024-09-21T05:47:38.387853+0000","last_peered":"2024-09-21T05:47:38.387853+0000","last_clean":"2024-09-21T05:47:38.387853+0000","last_became_active":"2024-09-21T05:47:05.637436+0000","last_became_peered":"2024-09-21T05:47:05.637436+0000","last_unstale":"2024-09-21T05:47:38.387853+0000","last_undegraded":"2024-09-21T05:47:38.387853+0000","last_fullsized":"2024-09-21T05:47:38.387853+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:45:59.041879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:47.526787+0000","last_change":"2024-09-21T05:47:03.611317+0000","last_active":"2024-09-21T05:47:47.526787+0000","last_peered":"2024-09-21T05:47:47.526787+0000","last_clean":"2024-09-21T05:47:47.526787+0000","last_became_active":"2024-09-21T05:47:03.610967+0000","last_became_peered":"2024-09-21T05:47:03.610967+0000","last_unstale":"2024-09-21T05:47:47.526787+0000","last_undegraded":"2024-09-21T05:47:47.526787+0000","last_fullsized":"2024-09-21T05:47:47.526787+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:44.263380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:48.538721+0000","last_change":"2024-09-21T05:47:03.624584+0000","last_active":"2024-09-21T05:47:48.538721+0000","last_peered":"2024-09-21T05:47:48.538721+0000","last_clean":"2024-09-21T05:47:48.538721+0000","last_became_active":"2024-09-21T05:47:03.623886+0000","last_became_peered":"2024-09-21T05:47:03.623886+0000","last_unstale":"2024-09-21T05:47:48.538721+0000","last_undegraded":"2024-09-21T05:47:48.538721+0000","last_fullsized":"2024-09-21T05:47:48.538721+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:55.451732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.731847+0000","last_change":"2024-09-21T05:47:38.731762+0000","last_active":"2024-09-21T05:47:38.731847+0000","last_peered":"2024-09-21T05:47:38.731847+0000","last_clean":"2024-09-21T05:47:38.731847+0000","last_became_active":"2024-09-21T05:47:38.731325+0000","last_became_peered":"2024-09-21T05:47:38.731325+0000","last_unstale":"2024-09-21T05:47:38.731847+0000","last_undegraded":"2024-09-21T05:47:38.731847+0000","last_fullsized":"2024-09-21T05:47:38.731847+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:42.516434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.388439+0000","last_change":"2024-09-21T05:47:12.677198+0000","last_active":"2024-09-21T05:47:38.388439+0000","last_peered":"2024-09-21T05:47:38.388439+0000","last_clean":"2024-09-21T05:47:38.388439+0000","last_became_active":"2024-09-21T05:47:12.676673+0000","last_became_peered":"2024-09-21T05:47:12.676673+0000","last_unstale":"2024-09-21T05:47:38.388439+0000","last_undegraded":"2024-09-21T05:47:38.388439+0000","last_fullsized":"2024-09-21T05:47:38.388439+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:58.861348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"83'5","reported_seq":50,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:57.564185+0000","last_change":"2024-09-21T05:47:03.620390+0000","last_active":"2024-09-21T05:47:57.564185+0000","last_peered":"2024-09-21T05:47:57.564185+0000","last_clean":"2024-09-21T05:47:57.564185+0000","last_became_active":"2024-09-21T05:47:03.620006+0000","last_became_peered":"2024-09-21T05:47:03.620006+0000","last_unstale":"2024-09-21T05:47:57.564185+0000","last_undegraded":"2024-09-21T05:47:57.564185+0000","last_fullsized":"2024-09-21T05:47:57.564185+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:31.530194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.394535+0000","last_change":"2024-09-21T05:47:05.641444+0000","last_active":"2024-09-21T05:47:38.394535+0000","last_peered":"2024-09-21T05:47:38.394535+0000","last_clean":"2024-09-21T05:47:38.394535+0000","last_became_active":"2024-09-21T05:47:05.640967+0000","last_became_peered":"2024-09-21T05:47:05.640967+0000","last_unstale":"2024-09-21T05:47:38.394535+0000","last_undegraded":"2024-09-21T05:47:38.394535+0000","last_fullsized":"2024-09-21T05:47:38.394535+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:20.698467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.388634+0000","last_change":"2024-09-21T05:47:12.680157+0000","last_active":"2024-09-21T05:47:38.388634+0000","last_peered":"2024-09-21T05:47:38.388634+0000","last_clean":"2024-09-21T05:47:38.388634+0000","last_became_active":"2024-09-21T05:47:12.679604+0000","last_became_peered":"2024-09-21T05:47:12.679604+0000","last_unstale":"2024-09-21T05:47:38.388634+0000","last_undegraded":"2024-09-21T05:47:38.388634+0000","last_fullsized":"2024-09-21T05:47:38.388634+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:15.381901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.393270+0000","last_change":"2024-09-21T05:47:05.635022+0000","last_active":"2024-09-21T05:47:38.393270+0000","last_peered":"2024-09-21T05:47:38.393270+0000","last_clean":"2024-09-21T05:47:38.393270+0000","last_became_active":"2024-09-21T05:47:05.634592+0000","last_became_peered":"2024-09-21T05:47:05.634592+0000","last_unstale":"2024-09-21T05:47:38.393270+0000","last_undegraded":"2024-09-21T05:47:38.393270+0000","last_fullsized":"2024-09-21T05:47:38.393270+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:48.159339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.388462+0000","last_change":"2024-09-21T05:47:05.639942+0000","last_active":"2024-09-21T05:47:38.388462+0000","last_peered":"2024-09-21T05:47:38.388462+0000","last_clean":"2024-09-21T05:47:38.388462+0000","last_became_active":"2024-09-21T05:47:05.639570+0000","last_became_peered":"2024-09-21T05:47:05.639570+0000","last_unstale":"2024-09-21T05:47:38.388462+0000","last_undegraded":"2024-09-21T05:47:38.388462+0000","last_fullsized":"2024-09-21T05:47:38.388462+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:32.657485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.388143+0000","last_change":"2024-09-21T05:47:05.637359+0000","last_active":"2024-09-21T05:47:38.388143+0000","last_peered":"2024-09-21T05:47:38.388143+0000","last_clean":"2024-09-21T05:47:38.388143+0000","last_became_active":"2024-09-21T05:47:05.636998+0000","last_became_peered":"2024-09-21T05:47:05.636998+0000","last_unstale":"2024-09-21T05:47:38.388143+0000","last_undegraded":"2024-09-21T05:47:38.388143+0000","last_fullsized":"2024-09-21T05:47:38.388143+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:06.186344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.392162+0000","last_change":"2024-09-21T05:47:05.633304+0000","last_active":"2024-09-21T05:47:38.392162+0000","last_peered":"2024-09-21T05:47:38.392162+0000","last_clean":"2024-09-21T05:47:38.392162+0000","last_became_active":"2024-09-21T05:47:05.632919+0000","last_became_peered":"2024-09-21T05:47:05.632919+0000","last_unstale":"2024-09-21T05:47:38.392162+0000","last_undegraded":"2024-09-21T05:47:38.392162+0000","last_fullsized":"2024-09-21T05:47:38.392162+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:16.108908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.730736+0000","last_change":"2024-09-21T05:47:05.631091+0000","last_active":"2024-09-21T05:47:38.730736+0000","last_peered":"2024-09-21T05:47:38.730736+0000","last_clean":"2024-09-21T05:47:38.730736+0000","last_became_active":"2024-09-21T05:47:05.630740+0000","last_became_peered":"2024-09-21T05:47:05.630740+0000","last_unstale":"2024-09-21T05:47:38.730736+0000","last_undegraded":"2024-09-21T05:47:38.730736+0000","last_fullsized":"2024-09-21T05:47:38.730736+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:36:41.136890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.398880+0000","last_change":"2024-09-21T05:47:38.398773+0000","last_active":"2024-09-21T05:47:38.398880+0000","last_peered":"2024-09-21T05:47:38.398880+0000","last_clean":"2024-09-21T05:47:38.398880+0000","last_became_active":"2024-09-21T05:47:38.398378+0000","last_became_peered":"2024-09-21T05:47:38.398378+0000","last_unstale":"2024-09-21T05:47:38.398880+0000","last_undegraded":"2024-09-21T05:47:38.398880+0000","last_fullsized":"2024-09-21T05:47:38.398880+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:32.247222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.389011+0000","last_change":"2024-09-21T05:47:05.641782+0000","last_active":"2024-09-21T05:47:38.389011+0000","last_peered":"2024-09-21T05:47:38.389011+0000","last_clean":"2024-09-21T05:47:38.389011+0000","last_became_active":"2024-09-21T05:47:05.641422+0000","last_became_peered":"2024-09-21T05:47:05.641422+0000","last_unstale":"2024-09-21T05:47:38.389011+0000","last_undegraded":"2024-09-21T05:47:38.389011+0000","last_fullsized":"2024-09-21T05:47:38.389011+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:33.819329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.396163+0000","last_change":"2024-09-21T05:47:38.396070+0000","last_active":"2024-09-21T05:47:38.396163+0000","last_peered":"2024-09-21T05:47:38.396163+0000","last_clean":"2024-09-21T05:47:38.396163+0000","last_became_active":"2024-09-21T05:47:38.395727+0000","last_became_peered":"2024-09-21T05:47:38.395727+0000","last_unstale":"2024-09-21T05:47:38.396163+0000","last_undegraded":"2024-09-21T05:47:38.396163+0000","last_fullsized":"2024-09-21T05:47:38.396163+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:41.816692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.390430+0000","last_change":"2024-09-21T05:47:05.633701+0000","last_active":"2024-09-21T05:47:38.390430+0000","last_peered":"2024-09-21T05:47:38.390430+0000","last_clean":"2024-09-21T05:47:38.390430+0000","last_became_active":"2024-09-21T05:47:05.632671+0000","last_became_peered":"2024-09-21T05:47:05.632671+0000","last_unstale":"2024-09-21T05:47:38.390430+0000","last_undegraded":"2024-09-21T05:47:38.390430+0000","last_fullsized":"2024-09-21T05:47:38.390430+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:56.180731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.387898+0000","last_change":"2024-09-21T05:47:05.639419+0000","last_active":"2024-09-21T05:47:38.387898+0000","last_peered":"2024-09-21T05:47:38.387898+0000","last_clean":"2024-09-21T05:47:38.387898+0000","last_became_active":"2024-09-21T05:47:05.639060+0000","last_became_peered":"2024-09-21T05:47:05.639060+0000","last_unstale":"2024-09-21T05:47:38.387898+0000","last_undegraded":"2024-09-21T05:47:38.387898+0000","last_fullsized":"2024-09-21T05:47:38.387898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:09.562359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.388763+0000","last_change":"2024-09-21T05:47:05.641218+0000","last_active":"2024-09-21T05:47:38.388763+0000","last_peered":"2024-09-21T05:47:38.388763+0000","last_clean":"2024-09-21T05:47:38.388763+0000","last_became_active":"2024-09-21T05:47:05.640813+0000","last_became_peered":"2024-09-21T05:47:05.640813+0000","last_unstale":"2024-09-21T05:47:38.388763+0000","last_undegraded":"2024-09-21T05:47:38.388763+0000","last_fullsized":"2024-09-21T05:47:38.388763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:21.057096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.730695+0000","last_change":"2024-09-21T05:47:05.627711+0000","last_active":"2024-09-21T05:47:38.730695+0000","last_peered":"2024-09-21T05:47:38.730695+0000","last_clean":"2024-09-21T05:47:38.730695+0000","last_became_active":"2024-09-21T05:47:05.626394+0000","last_became_peered":"2024-09-21T05:47:05.626394+0000","last_unstale":"2024-09-21T05:47:38.730695+0000","last_undegraded":"2024-09-21T05:47:38.730695+0000","last_fullsized":"2024-09-21T05:47:38.730695+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:31.038727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.394026+0000","last_change":"2024-09-21T05:47:05.632835+0000","last_active":"2024-09-21T05:47:38.394026+0000","last_peered":"2024-09-21T05:47:38.394026+0000","last_clean":"2024-09-21T05:47:38.394026+0000","last_became_active":"2024-09-21T05:47:05.632486+0000","last_became_peered":"2024-09-21T05:47:05.632486+0000","last_unstale":"2024-09-21T05:47:38.394026+0000","last_undegraded":"2024-09-21T05:47:38.394026+0000","last_fullsized":"2024-09-21T05:47:38.394026+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:04.365517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.388864+0000","last_change":"2024-09-21T05:47:05.638381+0000","last_active":"2024-09-21T05:47:38.388864+0000","last_peered":"2024-09-21T05:47:38.388864+0000","last_clean":"2024-09-21T05:47:38.388864+0000","last_became_active":"2024-09-21T05:47:05.638007+0000","last_became_peered":"2024-09-21T05:47:05.638007+0000","last_unstale":"2024-09-21T05:47:38.388864+0000","last_undegraded":"2024-09-21T05:47:38.388864+0000","last_fullsized":"2024-09-21T05:47:38.388864+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:06.615367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.392045+0000","last_change":"2024-09-21T05:47:05.644624+0000","last_active":"2024-09-21T05:47:38.392045+0000","last_peered":"2024-09-21T05:47:38.392045+0000","last_clean":"2024-09-21T05:47:38.392045+0000","last_became_active":"2024-09-21T05:47:05.644257+0000","last_became_peered":"2024-09-21T05:47:05.644257+0000","last_unstale":"2024-09-21T05:47:38.392045+0000","last_undegraded":"2024-09-21T05:47:38.392045+0000","last_fullsized":"2024-09-21T05:47:38.392045+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:31.385313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.395173+0000","last_change":"2024-09-21T05:47:05.646368+0000","last_active":"2024-09-21T05:47:38.395173+0000","last_peered":"2024-09-21T05:47:38.395173+0000","last_clean":"2024-09-21T05:47:38.395173+0000","last_became_active":"2024-09-21T05:47:05.645952+0000","last_became_peered":"2024-09-21T05:47:05.645952+0000","last_unstale":"2024-09-21T05:47:38.395173+0000","last_undegraded":"2024-09-21T05:47:38.395173+0000","last_fullsized":"2024-09-21T05:47:38.395173+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:56.585911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.388406+0000","last_change":"2024-09-21T05:47:05.640167+0000","last_active":"2024-09-21T05:47:38.388406+0000","last_peered":"2024-09-21T05:47:38.388406+0000","last_clean":"2024-09-21T05:47:38.388406+0000","last_became_active":"2024-09-21T05:47:05.639770+0000","last_became_peered":"2024-09-21T05:47:05.639770+0000","last_unstale":"2024-09-21T05:47:38.388406+0000","last_undegraded":"2024-09-21T05:47:38.388406+0000","last_fullsized":"2024-09-21T05:47:38.388406+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:45.661131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.732783+0000","last_change":"2024-09-21T05:47:38.732677+0000","last_active":"2024-09-21T05:47:38.732783+0000","last_peered":"2024-09-21T05:47:38.732783+0000","last_clean":"2024-09-21T05:47:38.732783+0000","last_became_active":"2024-09-21T05:47:38.732236+0000","last_became_peered":"2024-09-21T05:47:38.732236+0000","last_unstale":"2024-09-21T05:47:38.732783+0000","last_undegraded":"2024-09-21T05:47:38.732783+0000","last_fullsized":"2024-09-21T05:47:38.732783+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:41.474677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.391834+0000","last_change":"2024-09-21T05:47:05.629814+0000","last_active":"2024-09-21T05:47:38.391834+0000","last_peered":"2024-09-21T05:47:38.391834+0000","last_clean":"2024-09-21T05:47:38.391834+0000","last_became_active":"2024-09-21T05:47:05.629464+0000","last_became_peered":"2024-09-21T05:47:05.629464+0000","last_unstale":"2024-09-21T05:47:38.391834+0000","last_undegraded":"2024-09-21T05:47:38.391834+0000","last_fullsized":"2024-09-21T05:47:38.391834+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:58.222820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.730882+0000","last_change":"2024-09-21T05:47:05.629643+0000","last_active":"2024-09-21T05:47:38.730882+0000","last_peered":"2024-09-21T05:47:38.730882+0000","last_clean":"2024-09-21T05:47:38.730882+0000","last_became_active":"2024-09-21T05:47:05.629248+0000","last_became_peered":"2024-09-21T05:47:05.629248+0000","last_unstale":"2024-09-21T05:47:38.730882+0000","last_undegraded":"2024-09-21T05:47:38.730882+0000","last_fullsized":"2024-09-21T05:47:38.730882+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:31.569209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.396454+0000","last_change":"2024-09-21T05:47:05.632188+0000","last_active":"2024-09-21T05:47:38.396454+0000","last_peered":"2024-09-21T05:47:38.396454+0000","last_clean":"2024-09-21T05:47:38.396454+0000","last_became_active":"2024-09-21T05:47:05.631799+0000","last_became_peered":"2024-09-21T05:47:05.631799+0000","last_unstale":"2024-09-21T05:47:38.396454+0000","last_undegraded":"2024-09-21T05:47:38.396454+0000","last_fullsized":"2024-09-21T05:47:38.396454+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:09.762405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.731173+0000","last_change":"2024-09-21T05:47:05.644746+0000","last_active":"2024-09-21T05:47:38.731173+0000","last_peered":"2024-09-21T05:47:38.731173+0000","last_clean":"2024-09-21T05:47:38.731173+0000","last_became_active":"2024-09-21T05:47:05.644326+0000","last_became_peered":"2024-09-21T05:47:05.644326+0000","last_unstale":"2024-09-21T05:47:38.731173+0000","last_undegraded":"2024-09-21T05:47:38.731173+0000","last_fullsized":"2024-09-21T05:47:38.731173+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:22.937783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.394972+0000","last_change":"2024-09-21T05:47:05.639214+0000","last_active":"2024-09-21T05:47:38.394972+0000","last_peered":"2024-09-21T05:47:38.394972+0000","last_clean":"2024-09-21T05:47:38.394972+0000","last_became_active":"2024-09-21T05:47:05.638443+0000","last_became_peered":"2024-09-21T05:47:05.638443+0000","last_unstale":"2024-09-21T05:47:38.394972+0000","last_undegraded":"2024-09-21T05:47:38.394972+0000","last_fullsized":"2024-09-21T05:47:38.394972+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:30.134020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.389200+0000","last_change":"2024-09-21T05:47:05.644233+0000","last_active":"2024-09-21T05:47:38.389200+0000","last_peered":"2024-09-21T05:47:38.389200+0000","last_clean":"2024-09-21T05:47:38.389200+0000","last_became_active":"2024-09-21T05:47:05.643820+0000","last_became_peered":"2024-09-21T05:47:05.643820+0000","last_unstale":"2024-09-21T05:47:38.389200+0000","last_undegraded":"2024-09-21T05:47:38.389200+0000","last_fullsized":"2024-09-21T05:47:38.389200+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:42.695997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.387811+0000","last_change":"2024-09-21T05:47:05.637569+0000","last_active":"2024-09-21T05:47:38.387811+0000","last_peered":"2024-09-21T05:47:38.387811+0000","last_clean":"2024-09-21T05:47:38.387811+0000","last_became_active":"2024-09-21T05:47:05.637269+0000","last_became_peered":"2024-09-21T05:47:05.637269+0000","last_unstale":"2024-09-21T05:47:38.387811+0000","last_undegraded":"2024-09-21T05:47:38.387811+0000","last_fullsized":"2024-09-21T05:47:38.387811+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:28:26.335398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.731453+0000","last_change":"2024-09-21T05:47:05.633457+0000","last_active":"2024-09-21T05:47:38.731453+0000","last_peered":"2024-09-21T05:47:38.731453+0000","last_clean":"2024-09-21T05:47:38.731453+0000","last_became_active":"2024-09-21T05:47:05.633066+0000","last_became_peered":"2024-09-21T05:47:05.633066+0000","last_unstale":"2024-09-21T05:47:38.731453+0000","last_undegraded":"2024-09-21T05:47:38.731453+0000","last_fullsized":"2024-09-21T05:47:38.731453+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:45.904152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.400024+0000","last_change":"2024-09-21T05:47:38.399914+0000","last_active":"2024-09-21T05:47:38.400024+0000","last_peered":"2024-09-21T05:47:38.400024+0000","last_clean":"2024-09-21T05:47:38.400024+0000","last_became_active":"2024-09-21T05:47:38.399480+0000","last_became_peered":"2024-09-21T05:47:38.399480+0000","last_unstale":"2024-09-21T05:47:38.400024+0000","last_undegraded":"2024-09-21T05:47:38.400024+0000","last_fullsized":"2024-09-21T05:47:38.400024+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:51.281796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.393925+0000","last_change":"2024-09-21T05:47:05.630944+0000","last_active":"2024-09-21T05:47:38.393925+0000","last_peered":"2024-09-21T05:47:38.393925+0000","last_clean":"2024-09-21T05:47:38.393925+0000","last_became_active":"2024-09-21T05:47:05.630498+0000","last_became_peered":"2024-09-21T05:47:05.630498+0000","last_unstale":"2024-09-21T05:47:38.393925+0000","last_undegraded":"2024-09-21T05:47:38.393925+0000","last_fullsized":"2024-09-21T05:47:38.393925+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:20.185094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.396334+0000","last_change":"2024-09-21T05:47:05.636134+0000","last_active":"2024-09-21T05:47:38.396334+0000","last_peered":"2024-09-21T05:47:38.396334+0000","last_clean":"2024-09-21T05:47:38.396334+0000","last_became_active":"2024-09-21T05:47:05.635724+0000","last_became_peered":"2024-09-21T05:47:05.635724+0000","last_unstale":"2024-09-21T05:47:38.396334+0000","last_undegraded":"2024-09-21T05:47:38.396334+0000","last_fullsized":"2024-09-21T05:47:38.396334+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:55.455819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.392353+0000","last_change":"2024-09-21T05:47:05.641209+0000","last_active":"2024-09-21T05:47:38.392353+0000","last_peered":"2024-09-21T05:47:38.392353+0000","last_clean":"2024-09-21T05:47:38.392353+0000","last_became_active":"2024-09-21T05:47:05.640543+0000","last_became_peered":"2024-09-21T05:47:05.640543+0000","last_unstale":"2024-09-21T05:47:38.392353+0000","last_undegraded":"2024-09-21T05:47:38.392353+0000","last_fullsized":"2024-09-21T05:47:38.392353+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:49.579724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.392110+0000","last_change":"2024-09-21T05:47:05.634158+0000","last_active":"2024-09-21T05:47:38.392110+0000","last_peered":"2024-09-21T05:47:38.392110+0000","last_clean":"2024-09-21T05:47:38.392110+0000","last_became_active":"2024-09-21T05:47:05.633657+0000","last_became_peered":"2024-09-21T05:47:05.633657+0000","last_unstale":"2024-09-21T05:47:38.392110+0000","last_undegraded":"2024-09-21T05:47:38.392110+0000","last_fullsized":"2024-09-21T05:47:38.392110+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:37.868206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.395030+0000","last_change":"2024-09-21T05:47:05.641358+0000","last_active":"2024-09-21T05:47:38.395030+0000","last_peered":"2024-09-21T05:47:38.395030+0000","last_clean":"2024-09-21T05:47:38.395030+0000","last_became_active":"2024-09-21T05:47:05.641025+0000","last_became_peered":"2024-09-21T05:47:05.641025+0000","last_unstale":"2024-09-21T05:47:38.395030+0000","last_undegraded":"2024-09-21T05:47:38.395030+0000","last_fullsized":"2024-09-21T05:47:38.395030+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:01.654621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63357,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":150,"num_read_kb":146,"num_write":240,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":536576,"data_stored":171945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":248927,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":470577,"data_compressed":23473,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939677,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":1118424,"data_compressed":59727,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103202,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":470507,"data_compressed":23473,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299431,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32104,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713048,"statfs":{"total":95995035648,"available":95962161152,"internally_reserved":0,"allocated":942080,"data_stored":470885,"data_compressed":23473,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495660,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":1067382,"data_compressed":59727,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659184,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":466011,"data_compressed":23473,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855414,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32164,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712988,"statfs":{"total":95995035648,"available":95962099712,"internally_reserved":0,"allocated":1003520,"data_stored":1062573,"data_compressed":59727,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051644,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":929792,"data_stored":470476,"data_compressed":23473,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247872,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":465719,"data_compressed":23473,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444101,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":514742,"data_compressed":23473,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607626,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":514522,"data_compressed":23473,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":467467,"data_compressed":23473,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34637,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34637,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34637,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36254,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36254,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36254,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36254,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":49233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":49453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":58671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T05:48:05.304 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T05:48:05.549 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:05.847 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:05 smithi070 ceph-mon[30981]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:48:05.847 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:05 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:48:05.847 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:05 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:48:05.847 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:05 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:05.847 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:05 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:05.847 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:05 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:48:05.847 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:05 smithi070 ceph-mon[30981]: pgmap v327: 129 pgs: 129 active+clean; 639 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.1 KiB/s wr, 14 op/s 2024-09-21T05:48:05.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:05 smithi160 ceph-mon[33979]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:48:05.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:05 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:48:05.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:05 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:48:05.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:05 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:05.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:05 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:05.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:05 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:48:05.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:05 smithi160 ceph-mon[33979]: pgmap v327: 129 pgs: 129 active+clean; 639 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.1 KiB/s wr, 14 op/s 2024-09-21T05:48:06.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:05 smithi116 ceph-mon[34332]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:48:06.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:05 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:48:06.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:05 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:48:06.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:05 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:06.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:05 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:06.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:05 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:48:06.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:05 smithi116 ceph-mon[34332]: pgmap v327: 129 pgs: 129 active+clean; 639 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.1 KiB/s wr, 14 op/s 2024-09-21T05:48:06.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.055+0000 7f2898174640 1 -- 172.21.15.70:0/2283407813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2890103b60 msgr2=0x7f2890103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:06.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.055+0000 7f2898174640 1 --2- 172.21.15.70:0/2283407813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2890103b60 0x7f2890103f70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f288c009900 tx=0x7f288c02a410 comp rx=0 tx=0).stop 2024-09-21T05:48:06.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.055+0000 7f2898174640 1 -- 172.21.15.70:0/2283407813 shutdown_connections 2024-09-21T05:48:06.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.055+0000 7f2898174640 1 --2- 172.21.15.70:0/2283407813 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28901094a0 0x7f28901098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:06.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.055+0000 7f2898174640 1 --2- 172.21.15.70:0/2283407813 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2890109df0 0x7f2890110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:06.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.055+0000 7f2898174640 1 --2- 172.21.15.70:0/2283407813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2890103b60 0x7f2890103f70 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:06.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.055+0000 7f2898174640 1 -- 172.21.15.70:0/2283407813 >> 172.21.15.70:0/2283407813 conn(0x7f289007b850 msgr2=0x7f289007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:06.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.055+0000 7f2898174640 1 -- 172.21.15.70:0/2283407813 shutdown_connections 2024-09-21T05:48:06.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.055+0000 7f2898174640 1 -- 172.21.15.70:0/2283407813 wait complete. 2024-09-21T05:48:06.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.055+0000 7f2898174640 1 Processor -- start 2024-09-21T05:48:06.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.056+0000 7f2898174640 1 -- start start 2024-09-21T05:48:06.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.056+0000 7f2898174640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2890103b60 0x7f289019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:06.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.056+0000 7f2898174640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28901094a0 0x7f289019aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:06.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.056+0000 7f2898174640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2890109df0 0x7f289019fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:06.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.056+0000 7f2898174640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2890113aa0 con 0x7f2890109df0 2024-09-21T05:48:06.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.056+0000 7f2898174640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2890113920 con 0x7f2890103b60 2024-09-21T05:48:06.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.056+0000 7f2898174640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2890113c20 con 0x7f28901094a0 2024-09-21T05:48:06.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.056+0000 7f2896711640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2890109df0 0x7f289019fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:06.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.056+0000 7f2896711640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2890109df0 0x7f289019fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46608/0 (socket says 172.21.15.70:46608) 2024-09-21T05:48:06.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.056+0000 7f2896711640 1 -- 172.21.15.70:0/2003307260 learned_addr learned my addr 172.21.15.70:0/2003307260 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:06.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.056+0000 7f2895f10640 1 --2- 172.21.15.70:0/2003307260 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2890103b60 0x7f289019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:06.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.056+0000 7f289570f640 1 --2- 172.21.15.70:0/2003307260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28901094a0 0x7f289019aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:06.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.056+0000 7f2896711640 1 -- 172.21.15.70:0/2003307260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28901094a0 msgr2=0x7f289019aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:06.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.056+0000 7f2896711640 1 --2- 172.21.15.70:0/2003307260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28901094a0 0x7f289019aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:06.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.056+0000 7f2896711640 1 -- 172.21.15.70:0/2003307260 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2890103b60 msgr2=0x7f289019a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:06.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.056+0000 7f2896711640 1 --2- 172.21.15.70:0/2003307260 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2890103b60 0x7f289019a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:06.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.056+0000 7f2896711640 1 -- 172.21.15.70:0/2003307260 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28901a0420 con 0x7f2890109df0 2024-09-21T05:48:06.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.056+0000 7f2896711640 1 --2- 172.21.15.70:0/2003307260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2890109df0 0x7f289019fcf0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f288800eb10 tx=0x7f288800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:06.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.057+0000 7f2886ffd640 1 -- 172.21.15.70:0/2003307260 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2888004b20 con 0x7f2890109df0 2024-09-21T05:48:06.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.057+0000 7f2886ffd640 1 -- 172.21.15.70:0/2003307260 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f2888004cc0 con 0x7f2890109df0 2024-09-21T05:48:06.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.057+0000 7f2898174640 1 -- 172.21.15.70:0/2003307260 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28901a0710 con 0x7f2890109df0 2024-09-21T05:48:06.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.057+0000 7f2886ffd640 1 -- 172.21.15.70:0/2003307260 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2888010690 con 0x7f2890109df0 2024-09-21T05:48:06.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.057+0000 7f2898174640 1 -- 172.21.15.70:0/2003307260 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28901a6e70 con 0x7f2890109df0 2024-09-21T05:48:06.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.058+0000 7f2898174640 1 -- 172.21.15.70:0/2003307260 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2890103f70 con 0x7f2890109df0 2024-09-21T05:48:06.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.059+0000 7f2886ffd640 1 -- 172.21.15.70:0/2003307260 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f2888005000 con 0x7f2890109df0 2024-09-21T05:48:06.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.060+0000 7f2886ffd640 1 --2- 172.21.15.70:0/2003307260 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f287c0b65a0 0x7f287c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:06.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.060+0000 7f2895f10640 1 --2- 172.21.15.70:0/2003307260 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f287c0b65a0 0x7f287c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:06.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.060+0000 7f2886ffd640 1 -- 172.21.15.70:0/2003307260 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f28880e80f0 con 0x7f2890109df0 2024-09-21T05:48:06.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.060+0000 7f2895f10640 1 --2- 172.21.15.70:0/2003307260 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f287c0b65a0 0x7f287c0b8ab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f288c005d90 tx=0x7f288c005df0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:06.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.063+0000 7f2886ffd640 1 -- 172.21.15.70:0/2003307260 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2888056710 con 0x7f2890109df0 2024-09-21T05:48:06.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.238+0000 7f2898174640 1 -- 172.21.15.70:0/2003307260 --> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2890063800 con 0x7f287c0b65a0 2024-09-21T05:48:06.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.244+0000 7f2886ffd640 1 -- 172.21.15.70:0/2003307260 <== mgr.14150 v2:172.21.15.70:6800/1366013939 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340631 (secure 0 0 0) 0x7f2890063800 con 0x7f287c0b65a0 2024-09-21T05:48:06.250 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:48:06.252 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-21T05:48:06.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.248+0000 7f2898174640 1 -- 172.21.15.70:0/2003307260 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f287c0b65a0 msgr2=0x7f287c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:06.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.248+0000 7f2898174640 1 --2- 172.21.15.70:0/2003307260 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f287c0b65a0 0x7f287c0b8ab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f288c005d90 tx=0x7f288c005df0 comp rx=0 tx=0).stop 2024-09-21T05:48:06.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.248+0000 7f2898174640 1 -- 172.21.15.70:0/2003307260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2890109df0 msgr2=0x7f289019fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:06.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.248+0000 7f2898174640 1 --2- 172.21.15.70:0/2003307260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2890109df0 0x7f289019fcf0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f288800eb10 tx=0x7f288800c2d0 comp rx=0 tx=0).stop 2024-09-21T05:48:06.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.248+0000 7f2898174640 1 -- 172.21.15.70:0/2003307260 shutdown_connections 2024-09-21T05:48:06.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.248+0000 7f2898174640 1 --2- 172.21.15.70:0/2003307260 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f287c0b65a0 0x7f287c0b8ab0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:06.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.248+0000 7f2898174640 1 --2- 172.21.15.70:0/2003307260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28901094a0 0x7f289019aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:06.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.248+0000 7f2898174640 1 --2- 172.21.15.70:0/2003307260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2890109df0 0x7f289019fcf0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:06.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.248+0000 7f2898174640 1 --2- 172.21.15.70:0/2003307260 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2890103b60 0x7f289019a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:06.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.248+0000 7f2898174640 1 -- 172.21.15.70:0/2003307260 >> 172.21.15.70:0/2003307260 conn(0x7f289007b850 msgr2=0x7f2890107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:06.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.249+0000 7f2898174640 1 -- 172.21.15.70:0/2003307260 shutdown_connections 2024-09-21T05:48:06.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:06.249+0000 7f2898174640 1 -- 172.21.15.70:0/2003307260 wait complete. 2024-09-21T05:48:06.944 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":327,"stamp":"2024-09-21T05:48:05.408589+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653959,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":241,"num_read_kb":215,"num_write":365,"num_write_kb":2284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":301,"ondisk_log_size":301,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":348084,"kb_used_data":11316,"kb_used_omap":18,"kb_used_meta":336557,"kb_avail":1124593740,"statfs":{"total":1151940427776,"available":1151583989760,"internally_reserved":0,"allocated":11587584,"data_stored":7568348,"data_compressed":390438,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19143,"internal_metadata":344634681},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":52958,"num_objects":6,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":130,"num_read_kb":119,"num_write":39,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003649"},"pg_stats":[{"pgid":"2.1f","version":"83'13","reported_seq":60,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:48:00.565556+0000","last_change":"2024-09-21T05:47:03.620705+0000","last_active":"2024-09-21T05:48:00.565556+0000","last_peered":"2024-09-21T05:48:00.565556+0000","last_clean":"2024-09-21T05:48:00.565556+0000","last_became_active":"2024-09-21T05:47:03.620320+0000","last_became_peered":"2024-09-21T05:47:03.620320+0000","last_unstale":"2024-09-21T05:48:00.565556+0000","last_undegraded":"2024-09-21T05:48:00.565556+0000","last_fullsized":"2024-09-21T05:48:00.565556+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:31.684225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.388569+0000","last_change":"2024-09-21T05:47:05.637251+0000","last_active":"2024-09-21T05:47:38.388569+0000","last_peered":"2024-09-21T05:47:38.388569+0000","last_clean":"2024-09-21T05:47:38.388569+0000","last_became_active":"2024-09-21T05:47:05.636867+0000","last_became_peered":"2024-09-21T05:47:05.636867+0000","last_unstale":"2024-09-21T05:47:38.388569+0000","last_undegraded":"2024-09-21T05:47:38.388569+0000","last_fullsized":"2024-09-21T05:47:38.388569+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:08.538209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.388057+0000","last_change":"2024-09-21T05:47:12.676224+0000","last_active":"2024-09-21T05:47:38.388057+0000","last_peered":"2024-09-21T05:47:38.388057+0000","last_clean":"2024-09-21T05:47:38.388057+0000","last_became_active":"2024-09-21T05:47:12.675565+0000","last_became_peered":"2024-09-21T05:47:12.675565+0000","last_unstale":"2024-09-21T05:47:38.388057+0000","last_undegraded":"2024-09-21T05:47:38.388057+0000","last_fullsized":"2024-09-21T05:47:38.388057+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:37.684953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.388803+0000","last_change":"2024-09-21T05:47:03.670289+0000","last_active":"2024-09-21T05:47:38.388803+0000","last_peered":"2024-09-21T05:47:38.388803+0000","last_clean":"2024-09-21T05:47:38.388803+0000","last_became_active":"2024-09-21T05:47:03.669881+0000","last_became_peered":"2024-09-21T05:47:03.669881+0000","last_unstale":"2024-09-21T05:47:38.388803+0000","last_undegraded":"2024-09-21T05:47:38.388803+0000","last_fullsized":"2024-09-21T05:47:38.388803+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:12.597766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.391933+0000","last_change":"2024-09-21T05:47:05.640826+0000","last_active":"2024-09-21T05:47:38.391933+0000","last_peered":"2024-09-21T05:47:38.391933+0000","last_clean":"2024-09-21T05:47:38.391933+0000","last_became_active":"2024-09-21T05:47:05.640357+0000","last_became_peered":"2024-09-21T05:47:05.640357+0000","last_unstale":"2024-09-21T05:47:38.391933+0000","last_undegraded":"2024-09-21T05:47:38.391933+0000","last_fullsized":"2024-09-21T05:47:38.391933+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:16.434030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.393211+0000","last_change":"2024-09-21T05:47:12.677260+0000","last_active":"2024-09-21T05:47:38.393211+0000","last_peered":"2024-09-21T05:47:38.393211+0000","last_clean":"2024-09-21T05:47:38.393211+0000","last_became_active":"2024-09-21T05:47:12.676599+0000","last_became_peered":"2024-09-21T05:47:12.676599+0000","last_unstale":"2024-09-21T05:47:38.393211+0000","last_undegraded":"2024-09-21T05:47:38.393211+0000","last_fullsized":"2024-09-21T05:47:38.393211+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:10.644801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":48,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:50.539541+0000","last_change":"2024-09-21T05:47:03.619903+0000","last_active":"2024-09-21T05:47:50.539541+0000","last_peered":"2024-09-21T05:47:50.539541+0000","last_clean":"2024-09-21T05:47:50.539541+0000","last_became_active":"2024-09-21T05:47:03.619476+0000","last_became_peered":"2024-09-21T05:47:03.619476+0000","last_unstale":"2024-09-21T05:47:50.539541+0000","last_undegraded":"2024-09-21T05:47:50.539541+0000","last_fullsized":"2024-09-21T05:47:50.539541+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:09.717552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.388708+0000","last_change":"2024-09-21T05:47:05.646017+0000","last_active":"2024-09-21T05:47:38.388708+0000","last_peered":"2024-09-21T05:47:38.388708+0000","last_clean":"2024-09-21T05:47:38.388708+0000","last_became_active":"2024-09-21T05:47:05.644118+0000","last_became_peered":"2024-09-21T05:47:05.644118+0000","last_unstale":"2024-09-21T05:47:38.388708+0000","last_undegraded":"2024-09-21T05:47:38.388708+0000","last_fullsized":"2024-09-21T05:47:38.388708+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:52.908664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.394481+0000","last_change":"2024-09-21T05:47:12.677555+0000","last_active":"2024-09-21T05:47:38.394481+0000","last_peered":"2024-09-21T05:47:38.394481+0000","last_clean":"2024-09-21T05:47:38.394481+0000","last_became_active":"2024-09-21T05:47:12.676886+0000","last_became_peered":"2024-09-21T05:47:12.676886+0000","last_unstale":"2024-09-21T05:47:38.394481+0000","last_undegraded":"2024-09-21T05:47:38.394481+0000","last_fullsized":"2024-09-21T05:47:38.394481+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:10:24.516641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:49.546553+0000","last_change":"2024-09-21T05:47:03.621556+0000","last_active":"2024-09-21T05:47:49.546553+0000","last_peered":"2024-09-21T05:47:49.546553+0000","last_clean":"2024-09-21T05:47:49.546553+0000","last_became_active":"2024-09-21T05:47:03.621101+0000","last_became_peered":"2024-09-21T05:47:03.621101+0000","last_unstale":"2024-09-21T05:47:49.546553+0000","last_undegraded":"2024-09-21T05:47:49.546553+0000","last_fullsized":"2024-09-21T05:47:49.546553+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:39:23.639431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.391588+0000","last_change":"2024-09-21T05:47:05.646328+0000","last_active":"2024-09-21T05:47:38.391588+0000","last_peered":"2024-09-21T05:47:38.391588+0000","last_clean":"2024-09-21T05:47:38.391588+0000","last_became_active":"2024-09-21T05:47:05.645922+0000","last_became_peered":"2024-09-21T05:47:05.645922+0000","last_unstale":"2024-09-21T05:47:38.391588+0000","last_undegraded":"2024-09-21T05:47:38.391588+0000","last_fullsized":"2024-09-21T05:47:38.391588+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:43.801707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.393850+0000","last_change":"2024-09-21T05:47:12.673555+0000","last_active":"2024-09-21T05:47:38.393850+0000","last_peered":"2024-09-21T05:47:38.393850+0000","last_clean":"2024-09-21T05:47:38.393850+0000","last_became_active":"2024-09-21T05:47:12.673065+0000","last_became_peered":"2024-09-21T05:47:12.673065+0000","last_unstale":"2024-09-21T05:47:38.393850+0000","last_undegraded":"2024-09-21T05:47:38.393850+0000","last_fullsized":"2024-09-21T05:47:38.393850+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:53.548779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.731161+0000","last_change":"2024-09-21T05:47:05.645376+0000","last_active":"2024-09-21T05:47:38.731161+0000","last_peered":"2024-09-21T05:47:38.731161+0000","last_clean":"2024-09-21T05:47:38.731161+0000","last_became_active":"2024-09-21T05:47:05.644800+0000","last_became_peered":"2024-09-21T05:47:05.644800+0000","last_unstale":"2024-09-21T05:47:38.731161+0000","last_undegraded":"2024-09-21T05:47:38.731161+0000","last_fullsized":"2024-09-21T05:47:38.731161+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:10.460407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:46.518325+0000","last_change":"2024-09-21T05:47:03.619926+0000","last_active":"2024-09-21T05:47:46.518325+0000","last_peered":"2024-09-21T05:47:46.518325+0000","last_clean":"2024-09-21T05:47:46.518325+0000","last_became_active":"2024-09-21T05:47:03.619433+0000","last_became_peered":"2024-09-21T05:47:03.619433+0000","last_unstale":"2024-09-21T05:47:46.518325+0000","last_undegraded":"2024-09-21T05:47:46.518325+0000","last_fullsized":"2024-09-21T05:47:46.518325+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:33.792874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.395697+0000","last_change":"2024-09-21T05:47:12.874200+0000","last_active":"2024-09-21T05:47:38.395697+0000","last_peered":"2024-09-21T05:47:38.395697+0000","last_clean":"2024-09-21T05:47:38.395697+0000","last_became_active":"2024-09-21T05:47:12.873563+0000","last_became_peered":"2024-09-21T05:47:12.873563+0000","last_unstale":"2024-09-21T05:47:38.395697+0000","last_undegraded":"2024-09-21T05:47:38.395697+0000","last_fullsized":"2024-09-21T05:47:38.395697+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:34.839934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.388118+0000","last_change":"2024-09-21T05:47:05.639033+0000","last_active":"2024-09-21T05:47:38.388118+0000","last_peered":"2024-09-21T05:47:38.388118+0000","last_clean":"2024-09-21T05:47:38.388118+0000","last_became_active":"2024-09-21T05:47:05.637433+0000","last_became_peered":"2024-09-21T05:47:05.637433+0000","last_unstale":"2024-09-21T05:47:38.388118+0000","last_undegraded":"2024-09-21T05:47:38.388118+0000","last_fullsized":"2024-09-21T05:47:38.388118+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:55.181025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:48.536185+0000","last_change":"2024-09-21T05:47:03.614460+0000","last_active":"2024-09-21T05:47:48.536185+0000","last_peered":"2024-09-21T05:47:48.536185+0000","last_clean":"2024-09-21T05:47:48.536185+0000","last_became_active":"2024-09-21T05:47:03.613975+0000","last_became_peered":"2024-09-21T05:47:03.613975+0000","last_unstale":"2024-09-21T05:47:48.536185+0000","last_undegraded":"2024-09-21T05:47:48.536185+0000","last_fullsized":"2024-09-21T05:47:48.536185+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:26.838907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.733785+0000","last_change":"2024-09-21T05:47:38.733044+0000","last_active":"2024-09-21T05:47:38.733785+0000","last_peered":"2024-09-21T05:47:38.733785+0000","last_clean":"2024-09-21T05:47:38.733785+0000","last_became_active":"2024-09-21T05:47:38.732327+0000","last_became_peered":"2024-09-21T05:47:38.732327+0000","last_unstale":"2024-09-21T05:47:38.733785+0000","last_undegraded":"2024-09-21T05:47:38.733785+0000","last_fullsized":"2024-09-21T05:47:38.733785+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:59.462529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.393398+0000","last_change":"2024-09-21T05:47:05.631831+0000","last_active":"2024-09-21T05:47:38.393398+0000","last_peered":"2024-09-21T05:47:38.393398+0000","last_clean":"2024-09-21T05:47:38.393398+0000","last_became_active":"2024-09-21T05:47:05.630403+0000","last_became_peered":"2024-09-21T05:47:05.630403+0000","last_unstale":"2024-09-21T05:47:38.393398+0000","last_undegraded":"2024-09-21T05:47:38.393398+0000","last_fullsized":"2024-09-21T05:47:38.393398+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:21.163262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:49.545344+0000","last_change":"2024-09-21T05:47:03.618888+0000","last_active":"2024-09-21T05:47:49.545344+0000","last_peered":"2024-09-21T05:47:49.545344+0000","last_clean":"2024-09-21T05:47:49.545344+0000","last_became_active":"2024-09-21T05:47:03.618506+0000","last_became_peered":"2024-09-21T05:47:03.618506+0000","last_unstale":"2024-09-21T05:47:49.545344+0000","last_undegraded":"2024-09-21T05:47:49.545344+0000","last_fullsized":"2024-09-21T05:47:49.545344+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:52.711976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.392444+0000","last_change":"2024-09-21T05:47:12.675649+0000","last_active":"2024-09-21T05:47:38.392444+0000","last_peered":"2024-09-21T05:47:38.392444+0000","last_clean":"2024-09-21T05:47:38.392444+0000","last_became_active":"2024-09-21T05:47:12.675268+0000","last_became_peered":"2024-09-21T05:47:12.675268+0000","last_unstale":"2024-09-21T05:47:38.392444+0000","last_undegraded":"2024-09-21T05:47:38.392444+0000","last_fullsized":"2024-09-21T05:47:38.392444+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:48:31.481292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.394026+0000","last_change":"2024-09-21T05:47:05.622838+0000","last_active":"2024-09-21T05:47:38.394026+0000","last_peered":"2024-09-21T05:47:38.394026+0000","last_clean":"2024-09-21T05:47:38.394026+0000","last_became_active":"2024-09-21T05:47:05.622216+0000","last_became_peered":"2024-09-21T05:47:05.622216+0000","last_unstale":"2024-09-21T05:47:38.394026+0000","last_undegraded":"2024-09-21T05:47:38.394026+0000","last_fullsized":"2024-09-21T05:47:38.394026+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:55.446747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:46.516723+0000","last_change":"2024-09-21T05:47:03.670405+0000","last_active":"2024-09-21T05:47:46.516723+0000","last_peered":"2024-09-21T05:47:46.516723+0000","last_clean":"2024-09-21T05:47:46.516723+0000","last_became_active":"2024-09-21T05:47:03.669958+0000","last_became_peered":"2024-09-21T05:47:03.669958+0000","last_unstale":"2024-09-21T05:47:46.516723+0000","last_undegraded":"2024-09-21T05:47:46.516723+0000","last_fullsized":"2024-09-21T05:47:46.516723+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:25.702903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.399170+0000","last_change":"2024-09-21T05:47:38.399039+0000","last_active":"2024-09-21T05:47:38.399170+0000","last_peered":"2024-09-21T05:47:38.399170+0000","last_clean":"2024-09-21T05:47:38.399170+0000","last_became_active":"2024-09-21T05:47:38.398441+0000","last_became_peered":"2024-09-21T05:47:38.398441+0000","last_unstale":"2024-09-21T05:47:38.399170+0000","last_undegraded":"2024-09-21T05:47:38.399170+0000","last_fullsized":"2024-09-21T05:47:38.399170+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:11.095516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,8],"acting":[4,5,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.392217+0000","last_change":"2024-09-21T05:47:05.632911+0000","last_active":"2024-09-21T05:47:38.392217+0000","last_peered":"2024-09-21T05:47:38.392217+0000","last_clean":"2024-09-21T05:47:38.392217+0000","last_became_active":"2024-09-21T05:47:05.632256+0000","last_became_peered":"2024-09-21T05:47:05.632256+0000","last_unstale":"2024-09-21T05:47:38.392217+0000","last_undegraded":"2024-09-21T05:47:38.392217+0000","last_fullsized":"2024-09-21T05:47:38.392217+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:41.014253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:49.545014+0000","last_change":"2024-09-21T05:47:04.411753+0000","last_active":"2024-09-21T05:47:49.545014+0000","last_peered":"2024-09-21T05:47:49.545014+0000","last_clean":"2024-09-21T05:47:49.545014+0000","last_became_active":"2024-09-21T05:47:04.411225+0000","last_became_peered":"2024-09-21T05:47:04.411225+0000","last_unstale":"2024-09-21T05:47:49.545014+0000","last_undegraded":"2024-09-21T05:47:49.545014+0000","last_fullsized":"2024-09-21T05:47:49.545014+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:07.964184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.388266+0000","last_change":"2024-09-21T05:47:12.670157+0000","last_active":"2024-09-21T05:47:38.388266+0000","last_peered":"2024-09-21T05:47:38.388266+0000","last_clean":"2024-09-21T05:47:38.388266+0000","last_became_active":"2024-09-21T05:47:12.669710+0000","last_became_peered":"2024-09-21T05:47:12.669710+0000","last_unstale":"2024-09-21T05:47:38.388266+0000","last_undegraded":"2024-09-21T05:47:38.388266+0000","last_fullsized":"2024-09-21T05:47:38.388266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:31.023624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.388647+0000","last_change":"2024-09-21T05:47:05.637982+0000","last_active":"2024-09-21T05:47:38.388647+0000","last_peered":"2024-09-21T05:47:38.388647+0000","last_clean":"2024-09-21T05:47:38.388647+0000","last_became_active":"2024-09-21T05:47:05.637357+0000","last_became_peered":"2024-09-21T05:47:05.637357+0000","last_unstale":"2024-09-21T05:47:38.388647+0000","last_undegraded":"2024-09-21T05:47:38.388647+0000","last_fullsized":"2024-09-21T05:47:38.388647+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:41:12.986231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"83'13","reported_seq":47,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:59.631753+0000","last_change":"2024-09-21T05:47:03.611556+0000","last_active":"2024-09-21T05:47:59.631753+0000","last_peered":"2024-09-21T05:47:59.631753+0000","last_clean":"2024-09-21T05:47:59.631753+0000","last_became_active":"2024-09-21T05:47:03.611192+0000","last_became_peered":"2024-09-21T05:47:03.611192+0000","last_unstale":"2024-09-21T05:47:59.631753+0000","last_undegraded":"2024-09-21T05:47:59.631753+0000","last_fullsized":"2024-09-21T05:47:59.631753+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:20.047405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.387623+0000","last_change":"2024-09-21T05:47:12.874796+0000","last_active":"2024-09-21T05:47:38.387623+0000","last_peered":"2024-09-21T05:47:38.387623+0000","last_clean":"2024-09-21T05:47:38.387623+0000","last_became_active":"2024-09-21T05:47:12.873648+0000","last_became_peered":"2024-09-21T05:47:12.873648+0000","last_unstale":"2024-09-21T05:47:38.387623+0000","last_undegraded":"2024-09-21T05:47:38.387623+0000","last_fullsized":"2024-09-21T05:47:38.387623+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:50.591584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.730746+0000","last_change":"2024-09-21T05:47:05.634289+0000","last_active":"2024-09-21T05:47:38.730746+0000","last_peered":"2024-09-21T05:47:38.730746+0000","last_clean":"2024-09-21T05:47:38.730746+0000","last_became_active":"2024-09-21T05:47:05.633971+0000","last_became_peered":"2024-09-21T05:47:05.633971+0000","last_unstale":"2024-09-21T05:47:38.730746+0000","last_undegraded":"2024-09-21T05:47:38.730746+0000","last_fullsized":"2024-09-21T05:47:38.730746+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:53.819753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:49.546325+0000","last_change":"2024-09-21T05:47:03.671877+0000","last_active":"2024-09-21T05:47:49.546325+0000","last_peered":"2024-09-21T05:47:49.546325+0000","last_clean":"2024-09-21T05:47:49.546325+0000","last_became_active":"2024-09-21T05:47:03.671443+0000","last_became_peered":"2024-09-21T05:47:03.671443+0000","last_unstale":"2024-09-21T05:47:49.546325+0000","last_undegraded":"2024-09-21T05:47:49.546325+0000","last_fullsized":"2024-09-21T05:47:49.546325+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:00.114953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.393293+0000","last_change":"2024-09-21T05:47:12.673004+0000","last_active":"2024-09-21T05:47:38.393293+0000","last_peered":"2024-09-21T05:47:38.393293+0000","last_clean":"2024-09-21T05:47:38.393293+0000","last_became_active":"2024-09-21T05:47:12.671784+0000","last_became_peered":"2024-09-21T05:47:12.671784+0000","last_unstale":"2024-09-21T05:47:38.393293+0000","last_undegraded":"2024-09-21T05:47:38.393293+0000","last_fullsized":"2024-09-21T05:47:38.393293+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:38.672438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.394216+0000","last_change":"2024-09-21T05:47:05.635204+0000","last_active":"2024-09-21T05:47:38.394216+0000","last_peered":"2024-09-21T05:47:38.394216+0000","last_clean":"2024-09-21T05:47:38.394216+0000","last_became_active":"2024-09-21T05:47:05.634794+0000","last_became_peered":"2024-09-21T05:47:05.634794+0000","last_unstale":"2024-09-21T05:47:38.394216+0000","last_undegraded":"2024-09-21T05:47:38.394216+0000","last_fullsized":"2024-09-21T05:47:38.394216+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:08.208843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.391949+0000","last_change":"2024-09-21T05:47:03.671864+0000","last_active":"2024-09-21T05:47:38.391949+0000","last_peered":"2024-09-21T05:47:38.391949+0000","last_clean":"2024-09-21T05:47:38.391949+0000","last_became_active":"2024-09-21T05:47:03.671510+0000","last_became_peered":"2024-09-21T05:47:03.671510+0000","last_unstale":"2024-09-21T05:47:38.391949+0000","last_undegraded":"2024-09-21T05:47:38.391949+0000","last_fullsized":"2024-09-21T05:47:38.391949+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:12.831235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.398832+0000","last_change":"2024-09-21T05:47:38.398708+0000","last_active":"2024-09-21T05:47:38.398832+0000","last_peered":"2024-09-21T05:47:38.398832+0000","last_clean":"2024-09-21T05:47:38.398832+0000","last_became_active":"2024-09-21T05:47:38.398211+0000","last_became_peered":"2024-09-21T05:47:38.398211+0000","last_unstale":"2024-09-21T05:47:38.398832+0000","last_undegraded":"2024-09-21T05:47:38.398832+0000","last_fullsized":"2024-09-21T05:47:38.398832+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:29.250191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.395121+0000","last_change":"2024-09-21T05:47:05.633069+0000","last_active":"2024-09-21T05:47:38.395121+0000","last_peered":"2024-09-21T05:47:38.395121+0000","last_clean":"2024-09-21T05:47:38.395121+0000","last_became_active":"2024-09-21T05:47:05.632698+0000","last_became_peered":"2024-09-21T05:47:05.632698+0000","last_unstale":"2024-09-21T05:47:38.395121+0000","last_undegraded":"2024-09-21T05:47:38.395121+0000","last_fullsized":"2024-09-21T05:47:38.395121+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:04.081062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'5","reported_seq":52,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:59.564733+0000","last_change":"2024-09-21T05:47:03.622490+0000","last_active":"2024-09-21T05:47:59.564733+0000","last_peered":"2024-09-21T05:47:59.564733+0000","last_clean":"2024-09-21T05:47:59.564733+0000","last_became_active":"2024-09-21T05:47:03.622093+0000","last_became_peered":"2024-09-21T05:47:03.622093+0000","last_unstale":"2024-09-21T05:47:59.564733+0000","last_undegraded":"2024-09-21T05:47:59.564733+0000","last_fullsized":"2024-09-21T05:47:59.564733+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:40.500152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.730583+0000","last_change":"2024-09-21T05:47:12.670060+0000","last_active":"2024-09-21T05:47:38.730583+0000","last_peered":"2024-09-21T05:47:38.730583+0000","last_clean":"2024-09-21T05:47:38.730583+0000","last_became_active":"2024-09-21T05:47:12.669635+0000","last_became_peered":"2024-09-21T05:47:12.669635+0000","last_unstale":"2024-09-21T05:47:38.730583+0000","last_undegraded":"2024-09-21T05:47:38.730583+0000","last_fullsized":"2024-09-21T05:47:38.730583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:14.786984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.390489+0000","last_change":"2024-09-21T05:47:05.640553+0000","last_active":"2024-09-21T05:47:38.390489+0000","last_peered":"2024-09-21T05:47:38.390489+0000","last_clean":"2024-09-21T05:47:38.390489+0000","last_became_active":"2024-09-21T05:47:05.640151+0000","last_became_peered":"2024-09-21T05:47:05.640151+0000","last_unstale":"2024-09-21T05:47:38.390489+0000","last_undegraded":"2024-09-21T05:47:38.390489+0000","last_fullsized":"2024-09-21T05:47:38.390489+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:39.904129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":55,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:48:02.570745+0000","last_change":"2024-09-21T05:47:03.670178+0000","last_active":"2024-09-21T05:48:02.570745+0000","last_peered":"2024-09-21T05:48:02.570745+0000","last_clean":"2024-09-21T05:48:02.570745+0000","last_became_active":"2024-09-21T05:47:03.669715+0000","last_became_peered":"2024-09-21T05:47:03.669715+0000","last_unstale":"2024-09-21T05:48:02.570745+0000","last_undegraded":"2024-09-21T05:48:02.570745+0000","last_fullsized":"2024-09-21T05:48:02.570745+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:31.457820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.731258+0000","last_change":"2024-09-21T05:47:12.875173+0000","last_active":"2024-09-21T05:47:38.731258+0000","last_peered":"2024-09-21T05:47:38.731258+0000","last_clean":"2024-09-21T05:47:38.731258+0000","last_became_active":"2024-09-21T05:47:12.873749+0000","last_became_peered":"2024-09-21T05:47:12.873749+0000","last_unstale":"2024-09-21T05:47:38.731258+0000","last_undegraded":"2024-09-21T05:47:38.731258+0000","last_fullsized":"2024-09-21T05:47:38.731258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:33.473645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.730016+0000","last_change":"2024-09-21T05:47:05.634346+0000","last_active":"2024-09-21T05:47:38.730016+0000","last_peered":"2024-09-21T05:47:38.730016+0000","last_clean":"2024-09-21T05:47:38.730016+0000","last_became_active":"2024-09-21T05:47:05.634004+0000","last_became_peered":"2024-09-21T05:47:05.634004+0000","last_unstale":"2024-09-21T05:47:38.730016+0000","last_undegraded":"2024-09-21T05:47:38.730016+0000","last_fullsized":"2024-09-21T05:47:38.730016+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:16.328729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:47.529024+0000","last_change":"2024-09-21T05:47:03.619472+0000","last_active":"2024-09-21T05:47:47.529024+0000","last_peered":"2024-09-21T05:47:47.529024+0000","last_clean":"2024-09-21T05:47:47.529024+0000","last_became_active":"2024-09-21T05:47:03.619077+0000","last_became_peered":"2024-09-21T05:47:03.619077+0000","last_unstale":"2024-09-21T05:47:47.529024+0000","last_undegraded":"2024-09-21T05:47:47.529024+0000","last_fullsized":"2024-09-21T05:47:47.529024+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:17.774462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.731291+0000","last_change":"2024-09-21T05:47:38.730714+0000","last_active":"2024-09-21T05:47:38.731291+0000","last_peered":"2024-09-21T05:47:38.731291+0000","last_clean":"2024-09-21T05:47:38.731291+0000","last_became_active":"2024-09-21T05:47:38.730271+0000","last_became_peered":"2024-09-21T05:47:38.730271+0000","last_unstale":"2024-09-21T05:47:38.731291+0000","last_undegraded":"2024-09-21T05:47:38.731291+0000","last_fullsized":"2024-09-21T05:47:38.731291+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:53.391967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.387996+0000","last_change":"2024-09-21T05:47:05.642487+0000","last_active":"2024-09-21T05:47:38.387996+0000","last_peered":"2024-09-21T05:47:38.387996+0000","last_clean":"2024-09-21T05:47:38.387996+0000","last_became_active":"2024-09-21T05:47:05.642022+0000","last_became_peered":"2024-09-21T05:47:05.642022+0000","last_unstale":"2024-09-21T05:47:38.387996+0000","last_undegraded":"2024-09-21T05:47:38.387996+0000","last_fullsized":"2024-09-21T05:47:38.387996+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:50:38.435444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:50.546973+0000","last_change":"2024-09-21T05:47:03.618333+0000","last_active":"2024-09-21T05:47:50.546973+0000","last_peered":"2024-09-21T05:47:50.546973+0000","last_clean":"2024-09-21T05:47:50.546973+0000","last_became_active":"2024-09-21T05:47:03.617843+0000","last_became_peered":"2024-09-21T05:47:03.617843+0000","last_unstale":"2024-09-21T05:47:50.546973+0000","last_undegraded":"2024-09-21T05:47:50.546973+0000","last_fullsized":"2024-09-21T05:47:50.546973+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:01.647913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":110,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.730988+0000","last_change":"2024-09-21T05:45:52.661435+0000","last_active":"2024-09-21T05:47:38.730988+0000","last_peered":"2024-09-21T05:47:38.730988+0000","last_clean":"2024-09-21T05:47:38.730988+0000","last_became_active":"2024-09-21T05:45:52.656767+0000","last_became_peered":"2024-09-21T05:45:52.656767+0000","last_unstale":"2024-09-21T05:47:38.730988+0000","last_undegraded":"2024-09-21T05:47:38.730988+0000","last_fullsized":"2024-09-21T05:47:38.730988+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:42:26.045146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:42:26.045146+0000","last_clean_scrub_stamp":"2024-09-21T05:42:26.045146+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:40:12.152499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.731030+0000","last_change":"2024-09-21T05:47:12.675435+0000","last_active":"2024-09-21T05:47:38.731030+0000","last_peered":"2024-09-21T05:47:38.731030+0000","last_clean":"2024-09-21T05:47:38.731030+0000","last_became_active":"2024-09-21T05:47:12.674955+0000","last_became_peered":"2024-09-21T05:47:12.674955+0000","last_unstale":"2024-09-21T05:47:38.731030+0000","last_undegraded":"2024-09-21T05:47:38.731030+0000","last_fullsized":"2024-09-21T05:47:38.731030+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:18.758498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.731436+0000","last_change":"2024-09-21T05:47:05.640952+0000","last_active":"2024-09-21T05:47:38.731436+0000","last_peered":"2024-09-21T05:47:38.731436+0000","last_clean":"2024-09-21T05:47:38.731436+0000","last_became_active":"2024-09-21T05:47:05.640554+0000","last_became_peered":"2024-09-21T05:47:05.640554+0000","last_unstale":"2024-09-21T05:47:38.731436+0000","last_undegraded":"2024-09-21T05:47:38.731436+0000","last_fullsized":"2024-09-21T05:47:38.731436+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:15:08.553651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'5","reported_seq":56,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:48:03.571690+0000","last_change":"2024-09-21T05:47:04.411605+0000","last_active":"2024-09-21T05:48:03.571690+0000","last_peered":"2024-09-21T05:48:03.571690+0000","last_clean":"2024-09-21T05:48:03.571690+0000","last_became_active":"2024-09-21T05:47:04.411129+0000","last_became_peered":"2024-09-21T05:47:04.411129+0000","last_unstale":"2024-09-21T05:48:03.571690+0000","last_undegraded":"2024-09-21T05:48:03.571690+0000","last_fullsized":"2024-09-21T05:48:03.571690+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:25.469148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.388557+0000","last_change":"2024-09-21T05:47:12.670479+0000","last_active":"2024-09-21T05:47:38.388557+0000","last_peered":"2024-09-21T05:47:38.388557+0000","last_clean":"2024-09-21T05:47:38.388557+0000","last_became_active":"2024-09-21T05:47:12.669925+0000","last_became_peered":"2024-09-21T05:47:12.669925+0000","last_unstale":"2024-09-21T05:47:38.388557+0000","last_undegraded":"2024-09-21T05:47:38.388557+0000","last_fullsized":"2024-09-21T05:47:38.388557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:50.506063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.731196+0000","last_change":"2024-09-21T05:47:05.634519+0000","last_active":"2024-09-21T05:47:38.731196+0000","last_peered":"2024-09-21T05:47:38.731196+0000","last_clean":"2024-09-21T05:47:38.731196+0000","last_became_active":"2024-09-21T05:47:05.634134+0000","last_became_peered":"2024-09-21T05:47:05.634134+0000","last_unstale":"2024-09-21T05:47:38.731196+0000","last_undegraded":"2024-09-21T05:47:38.731196+0000","last_fullsized":"2024-09-21T05:47:38.731196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:57.464884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:49.545372+0000","last_change":"2024-09-21T05:47:03.622860+0000","last_active":"2024-09-21T05:47:49.545372+0000","last_peered":"2024-09-21T05:47:49.545372+0000","last_clean":"2024-09-21T05:47:49.545372+0000","last_became_active":"2024-09-21T05:47:03.622435+0000","last_became_peered":"2024-09-21T05:47:03.622435+0000","last_unstale":"2024-09-21T05:47:49.545372+0000","last_undegraded":"2024-09-21T05:47:49.545372+0000","last_fullsized":"2024-09-21T05:47:49.545372+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:03.352140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.392040+0000","last_change":"2024-09-21T05:47:12.673518+0000","last_active":"2024-09-21T05:47:38.392040+0000","last_peered":"2024-09-21T05:47:38.392040+0000","last_clean":"2024-09-21T05:47:38.392040+0000","last_became_active":"2024-09-21T05:47:12.673000+0000","last_became_peered":"2024-09-21T05:47:12.673000+0000","last_unstale":"2024-09-21T05:47:38.392040+0000","last_undegraded":"2024-09-21T05:47:38.392040+0000","last_fullsized":"2024-09-21T05:47:38.392040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:37.859801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.731674+0000","last_change":"2024-09-21T05:47:05.625144+0000","last_active":"2024-09-21T05:47:38.731674+0000","last_peered":"2024-09-21T05:47:38.731674+0000","last_clean":"2024-09-21T05:47:38.731674+0000","last_became_active":"2024-09-21T05:47:05.624593+0000","last_became_peered":"2024-09-21T05:47:05.624593+0000","last_unstale":"2024-09-21T05:47:38.731674+0000","last_undegraded":"2024-09-21T05:47:38.731674+0000","last_fullsized":"2024-09-21T05:47:38.731674+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:04.332686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:49.545189+0000","last_change":"2024-09-21T05:47:03.612389+0000","last_active":"2024-09-21T05:47:49.545189+0000","last_peered":"2024-09-21T05:47:49.545189+0000","last_clean":"2024-09-21T05:47:49.545189+0000","last_became_active":"2024-09-21T05:47:03.612023+0000","last_became_peered":"2024-09-21T05:47:03.612023+0000","last_unstale":"2024-09-21T05:47:49.545189+0000","last_undegraded":"2024-09-21T05:47:49.545189+0000","last_fullsized":"2024-09-21T05:47:49.545189+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:32.571903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.390278+0000","last_change":"2024-09-21T05:47:12.674963+0000","last_active":"2024-09-21T05:47:38.390278+0000","last_peered":"2024-09-21T05:47:38.390278+0000","last_clean":"2024-09-21T05:47:38.390278+0000","last_became_active":"2024-09-21T05:47:12.673883+0000","last_became_peered":"2024-09-21T05:47:12.673883+0000","last_unstale":"2024-09-21T05:47:38.390278+0000","last_undegraded":"2024-09-21T05:47:38.390278+0000","last_fullsized":"2024-09-21T05:47:38.390278+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:29.843443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.394407+0000","last_change":"2024-09-21T05:47:05.638440+0000","last_active":"2024-09-21T05:47:38.394407+0000","last_peered":"2024-09-21T05:47:38.394407+0000","last_clean":"2024-09-21T05:47:38.394407+0000","last_became_active":"2024-09-21T05:47:05.638010+0000","last_became_peered":"2024-09-21T05:47:05.638010+0000","last_unstale":"2024-09-21T05:47:38.394407+0000","last_undegraded":"2024-09-21T05:47:38.394407+0000","last_fullsized":"2024-09-21T05:47:38.394407+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:47.921461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:49.522786+0000","last_change":"2024-09-21T05:47:03.613800+0000","last_active":"2024-09-21T05:47:49.522786+0000","last_peered":"2024-09-21T05:47:49.522786+0000","last_clean":"2024-09-21T05:47:49.522786+0000","last_became_active":"2024-09-21T05:47:03.613377+0000","last_became_peered":"2024-09-21T05:47:03.613377+0000","last_unstale":"2024-09-21T05:47:49.522786+0000","last_undegraded":"2024-09-21T05:47:49.522786+0000","last_fullsized":"2024-09-21T05:47:49.522786+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:25.467703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.390473+0000","last_change":"2024-09-21T05:47:12.675362+0000","last_active":"2024-09-21T05:47:38.390473+0000","last_peered":"2024-09-21T05:47:38.390473+0000","last_clean":"2024-09-21T05:47:38.390473+0000","last_became_active":"2024-09-21T05:47:12.674578+0000","last_became_peered":"2024-09-21T05:47:12.674578+0000","last_unstale":"2024-09-21T05:47:38.390473+0000","last_undegraded":"2024-09-21T05:47:38.390473+0000","last_fullsized":"2024-09-21T05:47:38.390473+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:56.654323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.390703+0000","last_change":"2024-09-21T05:47:05.641130+0000","last_active":"2024-09-21T05:47:38.390703+0000","last_peered":"2024-09-21T05:47:38.390703+0000","last_clean":"2024-09-21T05:47:38.390703+0000","last_became_active":"2024-09-21T05:47:05.640794+0000","last_became_peered":"2024-09-21T05:47:05.640794+0000","last_unstale":"2024-09-21T05:47:38.390703+0000","last_undegraded":"2024-09-21T05:47:38.390703+0000","last_fullsized":"2024-09-21T05:47:38.390703+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:29:18.243240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:49.546100+0000","last_change":"2024-09-21T05:47:03.671834+0000","last_active":"2024-09-21T05:47:49.546100+0000","last_peered":"2024-09-21T05:47:49.546100+0000","last_clean":"2024-09-21T05:47:49.546100+0000","last_became_active":"2024-09-21T05:47:03.671437+0000","last_became_peered":"2024-09-21T05:47:03.671437+0000","last_unstale":"2024-09-21T05:47:49.546100+0000","last_undegraded":"2024-09-21T05:47:49.546100+0000","last_fullsized":"2024-09-21T05:47:49.546100+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:40.362718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.731182+0000","last_change":"2024-09-21T05:47:12.671181+0000","last_active":"2024-09-21T05:47:38.731182+0000","last_peered":"2024-09-21T05:47:38.731182+0000","last_clean":"2024-09-21T05:47:38.731182+0000","last_became_active":"2024-09-21T05:47:12.670522+0000","last_became_peered":"2024-09-21T05:47:12.670522+0000","last_unstale":"2024-09-21T05:47:38.731182+0000","last_undegraded":"2024-09-21T05:47:38.731182+0000","last_fullsized":"2024-09-21T05:47:38.731182+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:52.165812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.730644+0000","last_change":"2024-09-21T05:47:05.629167+0000","last_active":"2024-09-21T05:47:38.730644+0000","last_peered":"2024-09-21T05:47:38.730644+0000","last_clean":"2024-09-21T05:47:38.730644+0000","last_became_active":"2024-09-21T05:47:05.628794+0000","last_became_peered":"2024-09-21T05:47:05.628794+0000","last_unstale":"2024-09-21T05:47:38.730644+0000","last_undegraded":"2024-09-21T05:47:38.730644+0000","last_fullsized":"2024-09-21T05:47:38.730644+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:51.469247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'6","reported_seq":57,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:48:01.569813+0000","last_change":"2024-09-21T05:47:03.621479+0000","last_active":"2024-09-21T05:48:01.569813+0000","last_peered":"2024-09-21T05:48:01.569813+0000","last_clean":"2024-09-21T05:48:01.569813+0000","last_became_active":"2024-09-21T05:47:03.621041+0000","last_became_peered":"2024-09-21T05:47:03.621041+0000","last_unstale":"2024-09-21T05:48:01.569813+0000","last_undegraded":"2024-09-21T05:48:01.569813+0000","last_fullsized":"2024-09-21T05:48:01.569813+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:33.092750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.392577+0000","last_change":"2024-09-21T05:47:12.669821+0000","last_active":"2024-09-21T05:47:38.392577+0000","last_peered":"2024-09-21T05:47:38.392577+0000","last_clean":"2024-09-21T05:47:38.392577+0000","last_became_active":"2024-09-21T05:47:12.669418+0000","last_became_peered":"2024-09-21T05:47:12.669418+0000","last_unstale":"2024-09-21T05:47:38.392577+0000","last_undegraded":"2024-09-21T05:47:38.392577+0000","last_fullsized":"2024-09-21T05:47:38.392577+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:57.082509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.731241+0000","last_change":"2024-09-21T05:47:05.631182+0000","last_active":"2024-09-21T05:47:38.731241+0000","last_peered":"2024-09-21T05:47:38.731241+0000","last_clean":"2024-09-21T05:47:38.731241+0000","last_became_active":"2024-09-21T05:47:05.630716+0000","last_became_peered":"2024-09-21T05:47:05.630716+0000","last_unstale":"2024-09-21T05:47:38.731241+0000","last_undegraded":"2024-09-21T05:47:38.731241+0000","last_fullsized":"2024-09-21T05:47:38.731241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:17.946858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:49.545807+0000","last_change":"2024-09-21T05:47:03.620897+0000","last_active":"2024-09-21T05:47:49.545807+0000","last_peered":"2024-09-21T05:47:49.545807+0000","last_clean":"2024-09-21T05:47:49.545807+0000","last_became_active":"2024-09-21T05:47:03.620003+0000","last_became_peered":"2024-09-21T05:47:03.620003+0000","last_unstale":"2024-09-21T05:47:49.545807+0000","last_undegraded":"2024-09-21T05:47:49.545807+0000","last_fullsized":"2024-09-21T05:47:49.545807+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:51:07.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.393910+0000","last_change":"2024-09-21T05:47:12.675320+0000","last_active":"2024-09-21T05:47:38.393910+0000","last_peered":"2024-09-21T05:47:38.393910+0000","last_clean":"2024-09-21T05:47:38.393910+0000","last_became_active":"2024-09-21T05:47:12.674715+0000","last_became_peered":"2024-09-21T05:47:12.674715+0000","last_unstale":"2024-09-21T05:47:38.393910+0000","last_undegraded":"2024-09-21T05:47:38.393910+0000","last_fullsized":"2024-09-21T05:47:38.393910+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:28.151947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.730262+0000","last_change":"2024-09-21T05:47:05.630786+0000","last_active":"2024-09-21T05:47:38.730262+0000","last_peered":"2024-09-21T05:47:38.730262+0000","last_clean":"2024-09-21T05:47:38.730262+0000","last_became_active":"2024-09-21T05:47:05.630433+0000","last_became_peered":"2024-09-21T05:47:05.630433+0000","last_unstale":"2024-09-21T05:47:38.730262+0000","last_undegraded":"2024-09-21T05:47:38.730262+0000","last_fullsized":"2024-09-21T05:47:38.730262+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:54.481462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":45,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:50.546432+0000","last_change":"2024-09-21T05:47:03.618990+0000","last_active":"2024-09-21T05:47:50.546432+0000","last_peered":"2024-09-21T05:47:50.546432+0000","last_clean":"2024-09-21T05:47:50.546432+0000","last_became_active":"2024-09-21T05:47:03.618679+0000","last_became_peered":"2024-09-21T05:47:03.618679+0000","last_unstale":"2024-09-21T05:47:50.546432+0000","last_undegraded":"2024-09-21T05:47:50.546432+0000","last_fullsized":"2024-09-21T05:47:50.546432+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:10.193233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.391491+0000","last_change":"2024-09-21T05:47:12.675012+0000","last_active":"2024-09-21T05:47:38.391491+0000","last_peered":"2024-09-21T05:47:38.391491+0000","last_clean":"2024-09-21T05:47:38.391491+0000","last_became_active":"2024-09-21T05:47:12.674266+0000","last_became_peered":"2024-09-21T05:47:12.674266+0000","last_unstale":"2024-09-21T05:47:38.391491+0000","last_undegraded":"2024-09-21T05:47:38.391491+0000","last_fullsized":"2024-09-21T05:47:38.391491+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:43.525084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.395330+0000","last_change":"2024-09-21T05:47:05.625457+0000","last_active":"2024-09-21T05:47:38.395330+0000","last_peered":"2024-09-21T05:47:38.395330+0000","last_clean":"2024-09-21T05:47:38.395330+0000","last_became_active":"2024-09-21T05:47:05.625058+0000","last_became_peered":"2024-09-21T05:47:05.625058+0000","last_unstale":"2024-09-21T05:47:38.395330+0000","last_undegraded":"2024-09-21T05:47:38.395330+0000","last_fullsized":"2024-09-21T05:47:38.395330+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:29:09.352152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"83'31","reported_seq":96,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:48:01.574905+0000","last_change":"2024-09-21T05:47:03.621535+0000","last_active":"2024-09-21T05:48:01.574905+0000","last_peered":"2024-09-21T05:48:01.574905+0000","last_clean":"2024-09-21T05:48:01.574905+0000","last_became_active":"2024-09-21T05:47:03.621109+0000","last_became_peered":"2024-09-21T05:47:03.621109+0000","last_unstale":"2024-09-21T05:48:01.574905+0000","last_undegraded":"2024-09-21T05:48:01.574905+0000","last_fullsized":"2024-09-21T05:48:01.574905+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:31:12.135760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56544,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":31,"num_read_kb":70,"num_write":33,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.391728+0000","last_change":"2024-09-21T05:47:12.676827+0000","last_active":"2024-09-21T05:47:38.391728+0000","last_peered":"2024-09-21T05:47:38.391728+0000","last_clean":"2024-09-21T05:47:38.391728+0000","last_became_active":"2024-09-21T05:47:12.676256+0000","last_became_peered":"2024-09-21T05:47:12.676256+0000","last_unstale":"2024-09-21T05:47:38.391728+0000","last_undegraded":"2024-09-21T05:47:38.391728+0000","last_fullsized":"2024-09-21T05:47:38.391728+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:40.932328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.388793+0000","last_change":"2024-09-21T05:47:05.636507+0000","last_active":"2024-09-21T05:47:38.388793+0000","last_peered":"2024-09-21T05:47:38.388793+0000","last_clean":"2024-09-21T05:47:38.388793+0000","last_became_active":"2024-09-21T05:47:05.636140+0000","last_became_peered":"2024-09-21T05:47:05.636140+0000","last_unstale":"2024-09-21T05:47:38.388793+0000","last_undegraded":"2024-09-21T05:47:38.388793+0000","last_fullsized":"2024-09-21T05:47:38.388793+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:16.879274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:48.538065+0000","last_change":"2024-09-21T05:47:03.670425+0000","last_active":"2024-09-21T05:47:48.538065+0000","last_peered":"2024-09-21T05:47:48.538065+0000","last_clean":"2024-09-21T05:47:48.538065+0000","last_became_active":"2024-09-21T05:47:03.669973+0000","last_became_peered":"2024-09-21T05:47:03.669973+0000","last_unstale":"2024-09-21T05:47:48.538065+0000","last_undegraded":"2024-09-21T05:47:48.538065+0000","last_fullsized":"2024-09-21T05:47:48.538065+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:04.212044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.394015+0000","last_change":"2024-09-21T05:47:12.677600+0000","last_active":"2024-09-21T05:47:38.394015+0000","last_peered":"2024-09-21T05:47:38.394015+0000","last_clean":"2024-09-21T05:47:38.394015+0000","last_became_active":"2024-09-21T05:47:12.677037+0000","last_became_peered":"2024-09-21T05:47:12.677037+0000","last_unstale":"2024-09-21T05:47:38.394015+0000","last_undegraded":"2024-09-21T05:47:38.394015+0000","last_fullsized":"2024-09-21T05:47:38.394015+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:36.502821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.398486+0000","last_change":"2024-09-21T05:47:38.398403+0000","last_active":"2024-09-21T05:47:38.398486+0000","last_peered":"2024-09-21T05:47:38.398486+0000","last_clean":"2024-09-21T05:47:38.398486+0000","last_became_active":"2024-09-21T05:47:38.397953+0000","last_became_peered":"2024-09-21T05:47:38.397953+0000","last_unstale":"2024-09-21T05:47:38.398486+0000","last_undegraded":"2024-09-21T05:47:38.398486+0000","last_fullsized":"2024-09-21T05:47:38.398486+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:01.550222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:49.546201+0000","last_change":"2024-09-21T05:47:03.622681+0000","last_active":"2024-09-21T05:47:49.546201+0000","last_peered":"2024-09-21T05:47:49.546201+0000","last_clean":"2024-09-21T05:47:49.546201+0000","last_became_active":"2024-09-21T05:47:03.622139+0000","last_became_peered":"2024-09-21T05:47:03.622139+0000","last_unstale":"2024-09-21T05:47:49.546201+0000","last_undegraded":"2024-09-21T05:47:49.546201+0000","last_fullsized":"2024-09-21T05:47:49.546201+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:25.678388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.390593+0000","last_change":"2024-09-21T05:47:12.670466+0000","last_active":"2024-09-21T05:47:38.390593+0000","last_peered":"2024-09-21T05:47:38.390593+0000","last_clean":"2024-09-21T05:47:38.390593+0000","last_became_active":"2024-09-21T05:47:12.670032+0000","last_became_peered":"2024-09-21T05:47:12.670032+0000","last_unstale":"2024-09-21T05:47:38.390593+0000","last_undegraded":"2024-09-21T05:47:38.390593+0000","last_fullsized":"2024-09-21T05:47:38.390593+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:18.860347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.389110+0000","last_change":"2024-09-21T05:47:05.645093+0000","last_active":"2024-09-21T05:47:38.389110+0000","last_peered":"2024-09-21T05:47:38.389110+0000","last_clean":"2024-09-21T05:47:38.389110+0000","last_became_active":"2024-09-21T05:47:05.644739+0000","last_became_peered":"2024-09-21T05:47:05.644739+0000","last_unstale":"2024-09-21T05:47:38.389110+0000","last_undegraded":"2024-09-21T05:47:38.389110+0000","last_fullsized":"2024-09-21T05:47:38.389110+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:43.895574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":62,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:48:01.568698+0000","last_change":"2024-09-21T05:47:03.619070+0000","last_active":"2024-09-21T05:48:01.568698+0000","last_peered":"2024-09-21T05:48:01.568698+0000","last_clean":"2024-09-21T05:48:01.568698+0000","last_became_active":"2024-09-21T05:47:03.618655+0000","last_became_peered":"2024-09-21T05:47:03.618655+0000","last_unstale":"2024-09-21T05:48:01.568698+0000","last_undegraded":"2024-09-21T05:48:01.568698+0000","last_fullsized":"2024-09-21T05:48:01.568698+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:29.206109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.387832+0000","last_change":"2024-09-21T05:47:12.672677+0000","last_active":"2024-09-21T05:47:38.387832+0000","last_peered":"2024-09-21T05:47:38.387832+0000","last_clean":"2024-09-21T05:47:38.387832+0000","last_became_active":"2024-09-21T05:47:12.672264+0000","last_became_peered":"2024-09-21T05:47:12.672264+0000","last_unstale":"2024-09-21T05:47:38.387832+0000","last_undegraded":"2024-09-21T05:47:38.387832+0000","last_fullsized":"2024-09-21T05:47:38.387832+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:31.680678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.391999+0000","last_change":"2024-09-21T05:47:12.672702+0000","last_active":"2024-09-21T05:47:38.391999+0000","last_peered":"2024-09-21T05:47:38.391999+0000","last_clean":"2024-09-21T05:47:38.391999+0000","last_became_active":"2024-09-21T05:47:12.672233+0000","last_became_peered":"2024-09-21T05:47:12.672233+0000","last_unstale":"2024-09-21T05:47:38.391999+0000","last_undegraded":"2024-09-21T05:47:38.391999+0000","last_fullsized":"2024-09-21T05:47:38.391999+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:04.235603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.391077+0000","last_change":"2024-09-21T05:47:05.633566+0000","last_active":"2024-09-21T05:47:38.391077+0000","last_peered":"2024-09-21T05:47:38.391077+0000","last_clean":"2024-09-21T05:47:38.391077+0000","last_became_active":"2024-09-21T05:47:05.633240+0000","last_became_peered":"2024-09-21T05:47:05.633240+0000","last_unstale":"2024-09-21T05:47:38.391077+0000","last_undegraded":"2024-09-21T05:47:38.391077+0000","last_fullsized":"2024-09-21T05:47:38.391077+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:10.106647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:49.546244+0000","last_change":"2024-09-21T05:47:03.621788+0000","last_active":"2024-09-21T05:47:49.546244+0000","last_peered":"2024-09-21T05:47:49.546244+0000","last_clean":"2024-09-21T05:47:49.546244+0000","last_became_active":"2024-09-21T05:47:03.621425+0000","last_became_peered":"2024-09-21T05:47:03.621425+0000","last_unstale":"2024-09-21T05:47:49.546244+0000","last_undegraded":"2024-09-21T05:47:49.546244+0000","last_fullsized":"2024-09-21T05:47:49.546244+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:51.069361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.393402+0000","last_change":"2024-09-21T05:47:12.670670+0000","last_active":"2024-09-21T05:47:38.393402+0000","last_peered":"2024-09-21T05:47:38.393402+0000","last_clean":"2024-09-21T05:47:38.393402+0000","last_became_active":"2024-09-21T05:47:12.670192+0000","last_became_peered":"2024-09-21T05:47:12.670192+0000","last_unstale":"2024-09-21T05:47:38.393402+0000","last_undegraded":"2024-09-21T05:47:38.393402+0000","last_fullsized":"2024-09-21T05:47:38.393402+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:59.430991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.387853+0000","last_change":"2024-09-21T05:47:05.637775+0000","last_active":"2024-09-21T05:47:38.387853+0000","last_peered":"2024-09-21T05:47:38.387853+0000","last_clean":"2024-09-21T05:47:38.387853+0000","last_became_active":"2024-09-21T05:47:05.637436+0000","last_became_peered":"2024-09-21T05:47:05.637436+0000","last_unstale":"2024-09-21T05:47:38.387853+0000","last_undegraded":"2024-09-21T05:47:38.387853+0000","last_fullsized":"2024-09-21T05:47:38.387853+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:45:59.041879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:47.526787+0000","last_change":"2024-09-21T05:47:03.611317+0000","last_active":"2024-09-21T05:47:47.526787+0000","last_peered":"2024-09-21T05:47:47.526787+0000","last_clean":"2024-09-21T05:47:47.526787+0000","last_became_active":"2024-09-21T05:47:03.610967+0000","last_became_peered":"2024-09-21T05:47:03.610967+0000","last_unstale":"2024-09-21T05:47:47.526787+0000","last_undegraded":"2024-09-21T05:47:47.526787+0000","last_fullsized":"2024-09-21T05:47:47.526787+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:44.263380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:48.538721+0000","last_change":"2024-09-21T05:47:03.624584+0000","last_active":"2024-09-21T05:47:48.538721+0000","last_peered":"2024-09-21T05:47:48.538721+0000","last_clean":"2024-09-21T05:47:48.538721+0000","last_became_active":"2024-09-21T05:47:03.623886+0000","last_became_peered":"2024-09-21T05:47:03.623886+0000","last_unstale":"2024-09-21T05:47:48.538721+0000","last_undegraded":"2024-09-21T05:47:48.538721+0000","last_fullsized":"2024-09-21T05:47:48.538721+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:55.451732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.731847+0000","last_change":"2024-09-21T05:47:38.731762+0000","last_active":"2024-09-21T05:47:38.731847+0000","last_peered":"2024-09-21T05:47:38.731847+0000","last_clean":"2024-09-21T05:47:38.731847+0000","last_became_active":"2024-09-21T05:47:38.731325+0000","last_became_peered":"2024-09-21T05:47:38.731325+0000","last_unstale":"2024-09-21T05:47:38.731847+0000","last_undegraded":"2024-09-21T05:47:38.731847+0000","last_fullsized":"2024-09-21T05:47:38.731847+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:42.516434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.388439+0000","last_change":"2024-09-21T05:47:12.677198+0000","last_active":"2024-09-21T05:47:38.388439+0000","last_peered":"2024-09-21T05:47:38.388439+0000","last_clean":"2024-09-21T05:47:38.388439+0000","last_became_active":"2024-09-21T05:47:12.676673+0000","last_became_peered":"2024-09-21T05:47:12.676673+0000","last_unstale":"2024-09-21T05:47:38.388439+0000","last_undegraded":"2024-09-21T05:47:38.388439+0000","last_fullsized":"2024-09-21T05:47:38.388439+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:58.861348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"83'5","reported_seq":55,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:48:02.570644+0000","last_change":"2024-09-21T05:47:03.620390+0000","last_active":"2024-09-21T05:48:02.570644+0000","last_peered":"2024-09-21T05:48:02.570644+0000","last_clean":"2024-09-21T05:48:02.570644+0000","last_became_active":"2024-09-21T05:47:03.620006+0000","last_became_peered":"2024-09-21T05:47:03.620006+0000","last_unstale":"2024-09-21T05:48:02.570644+0000","last_undegraded":"2024-09-21T05:48:02.570644+0000","last_fullsized":"2024-09-21T05:48:02.570644+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:31.530194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.394535+0000","last_change":"2024-09-21T05:47:05.641444+0000","last_active":"2024-09-21T05:47:38.394535+0000","last_peered":"2024-09-21T05:47:38.394535+0000","last_clean":"2024-09-21T05:47:38.394535+0000","last_became_active":"2024-09-21T05:47:05.640967+0000","last_became_peered":"2024-09-21T05:47:05.640967+0000","last_unstale":"2024-09-21T05:47:38.394535+0000","last_undegraded":"2024-09-21T05:47:38.394535+0000","last_fullsized":"2024-09-21T05:47:38.394535+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:20.698467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.388634+0000","last_change":"2024-09-21T05:47:12.680157+0000","last_active":"2024-09-21T05:47:38.388634+0000","last_peered":"2024-09-21T05:47:38.388634+0000","last_clean":"2024-09-21T05:47:38.388634+0000","last_became_active":"2024-09-21T05:47:12.679604+0000","last_became_peered":"2024-09-21T05:47:12.679604+0000","last_unstale":"2024-09-21T05:47:38.388634+0000","last_undegraded":"2024-09-21T05:47:38.388634+0000","last_fullsized":"2024-09-21T05:47:38.388634+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:15.381901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.393270+0000","last_change":"2024-09-21T05:47:05.635022+0000","last_active":"2024-09-21T05:47:38.393270+0000","last_peered":"2024-09-21T05:47:38.393270+0000","last_clean":"2024-09-21T05:47:38.393270+0000","last_became_active":"2024-09-21T05:47:05.634592+0000","last_became_peered":"2024-09-21T05:47:05.634592+0000","last_unstale":"2024-09-21T05:47:38.393270+0000","last_undegraded":"2024-09-21T05:47:38.393270+0000","last_fullsized":"2024-09-21T05:47:38.393270+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:48.159339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.388462+0000","last_change":"2024-09-21T05:47:05.639942+0000","last_active":"2024-09-21T05:47:38.388462+0000","last_peered":"2024-09-21T05:47:38.388462+0000","last_clean":"2024-09-21T05:47:38.388462+0000","last_became_active":"2024-09-21T05:47:05.639570+0000","last_became_peered":"2024-09-21T05:47:05.639570+0000","last_unstale":"2024-09-21T05:47:38.388462+0000","last_undegraded":"2024-09-21T05:47:38.388462+0000","last_fullsized":"2024-09-21T05:47:38.388462+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:32.657485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.388143+0000","last_change":"2024-09-21T05:47:05.637359+0000","last_active":"2024-09-21T05:47:38.388143+0000","last_peered":"2024-09-21T05:47:38.388143+0000","last_clean":"2024-09-21T05:47:38.388143+0000","last_became_active":"2024-09-21T05:47:05.636998+0000","last_became_peered":"2024-09-21T05:47:05.636998+0000","last_unstale":"2024-09-21T05:47:38.388143+0000","last_undegraded":"2024-09-21T05:47:38.388143+0000","last_fullsized":"2024-09-21T05:47:38.388143+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:06.186344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.392162+0000","last_change":"2024-09-21T05:47:05.633304+0000","last_active":"2024-09-21T05:47:38.392162+0000","last_peered":"2024-09-21T05:47:38.392162+0000","last_clean":"2024-09-21T05:47:38.392162+0000","last_became_active":"2024-09-21T05:47:05.632919+0000","last_became_peered":"2024-09-21T05:47:05.632919+0000","last_unstale":"2024-09-21T05:47:38.392162+0000","last_undegraded":"2024-09-21T05:47:38.392162+0000","last_fullsized":"2024-09-21T05:47:38.392162+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:16.108908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.730736+0000","last_change":"2024-09-21T05:47:05.631091+0000","last_active":"2024-09-21T05:47:38.730736+0000","last_peered":"2024-09-21T05:47:38.730736+0000","last_clean":"2024-09-21T05:47:38.730736+0000","last_became_active":"2024-09-21T05:47:05.630740+0000","last_became_peered":"2024-09-21T05:47:05.630740+0000","last_unstale":"2024-09-21T05:47:38.730736+0000","last_undegraded":"2024-09-21T05:47:38.730736+0000","last_fullsized":"2024-09-21T05:47:38.730736+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:36:41.136890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.398880+0000","last_change":"2024-09-21T05:47:38.398773+0000","last_active":"2024-09-21T05:47:38.398880+0000","last_peered":"2024-09-21T05:47:38.398880+0000","last_clean":"2024-09-21T05:47:38.398880+0000","last_became_active":"2024-09-21T05:47:38.398378+0000","last_became_peered":"2024-09-21T05:47:38.398378+0000","last_unstale":"2024-09-21T05:47:38.398880+0000","last_undegraded":"2024-09-21T05:47:38.398880+0000","last_fullsized":"2024-09-21T05:47:38.398880+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:32.247222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.389011+0000","last_change":"2024-09-21T05:47:05.641782+0000","last_active":"2024-09-21T05:47:38.389011+0000","last_peered":"2024-09-21T05:47:38.389011+0000","last_clean":"2024-09-21T05:47:38.389011+0000","last_became_active":"2024-09-21T05:47:05.641422+0000","last_became_peered":"2024-09-21T05:47:05.641422+0000","last_unstale":"2024-09-21T05:47:38.389011+0000","last_undegraded":"2024-09-21T05:47:38.389011+0000","last_fullsized":"2024-09-21T05:47:38.389011+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:33.819329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.396163+0000","last_change":"2024-09-21T05:47:38.396070+0000","last_active":"2024-09-21T05:47:38.396163+0000","last_peered":"2024-09-21T05:47:38.396163+0000","last_clean":"2024-09-21T05:47:38.396163+0000","last_became_active":"2024-09-21T05:47:38.395727+0000","last_became_peered":"2024-09-21T05:47:38.395727+0000","last_unstale":"2024-09-21T05:47:38.396163+0000","last_undegraded":"2024-09-21T05:47:38.396163+0000","last_fullsized":"2024-09-21T05:47:38.396163+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:41.816692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.390430+0000","last_change":"2024-09-21T05:47:05.633701+0000","last_active":"2024-09-21T05:47:38.390430+0000","last_peered":"2024-09-21T05:47:38.390430+0000","last_clean":"2024-09-21T05:47:38.390430+0000","last_became_active":"2024-09-21T05:47:05.632671+0000","last_became_peered":"2024-09-21T05:47:05.632671+0000","last_unstale":"2024-09-21T05:47:38.390430+0000","last_undegraded":"2024-09-21T05:47:38.390430+0000","last_fullsized":"2024-09-21T05:47:38.390430+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:56.180731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.387898+0000","last_change":"2024-09-21T05:47:05.639419+0000","last_active":"2024-09-21T05:47:38.387898+0000","last_peered":"2024-09-21T05:47:38.387898+0000","last_clean":"2024-09-21T05:47:38.387898+0000","last_became_active":"2024-09-21T05:47:05.639060+0000","last_became_peered":"2024-09-21T05:47:05.639060+0000","last_unstale":"2024-09-21T05:47:38.387898+0000","last_undegraded":"2024-09-21T05:47:38.387898+0000","last_fullsized":"2024-09-21T05:47:38.387898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:09.562359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.388763+0000","last_change":"2024-09-21T05:47:05.641218+0000","last_active":"2024-09-21T05:47:38.388763+0000","last_peered":"2024-09-21T05:47:38.388763+0000","last_clean":"2024-09-21T05:47:38.388763+0000","last_became_active":"2024-09-21T05:47:05.640813+0000","last_became_peered":"2024-09-21T05:47:05.640813+0000","last_unstale":"2024-09-21T05:47:38.388763+0000","last_undegraded":"2024-09-21T05:47:38.388763+0000","last_fullsized":"2024-09-21T05:47:38.388763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:21.057096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.730695+0000","last_change":"2024-09-21T05:47:05.627711+0000","last_active":"2024-09-21T05:47:38.730695+0000","last_peered":"2024-09-21T05:47:38.730695+0000","last_clean":"2024-09-21T05:47:38.730695+0000","last_became_active":"2024-09-21T05:47:05.626394+0000","last_became_peered":"2024-09-21T05:47:05.626394+0000","last_unstale":"2024-09-21T05:47:38.730695+0000","last_undegraded":"2024-09-21T05:47:38.730695+0000","last_fullsized":"2024-09-21T05:47:38.730695+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:31.038727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.394026+0000","last_change":"2024-09-21T05:47:05.632835+0000","last_active":"2024-09-21T05:47:38.394026+0000","last_peered":"2024-09-21T05:47:38.394026+0000","last_clean":"2024-09-21T05:47:38.394026+0000","last_became_active":"2024-09-21T05:47:05.632486+0000","last_became_peered":"2024-09-21T05:47:05.632486+0000","last_unstale":"2024-09-21T05:47:38.394026+0000","last_undegraded":"2024-09-21T05:47:38.394026+0000","last_fullsized":"2024-09-21T05:47:38.394026+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:04.365517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.388864+0000","last_change":"2024-09-21T05:47:05.638381+0000","last_active":"2024-09-21T05:47:38.388864+0000","last_peered":"2024-09-21T05:47:38.388864+0000","last_clean":"2024-09-21T05:47:38.388864+0000","last_became_active":"2024-09-21T05:47:05.638007+0000","last_became_peered":"2024-09-21T05:47:05.638007+0000","last_unstale":"2024-09-21T05:47:38.388864+0000","last_undegraded":"2024-09-21T05:47:38.388864+0000","last_fullsized":"2024-09-21T05:47:38.388864+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:06.615367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.392045+0000","last_change":"2024-09-21T05:47:05.644624+0000","last_active":"2024-09-21T05:47:38.392045+0000","last_peered":"2024-09-21T05:47:38.392045+0000","last_clean":"2024-09-21T05:47:38.392045+0000","last_became_active":"2024-09-21T05:47:05.644257+0000","last_became_peered":"2024-09-21T05:47:05.644257+0000","last_unstale":"2024-09-21T05:47:38.392045+0000","last_undegraded":"2024-09-21T05:47:38.392045+0000","last_fullsized":"2024-09-21T05:47:38.392045+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:31.385313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.395173+0000","last_change":"2024-09-21T05:47:05.646368+0000","last_active":"2024-09-21T05:47:38.395173+0000","last_peered":"2024-09-21T05:47:38.395173+0000","last_clean":"2024-09-21T05:47:38.395173+0000","last_became_active":"2024-09-21T05:47:05.645952+0000","last_became_peered":"2024-09-21T05:47:05.645952+0000","last_unstale":"2024-09-21T05:47:38.395173+0000","last_undegraded":"2024-09-21T05:47:38.395173+0000","last_fullsized":"2024-09-21T05:47:38.395173+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:56.585911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.388406+0000","last_change":"2024-09-21T05:47:05.640167+0000","last_active":"2024-09-21T05:47:38.388406+0000","last_peered":"2024-09-21T05:47:38.388406+0000","last_clean":"2024-09-21T05:47:38.388406+0000","last_became_active":"2024-09-21T05:47:05.639770+0000","last_became_peered":"2024-09-21T05:47:05.639770+0000","last_unstale":"2024-09-21T05:47:38.388406+0000","last_undegraded":"2024-09-21T05:47:38.388406+0000","last_fullsized":"2024-09-21T05:47:38.388406+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:45.661131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.732783+0000","last_change":"2024-09-21T05:47:38.732677+0000","last_active":"2024-09-21T05:47:38.732783+0000","last_peered":"2024-09-21T05:47:38.732783+0000","last_clean":"2024-09-21T05:47:38.732783+0000","last_became_active":"2024-09-21T05:47:38.732236+0000","last_became_peered":"2024-09-21T05:47:38.732236+0000","last_unstale":"2024-09-21T05:47:38.732783+0000","last_undegraded":"2024-09-21T05:47:38.732783+0000","last_fullsized":"2024-09-21T05:47:38.732783+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:41.474677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.391834+0000","last_change":"2024-09-21T05:47:05.629814+0000","last_active":"2024-09-21T05:47:38.391834+0000","last_peered":"2024-09-21T05:47:38.391834+0000","last_clean":"2024-09-21T05:47:38.391834+0000","last_became_active":"2024-09-21T05:47:05.629464+0000","last_became_peered":"2024-09-21T05:47:05.629464+0000","last_unstale":"2024-09-21T05:47:38.391834+0000","last_undegraded":"2024-09-21T05:47:38.391834+0000","last_fullsized":"2024-09-21T05:47:38.391834+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:58.222820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.730882+0000","last_change":"2024-09-21T05:47:05.629643+0000","last_active":"2024-09-21T05:47:38.730882+0000","last_peered":"2024-09-21T05:47:38.730882+0000","last_clean":"2024-09-21T05:47:38.730882+0000","last_became_active":"2024-09-21T05:47:05.629248+0000","last_became_peered":"2024-09-21T05:47:05.629248+0000","last_unstale":"2024-09-21T05:47:38.730882+0000","last_undegraded":"2024-09-21T05:47:38.730882+0000","last_fullsized":"2024-09-21T05:47:38.730882+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:31.569209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.396454+0000","last_change":"2024-09-21T05:47:05.632188+0000","last_active":"2024-09-21T05:47:38.396454+0000","last_peered":"2024-09-21T05:47:38.396454+0000","last_clean":"2024-09-21T05:47:38.396454+0000","last_became_active":"2024-09-21T05:47:05.631799+0000","last_became_peered":"2024-09-21T05:47:05.631799+0000","last_unstale":"2024-09-21T05:47:38.396454+0000","last_undegraded":"2024-09-21T05:47:38.396454+0000","last_fullsized":"2024-09-21T05:47:38.396454+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:09.762405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.731173+0000","last_change":"2024-09-21T05:47:05.644746+0000","last_active":"2024-09-21T05:47:38.731173+0000","last_peered":"2024-09-21T05:47:38.731173+0000","last_clean":"2024-09-21T05:47:38.731173+0000","last_became_active":"2024-09-21T05:47:05.644326+0000","last_became_peered":"2024-09-21T05:47:05.644326+0000","last_unstale":"2024-09-21T05:47:38.731173+0000","last_undegraded":"2024-09-21T05:47:38.731173+0000","last_fullsized":"2024-09-21T05:47:38.731173+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:22.937783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.394972+0000","last_change":"2024-09-21T05:47:05.639214+0000","last_active":"2024-09-21T05:47:38.394972+0000","last_peered":"2024-09-21T05:47:38.394972+0000","last_clean":"2024-09-21T05:47:38.394972+0000","last_became_active":"2024-09-21T05:47:05.638443+0000","last_became_peered":"2024-09-21T05:47:05.638443+0000","last_unstale":"2024-09-21T05:47:38.394972+0000","last_undegraded":"2024-09-21T05:47:38.394972+0000","last_fullsized":"2024-09-21T05:47:38.394972+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:30.134020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.389200+0000","last_change":"2024-09-21T05:47:05.644233+0000","last_active":"2024-09-21T05:47:38.389200+0000","last_peered":"2024-09-21T05:47:38.389200+0000","last_clean":"2024-09-21T05:47:38.389200+0000","last_became_active":"2024-09-21T05:47:05.643820+0000","last_became_peered":"2024-09-21T05:47:05.643820+0000","last_unstale":"2024-09-21T05:47:38.389200+0000","last_undegraded":"2024-09-21T05:47:38.389200+0000","last_fullsized":"2024-09-21T05:47:38.389200+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:42.695997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.387811+0000","last_change":"2024-09-21T05:47:05.637569+0000","last_active":"2024-09-21T05:47:38.387811+0000","last_peered":"2024-09-21T05:47:38.387811+0000","last_clean":"2024-09-21T05:47:38.387811+0000","last_became_active":"2024-09-21T05:47:05.637269+0000","last_became_peered":"2024-09-21T05:47:05.637269+0000","last_unstale":"2024-09-21T05:47:38.387811+0000","last_undegraded":"2024-09-21T05:47:38.387811+0000","last_fullsized":"2024-09-21T05:47:38.387811+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:28:26.335398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.731453+0000","last_change":"2024-09-21T05:47:05.633457+0000","last_active":"2024-09-21T05:47:38.731453+0000","last_peered":"2024-09-21T05:47:38.731453+0000","last_clean":"2024-09-21T05:47:38.731453+0000","last_became_active":"2024-09-21T05:47:05.633066+0000","last_became_peered":"2024-09-21T05:47:05.633066+0000","last_unstale":"2024-09-21T05:47:38.731453+0000","last_undegraded":"2024-09-21T05:47:38.731453+0000","last_fullsized":"2024-09-21T05:47:38.731453+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:45.904152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.400024+0000","last_change":"2024-09-21T05:47:38.399914+0000","last_active":"2024-09-21T05:47:38.400024+0000","last_peered":"2024-09-21T05:47:38.400024+0000","last_clean":"2024-09-21T05:47:38.400024+0000","last_became_active":"2024-09-21T05:47:38.399480+0000","last_became_peered":"2024-09-21T05:47:38.399480+0000","last_unstale":"2024-09-21T05:47:38.400024+0000","last_undegraded":"2024-09-21T05:47:38.400024+0000","last_fullsized":"2024-09-21T05:47:38.400024+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:51.281796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.393925+0000","last_change":"2024-09-21T05:47:05.630944+0000","last_active":"2024-09-21T05:47:38.393925+0000","last_peered":"2024-09-21T05:47:38.393925+0000","last_clean":"2024-09-21T05:47:38.393925+0000","last_became_active":"2024-09-21T05:47:05.630498+0000","last_became_peered":"2024-09-21T05:47:05.630498+0000","last_unstale":"2024-09-21T05:47:38.393925+0000","last_undegraded":"2024-09-21T05:47:38.393925+0000","last_fullsized":"2024-09-21T05:47:38.393925+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:20.185094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.396334+0000","last_change":"2024-09-21T05:47:05.636134+0000","last_active":"2024-09-21T05:47:38.396334+0000","last_peered":"2024-09-21T05:47:38.396334+0000","last_clean":"2024-09-21T05:47:38.396334+0000","last_became_active":"2024-09-21T05:47:05.635724+0000","last_became_peered":"2024-09-21T05:47:05.635724+0000","last_unstale":"2024-09-21T05:47:38.396334+0000","last_undegraded":"2024-09-21T05:47:38.396334+0000","last_fullsized":"2024-09-21T05:47:38.396334+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:55.455819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.392353+0000","last_change":"2024-09-21T05:47:05.641209+0000","last_active":"2024-09-21T05:47:38.392353+0000","last_peered":"2024-09-21T05:47:38.392353+0000","last_clean":"2024-09-21T05:47:38.392353+0000","last_became_active":"2024-09-21T05:47:05.640543+0000","last_became_peered":"2024-09-21T05:47:05.640543+0000","last_unstale":"2024-09-21T05:47:38.392353+0000","last_undegraded":"2024-09-21T05:47:38.392353+0000","last_fullsized":"2024-09-21T05:47:38.392353+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:49.579724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.392110+0000","last_change":"2024-09-21T05:47:05.634158+0000","last_active":"2024-09-21T05:47:38.392110+0000","last_peered":"2024-09-21T05:47:38.392110+0000","last_clean":"2024-09-21T05:47:38.392110+0000","last_became_active":"2024-09-21T05:47:05.633657+0000","last_became_peered":"2024-09-21T05:47:05.633657+0000","last_unstale":"2024-09-21T05:47:38.392110+0000","last_undegraded":"2024-09-21T05:47:38.392110+0000","last_fullsized":"2024-09-21T05:47:38.392110+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:37.868206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T05:47:38.395030+0000","last_change":"2024-09-21T05:47:05.641358+0000","last_active":"2024-09-21T05:47:38.395030+0000","last_peered":"2024-09-21T05:47:38.395030+0000","last_clean":"2024-09-21T05:47:38.395030+0000","last_became_active":"2024-09-21T05:47:05.641025+0000","last_became_peered":"2024-09-21T05:47:05.641025+0000","last_unstale":"2024-09-21T05:47:38.395030+0000","last_undegraded":"2024-09-21T05:47:38.395030+0000","last_fullsized":"2024-09-21T05:47:38.395030+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:01.654621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63357,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":165,"num_read_kb":151,"num_write":240,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":181008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":248927,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":470577,"data_compressed":23473,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939677,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":1118424,"data_compressed":59727,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103202,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":470507,"data_compressed":23473,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299431,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32104,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713048,"statfs":{"total":95995035648,"available":95962161152,"internally_reserved":0,"allocated":942080,"data_stored":470885,"data_compressed":23473,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495660,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":1067382,"data_compressed":59727,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659185,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":466011,"data_compressed":23473,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855415,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32164,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712988,"statfs":{"total":95995035648,"available":95962099712,"internally_reserved":0,"allocated":1003520,"data_stored":1062573,"data_compressed":59727,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051644,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":929792,"data_stored":470476,"data_compressed":23473,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247872,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":465719,"data_compressed":23473,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444102,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":523805,"data_compressed":23473,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607626,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":514522,"data_compressed":23473,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":467467,"data_compressed":23473,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34637,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34637,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34637,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36254,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36254,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36254,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36254,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":49233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":58671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T05:48:06.950 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T05:48:06.950 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T05:48:06.950 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T05:48:07.200 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:07.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:06 smithi070 ceph-mon[30981]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:48:07.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:06 smithi116 ceph-mon[34332]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:48:07.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:06 smithi160 ceph-mon[33979]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:48:07.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.732+0000 7f824b917640 1 -- 172.21.15.70:0/2648679324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8244105180 msgr2=0x7f824410bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:07.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.732+0000 7f824b917640 1 --2- 172.21.15.70:0/2648679324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8244105180 0x7f824410bb20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f823c009ca0 tx=0x7f823c02a950 comp rx=0 tx=0).stop 2024-09-21T05:48:07.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.732+0000 7f824b917640 1 -- 172.21.15.70:0/2648679324 shutdown_connections 2024-09-21T05:48:07.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.732+0000 7f824b917640 1 --2- 172.21.15.70:0/2648679324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8244105180 0x7f824410bb20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:07.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.732+0000 7f824b917640 1 --2- 172.21.15.70:0/2648679324 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82441047e0 0x7f8244104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:07.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.732+0000 7f824b917640 1 --2- 172.21.15.70:0/2648679324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8244103750 0x7f8244103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:07.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.732+0000 7f824b917640 1 -- 172.21.15.70:0/2648679324 >> 172.21.15.70:0/2648679324 conn(0x7f82440ff0c0 msgr2=0x7f8244101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:07.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.732+0000 7f824b917640 1 -- 172.21.15.70:0/2648679324 shutdown_connections 2024-09-21T05:48:07.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.732+0000 7f824b917640 1 -- 172.21.15.70:0/2648679324 wait complete. 2024-09-21T05:48:07.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.732+0000 7f824b917640 1 Processor -- start 2024-09-21T05:48:07.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.733+0000 7f824b917640 1 -- start start 2024-09-21T05:48:07.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.733+0000 7f824b917640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8244103750 0x7f824419a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:07.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.733+0000 7f824b917640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82441047e0 0x7f824419a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:07.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.733+0000 7f824b917640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8244105180 0x7f824419b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:07.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.733+0000 7f824b917640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f824410f460 con 0x7f82441047e0 2024-09-21T05:48:07.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.733+0000 7f824b917640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f824410f2e0 con 0x7f8244103750 2024-09-21T05:48:07.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.733+0000 7f824b917640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f824410f5e0 con 0x7f8244105180 2024-09-21T05:48:07.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.733+0000 7f8248eb2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82441047e0 0x7f824419a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:07.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.733+0000 7f8248eb2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82441047e0 0x7f824419a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46632/0 (socket says 172.21.15.70:46632) 2024-09-21T05:48:07.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.733+0000 7f8248eb2640 1 -- 172.21.15.70:0/1374196624 learned_addr learned my addr 172.21.15.70:0/1374196624 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:07.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.733+0000 7f82496b3640 1 --2- 172.21.15.70:0/1374196624 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8244103750 0x7f824419a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:07.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.733+0000 7f8249eb4640 1 --2- 172.21.15.70:0/1374196624 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8244105180 0x7f824419b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:07.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.733+0000 7f8248eb2640 1 -- 172.21.15.70:0/1374196624 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8244105180 msgr2=0x7f824419b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:07.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.733+0000 7f8248eb2640 1 --2- 172.21.15.70:0/1374196624 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8244105180 0x7f824419b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:07.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.733+0000 7f8248eb2640 1 -- 172.21.15.70:0/1374196624 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8244103750 msgr2=0x7f824419a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:07.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.733+0000 7f8248eb2640 1 --2- 172.21.15.70:0/1374196624 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8244103750 0x7f824419a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:07.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.733+0000 7f8248eb2640 1 -- 172.21.15.70:0/1374196624 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f824419bac0 con 0x7f82441047e0 2024-09-21T05:48:07.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.733+0000 7f8248eb2640 1 --2- 172.21.15.70:0/1374196624 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82441047e0 0x7f824419a700 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f823800b4a0 tx=0x7f823800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:07.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.734+0000 7f82427fc640 1 -- 172.21.15.70:0/1374196624 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8238015020 con 0x7f82441047e0 2024-09-21T05:48:07.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.734+0000 7f82427fc640 1 -- 172.21.15.70:0/1374196624 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f8238011ce0 con 0x7f82441047e0 2024-09-21T05:48:07.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.734+0000 7f824b917640 1 -- 172.21.15.70:0/1374196624 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f824419bdb0 con 0x7f82441047e0 2024-09-21T05:48:07.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.734+0000 7f82427fc640 1 -- 172.21.15.70:0/1374196624 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8238010db0 con 0x7f82441047e0 2024-09-21T05:48:07.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.734+0000 7f824b917640 1 -- 172.21.15.70:0/1374196624 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82441a24b0 con 0x7f82441047e0 2024-09-21T05:48:07.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.735+0000 7f824b917640 1 -- 172.21.15.70:0/1374196624 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8244103c40 con 0x7f82441047e0 2024-09-21T05:48:07.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.736+0000 7f82427fc640 1 -- 172.21.15.70:0/1374196624 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f8238018020 con 0x7f82441047e0 2024-09-21T05:48:07.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.737+0000 7f82427fc640 1 --2- 172.21.15.70:0/1374196624 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f822c0b65a0 0x7f822c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:07.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.737+0000 7f82427fc640 1 -- 172.21.15.70:0/1374196624 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f82380e6fe0 con 0x7f82441047e0 2024-09-21T05:48:07.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.737+0000 7f82496b3640 1 --2- 172.21.15.70:0/1374196624 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f822c0b65a0 0x7f822c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:07.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.737+0000 7f82496b3640 1 --2- 172.21.15.70:0/1374196624 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f822c0b65a0 0x7f822c0b8ab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8234009990 tx=0x7f8234009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:07.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.741+0000 7f82427fc640 1 -- 172.21.15.70:0/1374196624 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f823801f020 con 0x7f82441047e0 2024-09-21T05:48:07.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.989+0000 7f824b917640 1 -- 172.21.15.70:0/1374196624 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f824402e6e0 con 0x7f82441047e0 2024-09-21T05:48:07.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.992+0000 7f82427fc640 1 -- 172.21.15.70:0/1374196624 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f824402e6e0 con 0x7f82441047e0 2024-09-21T05:48:07.994 INFO:teuthology.orchestra.run.smithi070.stdout:[client.0] 2024-09-21T05:48:07.994 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAXXu5mbjYTOxAATKO2nyKV1P0S90E5v0kE3g== 2024-09-21T05:48:07.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.994+0000 7f824b917640 1 -- 172.21.15.70:0/1374196624 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f822c0b65a0 msgr2=0x7f822c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:07.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.994+0000 7f824b917640 1 --2- 172.21.15.70:0/1374196624 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f822c0b65a0 0x7f822c0b8ab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8234009990 tx=0x7f8234009110 comp rx=0 tx=0).stop 2024-09-21T05:48:07.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.994+0000 7f824b917640 1 -- 172.21.15.70:0/1374196624 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82441047e0 msgr2=0x7f824419a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:07.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.994+0000 7f824b917640 1 --2- 172.21.15.70:0/1374196624 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82441047e0 0x7f824419a700 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f823800b4a0 tx=0x7f823800b8a0 comp rx=0 tx=0).stop 2024-09-21T05:48:07.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.994+0000 7f824b917640 1 -- 172.21.15.70:0/1374196624 shutdown_connections 2024-09-21T05:48:07.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.994+0000 7f824b917640 1 --2- 172.21.15.70:0/1374196624 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f822c0b65a0 0x7f822c0b8ab0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:07.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.994+0000 7f824b917640 1 --2- 172.21.15.70:0/1374196624 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8244105180 0x7f824419b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:07.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.994+0000 7f824b917640 1 --2- 172.21.15.70:0/1374196624 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82441047e0 0x7f824419a700 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:07.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.994+0000 7f824b917640 1 --2- 172.21.15.70:0/1374196624 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8244103750 0x7f824419a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:07.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.994+0000 7f824b917640 1 -- 172.21.15.70:0/1374196624 >> 172.21.15.70:0/1374196624 conn(0x7f82440ff0c0 msgr2=0x7f8244107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:07.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.994+0000 7f824b917640 1 -- 172.21.15.70:0/1374196624 shutdown_connections 2024-09-21T05:48:07.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:07.994+0000 7f824b917640 1 -- 172.21.15.70:0/1374196624 wait complete. 2024-09-21T05:48:08.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:07 smithi070 ceph-mon[30981]: pgmap v328: 129 pgs: 129 active+clean; 647 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 13 op/s 2024-09-21T05:48:08.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:07 smithi116 ceph-mon[34332]: pgmap v328: 129 pgs: 129 active+clean; 647 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 13 op/s 2024-09-21T05:48:08.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:07 smithi160 ceph-mon[33979]: pgmap v328: 129 pgs: 129 active+clean; 647 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 13 op/s 2024-09-21T05:48:08.697 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-21T05:48:08.697 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T05:48:08.697 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T05:48:08.735 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T05:48:09.021 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:09.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:08 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1374196624' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T05:48:09.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:08 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1374196624' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T05:48:09.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:08 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1374196624' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T05:48:09.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:08 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1374196624' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T05:48:09.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:08 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1374196624' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T05:48:09.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:08 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1374196624' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T05:48:09.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.521+0000 7f1c7f7b9640 1 -- 172.21.15.70:0/3471678093 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c78102a80 msgr2=0x7f1c78102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:09.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.522+0000 7f1c7f7b9640 1 --2- 172.21.15.70:0/3471678093 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c78102a80 0x7f1c78102e90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1c74009900 tx=0x7f1c7402a410 comp rx=0 tx=0).stop 2024-09-21T05:48:09.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.522+0000 7f1c7f7b9640 1 -- 172.21.15.70:0/3471678093 shutdown_connections 2024-09-21T05:48:09.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.522+0000 7f1c7f7b9640 1 --2- 172.21.15.70:0/3471678093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c78108d10 0x7f1c7810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:09.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.522+0000 7f1c7f7b9640 1 --2- 172.21.15.70:0/3471678093 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c781083c0 0x7f1c781087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:09.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.522+0000 7f1c7f7b9640 1 --2- 172.21.15.70:0/3471678093 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c78102a80 0x7f1c78102e90 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:09.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.522+0000 7f1c7f7b9640 1 -- 172.21.15.70:0/3471678093 >> 172.21.15.70:0/3471678093 conn(0x7f1c78079740 msgr2=0x7f1c78079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:09.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.522+0000 7f1c7f7b9640 1 -- 172.21.15.70:0/3471678093 shutdown_connections 2024-09-21T05:48:09.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.522+0000 7f1c7f7b9640 1 -- 172.21.15.70:0/3471678093 wait complete. 2024-09-21T05:48:09.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.522+0000 7f1c7f7b9640 1 Processor -- start 2024-09-21T05:48:09.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.522+0000 7f1c7f7b9640 1 -- start start 2024-09-21T05:48:09.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.523+0000 7f1c7f7b9640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c78102a80 0x7f1c78199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:09.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.523+0000 7f1c7f7b9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c781083c0 0x7f1c781998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:09.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.523+0000 7f1c7f7b9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c78108d10 0x7f1c7819eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:09.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.523+0000 7f1c7f7b9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1c78112970 con 0x7f1c78108d10 2024-09-21T05:48:09.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.523+0000 7f1c7f7b9640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1c781127f0 con 0x7f1c781083c0 2024-09-21T05:48:09.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.523+0000 7f1c7f7b9640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1c78112af0 con 0x7f1c78102a80 2024-09-21T05:48:09.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.523+0000 7f1c7dd56640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c78108d10 0x7f1c7819eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:09.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.523+0000 7f1c7dd56640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c78108d10 0x7f1c7819eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46650/0 (socket says 172.21.15.70:46650) 2024-09-21T05:48:09.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.523+0000 7f1c7dd56640 1 -- 172.21.15.70:0/3144529224 learned_addr learned my addr 172.21.15.70:0/3144529224 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:09.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.523+0000 7f1c7d555640 1 --2- 172.21.15.70:0/3144529224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c78102a80 0x7f1c78199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:09.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.523+0000 7f1c7cd54640 1 --2- 172.21.15.70:0/3144529224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c781083c0 0x7f1c781998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:09.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.523+0000 7f1c7dd56640 1 -- 172.21.15.70:0/3144529224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c78102a80 msgr2=0x7f1c78199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:09.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.523+0000 7f1c7dd56640 1 --2- 172.21.15.70:0/3144529224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c78102a80 0x7f1c78199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:09.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.523+0000 7f1c7dd56640 1 -- 172.21.15.70:0/3144529224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c781083c0 msgr2=0x7f1c781998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:09.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.523+0000 7f1c7dd56640 1 --2- 172.21.15.70:0/3144529224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c781083c0 0x7f1c781998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:09.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.523+0000 7f1c7dd56640 1 -- 172.21.15.70:0/3144529224 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c7819f2b0 con 0x7f1c78108d10 2024-09-21T05:48:09.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.524+0000 7f1c7dd56640 1 --2- 172.21.15.70:0/3144529224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c78108d10 0x7f1c7819eb80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1c7000eaa0 tx=0x7f1c7000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:09.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.524+0000 7f1c6e7fc640 1 -- 172.21.15.70:0/3144529224 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7000cdb0 con 0x7f1c78108d10 2024-09-21T05:48:09.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.524+0000 7f1c6e7fc640 1 -- 172.21.15.70:0/3144529224 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f1c70005020 con 0x7f1c78108d10 2024-09-21T05:48:09.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.524+0000 7f1c7f7b9640 1 -- 172.21.15.70:0/3144529224 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c7819f5a0 con 0x7f1c78108d10 2024-09-21T05:48:09.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.524+0000 7f1c6e7fc640 1 -- 172.21.15.70:0/3144529224 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c700116d0 con 0x7f1c78108d10 2024-09-21T05:48:09.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.524+0000 7f1c7f7b9640 1 -- 172.21.15.70:0/3144529224 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c781a5d00 con 0x7f1c78108d10 2024-09-21T05:48:09.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.525+0000 7f1c7f7b9640 1 -- 172.21.15.70:0/3144529224 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c78103d00 con 0x7f1c78108d10 2024-09-21T05:48:09.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.526+0000 7f1c6e7fc640 1 -- 172.21.15.70:0/3144529224 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f1c70005580 con 0x7f1c78108d10 2024-09-21T05:48:09.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.527+0000 7f1c6e7fc640 1 --2- 172.21.15.70:0/3144529224 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1c640b65a0 0x7f1c640b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:09.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.527+0000 7f1c7d555640 1 --2- 172.21.15.70:0/3144529224 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1c640b65a0 0x7f1c640b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:09.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.527+0000 7f1c6e7fc640 1 -- 172.21.15.70:0/3144529224 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f1c700e7ce0 con 0x7f1c78108d10 2024-09-21T05:48:09.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.528+0000 7f1c7d555640 1 --2- 172.21.15.70:0/3144529224 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1c640b65a0 0x7f1c640b8ab0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1c74005d90 tx=0x7f1c74005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:09.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.530+0000 7f1c6e7fc640 1 -- 172.21.15.70:0/3144529224 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1c70016030 con 0x7f1c78108d10 2024-09-21T05:48:09.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.713+0000 7f1c7f7b9640 1 -- 172.21.15.70:0/3144529224 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f1c78102e90 con 0x7f1c78108d10 2024-09-21T05:48:09.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.714+0000 7f1c6e7fc640 1 -- 172.21.15.70:0/3144529224 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v49) ==== 86+0+133 (secure 0 0 0) 0x7f1c78102e90 con 0x7f1c78108d10 2024-09-21T05:48:09.716 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:48:09.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.716+0000 7f1c7f7b9640 1 -- 172.21.15.70:0/3144529224 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1c640b65a0 msgr2=0x7f1c640b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:09.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.716+0000 7f1c7f7b9640 1 --2- 172.21.15.70:0/3144529224 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1c640b65a0 0x7f1c640b8ab0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1c74005d90 tx=0x7f1c74005e50 comp rx=0 tx=0).stop 2024-09-21T05:48:09.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.716+0000 7f1c7f7b9640 1 -- 172.21.15.70:0/3144529224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c78108d10 msgr2=0x7f1c7819eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:09.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.716+0000 7f1c7f7b9640 1 --2- 172.21.15.70:0/3144529224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c78108d10 0x7f1c7819eb80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1c7000eaa0 tx=0x7f1c7000ef60 comp rx=0 tx=0).stop 2024-09-21T05:48:09.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.716+0000 7f1c7f7b9640 1 -- 172.21.15.70:0/3144529224 shutdown_connections 2024-09-21T05:48:09.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.716+0000 7f1c7f7b9640 1 --2- 172.21.15.70:0/3144529224 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1c640b65a0 0x7f1c640b8ab0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:09.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.716+0000 7f1c7f7b9640 1 --2- 172.21.15.70:0/3144529224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c78108d10 0x7f1c7819eb80 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:09.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.716+0000 7f1c7f7b9640 1 --2- 172.21.15.70:0/3144529224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c781083c0 0x7f1c781998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:09.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.716+0000 7f1c7f7b9640 1 --2- 172.21.15.70:0/3144529224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c78102a80 0x7f1c78199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:09.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.716+0000 7f1c7f7b9640 1 -- 172.21.15.70:0/3144529224 >> 172.21.15.70:0/3144529224 conn(0x7f1c78079740 msgr2=0x7f1c78101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:09.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.717+0000 7f1c7f7b9640 1 -- 172.21.15.70:0/3144529224 shutdown_connections 2024-09-21T05:48:09.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:09.717+0000 7f1c7f7b9640 1 -- 172.21.15.70:0/3144529224 wait complete. 2024-09-21T05:48:10.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:09 smithi070 ceph-mon[30981]: pgmap v329: 129 pgs: 129 active+clean; 647 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 3.6 KiB/s wr, 12 op/s 2024-09-21T05:48:10.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:09 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3144529224' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T05:48:10.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:09 smithi116 ceph-mon[34332]: pgmap v329: 129 pgs: 129 active+clean; 647 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 3.6 KiB/s wr, 12 op/s 2024-09-21T05:48:10.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:09 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3144529224' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T05:48:10.368 INFO:teuthology.orchestra.run.smithi070.stdout:[{"version":49,"timestamp":"2024-09-21T05:46:56.258000+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-21T05:48:10.368 INFO:tasks.ceph_manager:config epoch is 49 2024-09-21T05:48:10.369 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T05:48:10.369 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T05:48:10.369 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T05:48:10.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:09 smithi160 ceph-mon[33979]: pgmap v329: 129 pgs: 129 active+clean; 647 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 3.6 KiB/s wr, 12 op/s 2024-09-21T05:48:10.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:09 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3144529224' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T05:48:10.615 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:11.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.243+0000 7fb98edd7640 1 -- 172.21.15.70:0/2543423550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb988103b60 msgr2=0x7fb988103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:11.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.243+0000 7fb98edd7640 1 --2- 172.21.15.70:0/2543423550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb988103b60 0x7fb988103f70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb970009900 tx=0x7fb97002a410 comp rx=0 tx=0).stop 2024-09-21T05:48:11.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.243+0000 7fb98edd7640 1 -- 172.21.15.70:0/2543423550 shutdown_connections 2024-09-21T05:48:11.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.243+0000 7fb98edd7640 1 --2- 172.21.15.70:0/2543423550 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb988109df0 0x7fb988110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:11.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.243+0000 7fb98edd7640 1 --2- 172.21.15.70:0/2543423550 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9881094a0 0x7fb9881098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:11.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.243+0000 7fb98edd7640 1 --2- 172.21.15.70:0/2543423550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb988103b60 0x7fb988103f70 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:11.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.243+0000 7fb98edd7640 1 -- 172.21.15.70:0/2543423550 >> 172.21.15.70:0/2543423550 conn(0x7fb98807b850 msgr2=0x7fb98807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:11.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.243+0000 7fb98edd7640 1 -- 172.21.15.70:0/2543423550 shutdown_connections 2024-09-21T05:48:11.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.243+0000 7fb98edd7640 1 -- 172.21.15.70:0/2543423550 wait complete. 2024-09-21T05:48:11.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.244+0000 7fb98edd7640 1 Processor -- start 2024-09-21T05:48:11.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.244+0000 7fb98edd7640 1 -- start start 2024-09-21T05:48:11.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.245+0000 7fb98edd7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb988103b60 0x7fb98819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:11.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.245+0000 7fb98edd7640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9881094a0 0x7fb98819aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:11.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.245+0000 7fb98edd7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb988109df0 0x7fb98819fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:11.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.245+0000 7fb98edd7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb988113aa0 con 0x7fb988103b60 2024-09-21T05:48:11.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.245+0000 7fb98edd7640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb988113920 con 0x7fb988109df0 2024-09-21T05:48:11.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.245+0000 7fb98edd7640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb988113c20 con 0x7fb9881094a0 2024-09-21T05:48:11.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.245+0000 7fb98cb73640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb988103b60 0x7fb98819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:11.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.245+0000 7fb98cb73640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb988103b60 0x7fb98819a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34646/0 (socket says 172.21.15.70:34646) 2024-09-21T05:48:11.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.245+0000 7fb98cb73640 1 -- 172.21.15.70:0/3146008923 learned_addr learned my addr 172.21.15.70:0/3146008923 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:11.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.245+0000 7fb98d374640 1 --2- 172.21.15.70:0/3146008923 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb988109df0 0x7fb98819fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:11.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.245+0000 7fb98cb73640 1 -- 172.21.15.70:0/3146008923 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9881094a0 msgr2=0x7fb98819aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:11.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.245+0000 7fb98cb73640 1 --2- 172.21.15.70:0/3146008923 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9881094a0 0x7fb98819aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:11.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.245+0000 7fb98cb73640 1 -- 172.21.15.70:0/3146008923 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb988109df0 msgr2=0x7fb98819fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:11.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.245+0000 7fb98cb73640 1 --2- 172.21.15.70:0/3146008923 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb988109df0 0x7fb98819fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:11.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.245+0000 7fb98cb73640 1 -- 172.21.15.70:0/3146008923 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9881a0400 con 0x7fb988103b60 2024-09-21T05:48:11.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.245+0000 7fb98cb73640 1 --2- 172.21.15.70:0/3146008923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb988103b60 0x7fb98819a490 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb970005940 tx=0x7fb9700042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:11.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.245+0000 7fb985ffb640 1 -- 172.21.15.70:0/3146008923 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97003f030 con 0x7fb988103b60 2024-09-21T05:48:11.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.245+0000 7fb985ffb640 1 -- 172.21.15.70:0/3146008923 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fb970003cb0 con 0x7fb988103b60 2024-09-21T05:48:11.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.245+0000 7fb98edd7640 1 -- 172.21.15.70:0/3146008923 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9881a0690 con 0x7fb988103b60 2024-09-21T05:48:11.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.245+0000 7fb985ffb640 1 -- 172.21.15.70:0/3146008923 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb970035070 con 0x7fb988103b60 2024-09-21T05:48:11.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.246+0000 7fb98edd7640 1 -- 172.21.15.70:0/3146008923 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9881a6e50 con 0x7fb988103b60 2024-09-21T05:48:11.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.247+0000 7fb98edd7640 1 -- 172.21.15.70:0/3146008923 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb988103f70 con 0x7fb988103b60 2024-09-21T05:48:11.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.248+0000 7fb985ffb640 1 -- 172.21.15.70:0/3146008923 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fb970042030 con 0x7fb988103b60 2024-09-21T05:48:11.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.249+0000 7fb985ffb640 1 --2- 172.21.15.70:0/3146008923 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb9740b6620 0x7fb9740b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:11.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.249+0000 7fb987fff640 1 --2- 172.21.15.70:0/3146008923 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb9740b6620 0x7fb9740b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:11.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.250+0000 7fb985ffb640 1 -- 172.21.15.70:0/3146008923 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7fb9701082f0 con 0x7fb988103b60 2024-09-21T05:48:11.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.250+0000 7fb987fff640 1 --2- 172.21.15.70:0/3146008923 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb9740b6620 0x7fb9740b8b30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb988106450 tx=0x7fb978009710 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:11.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.253+0000 7fb985ffb640 1 -- 172.21.15.70:0/3146008923 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb9700ce6c0 con 0x7fb988103b60 2024-09-21T05:48:11.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.481+0000 7fb98edd7640 1 -- 172.21.15.70:0/3146008923 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fb98819b5c0 con 0x7fb988103b60 2024-09-21T05:48:11.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.486+0000 7fb985ffb640 1 -- 172.21.15.70:0/3146008923 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+296436 (secure 0 0 0) 0x7fb9700d5e20 con 0x7fb988103b60 2024-09-21T05:48:11.493 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:48:11.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.489+0000 7fb98edd7640 1 -- 172.21.15.70:0/3146008923 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb9740b6620 msgr2=0x7fb9740b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:11.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.489+0000 7fb98edd7640 1 --2- 172.21.15.70:0/3146008923 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb9740b6620 0x7fb9740b8b30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb988106450 tx=0x7fb978009710 comp rx=0 tx=0).stop 2024-09-21T05:48:11.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.489+0000 7fb98edd7640 1 -- 172.21.15.70:0/3146008923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb988103b60 msgr2=0x7fb98819a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:11.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.489+0000 7fb98edd7640 1 --2- 172.21.15.70:0/3146008923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb988103b60 0x7fb98819a490 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb970005940 tx=0x7fb9700042f0 comp rx=0 tx=0).stop 2024-09-21T05:48:11.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.489+0000 7fb98edd7640 1 -- 172.21.15.70:0/3146008923 shutdown_connections 2024-09-21T05:48:11.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.489+0000 7fb98edd7640 1 --2- 172.21.15.70:0/3146008923 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb9740b6620 0x7fb9740b8b30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:11.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.489+0000 7fb98edd7640 1 --2- 172.21.15.70:0/3146008923 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9881094a0 0x7fb98819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:11.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.490+0000 7fb98edd7640 1 --2- 172.21.15.70:0/3146008923 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb988109df0 0x7fb98819fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:11.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.490+0000 7fb98edd7640 1 --2- 172.21.15.70:0/3146008923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb988103b60 0x7fb98819a490 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:11.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.490+0000 7fb98edd7640 1 -- 172.21.15.70:0/3146008923 >> 172.21.15.70:0/3146008923 conn(0x7fb98807b850 msgr2=0x7fb988107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:11.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.490+0000 7fb98edd7640 1 -- 172.21.15.70:0/3146008923 shutdown_connections 2024-09-21T05:48:11.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:11.490+0000 7fb98edd7640 1 -- 172.21.15.70:0/3146008923 wait complete. 2024-09-21T05:48:11.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:11 smithi070 ceph-mon[30981]: pgmap v330: 129 pgs: 129 active+clean; 647 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-09-21T05:48:11.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:11 smithi116 ceph-mon[34332]: pgmap v330: 129 pgs: 129 active+clean; 647 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-09-21T05:48:11.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:11 smithi160 ceph-mon[33979]: pgmap v330: 129 pgs: 129 active+clean; 647 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-09-21T05:48:12.198 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1366013939},{"type":"v1","addr":"172.21.15.70:6801","nonce":1366013939}]},"active_addr":"172.21.15.70:6801/1366013939","active_change":"2024-09-21T05:39:37.296750+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24124,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24134,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.70:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":2968459946}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":2487540417}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":753344669}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":1404558720}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":960126826}]}]} 2024-09-21T05:48:12.204 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T05:48:12.205 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T05:48:12.205 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:48:12.449 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:12.726 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:12 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3146008923' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T05:48:12.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:12 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3146008923' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T05:48:12.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:12 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3146008923' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T05:48:12.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.922+0000 7fc7d899f640 1 -- 172.21.15.70:0/3006871698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7d41081e0 msgr2=0x7fc7d41085f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:12.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.922+0000 7fc7d899f640 1 --2- 172.21.15.70:0/3006871698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7d41081e0 0x7fc7d41085f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009900 tx=0x7fc7bc02a410 comp rx=0 tx=0).stop 2024-09-21T05:48:12.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.922+0000 7fc7d899f640 1 -- 172.21.15.70:0/3006871698 shutdown_connections 2024-09-21T05:48:12.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.922+0000 7fc7d899f640 1 --2- 172.21.15.70:0/3006871698 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7d4108b30 0x7fc7d410f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:12.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.922+0000 7fc7d899f640 1 --2- 172.21.15.70:0/3006871698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7d41081e0 0x7fc7d41085f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:12.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.922+0000 7fc7d899f640 1 --2- 172.21.15.70:0/3006871698 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7d41028a0 0x7fc7d4102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:12.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.922+0000 7fc7d899f640 1 -- 172.21.15.70:0/3006871698 >> 172.21.15.70:0/3006871698 conn(0x7fc7d40fe2d0 msgr2=0x7fc7d4100720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:12.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.923+0000 7fc7d899f640 1 -- 172.21.15.70:0/3006871698 shutdown_connections 2024-09-21T05:48:12.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.923+0000 7fc7d899f640 1 -- 172.21.15.70:0/3006871698 wait complete. 2024-09-21T05:48:12.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.923+0000 7fc7d899f640 1 Processor -- start 2024-09-21T05:48:12.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.923+0000 7fc7d899f640 1 -- start start 2024-09-21T05:48:12.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.924+0000 7fc7d899f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7d41028a0 0x7fc7d419b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:12.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.924+0000 7fc7d899f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7d41081e0 0x7fc7d419b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:12.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.924+0000 7fc7d899f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7d4108b30 0x7fc7d419bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:12.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.924+0000 7fc7d899f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d4112780 con 0x7fc7d41081e0 2024-09-21T05:48:12.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.924+0000 7fc7d899f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d4112600 con 0x7fc7d4108b30 2024-09-21T05:48:12.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.924+0000 7fc7d899f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d4112900 con 0x7fc7d41028a0 2024-09-21T05:48:12.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.924+0000 7fc7cbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7d41081e0 0x7fc7d419b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:12.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.924+0000 7fc7cbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7d41081e0 0x7fc7d419b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34662/0 (socket says 172.21.15.70:34662) 2024-09-21T05:48:12.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.924+0000 7fc7cbfff640 1 -- 172.21.15.70:0/3506378488 learned_addr learned my addr 172.21.15.70:0/3506378488 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:12.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.924+0000 7fc7d3fff640 1 --2- 172.21.15.70:0/3506378488 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7d4108b30 0x7fc7d419bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:12.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.924+0000 7fc7d37fe640 1 --2- 172.21.15.70:0/3506378488 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7d41028a0 0x7fc7d419b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:12.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.924+0000 7fc7cbfff640 1 -- 172.21.15.70:0/3506378488 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7d41028a0 msgr2=0x7fc7d419b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:12.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.924+0000 7fc7cbfff640 1 --2- 172.21.15.70:0/3506378488 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7d41028a0 0x7fc7d419b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:12.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.924+0000 7fc7cbfff640 1 -- 172.21.15.70:0/3506378488 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7d4108b30 msgr2=0x7fc7d419bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:12.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.924+0000 7fc7cbfff640 1 --2- 172.21.15.70:0/3506378488 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7d4108b30 0x7fc7d419bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:12.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.924+0000 7fc7cbfff640 1 -- 172.21.15.70:0/3506378488 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7d41a6390 con 0x7fc7d41081e0 2024-09-21T05:48:12.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.924+0000 7fc7cbfff640 1 --2- 172.21.15.70:0/3506378488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7d41081e0 0x7fc7d419b610 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc02a930 tx=0x7fc7bc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:12.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.924+0000 7fc7d17fa640 1 -- 172.21.15.70:0/3506378488 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc03f030 con 0x7fc7d41081e0 2024-09-21T05:48:12.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.925+0000 7fc7d17fa640 1 -- 172.21.15.70:0/3506378488 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fc7bc0044d0 con 0x7fc7d41081e0 2024-09-21T05:48:12.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.925+0000 7fc7d899f640 1 -- 172.21.15.70:0/3506378488 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7d41a6620 con 0x7fc7d41081e0 2024-09-21T05:48:12.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.925+0000 7fc7d17fa640 1 -- 172.21.15.70:0/3506378488 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc035070 con 0x7fc7d41081e0 2024-09-21T05:48:12.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.925+0000 7fc7d899f640 1 -- 172.21.15.70:0/3506378488 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7d41a6b00 con 0x7fc7d41081e0 2024-09-21T05:48:12.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.926+0000 7fc7d899f640 1 -- 172.21.15.70:0/3506378488 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7d4102cb0 con 0x7fc7d41081e0 2024-09-21T05:48:12.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.928+0000 7fc7d17fa640 1 -- 172.21.15.70:0/3506378488 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fc7bc003ab0 con 0x7fc7d41081e0 2024-09-21T05:48:12.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.929+0000 7fc7d17fa640 1 --2- 172.21.15.70:0/3506378488 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc7c00b65a0 0x7fc7c00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:12.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.929+0000 7fc7d37fe640 1 --2- 172.21.15.70:0/3506378488 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc7c00b65a0 0x7fc7c00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:12.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.929+0000 7fc7d17fa640 1 -- 172.21.15.70:0/3506378488 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7fc7bc108480 con 0x7fc7d41081e0 2024-09-21T05:48:12.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.930+0000 7fc7d37fe640 1 --2- 172.21.15.70:0/3506378488 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc7c00b65a0 0x7fc7c00b8ab0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc7c40058c0 tx=0x7fc7c400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:12.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:12.932+0000 7fc7d17fa640 1 -- 172.21.15.70:0/3506378488 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc7bc0d2bd0 con 0x7fc7d41081e0 2024-09-21T05:48:13.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:13.111+0000 7fc7d899f640 1 -- 172.21.15.70:0/3506378488 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc7d402e640 con 0x7fc7d41081e0 2024-09-21T05:48:13.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:13.113+0000 7fc7d17fa640 1 -- 172.21.15.70:0/3506378488 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+24691 (secure 0 0 0) 0x7fc7bc0d7b10 con 0x7fc7d41081e0 2024-09-21T05:48:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:48:13.115 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":83,"fsid":"96c6636e-77db-11ef-baf5-efdc52797490","created":"2024-09-21T05:38:42.297307+0000","modified":"2024-09-21T05:47:38.383182+0000","last_up_change":"2024-09-21T05:46:15.910344+0000","last_in_change":"2024-09-21T05:45:53.382766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:42:25.611590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:47:01.987981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:47:04.388107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T05:47:10.651871+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00be8b82-7cb1-443f-ad18-02916f734df7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6803","nonce":1667051447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6805","nonce":1667051447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6809","nonce":1667051447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6807","nonce":1667051447}]},"public_addr":"172.21.15.70:6803/1667051447","cluster_addr":"172.21.15.70:6805/1667051447","heartbeat_back_addr":"172.21.15.70:6809/1667051447","heartbeat_front_addr":"172.21.15.70:6807/1667051447","state":["exists","up"]},{"osd":1,"uuid":"28ca8c5c-5e81-4e64-ac0e-3c8c3c2d3930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6801","nonce":1037621846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6803","nonce":1037621846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6807","nonce":1037621846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6805","nonce":1037621846}]},"public_addr":"172.21.15.116:6801/1037621846","cluster_addr":"172.21.15.116:6803/1037621846","heartbeat_back_addr":"172.21.15.116:6807/1037621846","heartbeat_front_addr":"172.21.15.116:6805/1037621846","state":["exists","up"]},{"osd":2,"uuid":"e9b42bf2-a38b-4cf9-8774-4950de12d0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6801","nonce":69260815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6803","nonce":69260815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6807","nonce":69260815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6805","nonce":69260815}]},"public_addr":"172.21.15.160:6801/69260815","cluster_addr":"172.21.15.160:6803/69260815","heartbeat_back_addr":"172.21.15.160:6807/69260815","heartbeat_front_addr":"172.21.15.160:6805/69260815","state":["exists","up"]},{"osd":3,"uuid":"25d8e9a8-3c14-43d6-9bb1-b44cd377133f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6811","nonce":3849416072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6813","nonce":3849416072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6817","nonce":3849416072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6815","nonce":3849416072}]},"public_addr":"172.21.15.70:6811/3849416072","cluster_addr":"172.21.15.70:6813/3849416072","heartbeat_back_addr":"172.21.15.70:6817/3849416072","heartbeat_front_addr":"172.21.15.70:6815/3849416072","state":["exists","up"]},{"osd":4,"uuid":"bdb84cbd-d718-4f69-90d0-2e732e580df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6809","nonce":3444857438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6811","nonce":3444857438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6815","nonce":3444857438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6813","nonce":3444857438}]},"public_addr":"172.21.15.116:6809/3444857438","cluster_addr":"172.21.15.116:6811/3444857438","heartbeat_back_addr":"172.21.15.116:6815/3444857438","heartbeat_front_addr":"172.21.15.116:6813/3444857438","state":["exists","up"]},{"osd":5,"uuid":"a490eeba-549f-4caa-8cd5-4168a23dafa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6809","nonce":3063220427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6811","nonce":3063220427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6815","nonce":3063220427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6813","nonce":3063220427}]},"public_addr":"172.21.15.160:6809/3063220427","cluster_addr":"172.21.15.160:6811/3063220427","heartbeat_back_addr":"172.21.15.160:6815/3063220427","heartbeat_front_addr":"172.21.15.160:6813/3063220427","state":["exists","up"]},{"osd":6,"uuid":"1bf22f48-c02f-4f09-b0fe-2597a55fd795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6819","nonce":3650315688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6821","nonce":3650315688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6825","nonce":3650315688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6823","nonce":3650315688}]},"public_addr":"172.21.15.70:6819/3650315688","cluster_addr":"172.21.15.70:6821/3650315688","heartbeat_back_addr":"172.21.15.70:6825/3650315688","heartbeat_front_addr":"172.21.15.70:6823/3650315688","state":["exists","up"]},{"osd":7,"uuid":"40d59744-4860-4a92-aa21-3f33e575e5b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6817","nonce":2034132009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6819","nonce":2034132009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6823","nonce":2034132009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6821","nonce":2034132009}]},"public_addr":"172.21.15.116:6817/2034132009","cluster_addr":"172.21.15.116:6819/2034132009","heartbeat_back_addr":"172.21.15.116:6823/2034132009","heartbeat_front_addr":"172.21.15.116:6821/2034132009","state":["exists","up"]},{"osd":8,"uuid":"65dc02e7-0dcd-4fa7-955a-4d5c00fbe4cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6817","nonce":3381625184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6819","nonce":3381625184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6823","nonce":3381625184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6821","nonce":3381625184}]},"public_addr":"172.21.15.160:6817/3381625184","cluster_addr":"172.21.15.160:6819/3381625184","heartbeat_back_addr":"172.21.15.160:6823/3381625184","heartbeat_front_addr":"172.21.15.160:6821/3381625184","state":["exists","up"]},{"osd":9,"uuid":"d8438a9c-012f-4082-be3f-9653cdfaac78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6827","nonce":3555256209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6829","nonce":3555256209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6833","nonce":3555256209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6831","nonce":3555256209}]},"public_addr":"172.21.15.70:6827/3555256209","cluster_addr":"172.21.15.70:6829/3555256209","heartbeat_back_addr":"172.21.15.70:6833/3555256209","heartbeat_front_addr":"172.21.15.70:6831/3555256209","state":["exists","up"]},{"osd":10,"uuid":"871619b0-181e-4020-9511-2cec296bfe70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6825","nonce":541280433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6827","nonce":541280433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6831","nonce":541280433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6829","nonce":541280433}]},"public_addr":"172.21.15.116:6825/541280433","cluster_addr":"172.21.15.116:6827/541280433","heartbeat_back_addr":"172.21.15.116:6831/541280433","heartbeat_front_addr":"172.21.15.116:6829/541280433","state":["exists","up"]},{"osd":11,"uuid":"302da945-7929-4b0c-a20b-099175752c41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6825","nonce":2632369083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6827","nonce":2632369083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6831","nonce":2632369083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6829","nonce":2632369083}]},"public_addr":"172.21.15.160:6825/2632369083","cluster_addr":"172.21.15.160:6827/2632369083","heartbeat_back_addr":"172.21.15.160:6831/2632369083","heartbeat_front_addr":"172.21.15.160:6829/2632369083","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:41:34.446744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:41:59.336955+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:42:23.958219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:42:49.396007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:43:15.325344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:43:41.923141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:07.873970+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:33.897951+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:58.397680+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:24.568406+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:49.504565+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:14.698577+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.e","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6800/605055695":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/897886925":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/1968357524":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/693721445":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/2810307308":"2024-09-22T05:39:12.492271+0000","172.21.15.70:6801/605055695":"2024-09-22T05:39:37.296630+0000","172.21.15.70:6801/1668927582":"2024-09-22T05:39:12.492271+0000","172.21.15.70:6800/1668927582":"2024-09-22T05:39:12.492271+0000","172.21.15.70:0/1979536420":"2024-09-22T05:39:12.492271+0000","172.21.15.70:0/2674019604":"2024-09-22T05:39:12.492271+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:48:13.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:13.115+0000 7fc7d899f640 1 -- 172.21.15.70:0/3506378488 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc7c00b65a0 msgr2=0x7fc7c00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:13.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:13.115+0000 7fc7d899f640 1 --2- 172.21.15.70:0/3506378488 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc7c00b65a0 0x7fc7c00b8ab0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc7c40058c0 tx=0x7fc7c400a2d0 comp rx=0 tx=0).stop 2024-09-21T05:48:13.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:13.115+0000 7fc7d899f640 1 -- 172.21.15.70:0/3506378488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7d41081e0 msgr2=0x7fc7d419b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:13.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:13.115+0000 7fc7d899f640 1 --2- 172.21.15.70:0/3506378488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7d41081e0 0x7fc7d419b610 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc02a930 tx=0x7fc7bc004270 comp rx=0 tx=0).stop 2024-09-21T05:48:13.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:13.115+0000 7fc7d899f640 1 -- 172.21.15.70:0/3506378488 shutdown_connections 2024-09-21T05:48:13.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:13.115+0000 7fc7d899f640 1 --2- 172.21.15.70:0/3506378488 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc7c00b65a0 0x7fc7c00b8ab0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:13.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:13.115+0000 7fc7d899f640 1 --2- 172.21.15.70:0/3506378488 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7d4108b30 0x7fc7d419bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:13.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:13.115+0000 7fc7d899f640 1 --2- 172.21.15.70:0/3506378488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7d41081e0 0x7fc7d419b610 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:13.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:13.115+0000 7fc7d899f640 1 --2- 172.21.15.70:0/3506378488 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7d41028a0 0x7fc7d419b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:13.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:13.115+0000 7fc7d899f640 1 -- 172.21.15.70:0/3506378488 >> 172.21.15.70:0/3506378488 conn(0x7fc7d40fe2d0 msgr2=0x7fc7d41078b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:13.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:13.115+0000 7fc7d899f640 1 -- 172.21.15.70:0/3506378488 shutdown_connections 2024-09-21T05:48:13.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:13.115+0000 7fc7d899f640 1 -- 172.21.15.70:0/3506378488 wait complete. 2024-09-21T05:48:13.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:13 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3506378488' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:48:13.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:13 smithi070 ceph-mon[30981]: pgmap v331: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 3.5 KiB/s wr, 12 op/s 2024-09-21T05:48:13.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:13 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3506378488' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:48:13.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:13 smithi116 ceph-mon[34332]: pgmap v331: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 3.5 KiB/s wr, 12 op/s 2024-09-21T05:48:13.808 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T05:48:13.808 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:48:13.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:13 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3506378488' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:48:13.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:13 smithi160 ceph-mon[33979]: pgmap v331: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 3.5 KiB/s wr, 12 op/s 2024-09-21T05:48:14.051 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:14.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.546+0000 7fd5b4838640 1 -- 172.21.15.70:0/3547114441 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5b0108cf0 msgr2=0x7fd5b010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:14.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.546+0000 7fd5b4838640 1 --2- 172.21.15.70:0/3547114441 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5b0108cf0 0x7fd5b010f520 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0009900 tx=0x7fd5a002a410 comp rx=0 tx=0).stop 2024-09-21T05:48:14.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.546+0000 7fd5b4838640 1 -- 172.21.15.70:0/3547114441 shutdown_connections 2024-09-21T05:48:14.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.546+0000 7fd5b4838640 1 --2- 172.21.15.70:0/3547114441 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5b01083a0 0x7fd5b01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:14.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.546+0000 7fd5b4838640 1 --2- 172.21.15.70:0/3547114441 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5b0108cf0 0x7fd5b010f520 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:14.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.546+0000 7fd5b4838640 1 --2- 172.21.15.70:0/3547114441 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd5b0102a60 0x7fd5b0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:14.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.546+0000 7fd5b4838640 1 -- 172.21.15.70:0/3547114441 >> 172.21.15.70:0/3547114441 conn(0x7fd5b0079730 msgr2=0x7fd5b0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:14.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.546+0000 7fd5b4838640 1 -- 172.21.15.70:0/3547114441 shutdown_connections 2024-09-21T05:48:14.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.546+0000 7fd5b4838640 1 -- 172.21.15.70:0/3547114441 wait complete. 2024-09-21T05:48:14.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.547+0000 7fd5b4838640 1 Processor -- start 2024-09-21T05:48:14.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.547+0000 7fd5b4838640 1 -- start start 2024-09-21T05:48:14.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.547+0000 7fd5b4838640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5b0102a60 0x7fd5b019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:14.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.547+0000 7fd5b4838640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd5b01083a0 0x7fd5b019acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:14.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.547+0000 7fd5b4838640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5b0108cf0 0x7fd5b019ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:14.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.547+0000 7fd5b4838640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b0112a30 con 0x7fd5b0108cf0 2024-09-21T05:48:14.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.547+0000 7fd5b4838640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b01128b0 con 0x7fd5b01083a0 2024-09-21T05:48:14.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.547+0000 7fd5b4838640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b0112bb0 con 0x7fd5b0102a60 2024-09-21T05:48:14.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.547+0000 7fd5aed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5b0108cf0 0x7fd5b019ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:14.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.547+0000 7fd5aed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5b0108cf0 0x7fd5b019ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34686/0 (socket says 172.21.15.70:34686) 2024-09-21T05:48:14.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.547+0000 7fd5aed9d640 1 -- 172.21.15.70:0/2216286650 learned_addr learned my addr 172.21.15.70:0/2216286650 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:14.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.547+0000 7fd5add9b640 1 --2- 172.21.15.70:0/2216286650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd5b01083a0 0x7fd5b019acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:14.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.548+0000 7fd5ae59c640 1 --2- 172.21.15.70:0/2216286650 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5b0102a60 0x7fd5b019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:14.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.548+0000 7fd5aed9d640 1 -- 172.21.15.70:0/2216286650 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5b0102a60 msgr2=0x7fd5b019a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:14.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.548+0000 7fd5aed9d640 1 --2- 172.21.15.70:0/2216286650 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5b0102a60 0x7fd5b019a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:14.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.548+0000 7fd5aed9d640 1 -- 172.21.15.70:0/2216286650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd5b01083a0 msgr2=0x7fd5b019acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:14.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.548+0000 7fd5aed9d640 1 --2- 172.21.15.70:0/2216286650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd5b01083a0 0x7fd5b019acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:14.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.548+0000 7fd5aed9d640 1 -- 172.21.15.70:0/2216286650 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b01a06a0 con 0x7fd5b0108cf0 2024-09-21T05:48:14.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.548+0000 7fd5aed9d640 1 --2- 172.21.15.70:0/2216286650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5b0108cf0 0x7fd5b019ff70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0009a20 tx=0x7fd5a0004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:14.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.548+0000 7fd59f7fe640 1 -- 172.21.15.70:0/2216286650 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a003f070 con 0x7fd5b0108cf0 2024-09-21T05:48:14.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.548+0000 7fd5b4838640 1 -- 172.21.15.70:0/2216286650 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5b01a0930 con 0x7fd5b0108cf0 2024-09-21T05:48:14.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.548+0000 7fd59f7fe640 1 -- 172.21.15.70:0/2216286650 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fd5a0003aa0 con 0x7fd5b0108cf0 2024-09-21T05:48:14.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.548+0000 7fd59f7fe640 1 -- 172.21.15.70:0/2216286650 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0035070 con 0x7fd5b0108cf0 2024-09-21T05:48:14.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.548+0000 7fd5b4838640 1 -- 172.21.15.70:0/2216286650 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5b01a70f0 con 0x7fd5b0108cf0 2024-09-21T05:48:14.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.549+0000 7fd5b4838640 1 -- 172.21.15.70:0/2216286650 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5b0102ef0 con 0x7fd5b0108cf0 2024-09-21T05:48:14.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.551+0000 7fd59f7fe640 1 -- 172.21.15.70:0/2216286650 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fd5a0042070 con 0x7fd5b0108cf0 2024-09-21T05:48:14.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.552+0000 7fd59f7fe640 1 --2- 172.21.15.70:0/2216286650 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd5980b65a0 0x7fd5980b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:14.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.552+0000 7fd5ae59c640 1 --2- 172.21.15.70:0/2216286650 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd5980b65a0 0x7fd5980b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:14.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.552+0000 7fd59f7fe640 1 -- 172.21.15.70:0/2216286650 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7fd5a0108300 con 0x7fd5b0108cf0 2024-09-21T05:48:14.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.552+0000 7fd5ae59c640 1 --2- 172.21.15.70:0/2216286650 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd5980b65a0 0x7fd5980b8ab0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8009890 tx=0x7fd5a8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:14.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.555+0000 7fd59f7fe640 1 -- 172.21.15.70:0/2216286650 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd5a00ce770 con 0x7fd5b0108cf0 2024-09-21T05:48:14.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.736+0000 7fd5b4838640 1 -- 172.21.15.70:0/2216286650 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd5b01a72c0 con 0x7fd5b0108cf0 2024-09-21T05:48:14.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.738+0000 7fd59f7fe640 1 -- 172.21.15.70:0/2216286650 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+24691 (secure 0 0 0) 0x7fd5a00d2b50 con 0x7fd5b0108cf0 2024-09-21T05:48:14.740 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:48:14.740 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":83,"fsid":"96c6636e-77db-11ef-baf5-efdc52797490","created":"2024-09-21T05:38:42.297307+0000","modified":"2024-09-21T05:47:38.383182+0000","last_up_change":"2024-09-21T05:46:15.910344+0000","last_in_change":"2024-09-21T05:45:53.382766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:42:25.611590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:47:01.987981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:47:04.388107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T05:47:10.651871+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00be8b82-7cb1-443f-ad18-02916f734df7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6803","nonce":1667051447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6805","nonce":1667051447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6809","nonce":1667051447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6807","nonce":1667051447}]},"public_addr":"172.21.15.70:6803/1667051447","cluster_addr":"172.21.15.70:6805/1667051447","heartbeat_back_addr":"172.21.15.70:6809/1667051447","heartbeat_front_addr":"172.21.15.70:6807/1667051447","state":["exists","up"]},{"osd":1,"uuid":"28ca8c5c-5e81-4e64-ac0e-3c8c3c2d3930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6801","nonce":1037621846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6803","nonce":1037621846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6807","nonce":1037621846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6805","nonce":1037621846}]},"public_addr":"172.21.15.116:6801/1037621846","cluster_addr":"172.21.15.116:6803/1037621846","heartbeat_back_addr":"172.21.15.116:6807/1037621846","heartbeat_front_addr":"172.21.15.116:6805/1037621846","state":["exists","up"]},{"osd":2,"uuid":"e9b42bf2-a38b-4cf9-8774-4950de12d0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6801","nonce":69260815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6803","nonce":69260815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6807","nonce":69260815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6805","nonce":69260815}]},"public_addr":"172.21.15.160:6801/69260815","cluster_addr":"172.21.15.160:6803/69260815","heartbeat_back_addr":"172.21.15.160:6807/69260815","heartbeat_front_addr":"172.21.15.160:6805/69260815","state":["exists","up"]},{"osd":3,"uuid":"25d8e9a8-3c14-43d6-9bb1-b44cd377133f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6811","nonce":3849416072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6813","nonce":3849416072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6817","nonce":3849416072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6815","nonce":3849416072}]},"public_addr":"172.21.15.70:6811/3849416072","cluster_addr":"172.21.15.70:6813/3849416072","heartbeat_back_addr":"172.21.15.70:6817/3849416072","heartbeat_front_addr":"172.21.15.70:6815/3849416072","state":["exists","up"]},{"osd":4,"uuid":"bdb84cbd-d718-4f69-90d0-2e732e580df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6809","nonce":3444857438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6811","nonce":3444857438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6815","nonce":3444857438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6813","nonce":3444857438}]},"public_addr":"172.21.15.116:6809/3444857438","cluster_addr":"172.21.15.116:6811/3444857438","heartbeat_back_addr":"172.21.15.116:6815/3444857438","heartbeat_front_addr":"172.21.15.116:6813/3444857438","state":["exists","up"]},{"osd":5,"uuid":"a490eeba-549f-4caa-8cd5-4168a23dafa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6809","nonce":3063220427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6811","nonce":3063220427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6815","nonce":3063220427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6813","nonce":3063220427}]},"public_addr":"172.21.15.160:6809/3063220427","cluster_addr":"172.21.15.160:6811/3063220427","heartbeat_back_addr":"172.21.15.160:6815/3063220427","heartbeat_front_addr":"172.21.15.160:6813/3063220427","state":["exists","up"]},{"osd":6,"uuid":"1bf22f48-c02f-4f09-b0fe-2597a55fd795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6819","nonce":3650315688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6821","nonce":3650315688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6825","nonce":3650315688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6823","nonce":3650315688}]},"public_addr":"172.21.15.70:6819/3650315688","cluster_addr":"172.21.15.70:6821/3650315688","heartbeat_back_addr":"172.21.15.70:6825/3650315688","heartbeat_front_addr":"172.21.15.70:6823/3650315688","state":["exists","up"]},{"osd":7,"uuid":"40d59744-4860-4a92-aa21-3f33e575e5b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6817","nonce":2034132009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6819","nonce":2034132009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6823","nonce":2034132009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6821","nonce":2034132009}]},"public_addr":"172.21.15.116:6817/2034132009","cluster_addr":"172.21.15.116:6819/2034132009","heartbeat_back_addr":"172.21.15.116:6823/2034132009","heartbeat_front_addr":"172.21.15.116:6821/2034132009","state":["exists","up"]},{"osd":8,"uuid":"65dc02e7-0dcd-4fa7-955a-4d5c00fbe4cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6817","nonce":3381625184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6819","nonce":3381625184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6823","nonce":3381625184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6821","nonce":3381625184}]},"public_addr":"172.21.15.160:6817/3381625184","cluster_addr":"172.21.15.160:6819/3381625184","heartbeat_back_addr":"172.21.15.160:6823/3381625184","heartbeat_front_addr":"172.21.15.160:6821/3381625184","state":["exists","up"]},{"osd":9,"uuid":"d8438a9c-012f-4082-be3f-9653cdfaac78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6827","nonce":3555256209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6829","nonce":3555256209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6833","nonce":3555256209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6831","nonce":3555256209}]},"public_addr":"172.21.15.70:6827/3555256209","cluster_addr":"172.21.15.70:6829/3555256209","heartbeat_back_addr":"172.21.15.70:6833/3555256209","heartbeat_front_addr":"172.21.15.70:6831/3555256209","state":["exists","up"]},{"osd":10,"uuid":"871619b0-181e-4020-9511-2cec296bfe70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6825","nonce":541280433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6827","nonce":541280433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6831","nonce":541280433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6829","nonce":541280433}]},"public_addr":"172.21.15.116:6825/541280433","cluster_addr":"172.21.15.116:6827/541280433","heartbeat_back_addr":"172.21.15.116:6831/541280433","heartbeat_front_addr":"172.21.15.116:6829/541280433","state":["exists","up"]},{"osd":11,"uuid":"302da945-7929-4b0c-a20b-099175752c41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6825","nonce":2632369083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6827","nonce":2632369083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6831","nonce":2632369083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6829","nonce":2632369083}]},"public_addr":"172.21.15.160:6825/2632369083","cluster_addr":"172.21.15.160:6827/2632369083","heartbeat_back_addr":"172.21.15.160:6831/2632369083","heartbeat_front_addr":"172.21.15.160:6829/2632369083","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:41:34.446744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:41:59.336955+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:42:23.958219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:42:49.396007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:43:15.325344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:43:41.923141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:07.873970+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:33.897951+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:58.397680+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:24.568406+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:49.504565+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:14.698577+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.e","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6800/605055695":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/897886925":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/1968357524":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/693721445":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/2810307308":"2024-09-22T05:39:12.492271+0000","172.21.15.70:6801/605055695":"2024-09-22T05:39:37.296630+0000","172.21.15.70:6801/1668927582":"2024-09-22T05:39:12.492271+0000","172.21.15.70:6800/1668927582":"2024-09-22T05:39:12.492271+0000","172.21.15.70:0/1979536420":"2024-09-22T05:39:12.492271+0000","172.21.15.70:0/2674019604":"2024-09-22T05:39:12.492271+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:48:14.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.740+0000 7fd5b4838640 1 -- 172.21.15.70:0/2216286650 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd5980b65a0 msgr2=0x7fd5980b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:14.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.740+0000 7fd5b4838640 1 --2- 172.21.15.70:0/2216286650 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd5980b65a0 0x7fd5980b8ab0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8009890 tx=0x7fd5a8008040 comp rx=0 tx=0).stop 2024-09-21T05:48:14.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.740+0000 7fd5b4838640 1 -- 172.21.15.70:0/2216286650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5b0108cf0 msgr2=0x7fd5b019ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:14.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.740+0000 7fd5b4838640 1 --2- 172.21.15.70:0/2216286650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5b0108cf0 0x7fd5b019ff70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0009a20 tx=0x7fd5a0004250 comp rx=0 tx=0).stop 2024-09-21T05:48:14.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.740+0000 7fd5b4838640 1 -- 172.21.15.70:0/2216286650 shutdown_connections 2024-09-21T05:48:14.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.740+0000 7fd5b4838640 1 --2- 172.21.15.70:0/2216286650 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd5980b65a0 0x7fd5980b8ab0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:14.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.740+0000 7fd5b4838640 1 --2- 172.21.15.70:0/2216286650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5b0108cf0 0x7fd5b019ff70 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:14.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.740+0000 7fd5b4838640 1 --2- 172.21.15.70:0/2216286650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd5b01083a0 0x7fd5b019acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:14.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.740+0000 7fd5b4838640 1 --2- 172.21.15.70:0/2216286650 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5b0102a60 0x7fd5b019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:14.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.740+0000 7fd5b4838640 1 -- 172.21.15.70:0/2216286650 >> 172.21.15.70:0/2216286650 conn(0x7fd5b0079730 msgr2=0x7fd5b0101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:14.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.740+0000 7fd5b4838640 1 -- 172.21.15.70:0/2216286650 shutdown_connections 2024-09-21T05:48:14.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:14.740+0000 7fd5b4838640 1 -- 172.21.15.70:0/2216286650 wait complete. 2024-09-21T05:48:14.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:14 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2216286650' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:48:15.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:14 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2216286650' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:48:15.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:14 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2216286650' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:48:15.412 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T05:48:15.412 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T05:48:15.412 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T05:48:15.413 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T05:48:15.413 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T05:48:15.414 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T05:48:15.414 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph tell osd.6 flush_pg_stats 2024-09-21T05:48:15.415 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph tell osd.7 flush_pg_stats 2024-09-21T05:48:15.415 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph tell osd.8 flush_pg_stats 2024-09-21T05:48:15.415 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph tell osd.9 flush_pg_stats 2024-09-21T05:48:15.416 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph tell osd.10 flush_pg_stats 2024-09-21T05:48:15.416 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph tell osd.11 flush_pg_stats 2024-09-21T05:48:16.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:15 smithi116 ceph-mon[34332]: pgmap v332: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-21T05:48:16.060 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:16.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:15 smithi160 ceph-mon[33979]: pgmap v332: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-21T05:48:16.214 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:15 smithi070 ceph-mon[30981]: pgmap v332: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-21T05:48:16.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.627+0000 7fae0925a640 1 -- 172.21.15.70:0/958982596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae04103b60 msgr2=0x7fae04103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:16.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.627+0000 7fae0925a640 1 --2- 172.21.15.70:0/958982596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae04103b60 0x7fae04103f70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fadf4009900 tx=0x7fadf402a410 comp rx=0 tx=0).stop 2024-09-21T05:48:16.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.627+0000 7fae0925a640 1 -- 172.21.15.70:0/958982596 shutdown_connections 2024-09-21T05:48:16.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.627+0000 7fae0925a640 1 --2- 172.21.15.70:0/958982596 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae04109df0 0x7fae04110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:16.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.627+0000 7fae0925a640 1 --2- 172.21.15.70:0/958982596 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae041094a0 0x7fae041098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:16.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.627+0000 7fae0925a640 1 --2- 172.21.15.70:0/958982596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae04103b60 0x7fae04103f70 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:16.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.627+0000 7fae0925a640 1 -- 172.21.15.70:0/958982596 >> 172.21.15.70:0/958982596 conn(0x7fae0407b850 msgr2=0x7fae0407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:16.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.627+0000 7fae0925a640 1 -- 172.21.15.70:0/958982596 shutdown_connections 2024-09-21T05:48:16.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.627+0000 7fae0925a640 1 -- 172.21.15.70:0/958982596 wait complete. 2024-09-21T05:48:16.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.628+0000 7fae0925a640 1 Processor -- start 2024-09-21T05:48:16.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.628+0000 7fae0925a640 1 -- start start 2024-09-21T05:48:16.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.629+0000 7fae0925a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae04103b60 0x7fae0419a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:16.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.629+0000 7fae0925a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae041094a0 0x7fae0419abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:16.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.629+0000 7fae0925a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae04109df0 0x7fae0419fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:16.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.629+0000 7fae0925a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fae04113b60 con 0x7fae04103b60 2024-09-21T05:48:16.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.629+0000 7fae0925a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fae041139e0 con 0x7fae041094a0 2024-09-21T05:48:16.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.629+0000 7fae0925a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fae04113ce0 con 0x7fae04109df0 2024-09-21T05:48:16.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.629+0000 7fae02d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae04103b60 0x7fae0419a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:16.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.629+0000 7fae02d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae04103b60 0x7fae0419a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34716/0 (socket says 172.21.15.70:34716) 2024-09-21T05:48:16.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.629+0000 7fae02d9d640 1 -- 172.21.15.70:0/1924955915 learned_addr learned my addr 172.21.15.70:0/1924955915 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:16.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.629+0000 7fae0259c640 1 --2- 172.21.15.70:0/1924955915 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae041094a0 0x7fae0419abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:16.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.629+0000 7fae0359e640 1 --2- 172.21.15.70:0/1924955915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae04109df0 0x7fae0419fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:16.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.629+0000 7fae02d9d640 1 -- 172.21.15.70:0/1924955915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae04109df0 msgr2=0x7fae0419fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:16.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.629+0000 7fae02d9d640 1 --2- 172.21.15.70:0/1924955915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae04109df0 0x7fae0419fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:16.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.629+0000 7fae02d9d640 1 -- 172.21.15.70:0/1924955915 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae041094a0 msgr2=0x7fae0419abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:16.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.629+0000 7fae02d9d640 1 --2- 172.21.15.70:0/1924955915 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae041094a0 0x7fae0419abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:16.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.629+0000 7fae02d9d640 1 -- 172.21.15.70:0/1924955915 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae041a0580 con 0x7fae04103b60 2024-09-21T05:48:16.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.629+0000 7fae02d9d640 1 --2- 172.21.15.70:0/1924955915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae04103b60 0x7fae0419a610 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fadf4005940 tx=0x7fadf40042d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:16.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.629+0000 7fadebfff640 1 -- 172.21.15.70:0/1924955915 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf403f070 con 0x7fae04103b60 2024-09-21T05:48:16.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.630+0000 7fadebfff640 1 -- 172.21.15.70:0/1924955915 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fadf40044c0 con 0x7fae04103b60 2024-09-21T05:48:16.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.630+0000 7fae0925a640 1 -- 172.21.15.70:0/1924955915 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae041a0810 con 0x7fae04103b60 2024-09-21T05:48:16.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.630+0000 7fadebfff640 1 -- 172.21.15.70:0/1924955915 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf4035030 con 0x7fae04103b60 2024-09-21T05:48:16.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.630+0000 7fae0925a640 1 -- 172.21.15.70:0/1924955915 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae041a6fd0 con 0x7fae04103b60 2024-09-21T05:48:16.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.631+0000 7fae0925a640 1 -- 172.21.15.70:0/1924955915 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fae04063ad0 con 0x7fae04103b60 2024-09-21T05:48:16.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.632+0000 7fadebfff640 1 -- 172.21.15.70:0/1924955915 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fadf4042070 con 0x7fae04103b60 2024-09-21T05:48:16.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.633+0000 7fadebfff640 1 --2- 172.21.15.70:0/1924955915 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fadec0b65a0 0x7fadec0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:16.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.633+0000 7fae0259c640 1 --2- 172.21.15.70:0/1924955915 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fadec0b65a0 0x7fadec0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:16.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.633+0000 7fadebfff640 1 -- 172.21.15.70:0/1924955915 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7fadf41085e0 con 0x7fae04103b60 2024-09-21T05:48:16.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.633+0000 7fadebfff640 1 --2- 172.21.15.70:0/1924955915 >> [v2:172.21.15.116:6808/3444857438,v1:172.21.15.116:6809/3444857438] conn(0x7fadec0c16b0 0x7fadec0c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:16.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.633+0000 7fadebfff640 1 -- 172.21.15.70:0/1924955915 --> [v2:172.21.15.116:6808/3444857438,v1:172.21.15.116:6809/3444857438] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fadec0c4270 con 0x7fadec0c16b0 2024-09-21T05:48:16.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.633+0000 7fadebfff640 1 -- 172.21.15.70:0/1924955915 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fadf4108a30 con 0x7fae04103b60 2024-09-21T05:48:16.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.633+0000 7fae0359e640 1 --2- 172.21.15.70:0/1924955915 >> [v2:172.21.15.116:6808/3444857438,v1:172.21.15.116:6809/3444857438] conn(0x7fadec0c16b0 0x7fadec0c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:16.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.633+0000 7fae0259c640 1 --2- 172.21.15.70:0/1924955915 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fadec0b65a0 0x7fadec0b8ab0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fae041066b0 tx=0x7fadf8009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:16.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.634+0000 7fae0359e640 1 --2- 172.21.15.70:0/1924955915 >> [v2:172.21.15.116:6808/3444857438,v1:172.21.15.116:6809/3444857438] conn(0x7fadec0c16b0 0x7fadec0c3ba0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:16.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.634+0000 7fadebfff640 1 -- 172.21.15.70:0/1924955915 <== osd.4 v2:172.21.15.116:6808/3444857438 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fadec0c4270 con 0x7fadec0c16b0 2024-09-21T05:48:16.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.648+0000 7fae0925a640 1 -- 172.21.15.70:0/1924955915 --> [v2:172.21.15.116:6808/3444857438,v1:172.21.15.116:6809/3444857438] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fae04063ed0 con 0x7fadec0c16b0 2024-09-21T05:48:16.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.648+0000 7fadebfff640 1 -- 172.21.15.70:0/1924955915 <== osd.4 v2:172.21.15.116:6808/3444857438 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fae04063ed0 con 0x7fadec0c16b0 2024-09-21T05:48:16.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.649+0000 7fae0925a640 1 -- 172.21.15.70:0/1924955915 >> [v2:172.21.15.116:6808/3444857438,v1:172.21.15.116:6809/3444857438] conn(0x7fadec0c16b0 msgr2=0x7fadec0c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:16.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.649+0000 7fae0925a640 1 --2- 172.21.15.70:0/1924955915 >> [v2:172.21.15.116:6808/3444857438,v1:172.21.15.116:6809/3444857438] conn(0x7fadec0c16b0 0x7fadec0c3ba0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:16.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.649+0000 7fae0925a640 1 -- 172.21.15.70:0/1924955915 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fadec0b65a0 msgr2=0x7fadec0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:16.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.649+0000 7fae0925a640 1 --2- 172.21.15.70:0/1924955915 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fadec0b65a0 0x7fadec0b8ab0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fae041066b0 tx=0x7fadf8009110 comp rx=0 tx=0).stop 2024-09-21T05:48:16.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.649+0000 7fae0925a640 1 -- 172.21.15.70:0/1924955915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae04103b60 msgr2=0x7fae0419a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:16.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.649+0000 7fae0925a640 1 --2- 172.21.15.70:0/1924955915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae04103b60 0x7fae0419a610 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fadf4005940 tx=0x7fadf40042d0 comp rx=0 tx=0).stop 2024-09-21T05:48:16.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.649+0000 7fae0359e640 1 -- 172.21.15.70:0/1924955915 reap_dead start 2024-09-21T05:48:16.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.649+0000 7fae0925a640 1 -- 172.21.15.70:0/1924955915 shutdown_connections 2024-09-21T05:48:16.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.649+0000 7fae0925a640 1 -- 172.21.15.70:0/1924955915 >> 172.21.15.70:0/1924955915 conn(0x7fae0407b850 msgr2=0x7fae04107640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:16.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.649+0000 7fae0925a640 1 -- 172.21.15.70:0/1924955915 shutdown_connections 2024-09-21T05:48:16.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:16.649+0000 7fae0925a640 1 -- 172.21.15.70:0/1924955915 wait complete. 2024-09-21T05:48:17.377 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:17.378 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:17.378 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:17.378 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:17.381 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:17.381 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:17.383 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:17.387 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:17.406 INFO:teuthology.orchestra.run.smithi070.stdout:124554051647 2024-09-21T05:48:17.406 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T05:48:17.463 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:17.545 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:17 smithi070 ceph-mon[30981]: pgmap v333: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-21T05:48:17.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:17 smithi116 ceph-mon[34332]: pgmap v333: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-21T05:48:17.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:17 smithi160 ceph-mon[33979]: pgmap v333: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-21T05:48:18.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.365+0000 7f0fbba65640 1 -- 172.21.15.70:0/858447699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fb4110200 msgr2=0x7f0fb4112620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:18.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.365+0000 7f0fbba65640 1 --2- 172.21.15.70:0/858447699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fb4110200 0x7f0fb4112620 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0fac009ca0 tx=0x7f0fac02a950 comp rx=0 tx=0).stop 2024-09-21T05:48:18.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.365+0000 7f0fbba65640 1 -- 172.21.15.70:0/858447699 shutdown_connections 2024-09-21T05:48:18.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.365+0000 7f0fbba65640 1 --2- 172.21.15.70:0/858447699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fb4110200 0x7f0fb4112620 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:18.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.365+0000 7f0fbba65640 1 --2- 172.21.15.70:0/858447699 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fb4102fa0 0x7f0fb410fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:18.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.365+0000 7f0fbba65640 1 --2- 172.21.15.70:0/858447699 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fb4102650 0x7f0fb4102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:18.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.365+0000 7f0fbba65640 1 -- 172.21.15.70:0/858447699 >> 172.21.15.70:0/858447699 conn(0x7f0fb4079770 msgr2=0x7f0fb4079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:18.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.365+0000 7f0fbba65640 1 -- 172.21.15.70:0/858447699 shutdown_connections 2024-09-21T05:48:18.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.365+0000 7f0fbba65640 1 -- 172.21.15.70:0/858447699 wait complete. 2024-09-21T05:48:18.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.366+0000 7f0fbba65640 1 Processor -- start 2024-09-21T05:48:18.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.366+0000 7f0fbba65640 1 -- start start 2024-09-21T05:48:18.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.366+0000 7f0fbba65640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fb4102650 0x7f0fb419c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:18.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.366+0000 7f0fbba65640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fb4102fa0 0x7f0fb419cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:18.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.366+0000 7f0fbba65640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fb4110200 0x7f0fb41a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:18.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.366+0000 7f0fbba65640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb4115cc0 con 0x7f0fb4102fa0 2024-09-21T05:48:18.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.366+0000 7f0fbba65640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb4115b40 con 0x7f0fb4110200 2024-09-21T05:48:18.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.366+0000 7f0fbba65640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb4115e40 con 0x7f0fb4102650 2024-09-21T05:48:18.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.366+0000 7f0fb9000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fb4102fa0 0x7f0fb419cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:18.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.366+0000 7f0fb9000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fb4102fa0 0x7f0fb419cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34734/0 (socket says 172.21.15.70:34734) 2024-09-21T05:48:18.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.366+0000 7f0fb9000640 1 -- 172.21.15.70:0/3718133891 learned_addr learned my addr 172.21.15.70:0/3718133891 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:18.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.366+0000 7f0fba002640 1 --2- 172.21.15.70:0/3718133891 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fb4110200 0x7f0fb41a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:18.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.366+0000 7f0fb9000640 1 -- 172.21.15.70:0/3718133891 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fb4102650 msgr2=0x7f0fb419c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:18.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.366+0000 7f0fb9801640 1 --2- 172.21.15.70:0/3718133891 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fb4102650 0x7f0fb419c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:18.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.366+0000 7f0fb9000640 1 --2- 172.21.15.70:0/3718133891 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fb4102650 0x7f0fb419c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:18.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.366+0000 7f0fb9000640 1 -- 172.21.15.70:0/3718133891 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fb4110200 msgr2=0x7f0fb41a1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:18.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.366+0000 7f0fb9000640 1 --2- 172.21.15.70:0/3718133891 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fb4110200 0x7f0fb41a1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:18.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.366+0000 7f0fb9000640 1 -- 172.21.15.70:0/3718133891 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb41a25e0 con 0x7f0fb4102fa0 2024-09-21T05:48:18.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.366+0000 7f0fba002640 1 --2- 172.21.15.70:0/3718133891 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fb4110200 0x7f0fb41a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:48:18.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.366+0000 7f0fb9801640 1 --2- 172.21.15.70:0/3718133891 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fb4102650 0x7f0fb419c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:48:18.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.367+0000 7f0fb9000640 1 --2- 172.21.15.70:0/3718133891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fb4102fa0 0x7f0fb419cc10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0fa400e9f0 tx=0x7f0fa400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:18.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.367+0000 7f0faa7fc640 1 -- 172.21.15.70:0/3718133891 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa400cd80 con 0x7f0fb4102fa0 2024-09-21T05:48:18.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.367+0000 7f0faa7fc640 1 -- 172.21.15.70:0/3718133891 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f0fa40108e0 con 0x7f0fb4102fa0 2024-09-21T05:48:18.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.367+0000 7f0faa7fc640 1 -- 172.21.15.70:0/3718133891 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa40188b0 con 0x7f0fb4102fa0 2024-09-21T05:48:18.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.367+0000 7f0fbba65640 1 -- 172.21.15.70:0/3718133891 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fb41a28d0 con 0x7f0fb4102fa0 2024-09-21T05:48:18.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.367+0000 7f0fbba65640 1 -- 172.21.15.70:0/3718133891 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fb41a9030 con 0x7f0fb4102fa0 2024-09-21T05:48:18.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.368+0000 7f0fbba65640 1 -- 172.21.15.70:0/3718133891 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0fb4112060 con 0x7f0fb4102fa0 2024-09-21T05:48:18.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.369+0000 7f0faa7fc640 1 -- 172.21.15.70:0/3718133891 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f0fa4010a90 con 0x7f0fb4102fa0 2024-09-21T05:48:18.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.370+0000 7f0faa7fc640 1 --2- 172.21.15.70:0/3718133891 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0fa00b65a0 0x7f0fa00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:18.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.370+0000 7f0fb9801640 1 --2- 172.21.15.70:0/3718133891 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0fa00b65a0 0x7f0fa00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:18.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.370+0000 7f0faa7fc640 1 -- 172.21.15.70:0/3718133891 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f0fa40e8470 con 0x7f0fb4102fa0 2024-09-21T05:48:18.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.370+0000 7f0faa7fc640 1 --2- 172.21.15.70:0/3718133891 >> [v2:172.21.15.70:6826/3555256209,v1:172.21.15.70:6827/3555256209] conn(0x7f0fa00c16b0 0x7f0fa00c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:18.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.370+0000 7f0faa7fc640 1 -- 172.21.15.70:0/3718133891 --> [v2:172.21.15.70:6826/3555256209,v1:172.21.15.70:6827/3555256209] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0fa4028ea0 con 0x7f0fa00c16b0 2024-09-21T05:48:18.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.370+0000 7f0faa7fc640 1 -- 172.21.15.70:0/3718133891 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f0fa40e88c0 con 0x7f0fb4102fa0 2024-09-21T05:48:18.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.371+0000 7f0fba002640 1 --2- 172.21.15.70:0/3718133891 >> [v2:172.21.15.70:6826/3555256209,v1:172.21.15.70:6827/3555256209] conn(0x7f0fa00c16b0 0x7f0fa00c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:18.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.371+0000 7f0fb9801640 1 --2- 172.21.15.70:0/3718133891 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0fa00b65a0 0x7f0fa00b8ab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009b50 tx=0x7f0fb0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:18.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.371+0000 7f0fba002640 1 --2- 172.21.15.70:0/3718133891 >> [v2:172.21.15.70:6826/3555256209,v1:172.21.15.70:6827/3555256209] conn(0x7f0fa00c16b0 0x7f0fa00c3ba0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:18.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.372+0000 7f0faa7fc640 1 -- 172.21.15.70:0/3718133891 <== osd.9 v2:172.21.15.70:6826/3555256209 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0fa4028ea0 con 0x7f0fa00c16b0 2024-09-21T05:48:18.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.385+0000 7f0fbba65640 1 -- 172.21.15.70:0/3718133891 --> [v2:172.21.15.70:6826/3555256209,v1:172.21.15.70:6827/3555256209] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0fb406b390 con 0x7f0fa00c16b0 2024-09-21T05:48:18.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.385+0000 7f0faa7fc640 1 -- 172.21.15.70:0/3718133891 <== osd.9 v2:172.21.15.70:6826/3555256209 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0fb406b390 con 0x7f0fa00c16b0 2024-09-21T05:48:18.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.386+0000 7f0fbba65640 1 -- 172.21.15.70:0/3718133891 >> [v2:172.21.15.70:6826/3555256209,v1:172.21.15.70:6827/3555256209] conn(0x7f0fa00c16b0 msgr2=0x7f0fa00c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:18.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.386+0000 7f0fbba65640 1 --2- 172.21.15.70:0/3718133891 >> [v2:172.21.15.70:6826/3555256209,v1:172.21.15.70:6827/3555256209] conn(0x7f0fa00c16b0 0x7f0fa00c3ba0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:18.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.386+0000 7f0fbba65640 1 -- 172.21.15.70:0/3718133891 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0fa00b65a0 msgr2=0x7f0fa00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:18.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.386+0000 7f0fbba65640 1 --2- 172.21.15.70:0/3718133891 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0fa00b65a0 0x7f0fa00b8ab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009b50 tx=0x7f0fb0005f90 comp rx=0 tx=0).stop 2024-09-21T05:48:18.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.386+0000 7f0fbba65640 1 -- 172.21.15.70:0/3718133891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fb4102fa0 msgr2=0x7f0fb419cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:18.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.386+0000 7f0fbba65640 1 --2- 172.21.15.70:0/3718133891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fb4102fa0 0x7f0fb419cc10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0fa400e9f0 tx=0x7f0fa400eeb0 comp rx=0 tx=0).stop 2024-09-21T05:48:18.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.386+0000 7f0fba002640 1 -- 172.21.15.70:0/3718133891 reap_dead start 2024-09-21T05:48:18.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.386+0000 7f0fbba65640 1 -- 172.21.15.70:0/3718133891 shutdown_connections 2024-09-21T05:48:18.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.386+0000 7f0fbba65640 1 -- 172.21.15.70:0/3718133891 >> 172.21.15.70:0/3718133891 conn(0x7f0fb4079770 msgr2=0x7f0fb4111680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:18.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.386+0000 7f0fbba65640 1 -- 172.21.15.70:0/3718133891 shutdown_connections 2024-09-21T05:48:18.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:18.386+0000 7f0fbba65640 1 -- 172.21.15.70:0/3718133891 wait complete. 2024-09-21T05:48:18.398 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:19.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.711+0000 7f13624f2640 1 -- 172.21.15.70:0/721750774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f135c108d10 msgr2=0x7f135c10f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:19.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.711+0000 7f13624f2640 1 --2- 172.21.15.70:0/721750774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f135c108d10 0x7f135c10f540 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1354009ca0 tx=0x7f135402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:48:19.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.711+0000 7f13624f2640 1 -- 172.21.15.70:0/721750774 shutdown_connections 2024-09-21T05:48:19.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.711+0000 7f13624f2640 1 --2- 172.21.15.70:0/721750774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f135c108d10 0x7f135c10f540 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:19.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.711+0000 7f13624f2640 1 --2- 172.21.15.70:0/721750774 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f135c1083c0 0x7f135c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:19.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.711+0000 7f13624f2640 1 --2- 172.21.15.70:0/721750774 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f135c102a80 0x7f135c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:19.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.711+0000 7f13624f2640 1 -- 172.21.15.70:0/721750774 >> 172.21.15.70:0/721750774 conn(0x7f135c079740 msgr2=0x7f135c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:19.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.711+0000 7f13624f2640 1 -- 172.21.15.70:0/721750774 shutdown_connections 2024-09-21T05:48:19.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.711+0000 7f13624f2640 1 -- 172.21.15.70:0/721750774 wait complete. 2024-09-21T05:48:19.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.711+0000 7f13624f2640 1 Processor -- start 2024-09-21T05:48:19.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.711+0000 7f13624f2640 1 -- start start 2024-09-21T05:48:19.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.712+0000 7f13624f2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f135c102a80 0x7f135c0ff690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:19.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.712+0000 7f13624f2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f135c1083c0 0x7f135c0ffbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:19.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.712+0000 7f13624f2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f135c108d10 0x7f135c100110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:19.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.712+0000 7f13624f2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f135c112970 con 0x7f135c1083c0 2024-09-21T05:48:19.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.712+0000 7f13624f2640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f135c1127f0 con 0x7f135c102a80 2024-09-21T05:48:19.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.712+0000 7f13624f2640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f135c112af0 con 0x7f135c108d10 2024-09-21T05:48:19.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.712+0000 7f135b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f135c1083c0 0x7f135c0ffbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:19.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.712+0000 7f135b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f135c1083c0 0x7f135c0ffbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34748/0 (socket says 172.21.15.70:34748) 2024-09-21T05:48:19.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.712+0000 7f135b7fe640 1 -- 172.21.15.70:0/3386004880 learned_addr learned my addr 172.21.15.70:0/3386004880 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:19.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.712+0000 7f135bfff640 1 --2- 172.21.15.70:0/3386004880 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f135c102a80 0x7f135c0ff690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:19.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.712+0000 7f135b7fe640 1 -- 172.21.15.70:0/3386004880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f135c108d10 msgr2=0x7f135c100110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:19.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.712+0000 7f135b7fe640 1 --2- 172.21.15.70:0/3386004880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f135c108d10 0x7f135c100110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:19.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.712+0000 7f135b7fe640 1 -- 172.21.15.70:0/3386004880 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f135c102a80 msgr2=0x7f135c0ff690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:19.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.712+0000 7f135b7fe640 1 --2- 172.21.15.70:0/3386004880 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f135c102a80 0x7f135c0ff690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:19.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.712+0000 7f135b7fe640 1 -- 172.21.15.70:0/3386004880 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f135c1a8710 con 0x7f135c1083c0 2024-09-21T05:48:19.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.713+0000 7f135b7fe640 1 --2- 172.21.15.70:0/3386004880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f135c1083c0 0x7f135c0ffbd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f135000e9c0 tx=0x7f135000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:19.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.713+0000 7f13597fa640 1 -- 172.21.15.70:0/3386004880 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135000cd80 con 0x7f135c1083c0 2024-09-21T05:48:19.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.713+0000 7f13597fa640 1 -- 172.21.15.70:0/3386004880 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f13500054d0 con 0x7f135c1083c0 2024-09-21T05:48:19.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.713+0000 7f13624f2640 1 -- 172.21.15.70:0/3386004880 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f135c1a8a00 con 0x7f135c1083c0 2024-09-21T05:48:19.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.713+0000 7f13597fa640 1 -- 172.21.15.70:0/3386004880 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1350010430 con 0x7f135c1083c0 2024-09-21T05:48:19.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.713+0000 7f13624f2640 1 -- 172.21.15.70:0/3386004880 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f135c1a8f40 con 0x7f135c1083c0 2024-09-21T05:48:19.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.714+0000 7f13624f2640 1 -- 172.21.15.70:0/3386004880 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f135c063b50 con 0x7f135c1083c0 2024-09-21T05:48:19.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.715+0000 7f13597fa640 1 -- 172.21.15.70:0/3386004880 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f1350004f80 con 0x7f135c1083c0 2024-09-21T05:48:19.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.716+0000 7f13597fa640 1 --2- 172.21.15.70:0/3386004880 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f13440b65a0 0x7f13440b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:19.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.716+0000 7f135bfff640 1 --2- 172.21.15.70:0/3386004880 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f13440b65a0 0x7f13440b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:19.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.716+0000 7f13597fa640 1 -- 172.21.15.70:0/3386004880 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f13500e8190 con 0x7f135c1083c0 2024-09-21T05:48:19.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.716+0000 7f13597fa640 1 --2- 172.21.15.70:0/3386004880 >> [v2:172.21.15.160:6800/69260815,v1:172.21.15.160:6801/69260815] conn(0x7f13440c16b0 0x7f13440c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:19.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.716+0000 7f13597fa640 1 -- 172.21.15.70:0/3386004880 --> [v2:172.21.15.160:6800/69260815,v1:172.21.15.160:6801/69260815] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f135001ce50 con 0x7f13440c16b0 2024-09-21T05:48:19.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.716+0000 7f13597fa640 1 -- 172.21.15.70:0/3386004880 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f13500e85e0 con 0x7f135c1083c0 2024-09-21T05:48:19.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.716+0000 7f135bfff640 1 --2- 172.21.15.70:0/3386004880 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f13440b65a0 0x7f13440b8ab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f134c005fd0 tx=0x7f134c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:19.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.717+0000 7f1360a8f640 1 --2- 172.21.15.70:0/3386004880 >> [v2:172.21.15.160:6800/69260815,v1:172.21.15.160:6801/69260815] conn(0x7f13440c16b0 0x7f13440c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:19.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.717+0000 7f1360a8f640 1 --2- 172.21.15.70:0/3386004880 >> [v2:172.21.15.160:6800/69260815,v1:172.21.15.160:6801/69260815] conn(0x7f13440c16b0 0x7f13440c3ba0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:19.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.718+0000 7f13597fa640 1 -- 172.21.15.70:0/3386004880 <== osd.2 v2:172.21.15.160:6800/69260815 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f135001ce50 con 0x7f13440c16b0 2024-09-21T05:48:19.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.731+0000 7f13624f2640 1 -- 172.21.15.70:0/3386004880 --> [v2:172.21.15.160:6800/69260815,v1:172.21.15.160:6801/69260815] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f135c063f50 con 0x7f13440c16b0 2024-09-21T05:48:19.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.732+0000 7f13597fa640 1 -- 172.21.15.70:0/3386004880 <== osd.2 v2:172.21.15.160:6800/69260815 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f135c063f50 con 0x7f13440c16b0 2024-09-21T05:48:19.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.733+0000 7f13624f2640 1 -- 172.21.15.70:0/3386004880 >> [v2:172.21.15.160:6800/69260815,v1:172.21.15.160:6801/69260815] conn(0x7f13440c16b0 msgr2=0x7f13440c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:19.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.733+0000 7f13624f2640 1 --2- 172.21.15.70:0/3386004880 >> [v2:172.21.15.160:6800/69260815,v1:172.21.15.160:6801/69260815] conn(0x7f13440c16b0 0x7f13440c3ba0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:19.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.733+0000 7f13624f2640 1 -- 172.21.15.70:0/3386004880 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f13440b65a0 msgr2=0x7f13440b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:19.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.733+0000 7f13624f2640 1 --2- 172.21.15.70:0/3386004880 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f13440b65a0 0x7f13440b8ab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f134c005fd0 tx=0x7f134c005850 comp rx=0 tx=0).stop 2024-09-21T05:48:19.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.733+0000 7f13624f2640 1 -- 172.21.15.70:0/3386004880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f135c1083c0 msgr2=0x7f135c0ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:19.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.733+0000 7f13624f2640 1 --2- 172.21.15.70:0/3386004880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f135c1083c0 0x7f135c0ffbd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f135000e9c0 tx=0x7f135000ee80 comp rx=0 tx=0).stop 2024-09-21T05:48:19.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.733+0000 7f1360a8f640 1 -- 172.21.15.70:0/3386004880 reap_dead start 2024-09-21T05:48:19.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.733+0000 7f13624f2640 1 -- 172.21.15.70:0/3386004880 shutdown_connections 2024-09-21T05:48:19.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.733+0000 7f13624f2640 1 -- 172.21.15.70:0/3386004880 >> 172.21.15.70:0/3386004880 conn(0x7f135c079740 msgr2=0x7f135c06be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:19.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.733+0000 7f13624f2640 1 -- 172.21.15.70:0/3386004880 shutdown_connections 2024-09-21T05:48:19.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.733+0000 7f13624f2640 1 -- 172.21.15.70:0/3386004880 wait complete. 2024-09-21T05:48:19.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:19 smithi116 ceph-mon[34332]: pgmap v334: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-21T05:48:19.840 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:19 smithi070 ceph-mon[30981]: pgmap v334: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-21T05:48:19.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:19 smithi160 ceph-mon[33979]: pgmap v334: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-21T05:48:19.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.927+0000 7f4b91081640 1 -- 172.21.15.70:0/1517048277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b8c108db0 msgr2=0x7f4b8c10f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:19.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.927+0000 7f4b91081640 1 --2- 172.21.15.70:0/1517048277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b8c108db0 0x7f4b8c10f5e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4b84009ca0 tx=0x7f4b8402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:48:19.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.927+0000 7f4b91081640 1 -- 172.21.15.70:0/1517048277 shutdown_connections 2024-09-21T05:48:19.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.927+0000 7f4b91081640 1 --2- 172.21.15.70:0/1517048277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b8c108460 0x7f4b8c108870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:19.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.928+0000 7f4b91081640 1 --2- 172.21.15.70:0/1517048277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b8c108db0 0x7f4b8c10f5e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:19.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.928+0000 7f4b91081640 1 --2- 172.21.15.70:0/1517048277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b8c103230 0x7f4b8c103640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:19.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.928+0000 7f4b91081640 1 -- 172.21.15.70:0/1517048277 >> 172.21.15.70:0/1517048277 conn(0x7f4b8c079ec0 msgr2=0x7f4b8c07a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:19.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.928+0000 7f4b91081640 1 -- 172.21.15.70:0/1517048277 shutdown_connections 2024-09-21T05:48:19.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.928+0000 7f4b91081640 1 -- 172.21.15.70:0/1517048277 wait complete. 2024-09-21T05:48:19.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.928+0000 7f4b91081640 1 Processor -- start 2024-09-21T05:48:19.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.929+0000 7f4b91081640 1 -- start start 2024-09-21T05:48:19.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.929+0000 7f4b91081640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b8c103230 0x7f4b8c19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:19.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.929+0000 7f4b91081640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b8c108460 0x7f4b8c19aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:19.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.929+0000 7f4b91081640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b8c108db0 0x7f4b8c19fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:19.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.929+0000 7f4b91081640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8c112a60 con 0x7f4b8c103230 2024-09-21T05:48:19.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.929+0000 7f4b91081640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8c1128e0 con 0x7f4b8c108db0 2024-09-21T05:48:19.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.929+0000 7f4b91081640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8c112be0 con 0x7f4b8c108460 2024-09-21T05:48:19.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.929+0000 7f4b8ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b8c103230 0x7f4b8c19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:19.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.929+0000 7f4b8ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b8c103230 0x7f4b8c19a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34766/0 (socket says 172.21.15.70:34766) 2024-09-21T05:48:19.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.929+0000 7f4b8ad9d640 1 -- 172.21.15.70:0/2899056558 learned_addr learned my addr 172.21.15.70:0/2899056558 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:19.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.929+0000 7f4b8b59e640 1 --2- 172.21.15.70:0/2899056558 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b8c108db0 0x7f4b8c19fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:19.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.929+0000 7f4b8ad9d640 1 -- 172.21.15.70:0/2899056558 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b8c108460 msgr2=0x7f4b8c19aa80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T05:48:19.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.929+0000 7f4b8ad9d640 1 --2- 172.21.15.70:0/2899056558 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b8c108460 0x7f4b8c19aa80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:19.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.929+0000 7f4b8ad9d640 1 -- 172.21.15.70:0/2899056558 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b8c108db0 msgr2=0x7f4b8c19fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:19.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.929+0000 7f4b8ad9d640 1 --2- 172.21.15.70:0/2899056558 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b8c108db0 0x7f4b8c19fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:19.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.929+0000 7f4b8ad9d640 1 -- 172.21.15.70:0/2899056558 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b8c1a0390 con 0x7f4b8c103230 2024-09-21T05:48:19.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.930+0000 7f4b8ad9d640 1 --2- 172.21.15.70:0/2899056558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b8c103230 0x7f4b8c19a4e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4b8000c920 tx=0x7f4b8000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:19.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.930+0000 7f4b73fff640 1 -- 172.21.15.70:0/2899056558 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b80007c70 con 0x7f4b8c103230 2024-09-21T05:48:19.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.930+0000 7f4b73fff640 1 -- 172.21.15.70:0/2899056558 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f4b80007e10 con 0x7f4b8c103230 2024-09-21T05:48:19.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.930+0000 7f4b91081640 1 -- 172.21.15.70:0/2899056558 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b8c1a0680 con 0x7f4b8c103230 2024-09-21T05:48:19.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.930+0000 7f4b73fff640 1 -- 172.21.15.70:0/2899056558 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b800187b0 con 0x7f4b8c103230 2024-09-21T05:48:19.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.930+0000 7f4b91081640 1 -- 172.21.15.70:0/2899056558 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b8c1a6ea0 con 0x7f4b8c103230 2024-09-21T05:48:19.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.931+0000 7f4b91081640 1 -- 172.21.15.70:0/2899056558 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4b8c063ad0 con 0x7f4b8c103230 2024-09-21T05:48:19.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.932+0000 7f4b73fff640 1 -- 172.21.15.70:0/2899056558 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f4b8000f450 con 0x7f4b8c103230 2024-09-21T05:48:19.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.933+0000 7f4b73fff640 1 --2- 172.21.15.70:0/2899056558 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4b740b65d0 0x7f4b740b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:19.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.933+0000 7f4b8a59c640 1 --2- 172.21.15.70:0/2899056558 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4b740b65d0 0x7f4b740b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:19.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.933+0000 7f4b73fff640 1 -- 172.21.15.70:0/2899056558 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f4b800e7f60 con 0x7f4b8c103230 2024-09-21T05:48:19.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.933+0000 7f4b73fff640 1 --2- 172.21.15.70:0/2899056558 >> [v2:172.21.15.160:6808/3063220427,v1:172.21.15.160:6809/3063220427] conn(0x7f4b740c16e0 0x7f4b740c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:19.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.933+0000 7f4b73fff640 1 -- 172.21.15.70:0/2899056558 --> [v2:172.21.15.160:6808/3063220427,v1:172.21.15.160:6809/3063220427] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4b8001ee50 con 0x7f4b740c16e0 2024-09-21T05:48:19.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.933+0000 7f4b73fff640 1 -- 172.21.15.70:0/2899056558 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f4b800e83b0 con 0x7f4b8c103230 2024-09-21T05:48:19.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.933+0000 7f4b8a59c640 1 --2- 172.21.15.70:0/2899056558 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4b740b65d0 0x7f4b740b8ae0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c06b0d0 tx=0x7f4b7c005b80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:19.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.934+0000 7f4b8b59e640 1 --2- 172.21.15.70:0/2899056558 >> [v2:172.21.15.160:6808/3063220427,v1:172.21.15.160:6809/3063220427] conn(0x7f4b740c16e0 0x7f4b740c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:19.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.935+0000 7f4b8b59e640 1 --2- 172.21.15.70:0/2899056558 >> [v2:172.21.15.160:6808/3063220427,v1:172.21.15.160:6809/3063220427] conn(0x7f4b740c16e0 0x7f4b740c3bd0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:19.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.936+0000 7f4b73fff640 1 -- 172.21.15.70:0/2899056558 <== osd.5 v2:172.21.15.160:6808/3063220427 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4b8001ee50 con 0x7f4b740c16e0 2024-09-21T05:48:19.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.950+0000 7f4b91081640 1 -- 172.21.15.70:0/2899056558 --> [v2:172.21.15.160:6808/3063220427,v1:172.21.15.160:6809/3063220427] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4b8c063ed0 con 0x7f4b740c16e0 2024-09-21T05:48:19.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.950+0000 7f4b73fff640 1 -- 172.21.15.70:0/2899056558 <== osd.5 v2:172.21.15.160:6808/3063220427 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4b8c063ed0 con 0x7f4b740c16e0 2024-09-21T05:48:19.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.951+0000 7f4b91081640 1 -- 172.21.15.70:0/2899056558 >> [v2:172.21.15.160:6808/3063220427,v1:172.21.15.160:6809/3063220427] conn(0x7f4b740c16e0 msgr2=0x7f4b740c3bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:19.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.951+0000 7f4b91081640 1 --2- 172.21.15.70:0/2899056558 >> [v2:172.21.15.160:6808/3063220427,v1:172.21.15.160:6809/3063220427] conn(0x7f4b740c16e0 0x7f4b740c3bd0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:19.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.951+0000 7f4b91081640 1 -- 172.21.15.70:0/2899056558 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4b740b65d0 msgr2=0x7f4b740b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:19.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.951+0000 7f4b91081640 1 --2- 172.21.15.70:0/2899056558 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4b740b65d0 0x7f4b740b8ae0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c06b0d0 tx=0x7f4b7c005b80 comp rx=0 tx=0).stop 2024-09-21T05:48:19.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.951+0000 7f4b91081640 1 -- 172.21.15.70:0/2899056558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b8c103230 msgr2=0x7f4b8c19a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:19.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.951+0000 7f4b91081640 1 --2- 172.21.15.70:0/2899056558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b8c103230 0x7f4b8c19a4e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4b8000c920 tx=0x7f4b8000cde0 comp rx=0 tx=0).stop 2024-09-21T05:48:19.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.951+0000 7f4b8b59e640 1 -- 172.21.15.70:0/2899056558 reap_dead start 2024-09-21T05:48:19.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.951+0000 7f4b91081640 1 -- 172.21.15.70:0/2899056558 shutdown_connections 2024-09-21T05:48:19.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.951+0000 7f4b91081640 1 -- 172.21.15.70:0/2899056558 >> 172.21.15.70:0/2899056558 conn(0x7f4b8c079ec0 msgr2=0x7f4b8c1012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:19.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.951+0000 7f4b91081640 1 -- 172.21.15.70:0/2899056558 shutdown_connections 2024-09-21T05:48:19.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:19.951+0000 7f4b91081640 1 -- 172.21.15.70:0/2899056558 wait complete. 2024-09-21T05:48:20.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.475+0000 7f59df07b640 1 -- 172.21.15.70:0/2801880974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59d8108cf0 msgr2=0x7f59d810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:20.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.475+0000 7f59df07b640 1 --2- 172.21.15.70:0/2801880974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59d8108cf0 0x7f59d810f520 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f59c0009900 tx=0x7f59c002a410 comp rx=0 tx=0).stop 2024-09-21T05:48:20.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.475+0000 7f59df07b640 1 -- 172.21.15.70:0/2801880974 shutdown_connections 2024-09-21T05:48:20.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.475+0000 7f59df07b640 1 --2- 172.21.15.70:0/2801880974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59d8108cf0 0x7f59d810f520 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:20.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.475+0000 7f59df07b640 1 --2- 172.21.15.70:0/2801880974 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59d81083a0 0x7f59d81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:20.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.475+0000 7f59df07b640 1 --2- 172.21.15.70:0/2801880974 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59d8102a60 0x7f59d8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:20.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.475+0000 7f59df07b640 1 -- 172.21.15.70:0/2801880974 >> 172.21.15.70:0/2801880974 conn(0x7f59d8079730 msgr2=0x7f59d8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:20.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.475+0000 7f59df07b640 1 -- 172.21.15.70:0/2801880974 shutdown_connections 2024-09-21T05:48:20.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.475+0000 7f59df07b640 1 -- 172.21.15.70:0/2801880974 wait complete. 2024-09-21T05:48:20.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.476+0000 7f59df07b640 1 Processor -- start 2024-09-21T05:48:20.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.476+0000 7f59df07b640 1 -- start start 2024-09-21T05:48:20.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.476+0000 7f59df07b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59d8102a60 0x7f59d819b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:20.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.476+0000 7f59df07b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59d81083a0 0x7f59d819b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:20.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.476+0000 7f59df07b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59d8108cf0 0x7f59d819bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:20.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.476+0000 7f59df07b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f59d8112950 con 0x7f59d8108cf0 2024-09-21T05:48:20.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.476+0000 7f59df07b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f59d81127d0 con 0x7f59d81083a0 2024-09-21T05:48:20.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.476+0000 7f59df07b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f59d8112ad0 con 0x7f59d8102a60 2024-09-21T05:48:20.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.476+0000 7f59dd618640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59d8108cf0 0x7f59d819bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:20.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.476+0000 7f59dd618640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59d8108cf0 0x7f59d819bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51908/0 (socket says 172.21.15.70:51908) 2024-09-21T05:48:20.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.476+0000 7f59dd618640 1 -- 172.21.15.70:0/2891215813 learned_addr learned my addr 172.21.15.70:0/2891215813 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:20.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.476+0000 7f59d7fff640 1 --2- 172.21.15.70:0/2891215813 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59d81083a0 0x7f59d819b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:20.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.476+0000 7f59dd618640 1 -- 172.21.15.70:0/2891215813 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59d8102a60 msgr2=0x7f59d819b280 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T05:48:20.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.476+0000 7f59dd618640 1 --2- 172.21.15.70:0/2891215813 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59d8102a60 0x7f59d819b280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:20.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.476+0000 7f59dd618640 1 -- 172.21.15.70:0/2891215813 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59d81083a0 msgr2=0x7f59d819b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:20.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.476+0000 7f59dd618640 1 --2- 172.21.15.70:0/2891215813 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59d81083a0 0x7f59d819b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:20.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.476+0000 7f59dd618640 1 -- 172.21.15.70:0/2891215813 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d81a6540 con 0x7f59d8108cf0 2024-09-21T05:48:20.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.477+0000 7f59dd618640 1 --2- 172.21.15.70:0/2891215813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59d8108cf0 0x7f59d819bd00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f59c0009230 tx=0x7f59c0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:20.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.477+0000 7f59d5ffb640 1 -- 172.21.15.70:0/2891215813 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c003f030 con 0x7f59d8108cf0 2024-09-21T05:48:20.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.477+0000 7f59d5ffb640 1 -- 172.21.15.70:0/2891215813 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f59c0003aa0 con 0x7f59d8108cf0 2024-09-21T05:48:20.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.477+0000 7f59df07b640 1 -- 172.21.15.70:0/2891215813 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59d81a67d0 con 0x7f59d8108cf0 2024-09-21T05:48:20.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.477+0000 7f59d5ffb640 1 -- 172.21.15.70:0/2891215813 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c0035070 con 0x7f59d8108cf0 2024-09-21T05:48:20.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.477+0000 7f59df07b640 1 -- 172.21.15.70:0/2891215813 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59d81a6cb0 con 0x7f59d8108cf0 2024-09-21T05:48:20.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.478+0000 7f59df07b640 1 -- 172.21.15.70:0/2891215813 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f59d8063b50 con 0x7f59d8108cf0 2024-09-21T05:48:20.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.479+0000 7f59d5ffb640 1 -- 172.21.15.70:0/2891215813 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f59c0042030 con 0x7f59d8108cf0 2024-09-21T05:48:20.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.480+0000 7f59d5ffb640 1 --2- 172.21.15.70:0/2891215813 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f59c40b65a0 0x7f59c40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:20.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.480+0000 7f59dce17640 1 --2- 172.21.15.70:0/2891215813 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f59c40b65a0 0x7f59c40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:20.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.480+0000 7f59d5ffb640 1 -- 172.21.15.70:0/2891215813 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f59c0108460 con 0x7f59d8108cf0 2024-09-21T05:48:20.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.480+0000 7f59d5ffb640 1 --2- 172.21.15.70:0/2891215813 >> [v2:172.21.15.160:6824/2632369083,v1:172.21.15.160:6825/2632369083] conn(0x7f59c40c16b0 0x7f59c40c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:20.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.480+0000 7f59d5ffb640 1 -- 172.21.15.70:0/2891215813 --> [v2:172.21.15.160:6824/2632369083,v1:172.21.15.160:6825/2632369083] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f59c0009080 con 0x7f59c40c16b0 2024-09-21T05:48:20.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.480+0000 7f59d5ffb640 1 -- 172.21.15.70:0/2891215813 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f59c01088b0 con 0x7f59d8108cf0 2024-09-21T05:48:20.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.481+0000 7f59dce17640 1 --2- 172.21.15.70:0/2891215813 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f59c40b65a0 0x7f59c40b8ab0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f59d806b9e0 tx=0x7f59d000b370 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:20.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.481+0000 7f59d7fff640 1 --2- 172.21.15.70:0/2891215813 >> [v2:172.21.15.160:6824/2632369083,v1:172.21.15.160:6825/2632369083] conn(0x7f59c40c16b0 0x7f59c40c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:20.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.481+0000 7f59d7fff640 1 --2- 172.21.15.70:0/2891215813 >> [v2:172.21.15.160:6824/2632369083,v1:172.21.15.160:6825/2632369083] conn(0x7f59c40c16b0 0x7f59c40c3ba0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:20.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.482+0000 7f59d5ffb640 1 -- 172.21.15.70:0/2891215813 <== osd.11 v2:172.21.15.160:6824/2632369083 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f59c0009080 con 0x7f59c40c16b0 2024-09-21T05:48:20.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.496+0000 7f59df07b640 1 -- 172.21.15.70:0/2891215813 --> [v2:172.21.15.160:6824/2632369083,v1:172.21.15.160:6825/2632369083] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f59d8063f50 con 0x7f59c40c16b0 2024-09-21T05:48:20.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.497+0000 7f59d5ffb640 1 -- 172.21.15.70:0/2891215813 <== osd.11 v2:172.21.15.160:6824/2632369083 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f59d8063f50 con 0x7f59c40c16b0 2024-09-21T05:48:20.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.497+0000 7f59df07b640 1 -- 172.21.15.70:0/2891215813 >> [v2:172.21.15.160:6824/2632369083,v1:172.21.15.160:6825/2632369083] conn(0x7f59c40c16b0 msgr2=0x7f59c40c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:20.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.497+0000 7f59df07b640 1 --2- 172.21.15.70:0/2891215813 >> [v2:172.21.15.160:6824/2632369083,v1:172.21.15.160:6825/2632369083] conn(0x7f59c40c16b0 0x7f59c40c3ba0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:20.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.497+0000 7f59df07b640 1 -- 172.21.15.70:0/2891215813 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f59c40b65a0 msgr2=0x7f59c40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:20.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.497+0000 7f59df07b640 1 --2- 172.21.15.70:0/2891215813 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f59c40b65a0 0x7f59c40b8ab0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f59d806b9e0 tx=0x7f59d000b370 comp rx=0 tx=0).stop 2024-09-21T05:48:20.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.497+0000 7f59df07b640 1 -- 172.21.15.70:0/2891215813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59d8108cf0 msgr2=0x7f59d819bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:20.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.497+0000 7f59df07b640 1 --2- 172.21.15.70:0/2891215813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59d8108cf0 0x7f59d819bd00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f59c0009230 tx=0x7f59c0004270 comp rx=0 tx=0).stop 2024-09-21T05:48:20.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.497+0000 7f59dd618640 1 -- 172.21.15.70:0/2891215813 reap_dead start 2024-09-21T05:48:20.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.497+0000 7f59df07b640 1 -- 172.21.15.70:0/2891215813 shutdown_connections 2024-09-21T05:48:20.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.497+0000 7f59df07b640 1 -- 172.21.15.70:0/2891215813 >> 172.21.15.70:0/2891215813 conn(0x7f59d8079730 msgr2=0x7f59d8104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:20.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.498+0000 7f59df07b640 1 -- 172.21.15.70:0/2891215813 shutdown_connections 2024-09-21T05:48:20.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:20.498+0000 7f59df07b640 1 -- 172.21.15.70:0/2891215813 wait complete. 2024-09-21T05:48:21.609 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:21 smithi070 ceph-mon[30981]: pgmap v335: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-21T05:48:21.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.702+0000 7feb559cc640 1 -- 172.21.15.70:0/2027112575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb50109570 msgr2=0x7feb50109980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:21.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.702+0000 7feb559cc640 1 --2- 172.21.15.70:0/2027112575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb50109570 0x7feb50109980 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7feb38009900 tx=0x7feb3802a410 comp rx=0 tx=0).stop 2024-09-21T05:48:21.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.702+0000 7feb559cc640 1 -- 172.21.15.70:0/2027112575 shutdown_connections 2024-09-21T05:48:21.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.702+0000 7feb559cc640 1 --2- 172.21.15.70:0/2027112575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb50109ec0 0x7feb501106f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:21.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.702+0000 7feb559cc640 1 --2- 172.21.15.70:0/2027112575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb50109570 0x7feb50109980 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:21.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.702+0000 7feb559cc640 1 --2- 172.21.15.70:0/2027112575 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb50103c30 0x7feb50104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:21.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.702+0000 7feb559cc640 1 -- 172.21.15.70:0/2027112575 >> 172.21.15.70:0/2027112575 conn(0x7feb5007b8d0 msgr2=0x7feb5007bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:21.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.702+0000 7feb559cc640 1 -- 172.21.15.70:0/2027112575 shutdown_connections 2024-09-21T05:48:21.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.702+0000 7feb559cc640 1 -- 172.21.15.70:0/2027112575 wait complete. 2024-09-21T05:48:21.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.703+0000 7feb559cc640 1 Processor -- start 2024-09-21T05:48:21.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.703+0000 7feb559cc640 1 -- start start 2024-09-21T05:48:21.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.703+0000 7feb559cc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb50103c30 0x7feb5019a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:21.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.703+0000 7feb559cc640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb50109570 0x7feb5019aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:21.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.703+0000 7feb559cc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb50109ec0 0x7feb5019fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:21.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.703+0000 7feb559cc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7feb50113b10 con 0x7feb50109ec0 2024-09-21T05:48:21.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.703+0000 7feb559cc640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7feb50113990 con 0x7feb50103c30 2024-09-21T05:48:21.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.703+0000 7feb559cc640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7feb50113c90 con 0x7feb50109570 2024-09-21T05:48:21.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.703+0000 7feb4f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb50109ec0 0x7feb5019fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:21.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.703+0000 7feb4f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb50109ec0 0x7feb5019fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51942/0 (socket says 172.21.15.70:51942) 2024-09-21T05:48:21.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.703+0000 7feb4f7fe640 1 -- 172.21.15.70:0/2199879309 learned_addr learned my addr 172.21.15.70:0/2199879309 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:21.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.704+0000 7feb4effd640 1 --2- 172.21.15.70:0/2199879309 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb50103c30 0x7feb5019a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:21.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.704+0000 7feb47fff640 1 --2- 172.21.15.70:0/2199879309 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb50109570 0x7feb5019aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:21.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.704+0000 7feb4f7fe640 1 -- 172.21.15.70:0/2199879309 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb50109570 msgr2=0x7feb5019aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:21.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.704+0000 7feb4f7fe640 1 --2- 172.21.15.70:0/2199879309 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb50109570 0x7feb5019aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:21.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.704+0000 7feb4f7fe640 1 -- 172.21.15.70:0/2199879309 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb50103c30 msgr2=0x7feb5019a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:21.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.704+0000 7feb4f7fe640 1 --2- 172.21.15.70:0/2199879309 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb50103c30 0x7feb5019a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:21.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.704+0000 7feb4f7fe640 1 -- 172.21.15.70:0/2199879309 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb501a0470 con 0x7feb50109ec0 2024-09-21T05:48:21.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.704+0000 7feb4f7fe640 1 --2- 172.21.15.70:0/2199879309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb50109ec0 0x7feb5019fd40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7feb4800b990 tx=0x7feb4800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:21.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.704+0000 7feb549ca640 1 -- 172.21.15.70:0/2199879309 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb48019070 con 0x7feb50109ec0 2024-09-21T05:48:21.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.704+0000 7feb549ca640 1 -- 172.21.15.70:0/2199879309 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7feb4800cba0 con 0x7feb50109ec0 2024-09-21T05:48:21.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.705+0000 7feb549ca640 1 -- 172.21.15.70:0/2199879309 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb480075d0 con 0x7feb50109ec0 2024-09-21T05:48:21.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.705+0000 7feb559cc640 1 -- 172.21.15.70:0/2199879309 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb501a0760 con 0x7feb50109ec0 2024-09-21T05:48:21.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.705+0000 7feb559cc640 1 -- 172.21.15.70:0/2199879309 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb501a6ec0 con 0x7feb50109ec0 2024-09-21T05:48:21.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.706+0000 7feb559cc640 1 -- 172.21.15.70:0/2199879309 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feb50063a90 con 0x7feb50109ec0 2024-09-21T05:48:21.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.707+0000 7feb549ca640 1 -- 172.21.15.70:0/2199879309 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7feb48014440 con 0x7feb50109ec0 2024-09-21T05:48:21.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.708+0000 7feb549ca640 1 --2- 172.21.15.70:0/2199879309 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7feb3c0b64f0 0x7feb3c0b8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:21.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.708+0000 7feb4effd640 1 --2- 172.21.15.70:0/2199879309 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7feb3c0b64f0 0x7feb3c0b8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:21.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.708+0000 7feb549ca640 1 -- 172.21.15.70:0/2199879309 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7feb480e7680 con 0x7feb50109ec0 2024-09-21T05:48:21.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.708+0000 7feb549ca640 1 --2- 172.21.15.70:0/2199879309 >> [v2:172.21.15.116:6816/2034132009,v1:172.21.15.116:6817/2034132009] conn(0x7feb3c0c1600 0x7feb3c0c3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:21.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.708+0000 7feb549ca640 1 -- 172.21.15.70:0/2199879309 --> [v2:172.21.15.116:6816/2034132009,v1:172.21.15.116:6817/2034132009] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feb48018ec0 con 0x7feb3c0c1600 2024-09-21T05:48:21.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.708+0000 7feb549ca640 1 -- 172.21.15.70:0/2199879309 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7feb480e7ad0 con 0x7feb50109ec0 2024-09-21T05:48:21.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.709+0000 7feb4effd640 1 --2- 172.21.15.70:0/2199879309 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7feb3c0b64f0 0x7feb3c0b8a00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7feb400058c0 tx=0x7feb4000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:21.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.709+0000 7feb47fff640 1 --2- 172.21.15.70:0/2199879309 >> [v2:172.21.15.116:6816/2034132009,v1:172.21.15.116:6817/2034132009] conn(0x7feb3c0c1600 0x7feb3c0c3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:21.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.709+0000 7feb47fff640 1 --2- 172.21.15.70:0/2199879309 >> [v2:172.21.15.116:6816/2034132009,v1:172.21.15.116:6817/2034132009] conn(0x7feb3c0c1600 0x7feb3c0c3af0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:21.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.710+0000 7feb549ca640 1 -- 172.21.15.70:0/2199879309 <== osd.7 v2:172.21.15.116:6816/2034132009 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feb48018ec0 con 0x7feb3c0c1600 2024-09-21T05:48:21.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.723+0000 7feb559cc640 1 -- 172.21.15.70:0/2199879309 --> [v2:172.21.15.116:6816/2034132009,v1:172.21.15.116:6817/2034132009] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7feb50063f10 con 0x7feb3c0c1600 2024-09-21T05:48:21.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.724+0000 7feb549ca640 1 -- 172.21.15.70:0/2199879309 <== osd.7 v2:172.21.15.116:6816/2034132009 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7feb50063f10 con 0x7feb3c0c1600 2024-09-21T05:48:21.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.724+0000 7feb559cc640 1 -- 172.21.15.70:0/2199879309 >> [v2:172.21.15.116:6816/2034132009,v1:172.21.15.116:6817/2034132009] conn(0x7feb3c0c1600 msgr2=0x7feb3c0c3af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:21.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.724+0000 7feb559cc640 1 --2- 172.21.15.70:0/2199879309 >> [v2:172.21.15.116:6816/2034132009,v1:172.21.15.116:6817/2034132009] conn(0x7feb3c0c1600 0x7feb3c0c3af0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:21.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.724+0000 7feb559cc640 1 -- 172.21.15.70:0/2199879309 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7feb3c0b64f0 msgr2=0x7feb3c0b8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:21.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.724+0000 7feb559cc640 1 --2- 172.21.15.70:0/2199879309 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7feb3c0b64f0 0x7feb3c0b8a00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7feb400058c0 tx=0x7feb4000a2d0 comp rx=0 tx=0).stop 2024-09-21T05:48:21.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.724+0000 7feb559cc640 1 -- 172.21.15.70:0/2199879309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb50109ec0 msgr2=0x7feb5019fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:21.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.724+0000 7feb559cc640 1 --2- 172.21.15.70:0/2199879309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb50109ec0 0x7feb5019fd40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7feb4800b990 tx=0x7feb4800be50 comp rx=0 tx=0).stop 2024-09-21T05:48:21.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.724+0000 7feb4f7fe640 1 -- 172.21.15.70:0/2199879309 reap_dead start 2024-09-21T05:48:21.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.724+0000 7feb559cc640 1 -- 172.21.15.70:0/2199879309 shutdown_connections 2024-09-21T05:48:21.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.724+0000 7feb559cc640 1 -- 172.21.15.70:0/2199879309 >> 172.21.15.70:0/2199879309 conn(0x7feb5007b8d0 msgr2=0x7feb501055e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:21.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.725+0000 7feb559cc640 1 -- 172.21.15.70:0/2199879309 shutdown_connections 2024-09-21T05:48:21.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.725+0000 7feb559cc640 1 -- 172.21.15.70:0/2199879309 wait complete. 2024-09-21T05:48:21.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:21 smithi116 ceph-mon[34332]: pgmap v335: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-21T05:48:21.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:21 smithi160 ceph-mon[33979]: pgmap v335: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-21T05:48:22.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.219+0000 7fa4d379e640 1 -- 172.21.15.70:0/2759525818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4cc108d10 msgr2=0x7fa4cc10f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:22.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.219+0000 7fa4d379e640 1 --2- 172.21.15.70:0/2759525818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4cc108d10 0x7fa4cc10f540 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009ca0 tx=0x7fa4c402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:48:22.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.219+0000 7fa4d379e640 1 -- 172.21.15.70:0/2759525818 shutdown_connections 2024-09-21T05:48:22.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.219+0000 7fa4d379e640 1 --2- 172.21.15.70:0/2759525818 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4cc1083c0 0x7fa4cc1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:22.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.219+0000 7fa4d379e640 1 --2- 172.21.15.70:0/2759525818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4cc108d10 0x7fa4cc10f540 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:22.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.219+0000 7fa4d379e640 1 --2- 172.21.15.70:0/2759525818 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4cc102a80 0x7fa4cc102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:22.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.219+0000 7fa4d379e640 1 -- 172.21.15.70:0/2759525818 >> 172.21.15.70:0/2759525818 conn(0x7fa4cc079740 msgr2=0x7fa4cc079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:22.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.219+0000 7fa4d379e640 1 -- 172.21.15.70:0/2759525818 shutdown_connections 2024-09-21T05:48:22.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.219+0000 7fa4d379e640 1 -- 172.21.15.70:0/2759525818 wait complete. 2024-09-21T05:48:22.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.219+0000 7fa4d379e640 1 Processor -- start 2024-09-21T05:48:22.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.219+0000 7fa4d379e640 1 -- start start 2024-09-21T05:48:22.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.220+0000 7fa4d379e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4cc102a80 0x7fa4cc199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:22.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.220+0000 7fa4d379e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4cc1083c0 0x7fa4cc1998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:22.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.220+0000 7fa4d379e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4cc108d10 0x7fa4cc19eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:22.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.220+0000 7fa4d379e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc112970 con 0x7fa4cc108d10 2024-09-21T05:48:22.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.220+0000 7fa4d379e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc1127f0 con 0x7fa4cc102a80 2024-09-21T05:48:22.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.220+0000 7fa4d379e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc112af0 con 0x7fa4cc1083c0 2024-09-21T05:48:22.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.220+0000 7fa4d1d3b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4cc108d10 0x7fa4cc19eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:22.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.220+0000 7fa4d1d3b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4cc108d10 0x7fa4cc19eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51956/0 (socket says 172.21.15.70:51956) 2024-09-21T05:48:22.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.220+0000 7fa4d1d3b640 1 -- 172.21.15.70:0/1606615754 learned_addr learned my addr 172.21.15.70:0/1606615754 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:22.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.220+0000 7fa4d0d39640 1 --2- 172.21.15.70:0/1606615754 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4cc1083c0 0x7fa4cc1998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:22.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.220+0000 7fa4d153a640 1 --2- 172.21.15.70:0/1606615754 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4cc102a80 0x7fa4cc199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:22.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.220+0000 7fa4d1d3b640 1 -- 172.21.15.70:0/1606615754 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4cc1083c0 msgr2=0x7fa4cc1998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:22.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.220+0000 7fa4d1d3b640 1 --2- 172.21.15.70:0/1606615754 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4cc1083c0 0x7fa4cc1998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:22.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.220+0000 7fa4d1d3b640 1 -- 172.21.15.70:0/1606615754 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4cc102a80 msgr2=0x7fa4cc199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:22.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.220+0000 7fa4d1d3b640 1 --2- 172.21.15.70:0/1606615754 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4cc102a80 0x7fa4cc199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:22.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.220+0000 7fa4d1d3b640 1 -- 172.21.15.70:0/1606615754 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4cc19f2b0 con 0x7fa4cc108d10 2024-09-21T05:48:22.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.220+0000 7fa4d153a640 1 --2- 172.21.15.70:0/1606615754 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4cc102a80 0x7fa4cc199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:48:22.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.220+0000 7fa4d1d3b640 1 --2- 172.21.15.70:0/1606615754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4cc108d10 0x7fa4cc19eb80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40097b0 tx=0x7fa4c4032fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:22.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.221+0000 7fa4c27fc640 1 -- 172.21.15.70:0/1606615754 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4003bf0 con 0x7fa4cc108d10 2024-09-21T05:48:22.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.221+0000 7fa4d379e640 1 -- 172.21.15.70:0/1606615754 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4cc19f540 con 0x7fa4cc108d10 2024-09-21T05:48:22.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.221+0000 7fa4c27fc640 1 -- 172.21.15.70:0/1606615754 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fa4c4003d90 con 0x7fa4cc108d10 2024-09-21T05:48:22.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.221+0000 7fa4c27fc640 1 -- 172.21.15.70:0/1606615754 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4030b20 con 0x7fa4cc108d10 2024-09-21T05:48:22.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.221+0000 7fa4d379e640 1 -- 172.21.15.70:0/1606615754 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4cc06bb40 con 0x7fa4cc108d10 2024-09-21T05:48:22.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.222+0000 7fa4d379e640 1 -- 172.21.15.70:0/1606615754 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa4cc06c170 con 0x7fa4cc108d10 2024-09-21T05:48:22.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.223+0000 7fa4c27fc640 1 -- 172.21.15.70:0/1606615754 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fa4c4030ce0 con 0x7fa4cc108d10 2024-09-21T05:48:22.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.224+0000 7fa4c27fc640 1 --2- 172.21.15.70:0/1606615754 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa4b80b87b0 0x7fa4b80bacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:22.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.224+0000 7fa4d153a640 1 --2- 172.21.15.70:0/1606615754 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa4b80b87b0 0x7fa4b80bacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:22.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.224+0000 7fa4c27fc640 1 -- 172.21.15.70:0/1606615754 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7fa4c4108cf0 con 0x7fa4cc108d10 2024-09-21T05:48:22.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.224+0000 7fa4c27fc640 1 --2- 172.21.15.70:0/1606615754 >> [v2:172.21.15.70:6810/3849416072,v1:172.21.15.70:6811/3849416072] conn(0x7fa4b80c38c0 0x7fa4b80c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:22.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.224+0000 7fa4c27fc640 1 -- 172.21.15.70:0/1606615754 --> [v2:172.21.15.70:6810/3849416072,v1:172.21.15.70:6811/3849416072] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa4b80c6480 con 0x7fa4b80c38c0 2024-09-21T05:48:22.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.224+0000 7fa4c27fc640 1 -- 172.21.15.70:0/1606615754 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fa4c4109140 con 0x7fa4cc108d10 2024-09-21T05:48:22.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.224+0000 7fa4d0d39640 1 --2- 172.21.15.70:0/1606615754 >> [v2:172.21.15.70:6810/3849416072,v1:172.21.15.70:6811/3849416072] conn(0x7fa4b80c38c0 0x7fa4b80c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:22.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.225+0000 7fa4d153a640 1 --2- 172.21.15.70:0/1606615754 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa4b80b87b0 0x7fa4b80bacc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009fc0 tx=0x7fa4c8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:22.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.225+0000 7fa4d0d39640 1 --2- 172.21.15.70:0/1606615754 >> [v2:172.21.15.70:6810/3849416072,v1:172.21.15.70:6811/3849416072] conn(0x7fa4b80c38c0 0x7fa4b80c5db0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:22.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.225+0000 7fa4c27fc640 1 -- 172.21.15.70:0/1606615754 <== osd.3 v2:172.21.15.70:6810/3849416072 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa4b80c6480 con 0x7fa4b80c38c0 2024-09-21T05:48:22.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.239+0000 7fa4d379e640 1 -- 172.21.15.70:0/1606615754 --> [v2:172.21.15.70:6810/3849416072,v1:172.21.15.70:6811/3849416072] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa4cc06c5f0 con 0x7fa4b80c38c0 2024-09-21T05:48:22.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.240+0000 7fa4c27fc640 1 -- 172.21.15.70:0/1606615754 <== osd.3 v2:172.21.15.70:6810/3849416072 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa4cc06c5f0 con 0x7fa4b80c38c0 2024-09-21T05:48:22.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.240+0000 7fa4d379e640 1 -- 172.21.15.70:0/1606615754 >> [v2:172.21.15.70:6810/3849416072,v1:172.21.15.70:6811/3849416072] conn(0x7fa4b80c38c0 msgr2=0x7fa4b80c5db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:22.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.240+0000 7fa4d379e640 1 --2- 172.21.15.70:0/1606615754 >> [v2:172.21.15.70:6810/3849416072,v1:172.21.15.70:6811/3849416072] conn(0x7fa4b80c38c0 0x7fa4b80c5db0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:22.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.240+0000 7fa4d379e640 1 -- 172.21.15.70:0/1606615754 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa4b80b87b0 msgr2=0x7fa4b80bacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:22.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.240+0000 7fa4d379e640 1 --2- 172.21.15.70:0/1606615754 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa4b80b87b0 0x7fa4b80bacc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009fc0 tx=0x7fa4c8005f90 comp rx=0 tx=0).stop 2024-09-21T05:48:22.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.240+0000 7fa4d379e640 1 -- 172.21.15.70:0/1606615754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4cc108d10 msgr2=0x7fa4cc19eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:22.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.240+0000 7fa4d379e640 1 --2- 172.21.15.70:0/1606615754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4cc108d10 0x7fa4cc19eb80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40097b0 tx=0x7fa4c4032fe0 comp rx=0 tx=0).stop 2024-09-21T05:48:22.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.240+0000 7fa4d1d3b640 1 -- 172.21.15.70:0/1606615754 reap_dead start 2024-09-21T05:48:22.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.240+0000 7fa4d379e640 1 -- 172.21.15.70:0/1606615754 shutdown_connections 2024-09-21T05:48:22.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.240+0000 7fa4d379e640 1 -- 172.21.15.70:0/1606615754 >> 172.21.15.70:0/1606615754 conn(0x7fa4cc079740 msgr2=0x7fa4cc1043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:22.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.240+0000 7fa4d379e640 1 -- 172.21.15.70:0/1606615754 shutdown_connections 2024-09-21T05:48:22.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:22.240+0000 7fa4d379e640 1 -- 172.21.15.70:0/1606615754 wait complete. 2024-09-21T05:48:22.793 INFO:teuthology.orchestra.run.smithi070.stdout:296352743452 2024-09-21T05:48:22.794 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.11 2024-09-21T05:48:22.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.615+0000 7f9574a23640 1 -- 172.21.15.70:0/887506070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9570105280 msgr2=0x7f957010d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:22.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.615+0000 7f9574a23640 1 --2- 172.21.15.70:0/887506070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9570105280 0x7f957010d910 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9564009900 tx=0x7f956402a410 comp rx=0 tx=0).stop 2024-09-21T05:48:22.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.615+0000 7f9574a23640 1 -- 172.21.15.70:0/887506070 shutdown_connections 2024-09-21T05:48:22.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.615+0000 7f9574a23640 1 --2- 172.21.15.70:0/887506070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f957010de50 0x7f9570110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:22.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.615+0000 7f9574a23640 1 --2- 172.21.15.70:0/887506070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9570105280 0x7f957010d910 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:22.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.615+0000 7f9574a23640 1 --2- 172.21.15.70:0/887506070 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95701048a0 0x7f9570104cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:22.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.615+0000 7f9574a23640 1 -- 172.21.15.70:0/887506070 >> 172.21.15.70:0/887506070 conn(0x7f9570079790 msgr2=0x7f9570079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:22.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.616+0000 7f9574a23640 1 -- 172.21.15.70:0/887506070 shutdown_connections 2024-09-21T05:48:22.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.616+0000 7f9574a23640 1 -- 172.21.15.70:0/887506070 wait complete. 2024-09-21T05:48:22.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.616+0000 7f9574a23640 1 Processor -- start 2024-09-21T05:48:22.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.617+0000 7f9574a23640 1 -- start start 2024-09-21T05:48:22.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.617+0000 7f9574a23640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95701048a0 0x7f957019a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:22.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.617+0000 7f9574a23640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9570105280 0x7f957019aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:22.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.617+0000 7f9574a23640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f957010de50 0x7f957019fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:22.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.617+0000 7f9574a23640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9570113a60 con 0x7f957010de50 2024-09-21T05:48:22.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.617+0000 7f9574a23640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f95701138e0 con 0x7f95701048a0 2024-09-21T05:48:22.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.617+0000 7f9574a23640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9570113be0 con 0x7f9570105280 2024-09-21T05:48:22.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.617+0000 7f956ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f957010de50 0x7f957019fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:22.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.617+0000 7f956ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f957010de50 0x7f957019fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51924/0 (socket says 172.21.15.70:51924) 2024-09-21T05:48:22.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.617+0000 7f956ed9d640 1 -- 172.21.15.70:0/1418926561 learned_addr learned my addr 172.21.15.70:0/1418926561 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:22.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.617+0000 7f956e59c640 1 --2- 172.21.15.70:0/1418926561 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95701048a0 0x7f957019a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:22.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.617+0000 7f956ed9d640 1 -- 172.21.15.70:0/1418926561 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9570105280 msgr2=0x7f957019aa90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T05:48:22.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.617+0000 7f956ed9d640 1 --2- 172.21.15.70:0/1418926561 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9570105280 0x7f957019aa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:22.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.617+0000 7f956ed9d640 1 -- 172.21.15.70:0/1418926561 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95701048a0 msgr2=0x7f957019a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:22.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.617+0000 7f956ed9d640 1 --2- 172.21.15.70:0/1418926561 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95701048a0 0x7f957019a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:22.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.617+0000 7f956ed9d640 1 -- 172.21.15.70:0/1418926561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95701a0460 con 0x7f957010de50 2024-09-21T05:48:22.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.618+0000 7f956ed9d640 1 --2- 172.21.15.70:0/1418926561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f957010de50 0x7f957019fd30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f956800eaa0 tx=0x7f956800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:22.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.618+0000 7f955f7fe640 1 -- 172.21.15.70:0/1418926561 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f956800cdb0 con 0x7f957010de50 2024-09-21T05:48:22.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.618+0000 7f9574a23640 1 -- 172.21.15.70:0/1418926561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95701a0750 con 0x7f957010de50 2024-09-21T05:48:22.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.618+0000 7f955f7fe640 1 -- 172.21.15.70:0/1418926561 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f9568005020 con 0x7f957010de50 2024-09-21T05:48:22.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.619+0000 7f955f7fe640 1 -- 172.21.15.70:0/1418926561 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95680116d0 con 0x7f957010de50 2024-09-21T05:48:22.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.619+0000 7f9574a23640 1 -- 172.21.15.70:0/1418926561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95701a6eb0 con 0x7f957010de50 2024-09-21T05:48:22.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.619+0000 7f9574a23640 1 -- 172.21.15.70:0/1418926561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9570063b50 con 0x7f957010de50 2024-09-21T05:48:22.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.621+0000 7f955f7fe640 1 -- 172.21.15.70:0/1418926561 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f9568004b20 con 0x7f957010de50 2024-09-21T05:48:22.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.621+0000 7f955f7fe640 1 --2- 172.21.15.70:0/1418926561 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f95580b65a0 0x7f95580b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:22.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.621+0000 7f956e59c640 1 --2- 172.21.15.70:0/1418926561 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f95580b65a0 0x7f95580b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:22.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.621+0000 7f955f7fe640 1 -- 172.21.15.70:0/1418926561 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f95680e7900 con 0x7f957010de50 2024-09-21T05:48:22.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.622+0000 7f955f7fe640 1 --2- 172.21.15.70:0/1418926561 >> [v2:172.21.15.70:6802/1667051447,v1:172.21.15.70:6803/1667051447] conn(0x7f95580c1630 0x7f95580c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:22.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.622+0000 7f955f7fe640 1 -- 172.21.15.70:0/1418926561 --> [v2:172.21.15.70:6802/1667051447,v1:172.21.15.70:6803/1667051447] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9568017e80 con 0x7f95580c1630 2024-09-21T05:48:22.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.622+0000 7f955f7fe640 1 -- 172.21.15.70:0/1418926561 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f95680ec2c0 con 0x7f957010de50 2024-09-21T05:48:22.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.622+0000 7f956dd9b640 1 --2- 172.21.15.70:0/1418926561 >> [v2:172.21.15.70:6802/1667051447,v1:172.21.15.70:6803/1667051447] conn(0x7f95580c1630 0x7f95580c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:22.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.622+0000 7f956e59c640 1 --2- 172.21.15.70:0/1418926561 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f95580b65a0 0x7f95580b8ab0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9560009bd0 tx=0x7f9560005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:22.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.622+0000 7f956dd9b640 1 --2- 172.21.15.70:0/1418926561 >> [v2:172.21.15.70:6802/1667051447,v1:172.21.15.70:6803/1667051447] conn(0x7f95580c1630 0x7f95580c3b20 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:22.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.623+0000 7f955f7fe640 1 -- 172.21.15.70:0/1418926561 <== osd.0 v2:172.21.15.70:6802/1667051447 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9568017e80 con 0x7f95580c1630 2024-09-21T05:48:22.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.637+0000 7f9574a23640 1 -- 172.21.15.70:0/1418926561 --> [v2:172.21.15.70:6802/1667051447,v1:172.21.15.70:6803/1667051447] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9570063f80 con 0x7f95580c1630 2024-09-21T05:48:22.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.637+0000 7f955f7fe640 1 -- 172.21.15.70:0/1418926561 <== osd.0 v2:172.21.15.70:6802/1667051447 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9570063f80 con 0x7f95580c1630 2024-09-21T05:48:22.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.637+0000 7f9574a23640 1 -- 172.21.15.70:0/1418926561 >> [v2:172.21.15.70:6802/1667051447,v1:172.21.15.70:6803/1667051447] conn(0x7f95580c1630 msgr2=0x7f95580c3b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:22.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.638+0000 7f9574a23640 1 --2- 172.21.15.70:0/1418926561 >> [v2:172.21.15.70:6802/1667051447,v1:172.21.15.70:6803/1667051447] conn(0x7f95580c1630 0x7f95580c3b20 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:22.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.638+0000 7f9574a23640 1 -- 172.21.15.70:0/1418926561 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f95580b65a0 msgr2=0x7f95580b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:22.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.638+0000 7f9574a23640 1 --2- 172.21.15.70:0/1418926561 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f95580b65a0 0x7f95580b8ab0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9560009bd0 tx=0x7f9560005f90 comp rx=0 tx=0).stop 2024-09-21T05:48:22.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.638+0000 7f9574a23640 1 -- 172.21.15.70:0/1418926561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f957010de50 msgr2=0x7f957019fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:22.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.638+0000 7f9574a23640 1 --2- 172.21.15.70:0/1418926561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f957010de50 0x7f957019fd30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f956800eaa0 tx=0x7f956800ef60 comp rx=0 tx=0).stop 2024-09-21T05:48:22.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.638+0000 7f956ed9d640 1 -- 172.21.15.70:0/1418926561 reap_dead start 2024-09-21T05:48:22.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.638+0000 7f9574a23640 1 -- 172.21.15.70:0/1418926561 shutdown_connections 2024-09-21T05:48:22.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.638+0000 7f9574a23640 1 -- 172.21.15.70:0/1418926561 >> 172.21.15.70:0/1418926561 conn(0x7f9570079790 msgr2=0x7f95700ff710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:22.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.638+0000 7f9574a23640 1 -- 172.21.15.70:0/1418926561 shutdown_connections 2024-09-21T05:48:22.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.638+0000 7f9574a23640 1 -- 172.21.15.70:0/1418926561 wait complete. 2024-09-21T05:48:23.631 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:23 smithi070 ceph-mon[30981]: pgmap v336: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-21T05:48:23.659 INFO:teuthology.orchestra.run.smithi070.stdout:73014444105 2024-09-21T05:48:23.659 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T05:48:23.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:23 smithi116 ceph-mon[34332]: pgmap v336: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-21T05:48:23.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:23 smithi160 ceph-mon[33979]: pgmap v336: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-21T05:48:24.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.215+0000 7f479b975640 1 -- 172.21.15.70:0/2252901560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47941051c0 msgr2=0x7f47941055d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:24.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.215+0000 7f479b975640 1 --2- 172.21.15.70:0/2252901560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47941051c0 0x7f47941055d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4784009900 tx=0x7f478402a410 comp rx=0 tx=0).stop 2024-09-21T05:48:24.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.215+0000 7f479b975640 1 -- 172.21.15.70:0/2252901560 shutdown_connections 2024-09-21T05:48:24.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.215+0000 7f479b975640 1 --2- 172.21.15.70:0/2252901560 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4794105b10 0x7f479410f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:24.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.215+0000 7f479b975640 1 --2- 172.21.15.70:0/2252901560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47941051c0 0x7f47941055d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:24.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.215+0000 7f479b975640 1 --2- 172.21.15.70:0/2252901560 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47941031b0 0x7f47941035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:24.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.215+0000 7f479b975640 1 -- 172.21.15.70:0/2252901560 >> 172.21.15.70:0/2252901560 conn(0x7f4794079f90 msgr2=0x7f479407a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:24.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.215+0000 7f479b975640 1 -- 172.21.15.70:0/2252901560 shutdown_connections 2024-09-21T05:48:24.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.215+0000 7f479b975640 1 -- 172.21.15.70:0/2252901560 wait complete. 2024-09-21T05:48:24.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.215+0000 7f479b975640 1 Processor -- start 2024-09-21T05:48:24.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.216+0000 7f479b975640 1 -- start start 2024-09-21T05:48:24.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.216+0000 7f479b975640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47941031b0 0x7f4794199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:24.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.216+0000 7f479b975640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47941051c0 0x7f47941999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:24.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.216+0000 7f479b975640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4794105b10 0x7f479419ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:24.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.216+0000 7f479b975640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4794112a20 con 0x7f47941051c0 2024-09-21T05:48:24.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.216+0000 7f479b975640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f47941128a0 con 0x7f47941031b0 2024-09-21T05:48:24.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.216+0000 7f479b975640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4794112ba0 con 0x7f4794105b10 2024-09-21T05:48:24.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.216+0000 7f4798f10640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47941051c0 0x7f47941999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:24.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.216+0000 7f4798f10640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47941051c0 0x7f47941999d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51968/0 (socket says 172.21.15.70:51968) 2024-09-21T05:48:24.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.216+0000 7f4798f10640 1 -- 172.21.15.70:0/1205682717 learned_addr learned my addr 172.21.15.70:0/1205682717 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:24.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.216+0000 7f4799f12640 1 --2- 172.21.15.70:0/1205682717 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4794105b10 0x7f479419ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:24.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.216+0000 7f4799711640 1 --2- 172.21.15.70:0/1205682717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47941031b0 0x7f4794199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:24.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.216+0000 7f4798f10640 1 -- 172.21.15.70:0/1205682717 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4794105b10 msgr2=0x7f479419ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:24.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.216+0000 7f4798f10640 1 --2- 172.21.15.70:0/1205682717 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4794105b10 0x7f479419ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:24.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.216+0000 7f4798f10640 1 -- 172.21.15.70:0/1205682717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47941031b0 msgr2=0x7f4794199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:24.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.216+0000 7f4798f10640 1 --2- 172.21.15.70:0/1205682717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47941031b0 0x7f4794199430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:24.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.216+0000 7f4798f10640 1 -- 172.21.15.70:0/1205682717 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f479419f3a0 con 0x7f47941051c0 2024-09-21T05:48:24.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.216+0000 7f4799f12640 1 --2- 172.21.15.70:0/1205682717 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4794105b10 0x7f479419ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:48:24.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.216+0000 7f4798f10640 1 --2- 172.21.15.70:0/1205682717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47941051c0 0x7f47941999d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f478402a930 tx=0x7f4784004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:24.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.217+0000 7f478a7fc640 1 -- 172.21.15.70:0/1205682717 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f478403f030 con 0x7f47941051c0 2024-09-21T05:48:24.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.217+0000 7f479b975640 1 -- 172.21.15.70:0/1205682717 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f479419f630 con 0x7f47941051c0 2024-09-21T05:48:24.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.217+0000 7f478a7fc640 1 -- 172.21.15.70:0/1205682717 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f4784004490 con 0x7f47941051c0 2024-09-21T05:48:24.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.217+0000 7f478a7fc640 1 -- 172.21.15.70:0/1205682717 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4784035070 con 0x7f47941051c0 2024-09-21T05:48:24.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.217+0000 7f479b975640 1 -- 172.21.15.70:0/1205682717 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47941a5df0 con 0x7f47941051c0 2024-09-21T05:48:24.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.217+0000 7f479b975640 1 -- 172.21.15.70:0/1205682717 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4794063b50 con 0x7f47941051c0 2024-09-21T05:48:24.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.219+0000 7f478a7fc640 1 -- 172.21.15.70:0/1205682717 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f4784042030 con 0x7f47941051c0 2024-09-21T05:48:24.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.220+0000 7f478a7fc640 1 --2- 172.21.15.70:0/1205682717 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f47800b65a0 0x7f47800b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:24.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.220+0000 7f4799711640 1 --2- 172.21.15.70:0/1205682717 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f47800b65a0 0x7f47800b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:24.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.220+0000 7f478a7fc640 1 -- 172.21.15.70:0/1205682717 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f4784108210 con 0x7f47941051c0 2024-09-21T05:48:24.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.220+0000 7f478a7fc640 1 --2- 172.21.15.70:0/1205682717 >> [v2:172.21.15.116:6824/541280433,v1:172.21.15.116:6825/541280433] conn(0x7f47800c16b0 0x7f47800c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:24.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.220+0000 7f478a7fc640 1 -- 172.21.15.70:0/1205682717 --> [v2:172.21.15.116:6824/541280433,v1:172.21.15.116:6825/541280433] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4784005df0 con 0x7f47800c16b0 2024-09-21T05:48:24.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.220+0000 7f478a7fc640 1 -- 172.21.15.70:0/1205682717 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f4784108660 con 0x7f47941051c0 2024-09-21T05:48:24.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.220+0000 7f4799f12640 1 --2- 172.21.15.70:0/1205682717 >> [v2:172.21.15.116:6824/541280433,v1:172.21.15.116:6825/541280433] conn(0x7f47800c16b0 0x7f47800c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:24.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.220+0000 7f4799711640 1 --2- 172.21.15.70:0/1205682717 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f47800b65a0 0x7f47800b8ab0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f479000a810 tx=0x7f4790008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:24.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.221+0000 7f4799f12640 1 --2- 172.21.15.70:0/1205682717 >> [v2:172.21.15.116:6824/541280433,v1:172.21.15.116:6825/541280433] conn(0x7f47800c16b0 0x7f47800c3ba0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:24.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.222+0000 7f478a7fc640 1 -- 172.21.15.70:0/1205682717 <== osd.10 v2:172.21.15.116:6824/541280433 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4784005df0 con 0x7f47800c16b0 2024-09-21T05:48:24.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.236+0000 7f479b975640 1 -- 172.21.15.70:0/1205682717 --> [v2:172.21.15.116:6824/541280433,v1:172.21.15.116:6825/541280433] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4794063f50 con 0x7f47800c16b0 2024-09-21T05:48:24.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.236+0000 7f478a7fc640 1 -- 172.21.15.70:0/1205682717 <== osd.10 v2:172.21.15.116:6824/541280433 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4794063f50 con 0x7f47800c16b0 2024-09-21T05:48:24.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.236+0000 7f479b975640 1 -- 172.21.15.70:0/1205682717 >> [v2:172.21.15.116:6824/541280433,v1:172.21.15.116:6825/541280433] conn(0x7f47800c16b0 msgr2=0x7f47800c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:24.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.237+0000 7f479b975640 1 --2- 172.21.15.70:0/1205682717 >> [v2:172.21.15.116:6824/541280433,v1:172.21.15.116:6825/541280433] conn(0x7f47800c16b0 0x7f47800c3ba0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:24.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.237+0000 7f479b975640 1 -- 172.21.15.70:0/1205682717 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f47800b65a0 msgr2=0x7f47800b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:24.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.237+0000 7f479b975640 1 --2- 172.21.15.70:0/1205682717 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f47800b65a0 0x7f47800b8ab0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f479000a810 tx=0x7f4790008040 comp rx=0 tx=0).stop 2024-09-21T05:48:24.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.237+0000 7f479b975640 1 -- 172.21.15.70:0/1205682717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47941051c0 msgr2=0x7f47941999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:24.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.237+0000 7f479b975640 1 --2- 172.21.15.70:0/1205682717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47941051c0 0x7f47941999d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f478402a930 tx=0x7f4784004270 comp rx=0 tx=0).stop 2024-09-21T05:48:24.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.237+0000 7f4799f12640 1 -- 172.21.15.70:0/1205682717 reap_dead start 2024-09-21T05:48:24.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.237+0000 7f479b975640 1 -- 172.21.15.70:0/1205682717 shutdown_connections 2024-09-21T05:48:24.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.237+0000 7f479b975640 1 -- 172.21.15.70:0/1205682717 >> 172.21.15.70:0/1205682717 conn(0x7f4794079f90 msgr2=0x7f47941064f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:24.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.237+0000 7f479b975640 1 -- 172.21.15.70:0/1205682717 shutdown_connections 2024-09-21T05:48:24.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:24.237+0000 7f479b975640 1 -- 172.21.15.70:0/1205682717 wait complete. 2024-09-21T05:48:24.918 INFO:teuthology.orchestra.run.smithi070.stdout:98784247877 2024-09-21T05:48:24.918 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T05:48:25.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.198+0000 7f6a44ee8640 1 -- 172.21.15.70:0/2540582028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a40102a60 msgr2=0x7f6a40102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:25.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.198+0000 7f6a44ee8640 1 --2- 172.21.15.70:0/2540582028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a40102a60 0x7f6a40102e70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6a30009900 tx=0x7f6a3002a410 comp rx=0 tx=0).stop 2024-09-21T05:48:25.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.198+0000 7f6a44ee8640 1 -- 172.21.15.70:0/2540582028 shutdown_connections 2024-09-21T05:48:25.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.198+0000 7f6a44ee8640 1 --2- 172.21.15.70:0/2540582028 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a40108cf0 0x7f6a4010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:25.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.198+0000 7f6a44ee8640 1 --2- 172.21.15.70:0/2540582028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a401083a0 0x7f6a401087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:25.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.198+0000 7f6a44ee8640 1 --2- 172.21.15.70:0/2540582028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a40102a60 0x7f6a40102e70 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:25.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.198+0000 7f6a44ee8640 1 -- 172.21.15.70:0/2540582028 >> 172.21.15.70:0/2540582028 conn(0x7f6a40079720 msgr2=0x7f6a40079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:25.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.198+0000 7f6a44ee8640 1 -- 172.21.15.70:0/2540582028 shutdown_connections 2024-09-21T05:48:25.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.198+0000 7f6a44ee8640 1 -- 172.21.15.70:0/2540582028 wait complete. 2024-09-21T05:48:25.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.199+0000 7f6a44ee8640 1 Processor -- start 2024-09-21T05:48:25.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.200+0000 7f6a44ee8640 1 -- start start 2024-09-21T05:48:25.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.200+0000 7f6a44ee8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a40102a60 0x7f6a40199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:25.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.200+0000 7f6a44ee8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a401083a0 0x7f6a40199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:25.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.200+0000 7f6a44ee8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a40108cf0 0x7f6a4019eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:25.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.200+0000 7f6a44ee8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6a40112950 con 0x7f6a401083a0 2024-09-21T05:48:25.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.200+0000 7f6a44ee8640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6a401127d0 con 0x7f6a40102a60 2024-09-21T05:48:25.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.200+0000 7f6a44ee8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6a40112ad0 con 0x7f6a40108cf0 2024-09-21T05:48:25.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.200+0000 7f6a3dd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a401083a0 0x7f6a40199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:25.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.200+0000 7f6a3e59c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a40102a60 0x7f6a40199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:25.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.200+0000 7f6a3dd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a401083a0 0x7f6a40199a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51986/0 (socket says 172.21.15.70:51986) 2024-09-21T05:48:25.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.200+0000 7f6a3dd9b640 1 -- 172.21.15.70:0/1112809672 learned_addr learned my addr 172.21.15.70:0/1112809672 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:25.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.200+0000 7f6a3ed9d640 1 --2- 172.21.15.70:0/1112809672 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a40108cf0 0x7f6a4019eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:25.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.200+0000 7f6a3dd9b640 1 -- 172.21.15.70:0/1112809672 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a40108cf0 msgr2=0x7f6a4019eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:25.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.200+0000 7f6a3dd9b640 1 --2- 172.21.15.70:0/1112809672 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a40108cf0 0x7f6a4019eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:25.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.201+0000 7f6a3dd9b640 1 -- 172.21.15.70:0/1112809672 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a40102a60 msgr2=0x7f6a40199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:25.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.201+0000 7f6a3dd9b640 1 --2- 172.21.15.70:0/1112809672 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a40102a60 0x7f6a40199460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:25.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.201+0000 7f6a3dd9b640 1 -- 172.21.15.70:0/1112809672 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a4019f310 con 0x7f6a401083a0 2024-09-21T05:48:25.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.201+0000 7f6a3dd9b640 1 --2- 172.21.15.70:0/1112809672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a401083a0 0x7f6a40199a00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6a3400c970 tx=0x7f6a3400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:25.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.201+0000 7f6a2f7fe640 1 -- 172.21.15.70:0/1112809672 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a34014070 con 0x7f6a401083a0 2024-09-21T05:48:25.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.201+0000 7f6a2f7fe640 1 -- 172.21.15.70:0/1112809672 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f6a34004440 con 0x7f6a401083a0 2024-09-21T05:48:25.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.201+0000 7f6a2f7fe640 1 -- 172.21.15.70:0/1112809672 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a34003d80 con 0x7f6a401083a0 2024-09-21T05:48:25.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.201+0000 7f6a44ee8640 1 -- 172.21.15.70:0/1112809672 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a4019f600 con 0x7f6a401083a0 2024-09-21T05:48:25.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.201+0000 7f6a44ee8640 1 -- 172.21.15.70:0/1112809672 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a4006bbe0 con 0x7f6a401083a0 2024-09-21T05:48:25.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.202+0000 7f6a44ee8640 1 -- 172.21.15.70:0/1112809672 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6a4006c170 con 0x7f6a401083a0 2024-09-21T05:48:25.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.204+0000 7f6a2f7fe640 1 -- 172.21.15.70:0/1112809672 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f6a34017070 con 0x7f6a401083a0 2024-09-21T05:48:25.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.204+0000 7f6a2f7fe640 1 --2- 172.21.15.70:0/1112809672 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f6a280b65d0 0x7f6a280b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:25.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.204+0000 7f6a3e59c640 1 --2- 172.21.15.70:0/1112809672 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f6a280b65d0 0x7f6a280b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:25.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.205+0000 7f6a2f7fe640 1 -- 172.21.15.70:0/1112809672 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f6a340e7740 con 0x7f6a401083a0 2024-09-21T05:48:25.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.205+0000 7f6a2f7fe640 1 --2- 172.21.15.70:0/1112809672 >> [v2:172.21.15.116:6800/1037621846,v1:172.21.15.116:6801/1037621846] conn(0x7f6a280c16e0 0x7f6a280c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:25.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.205+0000 7f6a2f7fe640 1 -- 172.21.15.70:0/1112809672 --> [v2:172.21.15.116:6800/1037621846,v1:172.21.15.116:6801/1037621846] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6a34021e80 con 0x7f6a280c16e0 2024-09-21T05:48:25.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.205+0000 7f6a2f7fe640 1 -- 172.21.15.70:0/1112809672 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f6a340e7b90 con 0x7f6a401083a0 2024-09-21T05:48:25.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.205+0000 7f6a3e59c640 1 --2- 172.21.15.70:0/1112809672 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f6a280b65d0 0x7f6a280b8ae0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6a30005d90 tx=0x7f6a30005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:25.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.205+0000 7f6a3ed9d640 1 --2- 172.21.15.70:0/1112809672 >> [v2:172.21.15.116:6800/1037621846,v1:172.21.15.116:6801/1037621846] conn(0x7f6a280c16e0 0x7f6a280c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:25.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.205+0000 7f6a3ed9d640 1 --2- 172.21.15.70:0/1112809672 >> [v2:172.21.15.116:6800/1037621846,v1:172.21.15.116:6801/1037621846] conn(0x7f6a280c16e0 0x7f6a280c3bd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:25.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.206+0000 7f6a2f7fe640 1 -- 172.21.15.70:0/1112809672 <== osd.1 v2:172.21.15.116:6800/1037621846 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6a34021e80 con 0x7f6a280c16e0 2024-09-21T05:48:25.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.220+0000 7f6a44ee8640 1 -- 172.21.15.70:0/1112809672 --> [v2:172.21.15.116:6800/1037621846,v1:172.21.15.116:6801/1037621846] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6a4006c5f0 con 0x7f6a280c16e0 2024-09-21T05:48:25.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.220+0000 7f6a2f7fe640 1 -- 172.21.15.70:0/1112809672 <== osd.1 v2:172.21.15.116:6800/1037621846 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6a4006c5f0 con 0x7f6a280c16e0 2024-09-21T05:48:25.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.220+0000 7f6a44ee8640 1 -- 172.21.15.70:0/1112809672 >> [v2:172.21.15.116:6800/1037621846,v1:172.21.15.116:6801/1037621846] conn(0x7f6a280c16e0 msgr2=0x7f6a280c3bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:25.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.220+0000 7f6a44ee8640 1 --2- 172.21.15.70:0/1112809672 >> [v2:172.21.15.116:6800/1037621846,v1:172.21.15.116:6801/1037621846] conn(0x7f6a280c16e0 0x7f6a280c3bd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:25.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.221+0000 7f6a44ee8640 1 -- 172.21.15.70:0/1112809672 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f6a280b65d0 msgr2=0x7f6a280b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:25.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.221+0000 7f6a44ee8640 1 --2- 172.21.15.70:0/1112809672 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f6a280b65d0 0x7f6a280b8ae0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6a30005d90 tx=0x7f6a30005e80 comp rx=0 tx=0).stop 2024-09-21T05:48:25.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.221+0000 7f6a44ee8640 1 -- 172.21.15.70:0/1112809672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a401083a0 msgr2=0x7f6a40199a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:25.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.221+0000 7f6a44ee8640 1 --2- 172.21.15.70:0/1112809672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a401083a0 0x7f6a40199a00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6a3400c970 tx=0x7f6a3400ce30 comp rx=0 tx=0).stop 2024-09-21T05:48:25.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.221+0000 7f6a3ed9d640 1 -- 172.21.15.70:0/1112809672 reap_dead start 2024-09-21T05:48:25.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.221+0000 7f6a44ee8640 1 -- 172.21.15.70:0/1112809672 shutdown_connections 2024-09-21T05:48:25.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.221+0000 7f6a44ee8640 1 -- 172.21.15.70:0/1112809672 >> 172.21.15.70:0/1112809672 conn(0x7f6a40079720 msgr2=0x7f6a401014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:25.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.221+0000 7f6a44ee8640 1 -- 172.21.15.70:0/1112809672 shutdown_connections 2024-09-21T05:48:25.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:25.221+0000 7f6a44ee8640 1 -- 172.21.15.70:0/1112809672 wait complete. 2024-09-21T05:48:25.681 INFO:teuthology.orchestra.run.smithi070.stdout:150323855419 2024-09-21T05:48:25.681 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T05:48:25.744 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:25 smithi070 ceph-mon[30981]: pgmap v337: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-09-21T05:48:25.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:25 smithi116 ceph-mon[34332]: pgmap v337: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-09-21T05:48:25.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:25 smithi160 ceph-mon[33979]: pgmap v337: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-09-21T05:48:26.441 INFO:teuthology.orchestra.run.smithi070.stdout:270582939682 2024-09-21T05:48:26.441 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.10 2024-09-21T05:48:26.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.076+0000 7f9dfdf75640 1 -- 172.21.15.70:0/2830934603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9df81048c0 msgr2=0x7f9df8104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:26.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.076+0000 7f9dfdf75640 1 --2- 172.21.15.70:0/2830934603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9df81048c0 0x7f9df8104cd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9de8009900 tx=0x7f9de802a410 comp rx=0 tx=0).stop 2024-09-21T05:48:26.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.076+0000 7f9dfdf75640 1 -- 172.21.15.70:0/2830934603 shutdown_connections 2024-09-21T05:48:26.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.076+0000 7f9dfdf75640 1 --2- 172.21.15.70:0/2830934603 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9df810de70 0x7f9df8110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:26.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.076+0000 7f9dfdf75640 1 --2- 172.21.15.70:0/2830934603 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9df81052a0 0x7f9df810d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:26.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.076+0000 7f9dfdf75640 1 --2- 172.21.15.70:0/2830934603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9df81048c0 0x7f9df8104cd0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:26.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.076+0000 7f9dfdf75640 1 -- 172.21.15.70:0/2830934603 >> 172.21.15.70:0/2830934603 conn(0x7f9df8079790 msgr2=0x7f9df8079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:26.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.076+0000 7f9dfdf75640 1 -- 172.21.15.70:0/2830934603 shutdown_connections 2024-09-21T05:48:26.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.076+0000 7f9dfdf75640 1 -- 172.21.15.70:0/2830934603 wait complete. 2024-09-21T05:48:26.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.077+0000 7f9dfdf75640 1 Processor -- start 2024-09-21T05:48:26.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.077+0000 7f9dfdf75640 1 -- start start 2024-09-21T05:48:26.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.077+0000 7f9dfdf75640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9df81048c0 0x7f9df819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:26.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.077+0000 7f9dfdf75640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9df81052a0 0x7f9df819aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:26.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.077+0000 7f9dfdf75640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9df810de70 0x7f9df819fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:26.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.077+0000 7f9dfdf75640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9df8113aa0 con 0x7f9df810de70 2024-09-21T05:48:26.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.077+0000 7f9dfdf75640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9df8113920 con 0x7f9df81052a0 2024-09-21T05:48:26.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.077+0000 7f9dfdf75640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9df8113c20 con 0x7f9df81048c0 2024-09-21T05:48:26.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.077+0000 7f9df7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9df810de70 0x7f9df819fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:26.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.078+0000 7f9df7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9df810de70 0x7f9df819fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51916/0 (socket says 172.21.15.70:51916) 2024-09-21T05:48:26.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.078+0000 7f9df7fff640 1 -- 172.21.15.70:0/647837477 learned_addr learned my addr 172.21.15.70:0/647837477 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:26.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.078+0000 7f9deffff640 1 --2- 172.21.15.70:0/647837477 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9df81052a0 0x7f9df819aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:26.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.078+0000 7f9df77fe640 1 --2- 172.21.15.70:0/647837477 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9df81048c0 0x7f9df819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:26.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.078+0000 7f9df7fff640 1 -- 172.21.15.70:0/647837477 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9df81048c0 msgr2=0x7f9df819a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:26.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.078+0000 7f9df7fff640 1 --2- 172.21.15.70:0/647837477 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9df81048c0 0x7f9df819a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:26.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.078+0000 7f9df7fff640 1 -- 172.21.15.70:0/647837477 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9df81052a0 msgr2=0x7f9df819aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:26.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.078+0000 7f9df7fff640 1 --2- 172.21.15.70:0/647837477 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9df81052a0 0x7f9df819aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:26.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.078+0000 7f9df7fff640 1 -- 172.21.15.70:0/647837477 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df81a0360 con 0x7f9df810de70 2024-09-21T05:48:26.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.078+0000 7f9df7fff640 1 --2- 172.21.15.70:0/647837477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9df810de70 0x7f9df819fcf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9df000cce0 tx=0x7f9df000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:26.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.078+0000 7f9df57fa640 1 -- 172.21.15.70:0/647837477 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df000f450 con 0x7f9df810de70 2024-09-21T05:48:26.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.078+0000 7f9dfdf75640 1 -- 172.21.15.70:0/647837477 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9df81a0650 con 0x7f9df810de70 2024-09-21T05:48:26.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.078+0000 7f9df57fa640 1 -- 172.21.15.70:0/647837477 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f9df000faa0 con 0x7f9df810de70 2024-09-21T05:48:26.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.078+0000 7f9df57fa640 1 -- 172.21.15.70:0/647837477 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df0018b20 con 0x7f9df810de70 2024-09-21T05:48:26.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.078+0000 7f9dfdf75640 1 -- 172.21.15.70:0/647837477 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9df81a0b40 con 0x7f9df810de70 2024-09-21T05:48:26.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.079+0000 7f9dfdf75640 1 -- 172.21.15.70:0/647837477 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9df8063b50 con 0x7f9df810de70 2024-09-21T05:48:26.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.081+0000 7f9df57fa640 1 -- 172.21.15.70:0/647837477 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f9df000fc50 con 0x7f9df810de70 2024-09-21T05:48:26.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.082+0000 7f9df57fa640 1 --2- 172.21.15.70:0/647837477 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f9de40b65d0 0x7f9de40b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:26.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.082+0000 7f9df77fe640 1 --2- 172.21.15.70:0/647837477 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f9de40b65d0 0x7f9de40b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:26.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.082+0000 7f9df57fa640 1 -- 172.21.15.70:0/647837477 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f9df00e8360 con 0x7f9df810de70 2024-09-21T05:48:26.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.082+0000 7f9df57fa640 1 --2- 172.21.15.70:0/647837477 >> [v2:172.21.15.70:6818/3650315688,v1:172.21.15.70:6819/3650315688] conn(0x7f9de40c16e0 0x7f9de40c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:26.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.082+0000 7f9df57fa640 1 -- 172.21.15.70:0/647837477 --> [v2:172.21.15.70:6818/3650315688,v1:172.21.15.70:6819/3650315688] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9de40c42a0 con 0x7f9de40c16e0 2024-09-21T05:48:26.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.082+0000 7f9df57fa640 1 -- 172.21.15.70:0/647837477 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f9df00e87f0 con 0x7f9df810de70 2024-09-21T05:48:26.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.082+0000 7f9deffff640 1 --2- 172.21.15.70:0/647837477 >> [v2:172.21.15.70:6818/3650315688,v1:172.21.15.70:6819/3650315688] conn(0x7f9de40c16e0 0x7f9de40c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:26.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.082+0000 7f9df77fe640 1 --2- 172.21.15.70:0/647837477 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f9de40b65d0 0x7f9de40b8ae0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9de8005d90 tx=0x7f9de8005df0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:26.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.082+0000 7f9deffff640 1 --2- 172.21.15.70:0/647837477 >> [v2:172.21.15.70:6818/3650315688,v1:172.21.15.70:6819/3650315688] conn(0x7f9de40c16e0 0x7f9de40c3bd0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:26.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.083+0000 7f9df57fa640 1 -- 172.21.15.70:0/647837477 <== osd.6 v2:172.21.15.70:6818/3650315688 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9de40c42a0 con 0x7f9de40c16e0 2024-09-21T05:48:26.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.098+0000 7f9dfdf75640 1 -- 172.21.15.70:0/647837477 --> [v2:172.21.15.70:6818/3650315688,v1:172.21.15.70:6819/3650315688] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9df8063f50 con 0x7f9de40c16e0 2024-09-21T05:48:26.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.098+0000 7f9df57fa640 1 -- 172.21.15.70:0/647837477 <== osd.6 v2:172.21.15.70:6818/3650315688 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9df8063f50 con 0x7f9de40c16e0 2024-09-21T05:48:26.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.098+0000 7f9dfdf75640 1 -- 172.21.15.70:0/647837477 >> [v2:172.21.15.70:6818/3650315688,v1:172.21.15.70:6819/3650315688] conn(0x7f9de40c16e0 msgr2=0x7f9de40c3bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:26.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.098+0000 7f9dfdf75640 1 --2- 172.21.15.70:0/647837477 >> [v2:172.21.15.70:6818/3650315688,v1:172.21.15.70:6819/3650315688] conn(0x7f9de40c16e0 0x7f9de40c3bd0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:26.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.098+0000 7f9dfdf75640 1 -- 172.21.15.70:0/647837477 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f9de40b65d0 msgr2=0x7f9de40b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:26.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.098+0000 7f9dfdf75640 1 --2- 172.21.15.70:0/647837477 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f9de40b65d0 0x7f9de40b8ae0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9de8005d90 tx=0x7f9de8005df0 comp rx=0 tx=0).stop 2024-09-21T05:48:26.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.098+0000 7f9dfdf75640 1 -- 172.21.15.70:0/647837477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9df810de70 msgr2=0x7f9df819fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:26.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.098+0000 7f9dfdf75640 1 --2- 172.21.15.70:0/647837477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9df810de70 0x7f9df819fcf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9df000cce0 tx=0x7f9df000a620 comp rx=0 tx=0).stop 2024-09-21T05:48:26.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.099+0000 7f9df7fff640 1 -- 172.21.15.70:0/647837477 reap_dead start 2024-09-21T05:48:26.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.099+0000 7f9dfdf75640 1 -- 172.21.15.70:0/647837477 shutdown_connections 2024-09-21T05:48:26.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.099+0000 7f9dfdf75640 1 -- 172.21.15.70:0/647837477 >> 172.21.15.70:0/647837477 conn(0x7f9df8079790 msgr2=0x7f9df8100850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:26.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.099+0000 7f9dfdf75640 1 -- 172.21.15.70:0/647837477 shutdown_connections 2024-09-21T05:48:26.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:21.099+0000 7f9dfdf75640 1 -- 172.21.15.70:0/647837477 wait complete. 2024-09-21T05:48:27.159 INFO:teuthology.orchestra.run.smithi070.stdout:176093659189 2024-09-21T05:48:27.160 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.6 2024-09-21T05:48:27.608 INFO:teuthology.orchestra.run.smithi070.stdout:51539607631 2024-09-21T05:48:27.608 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T05:48:27.744 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:27 smithi070 ceph-mon[30981]: pgmap v338: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T05:48:27.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:27 smithi116 ceph-mon[34332]: pgmap v338: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T05:48:27.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:27 smithi160 ceph-mon[33979]: pgmap v338: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T05:48:28.071 INFO:teuthology.orchestra.run.smithi070.stdout:34359738451 2024-09-21T05:48:28.071 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T05:48:28.518 INFO:teuthology.orchestra.run.smithi070.stdout:249108103206 2024-09-21T05:48:28.519 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.9 2024-09-21T05:48:29.003 INFO:teuthology.orchestra.run.smithi070.stdout:197568495665 2024-09-21T05:48:29.004 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.7 2024-09-21T05:48:29.070 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:29.201 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:29.202 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:29.202 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:29.213 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:29.214 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:29.217 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:29.218 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:29.221 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:29.570 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:29 smithi070 ceph-mon[30981]: pgmap v339: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T05:48:29.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:29 smithi116 ceph-mon[34332]: pgmap v339: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T05:48:29.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:29 smithi160 ceph-mon[33979]: pgmap v339: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T05:48:30.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.434+0000 7f99e540e640 1 -- 172.21.15.70:0/3732316558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99e01083d0 msgr2=0x7f99e01087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:30.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.434+0000 7f99e540e640 1 --2- 172.21.15.70:0/3732316558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99e01083d0 0x7f99e01087e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f99d4009900 tx=0x7f99d402a410 comp rx=0 tx=0).stop 2024-09-21T05:48:30.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.434+0000 7f99e540e640 1 -- 172.21.15.70:0/3732316558 shutdown_connections 2024-09-21T05:48:30.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.434+0000 7f99e540e640 1 --2- 172.21.15.70:0/3732316558 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99e0108d20 0x7f99e010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:30.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.434+0000 7f99e540e640 1 --2- 172.21.15.70:0/3732316558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99e01083d0 0x7f99e01087e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:30.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.434+0000 7f99e540e640 1 --2- 172.21.15.70:0/3732316558 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99e0102ae0 0x7f99e0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:30.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.434+0000 7f99e540e640 1 -- 172.21.15.70:0/3732316558 >> 172.21.15.70:0/3732316558 conn(0x7f99e0079760 msgr2=0x7f99e0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:30.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.434+0000 7f99e540e640 1 -- 172.21.15.70:0/3732316558 shutdown_connections 2024-09-21T05:48:30.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.434+0000 7f99e540e640 1 -- 172.21.15.70:0/3732316558 wait complete. 2024-09-21T05:48:30.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.435+0000 7f99e540e640 1 Processor -- start 2024-09-21T05:48:30.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.435+0000 7f99e540e640 1 -- start start 2024-09-21T05:48:30.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.435+0000 7f99e540e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99e0102ae0 0x7f99e0199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:30.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.435+0000 7f99e540e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99e01083d0 0x7f99e01999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:30.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.435+0000 7f99e540e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99e0108d20 0x7f99e019ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:30.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.435+0000 7f99e540e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f99e01129c0 con 0x7f99e01083d0 2024-09-21T05:48:30.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.435+0000 7f99e540e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f99e0112840 con 0x7f99e0102ae0 2024-09-21T05:48:30.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.435+0000 7f99e540e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f99e0112b40 con 0x7f99e0108d20 2024-09-21T05:48:30.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.435+0000 7f99de7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99e01083d0 0x7f99e01999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:30.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.435+0000 7f99de7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99e01083d0 0x7f99e01999b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44956/0 (socket says 172.21.15.70:44956) 2024-09-21T05:48:30.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.435+0000 7f99de7fc640 1 -- 172.21.15.70:0/2832587060 learned_addr learned my addr 172.21.15.70:0/2832587060 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:30.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.436+0000 7f99deffd640 1 --2- 172.21.15.70:0/2832587060 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99e0102ae0 0x7f99e0199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:30.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.436+0000 7f99df7fe640 1 --2- 172.21.15.70:0/2832587060 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99e0108d20 0x7f99e019ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:30.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.436+0000 7f99de7fc640 1 -- 172.21.15.70:0/2832587060 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99e0108d20 msgr2=0x7f99e019ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:30.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.436+0000 7f99de7fc640 1 --2- 172.21.15.70:0/2832587060 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99e0108d20 0x7f99e019ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:30.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.436+0000 7f99de7fc640 1 -- 172.21.15.70:0/2832587060 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99e0102ae0 msgr2=0x7f99e0199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:30.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.436+0000 7f99de7fc640 1 --2- 172.21.15.70:0/2832587060 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99e0102ae0 0x7f99e0199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:30.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.436+0000 7f99de7fc640 1 -- 172.21.15.70:0/2832587060 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99e019f380 con 0x7f99e01083d0 2024-09-21T05:48:30.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.436+0000 7f99de7fc640 1 --2- 172.21.15.70:0/2832587060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99e01083d0 0x7f99e01999b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f99d4004270 tx=0x7f99d40042a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:30.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.436+0000 7f99c7fff640 1 -- 172.21.15.70:0/2832587060 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d403f030 con 0x7f99e01083d0 2024-09-21T05:48:30.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.436+0000 7f99c7fff640 1 -- 172.21.15.70:0/2832587060 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f99d40044c0 con 0x7f99e01083d0 2024-09-21T05:48:30.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.436+0000 7f99e540e640 1 -- 172.21.15.70:0/2832587060 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99e019f610 con 0x7f99e01083d0 2024-09-21T05:48:30.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.436+0000 7f99c7fff640 1 -- 172.21.15.70:0/2832587060 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d4035070 con 0x7f99e01083d0 2024-09-21T05:48:30.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.436+0000 7f99e540e640 1 -- 172.21.15.70:0/2832587060 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99e01a5dd0 con 0x7f99e01083d0 2024-09-21T05:48:30.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.437+0000 7f99e540e640 1 -- 172.21.15.70:0/2832587060 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99e0103d10 con 0x7f99e01083d0 2024-09-21T05:48:30.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.439+0000 7f99c7fff640 1 -- 172.21.15.70:0/2832587060 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f99d4042030 con 0x7f99e01083d0 2024-09-21T05:48:30.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.439+0000 7f99c7fff640 1 --2- 172.21.15.70:0/2832587060 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f99c80b65a0 0x7f99c80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:30.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.439+0000 7f99deffd640 1 --2- 172.21.15.70:0/2832587060 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f99c80b65a0 0x7f99c80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:30.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.439+0000 7f99c7fff640 1 -- 172.21.15.70:0/2832587060 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f99d41081e0 con 0x7f99e01083d0 2024-09-21T05:48:30.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.440+0000 7f99deffd640 1 --2- 172.21.15.70:0/2832587060 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f99c80b65a0 0x7f99c80b8ab0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f99d0005fd0 tx=0x7f99d0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:30.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.443+0000 7f99c7fff640 1 -- 172.21.15.70:0/2832587060 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f99d40ce5b0 con 0x7f99e01083d0 2024-09-21T05:48:30.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.627+0000 7f99e540e640 1 -- 172.21.15.70:0/2832587060 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f99e019a540 con 0x7f99e01083d0 2024-09-21T05:48:30.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.627+0000 7f99c7fff640 1 -- 172.21.15.70:0/2832587060 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f99d40d2990 con 0x7f99e01083d0 2024-09-21T05:48:30.630 INFO:teuthology.orchestra.run.smithi070.stdout:51539607632 2024-09-21T05:48:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.630+0000 7f99e540e640 1 -- 172.21.15.70:0/2832587060 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f99c80b65a0 msgr2=0x7f99c80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.630+0000 7f99e540e640 1 --2- 172.21.15.70:0/2832587060 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f99c80b65a0 0x7f99c80b8ab0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f99d0005fd0 tx=0x7f99d0005850 comp rx=0 tx=0).stop 2024-09-21T05:48:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.630+0000 7f99e540e640 1 -- 172.21.15.70:0/2832587060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99e01083d0 msgr2=0x7f99e01999b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.630+0000 7f99e540e640 1 --2- 172.21.15.70:0/2832587060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99e01083d0 0x7f99e01999b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f99d4004270 tx=0x7f99d40042a0 comp rx=0 tx=0).stop 2024-09-21T05:48:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.630+0000 7f99e540e640 1 -- 172.21.15.70:0/2832587060 shutdown_connections 2024-09-21T05:48:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.630+0000 7f99e540e640 1 --2- 172.21.15.70:0/2832587060 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f99c80b65a0 0x7f99c80b8ab0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.630+0000 7f99e540e640 1 --2- 172.21.15.70:0/2832587060 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99e0108d20 0x7f99e019ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.630+0000 7f99e540e640 1 --2- 172.21.15.70:0/2832587060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99e01083d0 0x7f99e01999b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.630+0000 7f99e540e640 1 --2- 172.21.15.70:0/2832587060 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99e0102ae0 0x7f99e0199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.630+0000 7f99e540e640 1 -- 172.21.15.70:0/2832587060 >> 172.21.15.70:0/2832587060 conn(0x7f99e0079760 msgr2=0x7f99e01052d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.630+0000 7f99e540e640 1 -- 172.21.15.70:0/2832587060 shutdown_connections 2024-09-21T05:48:30.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.630+0000 7f99e540e640 1 -- 172.21.15.70:0/2832587060 wait complete. 2024-09-21T05:48:30.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.664+0000 7fc9f3c3b640 1 -- 172.21.15.70:0/1868574632 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9ec1083c0 msgr2=0x7fc9ec1087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:30.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.664+0000 7fc9f3c3b640 1 --2- 172.21.15.70:0/1868574632 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9ec1083c0 0x7fc9ec1087d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc009860 tx=0x7fc9dc02a340 comp rx=0 tx=0).stop 2024-09-21T05:48:30.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.664+0000 7fc9f3c3b640 1 -- 172.21.15.70:0/1868574632 shutdown_connections 2024-09-21T05:48:30.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.664+0000 7fc9f3c3b640 1 --2- 172.21.15.70:0/1868574632 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9ec108d10 0x7fc9ec10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:30.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.664+0000 7fc9f3c3b640 1 --2- 172.21.15.70:0/1868574632 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9ec1083c0 0x7fc9ec1087d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:30.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.664+0000 7fc9f3c3b640 1 --2- 172.21.15.70:0/1868574632 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9ec102a80 0x7fc9ec102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:30.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.664+0000 7fc9f3c3b640 1 -- 172.21.15.70:0/1868574632 >> 172.21.15.70:0/1868574632 conn(0x7fc9ec079740 msgr2=0x7fc9ec079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:30.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.664+0000 7fc9f3c3b640 1 -- 172.21.15.70:0/1868574632 shutdown_connections 2024-09-21T05:48:30.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.664+0000 7fc9f3c3b640 1 -- 172.21.15.70:0/1868574632 wait complete. 2024-09-21T05:48:30.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.665+0000 7fc9f3c3b640 1 Processor -- start 2024-09-21T05:48:30.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.665+0000 7fc9f3c3b640 1 -- start start 2024-09-21T05:48:30.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.665+0000 7fc9f3c3b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9ec102a80 0x7fc9ec199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:30.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.665+0000 7fc9f3c3b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9ec1083c0 0x7fc9ec1998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:30.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.665+0000 7fc9f3c3b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9ec108d10 0x7fc9ec19eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:30.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.665+0000 7fc9f3c3b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec112950 con 0x7fc9ec102a80 2024-09-21T05:48:30.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.665+0000 7fc9f3c3b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec1127d0 con 0x7fc9ec1083c0 2024-09-21T05:48:30.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.665+0000 7fc9f3c3b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec112ad0 con 0x7fc9ec108d10 2024-09-21T05:48:30.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.666+0000 7fc9f19d7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9ec102a80 0x7fc9ec199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:30.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.666+0000 7fc9f19d7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9ec102a80 0x7fc9ec199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44968/0 (socket says 172.21.15.70:44968) 2024-09-21T05:48:30.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.666+0000 7fc9f19d7640 1 -- 172.21.15.70:0/3416667280 learned_addr learned my addr 172.21.15.70:0/3416667280 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:30.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.666+0000 7fc9f21d8640 1 --2- 172.21.15.70:0/3416667280 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9ec108d10 0x7fc9ec19eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:30.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.666+0000 7fc9f11d6640 1 --2- 172.21.15.70:0/3416667280 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9ec1083c0 0x7fc9ec1998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:30.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.666+0000 7fc9f19d7640 1 -- 172.21.15.70:0/3416667280 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9ec108d10 msgr2=0x7fc9ec19eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:30.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.666+0000 7fc9f19d7640 1 --2- 172.21.15.70:0/3416667280 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9ec108d10 0x7fc9ec19eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:30.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.666+0000 7fc9f19d7640 1 -- 172.21.15.70:0/3416667280 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9ec1083c0 msgr2=0x7fc9ec1998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:30.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.666+0000 7fc9f19d7640 1 --2- 172.21.15.70:0/3416667280 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9ec1083c0 0x7fc9ec1998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:30.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.666+0000 7fc9f19d7640 1 -- 172.21.15.70:0/3416667280 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9ec19f290 con 0x7fc9ec102a80 2024-09-21T05:48:30.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.666+0000 7fc9f11d6640 1 --2- 172.21.15.70:0/3416667280 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9ec1083c0 0x7fc9ec1998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:48:30.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.666+0000 7fc9f19d7640 1 --2- 172.21.15.70:0/3416667280 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9ec102a80 0x7fc9ec199320 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc9e800e9c0 tx=0x7fc9e800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:30.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.666+0000 7fc9e2ffd640 1 -- 172.21.15.70:0/3416667280 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e800ccc0 con 0x7fc9ec102a80 2024-09-21T05:48:30.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.666+0000 7fc9f3c3b640 1 -- 172.21.15.70:0/3416667280 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9ec19f580 con 0x7fc9ec102a80 2024-09-21T05:48:30.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.666+0000 7fc9e2ffd640 1 -- 172.21.15.70:0/3416667280 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fc9e80054d0 con 0x7fc9ec102a80 2024-09-21T05:48:30.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.666+0000 7fc9e2ffd640 1 -- 172.21.15.70:0/3416667280 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8010430 con 0x7fc9ec102a80 2024-09-21T05:48:30.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.666+0000 7fc9f3c3b640 1 -- 172.21.15.70:0/3416667280 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9ec1a5ce0 con 0x7fc9ec102a80 2024-09-21T05:48:30.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.668+0000 7fc9f3c3b640 1 -- 172.21.15.70:0/3416667280 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9ec102e90 con 0x7fc9ec102a80 2024-09-21T05:48:30.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.669+0000 7fc9e2ffd640 1 -- 172.21.15.70:0/3416667280 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fc9e8005020 con 0x7fc9ec102a80 2024-09-21T05:48:30.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.669+0000 7fc9e2ffd640 1 --2- 172.21.15.70:0/3416667280 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc9d80b6620 0x7fc9d80b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:30.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.670+0000 7fc9f11d6640 1 --2- 172.21.15.70:0/3416667280 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc9d80b6620 0x7fc9d80b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:30.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.670+0000 7fc9e2ffd640 1 -- 172.21.15.70:0/3416667280 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7fc9e80e7ab0 con 0x7fc9ec102a80 2024-09-21T05:48:30.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.670+0000 7fc9f11d6640 1 --2- 172.21.15.70:0/3416667280 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc9d80b6620 0x7fc9d80b8b30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec06a2a0 tx=0x7fc9dc005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:30.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.675+0000 7fc9e2ffd640 1 -- 172.21.15.70:0/3416667280 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc9e80ade80 con 0x7fc9ec102a80 2024-09-21T05:48:30.744 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:30 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2832587060' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T05:48:30.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.860+0000 7fc9f3c3b640 1 -- 172.21.15.70:0/3416667280 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc9ec19a450 con 0x7fc9ec102a80 2024-09-21T05:48:30.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.861+0000 7fc9e2ffd640 1 -- 172.21.15.70:0/3416667280 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc9e80b2260 con 0x7fc9ec102a80 2024-09-21T05:48:30.863 INFO:teuthology.orchestra.run.smithi070.stdout:34359738453 2024-09-21T05:48:30.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.863+0000 7fc9f3c3b640 1 -- 172.21.15.70:0/3416667280 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc9d80b6620 msgr2=0x7fc9d80b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:30.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.863+0000 7fc9f3c3b640 1 --2- 172.21.15.70:0/3416667280 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc9d80b6620 0x7fc9d80b8b30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec06a2a0 tx=0x7fc9dc005c90 comp rx=0 tx=0).stop 2024-09-21T05:48:30.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.863+0000 7fc9f3c3b640 1 -- 172.21.15.70:0/3416667280 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9ec102a80 msgr2=0x7fc9ec199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:30.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.863+0000 7fc9f3c3b640 1 --2- 172.21.15.70:0/3416667280 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9ec102a80 0x7fc9ec199320 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc9e800e9c0 tx=0x7fc9e800ee80 comp rx=0 tx=0).stop 2024-09-21T05:48:30.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.863+0000 7fc9f3c3b640 1 -- 172.21.15.70:0/3416667280 shutdown_connections 2024-09-21T05:48:30.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.863+0000 7fc9f3c3b640 1 --2- 172.21.15.70:0/3416667280 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc9d80b6620 0x7fc9d80b8b30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:30.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.863+0000 7fc9f3c3b640 1 --2- 172.21.15.70:0/3416667280 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9ec108d10 0x7fc9ec19eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:30.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.863+0000 7fc9f3c3b640 1 --2- 172.21.15.70:0/3416667280 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9ec1083c0 0x7fc9ec1998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:30.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.863+0000 7fc9f3c3b640 1 --2- 172.21.15.70:0/3416667280 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9ec102a80 0x7fc9ec199320 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:30.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.863+0000 7fc9f3c3b640 1 -- 172.21.15.70:0/3416667280 >> 172.21.15.70:0/3416667280 conn(0x7fc9ec079740 msgr2=0x7fc9ec1043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:30.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.863+0000 7fc9f3c3b640 1 -- 172.21.15.70:0/3416667280 shutdown_connections 2024-09-21T05:48:30.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.863+0000 7fc9f3c3b640 1 -- 172.21.15.70:0/3416667280 wait complete. 2024-09-21T05:48:30.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.875+0000 7f2a1d45f640 1 -- 172.21.15.70:0/1228302467 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a181094d0 msgr2=0x7f2a181098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:30.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.875+0000 7f2a1d45f640 1 --2- 172.21.15.70:0/1228302467 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a181094d0 0x7f2a181098e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2a08009900 tx=0x7f2a0802a410 comp rx=0 tx=0).stop 2024-09-21T05:48:30.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.875+0000 7f2a1d45f640 1 -- 172.21.15.70:0/1228302467 shutdown_connections 2024-09-21T05:48:30.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.875+0000 7f2a1d45f640 1 --2- 172.21.15.70:0/1228302467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a18109e20 0x7f2a18110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:30.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.875+0000 7f2a1d45f640 1 --2- 172.21.15.70:0/1228302467 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a181094d0 0x7f2a181098e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:30.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.875+0000 7f2a1d45f640 1 --2- 172.21.15.70:0/1228302467 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a18103b90 0x7f2a18103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:30.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.875+0000 7f2a1d45f640 1 -- 172.21.15.70:0/1228302467 >> 172.21.15.70:0/1228302467 conn(0x7f2a180ff600 msgr2=0x7f2a18101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:30.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.875+0000 7f2a1d45f640 1 -- 172.21.15.70:0/1228302467 shutdown_connections 2024-09-21T05:48:30.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.875+0000 7f2a1d45f640 1 -- 172.21.15.70:0/1228302467 wait complete. 2024-09-21T05:48:30.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.876+0000 7f2a1d45f640 1 Processor -- start 2024-09-21T05:48:30.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.876+0000 7f2a1d45f640 1 -- start start 2024-09-21T05:48:30.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.876+0000 7f2a1d45f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a18103b90 0x7f2a18075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:30.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.876+0000 7f2a1d45f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a181094d0 0x7f2a18075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:30.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.877+0000 7f2a1d45f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a18109e20 0x7f2a18076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:30.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.877+0000 7f2a1d45f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2a18113ab0 con 0x7f2a18109e20 2024-09-21T05:48:30.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.877+0000 7f2a1d45f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2a18113930 con 0x7f2a18103b90 2024-09-21T05:48:30.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.877+0000 7f2a1d45f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2a18113c30 con 0x7f2a181094d0 2024-09-21T05:48:30.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.877+0000 7f2a177fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a18109e20 0x7f2a18076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:30.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.877+0000 7f2a177fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a18109e20 0x7f2a18076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44990/0 (socket says 172.21.15.70:44990) 2024-09-21T05:48:30.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.877+0000 7f2a177fe640 1 -- 172.21.15.70:0/3382037317 learned_addr learned my addr 172.21.15.70:0/3382037317 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:30.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.877+0000 7f2a16ffd640 1 --2- 172.21.15.70:0/3382037317 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a18103b90 0x7f2a18075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:30.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.877+0000 7f2a167fc640 1 --2- 172.21.15.70:0/3382037317 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a181094d0 0x7f2a18075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:30.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.877+0000 7f2a177fe640 1 -- 172.21.15.70:0/3382037317 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a181094d0 msgr2=0x7f2a18075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:30.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.877+0000 7f2a177fe640 1 --2- 172.21.15.70:0/3382037317 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a181094d0 0x7f2a18075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:30.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.877+0000 7f2a177fe640 1 -- 172.21.15.70:0/3382037317 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a18103b90 msgr2=0x7f2a18075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:30.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.877+0000 7f2a177fe640 1 --2- 172.21.15.70:0/3382037317 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a18103b90 0x7f2a18075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:30.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.877+0000 7f2a177fe640 1 -- 172.21.15.70:0/3382037317 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a181a8740 con 0x7f2a18109e20 2024-09-21T05:48:30.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.877+0000 7f2a177fe640 1 --2- 172.21.15.70:0/3382037317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a18109e20 0x7f2a18076190 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2a1000eb10 tx=0x7f2a1000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:30.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.877+0000 7f29fffff640 1 -- 172.21.15.70:0/3382037317 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a10004b20 con 0x7f2a18109e20 2024-09-21T05:48:30.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.878+0000 7f29fffff640 1 -- 172.21.15.70:0/3382037317 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f2a10004cc0 con 0x7f2a18109e20 2024-09-21T05:48:30.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.878+0000 7f2a1d45f640 1 -- 172.21.15.70:0/3382037317 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a181a8a30 con 0x7f2a18109e20 2024-09-21T05:48:30.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.878+0000 7f29fffff640 1 -- 172.21.15.70:0/3382037317 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a10010690 con 0x7f2a18109e20 2024-09-21T05:48:30.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.878+0000 7f2a1d45f640 1 -- 172.21.15.70:0/3382037317 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a181a8f40 con 0x7f2a18109e20 2024-09-21T05:48:30.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.879+0000 7f2a1d45f640 1 -- 172.21.15.70:0/3382037317 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a18104e10 con 0x7f2a18109e20 2024-09-21T05:48:30.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.881+0000 7f29fffff640 1 -- 172.21.15.70:0/3382037317 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f2a10005000 con 0x7f2a18109e20 2024-09-21T05:48:30.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.883+0000 7f29fffff640 1 --2- 172.21.15.70:0/3382037317 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f2a000b6620 0x7f2a000b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:30.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.883+0000 7f2a16ffd640 1 --2- 172.21.15.70:0/3382037317 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f2a000b6620 0x7f2a000b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:30.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.883+0000 7f29fffff640 1 -- 172.21.15.70:0/3382037317 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f2a100e7ec0 con 0x7f2a18109e20 2024-09-21T05:48:30.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.883+0000 7f2a16ffd640 1 --2- 172.21.15.70:0/3382037317 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f2a000b6620 0x7f2a000b8b30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2a18077160 tx=0x7f2a0c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:30.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:30.886+0000 7f29fffff640 1 -- 172.21.15.70:0/3382037317 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2a10056710 con 0x7f2a18109e20 2024-09-21T05:48:31.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:30 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2832587060' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T05:48:31.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.074+0000 7f2a1d45f640 1 -- 172.21.15.70:0/3382037317 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f2a18076a10 con 0x7f2a18109e20 2024-09-21T05:48:31.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.075+0000 7f29fffff640 1 -- 172.21.15.70:0/3382037317 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f2a18076a10 con 0x7f2a18109e20 2024-09-21T05:48:31.077 INFO:teuthology.orchestra.run.smithi070.stdout:124554051650 2024-09-21T05:48:31.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.077+0000 7f2a1d45f640 1 -- 172.21.15.70:0/3382037317 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f2a000b6620 msgr2=0x7f2a000b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:31.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.077+0000 7f2a1d45f640 1 --2- 172.21.15.70:0/3382037317 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f2a000b6620 0x7f2a000b8b30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2a18077160 tx=0x7f2a0c00b410 comp rx=0 tx=0).stop 2024-09-21T05:48:31.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.077+0000 7f2a1d45f640 1 -- 172.21.15.70:0/3382037317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a18109e20 msgr2=0x7f2a18076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:31.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.077+0000 7f2a1d45f640 1 --2- 172.21.15.70:0/3382037317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a18109e20 0x7f2a18076190 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2a1000eb10 tx=0x7f2a1000c2d0 comp rx=0 tx=0).stop 2024-09-21T05:48:31.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.077+0000 7f2a1d45f640 1 -- 172.21.15.70:0/3382037317 shutdown_connections 2024-09-21T05:48:31.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.078+0000 7f2a1d45f640 1 --2- 172.21.15.70:0/3382037317 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f2a000b6620 0x7f2a000b8b30 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:31.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.078+0000 7f2a1d45f640 1 --2- 172.21.15.70:0/3382037317 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a181094d0 0x7f2a18075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:31.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.078+0000 7f2a1d45f640 1 --2- 172.21.15.70:0/3382037317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a18109e20 0x7f2a18076190 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:31.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.078+0000 7f2a1d45f640 1 --2- 172.21.15.70:0/3382037317 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a18103b90 0x7f2a18075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:31.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.078+0000 7f2a1d45f640 1 -- 172.21.15.70:0/3382037317 >> 172.21.15.70:0/3382037317 conn(0x7f2a180ff600 msgr2=0x7f2a18101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:31.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.078+0000 7f2a1d45f640 1 -- 172.21.15.70:0/3382037317 shutdown_connections 2024-09-21T05:48:31.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.078+0000 7f2a1d45f640 1 -- 172.21.15.70:0/3382037317 wait complete. 2024-09-21T05:48:31.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.087+0000 7f4fbf8e5640 1 -- 172.21.15.70:0/441909232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fb8102aa0 msgr2=0x7f4fb8102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:31.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.087+0000 7f4fbf8e5640 1 --2- 172.21.15.70:0/441909232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fb8102aa0 0x7f4fb8102eb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4009900 tx=0x7f4fb402a410 comp rx=0 tx=0).stop 2024-09-21T05:48:31.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.088+0000 7f4fbf8e5640 1 -- 172.21.15.70:0/441909232 shutdown_connections 2024-09-21T05:48:31.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.088+0000 7f4fbf8e5640 1 --2- 172.21.15.70:0/441909232 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fb8108d30 0x7f4fb810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:31.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.088+0000 7f4fbf8e5640 1 --2- 172.21.15.70:0/441909232 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4fb81083e0 0x7f4fb81087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:31.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.088+0000 7f4fbf8e5640 1 --2- 172.21.15.70:0/441909232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fb8102aa0 0x7f4fb8102eb0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:31.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.088+0000 7f4fbf8e5640 1 -- 172.21.15.70:0/441909232 >> 172.21.15.70:0/441909232 conn(0x7f4fb80797e0 msgr2=0x7f4fb8079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:31.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.088+0000 7f4fbf8e5640 1 -- 172.21.15.70:0/441909232 shutdown_connections 2024-09-21T05:48:31.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.088+0000 7f4fbf8e5640 1 -- 172.21.15.70:0/441909232 wait complete. 2024-09-21T05:48:31.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.088+0000 7f4fbf8e5640 1 Processor -- start 2024-09-21T05:48:31.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.089+0000 7f4fbf8e5640 1 -- start start 2024-09-21T05:48:31.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.089+0000 7f4fbf8e5640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fb8102aa0 0x7f4fb819b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:31.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.089+0000 7f4fbf8e5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fb81083e0 0x7f4fb819b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:31.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.089+0000 7f4fbf8e5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4fb8108d30 0x7f4fb819bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:31.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.089+0000 7f4fbf8e5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb8112990 con 0x7f4fb81083e0 2024-09-21T05:48:31.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.089+0000 7f4fbf8e5640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb8112810 con 0x7f4fb8108d30 2024-09-21T05:48:31.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.089+0000 7f4fbf8e5640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb8112b10 con 0x7f4fb8102aa0 2024-09-21T05:48:31.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.089+0000 7f4fbce80640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fb81083e0 0x7f4fb819b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:31.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.089+0000 7f4fbce80640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fb81083e0 0x7f4fb819b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45000/0 (socket says 172.21.15.70:45000) 2024-09-21T05:48:31.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.089+0000 7f4fbce80640 1 -- 172.21.15.70:0/1869844867 learned_addr learned my addr 172.21.15.70:0/1869844867 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:31.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.089+0000 7f4fbde82640 1 --2- 172.21.15.70:0/1869844867 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4fb8108d30 0x7f4fb819bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:31.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.089+0000 7f4fbd681640 1 --2- 172.21.15.70:0/1869844867 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fb8102aa0 0x7f4fb819b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:31.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.089+0000 7f4fbce80640 1 -- 172.21.15.70:0/1869844867 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fb8102aa0 msgr2=0x7f4fb819b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:31.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.089+0000 7f4fbce80640 1 --2- 172.21.15.70:0/1869844867 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fb8102aa0 0x7f4fb819b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:31.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.089+0000 7f4fbce80640 1 -- 172.21.15.70:0/1869844867 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4fb8108d30 msgr2=0x7f4fb819bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:31.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.089+0000 7f4fbce80640 1 --2- 172.21.15.70:0/1869844867 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4fb8108d30 0x7f4fb819bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:31.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.089+0000 7f4fbce80640 1 -- 172.21.15.70:0/1869844867 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fb81a65b0 con 0x7f4fb81083e0 2024-09-21T05:48:31.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.090+0000 7f4fbce80640 1 --2- 172.21.15.70:0/1869844867 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fb81083e0 0x7f4fb819b7e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4fa800d770 tx=0x7f4fa800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:31.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.090+0000 7f4fae7fc640 1 -- 172.21.15.70:0/1869844867 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa8017070 con 0x7f4fb81083e0 2024-09-21T05:48:31.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.090+0000 7f4fae7fc640 1 -- 172.21.15.70:0/1869844867 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f4fa8009c30 con 0x7f4fb81083e0 2024-09-21T05:48:31.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.090+0000 7f4fbf8e5640 1 -- 172.21.15.70:0/1869844867 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fb81a68a0 con 0x7f4fb81083e0 2024-09-21T05:48:31.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.090+0000 7f4fbf8e5640 1 -- 172.21.15.70:0/1869844867 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fb81a6e30 con 0x7f4fb81083e0 2024-09-21T05:48:31.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.090+0000 7f4fae7fc640 1 -- 172.21.15.70:0/1869844867 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa800f620 con 0x7f4fb81083e0 2024-09-21T05:48:31.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.091+0000 7f4fbf8e5640 1 -- 172.21.15.70:0/1869844867 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4fb8063b50 con 0x7f4fb81083e0 2024-09-21T05:48:31.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.094+0000 7f4fae7fc640 1 -- 172.21.15.70:0/1869844867 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f4fa801a070 con 0x7f4fb81083e0 2024-09-21T05:48:31.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.094+0000 7f4fae7fc640 1 --2- 172.21.15.70:0/1869844867 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4fa40b6620 0x7f4fa40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:31.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.094+0000 7f4fbd681640 1 --2- 172.21.15.70:0/1869844867 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4fa40b6620 0x7f4fa40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:31.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.095+0000 7f4fae7fc640 1 -- 172.21.15.70:0/1869844867 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f4fa80e7530 con 0x7f4fb81083e0 2024-09-21T05:48:31.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.095+0000 7f4fae7fc640 1 --2- 172.21.15.70:0/1869844867 >> [v2:172.21.15.160:6816/3381625184,v1:172.21.15.160:6817/3381625184] conn(0x7f4fa40c1730 0x7f4fa40c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:31.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.095+0000 7f4fae7fc640 1 -- 172.21.15.70:0/1869844867 --> [v2:172.21.15.160:6816/3381625184,v1:172.21.15.160:6817/3381625184] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4fa40c42f0 con 0x7f4fa40c1730 2024-09-21T05:48:31.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.095+0000 7f4fae7fc640 1 -- 172.21.15.70:0/1869844867 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f4fa80e7980 con 0x7f4fb81083e0 2024-09-21T05:48:31.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.095+0000 7f4fbd681640 1 --2- 172.21.15.70:0/1869844867 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4fa40b6620 0x7f4fa40b8b30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4000c00 tx=0x7f4fb4005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:31.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.096+0000 7f4fbde82640 1 --2- 172.21.15.70:0/1869844867 >> [v2:172.21.15.160:6816/3381625184,v1:172.21.15.160:6817/3381625184] conn(0x7f4fa40c1730 0x7f4fa40c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:31.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.096+0000 7f4fbde82640 1 --2- 172.21.15.70:0/1869844867 >> [v2:172.21.15.160:6816/3381625184,v1:172.21.15.160:6817/3381625184] conn(0x7f4fa40c1730 0x7f4fa40c3c20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:31.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.097+0000 7f4fae7fc640 1 -- 172.21.15.70:0/1869844867 <== osd.8 v2:172.21.15.160:6816/3381625184 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4fa40c42f0 con 0x7f4fa40c1730 2024-09-21T05:48:31.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.111+0000 7f4fbf8e5640 1 -- 172.21.15.70:0/1869844867 --> [v2:172.21.15.160:6816/3381625184,v1:172.21.15.160:6817/3381625184] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4fb8063f50 con 0x7f4fa40c1730 2024-09-21T05:48:31.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.112+0000 7f4fae7fc640 1 -- 172.21.15.70:0/1869844867 <== osd.8 v2:172.21.15.160:6816/3381625184 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4fb8063f50 con 0x7f4fa40c1730 2024-09-21T05:48:31.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.112+0000 7f4fbf8e5640 1 -- 172.21.15.70:0/1869844867 >> [v2:172.21.15.160:6816/3381625184,v1:172.21.15.160:6817/3381625184] conn(0x7f4fa40c1730 msgr2=0x7f4fa40c3c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:31.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.112+0000 7f4fbf8e5640 1 --2- 172.21.15.70:0/1869844867 >> [v2:172.21.15.160:6816/3381625184,v1:172.21.15.160:6817/3381625184] conn(0x7f4fa40c1730 0x7f4fa40c3c20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:31.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.112+0000 7f4fbf8e5640 1 -- 172.21.15.70:0/1869844867 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4fa40b6620 msgr2=0x7f4fa40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:31.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.112+0000 7f4fbf8e5640 1 --2- 172.21.15.70:0/1869844867 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4fa40b6620 0x7f4fa40b8b30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4000c00 tx=0x7f4fb4005d50 comp rx=0 tx=0).stop 2024-09-21T05:48:31.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.112+0000 7f4fbf8e5640 1 -- 172.21.15.70:0/1869844867 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fb81083e0 msgr2=0x7f4fb819b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:31.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.112+0000 7f4fbf8e5640 1 --2- 172.21.15.70:0/1869844867 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fb81083e0 0x7f4fb819b7e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4fa800d770 tx=0x7f4fa800dc30 comp rx=0 tx=0).stop 2024-09-21T05:48:31.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.112+0000 7f4fbde82640 1 -- 172.21.15.70:0/1869844867 reap_dead start 2024-09-21T05:48:31.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.113+0000 7f4fbf8e5640 1 -- 172.21.15.70:0/1869844867 shutdown_connections 2024-09-21T05:48:31.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.113+0000 7f4fbf8e5640 1 -- 172.21.15.70:0/1869844867 >> 172.21.15.70:0/1869844867 conn(0x7f4fb80797e0 msgr2=0x7f4fb8101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:31.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.113+0000 7f4fbf8e5640 1 -- 172.21.15.70:0/1869844867 shutdown_connections 2024-09-21T05:48:31.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:31.113+0000 7f4fbf8e5640 1 -- 172.21.15.70:0/1869844867 wait complete. 2024-09-21T05:48:31.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:30 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2832587060' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T05:48:31.946 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:31 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3416667280' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T05:48:31.946 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:31 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3382037317' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T05:48:31.946 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:31 smithi070 ceph-mon[30981]: pgmap v340: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-21T05:48:32.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:31 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3416667280' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T05:48:32.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:31 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3382037317' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T05:48:32.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:31 smithi116 ceph-mon[34332]: pgmap v340: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-21T05:48:32.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:31 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3416667280' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T05:48:32.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:31 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3382037317' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T05:48:32.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:31 smithi160 ceph-mon[33979]: pgmap v340: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-21T05:48:32.850 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:32.851 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:33.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.050+0000 7fea111f7640 1 -- 172.21.15.70:0/974374653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea0c104860 msgr2=0x7fea0c104c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:33.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.050+0000 7fea111f7640 1 --2- 172.21.15.70:0/974374653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea0c104860 0x7fea0c104c70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc009900 tx=0x7fe9fc02a410 comp rx=0 tx=0).stop 2024-09-21T05:48:33.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.050+0000 7fea111f7640 1 -- 172.21.15.70:0/974374653 shutdown_connections 2024-09-21T05:48:33.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.050+0000 7fea111f7640 1 --2- 172.21.15.70:0/974374653 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea0c10de10 0x7fea0c110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:33.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.050+0000 7fea111f7640 1 --2- 172.21.15.70:0/974374653 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea0c105290 0x7fea0c10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:33.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.050+0000 7fea111f7640 1 --2- 172.21.15.70:0/974374653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea0c104860 0x7fea0c104c70 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:33.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.050+0000 7fea111f7640 1 -- 172.21.15.70:0/974374653 >> 172.21.15.70:0/974374653 conn(0x7fea0c079740 msgr2=0x7fea0c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:33.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.050+0000 7fea111f7640 1 -- 172.21.15.70:0/974374653 shutdown_connections 2024-09-21T05:48:33.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.050+0000 7fea111f7640 1 -- 172.21.15.70:0/974374653 wait complete. 2024-09-21T05:48:33.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.051+0000 7fea111f7640 1 Processor -- start 2024-09-21T05:48:33.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.051+0000 7fea111f7640 1 -- start start 2024-09-21T05:48:33.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.052+0000 7fea111f7640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea0c104860 0x7fea0c19a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:33.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.052+0000 7fea111f7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea0c105290 0x7fea0c19aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:33.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.052+0000 7fea111f7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea0c10de10 0x7fea0c19fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:33.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.052+0000 7fea111f7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fea0c113a80 con 0x7fea0c105290 2024-09-21T05:48:33.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.052+0000 7fea111f7640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fea0c113900 con 0x7fea0c10de10 2024-09-21T05:48:33.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.052+0000 7fea111f7640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fea0c113c00 con 0x7fea0c104860 2024-09-21T05:48:33.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.052+0000 7fea0a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea0c105290 0x7fea0c19aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:33.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.052+0000 7fea0a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea0c105290 0x7fea0c19aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45020/0 (socket says 172.21.15.70:45020) 2024-09-21T05:48:33.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.052+0000 7fea0a59c640 1 -- 172.21.15.70:0/778684777 learned_addr learned my addr 172.21.15.70:0/778684777 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:33.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.052+0000 7fea0b59e640 1 --2- 172.21.15.70:0/778684777 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea0c10de10 0x7fea0c19fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:33.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.052+0000 7fea0a59c640 1 -- 172.21.15.70:0/778684777 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea0c104860 msgr2=0x7fea0c19a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:33.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.052+0000 7fea0a59c640 1 --2- 172.21.15.70:0/778684777 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea0c104860 0x7fea0c19a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:33.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.052+0000 7fea0a59c640 1 -- 172.21.15.70:0/778684777 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea0c10de10 msgr2=0x7fea0c19fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:33.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.052+0000 7fea0a59c640 1 --2- 172.21.15.70:0/778684777 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea0c10de10 0x7fea0c19fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:33.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.052+0000 7fea0a59c640 1 -- 172.21.15.70:0/778684777 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea0c1a0460 con 0x7fea0c105290 2024-09-21T05:48:33.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.053+0000 7fea0a59c640 1 --2- 172.21.15.70:0/778684777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea0c105290 0x7fea0c19aa90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fea0000d740 tx=0x7fea0000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:33.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.053+0000 7fe9f3fff640 1 -- 172.21.15.70:0/778684777 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea00017070 con 0x7fea0c105290 2024-09-21T05:48:33.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.053+0000 7fea111f7640 1 -- 172.21.15.70:0/778684777 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea0c1a0750 con 0x7fea0c105290 2024-09-21T05:48:33.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.053+0000 7fe9f3fff640 1 -- 172.21.15.70:0/778684777 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fea0000de50 con 0x7fea0c105290 2024-09-21T05:48:33.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.053+0000 7fe9f3fff640 1 -- 172.21.15.70:0/778684777 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0000f620 con 0x7fea0c105290 2024-09-21T05:48:33.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.053+0000 7fea111f7640 1 -- 172.21.15.70:0/778684777 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea0c1a6eb0 con 0x7fea0c105290 2024-09-21T05:48:33.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.054+0000 7fea111f7640 1 -- 172.21.15.70:0/778684777 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea0c104c70 con 0x7fea0c105290 2024-09-21T05:48:33.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.056+0000 7fe9f3fff640 1 -- 172.21.15.70:0/778684777 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fea0001a070 con 0x7fea0c105290 2024-09-21T05:48:33.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.056+0000 7fe9f3fff640 1 --2- 172.21.15.70:0/778684777 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe9f40b65a0 0x7fe9f40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:33.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.056+0000 7fea0ad9d640 1 --2- 172.21.15.70:0/778684777 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe9f40b65a0 0x7fe9f40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:33.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.056+0000 7fe9f3fff640 1 -- 172.21.15.70:0/778684777 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7fea000e7150 con 0x7fea0c105290 2024-09-21T05:48:33.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.057+0000 7fea0ad9d640 1 --2- 172.21.15.70:0/778684777 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe9f40b65a0 0x7fe9f40b8ab0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc005f70 tx=0x7fe9fc005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:33.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.060+0000 7fe9f3fff640 1 -- 172.21.15.70:0/778684777 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fea000ad520 con 0x7fea0c105290 2024-09-21T05:48:33.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.241+0000 7fea111f7640 1 -- 172.21.15.70:0/778684777 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fea0c02e640 con 0x7fea0c105290 2024-09-21T05:48:33.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.241+0000 7fe9f3fff640 1 -- 172.21.15.70:0/778684777 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fea000b1900 con 0x7fea0c105290 2024-09-21T05:48:33.244 INFO:teuthology.orchestra.run.smithi070.stdout:296352743454 2024-09-21T05:48:33.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.244+0000 7fea111f7640 1 -- 172.21.15.70:0/778684777 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe9f40b65a0 msgr2=0x7fe9f40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:33.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.244+0000 7fea111f7640 1 --2- 172.21.15.70:0/778684777 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe9f40b65a0 0x7fe9f40b8ab0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc005f70 tx=0x7fe9fc005d50 comp rx=0 tx=0).stop 2024-09-21T05:48:33.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.244+0000 7fea111f7640 1 -- 172.21.15.70:0/778684777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea0c105290 msgr2=0x7fea0c19aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:33.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.244+0000 7fea111f7640 1 --2- 172.21.15.70:0/778684777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea0c105290 0x7fea0c19aa90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fea0000d740 tx=0x7fea0000dc00 comp rx=0 tx=0).stop 2024-09-21T05:48:33.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.244+0000 7fea111f7640 1 -- 172.21.15.70:0/778684777 shutdown_connections 2024-09-21T05:48:33.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.244+0000 7fea111f7640 1 --2- 172.21.15.70:0/778684777 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe9f40b65a0 0x7fe9f40b8ab0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:33.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.244+0000 7fea111f7640 1 --2- 172.21.15.70:0/778684777 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea0c10de10 0x7fea0c19fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:33.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.244+0000 7fea111f7640 1 --2- 172.21.15.70:0/778684777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea0c105290 0x7fea0c19aa90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:33.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.244+0000 7fea111f7640 1 --2- 172.21.15.70:0/778684777 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea0c104860 0x7fea0c19a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:33.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.244+0000 7fea111f7640 1 -- 172.21.15.70:0/778684777 >> 172.21.15.70:0/778684777 conn(0x7fea0c079740 msgr2=0x7fea0c100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:33.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.244+0000 7fea111f7640 1 -- 172.21.15.70:0/778684777 shutdown_connections 2024-09-21T05:48:33.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.244+0000 7fea111f7640 1 -- 172.21.15.70:0/778684777 wait complete. 2024-09-21T05:48:33.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:33 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/778684777' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T05:48:33.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:33 smithi070 ceph-mon[30981]: pgmap v341: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-09-21T05:48:33.505 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738451 got 34359738453 for osd.0 2024-09-21T05:48:33.505 DEBUG:teuthology.parallel:result is None 2024-09-21T05:48:33.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:33 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/778684777' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T05:48:33.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:33 smithi116 ceph-mon[34332]: pgmap v341: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-09-21T05:48:33.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:33 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/778684777' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T05:48:33.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:33 smithi160 ceph-mon[33979]: pgmap v341: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-09-21T05:48:34.592 INFO:tasks.cephadm.ceph_manager.ceph:need seq 124554051647 got 124554051650 for osd.4 2024-09-21T05:48:34.592 DEBUG:teuthology.parallel:result is None 2024-09-21T05:48:34.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:34 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/822664680' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T05:48:34.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.763+0000 7f85726e4640 1 -- 172.21.15.70:0/2146976184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f856c107690 msgr2=0x7f856c107aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:34.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.763+0000 7f85726e4640 1 --2- 172.21.15.70:0/2146976184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f856c107690 0x7f856c107aa0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f855c009900 tx=0x7f855c02a410 comp rx=0 tx=0).stop 2024-09-21T05:48:34.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.763+0000 7f85726e4640 1 -- 172.21.15.70:0/2146976184 shutdown_connections 2024-09-21T05:48:34.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.763+0000 7f85726e4640 1 --2- 172.21.15.70:0/2146976184 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f856c103950 0x7f856c10f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:34.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.763+0000 7f85726e4640 1 --2- 172.21.15.70:0/2146976184 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f856c103000 0x7f856c103410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:34.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.763+0000 7f85726e4640 1 --2- 172.21.15.70:0/2146976184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f856c107690 0x7f856c107aa0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:34.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.763+0000 7f85726e4640 1 -- 172.21.15.70:0/2146976184 >> 172.21.15.70:0/2146976184 conn(0x7f856c079ea0 msgr2=0x7f856c07a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:34.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.763+0000 7f85726e4640 1 -- 172.21.15.70:0/2146976184 shutdown_connections 2024-09-21T05:48:34.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.763+0000 7f85726e4640 1 -- 172.21.15.70:0/2146976184 wait complete. 2024-09-21T05:48:34.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.763+0000 7f85726e4640 1 Processor -- start 2024-09-21T05:48:34.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.763+0000 7f85726e4640 1 -- start start 2024-09-21T05:48:34.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.764+0000 7f85726e4640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f856c103000 0x7f856c19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:34.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.764+0000 7f85726e4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f856c103950 0x7f856c19abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:34.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.764+0000 7f85726e4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f856c107690 0x7f856c19fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:34.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.764+0000 7f85726e4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f856c112a90 con 0x7f856c103950 2024-09-21T05:48:34.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.764+0000 7f85726e4640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f856c112910 con 0x7f856c103000 2024-09-21T05:48:34.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.764+0000 7f85726e4640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f856c112c10 con 0x7f856c107690 2024-09-21T05:48:34.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.764+0000 7f856b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f856c103950 0x7f856c19abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:34.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.764+0000 7f856b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f856c103950 0x7f856c19abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45062/0 (socket says 172.21.15.70:45062) 2024-09-21T05:48:34.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.764+0000 7f856b7fe640 1 -- 172.21.15.70:0/2125078908 learned_addr learned my addr 172.21.15.70:0/2125078908 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:34.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.764+0000 7f856bfff640 1 --2- 172.21.15.70:0/2125078908 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f856c103000 0x7f856c19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:34.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.764+0000 7f8570c81640 1 --2- 172.21.15.70:0/2125078908 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f856c107690 0x7f856c19fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:34.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.764+0000 7f856b7fe640 1 -- 172.21.15.70:0/2125078908 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f856c107690 msgr2=0x7f856c19fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:34.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.764+0000 7f856b7fe640 1 --2- 172.21.15.70:0/2125078908 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f856c107690 0x7f856c19fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:34.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.764+0000 7f856b7fe640 1 -- 172.21.15.70:0/2125078908 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f856c103000 msgr2=0x7f856c19a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:34.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.764+0000 7f856b7fe640 1 --2- 172.21.15.70:0/2125078908 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f856c103000 0x7f856c19a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:34.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.764+0000 7f856b7fe640 1 -- 172.21.15.70:0/2125078908 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f856c1a05a0 con 0x7f856c103950 2024-09-21T05:48:34.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.764+0000 7f856bfff640 1 --2- 172.21.15.70:0/2125078908 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f856c103000 0x7f856c19a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:48:34.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.765+0000 7f856b7fe640 1 --2- 172.21.15.70:0/2125078908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f856c103950 0x7f856c19abd0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f856000d740 tx=0x7f856000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:34.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.765+0000 7f85697fa640 1 -- 172.21.15.70:0/2125078908 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8560017070 con 0x7f856c103950 2024-09-21T05:48:34.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.765+0000 7f85697fa640 1 -- 172.21.15.70:0/2125078908 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f856000de50 con 0x7f856c103950 2024-09-21T05:48:34.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.765+0000 7f85726e4640 1 -- 172.21.15.70:0/2125078908 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f856c1a0890 con 0x7f856c103950 2024-09-21T05:48:34.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.765+0000 7f85697fa640 1 -- 172.21.15.70:0/2125078908 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8560003cc0 con 0x7f856c103950 2024-09-21T05:48:34.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.765+0000 7f85726e4640 1 -- 172.21.15.70:0/2125078908 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f856c1a6ff0 con 0x7f856c103950 2024-09-21T05:48:34.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.766+0000 7f85726e4640 1 -- 172.21.15.70:0/2125078908 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f856c103410 con 0x7f856c103950 2024-09-21T05:48:34.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.768+0000 7f85697fa640 1 -- 172.21.15.70:0/2125078908 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f8560003e60 con 0x7f856c103950 2024-09-21T05:48:34.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.769+0000 7f85697fa640 1 --2- 172.21.15.70:0/2125078908 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f85540b65a0 0x7f85540b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:34.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.769+0000 7f856bfff640 1 --2- 172.21.15.70:0/2125078908 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f85540b65a0 0x7f85540b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:34.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.769+0000 7f85697fa640 1 -- 172.21.15.70:0/2125078908 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f85600e7660 con 0x7f856c103950 2024-09-21T05:48:34.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.769+0000 7f856bfff640 1 --2- 172.21.15.70:0/2125078908 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f85540b65a0 0x7f85540b8ab0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f855c005d90 tx=0x7f855c009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:34.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.772+0000 7f85697fa640 1 -- 172.21.15.70:0/2125078908 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f85600ada30 con 0x7f856c103950 2024-09-21T05:48:34.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:34 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/822664680' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T05:48:34.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:34 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/822664680' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T05:48:34.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.770+0000 7f9f35c4d640 1 -- 172.21.15.70:0/248850632 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f30105310 msgr2=0x7f9f3010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:34.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.770+0000 7f9f35c4d640 1 --2- 172.21.15.70:0/248850632 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f30105310 0x7f9f3010d950 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9f18009900 tx=0x7f9f1802a410 comp rx=0 tx=0).stop 2024-09-21T05:48:34.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.770+0000 7f9f35c4d640 1 -- 172.21.15.70:0/248850632 shutdown_connections 2024-09-21T05:48:34.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.770+0000 7f9f35c4d640 1 --2- 172.21.15.70:0/248850632 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9f3010de90 0x7f9f30110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:34.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.770+0000 7f9f35c4d640 1 --2- 172.21.15.70:0/248850632 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f30105310 0x7f9f3010d950 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:34.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.770+0000 7f9f35c4d640 1 --2- 172.21.15.70:0/248850632 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f301048e0 0x7f9f30104cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:34.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.770+0000 7f9f35c4d640 1 -- 172.21.15.70:0/248850632 >> 172.21.15.70:0/248850632 conn(0x7f9f300797b0 msgr2=0x7f9f30079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:34.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.770+0000 7f9f35c4d640 1 -- 172.21.15.70:0/248850632 shutdown_connections 2024-09-21T05:48:34.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.770+0000 7f9f35c4d640 1 -- 172.21.15.70:0/248850632 wait complete. 2024-09-21T05:48:34.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.771+0000 7f9f35c4d640 1 Processor -- start 2024-09-21T05:48:34.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.771+0000 7f9f35c4d640 1 -- start start 2024-09-21T05:48:34.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.771+0000 7f9f35c4d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f301048e0 0x7f9f3019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:34.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.771+0000 7f9f35c4d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f30105310 0x7f9f3019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:34.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.771+0000 7f9f35c4d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9f3010de90 0x7f9f3019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:34.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.771+0000 7f9f35c4d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9f30113a70 con 0x7f9f30105310 2024-09-21T05:48:34.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.771+0000 7f9f35c4d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9f301138f0 con 0x7f9f3010de90 2024-09-21T05:48:34.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.771+0000 7f9f35c4d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9f30113bf0 con 0x7f9f301048e0 2024-09-21T05:48:34.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.771+0000 7f9f26ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f30105310 0x7f9f3019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:34.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.772+0000 7f9f26ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f30105310 0x7f9f3019aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45044/0 (socket says 172.21.15.70:45044) 2024-09-21T05:48:34.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.772+0000 7f9f26ffd640 1 -- 172.21.15.70:0/822664680 learned_addr learned my addr 172.21.15.70:0/822664680 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:34.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.772+0000 7f9f2ffff640 1 --2- 172.21.15.70:0/822664680 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9f3010de90 0x7f9f3019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:34.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.772+0000 7f9f26ffd640 1 -- 172.21.15.70:0/822664680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f301048e0 msgr2=0x7f9f3019a4c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T05:48:34.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.772+0000 7f9f26ffd640 1 --2- 172.21.15.70:0/822664680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f301048e0 0x7f9f3019a4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:34.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.772+0000 7f9f26ffd640 1 -- 172.21.15.70:0/822664680 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9f3010de90 msgr2=0x7f9f3019fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:34.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.772+0000 7f9f26ffd640 1 --2- 172.21.15.70:0/822664680 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9f3010de90 0x7f9f3019fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:34.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.772+0000 7f9f26ffd640 1 -- 172.21.15.70:0/822664680 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f301a0430 con 0x7f9f30105310 2024-09-21T05:48:34.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.772+0000 7f9f26ffd640 1 --2- 172.21.15.70:0/822664680 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f30105310 0x7f9f3019aa60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9f1802a930 tx=0x7f9f18004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:34.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.772+0000 7f9f2d7fa640 1 -- 172.21.15.70:0/822664680 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1803f030 con 0x7f9f30105310 2024-09-21T05:48:34.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.772+0000 7f9f35c4d640 1 -- 172.21.15.70:0/822664680 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f301a06c0 con 0x7f9f30105310 2024-09-21T05:48:34.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.772+0000 7f9f2d7fa640 1 -- 172.21.15.70:0/822664680 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f9f180044d0 con 0x7f9f30105310 2024-09-21T05:48:34.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.772+0000 7f9f2d7fa640 1 -- 172.21.15.70:0/822664680 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f18035070 con 0x7f9f30105310 2024-09-21T05:48:34.910 INFO:teuthology.orchestra.run.smithi070.stdout:249108103209 2024-09-21T05:48:34.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.772+0000 7f9f35c4d640 1 -- 172.21.15.70:0/822664680 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f301a6e80 con 0x7f9f30105310 2024-09-21T05:48:34.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.773+0000 7f9f35c4d640 1 -- 172.21.15.70:0/822664680 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f3006be50 con 0x7f9f30105310 2024-09-21T05:48:34.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.775+0000 7f9f2d7fa640 1 -- 172.21.15.70:0/822664680 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f9f18003ab0 con 0x7f9f30105310 2024-09-21T05:48:34.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.775+0000 7f9f2d7fa640 1 --2- 172.21.15.70:0/822664680 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f9f1c0b65a0 0x7f9f1c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:34.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.776+0000 7f9f2f7fe640 1 --2- 172.21.15.70:0/822664680 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f9f1c0b65a0 0x7f9f1c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:34.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.776+0000 7f9f2d7fa640 1 -- 172.21.15.70:0/822664680 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f9f18108590 con 0x7f9f30105310 2024-09-21T05:48:34.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.776+0000 7f9f2f7fe640 1 --2- 172.21.15.70:0/822664680 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f9f1c0b65a0 0x7f9f1c0b8ab0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9f2000a890 tx=0x7f9f20005b80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:34.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.779+0000 7f9f2d7fa640 1 -- 172.21.15.70:0/822664680 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9f180ce960 con 0x7f9f30105310 2024-09-21T05:48:34.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.962+0000 7f9f35c4d640 1 -- 172.21.15.70:0/822664680 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f9f30108fc0 con 0x7f9f30105310 2024-09-21T05:48:34.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.963+0000 7f9f2d7fa640 1 -- 172.21.15.70:0/822664680 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9f180d2d40 con 0x7f9f30105310 2024-09-21T05:48:34.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.965+0000 7f9f35c4d640 1 -- 172.21.15.70:0/822664680 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f9f1c0b65a0 msgr2=0x7f9f1c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:34.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.965+0000 7f9f35c4d640 1 --2- 172.21.15.70:0/822664680 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f9f1c0b65a0 0x7f9f1c0b8ab0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9f2000a890 tx=0x7f9f20005b80 comp rx=0 tx=0).stop 2024-09-21T05:48:34.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.965+0000 7f9f35c4d640 1 -- 172.21.15.70:0/822664680 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f30105310 msgr2=0x7f9f3019aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:34.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.965+0000 7f9f35c4d640 1 --2- 172.21.15.70:0/822664680 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f30105310 0x7f9f3019aa60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9f1802a930 tx=0x7f9f18004270 comp rx=0 tx=0).stop 2024-09-21T05:48:34.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.965+0000 7f9f35c4d640 1 -- 172.21.15.70:0/822664680 shutdown_connections 2024-09-21T05:48:34.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.965+0000 7f9f35c4d640 1 --2- 172.21.15.70:0/822664680 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f9f1c0b65a0 0x7f9f1c0b8ab0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:34.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.965+0000 7f9f35c4d640 1 --2- 172.21.15.70:0/822664680 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9f3010de90 0x7f9f3019fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:34.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.965+0000 7f9f35c4d640 1 --2- 172.21.15.70:0/822664680 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f30105310 0x7f9f3019aa60 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:34.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.965+0000 7f9f35c4d640 1 --2- 172.21.15.70:0/822664680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f301048e0 0x7f9f3019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:34.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.965+0000 7f9f35c4d640 1 -- 172.21.15.70:0/822664680 >> 172.21.15.70:0/822664680 conn(0x7f9f300797b0 msgr2=0x7f9f30100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:34.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.965+0000 7f9f35c4d640 1 -- 172.21.15.70:0/822664680 shutdown_connections 2024-09-21T05:48:34.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:33.965+0000 7f9f35c4d640 1 -- 172.21.15.70:0/822664680 wait complete. 2024-09-21T05:48:34.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.955+0000 7f85726e4640 1 -- 172.21.15.70:0/2125078908 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f856c10bb20 con 0x7f856c103950 2024-09-21T05:48:34.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.956+0000 7f85697fa640 1 -- 172.21.15.70:0/2125078908 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f85600b1e10 con 0x7f856c103950 2024-09-21T05:48:34.958 INFO:teuthology.orchestra.run.smithi070.stdout:270582939684 2024-09-21T05:48:34.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.958+0000 7f85726e4640 1 -- 172.21.15.70:0/2125078908 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f85540b65a0 msgr2=0x7f85540b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:34.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.958+0000 7f85726e4640 1 --2- 172.21.15.70:0/2125078908 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f85540b65a0 0x7f85540b8ab0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f855c005d90 tx=0x7f855c009680 comp rx=0 tx=0).stop 2024-09-21T05:48:34.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.958+0000 7f85726e4640 1 -- 172.21.15.70:0/2125078908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f856c103950 msgr2=0x7f856c19abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:34.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.958+0000 7f85726e4640 1 --2- 172.21.15.70:0/2125078908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f856c103950 0x7f856c19abd0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f856000d740 tx=0x7f856000dc00 comp rx=0 tx=0).stop 2024-09-21T05:48:34.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.958+0000 7f85726e4640 1 -- 172.21.15.70:0/2125078908 shutdown_connections 2024-09-21T05:48:34.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.958+0000 7f85726e4640 1 --2- 172.21.15.70:0/2125078908 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f85540b65a0 0x7f85540b8ab0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:34.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.958+0000 7f85726e4640 1 --2- 172.21.15.70:0/2125078908 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f856c107690 0x7f856c19fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:34.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.958+0000 7f85726e4640 1 --2- 172.21.15.70:0/2125078908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f856c103950 0x7f856c19abd0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:34.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.958+0000 7f85726e4640 1 --2- 172.21.15.70:0/2125078908 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f856c103000 0x7f856c19a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:34.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.958+0000 7f85726e4640 1 -- 172.21.15.70:0/2125078908 >> 172.21.15.70:0/2125078908 conn(0x7f856c079ea0 msgr2=0x7f856c106650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:34.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.958+0000 7f85726e4640 1 -- 172.21.15.70:0/2125078908 shutdown_connections 2024-09-21T05:48:34.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:34.958+0000 7f85726e4640 1 -- 172.21.15.70:0/2125078908 wait complete. 2024-09-21T05:48:35.572 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103206 got 249108103209 for osd.9 2024-09-21T05:48:35.572 DEBUG:teuthology.parallel:result is None 2024-09-21T05:48:35.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:35 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2125078908' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T05:48:35.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:35 smithi070 ceph-mon[30981]: pgmap v342: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-09-21T05:48:35.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:35 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2125078908' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T05:48:35.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:35 smithi116 ceph-mon[34332]: pgmap v342: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-09-21T05:48:35.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:35 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2125078908' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T05:48:35.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:35 smithi160 ceph-mon[33979]: pgmap v342: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-09-21T05:48:35.982 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743452 got 296352743454 for osd.11 2024-09-21T05:48:35.983 DEBUG:teuthology.parallel:result is None 2024-09-21T05:48:36.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:36 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/143441309' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T05:48:37.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:36 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/143441309' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T05:48:37.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:36 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/143441309' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T05:48:37.386 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607631 got 51539607632 for osd.1 2024-09-21T05:48:37.386 DEBUG:teuthology.parallel:result is None 2024-09-21T05:48:37.614 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939682 got 270582939684 for osd.10 2024-09-21T05:48:37.615 DEBUG:teuthology.parallel:result is None 2024-09-21T05:48:37.730 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:37 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]} : dispatch 2024-09-21T05:48:37.730 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:37 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]} : dispatch 2024-09-21T05:48:37.730 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:37 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2024-09-21T05:48:37.730 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:37 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]} : dispatch 2024-09-21T05:48:37.730 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:37 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]} : dispatch 2024-09-21T05:48:37.730 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:37 smithi070 ceph-mon[30981]: pgmap v343: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-21T05:48:38.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:37 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]} : dispatch 2024-09-21T05:48:38.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:37 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]} : dispatch 2024-09-21T05:48:38.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:37 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2024-09-21T05:48:38.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:37 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]} : dispatch 2024-09-21T05:48:38.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:37 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]} : dispatch 2024-09-21T05:48:38.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:37 smithi116 ceph-mon[34332]: pgmap v343: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-21T05:48:38.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:37 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]} : dispatch 2024-09-21T05:48:38.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:37 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]} : dispatch 2024-09-21T05:48:38.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:37 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2024-09-21T05:48:38.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:37 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]} : dispatch 2024-09-21T05:48:38.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:37 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]} : dispatch 2024-09-21T05:48:38.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:37 smithi160 ceph-mon[33979]: pgmap v343: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-21T05:48:38.174 INFO:teuthology.orchestra.run.smithi070.stdout:223338299437 2024-09-21T05:48:38.174 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.8 2024-09-21T05:48:38.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.330+0000 7f203d9d0640 1 -- 172.21.15.70:0/2028987276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20381022a0 msgr2=0x7f20381026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:38.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.330+0000 7f203d9d0640 1 --2- 172.21.15.70:0/2028987276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20381022a0 0x7f20381026b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2028009900 tx=0x7f202802a410 comp rx=0 tx=0).stop 2024-09-21T05:48:38.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.330+0000 7f203d9d0640 1 -- 172.21.15.70:0/2028987276 shutdown_connections 2024-09-21T05:48:38.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.330+0000 7f203d9d0640 1 --2- 172.21.15.70:0/2028987276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2038107be0 0x7f2038107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:38.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.330+0000 7f203d9d0640 1 --2- 172.21.15.70:0/2028987276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2038108530 0x7f203810ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:38.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.330+0000 7f203d9d0640 1 --2- 172.21.15.70:0/2028987276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20381022a0 0x7f20381026b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:38.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.330+0000 7f203d9d0640 1 -- 172.21.15.70:0/2028987276 >> 172.21.15.70:0/2028987276 conn(0x7f2038079ec0 msgr2=0x7f203807a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:38.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.330+0000 7f203d9d0640 1 -- 172.21.15.70:0/2028987276 shutdown_connections 2024-09-21T05:48:38.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.330+0000 7f203d9d0640 1 -- 172.21.15.70:0/2028987276 wait complete. 2024-09-21T05:48:38.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.331+0000 7f203d9d0640 1 Processor -- start 2024-09-21T05:48:38.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.331+0000 7f203d9d0640 1 -- start start 2024-09-21T05:48:38.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.332+0000 7f203d9d0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20381022a0 0x7f2038199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:38.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.332+0000 7f203d9d0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2038107be0 0x7f20381999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:38.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.332+0000 7f203d9d0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2038108530 0x7f203819ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:38.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.332+0000 7f203d9d0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f20381121e0 con 0x7f20381022a0 2024-09-21T05:48:38.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.332+0000 7f203d9d0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2038112060 con 0x7f2038108530 2024-09-21T05:48:38.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.332+0000 7f203d9d0640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2038112360 con 0x7f2038107be0 2024-09-21T05:48:38.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.332+0000 7f2036ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20381022a0 0x7f2038199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:38.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.332+0000 7f2036ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20381022a0 0x7f2038199450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45092/0 (socket says 172.21.15.70:45092) 2024-09-21T05:48:38.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.332+0000 7f2036ffd640 1 -- 172.21.15.70:0/214628679 learned_addr learned my addr 172.21.15.70:0/214628679 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:38.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.332+0000 7f20367fc640 1 --2- 172.21.15.70:0/214628679 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2038107be0 0x7f20381999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:38.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.332+0000 7f20377fe640 1 --2- 172.21.15.70:0/214628679 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2038108530 0x7f203819ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:38.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.332+0000 7f2036ffd640 1 -- 172.21.15.70:0/214628679 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2038107be0 msgr2=0x7f20381999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:38.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.332+0000 7f2036ffd640 1 --2- 172.21.15.70:0/214628679 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2038107be0 0x7f20381999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:38.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.332+0000 7f2036ffd640 1 -- 172.21.15.70:0/214628679 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2038108530 msgr2=0x7f203819ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:38.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.332+0000 7f2036ffd640 1 --2- 172.21.15.70:0/214628679 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2038108530 0x7f203819ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:38.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.332+0000 7f2036ffd640 1 -- 172.21.15.70:0/214628679 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f203819f3c0 con 0x7f20381022a0 2024-09-21T05:48:38.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.332+0000 7f2036ffd640 1 --2- 172.21.15.70:0/214628679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20381022a0 0x7f2038199450 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2028005940 tx=0x7f20280042d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:38.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.333+0000 7f203c9ce640 1 -- 172.21.15.70:0/214628679 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202803f070 con 0x7f20381022a0 2024-09-21T05:48:38.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.333+0000 7f203d9d0640 1 -- 172.21.15.70:0/214628679 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f203819f650 con 0x7f20381022a0 2024-09-21T05:48:38.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.333+0000 7f203c9ce640 1 -- 172.21.15.70:0/214628679 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f2028003aa0 con 0x7f20381022a0 2024-09-21T05:48:38.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.333+0000 7f203d9d0640 1 -- 172.21.15.70:0/214628679 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20381a5e10 con 0x7f20381022a0 2024-09-21T05:48:38.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.333+0000 7f203c9ce640 1 -- 172.21.15.70:0/214628679 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2028035030 con 0x7f20381022a0 2024-09-21T05:48:38.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.334+0000 7f203d9d0640 1 -- 172.21.15.70:0/214628679 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20240052c0 con 0x7f20381022a0 2024-09-21T05:48:38.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.335+0000 7f203c9ce640 1 -- 172.21.15.70:0/214628679 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f2028042070 con 0x7f20381022a0 2024-09-21T05:48:38.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.336+0000 7f203c9ce640 1 --2- 172.21.15.70:0/214628679 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f20200b6620 0x7f20200b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:38.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.337+0000 7f20367fc640 1 --2- 172.21.15.70:0/214628679 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f20200b6620 0x7f20200b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:38.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.337+0000 7f203c9ce640 1 -- 172.21.15.70:0/214628679 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9237+0+0 (secure 0 0 0) 0x7f2028108100 con 0x7f20381022a0 2024-09-21T05:48:38.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.337+0000 7f20367fc640 1 --2- 172.21.15.70:0/214628679 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f20200b6620 0x7f20200b8b30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f203807a310 tx=0x7f202c00a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:38.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.340+0000 7f203c9ce640 1 -- 172.21.15.70:0/214628679 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f20280d2820 con 0x7f20381022a0 2024-09-21T05:48:38.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.530+0000 7f203d9d0640 1 -- 172.21.15.70:0/214628679 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f2024005880 con 0x7f20381022a0 2024-09-21T05:48:38.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.530+0000 7f203c9ce640 1 -- 172.21.15.70:0/214628679 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f20280d7760 con 0x7f20381022a0 2024-09-21T05:48:38.533 INFO:teuthology.orchestra.run.smithi070.stdout:176093659192 2024-09-21T05:48:38.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.532+0000 7f203d9d0640 1 -- 172.21.15.70:0/214628679 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f20200b6620 msgr2=0x7f20200b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:38.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.533+0000 7f203d9d0640 1 --2- 172.21.15.70:0/214628679 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f20200b6620 0x7f20200b8b30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f203807a310 tx=0x7f202c00a250 comp rx=0 tx=0).stop 2024-09-21T05:48:38.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.533+0000 7f203d9d0640 1 -- 172.21.15.70:0/214628679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20381022a0 msgr2=0x7f2038199450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:38.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.533+0000 7f203d9d0640 1 --2- 172.21.15.70:0/214628679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20381022a0 0x7f2038199450 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2028005940 tx=0x7f20280042d0 comp rx=0 tx=0).stop 2024-09-21T05:48:38.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.533+0000 7f203d9d0640 1 -- 172.21.15.70:0/214628679 shutdown_connections 2024-09-21T05:48:38.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.533+0000 7f203d9d0640 1 --2- 172.21.15.70:0/214628679 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f20200b6620 0x7f20200b8b30 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:38.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.533+0000 7f203d9d0640 1 --2- 172.21.15.70:0/214628679 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2038107be0 0x7f20381999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:38.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.533+0000 7f203d9d0640 1 --2- 172.21.15.70:0/214628679 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2038108530 0x7f203819ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:38.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.533+0000 7f203d9d0640 1 --2- 172.21.15.70:0/214628679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20381022a0 0x7f2038199450 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:38.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.533+0000 7f203d9d0640 1 -- 172.21.15.70:0/214628679 >> 172.21.15.70:0/214628679 conn(0x7f2038079ec0 msgr2=0x7f2038100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:38.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.533+0000 7f203d9d0640 1 -- 172.21.15.70:0/214628679 shutdown_connections 2024-09-21T05:48:38.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.533+0000 7f203d9d0640 1 -- 172.21.15.70:0/214628679 wait complete. 2024-09-21T05:48:38.961 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:38 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-21T05:48:38.961 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:38 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-21T05:48:38.961 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:38 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-21T05:48:38.961 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:38 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2024-09-21T05:48:38.961 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:38 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-09-21T05:48:38.961 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:38 smithi070 ceph-mon[30981]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T05:48:38.961 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:38 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/214628679' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T05:48:38.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.959+0000 7f49fc899640 1 -- 172.21.15.70:0/1706743381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49f8102a60 msgr2=0x7f49f8102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:38.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.959+0000 7f49fc899640 1 --2- 172.21.15.70:0/1706743381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49f8102a60 0x7f49f8102e70 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f49e8009900 tx=0x7f49e802a410 comp rx=0 tx=0).stop 2024-09-21T05:48:38.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.959+0000 7f49fc899640 1 -- 172.21.15.70:0/1706743381 shutdown_connections 2024-09-21T05:48:38.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.959+0000 7f49fc899640 1 --2- 172.21.15.70:0/1706743381 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49f81083a0 0x7f49f81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:38.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.959+0000 7f49fc899640 1 --2- 172.21.15.70:0/1706743381 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49f8108cf0 0x7f49f810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:38.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.959+0000 7f49fc899640 1 --2- 172.21.15.70:0/1706743381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49f8102a60 0x7f49f8102e70 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:38.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.959+0000 7f49fc899640 1 -- 172.21.15.70:0/1706743381 >> 172.21.15.70:0/1706743381 conn(0x7f49f8079730 msgr2=0x7f49f8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:38.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.959+0000 7f49fc899640 1 -- 172.21.15.70:0/1706743381 shutdown_connections 2024-09-21T05:48:38.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.959+0000 7f49fc899640 1 -- 172.21.15.70:0/1706743381 wait complete. 2024-09-21T05:48:38.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.960+0000 7f49fc899640 1 Processor -- start 2024-09-21T05:48:38.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.960+0000 7f49fc899640 1 -- start start 2024-09-21T05:48:38.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.960+0000 7f49fc899640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49f8102a60 0x7f49f819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:38.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.960+0000 7f49fc899640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49f81083a0 0x7f49f819aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:38.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.960+0000 7f49fc899640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49f8108cf0 0x7f49f819fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:38.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.960+0000 7f49fc899640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f49f81129b0 con 0x7f49f8102a60 2024-09-21T05:48:38.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.960+0000 7f49fc899640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f49f8112830 con 0x7f49f8108cf0 2024-09-21T05:48:38.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.960+0000 7f49fc899640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f49f8112b30 con 0x7f49f81083a0 2024-09-21T05:48:38.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.960+0000 7f49f659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49f8102a60 0x7f49f819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:38.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.960+0000 7f49f659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49f8102a60 0x7f49f819a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45118/0 (socket says 172.21.15.70:45118) 2024-09-21T05:48:38.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.960+0000 7f49f659c640 1 -- 172.21.15.70:0/1655953466 learned_addr learned my addr 172.21.15.70:0/1655953466 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:38.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.961+0000 7f49f5d9b640 1 --2- 172.21.15.70:0/1655953466 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49f81083a0 0x7f49f819aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:38.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.961+0000 7f49f6d9d640 1 --2- 172.21.15.70:0/1655953466 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49f8108cf0 0x7f49f819fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:38.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.961+0000 7f49f659c640 1 -- 172.21.15.70:0/1655953466 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49f81083a0 msgr2=0x7f49f819aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:38.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.961+0000 7f49f659c640 1 --2- 172.21.15.70:0/1655953466 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49f81083a0 0x7f49f819aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:38.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.961+0000 7f49f659c640 1 -- 172.21.15.70:0/1655953466 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49f8108cf0 msgr2=0x7f49f819fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:38.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.961+0000 7f49f659c640 1 --2- 172.21.15.70:0/1655953466 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49f8108cf0 0x7f49f819fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:38.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.961+0000 7f49f659c640 1 -- 172.21.15.70:0/1655953466 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f81a0420 con 0x7f49f8102a60 2024-09-21T05:48:38.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.961+0000 7f49f659c640 1 --2- 172.21.15.70:0/1655953466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49f8102a60 0x7f49f819a4b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f49e8005940 tx=0x7f49e80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:38.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.961+0000 7f49ef7fe640 1 -- 172.21.15.70:0/1655953466 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e803f030 con 0x7f49f8102a60 2024-09-21T05:48:38.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.961+0000 7f49ef7fe640 1 -- 172.21.15.70:0/1655953466 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f49e8003cb0 con 0x7f49f8102a60 2024-09-21T05:48:38.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.961+0000 7f49fc899640 1 -- 172.21.15.70:0/1655953466 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49f81a06b0 con 0x7f49f8102a60 2024-09-21T05:48:38.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.961+0000 7f49ef7fe640 1 -- 172.21.15.70:0/1655953466 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e8035070 con 0x7f49f8102a60 2024-09-21T05:48:38.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.961+0000 7f49fc899640 1 -- 172.21.15.70:0/1655953466 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49f81a6e70 con 0x7f49f8102a60 2024-09-21T05:48:38.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.962+0000 7f49fc899640 1 -- 172.21.15.70:0/1655953466 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49f8102e70 con 0x7f49f8102a60 2024-09-21T05:48:38.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.964+0000 7f49ef7fe640 1 -- 172.21.15.70:0/1655953466 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f49e8042030 con 0x7f49f8102a60 2024-09-21T05:48:38.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.965+0000 7f49ef7fe640 1 --2- 172.21.15.70:0/1655953466 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f49e40b6620 0x7f49e40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:38.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.965+0000 7f49f5d9b640 1 --2- 172.21.15.70:0/1655953466 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f49e40b6620 0x7f49e40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:38.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.965+0000 7f49ef7fe640 1 -- 172.21.15.70:0/1655953466 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f49e8108390 con 0x7f49f8102a60 2024-09-21T05:48:38.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.965+0000 7f49f5d9b640 1 --2- 172.21.15.70:0/1655953466 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f49e40b6620 0x7f49e40b8b30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f49f8079cd0 tx=0x7f49e0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:38.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:38.968+0000 7f49ef7fe640 1 -- 172.21.15.70:0/1655953466 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f49e80ce6d0 con 0x7f49f8102a60 2024-09-21T05:48:39.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:38 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-21T05:48:39.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:38 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-21T05:48:39.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:38 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-21T05:48:39.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:38 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2024-09-21T05:48:39.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:38 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-09-21T05:48:39.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:38 smithi116 ceph-mon[34332]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T05:48:39.055 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:38 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/214628679' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T05:48:39.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:38 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-21T05:48:39.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:38 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-21T05:48:39.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:38 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-21T05:48:39.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:38 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2024-09-21T05:48:39.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:38 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-09-21T05:48:39.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:38 smithi160 ceph-mon[33979]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T05:48:39.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:38 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/214628679' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T05:48:39.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.152+0000 7f49fc899640 1 -- 172.21.15.70:0/1655953466 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f49f819b5e0 con 0x7f49f8102a60 2024-09-21T05:48:39.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.153+0000 7f49ef7fe640 1 -- 172.21.15.70:0/1655953466 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f49e80d2ab0 con 0x7f49f8102a60 2024-09-21T05:48:39.155 INFO:teuthology.orchestra.run.smithi070.stdout:150323855422 2024-09-21T05:48:39.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.155+0000 7f49fc899640 1 -- 172.21.15.70:0/1655953466 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f49e40b6620 msgr2=0x7f49e40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:39.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.155+0000 7f49fc899640 1 --2- 172.21.15.70:0/1655953466 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f49e40b6620 0x7f49e40b8b30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f49f8079cd0 tx=0x7f49e0009110 comp rx=0 tx=0).stop 2024-09-21T05:48:39.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.155+0000 7f49fc899640 1 -- 172.21.15.70:0/1655953466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49f8102a60 msgr2=0x7f49f819a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:39.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.155+0000 7f49fc899640 1 --2- 172.21.15.70:0/1655953466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49f8102a60 0x7f49f819a4b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f49e8005940 tx=0x7f49e80042f0 comp rx=0 tx=0).stop 2024-09-21T05:48:39.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.155+0000 7f49fc899640 1 -- 172.21.15.70:0/1655953466 shutdown_connections 2024-09-21T05:48:39.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.155+0000 7f49fc899640 1 --2- 172.21.15.70:0/1655953466 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f49e40b6620 0x7f49e40b8b30 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:39.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.155+0000 7f49fc899640 1 --2- 172.21.15.70:0/1655953466 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49f81083a0 0x7f49f819aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:39.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.155+0000 7f49fc899640 1 --2- 172.21.15.70:0/1655953466 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49f8108cf0 0x7f49f819fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:39.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.155+0000 7f49fc899640 1 --2- 172.21.15.70:0/1655953466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49f8102a60 0x7f49f819a4b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:39.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.155+0000 7f49fc899640 1 -- 172.21.15.70:0/1655953466 >> 172.21.15.70:0/1655953466 conn(0x7f49f8079730 msgr2=0x7f49f8101ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:39.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.155+0000 7f49fc899640 1 -- 172.21.15.70:0/1655953466 shutdown_connections 2024-09-21T05:48:39.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.155+0000 7f49fc899640 1 -- 172.21.15.70:0/1655953466 wait complete. 2024-09-21T05:48:39.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.439+0000 7fd212d7b640 1 -- 172.21.15.70:0/1982935229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd20c108d70 msgr2=0x7fd20c10f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:39.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.439+0000 7fd212d7b640 1 --2- 172.21.15.70:0/1982935229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd20c108d70 0x7fd20c10f5a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd204009ca0 tx=0x7fd20402a8e0 comp rx=0 tx=0).stop 2024-09-21T05:48:39.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.439+0000 7fd212d7b640 1 -- 172.21.15.70:0/1982935229 shutdown_connections 2024-09-21T05:48:39.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.439+0000 7fd212d7b640 1 --2- 172.21.15.70:0/1982935229 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd20c108420 0x7fd20c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:39.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.439+0000 7fd212d7b640 1 --2- 172.21.15.70:0/1982935229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd20c108d70 0x7fd20c10f5a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:39.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.439+0000 7fd212d7b640 1 --2- 172.21.15.70:0/1982935229 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd20c102ae0 0x7fd20c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:39.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.439+0000 7fd212d7b640 1 -- 172.21.15.70:0/1982935229 >> 172.21.15.70:0/1982935229 conn(0x7fd20c079770 msgr2=0x7fd20c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:39.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.439+0000 7fd212d7b640 1 -- 172.21.15.70:0/1982935229 shutdown_connections 2024-09-21T05:48:39.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.439+0000 7fd212d7b640 1 -- 172.21.15.70:0/1982935229 wait complete. 2024-09-21T05:48:39.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.439+0000 7fd212d7b640 1 Processor -- start 2024-09-21T05:48:39.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.439+0000 7fd212d7b640 1 -- start start 2024-09-21T05:48:39.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.440+0000 7fd212d7b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd20c102ae0 0x7fd20c19a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:39.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.440+0000 7fd212d7b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd20c108420 0x7fd20c19aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:39.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.440+0000 7fd212d7b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd20c108d70 0x7fd20c19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:39.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.440+0000 7fd212d7b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c112a60 con 0x7fd20c108420 2024-09-21T05:48:39.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.440+0000 7fd212d7b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c1128e0 con 0x7fd20c102ae0 2024-09-21T05:48:39.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.440+0000 7fd212d7b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c112be0 con 0x7fd20c108d70 2024-09-21T05:48:39.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.440+0000 7fd20bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd20c108420 0x7fd20c19aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:39.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.440+0000 7fd20bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd20c108420 0x7fd20c19aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45088/0 (socket says 172.21.15.70:45088) 2024-09-21T05:48:39.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.440+0000 7fd20bfff640 1 -- 172.21.15.70:0/143441309 learned_addr learned my addr 172.21.15.70:0/143441309 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:39.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.440+0000 7fd210b17640 1 --2- 172.21.15.70:0/143441309 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd20c102ae0 0x7fd20c19a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:39.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.440+0000 7fd211318640 1 --2- 172.21.15.70:0/143441309 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd20c108d70 0x7fd20c19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:39.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.440+0000 7fd20bfff640 1 -- 172.21.15.70:0/143441309 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd20c108d70 msgr2=0x7fd20c19fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:39.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.440+0000 7fd20bfff640 1 --2- 172.21.15.70:0/143441309 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd20c108d70 0x7fd20c19fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:39.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.440+0000 7fd20bfff640 1 -- 172.21.15.70:0/143441309 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd20c102ae0 msgr2=0x7fd20c19a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:39.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.440+0000 7fd20bfff640 1 --2- 172.21.15.70:0/143441309 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd20c102ae0 0x7fd20c19a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:39.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.440+0000 7fd20bfff640 1 -- 172.21.15.70:0/143441309 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20c1a0470 con 0x7fd20c108420 2024-09-21T05:48:39.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.440+0000 7fd210b17640 1 --2- 172.21.15.70:0/143441309 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd20c102ae0 0x7fd20c19a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:48:39.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.440+0000 7fd20bfff640 1 --2- 172.21.15.70:0/143441309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd20c108420 0x7fd20c19aaa0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4006fd0 tx=0x7fd1f400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:39.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.440+0000 7fd209ffb640 1 -- 172.21.15.70:0/143441309 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4011830 con 0x7fd20c108420 2024-09-21T05:48:39.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.441+0000 7fd212d7b640 1 -- 172.21.15.70:0/143441309 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd20c1a0760 con 0x7fd20c108420 2024-09-21T05:48:39.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.441+0000 7fd209ffb640 1 -- 172.21.15.70:0/143441309 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fd1f4016070 con 0x7fd20c108420 2024-09-21T05:48:39.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.441+0000 7fd209ffb640 1 -- 172.21.15.70:0/143441309 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4010df0 con 0x7fd20c108420 2024-09-21T05:48:39.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.441+0000 7fd212d7b640 1 -- 172.21.15.70:0/143441309 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd20c1a6ec0 con 0x7fd20c108420 2024-09-21T05:48:39.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.442+0000 7fd212d7b640 1 -- 172.21.15.70:0/143441309 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd20c103d60 con 0x7fd20c108420 2024-09-21T05:48:39.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.443+0000 7fd209ffb640 1 -- 172.21.15.70:0/143441309 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fd1f401b460 con 0x7fd20c108420 2024-09-21T05:48:39.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.444+0000 7fd209ffb640 1 --2- 172.21.15.70:0/143441309 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd1f80b65a0 0x7fd1f80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:39.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.444+0000 7fd210b17640 1 --2- 172.21.15.70:0/143441309 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd1f80b65a0 0x7fd1f80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:39.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.444+0000 7fd209ffb640 1 -- 172.21.15.70:0/143441309 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7fd1f40e6df0 con 0x7fd20c108420 2024-09-21T05:48:39.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.444+0000 7fd210b17640 1 --2- 172.21.15.70:0/143441309 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd1f80b65a0 0x7fd1f80b8ab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc0058c0 tx=0x7fd1fc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:39.184 INFO:teuthology.orchestra.run.smithi070.stdout:98784247879 2024-09-21T05:48:39.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.448+0000 7fd209ffb640 1 -- 172.21.15.70:0/143441309 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd1f40ad1c0 con 0x7fd20c108420 2024-09-21T05:48:39.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.647+0000 7fd212d7b640 1 -- 172.21.15.70:0/143441309 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fd20c19b630 con 0x7fd20c108420 2024-09-21T05:48:39.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.647+0000 7fd209ffb640 1 -- 172.21.15.70:0/143441309 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd1f40b15a0 con 0x7fd20c108420 2024-09-21T05:48:39.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.649+0000 7fd212d7b640 1 -- 172.21.15.70:0/143441309 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd1f80b65a0 msgr2=0x7fd1f80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:39.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.649+0000 7fd212d7b640 1 --2- 172.21.15.70:0/143441309 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd1f80b65a0 0x7fd1f80b8ab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc0058c0 tx=0x7fd1fc005850 comp rx=0 tx=0).stop 2024-09-21T05:48:39.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.649+0000 7fd212d7b640 1 -- 172.21.15.70:0/143441309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd20c108420 msgr2=0x7fd20c19aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:39.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.649+0000 7fd212d7b640 1 --2- 172.21.15.70:0/143441309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd20c108420 0x7fd20c19aaa0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4006fd0 tx=0x7fd1f400b8e0 comp rx=0 tx=0).stop 2024-09-21T05:48:39.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.650+0000 7fd212d7b640 1 -- 172.21.15.70:0/143441309 shutdown_connections 2024-09-21T05:48:39.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.650+0000 7fd212d7b640 1 --2- 172.21.15.70:0/143441309 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd1f80b65a0 0x7fd1f80b8ab0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:39.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.650+0000 7fd212d7b640 1 --2- 172.21.15.70:0/143441309 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd20c108d70 0x7fd20c19fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:39.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.650+0000 7fd212d7b640 1 --2- 172.21.15.70:0/143441309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd20c108420 0x7fd20c19aaa0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:39.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.650+0000 7fd212d7b640 1 --2- 172.21.15.70:0/143441309 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd20c102ae0 0x7fd20c19a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:39.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.650+0000 7fd212d7b640 1 -- 172.21.15.70:0/143441309 >> 172.21.15.70:0/143441309 conn(0x7fd20c079770 msgr2=0x7fd20c101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:39.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.650+0000 7fd212d7b640 1 -- 172.21.15.70:0/143441309 shutdown_connections 2024-09-21T05:48:39.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:36.650+0000 7fd212d7b640 1 -- 172.21.15.70:0/143441309 wait complete. 2024-09-21T05:48:39.839 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247877 got 98784247879 for osd.3 2024-09-21T05:48:39.839 DEBUG:teuthology.parallel:result is None 2024-09-21T05:48:39.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.180+0000 7fa84faa2640 1 -- 172.21.15.70:0/1364054676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa848105ac0 msgr2=0x7fa84810f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:39.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.180+0000 7fa84faa2640 1 --2- 172.21.15.70:0/1364054676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa848105ac0 0x7fa84810f530 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa840009ca0 tx=0x7fa84002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:48:39.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.180+0000 7fa84faa2640 1 -- 172.21.15.70:0/1364054676 shutdown_connections 2024-09-21T05:48:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.180+0000 7fa84faa2640 1 --2- 172.21.15.70:0/1364054676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa848105170 0x7fa848105580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.180+0000 7fa84faa2640 1 --2- 172.21.15.70:0/1364054676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa848105ac0 0x7fa84810f530 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.180+0000 7fa84faa2640 1 --2- 172.21.15.70:0/1364054676 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa848103160 0x7fa848103570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.180+0000 7fa84faa2640 1 -- 172.21.15.70:0/1364054676 >> 172.21.15.70:0/1364054676 conn(0x7fa848077c60 msgr2=0x7fa8480780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.180+0000 7fa84faa2640 1 -- 172.21.15.70:0/1364054676 shutdown_connections 2024-09-21T05:48:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.180+0000 7fa84faa2640 1 -- 172.21.15.70:0/1364054676 wait complete. 2024-09-21T05:48:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.181+0000 7fa84faa2640 1 Processor -- start 2024-09-21T05:48:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.181+0000 7fa84faa2640 1 -- start start 2024-09-21T05:48:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.181+0000 7fa84faa2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa848103160 0x7fa84819c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.181+0000 7fa84faa2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa848105170 0x7fa84819cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.181+0000 7fa84faa2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa848105ac0 0x7fa8481a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.181+0000 7fa84faa2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa8481129e0 con 0x7fa848105ac0 2024-09-21T05:48:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.181+0000 7fa84faa2640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa848112860 con 0x7fa848103160 2024-09-21T05:48:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.181+0000 7fa84faa2640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa848112b60 con 0x7fa848105170 2024-09-21T05:48:39.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.181+0000 7fa84e03f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa848105ac0 0x7fa8481a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:39.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.181+0000 7fa84e03f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa848105ac0 0x7fa8481a1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45126/0 (socket says 172.21.15.70:45126) 2024-09-21T05:48:39.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.181+0000 7fa84e03f640 1 -- 172.21.15.70:0/2566278040 learned_addr learned my addr 172.21.15.70:0/2566278040 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:39.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.181+0000 7fa84d83e640 1 --2- 172.21.15.70:0/2566278040 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa848103160 0x7fa84819c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:39.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.181+0000 7fa84d03d640 1 --2- 172.21.15.70:0/2566278040 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa848105170 0x7fa84819cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:39.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.182+0000 7fa84e03f640 1 -- 172.21.15.70:0/2566278040 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa848105170 msgr2=0x7fa84819cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:39.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.182+0000 7fa84e03f640 1 --2- 172.21.15.70:0/2566278040 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa848105170 0x7fa84819cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:39.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.182+0000 7fa84e03f640 1 -- 172.21.15.70:0/2566278040 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa848103160 msgr2=0x7fa84819c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:39.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.182+0000 7fa84e03f640 1 --2- 172.21.15.70:0/2566278040 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa848103160 0x7fa84819c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:39.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.182+0000 7fa84e03f640 1 -- 172.21.15.70:0/2566278040 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8481a24d0 con 0x7fa848105ac0 2024-09-21T05:48:39.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.182+0000 7fa84d83e640 1 --2- 172.21.15.70:0/2566278040 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa848103160 0x7fa84819c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:48:39.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.182+0000 7fa84e03f640 1 --2- 172.21.15.70:0/2566278040 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa848105ac0 0x7fa8481a1e60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa840031040 tx=0x7fa840003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:39.922 INFO:teuthology.orchestra.run.smithi070.stdout:73014444109 2024-09-21T05:48:39.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.182+0000 7fa83effd640 1 -- 172.21.15.70:0/2566278040 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa840003ce0 con 0x7fa848105ac0 2024-09-21T05:48:39.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.182+0000 7fa83effd640 1 -- 172.21.15.70:0/2566278040 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fa8400044f0 con 0x7fa848105ac0 2024-09-21T05:48:39.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.182+0000 7fa84faa2640 1 -- 172.21.15.70:0/2566278040 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8481a2760 con 0x7fa848105ac0 2024-09-21T05:48:39.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.182+0000 7fa83effd640 1 -- 172.21.15.70:0/2566278040 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa840030c60 con 0x7fa848105ac0 2024-09-21T05:48:39.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.182+0000 7fa84faa2640 1 -- 172.21.15.70:0/2566278040 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8481a2ca0 con 0x7fa848105ac0 2024-09-21T05:48:39.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.183+0000 7fa84faa2640 1 -- 172.21.15.70:0/2566278040 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa848103570 con 0x7fa848105ac0 2024-09-21T05:48:39.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.185+0000 7fa83effd640 1 -- 172.21.15.70:0/2566278040 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fa8400046a0 con 0x7fa848105ac0 2024-09-21T05:48:39.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.186+0000 7fa83effd640 1 --2- 172.21.15.70:0/2566278040 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa8340b65d0 0x7fa8340b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:39.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.186+0000 7fa84d83e640 1 --2- 172.21.15.70:0/2566278040 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa8340b65d0 0x7fa8340b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.186+0000 7fa83effd640 1 -- 172.21.15.70:0/2566278040 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fa840108d50 con 0x7fa848105ac0 2024-09-21T05:48:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.187+0000 7fa84d83e640 1 --2- 172.21.15.70:0/2566278040 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa8340b65d0 0x7fa8340b8ae0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa844005d00 tx=0x7fa844005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.189+0000 7fa83effd640 1 -- 172.21.15.70:0/2566278040 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa8400cf090 con 0x7fa848105ac0 2024-09-21T05:48:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.377+0000 7fa84faa2640 1 -- 172.21.15.70:0/2566278040 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fa8481a9150 con 0x7fa848105ac0 2024-09-21T05:48:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.377+0000 7fa83effd640 1 -- 172.21.15.70:0/2566278040 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa8400d3470 con 0x7fa848105ac0 2024-09-21T05:48:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.379+0000 7fa84faa2640 1 -- 172.21.15.70:0/2566278040 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa8340b65d0 msgr2=0x7fa8340b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.379+0000 7fa84faa2640 1 --2- 172.21.15.70:0/2566278040 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa8340b65d0 0x7fa8340b8ae0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa844005d00 tx=0x7fa844005c70 comp rx=0 tx=0).stop 2024-09-21T05:48:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.379+0000 7fa84faa2640 1 -- 172.21.15.70:0/2566278040 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa848105ac0 msgr2=0x7fa8481a1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.379+0000 7fa84faa2640 1 --2- 172.21.15.70:0/2566278040 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa848105ac0 0x7fa8481a1e60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa840031040 tx=0x7fa840003970 comp rx=0 tx=0).stop 2024-09-21T05:48:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.379+0000 7fa84faa2640 1 -- 172.21.15.70:0/2566278040 shutdown_connections 2024-09-21T05:48:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.379+0000 7fa84faa2640 1 --2- 172.21.15.70:0/2566278040 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa8340b65d0 0x7fa8340b8ae0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.379+0000 7fa84faa2640 1 --2- 172.21.15.70:0/2566278040 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa848105170 0x7fa84819cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.379+0000 7fa84faa2640 1 --2- 172.21.15.70:0/2566278040 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa848105ac0 0x7fa8481a1e60 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.379+0000 7fa84faa2640 1 --2- 172.21.15.70:0/2566278040 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa848103160 0x7fa84819c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:39.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.379+0000 7fa84faa2640 1 -- 172.21.15.70:0/2566278040 >> 172.21.15.70:0/2566278040 conn(0x7fa848077c60 msgr2=0x7fa84810e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:39.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.380+0000 7fa84faa2640 1 -- 172.21.15.70:0/2566278040 shutdown_connections 2024-09-21T05:48:39.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:39.380+0000 7fa84faa2640 1 -- 172.21.15.70:0/2566278040 wait complete. 2024-09-21T05:48:39.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:39 smithi070 ceph-mon[30981]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T05:48:39.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:39 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1655953466' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T05:48:39.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:39 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2566278040' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T05:48:39.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:39 smithi070 ceph-mon[30981]: pgmap v346: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s; 77 B/s, 0 objects/s recovering 2024-09-21T05:48:40.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:39 smithi116 ceph-mon[34332]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T05:48:40.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:39 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1655953466' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T05:48:40.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:39 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2566278040' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T05:48:40.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:39 smithi116 ceph-mon[34332]: pgmap v346: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s; 77 B/s, 0 objects/s recovering 2024-09-21T05:48:40.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:39 smithi160 ceph-mon[33979]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T05:48:40.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:39 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1655953466' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T05:48:40.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:39 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2566278040' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T05:48:40.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:39 smithi160 ceph-mon[33979]: pgmap v346: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s; 77 B/s, 0 objects/s recovering 2024-09-21T05:48:40.611 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444105 got 73014444109 for osd.2 2024-09-21T05:48:40.611 DEBUG:teuthology.parallel:result is None 2024-09-21T05:48:41.412 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855419 got 150323855422 for osd.5 2024-09-21T05:48:41.413 DEBUG:teuthology.parallel:result is None 2024-09-21T05:48:41.417 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:41.689 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:41 smithi070 ceph-mon[30981]: pgmap v347: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 77 B/s, 0 objects/s recovering 2024-09-21T05:48:41.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:41 smithi116 ceph-mon[34332]: pgmap v347: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 77 B/s, 0 objects/s recovering 2024-09-21T05:48:41.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:41 smithi160 ceph-mon[33979]: pgmap v347: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 77 B/s, 0 objects/s recovering 2024-09-21T05:48:42.015 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659189 got 176093659192 for osd.6 2024-09-21T05:48:42.015 DEBUG:teuthology.parallel:result is None 2024-09-21T05:48:42.081 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:42.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.516+0000 7fcb63c8c640 1 -- 172.21.15.70:0/489663266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb5c108cf0 msgr2=0x7fcb5c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:42.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.517+0000 7fcb63c8c640 1 --2- 172.21.15.70:0/489663266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb5c108cf0 0x7fcb5c10f520 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fcb54009ca0 tx=0x7fcb5402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:48:42.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.517+0000 7fcb63c8c640 1 -- 172.21.15.70:0/489663266 shutdown_connections 2024-09-21T05:48:42.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.517+0000 7fcb63c8c640 1 --2- 172.21.15.70:0/489663266 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb5c1083a0 0x7fcb5c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:42.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.517+0000 7fcb63c8c640 1 --2- 172.21.15.70:0/489663266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb5c108cf0 0x7fcb5c10f520 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:42.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.517+0000 7fcb63c8c640 1 --2- 172.21.15.70:0/489663266 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcb5c102a60 0x7fcb5c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:42.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.517+0000 7fcb63c8c640 1 -- 172.21.15.70:0/489663266 >> 172.21.15.70:0/489663266 conn(0x7fcb5c079730 msgr2=0x7fcb5c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:42.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.517+0000 7fcb63c8c640 1 -- 172.21.15.70:0/489663266 shutdown_connections 2024-09-21T05:48:42.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.517+0000 7fcb63c8c640 1 -- 172.21.15.70:0/489663266 wait complete. 2024-09-21T05:48:42.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.517+0000 7fcb63c8c640 1 Processor -- start 2024-09-21T05:48:42.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.517+0000 7fcb63c8c640 1 -- start start 2024-09-21T05:48:42.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.518+0000 7fcb63c8c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb5c102a60 0x7fcb5c1993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:42.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.518+0000 7fcb63c8c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcb5c1083a0 0x7fcb5c199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:42.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.518+0000 7fcb63c8c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb5c108cf0 0x7fcb5c19ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:42.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.518+0000 7fcb63c8c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5c112980 con 0x7fcb5c108cf0 2024-09-21T05:48:42.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.518+0000 7fcb63c8c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5c112800 con 0x7fcb5c1083a0 2024-09-21T05:48:42.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.518+0000 7fcb63c8c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5c112b00 con 0x7fcb5c102a60 2024-09-21T05:48:42.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.518+0000 7fcb62229640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb5c108cf0 0x7fcb5c19ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:42.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.518+0000 7fcb62229640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb5c108cf0 0x7fcb5c19ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47948/0 (socket says 172.21.15.70:47948) 2024-09-21T05:48:42.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.518+0000 7fcb62229640 1 -- 172.21.15.70:0/2876275880 learned_addr learned my addr 172.21.15.70:0/2876275880 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:42.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.518+0000 7fcb61a28640 1 --2- 172.21.15.70:0/2876275880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb5c102a60 0x7fcb5c1993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:42.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.518+0000 7fcb61227640 1 --2- 172.21.15.70:0/2876275880 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcb5c1083a0 0x7fcb5c199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:42.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.518+0000 7fcb62229640 1 -- 172.21.15.70:0/2876275880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb5c102a60 msgr2=0x7fcb5c1993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:42.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.518+0000 7fcb62229640 1 --2- 172.21.15.70:0/2876275880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb5c102a60 0x7fcb5c1993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:42.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.518+0000 7fcb62229640 1 -- 172.21.15.70:0/2876275880 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcb5c1083a0 msgr2=0x7fcb5c199990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:42.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.518+0000 7fcb62229640 1 --2- 172.21.15.70:0/2876275880 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcb5c1083a0 0x7fcb5c199990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:42.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.518+0000 7fcb62229640 1 -- 172.21.15.70:0/2876275880 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb5c19f2a0 con 0x7fcb5c108cf0 2024-09-21T05:48:42.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.518+0000 7fcb61a28640 1 --2- 172.21.15.70:0/2876275880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb5c102a60 0x7fcb5c1993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:48:42.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.518+0000 7fcb62229640 1 --2- 172.21.15.70:0/2876275880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb5c108cf0 0x7fcb5c19ec30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fcb54031040 tx=0x7fcb54003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:42.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.519+0000 7fcb52ffd640 1 -- 172.21.15.70:0/2876275880 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5404a070 con 0x7fcb5c108cf0 2024-09-21T05:48:42.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.519+0000 7fcb52ffd640 1 -- 172.21.15.70:0/2876275880 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fcb540044f0 con 0x7fcb5c108cf0 2024-09-21T05:48:42.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.519+0000 7fcb63c8c640 1 -- 172.21.15.70:0/2876275880 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb5c19f530 con 0x7fcb5c108cf0 2024-09-21T05:48:42.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.519+0000 7fcb52ffd640 1 -- 172.21.15.70:0/2876275880 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb54030c30 con 0x7fcb5c108cf0 2024-09-21T05:48:42.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.519+0000 7fcb63c8c640 1 -- 172.21.15.70:0/2876275880 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb5c19fa70 con 0x7fcb5c108cf0 2024-09-21T05:48:42.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.520+0000 7fcb63c8c640 1 -- 172.21.15.70:0/2876275880 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb5c102e70 con 0x7fcb5c108cf0 2024-09-21T05:48:42.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.521+0000 7fcb52ffd640 1 -- 172.21.15.70:0/2876275880 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fcb5404d070 con 0x7fcb5c108cf0 2024-09-21T05:48:42.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.522+0000 7fcb52ffd640 1 --2- 172.21.15.70:0/2876275880 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fcb480b65d0 0x7fcb480b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:42.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.523+0000 7fcb61a28640 1 --2- 172.21.15.70:0/2876275880 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fcb480b65d0 0x7fcb480b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:42.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.523+0000 7fcb52ffd640 1 -- 172.21.15.70:0/2876275880 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fcb5410a200 con 0x7fcb5c108cf0 2024-09-21T05:48:42.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.523+0000 7fcb61a28640 1 --2- 172.21.15.70:0/2876275880 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fcb480b65d0 0x7fcb480b8ae0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcb5800abe0 tx=0x7fcb5800a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:42.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.526+0000 7fcb52ffd640 1 -- 172.21.15.70:0/2876275880 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcb54084710 con 0x7fcb5c108cf0 2024-09-21T05:48:42.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.711+0000 7fcb63c8c640 1 -- 172.21.15.70:0/2876275880 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fcb5c10a660 con 0x7fcb5c108cf0 2024-09-21T05:48:42.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.711+0000 7fcb52ffd640 1 -- 172.21.15.70:0/2876275880 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fcb540d04e0 con 0x7fcb5c108cf0 2024-09-21T05:48:42.714 INFO:teuthology.orchestra.run.smithi070.stdout:223338299439 2024-09-21T05:48:42.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.714+0000 7fcb63c8c640 1 -- 172.21.15.70:0/2876275880 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fcb480b65d0 msgr2=0x7fcb480b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:42.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.714+0000 7fcb63c8c640 1 --2- 172.21.15.70:0/2876275880 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fcb480b65d0 0x7fcb480b8ae0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcb5800abe0 tx=0x7fcb5800a5c0 comp rx=0 tx=0).stop 2024-09-21T05:48:42.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.714+0000 7fcb63c8c640 1 -- 172.21.15.70:0/2876275880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb5c108cf0 msgr2=0x7fcb5c19ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:42.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.714+0000 7fcb63c8c640 1 --2- 172.21.15.70:0/2876275880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb5c108cf0 0x7fcb5c19ec30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fcb54031040 tx=0x7fcb54003ba0 comp rx=0 tx=0).stop 2024-09-21T05:48:42.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.714+0000 7fcb63c8c640 1 -- 172.21.15.70:0/2876275880 shutdown_connections 2024-09-21T05:48:42.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.714+0000 7fcb63c8c640 1 --2- 172.21.15.70:0/2876275880 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fcb480b65d0 0x7fcb480b8ae0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:42.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.714+0000 7fcb63c8c640 1 --2- 172.21.15.70:0/2876275880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb5c108cf0 0x7fcb5c19ec30 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:42.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.714+0000 7fcb63c8c640 1 --2- 172.21.15.70:0/2876275880 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcb5c1083a0 0x7fcb5c199990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:42.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.714+0000 7fcb63c8c640 1 --2- 172.21.15.70:0/2876275880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb5c102a60 0x7fcb5c1993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:42.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.714+0000 7fcb63c8c640 1 -- 172.21.15.70:0/2876275880 >> 172.21.15.70:0/2876275880 conn(0x7fcb5c079730 msgr2=0x7fcb5c104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:42.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.714+0000 7fcb63c8c640 1 -- 172.21.15.70:0/2876275880 shutdown_connections 2024-09-21T05:48:42.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:42.714+0000 7fcb63c8c640 1 -- 172.21.15.70:0/2876275880 wait complete. 2024-09-21T05:48:42.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:42 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2876275880' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T05:48:43.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:42 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2876275880' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T05:48:43.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:42 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2876275880' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T05:48:43.433 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299437 got 223338299439 for osd.8 2024-09-21T05:48:43.433 DEBUG:teuthology.parallel:result is None 2024-09-21T05:48:43.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.669+0000 7faa1ca24640 1 -- 172.21.15.70:0/3541718273 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa18102a80 msgr2=0x7faa18102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:43.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.669+0000 7faa1ca24640 1 --2- 172.21.15.70:0/3541718273 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa18102a80 0x7faa18102e90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7faa08009900 tx=0x7faa0802a410 comp rx=0 tx=0).stop 2024-09-21T05:48:43.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.669+0000 7faa1ca24640 1 -- 172.21.15.70:0/3541718273 shutdown_connections 2024-09-21T05:48:43.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.669+0000 7faa1ca24640 1 --2- 172.21.15.70:0/3541718273 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa18108d10 0x7faa1810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:43.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.669+0000 7faa1ca24640 1 --2- 172.21.15.70:0/3541718273 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa181083c0 0x7faa181087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:43.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.669+0000 7faa1ca24640 1 --2- 172.21.15.70:0/3541718273 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa18102a80 0x7faa18102e90 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:43.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.669+0000 7faa1ca24640 1 -- 172.21.15.70:0/3541718273 >> 172.21.15.70:0/3541718273 conn(0x7faa18079740 msgr2=0x7faa18079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:43.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.670+0000 7faa1ca24640 1 -- 172.21.15.70:0/3541718273 shutdown_connections 2024-09-21T05:48:43.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.670+0000 7faa1ca24640 1 -- 172.21.15.70:0/3541718273 wait complete. 2024-09-21T05:48:43.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.670+0000 7faa1ca24640 1 Processor -- start 2024-09-21T05:48:43.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.671+0000 7faa1ca24640 1 -- start start 2024-09-21T05:48:43.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.671+0000 7faa1ca24640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa18102a80 0x7faa1819b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:43.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.671+0000 7faa1ca24640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa181083c0 0x7faa1819b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:43.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.671+0000 7faa1ca24640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa18108d10 0x7faa1819bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:43.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.671+0000 7faa1ca24640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faa18112970 con 0x7faa18108d10 2024-09-21T05:48:43.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.671+0000 7faa1ca24640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7faa181127f0 con 0x7faa181083c0 2024-09-21T05:48:43.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.671+0000 7faa1ca24640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7faa18112af0 con 0x7faa18102a80 2024-09-21T05:48:43.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.671+0000 7faa16d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa18108d10 0x7faa1819bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:43.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.671+0000 7faa16d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa18108d10 0x7faa1819bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47958/0 (socket says 172.21.15.70:47958) 2024-09-21T05:48:43.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.671+0000 7faa16d9d640 1 -- 172.21.15.70:0/3804869364 learned_addr learned my addr 172.21.15.70:0/3804869364 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:43.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.671+0000 7faa0ffff640 1 --2- 172.21.15.70:0/3804869364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa181083c0 0x7faa1819b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:43.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.671+0000 7faa1659c640 1 --2- 172.21.15.70:0/3804869364 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa18102a80 0x7faa1819b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:43.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.671+0000 7faa16d9d640 1 -- 172.21.15.70:0/3804869364 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa18102a80 msgr2=0x7faa1819b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:43.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.671+0000 7faa16d9d640 1 --2- 172.21.15.70:0/3804869364 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa18102a80 0x7faa1819b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:43.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.671+0000 7faa16d9d640 1 -- 172.21.15.70:0/3804869364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa181083c0 msgr2=0x7faa1819b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:43.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.671+0000 7faa16d9d640 1 --2- 172.21.15.70:0/3804869364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa181083c0 0x7faa1819b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:43.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.671+0000 7faa16d9d640 1 -- 172.21.15.70:0/3804869364 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa181a6480 con 0x7faa18108d10 2024-09-21T05:48:43.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.671+0000 7faa0ffff640 1 --2- 172.21.15.70:0/3804869364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa181083c0 0x7faa1819b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:48:43.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.672+0000 7faa16d9d640 1 --2- 172.21.15.70:0/3804869364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa18108d10 0x7faa1819bc80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7faa1000eaa0 tx=0x7faa1000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:43.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.672+0000 7faa0f7fe640 1 -- 172.21.15.70:0/3804869364 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1000cdb0 con 0x7faa18108d10 2024-09-21T05:48:43.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.672+0000 7faa0f7fe640 1 -- 172.21.15.70:0/3804869364 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7faa10005020 con 0x7faa18108d10 2024-09-21T05:48:43.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.672+0000 7faa1ca24640 1 -- 172.21.15.70:0/3804869364 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa181a6770 con 0x7faa18108d10 2024-09-21T05:48:43.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.672+0000 7faa0f7fe640 1 -- 172.21.15.70:0/3804869364 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa100116d0 con 0x7faa18108d10 2024-09-21T05:48:43.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.672+0000 7faa1ca24640 1 -- 172.21.15.70:0/3804869364 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa181a6cb0 con 0x7faa18108d10 2024-09-21T05:48:43.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.673+0000 7faa1ca24640 1 -- 172.21.15.70:0/3804869364 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa18103d00 con 0x7faa18108d10 2024-09-21T05:48:43.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.675+0000 7faa0f7fe640 1 -- 172.21.15.70:0/3804869364 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7faa10005580 con 0x7faa18108d10 2024-09-21T05:48:43.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.675+0000 7faa0f7fe640 1 --2- 172.21.15.70:0/3804869364 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7faa040b65a0 0x7faa040b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:43.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.676+0000 7faa1659c640 1 --2- 172.21.15.70:0/3804869364 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7faa040b65a0 0x7faa040b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:43.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.676+0000 7faa0f7fe640 1 -- 172.21.15.70:0/3804869364 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7faa100e7f50 con 0x7faa18108d10 2024-09-21T05:48:43.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.676+0000 7faa1659c640 1 --2- 172.21.15.70:0/3804869364 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7faa040b65a0 0x7faa040b8ab0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faa08000c00 tx=0x7faa08005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:43.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.680+0000 7faa0f7fe640 1 -- 172.21.15.70:0/3804869364 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faa10016030 con 0x7faa18108d10 2024-09-21T05:48:43.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.861+0000 7faa1ca24640 1 -- 172.21.15.70:0/3804869364 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7faa1806bfb0 con 0x7faa18108d10 2024-09-21T05:48:43.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.861+0000 7faa0f7fe640 1 -- 172.21.15.70:0/3804869364 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7faa100ae290 con 0x7faa18108d10 2024-09-21T05:48:43.864 INFO:teuthology.orchestra.run.smithi070.stdout:197568495669 2024-09-21T05:48:43.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.864+0000 7faa1ca24640 1 -- 172.21.15.70:0/3804869364 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7faa040b65a0 msgr2=0x7faa040b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:43.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.864+0000 7faa1ca24640 1 --2- 172.21.15.70:0/3804869364 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7faa040b65a0 0x7faa040b8ab0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faa08000c00 tx=0x7faa08005d50 comp rx=0 tx=0).stop 2024-09-21T05:48:43.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.864+0000 7faa1ca24640 1 -- 172.21.15.70:0/3804869364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa18108d10 msgr2=0x7faa1819bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:43.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.864+0000 7faa1ca24640 1 --2- 172.21.15.70:0/3804869364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa18108d10 0x7faa1819bc80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7faa1000eaa0 tx=0x7faa1000ef60 comp rx=0 tx=0).stop 2024-09-21T05:48:43.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.864+0000 7faa1ca24640 1 -- 172.21.15.70:0/3804869364 shutdown_connections 2024-09-21T05:48:43.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.864+0000 7faa1ca24640 1 --2- 172.21.15.70:0/3804869364 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7faa040b65a0 0x7faa040b8ab0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:43.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.864+0000 7faa1ca24640 1 --2- 172.21.15.70:0/3804869364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa18108d10 0x7faa1819bc80 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:43.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.864+0000 7faa1ca24640 1 --2- 172.21.15.70:0/3804869364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa181083c0 0x7faa1819b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:43.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.864+0000 7faa1ca24640 1 --2- 172.21.15.70:0/3804869364 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa18102a80 0x7faa1819b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:43.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.864+0000 7faa1ca24640 1 -- 172.21.15.70:0/3804869364 >> 172.21.15.70:0/3804869364 conn(0x7faa18079740 msgr2=0x7faa18101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:43.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.864+0000 7faa1ca24640 1 -- 172.21.15.70:0/3804869364 shutdown_connections 2024-09-21T05:48:43.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:43.864+0000 7faa1ca24640 1 -- 172.21.15.70:0/3804869364 wait complete. 2024-09-21T05:48:43.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:43 smithi070 ceph-mon[30981]: pgmap v348: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 94 B/s, 1 objects/s recovering 2024-09-21T05:48:44.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:43 smithi116 ceph-mon[34332]: pgmap v348: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 94 B/s, 1 objects/s recovering 2024-09-21T05:48:44.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:43 smithi160 ceph-mon[33979]: pgmap v348: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 94 B/s, 1 objects/s recovering 2024-09-21T05:48:44.668 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495665 got 197568495669 for osd.7 2024-09-21T05:48:44.668 DEBUG:teuthology.parallel:result is None 2024-09-21T05:48:44.668 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T05:48:44.668 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T05:48:44.914 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:44.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:44 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3804869364' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T05:48:45.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:44 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3804869364' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T05:48:45.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:44 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3804869364' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T05:48:45.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.447+0000 7fc612112640 1 -- 172.21.15.70:0/575433798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc60c1094c0 msgr2=0x7fc60c1098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:45.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.447+0000 7fc612112640 1 --2- 172.21.15.70:0/575433798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc60c1094c0 0x7fc60c1098d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4009900 tx=0x7fc5f402a410 comp rx=0 tx=0).stop 2024-09-21T05:48:45.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.447+0000 7fc612112640 1 -- 172.21.15.70:0/575433798 shutdown_connections 2024-09-21T05:48:45.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.447+0000 7fc612112640 1 --2- 172.21.15.70:0/575433798 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc60c109e10 0x7fc60c110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.447+0000 7fc612112640 1 --2- 172.21.15.70:0/575433798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc60c1094c0 0x7fc60c1098d0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.447+0000 7fc612112640 1 --2- 172.21.15.70:0/575433798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc60c103b80 0x7fc60c103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.447+0000 7fc612112640 1 -- 172.21.15.70:0/575433798 >> 172.21.15.70:0/575433798 conn(0x7fc60c0ff610 msgr2=0x7fc60c101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.447+0000 7fc612112640 1 -- 172.21.15.70:0/575433798 shutdown_connections 2024-09-21T05:48:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.447+0000 7fc612112640 1 -- 172.21.15.70:0/575433798 wait complete. 2024-09-21T05:48:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.448+0000 7fc612112640 1 Processor -- start 2024-09-21T05:48:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.448+0000 7fc612112640 1 -- start start 2024-09-21T05:48:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.448+0000 7fc612112640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc60c103b80 0x7fc60c19a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.448+0000 7fc612112640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc60c1094c0 0x7fc60c19ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.448+0000 7fc612112640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc60c109e10 0x7fc60c19fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.448+0000 7fc612112640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c113aa0 con 0x7fc60c109e10 2024-09-21T05:48:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.448+0000 7fc612112640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c113920 con 0x7fc60c1094c0 2024-09-21T05:48:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.448+0000 7fc612112640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c113c20 con 0x7fc60c103b80 2024-09-21T05:48:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.448+0000 7fc60bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc60c109e10 0x7fc60c19fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.449+0000 7fc60bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc60c109e10 0x7fc60c19fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47978/0 (socket says 172.21.15.70:47978) 2024-09-21T05:48:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.449+0000 7fc60bfff640 1 -- 172.21.15.70:0/3782206519 learned_addr learned my addr 172.21.15.70:0/3782206519 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.449+0000 7fc60affd640 1 --2- 172.21.15.70:0/3782206519 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc60c1094c0 0x7fc60c19ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.449+0000 7fc60b7fe640 1 --2- 172.21.15.70:0/3782206519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc60c103b80 0x7fc60c19a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.449+0000 7fc60bfff640 1 -- 172.21.15.70:0/3782206519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc60c103b80 msgr2=0x7fc60c19a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.449+0000 7fc60bfff640 1 --2- 172.21.15.70:0/3782206519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc60c103b80 0x7fc60c19a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.449+0000 7fc60bfff640 1 -- 172.21.15.70:0/3782206519 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc60c1094c0 msgr2=0x7fc60c19ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.449+0000 7fc60bfff640 1 --2- 172.21.15.70:0/3782206519 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc60c1094c0 0x7fc60c19ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.449+0000 7fc60bfff640 1 -- 172.21.15.70:0/3782206519 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc60c1a0420 con 0x7fc60c109e10 2024-09-21T05:48:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.449+0000 7fc60b7fe640 1 --2- 172.21.15.70:0/3782206519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc60c103b80 0x7fc60c19a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:48:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.449+0000 7fc60affd640 1 --2- 172.21.15.70:0/3782206519 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc60c1094c0 0x7fc60c19ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:48:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.449+0000 7fc60bfff640 1 --2- 172.21.15.70:0/3782206519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc60c109e10 0x7fc60c19fdb0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc60400cce0 tx=0x7fc60400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.449+0000 7fc608ff9640 1 -- 172.21.15.70:0/3782206519 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60400f450 con 0x7fc60c109e10 2024-09-21T05:48:45.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.449+0000 7fc612112640 1 -- 172.21.15.70:0/3782206519 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc60c1a0710 con 0x7fc60c109e10 2024-09-21T05:48:45.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.449+0000 7fc608ff9640 1 -- 172.21.15.70:0/3782206519 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fc60400faa0 con 0x7fc60c109e10 2024-09-21T05:48:45.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.449+0000 7fc612112640 1 -- 172.21.15.70:0/3782206519 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc60c1a6f30 con 0x7fc60c109e10 2024-09-21T05:48:45.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.449+0000 7fc608ff9640 1 -- 172.21.15.70:0/3782206519 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc604018b20 con 0x7fc60c109e10 2024-09-21T05:48:45.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.451+0000 7fc612112640 1 -- 172.21.15.70:0/3782206519 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc60c104e00 con 0x7fc60c109e10 2024-09-21T05:48:45.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.452+0000 7fc608ff9640 1 -- 172.21.15.70:0/3782206519 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fc60400fc50 con 0x7fc60c109e10 2024-09-21T05:48:45.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.453+0000 7fc608ff9640 1 --2- 172.21.15.70:0/3782206519 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc5f80b65d0 0x7fc5f80b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:45.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.453+0000 7fc60b7fe640 1 --2- 172.21.15.70:0/3782206519 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc5f80b65d0 0x7fc5f80b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:45.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.453+0000 7fc608ff9640 1 -- 172.21.15.70:0/3782206519 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fc6040e7fe0 con 0x7fc60c109e10 2024-09-21T05:48:45.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.453+0000 7fc60b7fe640 1 --2- 172.21.15.70:0/3782206519 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc5f80b65d0 0x7fc5f80b8ae0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc005fd0 tx=0x7fc5fc005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:45.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.457+0000 7fc608ff9640 1 -- 172.21.15.70:0/3782206519 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc604014030 con 0x7fc60c109e10 2024-09-21T05:48:45.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.633+0000 7fc612112640 1 -- 172.21.15.70:0/3782206519 --> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc60c063800 con 0x7fc5f80b65d0 2024-09-21T05:48:45.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.638+0000 7fc608ff9640 1 -- 172.21.15.70:0/3782206519 <== mgr.14150 v2:172.21.15.70:6800/1366013939 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340656 (secure 0 0 0) 0x7fc60c063800 con 0x7fc5f80b65d0 2024-09-21T05:48:45.644 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:48:45.645 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-21T05:48:45.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.641+0000 7fc612112640 1 -- 172.21.15.70:0/3782206519 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc5f80b65d0 msgr2=0x7fc5f80b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:45.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.641+0000 7fc612112640 1 --2- 172.21.15.70:0/3782206519 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc5f80b65d0 0x7fc5f80b8ae0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc005fd0 tx=0x7fc5fc005ea0 comp rx=0 tx=0).stop 2024-09-21T05:48:45.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.641+0000 7fc612112640 1 -- 172.21.15.70:0/3782206519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc60c109e10 msgr2=0x7fc60c19fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:45.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.641+0000 7fc612112640 1 --2- 172.21.15.70:0/3782206519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc60c109e10 0x7fc60c19fdb0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc60400cce0 tx=0x7fc60400a620 comp rx=0 tx=0).stop 2024-09-21T05:48:45.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.641+0000 7fc612112640 1 -- 172.21.15.70:0/3782206519 shutdown_connections 2024-09-21T05:48:45.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.641+0000 7fc612112640 1 --2- 172.21.15.70:0/3782206519 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc5f80b65d0 0x7fc5f80b8ae0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:45.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.641+0000 7fc612112640 1 --2- 172.21.15.70:0/3782206519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc60c109e10 0x7fc60c19fdb0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:45.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.641+0000 7fc612112640 1 --2- 172.21.15.70:0/3782206519 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc60c1094c0 0x7fc60c19ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:45.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.641+0000 7fc612112640 1 --2- 172.21.15.70:0/3782206519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc60c103b80 0x7fc60c19a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:45.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.641+0000 7fc612112640 1 -- 172.21.15.70:0/3782206519 >> 172.21.15.70:0/3782206519 conn(0x7fc60c0ff610 msgr2=0x7fc60c101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:45.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.642+0000 7fc612112640 1 -- 172.21.15.70:0/3782206519 shutdown_connections 2024-09-21T05:48:45.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:45.642+0000 7fc612112640 1 -- 172.21.15.70:0/3782206519 wait complete. 2024-09-21T05:48:45.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:45 smithi070 ceph-mon[30981]: pgmap v349: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 94 B/s, 1 objects/s recovering 2024-09-21T05:48:46.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:45 smithi116 ceph-mon[34332]: pgmap v349: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 94 B/s, 1 objects/s recovering 2024-09-21T05:48:46.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:45 smithi160 ceph-mon[33979]: pgmap v349: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 94 B/s, 1 objects/s recovering 2024-09-21T05:48:46.368 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":349,"stamp":"2024-09-21T05:48:45.421727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":663627,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":631,"num_read_kb":421,"num_write":372,"num_write_kb":2296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":2952596,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":306,"ondisk_log_size":306,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":420,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":348496,"kb_used_data":11648,"kb_used_omap":18,"kb_used_meta":336557,"kb_avail":1124593328,"statfs":{"total":1151940427776,"available":1151583567872,"internally_reserved":0,"allocated":11927552,"data_stored":7835027,"data_compressed":461514,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19143,"internal_metadata":344634681},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":756,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002421"},"pg_stats":[{"pgid":"2.1f","version":"83'13","reported_seq":104,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:40.624543+0000","last_change":"2024-09-21T05:47:03.620705+0000","last_active":"2024-09-21T05:48:40.624543+0000","last_peered":"2024-09-21T05:48:40.624543+0000","last_clean":"2024-09-21T05:48:40.624543+0000","last_became_active":"2024-09-21T05:47:03.620320+0000","last_became_peered":"2024-09-21T05:47:03.620320+0000","last_unstale":"2024-09-21T05:48:40.624543+0000","last_undegraded":"2024-09-21T05:48:40.624543+0000","last_fullsized":"2024-09-21T05:48:40.624543+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:31.684225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285636+0000","last_change":"2024-09-21T05:47:05.637251+0000","last_active":"2024-09-21T05:48:39.285636+0000","last_peered":"2024-09-21T05:48:39.285636+0000","last_clean":"2024-09-21T05:48:39.285636+0000","last_became_active":"2024-09-21T05:47:05.636867+0000","last_became_peered":"2024-09-21T05:47:05.636867+0000","last_unstale":"2024-09-21T05:48:39.285636+0000","last_undegraded":"2024-09-21T05:48:39.285636+0000","last_fullsized":"2024-09-21T05:48:39.285636+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:08.538209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715529+0000","last_change":"2024-09-21T05:47:12.676224+0000","last_active":"2024-09-21T05:48:38.715529+0000","last_peered":"2024-09-21T05:48:38.715529+0000","last_clean":"2024-09-21T05:48:38.715529+0000","last_became_active":"2024-09-21T05:47:12.675565+0000","last_became_peered":"2024-09-21T05:47:12.675565+0000","last_unstale":"2024-09-21T05:48:38.715529+0000","last_undegraded":"2024-09-21T05:48:38.715529+0000","last_fullsized":"2024-09-21T05:48:38.715529+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:37.684953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285873+0000","last_change":"2024-09-21T05:47:03.670289+0000","last_active":"2024-09-21T05:48:39.285873+0000","last_peered":"2024-09-21T05:48:39.285873+0000","last_clean":"2024-09-21T05:48:39.285873+0000","last_became_active":"2024-09-21T05:47:03.669881+0000","last_became_peered":"2024-09-21T05:47:03.669881+0000","last_unstale":"2024-09-21T05:48:39.285873+0000","last_undegraded":"2024-09-21T05:48:39.285873+0000","last_fullsized":"2024-09-21T05:48:39.285873+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:12.597766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720549+0000","last_change":"2024-09-21T05:47:05.640826+0000","last_active":"2024-09-21T05:48:38.720549+0000","last_peered":"2024-09-21T05:48:38.720549+0000","last_clean":"2024-09-21T05:48:38.720549+0000","last_became_active":"2024-09-21T05:47:05.640357+0000","last_became_peered":"2024-09-21T05:47:05.640357+0000","last_unstale":"2024-09-21T05:48:38.720549+0000","last_undegraded":"2024-09-21T05:48:38.720549+0000","last_fullsized":"2024-09-21T05:48:38.720549+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:16.434030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721134+0000","last_change":"2024-09-21T05:47:12.677260+0000","last_active":"2024-09-21T05:48:38.721134+0000","last_peered":"2024-09-21T05:48:38.721134+0000","last_clean":"2024-09-21T05:48:38.721134+0000","last_became_active":"2024-09-21T05:47:12.676599+0000","last_became_peered":"2024-09-21T05:47:12.676599+0000","last_unstale":"2024-09-21T05:48:38.721134+0000","last_undegraded":"2024-09-21T05:48:38.721134+0000","last_fullsized":"2024-09-21T05:48:38.721134+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:10.644801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.722446+0000","last_change":"2024-09-21T05:47:03.619903+0000","last_active":"2024-09-21T05:48:38.722446+0000","last_peered":"2024-09-21T05:48:38.722446+0000","last_clean":"2024-09-21T05:48:38.722446+0000","last_became_active":"2024-09-21T05:47:03.619476+0000","last_became_peered":"2024-09-21T05:47:03.619476+0000","last_unstale":"2024-09-21T05:48:38.722446+0000","last_undegraded":"2024-09-21T05:48:38.722446+0000","last_fullsized":"2024-09-21T05:48:38.722446+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:09.717552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715414+0000","last_change":"2024-09-21T05:47:05.646017+0000","last_active":"2024-09-21T05:48:38.715414+0000","last_peered":"2024-09-21T05:48:38.715414+0000","last_clean":"2024-09-21T05:48:38.715414+0000","last_became_active":"2024-09-21T05:47:05.644118+0000","last_became_peered":"2024-09-21T05:47:05.644118+0000","last_unstale":"2024-09-21T05:48:38.715414+0000","last_undegraded":"2024-09-21T05:48:38.715414+0000","last_fullsized":"2024-09-21T05:48:38.715414+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:52.908664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721813+0000","last_change":"2024-09-21T05:47:12.677555+0000","last_active":"2024-09-21T05:48:38.721813+0000","last_peered":"2024-09-21T05:48:38.721813+0000","last_clean":"2024-09-21T05:48:38.721813+0000","last_became_active":"2024-09-21T05:47:12.676886+0000","last_became_peered":"2024-09-21T05:47:12.676886+0000","last_unstale":"2024-09-21T05:48:38.721813+0000","last_undegraded":"2024-09-21T05:48:38.721813+0000","last_fullsized":"2024-09-21T05:48:38.721813+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:10:24.516641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.723105+0000","last_change":"2024-09-21T05:47:03.621556+0000","last_active":"2024-09-21T05:48:38.723105+0000","last_peered":"2024-09-21T05:48:38.723105+0000","last_clean":"2024-09-21T05:48:38.723105+0000","last_became_active":"2024-09-21T05:47:03.621101+0000","last_became_peered":"2024-09-21T05:47:03.621101+0000","last_unstale":"2024-09-21T05:48:38.723105+0000","last_undegraded":"2024-09-21T05:48:38.723105+0000","last_fullsized":"2024-09-21T05:48:38.723105+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:39:23.639431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721113+0000","last_change":"2024-09-21T05:47:05.646328+0000","last_active":"2024-09-21T05:48:38.721113+0000","last_peered":"2024-09-21T05:48:38.721113+0000","last_clean":"2024-09-21T05:48:38.721113+0000","last_became_active":"2024-09-21T05:47:05.645922+0000","last_became_peered":"2024-09-21T05:47:05.645922+0000","last_unstale":"2024-09-21T05:48:38.721113+0000","last_undegraded":"2024-09-21T05:48:38.721113+0000","last_fullsized":"2024-09-21T05:48:38.721113+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:43.801707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721553+0000","last_change":"2024-09-21T05:47:12.673555+0000","last_active":"2024-09-21T05:48:38.721553+0000","last_peered":"2024-09-21T05:48:38.721553+0000","last_clean":"2024-09-21T05:48:38.721553+0000","last_became_active":"2024-09-21T05:47:12.673065+0000","last_became_peered":"2024-09-21T05:47:12.673065+0000","last_unstale":"2024-09-21T05:48:38.721553+0000","last_undegraded":"2024-09-21T05:48:38.721553+0000","last_fullsized":"2024-09-21T05:48:38.721553+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:53.548779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.717684+0000","last_change":"2024-09-21T05:47:05.645376+0000","last_active":"2024-09-21T05:48:38.717684+0000","last_peered":"2024-09-21T05:48:38.717684+0000","last_clean":"2024-09-21T05:48:38.717684+0000","last_became_active":"2024-09-21T05:47:05.644800+0000","last_became_peered":"2024-09-21T05:47:05.644800+0000","last_unstale":"2024-09-21T05:48:38.717684+0000","last_undegraded":"2024-09-21T05:48:38.717684+0000","last_fullsized":"2024-09-21T05:48:38.717684+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:10.460407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720612+0000","last_change":"2024-09-21T05:47:03.619926+0000","last_active":"2024-09-21T05:48:38.720612+0000","last_peered":"2024-09-21T05:48:38.720612+0000","last_clean":"2024-09-21T05:48:38.720612+0000","last_became_active":"2024-09-21T05:47:03.619433+0000","last_became_peered":"2024-09-21T05:47:03.619433+0000","last_unstale":"2024-09-21T05:48:38.720612+0000","last_undegraded":"2024-09-21T05:48:38.720612+0000","last_fullsized":"2024-09-21T05:48:38.720612+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:33.792874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721928+0000","last_change":"2024-09-21T05:47:12.874200+0000","last_active":"2024-09-21T05:48:38.721928+0000","last_peered":"2024-09-21T05:48:38.721928+0000","last_clean":"2024-09-21T05:48:38.721928+0000","last_became_active":"2024-09-21T05:47:12.873563+0000","last_became_peered":"2024-09-21T05:47:12.873563+0000","last_unstale":"2024-09-21T05:48:38.721928+0000","last_undegraded":"2024-09-21T05:48:38.721928+0000","last_fullsized":"2024-09-21T05:48:38.721928+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:34.839934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285679+0000","last_change":"2024-09-21T05:47:05.639033+0000","last_active":"2024-09-21T05:48:39.285679+0000","last_peered":"2024-09-21T05:48:39.285679+0000","last_clean":"2024-09-21T05:48:39.285679+0000","last_became_active":"2024-09-21T05:47:05.637433+0000","last_became_peered":"2024-09-21T05:47:05.637433+0000","last_unstale":"2024-09-21T05:48:39.285679+0000","last_undegraded":"2024-09-21T05:48:39.285679+0000","last_fullsized":"2024-09-21T05:48:39.285679+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:55.181025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715812+0000","last_change":"2024-09-21T05:47:03.614460+0000","last_active":"2024-09-21T05:48:38.715812+0000","last_peered":"2024-09-21T05:48:38.715812+0000","last_clean":"2024-09-21T05:48:38.715812+0000","last_became_active":"2024-09-21T05:47:03.613975+0000","last_became_peered":"2024-09-21T05:47:03.613975+0000","last_unstale":"2024-09-21T05:48:38.715812+0000","last_undegraded":"2024-09-21T05:48:38.715812+0000","last_fullsized":"2024-09-21T05:48:38.715812+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:26.838907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721726+0000","last_change":"2024-09-21T05:47:38.733044+0000","last_active":"2024-09-21T05:48:38.721726+0000","last_peered":"2024-09-21T05:48:38.721726+0000","last_clean":"2024-09-21T05:48:38.721726+0000","last_became_active":"2024-09-21T05:47:38.732327+0000","last_became_peered":"2024-09-21T05:47:38.732327+0000","last_unstale":"2024-09-21T05:48:38.721726+0000","last_undegraded":"2024-09-21T05:48:38.721726+0000","last_fullsized":"2024-09-21T05:48:38.721726+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:59.462529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718895+0000","last_change":"2024-09-21T05:47:05.631831+0000","last_active":"2024-09-21T05:48:38.718895+0000","last_peered":"2024-09-21T05:48:38.718895+0000","last_clean":"2024-09-21T05:48:38.718895+0000","last_became_active":"2024-09-21T05:47:05.630403+0000","last_became_peered":"2024-09-21T05:47:05.630403+0000","last_unstale":"2024-09-21T05:48:38.718895+0000","last_undegraded":"2024-09-21T05:48:38.718895+0000","last_fullsized":"2024-09-21T05:48:38.718895+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:21.163262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285507+0000","last_change":"2024-09-21T05:47:03.618888+0000","last_active":"2024-09-21T05:48:39.285507+0000","last_peered":"2024-09-21T05:48:39.285507+0000","last_clean":"2024-09-21T05:48:39.285507+0000","last_became_active":"2024-09-21T05:47:03.618506+0000","last_became_peered":"2024-09-21T05:47:03.618506+0000","last_unstale":"2024-09-21T05:48:39.285507+0000","last_undegraded":"2024-09-21T05:48:39.285507+0000","last_fullsized":"2024-09-21T05:48:39.285507+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:52.711976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714826+0000","last_change":"2024-09-21T05:47:12.675649+0000","last_active":"2024-09-21T05:48:38.714826+0000","last_peered":"2024-09-21T05:48:38.714826+0000","last_clean":"2024-09-21T05:48:38.714826+0000","last_became_active":"2024-09-21T05:47:12.675268+0000","last_became_peered":"2024-09-21T05:47:12.675268+0000","last_unstale":"2024-09-21T05:48:38.714826+0000","last_undegraded":"2024-09-21T05:48:38.714826+0000","last_fullsized":"2024-09-21T05:48:38.714826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:48:31.481292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720444+0000","last_change":"2024-09-21T05:47:05.622838+0000","last_active":"2024-09-21T05:48:38.720444+0000","last_peered":"2024-09-21T05:48:38.720444+0000","last_clean":"2024-09-21T05:48:38.720444+0000","last_became_active":"2024-09-21T05:47:05.622216+0000","last_became_peered":"2024-09-21T05:47:05.622216+0000","last_unstale":"2024-09-21T05:48:38.720444+0000","last_undegraded":"2024-09-21T05:48:38.720444+0000","last_fullsized":"2024-09-21T05:48:38.720444+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:55.446747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715215+0000","last_change":"2024-09-21T05:47:03.670405+0000","last_active":"2024-09-21T05:48:38.715215+0000","last_peered":"2024-09-21T05:48:38.715215+0000","last_clean":"2024-09-21T05:48:38.715215+0000","last_became_active":"2024-09-21T05:47:03.669958+0000","last_became_peered":"2024-09-21T05:47:03.669958+0000","last_unstale":"2024-09-21T05:48:38.715215+0000","last_undegraded":"2024-09-21T05:48:38.715215+0000","last_fullsized":"2024-09-21T05:48:38.715215+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:25.702903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.722178+0000","last_change":"2024-09-21T05:47:38.399039+0000","last_active":"2024-09-21T05:48:38.722178+0000","last_peered":"2024-09-21T05:48:38.722178+0000","last_clean":"2024-09-21T05:48:38.722178+0000","last_became_active":"2024-09-21T05:47:38.398441+0000","last_became_peered":"2024-09-21T05:47:38.398441+0000","last_unstale":"2024-09-21T05:48:38.722178+0000","last_undegraded":"2024-09-21T05:48:38.722178+0000","last_fullsized":"2024-09-21T05:48:38.722178+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:11.095516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,8],"acting":[4,5,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720364+0000","last_change":"2024-09-21T05:47:05.632911+0000","last_active":"2024-09-21T05:48:38.720364+0000","last_peered":"2024-09-21T05:48:38.720364+0000","last_clean":"2024-09-21T05:48:38.720364+0000","last_became_active":"2024-09-21T05:47:05.632256+0000","last_became_peered":"2024-09-21T05:47:05.632256+0000","last_unstale":"2024-09-21T05:48:38.720364+0000","last_undegraded":"2024-09-21T05:48:38.720364+0000","last_fullsized":"2024-09-21T05:48:38.720364+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:41.014253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.722338+0000","last_change":"2024-09-21T05:47:04.411753+0000","last_active":"2024-09-21T05:48:38.722338+0000","last_peered":"2024-09-21T05:48:38.722338+0000","last_clean":"2024-09-21T05:48:38.722338+0000","last_became_active":"2024-09-21T05:47:04.411225+0000","last_became_peered":"2024-09-21T05:47:04.411225+0000","last_unstale":"2024-09-21T05:48:38.722338+0000","last_undegraded":"2024-09-21T05:48:38.722338+0000","last_fullsized":"2024-09-21T05:48:38.722338+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:07.964184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715636+0000","last_change":"2024-09-21T05:47:12.670157+0000","last_active":"2024-09-21T05:48:38.715636+0000","last_peered":"2024-09-21T05:48:38.715636+0000","last_clean":"2024-09-21T05:48:38.715636+0000","last_became_active":"2024-09-21T05:47:12.669710+0000","last_became_peered":"2024-09-21T05:47:12.669710+0000","last_unstale":"2024-09-21T05:48:38.715636+0000","last_undegraded":"2024-09-21T05:48:38.715636+0000","last_fullsized":"2024-09-21T05:48:38.715636+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:31.023624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285760+0000","last_change":"2024-09-21T05:47:05.637982+0000","last_active":"2024-09-21T05:48:39.285760+0000","last_peered":"2024-09-21T05:48:39.285760+0000","last_clean":"2024-09-21T05:48:39.285760+0000","last_became_active":"2024-09-21T05:47:05.637357+0000","last_became_peered":"2024-09-21T05:47:05.637357+0000","last_unstale":"2024-09-21T05:48:39.285760+0000","last_undegraded":"2024-09-21T05:48:39.285760+0000","last_fullsized":"2024-09-21T05:48:39.285760+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:41:12.986231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"83'15","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714741+0000","last_change":"2024-09-21T05:47:03.611556+0000","last_active":"2024-09-21T05:48:38.714741+0000","last_peered":"2024-09-21T05:48:38.714741+0000","last_clean":"2024-09-21T05:48:38.714741+0000","last_became_active":"2024-09-21T05:47:03.611192+0000","last_became_peered":"2024-09-21T05:47:03.611192+0000","last_unstale":"2024-09-21T05:48:38.714741+0000","last_undegraded":"2024-09-21T05:48:38.714741+0000","last_fullsized":"2024-09-21T05:48:38.714741+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:20.047405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285193+0000","last_change":"2024-09-21T05:47:12.874796+0000","last_active":"2024-09-21T05:48:39.285193+0000","last_peered":"2024-09-21T05:48:39.285193+0000","last_clean":"2024-09-21T05:48:39.285193+0000","last_became_active":"2024-09-21T05:47:12.873648+0000","last_became_peered":"2024-09-21T05:47:12.873648+0000","last_unstale":"2024-09-21T05:48:39.285193+0000","last_undegraded":"2024-09-21T05:48:39.285193+0000","last_fullsized":"2024-09-21T05:48:39.285193+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:50.591584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.432887+0000","last_change":"2024-09-21T05:47:05.634289+0000","last_active":"2024-09-21T05:48:39.432887+0000","last_peered":"2024-09-21T05:48:39.432887+0000","last_clean":"2024-09-21T05:48:39.432887+0000","last_became_active":"2024-09-21T05:47:05.633971+0000","last_became_peered":"2024-09-21T05:47:05.633971+0000","last_unstale":"2024-09-21T05:48:39.432887+0000","last_undegraded":"2024-09-21T05:48:39.432887+0000","last_fullsized":"2024-09-21T05:48:39.432887+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:53.819753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.722582+0000","last_change":"2024-09-21T05:47:03.671877+0000","last_active":"2024-09-21T05:48:38.722582+0000","last_peered":"2024-09-21T05:48:38.722582+0000","last_clean":"2024-09-21T05:48:38.722582+0000","last_became_active":"2024-09-21T05:47:03.671443+0000","last_became_peered":"2024-09-21T05:47:03.671443+0000","last_unstale":"2024-09-21T05:48:38.722582+0000","last_undegraded":"2024-09-21T05:48:38.722582+0000","last_fullsized":"2024-09-21T05:48:38.722582+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:00.114953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.717823+0000","last_change":"2024-09-21T05:47:12.673004+0000","last_active":"2024-09-21T05:48:38.717823+0000","last_peered":"2024-09-21T05:48:38.717823+0000","last_clean":"2024-09-21T05:48:38.717823+0000","last_became_active":"2024-09-21T05:47:12.671784+0000","last_became_peered":"2024-09-21T05:47:12.671784+0000","last_unstale":"2024-09-21T05:48:38.717823+0000","last_undegraded":"2024-09-21T05:48:38.717823+0000","last_fullsized":"2024-09-21T05:48:38.717823+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:38.672438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.286275+0000","last_change":"2024-09-21T05:47:05.635204+0000","last_active":"2024-09-21T05:48:39.286275+0000","last_peered":"2024-09-21T05:48:39.286275+0000","last_clean":"2024-09-21T05:48:39.286275+0000","last_became_active":"2024-09-21T05:47:05.634794+0000","last_became_peered":"2024-09-21T05:47:05.634794+0000","last_unstale":"2024-09-21T05:48:39.286275+0000","last_undegraded":"2024-09-21T05:48:39.286275+0000","last_fullsized":"2024-09-21T05:48:39.286275+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:08.208843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714631+0000","last_change":"2024-09-21T05:47:03.671864+0000","last_active":"2024-09-21T05:48:38.714631+0000","last_peered":"2024-09-21T05:48:38.714631+0000","last_clean":"2024-09-21T05:48:38.714631+0000","last_became_active":"2024-09-21T05:47:03.671510+0000","last_became_peered":"2024-09-21T05:47:03.671510+0000","last_unstale":"2024-09-21T05:48:38.714631+0000","last_undegraded":"2024-09-21T05:48:38.714631+0000","last_fullsized":"2024-09-21T05:48:38.714631+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:12.831235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720666+0000","last_change":"2024-09-21T05:47:38.398708+0000","last_active":"2024-09-21T05:48:38.720666+0000","last_peered":"2024-09-21T05:48:38.720666+0000","last_clean":"2024-09-21T05:48:38.720666+0000","last_became_active":"2024-09-21T05:47:38.398211+0000","last_became_peered":"2024-09-21T05:47:38.398211+0000","last_unstale":"2024-09-21T05:48:38.720666+0000","last_undegraded":"2024-09-21T05:48:38.720666+0000","last_fullsized":"2024-09-21T05:48:38.720666+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:29.250191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.286123+0000","last_change":"2024-09-21T05:47:05.633069+0000","last_active":"2024-09-21T05:48:39.286123+0000","last_peered":"2024-09-21T05:48:39.286123+0000","last_clean":"2024-09-21T05:48:39.286123+0000","last_became_active":"2024-09-21T05:47:05.632698+0000","last_became_peered":"2024-09-21T05:47:05.632698+0000","last_unstale":"2024-09-21T05:48:39.286123+0000","last_undegraded":"2024-09-21T05:48:39.286123+0000","last_fullsized":"2024-09-21T05:48:39.286123+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:04.081062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'5","reported_seq":96,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.623778+0000","last_change":"2024-09-21T05:47:03.622490+0000","last_active":"2024-09-21T05:48:39.623778+0000","last_peered":"2024-09-21T05:48:39.623778+0000","last_clean":"2024-09-21T05:48:39.623778+0000","last_became_active":"2024-09-21T05:47:03.622093+0000","last_became_peered":"2024-09-21T05:47:03.622093+0000","last_unstale":"2024-09-21T05:48:39.623778+0000","last_undegraded":"2024-09-21T05:48:39.623778+0000","last_fullsized":"2024-09-21T05:48:39.623778+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:40.500152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.432756+0000","last_change":"2024-09-21T05:47:12.670060+0000","last_active":"2024-09-21T05:48:39.432756+0000","last_peered":"2024-09-21T05:48:39.432756+0000","last_clean":"2024-09-21T05:48:39.432756+0000","last_became_active":"2024-09-21T05:47:12.669635+0000","last_became_peered":"2024-09-21T05:47:12.669635+0000","last_unstale":"2024-09-21T05:48:39.432756+0000","last_undegraded":"2024-09-21T05:48:39.432756+0000","last_fullsized":"2024-09-21T05:48:39.432756+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:14.786984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721254+0000","last_change":"2024-09-21T05:47:05.640553+0000","last_active":"2024-09-21T05:48:38.721254+0000","last_peered":"2024-09-21T05:48:38.721254+0000","last_clean":"2024-09-21T05:48:38.721254+0000","last_became_active":"2024-09-21T05:47:05.640151+0000","last_became_peered":"2024-09-21T05:47:05.640151+0000","last_unstale":"2024-09-21T05:48:38.721254+0000","last_undegraded":"2024-09-21T05:48:38.721254+0000","last_fullsized":"2024-09-21T05:48:38.721254+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:39.904129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":99,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:42.633702+0000","last_change":"2024-09-21T05:47:03.670178+0000","last_active":"2024-09-21T05:48:42.633702+0000","last_peered":"2024-09-21T05:48:42.633702+0000","last_clean":"2024-09-21T05:48:42.633702+0000","last_became_active":"2024-09-21T05:47:03.669715+0000","last_became_peered":"2024-09-21T05:47:03.669715+0000","last_unstale":"2024-09-21T05:48:42.633702+0000","last_undegraded":"2024-09-21T05:48:42.633702+0000","last_fullsized":"2024-09-21T05:48:42.633702+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:31.457820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.432986+0000","last_change":"2024-09-21T05:47:12.875173+0000","last_active":"2024-09-21T05:48:39.432986+0000","last_peered":"2024-09-21T05:48:39.432986+0000","last_clean":"2024-09-21T05:48:39.432986+0000","last_became_active":"2024-09-21T05:47:12.873749+0000","last_became_peered":"2024-09-21T05:47:12.873749+0000","last_unstale":"2024-09-21T05:48:39.432986+0000","last_undegraded":"2024-09-21T05:48:39.432986+0000","last_fullsized":"2024-09-21T05:48:39.432986+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:33.473645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.432478+0000","last_change":"2024-09-21T05:47:05.634346+0000","last_active":"2024-09-21T05:48:39.432478+0000","last_peered":"2024-09-21T05:48:39.432478+0000","last_clean":"2024-09-21T05:48:39.432478+0000","last_became_active":"2024-09-21T05:47:05.634004+0000","last_became_peered":"2024-09-21T05:47:05.634004+0000","last_unstale":"2024-09-21T05:48:39.432478+0000","last_undegraded":"2024-09-21T05:48:39.432478+0000","last_fullsized":"2024-09-21T05:48:39.432478+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:16.328729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.717723+0000","last_change":"2024-09-21T05:47:03.619472+0000","last_active":"2024-09-21T05:48:38.717723+0000","last_peered":"2024-09-21T05:48:38.717723+0000","last_clean":"2024-09-21T05:48:38.717723+0000","last_became_active":"2024-09-21T05:47:03.619077+0000","last_became_peered":"2024-09-21T05:47:03.619077+0000","last_unstale":"2024-09-21T05:48:38.717723+0000","last_undegraded":"2024-09-21T05:48:38.717723+0000","last_fullsized":"2024-09-21T05:48:38.717723+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:17.774462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.722547+0000","last_change":"2024-09-21T05:47:38.730714+0000","last_active":"2024-09-21T05:48:38.722547+0000","last_peered":"2024-09-21T05:48:38.722547+0000","last_clean":"2024-09-21T05:48:38.722547+0000","last_became_active":"2024-09-21T05:47:38.730271+0000","last_became_peered":"2024-09-21T05:47:38.730271+0000","last_unstale":"2024-09-21T05:48:38.722547+0000","last_undegraded":"2024-09-21T05:48:38.722547+0000","last_fullsized":"2024-09-21T05:48:38.722547+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:53.391967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285511+0000","last_change":"2024-09-21T05:47:05.642487+0000","last_active":"2024-09-21T05:48:39.285511+0000","last_peered":"2024-09-21T05:48:39.285511+0000","last_clean":"2024-09-21T05:48:39.285511+0000","last_became_active":"2024-09-21T05:47:05.642022+0000","last_became_peered":"2024-09-21T05:47:05.642022+0000","last_unstale":"2024-09-21T05:48:39.285511+0000","last_undegraded":"2024-09-21T05:48:39.285511+0000","last_fullsized":"2024-09-21T05:48:39.285511+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:50:38.435444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721907+0000","last_change":"2024-09-21T05:47:03.618333+0000","last_active":"2024-09-21T05:48:38.721907+0000","last_peered":"2024-09-21T05:48:38.721907+0000","last_clean":"2024-09-21T05:48:38.721907+0000","last_became_active":"2024-09-21T05:47:03.617843+0000","last_became_peered":"2024-09-21T05:47:03.617843+0000","last_unstale":"2024-09-21T05:48:38.721907+0000","last_undegraded":"2024-09-21T05:48:38.721907+0000","last_fullsized":"2024-09-21T05:48:38.721907+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:01.647913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":115,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718194+0000","last_change":"2024-09-21T05:45:52.661435+0000","last_active":"2024-09-21T05:48:38.718194+0000","last_peered":"2024-09-21T05:48:38.718194+0000","last_clean":"2024-09-21T05:48:38.718194+0000","last_became_active":"2024-09-21T05:45:52.656767+0000","last_became_peered":"2024-09-21T05:45:52.656767+0000","last_unstale":"2024-09-21T05:48:38.718194+0000","last_undegraded":"2024-09-21T05:48:38.718194+0000","last_fullsized":"2024-09-21T05:48:38.718194+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:42:26.045146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:42:26.045146+0000","last_clean_scrub_stamp":"2024-09-21T05:42:26.045146+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:40:12.152499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718097+0000","last_change":"2024-09-21T05:47:12.675435+0000","last_active":"2024-09-21T05:48:38.718097+0000","last_peered":"2024-09-21T05:48:38.718097+0000","last_clean":"2024-09-21T05:48:38.718097+0000","last_became_active":"2024-09-21T05:47:12.674955+0000","last_became_peered":"2024-09-21T05:47:12.674955+0000","last_unstale":"2024-09-21T05:48:38.718097+0000","last_undegraded":"2024-09-21T05:48:38.718097+0000","last_fullsized":"2024-09-21T05:48:38.718097+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:18.758498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718264+0000","last_change":"2024-09-21T05:47:05.640952+0000","last_active":"2024-09-21T05:48:38.718264+0000","last_peered":"2024-09-21T05:48:38.718264+0000","last_clean":"2024-09-21T05:48:38.718264+0000","last_became_active":"2024-09-21T05:47:05.640554+0000","last_became_peered":"2024-09-21T05:47:05.640554+0000","last_unstale":"2024-09-21T05:48:38.718264+0000","last_undegraded":"2024-09-21T05:48:38.718264+0000","last_fullsized":"2024-09-21T05:48:38.718264+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:15:08.553651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'5","reported_seq":100,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:43.645943+0000","last_change":"2024-09-21T05:47:04.411605+0000","last_active":"2024-09-21T05:48:43.645943+0000","last_peered":"2024-09-21T05:48:43.645943+0000","last_clean":"2024-09-21T05:48:43.645943+0000","last_became_active":"2024-09-21T05:47:04.411129+0000","last_became_peered":"2024-09-21T05:47:04.411129+0000","last_unstale":"2024-09-21T05:48:43.645943+0000","last_undegraded":"2024-09-21T05:48:43.645943+0000","last_fullsized":"2024-09-21T05:48:43.645943+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:25.469148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715250+0000","last_change":"2024-09-21T05:47:12.670479+0000","last_active":"2024-09-21T05:48:38.715250+0000","last_peered":"2024-09-21T05:48:38.715250+0000","last_clean":"2024-09-21T05:48:38.715250+0000","last_became_active":"2024-09-21T05:47:12.669925+0000","last_became_peered":"2024-09-21T05:47:12.669925+0000","last_unstale":"2024-09-21T05:48:38.715250+0000","last_undegraded":"2024-09-21T05:48:38.715250+0000","last_fullsized":"2024-09-21T05:48:38.715250+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:50.506063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718020+0000","last_change":"2024-09-21T05:47:05.634519+0000","last_active":"2024-09-21T05:48:38.718020+0000","last_peered":"2024-09-21T05:48:38.718020+0000","last_clean":"2024-09-21T05:48:38.718020+0000","last_became_active":"2024-09-21T05:47:05.634134+0000","last_became_peered":"2024-09-21T05:47:05.634134+0000","last_unstale":"2024-09-21T05:48:38.718020+0000","last_undegraded":"2024-09-21T05:48:38.718020+0000","last_fullsized":"2024-09-21T05:48:38.718020+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:57.464884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721323+0000","last_change":"2024-09-21T05:47:03.622860+0000","last_active":"2024-09-21T05:48:38.721323+0000","last_peered":"2024-09-21T05:48:38.721323+0000","last_clean":"2024-09-21T05:48:38.721323+0000","last_became_active":"2024-09-21T05:47:03.622435+0000","last_became_peered":"2024-09-21T05:47:03.622435+0000","last_unstale":"2024-09-21T05:48:38.721323+0000","last_undegraded":"2024-09-21T05:48:38.721323+0000","last_fullsized":"2024-09-21T05:48:38.721323+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:03.352140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720141+0000","last_change":"2024-09-21T05:47:12.673518+0000","last_active":"2024-09-21T05:48:38.720141+0000","last_peered":"2024-09-21T05:48:38.720141+0000","last_clean":"2024-09-21T05:48:38.720141+0000","last_became_active":"2024-09-21T05:47:12.673000+0000","last_became_peered":"2024-09-21T05:47:12.673000+0000","last_unstale":"2024-09-21T05:48:38.720141+0000","last_undegraded":"2024-09-21T05:48:38.720141+0000","last_fullsized":"2024-09-21T05:48:38.720141+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:37.859801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718272+0000","last_change":"2024-09-21T05:47:05.625144+0000","last_active":"2024-09-21T05:48:38.718272+0000","last_peered":"2024-09-21T05:48:38.718272+0000","last_clean":"2024-09-21T05:48:38.718272+0000","last_became_active":"2024-09-21T05:47:05.624593+0000","last_became_peered":"2024-09-21T05:47:05.624593+0000","last_unstale":"2024-09-21T05:48:38.718272+0000","last_undegraded":"2024-09-21T05:48:38.718272+0000","last_fullsized":"2024-09-21T05:48:38.718272+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:04.332686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.433017+0000","last_change":"2024-09-21T05:47:03.612389+0000","last_active":"2024-09-21T05:48:39.433017+0000","last_peered":"2024-09-21T05:48:39.433017+0000","last_clean":"2024-09-21T05:48:39.433017+0000","last_became_active":"2024-09-21T05:47:03.612023+0000","last_became_peered":"2024-09-21T05:47:03.612023+0000","last_unstale":"2024-09-21T05:48:39.433017+0000","last_undegraded":"2024-09-21T05:48:39.433017+0000","last_fullsized":"2024-09-21T05:48:39.433017+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:32.571903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721092+0000","last_change":"2024-09-21T05:47:12.674963+0000","last_active":"2024-09-21T05:48:38.721092+0000","last_peered":"2024-09-21T05:48:38.721092+0000","last_clean":"2024-09-21T05:48:38.721092+0000","last_became_active":"2024-09-21T05:47:12.673883+0000","last_became_peered":"2024-09-21T05:47:12.673883+0000","last_unstale":"2024-09-21T05:48:38.721092+0000","last_undegraded":"2024-09-21T05:48:38.721092+0000","last_fullsized":"2024-09-21T05:48:38.721092+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:29.843443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718170+0000","last_change":"2024-09-21T05:47:05.638440+0000","last_active":"2024-09-21T05:48:38.718170+0000","last_peered":"2024-09-21T05:48:38.718170+0000","last_clean":"2024-09-21T05:48:38.718170+0000","last_became_active":"2024-09-21T05:47:05.638010+0000","last_became_peered":"2024-09-21T05:47:05.638010+0000","last_unstale":"2024-09-21T05:48:38.718170+0000","last_undegraded":"2024-09-21T05:48:38.718170+0000","last_fullsized":"2024-09-21T05:48:38.718170+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:47.921461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.742870+0000","last_change":"2024-09-21T05:48:38.742314+0000","last_active":"2024-09-21T05:48:38.742870+0000","last_peered":"2024-09-21T05:48:38.742870+0000","last_clean":"2024-09-21T05:48:38.742870+0000","last_became_active":"2024-09-21T05:48:38.723546+0000","last_became_peered":"2024-09-21T05:48:38.723546+0000","last_unstale":"2024-09-21T05:48:38.742870+0000","last_undegraded":"2024-09-21T05:48:38.742870+0000","last_fullsized":"2024-09-21T05:48:38.742870+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:12.911309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.719761+0000","last_change":"2024-09-21T05:47:12.675362+0000","last_active":"2024-09-21T05:48:38.719761+0000","last_peered":"2024-09-21T05:48:38.719761+0000","last_clean":"2024-09-21T05:48:38.719761+0000","last_became_active":"2024-09-21T05:47:12.674578+0000","last_became_peered":"2024-09-21T05:47:12.674578+0000","last_unstale":"2024-09-21T05:48:38.719761+0000","last_undegraded":"2024-09-21T05:48:38.719761+0000","last_fullsized":"2024-09-21T05:48:38.719761+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:56.654323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720182+0000","last_change":"2024-09-21T05:47:05.641130+0000","last_active":"2024-09-21T05:48:38.720182+0000","last_peered":"2024-09-21T05:48:38.720182+0000","last_clean":"2024-09-21T05:48:38.720182+0000","last_became_active":"2024-09-21T05:47:05.640794+0000","last_became_peered":"2024-09-21T05:47:05.640794+0000","last_unstale":"2024-09-21T05:48:38.720182+0000","last_undegraded":"2024-09-21T05:48:38.720182+0000","last_fullsized":"2024-09-21T05:48:38.720182+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:29:18.243240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.738576+0000","last_change":"2024-09-21T05:48:38.737941+0000","last_active":"2024-09-21T05:48:38.738576+0000","last_peered":"2024-09-21T05:48:38.738576+0000","last_clean":"2024-09-21T05:48:38.738576+0000","last_became_active":"2024-09-21T05:48:38.722769+0000","last_became_peered":"2024-09-21T05:48:38.722769+0000","last_unstale":"2024-09-21T05:48:38.738576+0000","last_undegraded":"2024-09-21T05:48:38.738576+0000","last_fullsized":"2024-09-21T05:48:38.738576+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:24.258822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.432974+0000","last_change":"2024-09-21T05:47:12.671181+0000","last_active":"2024-09-21T05:48:39.432974+0000","last_peered":"2024-09-21T05:48:39.432974+0000","last_clean":"2024-09-21T05:48:39.432974+0000","last_became_active":"2024-09-21T05:47:12.670522+0000","last_became_peered":"2024-09-21T05:47:12.670522+0000","last_unstale":"2024-09-21T05:48:39.432974+0000","last_undegraded":"2024-09-21T05:48:39.432974+0000","last_fullsized":"2024-09-21T05:48:39.432974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:52.165812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.717455+0000","last_change":"2024-09-21T05:47:05.629167+0000","last_active":"2024-09-21T05:48:38.717455+0000","last_peered":"2024-09-21T05:48:38.717455+0000","last_clean":"2024-09-21T05:48:38.717455+0000","last_became_active":"2024-09-21T05:47:05.628794+0000","last_became_peered":"2024-09-21T05:47:05.628794+0000","last_unstale":"2024-09-21T05:48:38.717455+0000","last_undegraded":"2024-09-21T05:48:38.717455+0000","last_fullsized":"2024-09-21T05:48:38.717455+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:51.469247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'6","reported_seq":101,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:41.632854+0000","last_change":"2024-09-21T05:47:03.621479+0000","last_active":"2024-09-21T05:48:41.632854+0000","last_peered":"2024-09-21T05:48:41.632854+0000","last_clean":"2024-09-21T05:48:41.632854+0000","last_became_active":"2024-09-21T05:47:03.621041+0000","last_became_peered":"2024-09-21T05:47:03.621041+0000","last_unstale":"2024-09-21T05:48:41.632854+0000","last_undegraded":"2024-09-21T05:48:41.632854+0000","last_fullsized":"2024-09-21T05:48:41.632854+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:33.092750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714842+0000","last_change":"2024-09-21T05:47:12.669821+0000","last_active":"2024-09-21T05:48:38.714842+0000","last_peered":"2024-09-21T05:48:38.714842+0000","last_clean":"2024-09-21T05:48:38.714842+0000","last_became_active":"2024-09-21T05:47:12.669418+0000","last_became_peered":"2024-09-21T05:47:12.669418+0000","last_unstale":"2024-09-21T05:48:38.714842+0000","last_undegraded":"2024-09-21T05:48:38.714842+0000","last_fullsized":"2024-09-21T05:48:38.714842+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:57.082509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.717767+0000","last_change":"2024-09-21T05:47:05.631182+0000","last_active":"2024-09-21T05:48:38.717767+0000","last_peered":"2024-09-21T05:48:38.717767+0000","last_clean":"2024-09-21T05:48:38.717767+0000","last_became_active":"2024-09-21T05:47:05.630716+0000","last_became_peered":"2024-09-21T05:47:05.630716+0000","last_unstale":"2024-09-21T05:48:38.717767+0000","last_undegraded":"2024-09-21T05:48:38.717767+0000","last_fullsized":"2024-09-21T05:48:38.717767+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:17.946858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720713+0000","last_change":"2024-09-21T05:47:03.620897+0000","last_active":"2024-09-21T05:48:38.720713+0000","last_peered":"2024-09-21T05:48:38.720713+0000","last_clean":"2024-09-21T05:48:38.720713+0000","last_became_active":"2024-09-21T05:47:03.620003+0000","last_became_peered":"2024-09-21T05:47:03.620003+0000","last_unstale":"2024-09-21T05:48:38.720713+0000","last_undegraded":"2024-09-21T05:48:38.720713+0000","last_fullsized":"2024-09-21T05:48:38.720713+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:51:07.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718077+0000","last_change":"2024-09-21T05:47:12.675320+0000","last_active":"2024-09-21T05:48:38.718077+0000","last_peered":"2024-09-21T05:48:38.718077+0000","last_clean":"2024-09-21T05:48:38.718077+0000","last_became_active":"2024-09-21T05:47:12.674715+0000","last_became_peered":"2024-09-21T05:47:12.674715+0000","last_unstale":"2024-09-21T05:48:38.718077+0000","last_undegraded":"2024-09-21T05:48:38.718077+0000","last_fullsized":"2024-09-21T05:48:38.718077+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:28.151947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.432628+0000","last_change":"2024-09-21T05:47:05.630786+0000","last_active":"2024-09-21T05:48:39.432628+0000","last_peered":"2024-09-21T05:48:39.432628+0000","last_clean":"2024-09-21T05:48:39.432628+0000","last_became_active":"2024-09-21T05:47:05.630433+0000","last_became_peered":"2024-09-21T05:47:05.630433+0000","last_unstale":"2024-09-21T05:48:39.432628+0000","last_undegraded":"2024-09-21T05:48:39.432628+0000","last_fullsized":"2024-09-21T05:48:39.432628+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:54.481462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.716267+0000","last_change":"2024-09-21T05:47:03.618990+0000","last_active":"2024-09-21T05:48:38.716267+0000","last_peered":"2024-09-21T05:48:38.716267+0000","last_clean":"2024-09-21T05:48:38.716267+0000","last_became_active":"2024-09-21T05:47:03.618679+0000","last_became_peered":"2024-09-21T05:47:03.618679+0000","last_unstale":"2024-09-21T05:48:38.716267+0000","last_undegraded":"2024-09-21T05:48:38.716267+0000","last_fullsized":"2024-09-21T05:48:38.716267+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:10.193233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721027+0000","last_change":"2024-09-21T05:47:12.675012+0000","last_active":"2024-09-21T05:48:38.721027+0000","last_peered":"2024-09-21T05:48:38.721027+0000","last_clean":"2024-09-21T05:48:38.721027+0000","last_became_active":"2024-09-21T05:47:12.674266+0000","last_became_peered":"2024-09-21T05:47:12.674266+0000","last_unstale":"2024-09-21T05:48:38.721027+0000","last_undegraded":"2024-09-21T05:48:38.721027+0000","last_fullsized":"2024-09-21T05:48:38.721027+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:43.525084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.722236+0000","last_change":"2024-09-21T05:47:05.625457+0000","last_active":"2024-09-21T05:48:38.722236+0000","last_peered":"2024-09-21T05:48:38.722236+0000","last_clean":"2024-09-21T05:48:38.722236+0000","last_became_active":"2024-09-21T05:47:05.625058+0000","last_became_peered":"2024-09-21T05:47:05.625058+0000","last_unstale":"2024-09-21T05:48:38.722236+0000","last_undegraded":"2024-09-21T05:48:38.722236+0000","last_fullsized":"2024-09-21T05:48:38.722236+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:29:09.352152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"83'34","reported_seq":183,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:40.726001+0000","last_change":"2024-09-21T05:47:03.621535+0000","last_active":"2024-09-21T05:48:40.726001+0000","last_peered":"2024-09-21T05:48:40.726001+0000","last_clean":"2024-09-21T05:48:40.726001+0000","last_became_active":"2024-09-21T05:47:03.621109+0000","last_became_peered":"2024-09-21T05:47:03.621109+0000","last_unstale":"2024-09-21T05:48:40.726001+0000","last_undegraded":"2024-09-21T05:48:40.726001+0000","last_fullsized":"2024-09-21T05:48:40.726001+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:31:12.135760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66212,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":120,"num_write":36,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714371+0000","last_change":"2024-09-21T05:47:12.676827+0000","last_active":"2024-09-21T05:48:38.714371+0000","last_peered":"2024-09-21T05:48:38.714371+0000","last_clean":"2024-09-21T05:48:38.714371+0000","last_became_active":"2024-09-21T05:47:12.676256+0000","last_became_peered":"2024-09-21T05:47:12.676256+0000","last_unstale":"2024-09-21T05:48:38.714371+0000","last_undegraded":"2024-09-21T05:48:38.714371+0000","last_fullsized":"2024-09-21T05:48:38.714371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:40.932328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715421+0000","last_change":"2024-09-21T05:47:05.636507+0000","last_active":"2024-09-21T05:48:38.715421+0000","last_peered":"2024-09-21T05:48:38.715421+0000","last_clean":"2024-09-21T05:48:38.715421+0000","last_became_active":"2024-09-21T05:47:05.636140+0000","last_became_peered":"2024-09-21T05:47:05.636140+0000","last_unstale":"2024-09-21T05:48:38.715421+0000","last_undegraded":"2024-09-21T05:48:38.715421+0000","last_fullsized":"2024-09-21T05:48:38.715421+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:16.879274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721437+0000","last_change":"2024-09-21T05:47:03.670425+0000","last_active":"2024-09-21T05:48:38.721437+0000","last_peered":"2024-09-21T05:48:38.721437+0000","last_clean":"2024-09-21T05:48:38.721437+0000","last_became_active":"2024-09-21T05:47:03.669973+0000","last_became_peered":"2024-09-21T05:47:03.669973+0000","last_unstale":"2024-09-21T05:48:38.721437+0000","last_undegraded":"2024-09-21T05:48:38.721437+0000","last_fullsized":"2024-09-21T05:48:38.721437+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:04.212044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721599+0000","last_change":"2024-09-21T05:47:12.677600+0000","last_active":"2024-09-21T05:48:38.721599+0000","last_peered":"2024-09-21T05:48:38.721599+0000","last_clean":"2024-09-21T05:48:38.721599+0000","last_became_active":"2024-09-21T05:47:12.677037+0000","last_became_peered":"2024-09-21T05:47:12.677037+0000","last_unstale":"2024-09-21T05:48:38.721599+0000","last_undegraded":"2024-09-21T05:48:38.721599+0000","last_fullsized":"2024-09-21T05:48:38.721599+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:36.502821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720568+0000","last_change":"2024-09-21T05:47:38.398403+0000","last_active":"2024-09-21T05:48:38.720568+0000","last_peered":"2024-09-21T05:48:38.720568+0000","last_clean":"2024-09-21T05:48:38.720568+0000","last_became_active":"2024-09-21T05:47:38.397953+0000","last_became_peered":"2024-09-21T05:47:38.397953+0000","last_unstale":"2024-09-21T05:48:38.720568+0000","last_undegraded":"2024-09-21T05:48:38.720568+0000","last_fullsized":"2024-09-21T05:48:38.720568+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:01.550222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":56,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.727961+0000","last_change":"2024-09-21T05:48:38.727813+0000","last_active":"2024-09-21T05:48:38.727961+0000","last_peered":"2024-09-21T05:48:38.727961+0000","last_clean":"2024-09-21T05:48:38.727961+0000","last_became_active":"2024-09-21T05:48:38.722709+0000","last_became_peered":"2024-09-21T05:48:38.722709+0000","last_unstale":"2024-09-21T05:48:38.727961+0000","last_undegraded":"2024-09-21T05:48:38.727961+0000","last_fullsized":"2024-09-21T05:48:38.727961+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:22.544711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714216+0000","last_change":"2024-09-21T05:47:12.670466+0000","last_active":"2024-09-21T05:48:38.714216+0000","last_peered":"2024-09-21T05:48:38.714216+0000","last_clean":"2024-09-21T05:48:38.714216+0000","last_became_active":"2024-09-21T05:47:12.670032+0000","last_became_peered":"2024-09-21T05:47:12.670032+0000","last_unstale":"2024-09-21T05:48:38.714216+0000","last_undegraded":"2024-09-21T05:48:38.714216+0000","last_fullsized":"2024-09-21T05:48:38.714216+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:18.860347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715681+0000","last_change":"2024-09-21T05:47:05.645093+0000","last_active":"2024-09-21T05:48:38.715681+0000","last_peered":"2024-09-21T05:48:38.715681+0000","last_clean":"2024-09-21T05:48:38.715681+0000","last_became_active":"2024-09-21T05:47:05.644739+0000","last_became_peered":"2024-09-21T05:47:05.644739+0000","last_unstale":"2024-09-21T05:48:38.715681+0000","last_undegraded":"2024-09-21T05:48:38.715681+0000","last_fullsized":"2024-09-21T05:48:38.715681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:43.895574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":144,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:40.640432+0000","last_change":"2024-09-21T05:47:03.619070+0000","last_active":"2024-09-21T05:48:40.640432+0000","last_peered":"2024-09-21T05:48:40.640432+0000","last_clean":"2024-09-21T05:48:40.640432+0000","last_became_active":"2024-09-21T05:47:03.618655+0000","last_became_peered":"2024-09-21T05:47:03.618655+0000","last_unstale":"2024-09-21T05:48:40.640432+0000","last_undegraded":"2024-09-21T05:48:40.640432+0000","last_fullsized":"2024-09-21T05:48:40.640432+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:29.206109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285302+0000","last_change":"2024-09-21T05:47:12.672677+0000","last_active":"2024-09-21T05:48:39.285302+0000","last_peered":"2024-09-21T05:48:39.285302+0000","last_clean":"2024-09-21T05:48:39.285302+0000","last_became_active":"2024-09-21T05:47:12.672264+0000","last_became_peered":"2024-09-21T05:47:12.672264+0000","last_unstale":"2024-09-21T05:48:39.285302+0000","last_undegraded":"2024-09-21T05:48:39.285302+0000","last_fullsized":"2024-09-21T05:48:39.285302+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:31.680678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720222+0000","last_change":"2024-09-21T05:47:12.672702+0000","last_active":"2024-09-21T05:48:38.720222+0000","last_peered":"2024-09-21T05:48:38.720222+0000","last_clean":"2024-09-21T05:48:38.720222+0000","last_became_active":"2024-09-21T05:47:12.672233+0000","last_became_peered":"2024-09-21T05:47:12.672233+0000","last_unstale":"2024-09-21T05:48:38.720222+0000","last_undegraded":"2024-09-21T05:48:38.720222+0000","last_fullsized":"2024-09-21T05:48:38.720222+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:04.235603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714343+0000","last_change":"2024-09-21T05:47:05.633566+0000","last_active":"2024-09-21T05:48:38.714343+0000","last_peered":"2024-09-21T05:48:38.714343+0000","last_clean":"2024-09-21T05:48:38.714343+0000","last_became_active":"2024-09-21T05:47:05.633240+0000","last_became_peered":"2024-09-21T05:47:05.633240+0000","last_unstale":"2024-09-21T05:48:38.714343+0000","last_undegraded":"2024-09-21T05:48:38.714343+0000","last_fullsized":"2024-09-21T05:48:38.714343+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:10.106647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721456+0000","last_change":"2024-09-21T05:47:03.621788+0000","last_active":"2024-09-21T05:48:38.721456+0000","last_peered":"2024-09-21T05:48:38.721456+0000","last_clean":"2024-09-21T05:48:38.721456+0000","last_became_active":"2024-09-21T05:47:03.621425+0000","last_became_peered":"2024-09-21T05:47:03.621425+0000","last_unstale":"2024-09-21T05:48:38.721456+0000","last_undegraded":"2024-09-21T05:48:38.721456+0000","last_fullsized":"2024-09-21T05:48:38.721456+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:51.069361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718106+0000","last_change":"2024-09-21T05:47:12.670670+0000","last_active":"2024-09-21T05:48:38.718106+0000","last_peered":"2024-09-21T05:48:38.718106+0000","last_clean":"2024-09-21T05:48:38.718106+0000","last_became_active":"2024-09-21T05:47:12.670192+0000","last_became_peered":"2024-09-21T05:47:12.670192+0000","last_unstale":"2024-09-21T05:48:38.718106+0000","last_undegraded":"2024-09-21T05:48:38.718106+0000","last_fullsized":"2024-09-21T05:48:38.718106+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:59.430991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285347+0000","last_change":"2024-09-21T05:47:05.637775+0000","last_active":"2024-09-21T05:48:39.285347+0000","last_peered":"2024-09-21T05:48:39.285347+0000","last_clean":"2024-09-21T05:48:39.285347+0000","last_became_active":"2024-09-21T05:47:05.637436+0000","last_became_peered":"2024-09-21T05:47:05.637436+0000","last_unstale":"2024-09-21T05:48:39.285347+0000","last_undegraded":"2024-09-21T05:48:39.285347+0000","last_fullsized":"2024-09-21T05:48:39.285347+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:45:59.041879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.432501+0000","last_change":"2024-09-21T05:47:03.611317+0000","last_active":"2024-09-21T05:48:39.432501+0000","last_peered":"2024-09-21T05:48:39.432501+0000","last_clean":"2024-09-21T05:48:39.432501+0000","last_became_active":"2024-09-21T05:47:03.610967+0000","last_became_peered":"2024-09-21T05:47:03.610967+0000","last_unstale":"2024-09-21T05:48:39.432501+0000","last_undegraded":"2024-09-21T05:48:39.432501+0000","last_fullsized":"2024-09-21T05:48:39.432501+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:44.263380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.286079+0000","last_change":"2024-09-21T05:47:03.624584+0000","last_active":"2024-09-21T05:48:39.286079+0000","last_peered":"2024-09-21T05:48:39.286079+0000","last_clean":"2024-09-21T05:48:39.286079+0000","last_became_active":"2024-09-21T05:47:03.623886+0000","last_became_peered":"2024-09-21T05:47:03.623886+0000","last_unstale":"2024-09-21T05:48:39.286079+0000","last_undegraded":"2024-09-21T05:48:39.286079+0000","last_fullsized":"2024-09-21T05:48:39.286079+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:55.451732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720640+0000","last_change":"2024-09-21T05:47:38.731762+0000","last_active":"2024-09-21T05:48:38.720640+0000","last_peered":"2024-09-21T05:48:38.720640+0000","last_clean":"2024-09-21T05:48:38.720640+0000","last_became_active":"2024-09-21T05:47:38.731325+0000","last_became_peered":"2024-09-21T05:47:38.731325+0000","last_unstale":"2024-09-21T05:48:38.720640+0000","last_undegraded":"2024-09-21T05:48:38.720640+0000","last_fullsized":"2024-09-21T05:48:38.720640+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:42.516434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715948+0000","last_change":"2024-09-21T05:47:12.677198+0000","last_active":"2024-09-21T05:48:38.715948+0000","last_peered":"2024-09-21T05:48:38.715948+0000","last_clean":"2024-09-21T05:48:38.715948+0000","last_became_active":"2024-09-21T05:47:12.676673+0000","last_became_peered":"2024-09-21T05:47:12.676673+0000","last_unstale":"2024-09-21T05:48:38.715948+0000","last_undegraded":"2024-09-21T05:48:38.715948+0000","last_fullsized":"2024-09-21T05:48:38.715948+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:58.861348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"83'5","reported_seq":112,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:42.730399+0000","last_change":"2024-09-21T05:48:38.730420+0000","last_active":"2024-09-21T05:48:42.730399+0000","last_peered":"2024-09-21T05:48:42.730399+0000","last_clean":"2024-09-21T05:48:42.730399+0000","last_became_active":"2024-09-21T05:48:38.722303+0000","last_became_peered":"2024-09-21T05:48:38.722303+0000","last_unstale":"2024-09-21T05:48:42.730399+0000","last_undegraded":"2024-09-21T05:48:42.730399+0000","last_fullsized":"2024-09-21T05:48:42.730399+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:37.846446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720875+0000","last_change":"2024-09-21T05:47:05.641444+0000","last_active":"2024-09-21T05:48:38.720875+0000","last_peered":"2024-09-21T05:48:38.720875+0000","last_clean":"2024-09-21T05:48:38.720875+0000","last_became_active":"2024-09-21T05:47:05.640967+0000","last_became_peered":"2024-09-21T05:47:05.640967+0000","last_unstale":"2024-09-21T05:48:38.720875+0000","last_undegraded":"2024-09-21T05:48:38.720875+0000","last_fullsized":"2024-09-21T05:48:38.720875+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:20.698467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.716537+0000","last_change":"2024-09-21T05:47:12.680157+0000","last_active":"2024-09-21T05:48:38.716537+0000","last_peered":"2024-09-21T05:48:38.716537+0000","last_clean":"2024-09-21T05:48:38.716537+0000","last_became_active":"2024-09-21T05:47:12.679604+0000","last_became_peered":"2024-09-21T05:47:12.679604+0000","last_unstale":"2024-09-21T05:48:38.716537+0000","last_undegraded":"2024-09-21T05:48:38.716537+0000","last_fullsized":"2024-09-21T05:48:38.716537+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:15.381901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718744+0000","last_change":"2024-09-21T05:47:05.635022+0000","last_active":"2024-09-21T05:48:38.718744+0000","last_peered":"2024-09-21T05:48:38.718744+0000","last_clean":"2024-09-21T05:48:38.718744+0000","last_became_active":"2024-09-21T05:47:05.634592+0000","last_became_peered":"2024-09-21T05:47:05.634592+0000","last_unstale":"2024-09-21T05:48:38.718744+0000","last_undegraded":"2024-09-21T05:48:38.718744+0000","last_fullsized":"2024-09-21T05:48:38.718744+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:48.159339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.722743+0000","last_change":"2024-09-21T05:48:38.722629+0000","last_active":"2024-09-21T05:48:38.722743+0000","last_peered":"2024-09-21T05:48:38.722743+0000","last_clean":"2024-09-21T05:48:38.722743+0000","last_became_active":"2024-09-21T05:48:38.722198+0000","last_became_peered":"2024-09-21T05:48:38.722198+0000","last_unstale":"2024-09-21T05:48:38.722743+0000","last_undegraded":"2024-09-21T05:48:38.722743+0000","last_fullsized":"2024-09-21T05:48:38.722743+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:26.126710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715809+0000","last_change":"2024-09-21T05:47:05.637359+0000","last_active":"2024-09-21T05:48:38.715809+0000","last_peered":"2024-09-21T05:48:38.715809+0000","last_clean":"2024-09-21T05:48:38.715809+0000","last_became_active":"2024-09-21T05:47:05.636998+0000","last_became_peered":"2024-09-21T05:47:05.636998+0000","last_unstale":"2024-09-21T05:48:38.715809+0000","last_undegraded":"2024-09-21T05:48:38.715809+0000","last_fullsized":"2024-09-21T05:48:38.715809+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:06.186344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720270+0000","last_change":"2024-09-21T05:47:05.633304+0000","last_active":"2024-09-21T05:48:38.720270+0000","last_peered":"2024-09-21T05:48:38.720270+0000","last_clean":"2024-09-21T05:48:38.720270+0000","last_became_active":"2024-09-21T05:47:05.632919+0000","last_became_peered":"2024-09-21T05:47:05.632919+0000","last_unstale":"2024-09-21T05:48:38.720270+0000","last_undegraded":"2024-09-21T05:48:38.720270+0000","last_fullsized":"2024-09-21T05:48:38.720270+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:16.108908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.432862+0000","last_change":"2024-09-21T05:47:05.631091+0000","last_active":"2024-09-21T05:48:39.432862+0000","last_peered":"2024-09-21T05:48:39.432862+0000","last_clean":"2024-09-21T05:48:39.432862+0000","last_became_active":"2024-09-21T05:47:05.630740+0000","last_became_peered":"2024-09-21T05:47:05.630740+0000","last_unstale":"2024-09-21T05:48:39.432862+0000","last_undegraded":"2024-09-21T05:48:39.432862+0000","last_fullsized":"2024-09-21T05:48:39.432862+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:36:41.136890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718425+0000","last_change":"2024-09-21T05:47:38.398773+0000","last_active":"2024-09-21T05:48:38.718425+0000","last_peered":"2024-09-21T05:48:38.718425+0000","last_clean":"2024-09-21T05:48:38.718425+0000","last_became_active":"2024-09-21T05:47:38.398378+0000","last_became_peered":"2024-09-21T05:47:38.398378+0000","last_unstale":"2024-09-21T05:48:38.718425+0000","last_undegraded":"2024-09-21T05:48:38.718425+0000","last_fullsized":"2024-09-21T05:48:38.718425+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:32.247222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.716471+0000","last_change":"2024-09-21T05:47:05.641782+0000","last_active":"2024-09-21T05:48:38.716471+0000","last_peered":"2024-09-21T05:48:38.716471+0000","last_clean":"2024-09-21T05:48:38.716471+0000","last_became_active":"2024-09-21T05:47:05.641422+0000","last_became_peered":"2024-09-21T05:47:05.641422+0000","last_unstale":"2024-09-21T05:48:38.716471+0000","last_undegraded":"2024-09-21T05:48:38.716471+0000","last_fullsized":"2024-09-21T05:48:38.716471+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:33.819329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714772+0000","last_change":"2024-09-21T05:47:38.396070+0000","last_active":"2024-09-21T05:48:38.714772+0000","last_peered":"2024-09-21T05:48:38.714772+0000","last_clean":"2024-09-21T05:48:38.714772+0000","last_became_active":"2024-09-21T05:47:38.395727+0000","last_became_peered":"2024-09-21T05:47:38.395727+0000","last_unstale":"2024-09-21T05:48:38.714772+0000","last_undegraded":"2024-09-21T05:48:38.714772+0000","last_fullsized":"2024-09-21T05:48:38.714772+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:41.816692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721233+0000","last_change":"2024-09-21T05:47:05.633701+0000","last_active":"2024-09-21T05:48:38.721233+0000","last_peered":"2024-09-21T05:48:38.721233+0000","last_clean":"2024-09-21T05:48:38.721233+0000","last_became_active":"2024-09-21T05:47:05.632671+0000","last_became_peered":"2024-09-21T05:47:05.632671+0000","last_unstale":"2024-09-21T05:48:38.721233+0000","last_undegraded":"2024-09-21T05:48:38.721233+0000","last_fullsized":"2024-09-21T05:48:38.721233+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:56.180731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285415+0000","last_change":"2024-09-21T05:47:05.639419+0000","last_active":"2024-09-21T05:48:39.285415+0000","last_peered":"2024-09-21T05:48:39.285415+0000","last_clean":"2024-09-21T05:48:39.285415+0000","last_became_active":"2024-09-21T05:47:05.639060+0000","last_became_peered":"2024-09-21T05:47:05.639060+0000","last_unstale":"2024-09-21T05:48:39.285415+0000","last_undegraded":"2024-09-21T05:48:39.285415+0000","last_fullsized":"2024-09-21T05:48:39.285415+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:09.562359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715435+0000","last_change":"2024-09-21T05:47:05.641218+0000","last_active":"2024-09-21T05:48:38.715435+0000","last_peered":"2024-09-21T05:48:38.715435+0000","last_clean":"2024-09-21T05:48:38.715435+0000","last_became_active":"2024-09-21T05:47:05.640813+0000","last_became_peered":"2024-09-21T05:47:05.640813+0000","last_unstale":"2024-09-21T05:48:38.715435+0000","last_undegraded":"2024-09-21T05:48:38.715435+0000","last_fullsized":"2024-09-21T05:48:38.715435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:21.057096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.432793+0000","last_change":"2024-09-21T05:47:05.627711+0000","last_active":"2024-09-21T05:48:39.432793+0000","last_peered":"2024-09-21T05:48:39.432793+0000","last_clean":"2024-09-21T05:48:39.432793+0000","last_became_active":"2024-09-21T05:47:05.626394+0000","last_became_peered":"2024-09-21T05:47:05.626394+0000","last_unstale":"2024-09-21T05:48:39.432793+0000","last_undegraded":"2024-09-21T05:48:39.432793+0000","last_fullsized":"2024-09-21T05:48:39.432793+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:31.038727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718058+0000","last_change":"2024-09-21T05:47:05.632835+0000","last_active":"2024-09-21T05:48:38.718058+0000","last_peered":"2024-09-21T05:48:38.718058+0000","last_clean":"2024-09-21T05:48:38.718058+0000","last_became_active":"2024-09-21T05:47:05.632486+0000","last_became_peered":"2024-09-21T05:47:05.632486+0000","last_unstale":"2024-09-21T05:48:38.718058+0000","last_undegraded":"2024-09-21T05:48:38.718058+0000","last_fullsized":"2024-09-21T05:48:38.718058+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:04.365517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.716282+0000","last_change":"2024-09-21T05:47:05.638381+0000","last_active":"2024-09-21T05:48:38.716282+0000","last_peered":"2024-09-21T05:48:38.716282+0000","last_clean":"2024-09-21T05:48:38.716282+0000","last_became_active":"2024-09-21T05:47:05.638007+0000","last_became_peered":"2024-09-21T05:47:05.638007+0000","last_unstale":"2024-09-21T05:48:38.716282+0000","last_undegraded":"2024-09-21T05:48:38.716282+0000","last_fullsized":"2024-09-21T05:48:38.716282+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:06.615367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714733+0000","last_change":"2024-09-21T05:47:05.644624+0000","last_active":"2024-09-21T05:48:38.714733+0000","last_peered":"2024-09-21T05:48:38.714733+0000","last_clean":"2024-09-21T05:48:38.714733+0000","last_became_active":"2024-09-21T05:47:05.644257+0000","last_became_peered":"2024-09-21T05:47:05.644257+0000","last_unstale":"2024-09-21T05:48:38.714733+0000","last_undegraded":"2024-09-21T05:48:38.714733+0000","last_fullsized":"2024-09-21T05:48:38.714733+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:31.385313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718685+0000","last_change":"2024-09-21T05:47:05.646368+0000","last_active":"2024-09-21T05:48:38.718685+0000","last_peered":"2024-09-21T05:48:38.718685+0000","last_clean":"2024-09-21T05:48:38.718685+0000","last_became_active":"2024-09-21T05:47:05.645952+0000","last_became_peered":"2024-09-21T05:47:05.645952+0000","last_unstale":"2024-09-21T05:48:38.718685+0000","last_undegraded":"2024-09-21T05:48:38.718685+0000","last_fullsized":"2024-09-21T05:48:38.718685+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:56.585911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715055+0000","last_change":"2024-09-21T05:47:05.640167+0000","last_active":"2024-09-21T05:48:38.715055+0000","last_peered":"2024-09-21T05:48:38.715055+0000","last_clean":"2024-09-21T05:48:38.715055+0000","last_became_active":"2024-09-21T05:47:05.639770+0000","last_became_peered":"2024-09-21T05:47:05.639770+0000","last_unstale":"2024-09-21T05:48:38.715055+0000","last_undegraded":"2024-09-21T05:48:38.715055+0000","last_fullsized":"2024-09-21T05:48:38.715055+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:45.661131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.719912+0000","last_change":"2024-09-21T05:47:38.732677+0000","last_active":"2024-09-21T05:48:38.719912+0000","last_peered":"2024-09-21T05:48:38.719912+0000","last_clean":"2024-09-21T05:48:38.719912+0000","last_became_active":"2024-09-21T05:47:38.732236+0000","last_became_peered":"2024-09-21T05:47:38.732236+0000","last_unstale":"2024-09-21T05:48:38.719912+0000","last_undegraded":"2024-09-21T05:48:38.719912+0000","last_fullsized":"2024-09-21T05:48:38.719912+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:41.474677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.719941+0000","last_change":"2024-09-21T05:47:05.629814+0000","last_active":"2024-09-21T05:48:38.719941+0000","last_peered":"2024-09-21T05:48:38.719941+0000","last_clean":"2024-09-21T05:48:38.719941+0000","last_became_active":"2024-09-21T05:47:05.629464+0000","last_became_peered":"2024-09-21T05:47:05.629464+0000","last_unstale":"2024-09-21T05:48:38.719941+0000","last_undegraded":"2024-09-21T05:48:38.719941+0000","last_fullsized":"2024-09-21T05:48:38.719941+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:58.222820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.432784+0000","last_change":"2024-09-21T05:47:05.629643+0000","last_active":"2024-09-21T05:48:39.432784+0000","last_peered":"2024-09-21T05:48:39.432784+0000","last_clean":"2024-09-21T05:48:39.432784+0000","last_became_active":"2024-09-21T05:47:05.629248+0000","last_became_peered":"2024-09-21T05:47:05.629248+0000","last_unstale":"2024-09-21T05:48:39.432784+0000","last_undegraded":"2024-09-21T05:48:39.432784+0000","last_fullsized":"2024-09-21T05:48:39.432784+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:31.569209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721917+0000","last_change":"2024-09-21T05:47:05.632188+0000","last_active":"2024-09-21T05:48:38.721917+0000","last_peered":"2024-09-21T05:48:38.721917+0000","last_clean":"2024-09-21T05:48:38.721917+0000","last_became_active":"2024-09-21T05:47:05.631799+0000","last_became_peered":"2024-09-21T05:47:05.631799+0000","last_unstale":"2024-09-21T05:48:38.721917+0000","last_undegraded":"2024-09-21T05:48:38.721917+0000","last_fullsized":"2024-09-21T05:48:38.721917+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:09.762405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718331+0000","last_change":"2024-09-21T05:47:05.644746+0000","last_active":"2024-09-21T05:48:38.718331+0000","last_peered":"2024-09-21T05:48:38.718331+0000","last_clean":"2024-09-21T05:48:38.718331+0000","last_became_active":"2024-09-21T05:47:05.644326+0000","last_became_peered":"2024-09-21T05:47:05.644326+0000","last_unstale":"2024-09-21T05:48:38.718331+0000","last_undegraded":"2024-09-21T05:48:38.718331+0000","last_fullsized":"2024-09-21T05:48:38.718331+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:22.937783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.286544+0000","last_change":"2024-09-21T05:47:05.639214+0000","last_active":"2024-09-21T05:48:39.286544+0000","last_peered":"2024-09-21T05:48:39.286544+0000","last_clean":"2024-09-21T05:48:39.286544+0000","last_became_active":"2024-09-21T05:47:05.638443+0000","last_became_peered":"2024-09-21T05:47:05.638443+0000","last_unstale":"2024-09-21T05:48:39.286544+0000","last_undegraded":"2024-09-21T05:48:39.286544+0000","last_fullsized":"2024-09-21T05:48:39.286544+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:30.134020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715810+0000","last_change":"2024-09-21T05:47:05.644233+0000","last_active":"2024-09-21T05:48:38.715810+0000","last_peered":"2024-09-21T05:48:38.715810+0000","last_clean":"2024-09-21T05:48:38.715810+0000","last_became_active":"2024-09-21T05:47:05.643820+0000","last_became_peered":"2024-09-21T05:47:05.643820+0000","last_unstale":"2024-09-21T05:48:38.715810+0000","last_undegraded":"2024-09-21T05:48:38.715810+0000","last_fullsized":"2024-09-21T05:48:38.715810+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:42.695997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285463+0000","last_change":"2024-09-21T05:47:05.637569+0000","last_active":"2024-09-21T05:48:39.285463+0000","last_peered":"2024-09-21T05:48:39.285463+0000","last_clean":"2024-09-21T05:48:39.285463+0000","last_became_active":"2024-09-21T05:47:05.637269+0000","last_became_peered":"2024-09-21T05:47:05.637269+0000","last_unstale":"2024-09-21T05:48:39.285463+0000","last_undegraded":"2024-09-21T05:48:39.285463+0000","last_fullsized":"2024-09-21T05:48:39.285463+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:28:26.335398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.717597+0000","last_change":"2024-09-21T05:47:05.633457+0000","last_active":"2024-09-21T05:48:38.717597+0000","last_peered":"2024-09-21T05:48:38.717597+0000","last_clean":"2024-09-21T05:48:38.717597+0000","last_became_active":"2024-09-21T05:47:05.633066+0000","last_became_peered":"2024-09-21T05:47:05.633066+0000","last_unstale":"2024-09-21T05:48:38.717597+0000","last_undegraded":"2024-09-21T05:48:38.717597+0000","last_fullsized":"2024-09-21T05:48:38.717597+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:45.904152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.286089+0000","last_change":"2024-09-21T05:47:38.399914+0000","last_active":"2024-09-21T05:48:39.286089+0000","last_peered":"2024-09-21T05:48:39.286089+0000","last_clean":"2024-09-21T05:48:39.286089+0000","last_became_active":"2024-09-21T05:47:38.399480+0000","last_became_peered":"2024-09-21T05:47:38.399480+0000","last_unstale":"2024-09-21T05:48:39.286089+0000","last_undegraded":"2024-09-21T05:48:39.286089+0000","last_fullsized":"2024-09-21T05:48:39.286089+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:51.281796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720436+0000","last_change":"2024-09-21T05:47:05.630944+0000","last_active":"2024-09-21T05:48:38.720436+0000","last_peered":"2024-09-21T05:48:38.720436+0000","last_clean":"2024-09-21T05:48:38.720436+0000","last_became_active":"2024-09-21T05:47:05.630498+0000","last_became_peered":"2024-09-21T05:47:05.630498+0000","last_unstale":"2024-09-21T05:48:38.720436+0000","last_undegraded":"2024-09-21T05:48:38.720436+0000","last_fullsized":"2024-09-21T05:48:38.720436+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:20.185094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721886+0000","last_change":"2024-09-21T05:47:05.636134+0000","last_active":"2024-09-21T05:48:38.721886+0000","last_peered":"2024-09-21T05:48:38.721886+0000","last_clean":"2024-09-21T05:48:38.721886+0000","last_became_active":"2024-09-21T05:47:05.635724+0000","last_became_peered":"2024-09-21T05:47:05.635724+0000","last_unstale":"2024-09-21T05:48:38.721886+0000","last_undegraded":"2024-09-21T05:48:38.721886+0000","last_fullsized":"2024-09-21T05:48:38.721886+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:55.455819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720240+0000","last_change":"2024-09-21T05:47:05.641209+0000","last_active":"2024-09-21T05:48:38.720240+0000","last_peered":"2024-09-21T05:48:38.720240+0000","last_clean":"2024-09-21T05:48:38.720240+0000","last_became_active":"2024-09-21T05:47:05.640543+0000","last_became_peered":"2024-09-21T05:47:05.640543+0000","last_unstale":"2024-09-21T05:48:38.720240+0000","last_undegraded":"2024-09-21T05:48:38.720240+0000","last_fullsized":"2024-09-21T05:48:38.720240+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:49.579724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720245+0000","last_change":"2024-09-21T05:47:05.634158+0000","last_active":"2024-09-21T05:48:38.720245+0000","last_peered":"2024-09-21T05:48:38.720245+0000","last_clean":"2024-09-21T05:48:38.720245+0000","last_became_active":"2024-09-21T05:47:05.633657+0000","last_became_peered":"2024-09-21T05:47:05.633657+0000","last_unstale":"2024-09-21T05:48:38.720245+0000","last_undegraded":"2024-09-21T05:48:38.720245+0000","last_fullsized":"2024-09-21T05:48:38.720245+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:37.868206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718567+0000","last_change":"2024-09-21T05:47:05.641358+0000","last_active":"2024-09-21T05:48:38.718567+0000","last_peered":"2024-09-21T05:48:38.718567+0000","last_clean":"2024-09-21T05:48:38.718567+0000","last_became_active":"2024-09-21T05:47:05.641025+0000","last_became_peered":"2024-09-21T05:47:05.641025+0000","last_unstale":"2024-09-21T05:48:38.718567+0000","last_undegraded":"2024-09-21T05:48:38.718567+0000","last_fullsized":"2024-09-21T05:48:38.718567+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:01.654621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":73025,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":555,"num_read_kb":357,"num_write":247,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":756,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":219075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":248927,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743457,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":958464,"data_stored":489762,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939686,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1105920,"data_stored":1147143,"data_compressed":65650,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103211,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":970752,"data_stored":489558,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299440,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":954368,"data_stored":489802,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495669,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1019904,"data_stored":1086433,"data_compressed":65650,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659194,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":946176,"data_stored":485062,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855424,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1028096,"data_stored":1081624,"data_compressed":65650,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051653,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":954368,"data_stored":489527,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247881,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":958464,"data_stored":484770,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1032192,"data_stored":551902,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607635,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1028096,"data_stored":552926,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":970752,"data_stored":486518,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34637,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34637,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34637,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36254,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36254,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36254,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36254,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":68586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":67562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":68339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T05:48:46.373 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T05:48:46.617 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:46.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:46 smithi070 ceph-mon[30981]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:48:47.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:46 smithi116 ceph-mon[34332]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:48:47.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.121+0000 7f4c2582b640 1 -- 172.21.15.70:0/2977979911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c20109df0 msgr2=0x7f4c20110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:47.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.121+0000 7f4c2582b640 1 --2- 172.21.15.70:0/2977979911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c20109df0 0x7f4c20110620 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4c18009900 tx=0x7f4c1802a410 comp rx=0 tx=0).stop 2024-09-21T05:48:47.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.121+0000 7f4c2582b640 1 -- 172.21.15.70:0/2977979911 shutdown_connections 2024-09-21T05:48:47.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.121+0000 7f4c2582b640 1 --2- 172.21.15.70:0/2977979911 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c201094a0 0x7f4c201098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:47.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.121+0000 7f4c2582b640 1 --2- 172.21.15.70:0/2977979911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c20109df0 0x7f4c20110620 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:47.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.121+0000 7f4c2582b640 1 --2- 172.21.15.70:0/2977979911 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c20103b60 0x7f4c20103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:47.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.121+0000 7f4c2582b640 1 -- 172.21.15.70:0/2977979911 >> 172.21.15.70:0/2977979911 conn(0x7f4c2007b850 msgr2=0x7f4c2007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:47.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.121+0000 7f4c2582b640 1 -- 172.21.15.70:0/2977979911 shutdown_connections 2024-09-21T05:48:47.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.121+0000 7f4c2582b640 1 -- 172.21.15.70:0/2977979911 wait complete. 2024-09-21T05:48:47.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.121+0000 7f4c2582b640 1 Processor -- start 2024-09-21T05:48:47.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.122+0000 7f4c2582b640 1 -- start start 2024-09-21T05:48:47.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.122+0000 7f4c2582b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c20103b60 0x7f4c2019a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:47.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.122+0000 7f4c2582b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c201094a0 0x7f4c2019aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:47.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.122+0000 7f4c2582b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c20109df0 0x7f4c2019fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:47.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.122+0000 7f4c2582b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4c20113a80 con 0x7f4c201094a0 2024-09-21T05:48:47.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.122+0000 7f4c2582b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4c20113900 con 0x7f4c20103b60 2024-09-21T05:48:47.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.122+0000 7f4c2582b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4c20113c00 con 0x7f4c20109df0 2024-09-21T05:48:47.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.122+0000 7f4c1e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c201094a0 0x7f4c2019aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:47.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.122+0000 7f4c1e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c201094a0 0x7f4c2019aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47986/0 (socket says 172.21.15.70:47986) 2024-09-21T05:48:47.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.122+0000 7f4c1e7fc640 1 -- 172.21.15.70:0/3501001211 learned_addr learned my addr 172.21.15.70:0/3501001211 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:47.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.122+0000 7f4c1effd640 1 --2- 172.21.15.70:0/3501001211 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c20103b60 0x7f4c2019a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:47.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.122+0000 7f4c1f7fe640 1 --2- 172.21.15.70:0/3501001211 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c20109df0 0x7f4c2019fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:47.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.122+0000 7f4c1e7fc640 1 -- 172.21.15.70:0/3501001211 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c20109df0 msgr2=0x7f4c2019fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:47.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.122+0000 7f4c1e7fc640 1 --2- 172.21.15.70:0/3501001211 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c20109df0 0x7f4c2019fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:47.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.122+0000 7f4c1e7fc640 1 -- 172.21.15.70:0/3501001211 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c20103b60 msgr2=0x7f4c2019a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:47.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.122+0000 7f4c1e7fc640 1 --2- 172.21.15.70:0/3501001211 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c20103b60 0x7f4c2019a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:47.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.122+0000 7f4c1e7fc640 1 -- 172.21.15.70:0/3501001211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c201a0440 con 0x7f4c201094a0 2024-09-21T05:48:47.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.122+0000 7f4c1e7fc640 1 --2- 172.21.15.70:0/3501001211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c201094a0 0x7f4c2019aa70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4c1400cce0 tx=0x7f4c1400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:47.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.123+0000 7f4c24829640 1 -- 172.21.15.70:0/3501001211 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c14004b20 con 0x7f4c201094a0 2024-09-21T05:48:47.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.123+0000 7f4c24829640 1 -- 172.21.15.70:0/3501001211 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f4c14004cc0 con 0x7f4c201094a0 2024-09-21T05:48:47.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.123+0000 7f4c2582b640 1 -- 172.21.15.70:0/3501001211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c201a0730 con 0x7f4c201094a0 2024-09-21T05:48:47.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.123+0000 7f4c24829640 1 -- 172.21.15.70:0/3501001211 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1400f6b0 con 0x7f4c201094a0 2024-09-21T05:48:47.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.123+0000 7f4c2582b640 1 -- 172.21.15.70:0/3501001211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c201a6e90 con 0x7f4c201094a0 2024-09-21T05:48:47.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.124+0000 7f4c2582b640 1 -- 172.21.15.70:0/3501001211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c20103f70 con 0x7f4c201094a0 2024-09-21T05:48:47.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.126+0000 7f4c24829640 1 -- 172.21.15.70:0/3501001211 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f4c1400f850 con 0x7f4c201094a0 2024-09-21T05:48:47.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.126+0000 7f4c24829640 1 --2- 172.21.15.70:0/3501001211 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4c080b65a0 0x7f4c080b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:47.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.126+0000 7f4c1effd640 1 --2- 172.21.15.70:0/3501001211 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4c080b65a0 0x7f4c080b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:47.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.126+0000 7f4c24829640 1 -- 172.21.15.70:0/3501001211 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f4c140e7cd0 con 0x7f4c201094a0 2024-09-21T05:48:47.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.127+0000 7f4c1effd640 1 --2- 172.21.15.70:0/3501001211 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4c080b65a0 0x7f4c080b8ab0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4c10005fd0 tx=0x7f4c10005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:47.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.129+0000 7f4c24829640 1 -- 172.21.15.70:0/3501001211 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4c14014030 con 0x7f4c201094a0 2024-09-21T05:48:47.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:46 smithi160 ceph-mon[33979]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:48:47.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.301+0000 7f4c2582b640 1 -- 172.21.15.70:0/3501001211 --> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4c2010bc50 con 0x7f4c080b65a0 2024-09-21T05:48:47.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.307+0000 7f4c24829640 1 -- 172.21.15.70:0/3501001211 <== mgr.14150 v2:172.21.15.70:6800/1366013939 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340656 (secure 0 0 0) 0x7f4c1000b360 con 0x7f4c080b65a0 2024-09-21T05:48:47.312 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:48:47.313 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-21T05:48:47.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.310+0000 7f4c2582b640 1 -- 172.21.15.70:0/3501001211 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4c080b65a0 msgr2=0x7f4c080b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:47.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.310+0000 7f4c2582b640 1 --2- 172.21.15.70:0/3501001211 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4c080b65a0 0x7f4c080b8ab0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4c10005fd0 tx=0x7f4c10005850 comp rx=0 tx=0).stop 2024-09-21T05:48:47.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.310+0000 7f4c2582b640 1 -- 172.21.15.70:0/3501001211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c201094a0 msgr2=0x7f4c2019aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:47.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.310+0000 7f4c2582b640 1 --2- 172.21.15.70:0/3501001211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c201094a0 0x7f4c2019aa70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4c1400cce0 tx=0x7f4c1400a620 comp rx=0 tx=0).stop 2024-09-21T05:48:47.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.310+0000 7f4c2582b640 1 -- 172.21.15.70:0/3501001211 shutdown_connections 2024-09-21T05:48:47.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.310+0000 7f4c2582b640 1 --2- 172.21.15.70:0/3501001211 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4c080b65a0 0x7f4c080b8ab0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:47.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.310+0000 7f4c2582b640 1 --2- 172.21.15.70:0/3501001211 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c20109df0 0x7f4c2019fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:47.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.310+0000 7f4c2582b640 1 --2- 172.21.15.70:0/3501001211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c201094a0 0x7f4c2019aa70 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:47.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.310+0000 7f4c2582b640 1 --2- 172.21.15.70:0/3501001211 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c20103b60 0x7f4c2019a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:47.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.310+0000 7f4c2582b640 1 -- 172.21.15.70:0/3501001211 >> 172.21.15.70:0/3501001211 conn(0x7f4c2007b850 msgr2=0x7f4c20105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:47.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.310+0000 7f4c2582b640 1 -- 172.21.15.70:0/3501001211 shutdown_connections 2024-09-21T05:48:47.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:47.310+0000 7f4c2582b640 1 -- 172.21.15.70:0/3501001211 wait complete. 2024-09-21T05:48:47.989 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:47 smithi070 ceph-mon[30981]: from='client.15207 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:48:48.017 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":349,"stamp":"2024-09-21T05:48:45.421727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":663627,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":631,"num_read_kb":421,"num_write":372,"num_write_kb":2296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":2952596,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":306,"ondisk_log_size":306,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":420,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":348496,"kb_used_data":11648,"kb_used_omap":18,"kb_used_meta":336557,"kb_avail":1124593328,"statfs":{"total":1151940427776,"available":1151583567872,"internally_reserved":0,"allocated":11927552,"data_stored":7835027,"data_compressed":461514,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19143,"internal_metadata":344634681},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":756,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002421"},"pg_stats":[{"pgid":"2.1f","version":"83'13","reported_seq":104,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:40.624543+0000","last_change":"2024-09-21T05:47:03.620705+0000","last_active":"2024-09-21T05:48:40.624543+0000","last_peered":"2024-09-21T05:48:40.624543+0000","last_clean":"2024-09-21T05:48:40.624543+0000","last_became_active":"2024-09-21T05:47:03.620320+0000","last_became_peered":"2024-09-21T05:47:03.620320+0000","last_unstale":"2024-09-21T05:48:40.624543+0000","last_undegraded":"2024-09-21T05:48:40.624543+0000","last_fullsized":"2024-09-21T05:48:40.624543+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:31.684225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285636+0000","last_change":"2024-09-21T05:47:05.637251+0000","last_active":"2024-09-21T05:48:39.285636+0000","last_peered":"2024-09-21T05:48:39.285636+0000","last_clean":"2024-09-21T05:48:39.285636+0000","last_became_active":"2024-09-21T05:47:05.636867+0000","last_became_peered":"2024-09-21T05:47:05.636867+0000","last_unstale":"2024-09-21T05:48:39.285636+0000","last_undegraded":"2024-09-21T05:48:39.285636+0000","last_fullsized":"2024-09-21T05:48:39.285636+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:08.538209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715529+0000","last_change":"2024-09-21T05:47:12.676224+0000","last_active":"2024-09-21T05:48:38.715529+0000","last_peered":"2024-09-21T05:48:38.715529+0000","last_clean":"2024-09-21T05:48:38.715529+0000","last_became_active":"2024-09-21T05:47:12.675565+0000","last_became_peered":"2024-09-21T05:47:12.675565+0000","last_unstale":"2024-09-21T05:48:38.715529+0000","last_undegraded":"2024-09-21T05:48:38.715529+0000","last_fullsized":"2024-09-21T05:48:38.715529+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:37.684953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285873+0000","last_change":"2024-09-21T05:47:03.670289+0000","last_active":"2024-09-21T05:48:39.285873+0000","last_peered":"2024-09-21T05:48:39.285873+0000","last_clean":"2024-09-21T05:48:39.285873+0000","last_became_active":"2024-09-21T05:47:03.669881+0000","last_became_peered":"2024-09-21T05:47:03.669881+0000","last_unstale":"2024-09-21T05:48:39.285873+0000","last_undegraded":"2024-09-21T05:48:39.285873+0000","last_fullsized":"2024-09-21T05:48:39.285873+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:12.597766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720549+0000","last_change":"2024-09-21T05:47:05.640826+0000","last_active":"2024-09-21T05:48:38.720549+0000","last_peered":"2024-09-21T05:48:38.720549+0000","last_clean":"2024-09-21T05:48:38.720549+0000","last_became_active":"2024-09-21T05:47:05.640357+0000","last_became_peered":"2024-09-21T05:47:05.640357+0000","last_unstale":"2024-09-21T05:48:38.720549+0000","last_undegraded":"2024-09-21T05:48:38.720549+0000","last_fullsized":"2024-09-21T05:48:38.720549+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:16.434030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721134+0000","last_change":"2024-09-21T05:47:12.677260+0000","last_active":"2024-09-21T05:48:38.721134+0000","last_peered":"2024-09-21T05:48:38.721134+0000","last_clean":"2024-09-21T05:48:38.721134+0000","last_became_active":"2024-09-21T05:47:12.676599+0000","last_became_peered":"2024-09-21T05:47:12.676599+0000","last_unstale":"2024-09-21T05:48:38.721134+0000","last_undegraded":"2024-09-21T05:48:38.721134+0000","last_fullsized":"2024-09-21T05:48:38.721134+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:10.644801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.722446+0000","last_change":"2024-09-21T05:47:03.619903+0000","last_active":"2024-09-21T05:48:38.722446+0000","last_peered":"2024-09-21T05:48:38.722446+0000","last_clean":"2024-09-21T05:48:38.722446+0000","last_became_active":"2024-09-21T05:47:03.619476+0000","last_became_peered":"2024-09-21T05:47:03.619476+0000","last_unstale":"2024-09-21T05:48:38.722446+0000","last_undegraded":"2024-09-21T05:48:38.722446+0000","last_fullsized":"2024-09-21T05:48:38.722446+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:09.717552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715414+0000","last_change":"2024-09-21T05:47:05.646017+0000","last_active":"2024-09-21T05:48:38.715414+0000","last_peered":"2024-09-21T05:48:38.715414+0000","last_clean":"2024-09-21T05:48:38.715414+0000","last_became_active":"2024-09-21T05:47:05.644118+0000","last_became_peered":"2024-09-21T05:47:05.644118+0000","last_unstale":"2024-09-21T05:48:38.715414+0000","last_undegraded":"2024-09-21T05:48:38.715414+0000","last_fullsized":"2024-09-21T05:48:38.715414+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:52.908664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721813+0000","last_change":"2024-09-21T05:47:12.677555+0000","last_active":"2024-09-21T05:48:38.721813+0000","last_peered":"2024-09-21T05:48:38.721813+0000","last_clean":"2024-09-21T05:48:38.721813+0000","last_became_active":"2024-09-21T05:47:12.676886+0000","last_became_peered":"2024-09-21T05:47:12.676886+0000","last_unstale":"2024-09-21T05:48:38.721813+0000","last_undegraded":"2024-09-21T05:48:38.721813+0000","last_fullsized":"2024-09-21T05:48:38.721813+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:10:24.516641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.723105+0000","last_change":"2024-09-21T05:47:03.621556+0000","last_active":"2024-09-21T05:48:38.723105+0000","last_peered":"2024-09-21T05:48:38.723105+0000","last_clean":"2024-09-21T05:48:38.723105+0000","last_became_active":"2024-09-21T05:47:03.621101+0000","last_became_peered":"2024-09-21T05:47:03.621101+0000","last_unstale":"2024-09-21T05:48:38.723105+0000","last_undegraded":"2024-09-21T05:48:38.723105+0000","last_fullsized":"2024-09-21T05:48:38.723105+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:39:23.639431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721113+0000","last_change":"2024-09-21T05:47:05.646328+0000","last_active":"2024-09-21T05:48:38.721113+0000","last_peered":"2024-09-21T05:48:38.721113+0000","last_clean":"2024-09-21T05:48:38.721113+0000","last_became_active":"2024-09-21T05:47:05.645922+0000","last_became_peered":"2024-09-21T05:47:05.645922+0000","last_unstale":"2024-09-21T05:48:38.721113+0000","last_undegraded":"2024-09-21T05:48:38.721113+0000","last_fullsized":"2024-09-21T05:48:38.721113+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:43.801707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721553+0000","last_change":"2024-09-21T05:47:12.673555+0000","last_active":"2024-09-21T05:48:38.721553+0000","last_peered":"2024-09-21T05:48:38.721553+0000","last_clean":"2024-09-21T05:48:38.721553+0000","last_became_active":"2024-09-21T05:47:12.673065+0000","last_became_peered":"2024-09-21T05:47:12.673065+0000","last_unstale":"2024-09-21T05:48:38.721553+0000","last_undegraded":"2024-09-21T05:48:38.721553+0000","last_fullsized":"2024-09-21T05:48:38.721553+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:53.548779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.717684+0000","last_change":"2024-09-21T05:47:05.645376+0000","last_active":"2024-09-21T05:48:38.717684+0000","last_peered":"2024-09-21T05:48:38.717684+0000","last_clean":"2024-09-21T05:48:38.717684+0000","last_became_active":"2024-09-21T05:47:05.644800+0000","last_became_peered":"2024-09-21T05:47:05.644800+0000","last_unstale":"2024-09-21T05:48:38.717684+0000","last_undegraded":"2024-09-21T05:48:38.717684+0000","last_fullsized":"2024-09-21T05:48:38.717684+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:10.460407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720612+0000","last_change":"2024-09-21T05:47:03.619926+0000","last_active":"2024-09-21T05:48:38.720612+0000","last_peered":"2024-09-21T05:48:38.720612+0000","last_clean":"2024-09-21T05:48:38.720612+0000","last_became_active":"2024-09-21T05:47:03.619433+0000","last_became_peered":"2024-09-21T05:47:03.619433+0000","last_unstale":"2024-09-21T05:48:38.720612+0000","last_undegraded":"2024-09-21T05:48:38.720612+0000","last_fullsized":"2024-09-21T05:48:38.720612+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:33.792874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721928+0000","last_change":"2024-09-21T05:47:12.874200+0000","last_active":"2024-09-21T05:48:38.721928+0000","last_peered":"2024-09-21T05:48:38.721928+0000","last_clean":"2024-09-21T05:48:38.721928+0000","last_became_active":"2024-09-21T05:47:12.873563+0000","last_became_peered":"2024-09-21T05:47:12.873563+0000","last_unstale":"2024-09-21T05:48:38.721928+0000","last_undegraded":"2024-09-21T05:48:38.721928+0000","last_fullsized":"2024-09-21T05:48:38.721928+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:34.839934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285679+0000","last_change":"2024-09-21T05:47:05.639033+0000","last_active":"2024-09-21T05:48:39.285679+0000","last_peered":"2024-09-21T05:48:39.285679+0000","last_clean":"2024-09-21T05:48:39.285679+0000","last_became_active":"2024-09-21T05:47:05.637433+0000","last_became_peered":"2024-09-21T05:47:05.637433+0000","last_unstale":"2024-09-21T05:48:39.285679+0000","last_undegraded":"2024-09-21T05:48:39.285679+0000","last_fullsized":"2024-09-21T05:48:39.285679+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:55.181025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715812+0000","last_change":"2024-09-21T05:47:03.614460+0000","last_active":"2024-09-21T05:48:38.715812+0000","last_peered":"2024-09-21T05:48:38.715812+0000","last_clean":"2024-09-21T05:48:38.715812+0000","last_became_active":"2024-09-21T05:47:03.613975+0000","last_became_peered":"2024-09-21T05:47:03.613975+0000","last_unstale":"2024-09-21T05:48:38.715812+0000","last_undegraded":"2024-09-21T05:48:38.715812+0000","last_fullsized":"2024-09-21T05:48:38.715812+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:26.838907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721726+0000","last_change":"2024-09-21T05:47:38.733044+0000","last_active":"2024-09-21T05:48:38.721726+0000","last_peered":"2024-09-21T05:48:38.721726+0000","last_clean":"2024-09-21T05:48:38.721726+0000","last_became_active":"2024-09-21T05:47:38.732327+0000","last_became_peered":"2024-09-21T05:47:38.732327+0000","last_unstale":"2024-09-21T05:48:38.721726+0000","last_undegraded":"2024-09-21T05:48:38.721726+0000","last_fullsized":"2024-09-21T05:48:38.721726+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:59.462529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718895+0000","last_change":"2024-09-21T05:47:05.631831+0000","last_active":"2024-09-21T05:48:38.718895+0000","last_peered":"2024-09-21T05:48:38.718895+0000","last_clean":"2024-09-21T05:48:38.718895+0000","last_became_active":"2024-09-21T05:47:05.630403+0000","last_became_peered":"2024-09-21T05:47:05.630403+0000","last_unstale":"2024-09-21T05:48:38.718895+0000","last_undegraded":"2024-09-21T05:48:38.718895+0000","last_fullsized":"2024-09-21T05:48:38.718895+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:21.163262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285507+0000","last_change":"2024-09-21T05:47:03.618888+0000","last_active":"2024-09-21T05:48:39.285507+0000","last_peered":"2024-09-21T05:48:39.285507+0000","last_clean":"2024-09-21T05:48:39.285507+0000","last_became_active":"2024-09-21T05:47:03.618506+0000","last_became_peered":"2024-09-21T05:47:03.618506+0000","last_unstale":"2024-09-21T05:48:39.285507+0000","last_undegraded":"2024-09-21T05:48:39.285507+0000","last_fullsized":"2024-09-21T05:48:39.285507+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:52.711976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714826+0000","last_change":"2024-09-21T05:47:12.675649+0000","last_active":"2024-09-21T05:48:38.714826+0000","last_peered":"2024-09-21T05:48:38.714826+0000","last_clean":"2024-09-21T05:48:38.714826+0000","last_became_active":"2024-09-21T05:47:12.675268+0000","last_became_peered":"2024-09-21T05:47:12.675268+0000","last_unstale":"2024-09-21T05:48:38.714826+0000","last_undegraded":"2024-09-21T05:48:38.714826+0000","last_fullsized":"2024-09-21T05:48:38.714826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:48:31.481292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720444+0000","last_change":"2024-09-21T05:47:05.622838+0000","last_active":"2024-09-21T05:48:38.720444+0000","last_peered":"2024-09-21T05:48:38.720444+0000","last_clean":"2024-09-21T05:48:38.720444+0000","last_became_active":"2024-09-21T05:47:05.622216+0000","last_became_peered":"2024-09-21T05:47:05.622216+0000","last_unstale":"2024-09-21T05:48:38.720444+0000","last_undegraded":"2024-09-21T05:48:38.720444+0000","last_fullsized":"2024-09-21T05:48:38.720444+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:55.446747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715215+0000","last_change":"2024-09-21T05:47:03.670405+0000","last_active":"2024-09-21T05:48:38.715215+0000","last_peered":"2024-09-21T05:48:38.715215+0000","last_clean":"2024-09-21T05:48:38.715215+0000","last_became_active":"2024-09-21T05:47:03.669958+0000","last_became_peered":"2024-09-21T05:47:03.669958+0000","last_unstale":"2024-09-21T05:48:38.715215+0000","last_undegraded":"2024-09-21T05:48:38.715215+0000","last_fullsized":"2024-09-21T05:48:38.715215+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:25.702903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.722178+0000","last_change":"2024-09-21T05:47:38.399039+0000","last_active":"2024-09-21T05:48:38.722178+0000","last_peered":"2024-09-21T05:48:38.722178+0000","last_clean":"2024-09-21T05:48:38.722178+0000","last_became_active":"2024-09-21T05:47:38.398441+0000","last_became_peered":"2024-09-21T05:47:38.398441+0000","last_unstale":"2024-09-21T05:48:38.722178+0000","last_undegraded":"2024-09-21T05:48:38.722178+0000","last_fullsized":"2024-09-21T05:48:38.722178+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:11.095516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,8],"acting":[4,5,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720364+0000","last_change":"2024-09-21T05:47:05.632911+0000","last_active":"2024-09-21T05:48:38.720364+0000","last_peered":"2024-09-21T05:48:38.720364+0000","last_clean":"2024-09-21T05:48:38.720364+0000","last_became_active":"2024-09-21T05:47:05.632256+0000","last_became_peered":"2024-09-21T05:47:05.632256+0000","last_unstale":"2024-09-21T05:48:38.720364+0000","last_undegraded":"2024-09-21T05:48:38.720364+0000","last_fullsized":"2024-09-21T05:48:38.720364+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:41.014253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.722338+0000","last_change":"2024-09-21T05:47:04.411753+0000","last_active":"2024-09-21T05:48:38.722338+0000","last_peered":"2024-09-21T05:48:38.722338+0000","last_clean":"2024-09-21T05:48:38.722338+0000","last_became_active":"2024-09-21T05:47:04.411225+0000","last_became_peered":"2024-09-21T05:47:04.411225+0000","last_unstale":"2024-09-21T05:48:38.722338+0000","last_undegraded":"2024-09-21T05:48:38.722338+0000","last_fullsized":"2024-09-21T05:48:38.722338+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:07.964184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715636+0000","last_change":"2024-09-21T05:47:12.670157+0000","last_active":"2024-09-21T05:48:38.715636+0000","last_peered":"2024-09-21T05:48:38.715636+0000","last_clean":"2024-09-21T05:48:38.715636+0000","last_became_active":"2024-09-21T05:47:12.669710+0000","last_became_peered":"2024-09-21T05:47:12.669710+0000","last_unstale":"2024-09-21T05:48:38.715636+0000","last_undegraded":"2024-09-21T05:48:38.715636+0000","last_fullsized":"2024-09-21T05:48:38.715636+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:31.023624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285760+0000","last_change":"2024-09-21T05:47:05.637982+0000","last_active":"2024-09-21T05:48:39.285760+0000","last_peered":"2024-09-21T05:48:39.285760+0000","last_clean":"2024-09-21T05:48:39.285760+0000","last_became_active":"2024-09-21T05:47:05.637357+0000","last_became_peered":"2024-09-21T05:47:05.637357+0000","last_unstale":"2024-09-21T05:48:39.285760+0000","last_undegraded":"2024-09-21T05:48:39.285760+0000","last_fullsized":"2024-09-21T05:48:39.285760+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:41:12.986231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"83'15","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714741+0000","last_change":"2024-09-21T05:47:03.611556+0000","last_active":"2024-09-21T05:48:38.714741+0000","last_peered":"2024-09-21T05:48:38.714741+0000","last_clean":"2024-09-21T05:48:38.714741+0000","last_became_active":"2024-09-21T05:47:03.611192+0000","last_became_peered":"2024-09-21T05:47:03.611192+0000","last_unstale":"2024-09-21T05:48:38.714741+0000","last_undegraded":"2024-09-21T05:48:38.714741+0000","last_fullsized":"2024-09-21T05:48:38.714741+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:20.047405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285193+0000","last_change":"2024-09-21T05:47:12.874796+0000","last_active":"2024-09-21T05:48:39.285193+0000","last_peered":"2024-09-21T05:48:39.285193+0000","last_clean":"2024-09-21T05:48:39.285193+0000","last_became_active":"2024-09-21T05:47:12.873648+0000","last_became_peered":"2024-09-21T05:47:12.873648+0000","last_unstale":"2024-09-21T05:48:39.285193+0000","last_undegraded":"2024-09-21T05:48:39.285193+0000","last_fullsized":"2024-09-21T05:48:39.285193+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:50.591584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.432887+0000","last_change":"2024-09-21T05:47:05.634289+0000","last_active":"2024-09-21T05:48:39.432887+0000","last_peered":"2024-09-21T05:48:39.432887+0000","last_clean":"2024-09-21T05:48:39.432887+0000","last_became_active":"2024-09-21T05:47:05.633971+0000","last_became_peered":"2024-09-21T05:47:05.633971+0000","last_unstale":"2024-09-21T05:48:39.432887+0000","last_undegraded":"2024-09-21T05:48:39.432887+0000","last_fullsized":"2024-09-21T05:48:39.432887+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:53.819753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.722582+0000","last_change":"2024-09-21T05:47:03.671877+0000","last_active":"2024-09-21T05:48:38.722582+0000","last_peered":"2024-09-21T05:48:38.722582+0000","last_clean":"2024-09-21T05:48:38.722582+0000","last_became_active":"2024-09-21T05:47:03.671443+0000","last_became_peered":"2024-09-21T05:47:03.671443+0000","last_unstale":"2024-09-21T05:48:38.722582+0000","last_undegraded":"2024-09-21T05:48:38.722582+0000","last_fullsized":"2024-09-21T05:48:38.722582+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:00.114953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.717823+0000","last_change":"2024-09-21T05:47:12.673004+0000","last_active":"2024-09-21T05:48:38.717823+0000","last_peered":"2024-09-21T05:48:38.717823+0000","last_clean":"2024-09-21T05:48:38.717823+0000","last_became_active":"2024-09-21T05:47:12.671784+0000","last_became_peered":"2024-09-21T05:47:12.671784+0000","last_unstale":"2024-09-21T05:48:38.717823+0000","last_undegraded":"2024-09-21T05:48:38.717823+0000","last_fullsized":"2024-09-21T05:48:38.717823+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:38.672438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.286275+0000","last_change":"2024-09-21T05:47:05.635204+0000","last_active":"2024-09-21T05:48:39.286275+0000","last_peered":"2024-09-21T05:48:39.286275+0000","last_clean":"2024-09-21T05:48:39.286275+0000","last_became_active":"2024-09-21T05:47:05.634794+0000","last_became_peered":"2024-09-21T05:47:05.634794+0000","last_unstale":"2024-09-21T05:48:39.286275+0000","last_undegraded":"2024-09-21T05:48:39.286275+0000","last_fullsized":"2024-09-21T05:48:39.286275+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:08.208843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714631+0000","last_change":"2024-09-21T05:47:03.671864+0000","last_active":"2024-09-21T05:48:38.714631+0000","last_peered":"2024-09-21T05:48:38.714631+0000","last_clean":"2024-09-21T05:48:38.714631+0000","last_became_active":"2024-09-21T05:47:03.671510+0000","last_became_peered":"2024-09-21T05:47:03.671510+0000","last_unstale":"2024-09-21T05:48:38.714631+0000","last_undegraded":"2024-09-21T05:48:38.714631+0000","last_fullsized":"2024-09-21T05:48:38.714631+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:12.831235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720666+0000","last_change":"2024-09-21T05:47:38.398708+0000","last_active":"2024-09-21T05:48:38.720666+0000","last_peered":"2024-09-21T05:48:38.720666+0000","last_clean":"2024-09-21T05:48:38.720666+0000","last_became_active":"2024-09-21T05:47:38.398211+0000","last_became_peered":"2024-09-21T05:47:38.398211+0000","last_unstale":"2024-09-21T05:48:38.720666+0000","last_undegraded":"2024-09-21T05:48:38.720666+0000","last_fullsized":"2024-09-21T05:48:38.720666+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:29.250191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.286123+0000","last_change":"2024-09-21T05:47:05.633069+0000","last_active":"2024-09-21T05:48:39.286123+0000","last_peered":"2024-09-21T05:48:39.286123+0000","last_clean":"2024-09-21T05:48:39.286123+0000","last_became_active":"2024-09-21T05:47:05.632698+0000","last_became_peered":"2024-09-21T05:47:05.632698+0000","last_unstale":"2024-09-21T05:48:39.286123+0000","last_undegraded":"2024-09-21T05:48:39.286123+0000","last_fullsized":"2024-09-21T05:48:39.286123+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:04.081062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'5","reported_seq":96,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.623778+0000","last_change":"2024-09-21T05:47:03.622490+0000","last_active":"2024-09-21T05:48:39.623778+0000","last_peered":"2024-09-21T05:48:39.623778+0000","last_clean":"2024-09-21T05:48:39.623778+0000","last_became_active":"2024-09-21T05:47:03.622093+0000","last_became_peered":"2024-09-21T05:47:03.622093+0000","last_unstale":"2024-09-21T05:48:39.623778+0000","last_undegraded":"2024-09-21T05:48:39.623778+0000","last_fullsized":"2024-09-21T05:48:39.623778+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:40.500152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.432756+0000","last_change":"2024-09-21T05:47:12.670060+0000","last_active":"2024-09-21T05:48:39.432756+0000","last_peered":"2024-09-21T05:48:39.432756+0000","last_clean":"2024-09-21T05:48:39.432756+0000","last_became_active":"2024-09-21T05:47:12.669635+0000","last_became_peered":"2024-09-21T05:47:12.669635+0000","last_unstale":"2024-09-21T05:48:39.432756+0000","last_undegraded":"2024-09-21T05:48:39.432756+0000","last_fullsized":"2024-09-21T05:48:39.432756+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:14.786984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721254+0000","last_change":"2024-09-21T05:47:05.640553+0000","last_active":"2024-09-21T05:48:38.721254+0000","last_peered":"2024-09-21T05:48:38.721254+0000","last_clean":"2024-09-21T05:48:38.721254+0000","last_became_active":"2024-09-21T05:47:05.640151+0000","last_became_peered":"2024-09-21T05:47:05.640151+0000","last_unstale":"2024-09-21T05:48:38.721254+0000","last_undegraded":"2024-09-21T05:48:38.721254+0000","last_fullsized":"2024-09-21T05:48:38.721254+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:39.904129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":99,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:42.633702+0000","last_change":"2024-09-21T05:47:03.670178+0000","last_active":"2024-09-21T05:48:42.633702+0000","last_peered":"2024-09-21T05:48:42.633702+0000","last_clean":"2024-09-21T05:48:42.633702+0000","last_became_active":"2024-09-21T05:47:03.669715+0000","last_became_peered":"2024-09-21T05:47:03.669715+0000","last_unstale":"2024-09-21T05:48:42.633702+0000","last_undegraded":"2024-09-21T05:48:42.633702+0000","last_fullsized":"2024-09-21T05:48:42.633702+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:31.457820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.432986+0000","last_change":"2024-09-21T05:47:12.875173+0000","last_active":"2024-09-21T05:48:39.432986+0000","last_peered":"2024-09-21T05:48:39.432986+0000","last_clean":"2024-09-21T05:48:39.432986+0000","last_became_active":"2024-09-21T05:47:12.873749+0000","last_became_peered":"2024-09-21T05:47:12.873749+0000","last_unstale":"2024-09-21T05:48:39.432986+0000","last_undegraded":"2024-09-21T05:48:39.432986+0000","last_fullsized":"2024-09-21T05:48:39.432986+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:33.473645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.432478+0000","last_change":"2024-09-21T05:47:05.634346+0000","last_active":"2024-09-21T05:48:39.432478+0000","last_peered":"2024-09-21T05:48:39.432478+0000","last_clean":"2024-09-21T05:48:39.432478+0000","last_became_active":"2024-09-21T05:47:05.634004+0000","last_became_peered":"2024-09-21T05:47:05.634004+0000","last_unstale":"2024-09-21T05:48:39.432478+0000","last_undegraded":"2024-09-21T05:48:39.432478+0000","last_fullsized":"2024-09-21T05:48:39.432478+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:16.328729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.717723+0000","last_change":"2024-09-21T05:47:03.619472+0000","last_active":"2024-09-21T05:48:38.717723+0000","last_peered":"2024-09-21T05:48:38.717723+0000","last_clean":"2024-09-21T05:48:38.717723+0000","last_became_active":"2024-09-21T05:47:03.619077+0000","last_became_peered":"2024-09-21T05:47:03.619077+0000","last_unstale":"2024-09-21T05:48:38.717723+0000","last_undegraded":"2024-09-21T05:48:38.717723+0000","last_fullsized":"2024-09-21T05:48:38.717723+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:17.774462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.722547+0000","last_change":"2024-09-21T05:47:38.730714+0000","last_active":"2024-09-21T05:48:38.722547+0000","last_peered":"2024-09-21T05:48:38.722547+0000","last_clean":"2024-09-21T05:48:38.722547+0000","last_became_active":"2024-09-21T05:47:38.730271+0000","last_became_peered":"2024-09-21T05:47:38.730271+0000","last_unstale":"2024-09-21T05:48:38.722547+0000","last_undegraded":"2024-09-21T05:48:38.722547+0000","last_fullsized":"2024-09-21T05:48:38.722547+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:53.391967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285511+0000","last_change":"2024-09-21T05:47:05.642487+0000","last_active":"2024-09-21T05:48:39.285511+0000","last_peered":"2024-09-21T05:48:39.285511+0000","last_clean":"2024-09-21T05:48:39.285511+0000","last_became_active":"2024-09-21T05:47:05.642022+0000","last_became_peered":"2024-09-21T05:47:05.642022+0000","last_unstale":"2024-09-21T05:48:39.285511+0000","last_undegraded":"2024-09-21T05:48:39.285511+0000","last_fullsized":"2024-09-21T05:48:39.285511+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:50:38.435444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721907+0000","last_change":"2024-09-21T05:47:03.618333+0000","last_active":"2024-09-21T05:48:38.721907+0000","last_peered":"2024-09-21T05:48:38.721907+0000","last_clean":"2024-09-21T05:48:38.721907+0000","last_became_active":"2024-09-21T05:47:03.617843+0000","last_became_peered":"2024-09-21T05:47:03.617843+0000","last_unstale":"2024-09-21T05:48:38.721907+0000","last_undegraded":"2024-09-21T05:48:38.721907+0000","last_fullsized":"2024-09-21T05:48:38.721907+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:01.647913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":115,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718194+0000","last_change":"2024-09-21T05:45:52.661435+0000","last_active":"2024-09-21T05:48:38.718194+0000","last_peered":"2024-09-21T05:48:38.718194+0000","last_clean":"2024-09-21T05:48:38.718194+0000","last_became_active":"2024-09-21T05:45:52.656767+0000","last_became_peered":"2024-09-21T05:45:52.656767+0000","last_unstale":"2024-09-21T05:48:38.718194+0000","last_undegraded":"2024-09-21T05:48:38.718194+0000","last_fullsized":"2024-09-21T05:48:38.718194+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:42:26.045146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:42:26.045146+0000","last_clean_scrub_stamp":"2024-09-21T05:42:26.045146+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:40:12.152499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718097+0000","last_change":"2024-09-21T05:47:12.675435+0000","last_active":"2024-09-21T05:48:38.718097+0000","last_peered":"2024-09-21T05:48:38.718097+0000","last_clean":"2024-09-21T05:48:38.718097+0000","last_became_active":"2024-09-21T05:47:12.674955+0000","last_became_peered":"2024-09-21T05:47:12.674955+0000","last_unstale":"2024-09-21T05:48:38.718097+0000","last_undegraded":"2024-09-21T05:48:38.718097+0000","last_fullsized":"2024-09-21T05:48:38.718097+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:18.758498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718264+0000","last_change":"2024-09-21T05:47:05.640952+0000","last_active":"2024-09-21T05:48:38.718264+0000","last_peered":"2024-09-21T05:48:38.718264+0000","last_clean":"2024-09-21T05:48:38.718264+0000","last_became_active":"2024-09-21T05:47:05.640554+0000","last_became_peered":"2024-09-21T05:47:05.640554+0000","last_unstale":"2024-09-21T05:48:38.718264+0000","last_undegraded":"2024-09-21T05:48:38.718264+0000","last_fullsized":"2024-09-21T05:48:38.718264+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:15:08.553651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'5","reported_seq":100,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:43.645943+0000","last_change":"2024-09-21T05:47:04.411605+0000","last_active":"2024-09-21T05:48:43.645943+0000","last_peered":"2024-09-21T05:48:43.645943+0000","last_clean":"2024-09-21T05:48:43.645943+0000","last_became_active":"2024-09-21T05:47:04.411129+0000","last_became_peered":"2024-09-21T05:47:04.411129+0000","last_unstale":"2024-09-21T05:48:43.645943+0000","last_undegraded":"2024-09-21T05:48:43.645943+0000","last_fullsized":"2024-09-21T05:48:43.645943+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:25.469148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715250+0000","last_change":"2024-09-21T05:47:12.670479+0000","last_active":"2024-09-21T05:48:38.715250+0000","last_peered":"2024-09-21T05:48:38.715250+0000","last_clean":"2024-09-21T05:48:38.715250+0000","last_became_active":"2024-09-21T05:47:12.669925+0000","last_became_peered":"2024-09-21T05:47:12.669925+0000","last_unstale":"2024-09-21T05:48:38.715250+0000","last_undegraded":"2024-09-21T05:48:38.715250+0000","last_fullsized":"2024-09-21T05:48:38.715250+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:50.506063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718020+0000","last_change":"2024-09-21T05:47:05.634519+0000","last_active":"2024-09-21T05:48:38.718020+0000","last_peered":"2024-09-21T05:48:38.718020+0000","last_clean":"2024-09-21T05:48:38.718020+0000","last_became_active":"2024-09-21T05:47:05.634134+0000","last_became_peered":"2024-09-21T05:47:05.634134+0000","last_unstale":"2024-09-21T05:48:38.718020+0000","last_undegraded":"2024-09-21T05:48:38.718020+0000","last_fullsized":"2024-09-21T05:48:38.718020+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:57.464884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721323+0000","last_change":"2024-09-21T05:47:03.622860+0000","last_active":"2024-09-21T05:48:38.721323+0000","last_peered":"2024-09-21T05:48:38.721323+0000","last_clean":"2024-09-21T05:48:38.721323+0000","last_became_active":"2024-09-21T05:47:03.622435+0000","last_became_peered":"2024-09-21T05:47:03.622435+0000","last_unstale":"2024-09-21T05:48:38.721323+0000","last_undegraded":"2024-09-21T05:48:38.721323+0000","last_fullsized":"2024-09-21T05:48:38.721323+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:03.352140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720141+0000","last_change":"2024-09-21T05:47:12.673518+0000","last_active":"2024-09-21T05:48:38.720141+0000","last_peered":"2024-09-21T05:48:38.720141+0000","last_clean":"2024-09-21T05:48:38.720141+0000","last_became_active":"2024-09-21T05:47:12.673000+0000","last_became_peered":"2024-09-21T05:47:12.673000+0000","last_unstale":"2024-09-21T05:48:38.720141+0000","last_undegraded":"2024-09-21T05:48:38.720141+0000","last_fullsized":"2024-09-21T05:48:38.720141+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:37.859801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718272+0000","last_change":"2024-09-21T05:47:05.625144+0000","last_active":"2024-09-21T05:48:38.718272+0000","last_peered":"2024-09-21T05:48:38.718272+0000","last_clean":"2024-09-21T05:48:38.718272+0000","last_became_active":"2024-09-21T05:47:05.624593+0000","last_became_peered":"2024-09-21T05:47:05.624593+0000","last_unstale":"2024-09-21T05:48:38.718272+0000","last_undegraded":"2024-09-21T05:48:38.718272+0000","last_fullsized":"2024-09-21T05:48:38.718272+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:04.332686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.433017+0000","last_change":"2024-09-21T05:47:03.612389+0000","last_active":"2024-09-21T05:48:39.433017+0000","last_peered":"2024-09-21T05:48:39.433017+0000","last_clean":"2024-09-21T05:48:39.433017+0000","last_became_active":"2024-09-21T05:47:03.612023+0000","last_became_peered":"2024-09-21T05:47:03.612023+0000","last_unstale":"2024-09-21T05:48:39.433017+0000","last_undegraded":"2024-09-21T05:48:39.433017+0000","last_fullsized":"2024-09-21T05:48:39.433017+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:32.571903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721092+0000","last_change":"2024-09-21T05:47:12.674963+0000","last_active":"2024-09-21T05:48:38.721092+0000","last_peered":"2024-09-21T05:48:38.721092+0000","last_clean":"2024-09-21T05:48:38.721092+0000","last_became_active":"2024-09-21T05:47:12.673883+0000","last_became_peered":"2024-09-21T05:47:12.673883+0000","last_unstale":"2024-09-21T05:48:38.721092+0000","last_undegraded":"2024-09-21T05:48:38.721092+0000","last_fullsized":"2024-09-21T05:48:38.721092+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:29.843443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718170+0000","last_change":"2024-09-21T05:47:05.638440+0000","last_active":"2024-09-21T05:48:38.718170+0000","last_peered":"2024-09-21T05:48:38.718170+0000","last_clean":"2024-09-21T05:48:38.718170+0000","last_became_active":"2024-09-21T05:47:05.638010+0000","last_became_peered":"2024-09-21T05:47:05.638010+0000","last_unstale":"2024-09-21T05:48:38.718170+0000","last_undegraded":"2024-09-21T05:48:38.718170+0000","last_fullsized":"2024-09-21T05:48:38.718170+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:47.921461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.742870+0000","last_change":"2024-09-21T05:48:38.742314+0000","last_active":"2024-09-21T05:48:38.742870+0000","last_peered":"2024-09-21T05:48:38.742870+0000","last_clean":"2024-09-21T05:48:38.742870+0000","last_became_active":"2024-09-21T05:48:38.723546+0000","last_became_peered":"2024-09-21T05:48:38.723546+0000","last_unstale":"2024-09-21T05:48:38.742870+0000","last_undegraded":"2024-09-21T05:48:38.742870+0000","last_fullsized":"2024-09-21T05:48:38.742870+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:12.911309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.719761+0000","last_change":"2024-09-21T05:47:12.675362+0000","last_active":"2024-09-21T05:48:38.719761+0000","last_peered":"2024-09-21T05:48:38.719761+0000","last_clean":"2024-09-21T05:48:38.719761+0000","last_became_active":"2024-09-21T05:47:12.674578+0000","last_became_peered":"2024-09-21T05:47:12.674578+0000","last_unstale":"2024-09-21T05:48:38.719761+0000","last_undegraded":"2024-09-21T05:48:38.719761+0000","last_fullsized":"2024-09-21T05:48:38.719761+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:56.654323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720182+0000","last_change":"2024-09-21T05:47:05.641130+0000","last_active":"2024-09-21T05:48:38.720182+0000","last_peered":"2024-09-21T05:48:38.720182+0000","last_clean":"2024-09-21T05:48:38.720182+0000","last_became_active":"2024-09-21T05:47:05.640794+0000","last_became_peered":"2024-09-21T05:47:05.640794+0000","last_unstale":"2024-09-21T05:48:38.720182+0000","last_undegraded":"2024-09-21T05:48:38.720182+0000","last_fullsized":"2024-09-21T05:48:38.720182+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:29:18.243240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.738576+0000","last_change":"2024-09-21T05:48:38.737941+0000","last_active":"2024-09-21T05:48:38.738576+0000","last_peered":"2024-09-21T05:48:38.738576+0000","last_clean":"2024-09-21T05:48:38.738576+0000","last_became_active":"2024-09-21T05:48:38.722769+0000","last_became_peered":"2024-09-21T05:48:38.722769+0000","last_unstale":"2024-09-21T05:48:38.738576+0000","last_undegraded":"2024-09-21T05:48:38.738576+0000","last_fullsized":"2024-09-21T05:48:38.738576+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:24.258822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.432974+0000","last_change":"2024-09-21T05:47:12.671181+0000","last_active":"2024-09-21T05:48:39.432974+0000","last_peered":"2024-09-21T05:48:39.432974+0000","last_clean":"2024-09-21T05:48:39.432974+0000","last_became_active":"2024-09-21T05:47:12.670522+0000","last_became_peered":"2024-09-21T05:47:12.670522+0000","last_unstale":"2024-09-21T05:48:39.432974+0000","last_undegraded":"2024-09-21T05:48:39.432974+0000","last_fullsized":"2024-09-21T05:48:39.432974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:52.165812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.717455+0000","last_change":"2024-09-21T05:47:05.629167+0000","last_active":"2024-09-21T05:48:38.717455+0000","last_peered":"2024-09-21T05:48:38.717455+0000","last_clean":"2024-09-21T05:48:38.717455+0000","last_became_active":"2024-09-21T05:47:05.628794+0000","last_became_peered":"2024-09-21T05:47:05.628794+0000","last_unstale":"2024-09-21T05:48:38.717455+0000","last_undegraded":"2024-09-21T05:48:38.717455+0000","last_fullsized":"2024-09-21T05:48:38.717455+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:51.469247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'6","reported_seq":101,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:41.632854+0000","last_change":"2024-09-21T05:47:03.621479+0000","last_active":"2024-09-21T05:48:41.632854+0000","last_peered":"2024-09-21T05:48:41.632854+0000","last_clean":"2024-09-21T05:48:41.632854+0000","last_became_active":"2024-09-21T05:47:03.621041+0000","last_became_peered":"2024-09-21T05:47:03.621041+0000","last_unstale":"2024-09-21T05:48:41.632854+0000","last_undegraded":"2024-09-21T05:48:41.632854+0000","last_fullsized":"2024-09-21T05:48:41.632854+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:33.092750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714842+0000","last_change":"2024-09-21T05:47:12.669821+0000","last_active":"2024-09-21T05:48:38.714842+0000","last_peered":"2024-09-21T05:48:38.714842+0000","last_clean":"2024-09-21T05:48:38.714842+0000","last_became_active":"2024-09-21T05:47:12.669418+0000","last_became_peered":"2024-09-21T05:47:12.669418+0000","last_unstale":"2024-09-21T05:48:38.714842+0000","last_undegraded":"2024-09-21T05:48:38.714842+0000","last_fullsized":"2024-09-21T05:48:38.714842+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:57.082509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.717767+0000","last_change":"2024-09-21T05:47:05.631182+0000","last_active":"2024-09-21T05:48:38.717767+0000","last_peered":"2024-09-21T05:48:38.717767+0000","last_clean":"2024-09-21T05:48:38.717767+0000","last_became_active":"2024-09-21T05:47:05.630716+0000","last_became_peered":"2024-09-21T05:47:05.630716+0000","last_unstale":"2024-09-21T05:48:38.717767+0000","last_undegraded":"2024-09-21T05:48:38.717767+0000","last_fullsized":"2024-09-21T05:48:38.717767+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:17.946858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720713+0000","last_change":"2024-09-21T05:47:03.620897+0000","last_active":"2024-09-21T05:48:38.720713+0000","last_peered":"2024-09-21T05:48:38.720713+0000","last_clean":"2024-09-21T05:48:38.720713+0000","last_became_active":"2024-09-21T05:47:03.620003+0000","last_became_peered":"2024-09-21T05:47:03.620003+0000","last_unstale":"2024-09-21T05:48:38.720713+0000","last_undegraded":"2024-09-21T05:48:38.720713+0000","last_fullsized":"2024-09-21T05:48:38.720713+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:51:07.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718077+0000","last_change":"2024-09-21T05:47:12.675320+0000","last_active":"2024-09-21T05:48:38.718077+0000","last_peered":"2024-09-21T05:48:38.718077+0000","last_clean":"2024-09-21T05:48:38.718077+0000","last_became_active":"2024-09-21T05:47:12.674715+0000","last_became_peered":"2024-09-21T05:47:12.674715+0000","last_unstale":"2024-09-21T05:48:38.718077+0000","last_undegraded":"2024-09-21T05:48:38.718077+0000","last_fullsized":"2024-09-21T05:48:38.718077+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:28.151947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.432628+0000","last_change":"2024-09-21T05:47:05.630786+0000","last_active":"2024-09-21T05:48:39.432628+0000","last_peered":"2024-09-21T05:48:39.432628+0000","last_clean":"2024-09-21T05:48:39.432628+0000","last_became_active":"2024-09-21T05:47:05.630433+0000","last_became_peered":"2024-09-21T05:47:05.630433+0000","last_unstale":"2024-09-21T05:48:39.432628+0000","last_undegraded":"2024-09-21T05:48:39.432628+0000","last_fullsized":"2024-09-21T05:48:39.432628+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:54.481462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.716267+0000","last_change":"2024-09-21T05:47:03.618990+0000","last_active":"2024-09-21T05:48:38.716267+0000","last_peered":"2024-09-21T05:48:38.716267+0000","last_clean":"2024-09-21T05:48:38.716267+0000","last_became_active":"2024-09-21T05:47:03.618679+0000","last_became_peered":"2024-09-21T05:47:03.618679+0000","last_unstale":"2024-09-21T05:48:38.716267+0000","last_undegraded":"2024-09-21T05:48:38.716267+0000","last_fullsized":"2024-09-21T05:48:38.716267+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:10.193233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721027+0000","last_change":"2024-09-21T05:47:12.675012+0000","last_active":"2024-09-21T05:48:38.721027+0000","last_peered":"2024-09-21T05:48:38.721027+0000","last_clean":"2024-09-21T05:48:38.721027+0000","last_became_active":"2024-09-21T05:47:12.674266+0000","last_became_peered":"2024-09-21T05:47:12.674266+0000","last_unstale":"2024-09-21T05:48:38.721027+0000","last_undegraded":"2024-09-21T05:48:38.721027+0000","last_fullsized":"2024-09-21T05:48:38.721027+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:43.525084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.722236+0000","last_change":"2024-09-21T05:47:05.625457+0000","last_active":"2024-09-21T05:48:38.722236+0000","last_peered":"2024-09-21T05:48:38.722236+0000","last_clean":"2024-09-21T05:48:38.722236+0000","last_became_active":"2024-09-21T05:47:05.625058+0000","last_became_peered":"2024-09-21T05:47:05.625058+0000","last_unstale":"2024-09-21T05:48:38.722236+0000","last_undegraded":"2024-09-21T05:48:38.722236+0000","last_fullsized":"2024-09-21T05:48:38.722236+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:29:09.352152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"83'34","reported_seq":183,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:40.726001+0000","last_change":"2024-09-21T05:47:03.621535+0000","last_active":"2024-09-21T05:48:40.726001+0000","last_peered":"2024-09-21T05:48:40.726001+0000","last_clean":"2024-09-21T05:48:40.726001+0000","last_became_active":"2024-09-21T05:47:03.621109+0000","last_became_peered":"2024-09-21T05:47:03.621109+0000","last_unstale":"2024-09-21T05:48:40.726001+0000","last_undegraded":"2024-09-21T05:48:40.726001+0000","last_fullsized":"2024-09-21T05:48:40.726001+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:31:12.135760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66212,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":120,"num_write":36,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714371+0000","last_change":"2024-09-21T05:47:12.676827+0000","last_active":"2024-09-21T05:48:38.714371+0000","last_peered":"2024-09-21T05:48:38.714371+0000","last_clean":"2024-09-21T05:48:38.714371+0000","last_became_active":"2024-09-21T05:47:12.676256+0000","last_became_peered":"2024-09-21T05:47:12.676256+0000","last_unstale":"2024-09-21T05:48:38.714371+0000","last_undegraded":"2024-09-21T05:48:38.714371+0000","last_fullsized":"2024-09-21T05:48:38.714371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:40.932328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715421+0000","last_change":"2024-09-21T05:47:05.636507+0000","last_active":"2024-09-21T05:48:38.715421+0000","last_peered":"2024-09-21T05:48:38.715421+0000","last_clean":"2024-09-21T05:48:38.715421+0000","last_became_active":"2024-09-21T05:47:05.636140+0000","last_became_peered":"2024-09-21T05:47:05.636140+0000","last_unstale":"2024-09-21T05:48:38.715421+0000","last_undegraded":"2024-09-21T05:48:38.715421+0000","last_fullsized":"2024-09-21T05:48:38.715421+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:16.879274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721437+0000","last_change":"2024-09-21T05:47:03.670425+0000","last_active":"2024-09-21T05:48:38.721437+0000","last_peered":"2024-09-21T05:48:38.721437+0000","last_clean":"2024-09-21T05:48:38.721437+0000","last_became_active":"2024-09-21T05:47:03.669973+0000","last_became_peered":"2024-09-21T05:47:03.669973+0000","last_unstale":"2024-09-21T05:48:38.721437+0000","last_undegraded":"2024-09-21T05:48:38.721437+0000","last_fullsized":"2024-09-21T05:48:38.721437+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:04.212044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721599+0000","last_change":"2024-09-21T05:47:12.677600+0000","last_active":"2024-09-21T05:48:38.721599+0000","last_peered":"2024-09-21T05:48:38.721599+0000","last_clean":"2024-09-21T05:48:38.721599+0000","last_became_active":"2024-09-21T05:47:12.677037+0000","last_became_peered":"2024-09-21T05:47:12.677037+0000","last_unstale":"2024-09-21T05:48:38.721599+0000","last_undegraded":"2024-09-21T05:48:38.721599+0000","last_fullsized":"2024-09-21T05:48:38.721599+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:36.502821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720568+0000","last_change":"2024-09-21T05:47:38.398403+0000","last_active":"2024-09-21T05:48:38.720568+0000","last_peered":"2024-09-21T05:48:38.720568+0000","last_clean":"2024-09-21T05:48:38.720568+0000","last_became_active":"2024-09-21T05:47:38.397953+0000","last_became_peered":"2024-09-21T05:47:38.397953+0000","last_unstale":"2024-09-21T05:48:38.720568+0000","last_undegraded":"2024-09-21T05:48:38.720568+0000","last_fullsized":"2024-09-21T05:48:38.720568+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:01.550222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":56,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.727961+0000","last_change":"2024-09-21T05:48:38.727813+0000","last_active":"2024-09-21T05:48:38.727961+0000","last_peered":"2024-09-21T05:48:38.727961+0000","last_clean":"2024-09-21T05:48:38.727961+0000","last_became_active":"2024-09-21T05:48:38.722709+0000","last_became_peered":"2024-09-21T05:48:38.722709+0000","last_unstale":"2024-09-21T05:48:38.727961+0000","last_undegraded":"2024-09-21T05:48:38.727961+0000","last_fullsized":"2024-09-21T05:48:38.727961+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:22.544711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714216+0000","last_change":"2024-09-21T05:47:12.670466+0000","last_active":"2024-09-21T05:48:38.714216+0000","last_peered":"2024-09-21T05:48:38.714216+0000","last_clean":"2024-09-21T05:48:38.714216+0000","last_became_active":"2024-09-21T05:47:12.670032+0000","last_became_peered":"2024-09-21T05:47:12.670032+0000","last_unstale":"2024-09-21T05:48:38.714216+0000","last_undegraded":"2024-09-21T05:48:38.714216+0000","last_fullsized":"2024-09-21T05:48:38.714216+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:18.860347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715681+0000","last_change":"2024-09-21T05:47:05.645093+0000","last_active":"2024-09-21T05:48:38.715681+0000","last_peered":"2024-09-21T05:48:38.715681+0000","last_clean":"2024-09-21T05:48:38.715681+0000","last_became_active":"2024-09-21T05:47:05.644739+0000","last_became_peered":"2024-09-21T05:47:05.644739+0000","last_unstale":"2024-09-21T05:48:38.715681+0000","last_undegraded":"2024-09-21T05:48:38.715681+0000","last_fullsized":"2024-09-21T05:48:38.715681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:43.895574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":144,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:40.640432+0000","last_change":"2024-09-21T05:47:03.619070+0000","last_active":"2024-09-21T05:48:40.640432+0000","last_peered":"2024-09-21T05:48:40.640432+0000","last_clean":"2024-09-21T05:48:40.640432+0000","last_became_active":"2024-09-21T05:47:03.618655+0000","last_became_peered":"2024-09-21T05:47:03.618655+0000","last_unstale":"2024-09-21T05:48:40.640432+0000","last_undegraded":"2024-09-21T05:48:40.640432+0000","last_fullsized":"2024-09-21T05:48:40.640432+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:29.206109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285302+0000","last_change":"2024-09-21T05:47:12.672677+0000","last_active":"2024-09-21T05:48:39.285302+0000","last_peered":"2024-09-21T05:48:39.285302+0000","last_clean":"2024-09-21T05:48:39.285302+0000","last_became_active":"2024-09-21T05:47:12.672264+0000","last_became_peered":"2024-09-21T05:47:12.672264+0000","last_unstale":"2024-09-21T05:48:39.285302+0000","last_undegraded":"2024-09-21T05:48:39.285302+0000","last_fullsized":"2024-09-21T05:48:39.285302+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:31.680678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720222+0000","last_change":"2024-09-21T05:47:12.672702+0000","last_active":"2024-09-21T05:48:38.720222+0000","last_peered":"2024-09-21T05:48:38.720222+0000","last_clean":"2024-09-21T05:48:38.720222+0000","last_became_active":"2024-09-21T05:47:12.672233+0000","last_became_peered":"2024-09-21T05:47:12.672233+0000","last_unstale":"2024-09-21T05:48:38.720222+0000","last_undegraded":"2024-09-21T05:48:38.720222+0000","last_fullsized":"2024-09-21T05:48:38.720222+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:04.235603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714343+0000","last_change":"2024-09-21T05:47:05.633566+0000","last_active":"2024-09-21T05:48:38.714343+0000","last_peered":"2024-09-21T05:48:38.714343+0000","last_clean":"2024-09-21T05:48:38.714343+0000","last_became_active":"2024-09-21T05:47:05.633240+0000","last_became_peered":"2024-09-21T05:47:05.633240+0000","last_unstale":"2024-09-21T05:48:38.714343+0000","last_undegraded":"2024-09-21T05:48:38.714343+0000","last_fullsized":"2024-09-21T05:48:38.714343+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:10.106647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721456+0000","last_change":"2024-09-21T05:47:03.621788+0000","last_active":"2024-09-21T05:48:38.721456+0000","last_peered":"2024-09-21T05:48:38.721456+0000","last_clean":"2024-09-21T05:48:38.721456+0000","last_became_active":"2024-09-21T05:47:03.621425+0000","last_became_peered":"2024-09-21T05:47:03.621425+0000","last_unstale":"2024-09-21T05:48:38.721456+0000","last_undegraded":"2024-09-21T05:48:38.721456+0000","last_fullsized":"2024-09-21T05:48:38.721456+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:51.069361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718106+0000","last_change":"2024-09-21T05:47:12.670670+0000","last_active":"2024-09-21T05:48:38.718106+0000","last_peered":"2024-09-21T05:48:38.718106+0000","last_clean":"2024-09-21T05:48:38.718106+0000","last_became_active":"2024-09-21T05:47:12.670192+0000","last_became_peered":"2024-09-21T05:47:12.670192+0000","last_unstale":"2024-09-21T05:48:38.718106+0000","last_undegraded":"2024-09-21T05:48:38.718106+0000","last_fullsized":"2024-09-21T05:48:38.718106+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:59.430991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285347+0000","last_change":"2024-09-21T05:47:05.637775+0000","last_active":"2024-09-21T05:48:39.285347+0000","last_peered":"2024-09-21T05:48:39.285347+0000","last_clean":"2024-09-21T05:48:39.285347+0000","last_became_active":"2024-09-21T05:47:05.637436+0000","last_became_peered":"2024-09-21T05:47:05.637436+0000","last_unstale":"2024-09-21T05:48:39.285347+0000","last_undegraded":"2024-09-21T05:48:39.285347+0000","last_fullsized":"2024-09-21T05:48:39.285347+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:45:59.041879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.432501+0000","last_change":"2024-09-21T05:47:03.611317+0000","last_active":"2024-09-21T05:48:39.432501+0000","last_peered":"2024-09-21T05:48:39.432501+0000","last_clean":"2024-09-21T05:48:39.432501+0000","last_became_active":"2024-09-21T05:47:03.610967+0000","last_became_peered":"2024-09-21T05:47:03.610967+0000","last_unstale":"2024-09-21T05:48:39.432501+0000","last_undegraded":"2024-09-21T05:48:39.432501+0000","last_fullsized":"2024-09-21T05:48:39.432501+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:44.263380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.286079+0000","last_change":"2024-09-21T05:47:03.624584+0000","last_active":"2024-09-21T05:48:39.286079+0000","last_peered":"2024-09-21T05:48:39.286079+0000","last_clean":"2024-09-21T05:48:39.286079+0000","last_became_active":"2024-09-21T05:47:03.623886+0000","last_became_peered":"2024-09-21T05:47:03.623886+0000","last_unstale":"2024-09-21T05:48:39.286079+0000","last_undegraded":"2024-09-21T05:48:39.286079+0000","last_fullsized":"2024-09-21T05:48:39.286079+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:55.451732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720640+0000","last_change":"2024-09-21T05:47:38.731762+0000","last_active":"2024-09-21T05:48:38.720640+0000","last_peered":"2024-09-21T05:48:38.720640+0000","last_clean":"2024-09-21T05:48:38.720640+0000","last_became_active":"2024-09-21T05:47:38.731325+0000","last_became_peered":"2024-09-21T05:47:38.731325+0000","last_unstale":"2024-09-21T05:48:38.720640+0000","last_undegraded":"2024-09-21T05:48:38.720640+0000","last_fullsized":"2024-09-21T05:48:38.720640+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:42.516434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715948+0000","last_change":"2024-09-21T05:47:12.677198+0000","last_active":"2024-09-21T05:48:38.715948+0000","last_peered":"2024-09-21T05:48:38.715948+0000","last_clean":"2024-09-21T05:48:38.715948+0000","last_became_active":"2024-09-21T05:47:12.676673+0000","last_became_peered":"2024-09-21T05:47:12.676673+0000","last_unstale":"2024-09-21T05:48:38.715948+0000","last_undegraded":"2024-09-21T05:48:38.715948+0000","last_fullsized":"2024-09-21T05:48:38.715948+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:58.861348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"83'5","reported_seq":112,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:42.730399+0000","last_change":"2024-09-21T05:48:38.730420+0000","last_active":"2024-09-21T05:48:42.730399+0000","last_peered":"2024-09-21T05:48:42.730399+0000","last_clean":"2024-09-21T05:48:42.730399+0000","last_became_active":"2024-09-21T05:48:38.722303+0000","last_became_peered":"2024-09-21T05:48:38.722303+0000","last_unstale":"2024-09-21T05:48:42.730399+0000","last_undegraded":"2024-09-21T05:48:42.730399+0000","last_fullsized":"2024-09-21T05:48:42.730399+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:37.846446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720875+0000","last_change":"2024-09-21T05:47:05.641444+0000","last_active":"2024-09-21T05:48:38.720875+0000","last_peered":"2024-09-21T05:48:38.720875+0000","last_clean":"2024-09-21T05:48:38.720875+0000","last_became_active":"2024-09-21T05:47:05.640967+0000","last_became_peered":"2024-09-21T05:47:05.640967+0000","last_unstale":"2024-09-21T05:48:38.720875+0000","last_undegraded":"2024-09-21T05:48:38.720875+0000","last_fullsized":"2024-09-21T05:48:38.720875+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:20.698467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.716537+0000","last_change":"2024-09-21T05:47:12.680157+0000","last_active":"2024-09-21T05:48:38.716537+0000","last_peered":"2024-09-21T05:48:38.716537+0000","last_clean":"2024-09-21T05:48:38.716537+0000","last_became_active":"2024-09-21T05:47:12.679604+0000","last_became_peered":"2024-09-21T05:47:12.679604+0000","last_unstale":"2024-09-21T05:48:38.716537+0000","last_undegraded":"2024-09-21T05:48:38.716537+0000","last_fullsized":"2024-09-21T05:48:38.716537+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:15.381901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718744+0000","last_change":"2024-09-21T05:47:05.635022+0000","last_active":"2024-09-21T05:48:38.718744+0000","last_peered":"2024-09-21T05:48:38.718744+0000","last_clean":"2024-09-21T05:48:38.718744+0000","last_became_active":"2024-09-21T05:47:05.634592+0000","last_became_peered":"2024-09-21T05:47:05.634592+0000","last_unstale":"2024-09-21T05:48:38.718744+0000","last_undegraded":"2024-09-21T05:48:38.718744+0000","last_fullsized":"2024-09-21T05:48:38.718744+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:48.159339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.722743+0000","last_change":"2024-09-21T05:48:38.722629+0000","last_active":"2024-09-21T05:48:38.722743+0000","last_peered":"2024-09-21T05:48:38.722743+0000","last_clean":"2024-09-21T05:48:38.722743+0000","last_became_active":"2024-09-21T05:48:38.722198+0000","last_became_peered":"2024-09-21T05:48:38.722198+0000","last_unstale":"2024-09-21T05:48:38.722743+0000","last_undegraded":"2024-09-21T05:48:38.722743+0000","last_fullsized":"2024-09-21T05:48:38.722743+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:26.126710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715809+0000","last_change":"2024-09-21T05:47:05.637359+0000","last_active":"2024-09-21T05:48:38.715809+0000","last_peered":"2024-09-21T05:48:38.715809+0000","last_clean":"2024-09-21T05:48:38.715809+0000","last_became_active":"2024-09-21T05:47:05.636998+0000","last_became_peered":"2024-09-21T05:47:05.636998+0000","last_unstale":"2024-09-21T05:48:38.715809+0000","last_undegraded":"2024-09-21T05:48:38.715809+0000","last_fullsized":"2024-09-21T05:48:38.715809+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:06.186344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720270+0000","last_change":"2024-09-21T05:47:05.633304+0000","last_active":"2024-09-21T05:48:38.720270+0000","last_peered":"2024-09-21T05:48:38.720270+0000","last_clean":"2024-09-21T05:48:38.720270+0000","last_became_active":"2024-09-21T05:47:05.632919+0000","last_became_peered":"2024-09-21T05:47:05.632919+0000","last_unstale":"2024-09-21T05:48:38.720270+0000","last_undegraded":"2024-09-21T05:48:38.720270+0000","last_fullsized":"2024-09-21T05:48:38.720270+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:16.108908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.432862+0000","last_change":"2024-09-21T05:47:05.631091+0000","last_active":"2024-09-21T05:48:39.432862+0000","last_peered":"2024-09-21T05:48:39.432862+0000","last_clean":"2024-09-21T05:48:39.432862+0000","last_became_active":"2024-09-21T05:47:05.630740+0000","last_became_peered":"2024-09-21T05:47:05.630740+0000","last_unstale":"2024-09-21T05:48:39.432862+0000","last_undegraded":"2024-09-21T05:48:39.432862+0000","last_fullsized":"2024-09-21T05:48:39.432862+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:36:41.136890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718425+0000","last_change":"2024-09-21T05:47:38.398773+0000","last_active":"2024-09-21T05:48:38.718425+0000","last_peered":"2024-09-21T05:48:38.718425+0000","last_clean":"2024-09-21T05:48:38.718425+0000","last_became_active":"2024-09-21T05:47:38.398378+0000","last_became_peered":"2024-09-21T05:47:38.398378+0000","last_unstale":"2024-09-21T05:48:38.718425+0000","last_undegraded":"2024-09-21T05:48:38.718425+0000","last_fullsized":"2024-09-21T05:48:38.718425+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:32.247222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.716471+0000","last_change":"2024-09-21T05:47:05.641782+0000","last_active":"2024-09-21T05:48:38.716471+0000","last_peered":"2024-09-21T05:48:38.716471+0000","last_clean":"2024-09-21T05:48:38.716471+0000","last_became_active":"2024-09-21T05:47:05.641422+0000","last_became_peered":"2024-09-21T05:47:05.641422+0000","last_unstale":"2024-09-21T05:48:38.716471+0000","last_undegraded":"2024-09-21T05:48:38.716471+0000","last_fullsized":"2024-09-21T05:48:38.716471+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:33.819329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714772+0000","last_change":"2024-09-21T05:47:38.396070+0000","last_active":"2024-09-21T05:48:38.714772+0000","last_peered":"2024-09-21T05:48:38.714772+0000","last_clean":"2024-09-21T05:48:38.714772+0000","last_became_active":"2024-09-21T05:47:38.395727+0000","last_became_peered":"2024-09-21T05:47:38.395727+0000","last_unstale":"2024-09-21T05:48:38.714772+0000","last_undegraded":"2024-09-21T05:48:38.714772+0000","last_fullsized":"2024-09-21T05:48:38.714772+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:41.816692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721233+0000","last_change":"2024-09-21T05:47:05.633701+0000","last_active":"2024-09-21T05:48:38.721233+0000","last_peered":"2024-09-21T05:48:38.721233+0000","last_clean":"2024-09-21T05:48:38.721233+0000","last_became_active":"2024-09-21T05:47:05.632671+0000","last_became_peered":"2024-09-21T05:47:05.632671+0000","last_unstale":"2024-09-21T05:48:38.721233+0000","last_undegraded":"2024-09-21T05:48:38.721233+0000","last_fullsized":"2024-09-21T05:48:38.721233+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:56.180731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285415+0000","last_change":"2024-09-21T05:47:05.639419+0000","last_active":"2024-09-21T05:48:39.285415+0000","last_peered":"2024-09-21T05:48:39.285415+0000","last_clean":"2024-09-21T05:48:39.285415+0000","last_became_active":"2024-09-21T05:47:05.639060+0000","last_became_peered":"2024-09-21T05:47:05.639060+0000","last_unstale":"2024-09-21T05:48:39.285415+0000","last_undegraded":"2024-09-21T05:48:39.285415+0000","last_fullsized":"2024-09-21T05:48:39.285415+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:09.562359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715435+0000","last_change":"2024-09-21T05:47:05.641218+0000","last_active":"2024-09-21T05:48:38.715435+0000","last_peered":"2024-09-21T05:48:38.715435+0000","last_clean":"2024-09-21T05:48:38.715435+0000","last_became_active":"2024-09-21T05:47:05.640813+0000","last_became_peered":"2024-09-21T05:47:05.640813+0000","last_unstale":"2024-09-21T05:48:38.715435+0000","last_undegraded":"2024-09-21T05:48:38.715435+0000","last_fullsized":"2024-09-21T05:48:38.715435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:21.057096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.432793+0000","last_change":"2024-09-21T05:47:05.627711+0000","last_active":"2024-09-21T05:48:39.432793+0000","last_peered":"2024-09-21T05:48:39.432793+0000","last_clean":"2024-09-21T05:48:39.432793+0000","last_became_active":"2024-09-21T05:47:05.626394+0000","last_became_peered":"2024-09-21T05:47:05.626394+0000","last_unstale":"2024-09-21T05:48:39.432793+0000","last_undegraded":"2024-09-21T05:48:39.432793+0000","last_fullsized":"2024-09-21T05:48:39.432793+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:31.038727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718058+0000","last_change":"2024-09-21T05:47:05.632835+0000","last_active":"2024-09-21T05:48:38.718058+0000","last_peered":"2024-09-21T05:48:38.718058+0000","last_clean":"2024-09-21T05:48:38.718058+0000","last_became_active":"2024-09-21T05:47:05.632486+0000","last_became_peered":"2024-09-21T05:47:05.632486+0000","last_unstale":"2024-09-21T05:48:38.718058+0000","last_undegraded":"2024-09-21T05:48:38.718058+0000","last_fullsized":"2024-09-21T05:48:38.718058+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:04.365517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.716282+0000","last_change":"2024-09-21T05:47:05.638381+0000","last_active":"2024-09-21T05:48:38.716282+0000","last_peered":"2024-09-21T05:48:38.716282+0000","last_clean":"2024-09-21T05:48:38.716282+0000","last_became_active":"2024-09-21T05:47:05.638007+0000","last_became_peered":"2024-09-21T05:47:05.638007+0000","last_unstale":"2024-09-21T05:48:38.716282+0000","last_undegraded":"2024-09-21T05:48:38.716282+0000","last_fullsized":"2024-09-21T05:48:38.716282+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:06.615367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714733+0000","last_change":"2024-09-21T05:47:05.644624+0000","last_active":"2024-09-21T05:48:38.714733+0000","last_peered":"2024-09-21T05:48:38.714733+0000","last_clean":"2024-09-21T05:48:38.714733+0000","last_became_active":"2024-09-21T05:47:05.644257+0000","last_became_peered":"2024-09-21T05:47:05.644257+0000","last_unstale":"2024-09-21T05:48:38.714733+0000","last_undegraded":"2024-09-21T05:48:38.714733+0000","last_fullsized":"2024-09-21T05:48:38.714733+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:31.385313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718685+0000","last_change":"2024-09-21T05:47:05.646368+0000","last_active":"2024-09-21T05:48:38.718685+0000","last_peered":"2024-09-21T05:48:38.718685+0000","last_clean":"2024-09-21T05:48:38.718685+0000","last_became_active":"2024-09-21T05:47:05.645952+0000","last_became_peered":"2024-09-21T05:47:05.645952+0000","last_unstale":"2024-09-21T05:48:38.718685+0000","last_undegraded":"2024-09-21T05:48:38.718685+0000","last_fullsized":"2024-09-21T05:48:38.718685+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:56.585911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715055+0000","last_change":"2024-09-21T05:47:05.640167+0000","last_active":"2024-09-21T05:48:38.715055+0000","last_peered":"2024-09-21T05:48:38.715055+0000","last_clean":"2024-09-21T05:48:38.715055+0000","last_became_active":"2024-09-21T05:47:05.639770+0000","last_became_peered":"2024-09-21T05:47:05.639770+0000","last_unstale":"2024-09-21T05:48:38.715055+0000","last_undegraded":"2024-09-21T05:48:38.715055+0000","last_fullsized":"2024-09-21T05:48:38.715055+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:45.661131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.719912+0000","last_change":"2024-09-21T05:47:38.732677+0000","last_active":"2024-09-21T05:48:38.719912+0000","last_peered":"2024-09-21T05:48:38.719912+0000","last_clean":"2024-09-21T05:48:38.719912+0000","last_became_active":"2024-09-21T05:47:38.732236+0000","last_became_peered":"2024-09-21T05:47:38.732236+0000","last_unstale":"2024-09-21T05:48:38.719912+0000","last_undegraded":"2024-09-21T05:48:38.719912+0000","last_fullsized":"2024-09-21T05:48:38.719912+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:41.474677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.719941+0000","last_change":"2024-09-21T05:47:05.629814+0000","last_active":"2024-09-21T05:48:38.719941+0000","last_peered":"2024-09-21T05:48:38.719941+0000","last_clean":"2024-09-21T05:48:38.719941+0000","last_became_active":"2024-09-21T05:47:05.629464+0000","last_became_peered":"2024-09-21T05:47:05.629464+0000","last_unstale":"2024-09-21T05:48:38.719941+0000","last_undegraded":"2024-09-21T05:48:38.719941+0000","last_fullsized":"2024-09-21T05:48:38.719941+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:58.222820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.432784+0000","last_change":"2024-09-21T05:47:05.629643+0000","last_active":"2024-09-21T05:48:39.432784+0000","last_peered":"2024-09-21T05:48:39.432784+0000","last_clean":"2024-09-21T05:48:39.432784+0000","last_became_active":"2024-09-21T05:47:05.629248+0000","last_became_peered":"2024-09-21T05:47:05.629248+0000","last_unstale":"2024-09-21T05:48:39.432784+0000","last_undegraded":"2024-09-21T05:48:39.432784+0000","last_fullsized":"2024-09-21T05:48:39.432784+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:31.569209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721917+0000","last_change":"2024-09-21T05:47:05.632188+0000","last_active":"2024-09-21T05:48:38.721917+0000","last_peered":"2024-09-21T05:48:38.721917+0000","last_clean":"2024-09-21T05:48:38.721917+0000","last_became_active":"2024-09-21T05:47:05.631799+0000","last_became_peered":"2024-09-21T05:47:05.631799+0000","last_unstale":"2024-09-21T05:48:38.721917+0000","last_undegraded":"2024-09-21T05:48:38.721917+0000","last_fullsized":"2024-09-21T05:48:38.721917+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:09.762405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718331+0000","last_change":"2024-09-21T05:47:05.644746+0000","last_active":"2024-09-21T05:48:38.718331+0000","last_peered":"2024-09-21T05:48:38.718331+0000","last_clean":"2024-09-21T05:48:38.718331+0000","last_became_active":"2024-09-21T05:47:05.644326+0000","last_became_peered":"2024-09-21T05:47:05.644326+0000","last_unstale":"2024-09-21T05:48:38.718331+0000","last_undegraded":"2024-09-21T05:48:38.718331+0000","last_fullsized":"2024-09-21T05:48:38.718331+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:22.937783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.286544+0000","last_change":"2024-09-21T05:47:05.639214+0000","last_active":"2024-09-21T05:48:39.286544+0000","last_peered":"2024-09-21T05:48:39.286544+0000","last_clean":"2024-09-21T05:48:39.286544+0000","last_became_active":"2024-09-21T05:47:05.638443+0000","last_became_peered":"2024-09-21T05:47:05.638443+0000","last_unstale":"2024-09-21T05:48:39.286544+0000","last_undegraded":"2024-09-21T05:48:39.286544+0000","last_fullsized":"2024-09-21T05:48:39.286544+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:30.134020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715810+0000","last_change":"2024-09-21T05:47:05.644233+0000","last_active":"2024-09-21T05:48:38.715810+0000","last_peered":"2024-09-21T05:48:38.715810+0000","last_clean":"2024-09-21T05:48:38.715810+0000","last_became_active":"2024-09-21T05:47:05.643820+0000","last_became_peered":"2024-09-21T05:47:05.643820+0000","last_unstale":"2024-09-21T05:48:38.715810+0000","last_undegraded":"2024-09-21T05:48:38.715810+0000","last_fullsized":"2024-09-21T05:48:38.715810+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:42.695997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285463+0000","last_change":"2024-09-21T05:47:05.637569+0000","last_active":"2024-09-21T05:48:39.285463+0000","last_peered":"2024-09-21T05:48:39.285463+0000","last_clean":"2024-09-21T05:48:39.285463+0000","last_became_active":"2024-09-21T05:47:05.637269+0000","last_became_peered":"2024-09-21T05:47:05.637269+0000","last_unstale":"2024-09-21T05:48:39.285463+0000","last_undegraded":"2024-09-21T05:48:39.285463+0000","last_fullsized":"2024-09-21T05:48:39.285463+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:28:26.335398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.717597+0000","last_change":"2024-09-21T05:47:05.633457+0000","last_active":"2024-09-21T05:48:38.717597+0000","last_peered":"2024-09-21T05:48:38.717597+0000","last_clean":"2024-09-21T05:48:38.717597+0000","last_became_active":"2024-09-21T05:47:05.633066+0000","last_became_peered":"2024-09-21T05:47:05.633066+0000","last_unstale":"2024-09-21T05:48:38.717597+0000","last_undegraded":"2024-09-21T05:48:38.717597+0000","last_fullsized":"2024-09-21T05:48:38.717597+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:45.904152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.286089+0000","last_change":"2024-09-21T05:47:38.399914+0000","last_active":"2024-09-21T05:48:39.286089+0000","last_peered":"2024-09-21T05:48:39.286089+0000","last_clean":"2024-09-21T05:48:39.286089+0000","last_became_active":"2024-09-21T05:47:38.399480+0000","last_became_peered":"2024-09-21T05:47:38.399480+0000","last_unstale":"2024-09-21T05:48:39.286089+0000","last_undegraded":"2024-09-21T05:48:39.286089+0000","last_fullsized":"2024-09-21T05:48:39.286089+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:51.281796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720436+0000","last_change":"2024-09-21T05:47:05.630944+0000","last_active":"2024-09-21T05:48:38.720436+0000","last_peered":"2024-09-21T05:48:38.720436+0000","last_clean":"2024-09-21T05:48:38.720436+0000","last_became_active":"2024-09-21T05:47:05.630498+0000","last_became_peered":"2024-09-21T05:47:05.630498+0000","last_unstale":"2024-09-21T05:48:38.720436+0000","last_undegraded":"2024-09-21T05:48:38.720436+0000","last_fullsized":"2024-09-21T05:48:38.720436+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:20.185094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721886+0000","last_change":"2024-09-21T05:47:05.636134+0000","last_active":"2024-09-21T05:48:38.721886+0000","last_peered":"2024-09-21T05:48:38.721886+0000","last_clean":"2024-09-21T05:48:38.721886+0000","last_became_active":"2024-09-21T05:47:05.635724+0000","last_became_peered":"2024-09-21T05:47:05.635724+0000","last_unstale":"2024-09-21T05:48:38.721886+0000","last_undegraded":"2024-09-21T05:48:38.721886+0000","last_fullsized":"2024-09-21T05:48:38.721886+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:55.455819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720240+0000","last_change":"2024-09-21T05:47:05.641209+0000","last_active":"2024-09-21T05:48:38.720240+0000","last_peered":"2024-09-21T05:48:38.720240+0000","last_clean":"2024-09-21T05:48:38.720240+0000","last_became_active":"2024-09-21T05:47:05.640543+0000","last_became_peered":"2024-09-21T05:47:05.640543+0000","last_unstale":"2024-09-21T05:48:38.720240+0000","last_undegraded":"2024-09-21T05:48:38.720240+0000","last_fullsized":"2024-09-21T05:48:38.720240+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:49.579724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720245+0000","last_change":"2024-09-21T05:47:05.634158+0000","last_active":"2024-09-21T05:48:38.720245+0000","last_peered":"2024-09-21T05:48:38.720245+0000","last_clean":"2024-09-21T05:48:38.720245+0000","last_became_active":"2024-09-21T05:47:05.633657+0000","last_became_peered":"2024-09-21T05:47:05.633657+0000","last_unstale":"2024-09-21T05:48:38.720245+0000","last_undegraded":"2024-09-21T05:48:38.720245+0000","last_fullsized":"2024-09-21T05:48:38.720245+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:37.868206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718567+0000","last_change":"2024-09-21T05:47:05.641358+0000","last_active":"2024-09-21T05:48:38.718567+0000","last_peered":"2024-09-21T05:48:38.718567+0000","last_clean":"2024-09-21T05:48:38.718567+0000","last_became_active":"2024-09-21T05:47:05.641025+0000","last_became_peered":"2024-09-21T05:47:05.641025+0000","last_unstale":"2024-09-21T05:48:38.718567+0000","last_undegraded":"2024-09-21T05:48:38.718567+0000","last_fullsized":"2024-09-21T05:48:38.718567+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:01.654621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":73025,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":555,"num_read_kb":357,"num_write":247,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":756,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":219075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":248927,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743457,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":958464,"data_stored":489762,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939686,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1105920,"data_stored":1147143,"data_compressed":65650,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103211,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":970752,"data_stored":489558,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299440,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":954368,"data_stored":489802,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495669,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1019904,"data_stored":1086433,"data_compressed":65650,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659194,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":946176,"data_stored":485062,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855424,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1028096,"data_stored":1081624,"data_compressed":65650,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051653,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":954368,"data_stored":489527,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247881,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":958464,"data_stored":484770,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1032192,"data_stored":551902,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607635,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1028096,"data_stored":552926,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":970752,"data_stored":486518,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34637,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34637,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34637,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36254,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36254,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36254,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36254,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":68586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":67562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":68339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T05:48:48.023 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T05:48:48.023 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T05:48:48.023 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T05:48:48.023 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph health --format=json 2024-09-21T05:48:48.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:47 smithi116 ceph-mon[34332]: from='client.15207 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:48:48.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:47 smithi160 ceph-mon[33979]: from='client.15207 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:48:48.267 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:48.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.789+0000 7f9e1e88b640 1 -- 172.21.15.70:0/1822710277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e181083a0 msgr2=0x7f9e181087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:48.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.789+0000 7f9e1e88b640 1 --2- 172.21.15.70:0/1822710277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e181083a0 0x7f9e181087b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c009900 tx=0x7f9e0c02a410 comp rx=0 tx=0).stop 2024-09-21T05:48:48.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.789+0000 7f9e1e88b640 1 -- 172.21.15.70:0/1822710277 shutdown_connections 2024-09-21T05:48:48.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.789+0000 7f9e1e88b640 1 --2- 172.21.15.70:0/1822710277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e18108cf0 0x7f9e1810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:48.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.789+0000 7f9e1e88b640 1 --2- 172.21.15.70:0/1822710277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e181083a0 0x7f9e181087b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:48.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.789+0000 7f9e1e88b640 1 --2- 172.21.15.70:0/1822710277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e18102a60 0x7f9e18102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:48.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.789+0000 7f9e1e88b640 1 -- 172.21.15.70:0/1822710277 >> 172.21.15.70:0/1822710277 conn(0x7f9e18079730 msgr2=0x7f9e18079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:48.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.789+0000 7f9e1e88b640 1 -- 172.21.15.70:0/1822710277 shutdown_connections 2024-09-21T05:48:48.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.789+0000 7f9e1e88b640 1 -- 172.21.15.70:0/1822710277 wait complete. 2024-09-21T05:48:48.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.790+0000 7f9e1e88b640 1 Processor -- start 2024-09-21T05:48:48.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.790+0000 7f9e1e88b640 1 -- start start 2024-09-21T05:48:48.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.790+0000 7f9e1e88b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e18102a60 0x7f9e1819b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:48.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.790+0000 7f9e1e88b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e181083a0 0x7f9e1819b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:48.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.790+0000 7f9e1e88b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e18108cf0 0x7f9e1819bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:48.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.790+0000 7f9e1e88b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9e18112930 con 0x7f9e18102a60 2024-09-21T05:48:48.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.790+0000 7f9e1e88b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9e181127b0 con 0x7f9e181083a0 2024-09-21T05:48:48.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.790+0000 7f9e1e88b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9e18112ab0 con 0x7f9e18108cf0 2024-09-21T05:48:48.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.790+0000 7f9e17fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e18102a60 0x7f9e1819b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:48.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.790+0000 7f9e17fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e18102a60 0x7f9e1819b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48006/0 (socket says 172.21.15.70:48006) 2024-09-21T05:48:48.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.790+0000 7f9e17fff640 1 -- 172.21.15.70:0/1309047228 learned_addr learned my addr 172.21.15.70:0/1309047228 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:48.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.790+0000 7f9e177fe640 1 --2- 172.21.15.70:0/1309047228 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e181083a0 0x7f9e1819b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:48.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.791+0000 7f9e1ce28640 1 --2- 172.21.15.70:0/1309047228 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e18108cf0 0x7f9e1819bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:48.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.791+0000 7f9e17fff640 1 -- 172.21.15.70:0/1309047228 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e18108cf0 msgr2=0x7f9e1819bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:48.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.791+0000 7f9e17fff640 1 --2- 172.21.15.70:0/1309047228 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e18108cf0 0x7f9e1819bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:48.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.791+0000 7f9e17fff640 1 -- 172.21.15.70:0/1309047228 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e181083a0 msgr2=0x7f9e1819b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:48.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.791+0000 7f9e17fff640 1 --2- 172.21.15.70:0/1309047228 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e181083a0 0x7f9e1819b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:48.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.791+0000 7f9e17fff640 1 -- 172.21.15.70:0/1309047228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e181a6540 con 0x7f9e18102a60 2024-09-21T05:48:48.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.791+0000 7f9e17fff640 1 --2- 172.21.15.70:0/1309047228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e18102a60 0x7f9e1819b280 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9e0800d950 tx=0x7f9e0800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:48.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.791+0000 7f9e157fa640 1 -- 172.21.15.70:0/1309047228 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e08017030 con 0x7f9e18102a60 2024-09-21T05:48:48.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.791+0000 7f9e157fa640 1 -- 172.21.15.70:0/1309047228 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f9e08004020 con 0x7f9e18102a60 2024-09-21T05:48:48.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.791+0000 7f9e157fa640 1 -- 172.21.15.70:0/1309047228 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e080047a0 con 0x7f9e18102a60 2024-09-21T05:48:48.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.791+0000 7f9e1e88b640 1 -- 172.21.15.70:0/1309047228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e181a6830 con 0x7f9e18102a60 2024-09-21T05:48:48.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.791+0000 7f9e1e88b640 1 -- 172.21.15.70:0/1309047228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e181a6d40 con 0x7f9e18102a60 2024-09-21T05:48:48.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.792+0000 7f9e1e88b640 1 -- 172.21.15.70:0/1309047228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e18102e70 con 0x7f9e18102a60 2024-09-21T05:48:48.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.794+0000 7f9e157fa640 1 -- 172.21.15.70:0/1309047228 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f9e080041d0 con 0x7f9e18102a60 2024-09-21T05:48:48.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.795+0000 7f9e157fa640 1 --2- 172.21.15.70:0/1309047228 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f9e000b65a0 0x7f9e000b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:48.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.795+0000 7f9e177fe640 1 --2- 172.21.15.70:0/1309047228 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f9e000b65a0 0x7f9e000b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:48.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.795+0000 7f9e157fa640 1 -- 172.21.15.70:0/1309047228 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f9e080e7890 con 0x7f9e18102a60 2024-09-21T05:48:48.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.795+0000 7f9e177fe640 1 --2- 172.21.15.70:0/1309047228 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f9e000b65a0 0x7f9e000b8ab0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c000c00 tx=0x7f9e0c005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:48.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:48.798+0000 7f9e157fa640 1 -- 172.21.15.70:0/1309047228 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9e080adbd0 con 0x7f9e18102a60 2024-09-21T05:48:48.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:48 smithi070 ceph-mon[30981]: pgmap v350: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s; 77 B/s, 1 objects/s recovering 2024-09-21T05:48:49.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:49.015+0000 7f9e1e88b640 1 -- 172.21.15.70:0/1309047228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9e1806b290 con 0x7f9e18102a60 2024-09-21T05:48:49.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:49.015+0000 7f9e157fa640 1 -- 172.21.15.70:0/1309047228 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f9e080b1fb0 con 0x7f9e18102a60 2024-09-21T05:48:49.017 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:48:49.017 INFO:teuthology.orchestra.run.smithi070.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T05:48:49.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:49.017+0000 7f9e1e88b640 1 -- 172.21.15.70:0/1309047228 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f9e000b65a0 msgr2=0x7f9e000b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:49.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:49.017+0000 7f9e1e88b640 1 --2- 172.21.15.70:0/1309047228 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f9e000b65a0 0x7f9e000b8ab0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c000c00 tx=0x7f9e0c005d50 comp rx=0 tx=0).stop 2024-09-21T05:48:49.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:49.017+0000 7f9e1e88b640 1 -- 172.21.15.70:0/1309047228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e18102a60 msgr2=0x7f9e1819b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:49.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:49.017+0000 7f9e1e88b640 1 --2- 172.21.15.70:0/1309047228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e18102a60 0x7f9e1819b280 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9e0800d950 tx=0x7f9e0800de10 comp rx=0 tx=0).stop 2024-09-21T05:48:49.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:49.017+0000 7f9e1e88b640 1 -- 172.21.15.70:0/1309047228 shutdown_connections 2024-09-21T05:48:49.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:49.017+0000 7f9e1e88b640 1 --2- 172.21.15.70:0/1309047228 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f9e000b65a0 0x7f9e000b8ab0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:49.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:49.017+0000 7f9e1e88b640 1 --2- 172.21.15.70:0/1309047228 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e18108cf0 0x7f9e1819bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:49.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:49.017+0000 7f9e1e88b640 1 --2- 172.21.15.70:0/1309047228 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e181083a0 0x7f9e1819b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:49.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:49.017+0000 7f9e1e88b640 1 --2- 172.21.15.70:0/1309047228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e18102a60 0x7f9e1819b280 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:49.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:49.017+0000 7f9e1e88b640 1 -- 172.21.15.70:0/1309047228 >> 172.21.15.70:0/1309047228 conn(0x7f9e18079730 msgr2=0x7f9e181044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:49.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:49.017+0000 7f9e1e88b640 1 -- 172.21.15.70:0/1309047228 shutdown_connections 2024-09-21T05:48:49.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:49.017+0000 7f9e1e88b640 1 -- 172.21.15.70:0/1309047228 wait complete. 2024-09-21T05:48:49.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:48 smithi116 ceph-mon[34332]: pgmap v350: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s; 77 B/s, 1 objects/s recovering 2024-09-21T05:48:49.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:48 smithi160 ceph-mon[33979]: pgmap v350: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s; 77 B/s, 1 objects/s recovering 2024-09-21T05:48:49.718 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T05:48:49.719 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:48:49.979 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:49.994 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:49 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1309047228' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T05:48:50.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:49 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1309047228' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T05:48:50.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:49 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1309047228' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T05:48:50.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.540+0000 7f810e769640 1 -- 172.21.15.70:0/1223932568 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8108108d20 msgr2=0x7f810810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:50.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.540+0000 7f810e769640 1 --2- 172.21.15.70:0/1223932568 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8108108d20 0x7f810810f550 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8100009ca0 tx=0x7f810002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:48:50.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.540+0000 7f810e769640 1 -- 172.21.15.70:0/1223932568 shutdown_connections 2024-09-21T05:48:50.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.540+0000 7f810e769640 1 --2- 172.21.15.70:0/1223932568 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81081083d0 0x7f81081087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:50.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.540+0000 7f810e769640 1 --2- 172.21.15.70:0/1223932568 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8108108d20 0x7f810810f550 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:50.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.540+0000 7f810e769640 1 --2- 172.21.15.70:0/1223932568 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8108102a90 0x7f8108102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:50.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.540+0000 7f810e769640 1 -- 172.21.15.70:0/1223932568 >> 172.21.15.70:0/1223932568 conn(0x7f8108079750 msgr2=0x7f8108079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:50.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.540+0000 7f810e769640 1 -- 172.21.15.70:0/1223932568 shutdown_connections 2024-09-21T05:48:50.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.540+0000 7f810e769640 1 -- 172.21.15.70:0/1223932568 wait complete. 2024-09-21T05:48:50.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.541+0000 7f810e769640 1 Processor -- start 2024-09-21T05:48:50.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.541+0000 7f810e769640 1 -- start start 2024-09-21T05:48:50.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.541+0000 7f810e769640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8108102a90 0x7f810819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:50.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.541+0000 7f810e769640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f81081083d0 0x7f810819aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:50.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.541+0000 7f810e769640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8108108d20 0x7f810819fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:50.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.541+0000 7f810e769640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8108112980 con 0x7f8108102a90 2024-09-21T05:48:50.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.541+0000 7f810e769640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8108112800 con 0x7f81081083d0 2024-09-21T05:48:50.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.541+0000 7f810e769640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8108112b00 con 0x7f8108108d20 2024-09-21T05:48:50.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.541+0000 7f8107fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8108102a90 0x7f810819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:50.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.541+0000 7f8107fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8108102a90 0x7f810819a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55776/0 (socket says 172.21.15.70:55776) 2024-09-21T05:48:50.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.541+0000 7f8107fff640 1 -- 172.21.15.70:0/4031736849 learned_addr learned my addr 172.21.15.70:0/4031736849 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:50.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.541+0000 7f81077fe640 1 --2- 172.21.15.70:0/4031736849 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f81081083d0 0x7f810819aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:50.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.542+0000 7f810cd06640 1 --2- 172.21.15.70:0/4031736849 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8108108d20 0x7f810819fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:50.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.542+0000 7f8107fff640 1 -- 172.21.15.70:0/4031736849 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8108108d20 msgr2=0x7f810819fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:50.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.542+0000 7f8107fff640 1 --2- 172.21.15.70:0/4031736849 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8108108d20 0x7f810819fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:50.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.542+0000 7f8107fff640 1 -- 172.21.15.70:0/4031736849 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f81081083d0 msgr2=0x7f810819aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:50.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.542+0000 7f8107fff640 1 --2- 172.21.15.70:0/4031736849 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f81081083d0 0x7f810819aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:50.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.542+0000 7f8107fff640 1 -- 172.21.15.70:0/4031736849 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81081a0340 con 0x7f8108102a90 2024-09-21T05:48:50.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.542+0000 7f81077fe640 1 --2- 172.21.15.70:0/4031736849 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f81081083d0 0x7f810819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:48:50.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.542+0000 7f8107fff640 1 --2- 172.21.15.70:0/4031736849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8108102a90 0x7f810819a490 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f80f800c920 tx=0x7f80f800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:50.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.542+0000 7f81057fa640 1 -- 172.21.15.70:0/4031736849 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f8007c70 con 0x7f8108102a90 2024-09-21T05:48:50.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.542+0000 7f810e769640 1 -- 172.21.15.70:0/4031736849 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81081a0630 con 0x7f8108102a90 2024-09-21T05:48:50.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.542+0000 7f81057fa640 1 -- 172.21.15.70:0/4031736849 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f80f8007e10 con 0x7f8108102a90 2024-09-21T05:48:50.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.542+0000 7f81057fa640 1 -- 172.21.15.70:0/4031736849 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f8018760 con 0x7f8108102a90 2024-09-21T05:48:50.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.542+0000 7f810e769640 1 -- 172.21.15.70:0/4031736849 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81081a6e50 con 0x7f8108102a90 2024-09-21T05:48:50.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.543+0000 7f810e769640 1 -- 172.21.15.70:0/4031736849 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8108103d10 con 0x7f8108102a90 2024-09-21T05:48:50.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.545+0000 7f81057fa640 1 -- 172.21.15.70:0/4031736849 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f80f800f450 con 0x7f8108102a90 2024-09-21T05:48:50.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.545+0000 7f81057fa640 1 --2- 172.21.15.70:0/4031736849 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f80f00b65d0 0x7f80f00b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:50.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.545+0000 7f81077fe640 1 --2- 172.21.15.70:0/4031736849 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f80f00b65d0 0x7f80f00b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:50.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.545+0000 7f81057fa640 1 -- 172.21.15.70:0/4031736849 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f80f80e7d10 con 0x7f8108102a90 2024-09-21T05:48:50.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.546+0000 7f81077fe640 1 --2- 172.21.15.70:0/4031736849 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f80f00b65d0 0x7f80f00b8ae0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f80fc005d70 tx=0x7f80fc005d00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:50.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.548+0000 7f81057fa640 1 -- 172.21.15.70:0/4031736849 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f80f8014030 con 0x7f8108102a90 2024-09-21T05:48:50.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.766+0000 7f810e769640 1 -- 172.21.15.70:0/4031736849 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8108102ea0 con 0x7f8108102a90 2024-09-21T05:48:50.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.767+0000 7f81057fa640 1 -- 172.21.15.70:0/4031736849 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11986 (secure 0 0 0) 0x7f8108102ea0 con 0x7f8108102a90 2024-09-21T05:48:50.769 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:48:50.769 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":27,"btime":"2024-09-21T05:47:50:538503+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3519318330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3519318330},{"type":"v1","addr":"172.21.15.70:6835","nonce":3519318330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2706663460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2706663460},{"type":"v1","addr":"172.21.15.70:6837","nonce":2706663460}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:47:06.246985+0000","modified":"2024-09-21T05:47:50.538486+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24628,"mds_2":24611,"mds_3":24610,"mds_4":24598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/1914209867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1914209867},{"type":"v1","addr":"172.21.15.70:6839","nonce":1914209867}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3392175775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3392175775},{"type":"v1","addr":"172.21.15.70:6841","nonce":3392175775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/3543945704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3543945704},{"type":"v1","addr":"172.21.15.160:6833","nonce":3543945704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6833/283778129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":283778129},{"type":"v1","addr":"172.21.15.116:6833","nonce":283778129}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/3787256790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3787256790},{"type":"v1","addr":"172.21.15.116:6835","nonce":3787256790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.160:6835/2001692372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2001692372},{"type":"v1","addr":"172.21.15.160:6835","nonce":2001692372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.160:6837/2558120045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2558120045},{"type":"v1","addr":"172.21.15.160:6837","nonce":2558120045}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24611":{"gid":24611,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/444312934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":444312934},{"type":"v1","addr":"172.21.15.116:6837","nonce":444312934}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.160:6839/1339744282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1339744282},{"type":"v1","addr":"172.21.15.160:6839","nonce":1339744282}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/3952175670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3952175670},{"type":"v1","addr":"172.21.15.116:6839","nonce":3952175670}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24641,"qdb_cluster":[24641,24628,24610,24611,24598]},"id":1}]} 2024-09-21T05:48:50.770 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 27 2024-09-21T05:48:50.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.769+0000 7f810e769640 1 -- 172.21.15.70:0/4031736849 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f80f00b65d0 msgr2=0x7f80f00b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:50.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.769+0000 7f810e769640 1 --2- 172.21.15.70:0/4031736849 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f80f00b65d0 0x7f80f00b8ae0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f80fc005d70 tx=0x7f80fc005d00 comp rx=0 tx=0).stop 2024-09-21T05:48:50.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.769+0000 7f810e769640 1 -- 172.21.15.70:0/4031736849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8108102a90 msgr2=0x7f810819a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:50.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.769+0000 7f810e769640 1 --2- 172.21.15.70:0/4031736849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8108102a90 0x7f810819a490 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f80f800c920 tx=0x7f80f800cde0 comp rx=0 tx=0).stop 2024-09-21T05:48:50.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.769+0000 7f810e769640 1 -- 172.21.15.70:0/4031736849 shutdown_connections 2024-09-21T05:48:50.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.769+0000 7f810e769640 1 --2- 172.21.15.70:0/4031736849 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f80f00b65d0 0x7f80f00b8ae0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:50.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.769+0000 7f810e769640 1 --2- 172.21.15.70:0/4031736849 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8108108d20 0x7f810819fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:50.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.769+0000 7f810e769640 1 --2- 172.21.15.70:0/4031736849 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f81081083d0 0x7f810819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:50.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.769+0000 7f810e769640 1 --2- 172.21.15.70:0/4031736849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8108102a90 0x7f810819a490 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:50.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.769+0000 7f810e769640 1 -- 172.21.15.70:0/4031736849 >> 172.21.15.70:0/4031736849 conn(0x7f8108079750 msgr2=0x7f81081014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:50.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.769+0000 7f810e769640 1 -- 172.21.15.70:0/4031736849 shutdown_connections 2024-09-21T05:48:50.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:50.769+0000 7f810e769640 1 -- 172.21.15.70:0/4031736849 wait complete. 2024-09-21T05:48:51.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:50 smithi116 ceph-mon[34332]: pgmap v351: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s; 70 B/s, 1 objects/s recovering 2024-09-21T05:48:51.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:50 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/4031736849' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:48:51.138 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:50 smithi070 ceph-mon[30981]: pgmap v351: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s; 70 B/s, 1 objects/s recovering 2024-09-21T05:48:51.138 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:50 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/4031736849' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:48:51.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:50 smithi160 ceph-mon[33979]: pgmap v351: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s; 70 B/s, 1 objects/s recovering 2024-09-21T05:48:51.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:50 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/4031736849' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:48:51.603 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:48:51.850 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:52.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.374+0000 7fa56e885640 1 -- 172.21.15.70:0/2784631946 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa56810de30 msgr2=0x7fa568110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:52.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.374+0000 7fa56e885640 1 --2- 172.21.15.70:0/2784631946 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa56810de30 0x7fa568110300 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa560009ca0 tx=0x7fa56002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:48:52.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.374+0000 7fa56e885640 1 -- 172.21.15.70:0/2784631946 shutdown_connections 2024-09-21T05:48:52.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.374+0000 7fa56e885640 1 --2- 172.21.15.70:0/2784631946 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa56810de30 0x7fa568110300 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:52.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.374+0000 7fa56e885640 1 --2- 172.21.15.70:0/2784631946 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5681052b0 0x7fa56810d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:52.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.374+0000 7fa56e885640 1 --2- 172.21.15.70:0/2784631946 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa568104880 0x7fa568104c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:52.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.374+0000 7fa56e885640 1 -- 172.21.15.70:0/2784631946 >> 172.21.15.70:0/2784631946 conn(0x7fa568079730 msgr2=0x7fa568079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:52.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.374+0000 7fa56e885640 1 -- 172.21.15.70:0/2784631946 shutdown_connections 2024-09-21T05:48:52.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.374+0000 7fa56e885640 1 -- 172.21.15.70:0/2784631946 wait complete. 2024-09-21T05:48:52.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.375+0000 7fa56e885640 1 Processor -- start 2024-09-21T05:48:52.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.375+0000 7fa56e885640 1 -- start start 2024-09-21T05:48:52.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.375+0000 7fa56e885640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa568104880 0x7fa56819a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:52.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.375+0000 7fa56e885640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5681052b0 0x7fa56819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:52.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.375+0000 7fa56e885640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa56810de30 0x7fa56819fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:52.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.375+0000 7fa56e885640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa568113a40 con 0x7fa56810de30 2024-09-21T05:48:52.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.375+0000 7fa56e885640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa5681138c0 con 0x7fa568104880 2024-09-21T05:48:52.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.375+0000 7fa56e885640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa568113bc0 con 0x7fa5681052b0 2024-09-21T05:48:52.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.375+0000 7fa56ce22640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa56810de30 0x7fa56819fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:52.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.375+0000 7fa56ce22640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa56810de30 0x7fa56819fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55802/0 (socket says 172.21.15.70:55802) 2024-09-21T05:48:52.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.375+0000 7fa56ce22640 1 -- 172.21.15.70:0/3617755122 learned_addr learned my addr 172.21.15.70:0/3617755122 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:52.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.375+0000 7fa55ffff640 1 --2- 172.21.15.70:0/3617755122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5681052b0 0x7fa56819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:52.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.376+0000 7fa567fff640 1 --2- 172.21.15.70:0/3617755122 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa568104880 0x7fa56819a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:52.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.376+0000 7fa56ce22640 1 -- 172.21.15.70:0/3617755122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5681052b0 msgr2=0x7fa56819a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:52.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.376+0000 7fa56ce22640 1 --2- 172.21.15.70:0/3617755122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5681052b0 0x7fa56819a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:52.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.376+0000 7fa56ce22640 1 -- 172.21.15.70:0/3617755122 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa568104880 msgr2=0x7fa56819a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:52.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.376+0000 7fa56ce22640 1 --2- 172.21.15.70:0/3617755122 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa568104880 0x7fa56819a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:52.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.376+0000 7fa56ce22640 1 -- 172.21.15.70:0/3617755122 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5681a02c0 con 0x7fa56810de30 2024-09-21T05:48:52.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.376+0000 7fa56ce22640 1 --2- 172.21.15.70:0/3617755122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa56810de30 0x7fa56819fc50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa5600097b0 tx=0x7fa560032fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:52.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.376+0000 7fa565ffb640 1 -- 172.21.15.70:0/3617755122 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa560003cf0 con 0x7fa56810de30 2024-09-21T05:48:52.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.376+0000 7fa565ffb640 1 -- 172.21.15.70:0/3617755122 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fa5600044f0 con 0x7fa56810de30 2024-09-21T05:48:52.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.376+0000 7fa565ffb640 1 -- 172.21.15.70:0/3617755122 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa560030c30 con 0x7fa56810de30 2024-09-21T05:48:52.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.376+0000 7fa56e885640 1 -- 172.21.15.70:0/3617755122 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5681a0550 con 0x7fa56810de30 2024-09-21T05:48:52.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.376+0000 7fa56e885640 1 -- 172.21.15.70:0/3617755122 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5681a0a40 con 0x7fa56810de30 2024-09-21T05:48:52.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.377+0000 7fa56e885640 1 -- 172.21.15.70:0/3617755122 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa568104c90 con 0x7fa56810de30 2024-09-21T05:48:52.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.379+0000 7fa565ffb640 1 -- 172.21.15.70:0/3617755122 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fa5600046a0 con 0x7fa56810de30 2024-09-21T05:48:52.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.380+0000 7fa565ffb640 1 --2- 172.21.15.70:0/3617755122 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa5540b65d0 0x7fa5540b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:52.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.380+0000 7fa567fff640 1 --2- 172.21.15.70:0/3617755122 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa5540b65d0 0x7fa5540b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:52.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.380+0000 7fa565ffb640 1 -- 172.21.15.70:0/3617755122 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fa560108d90 con 0x7fa56810de30 2024-09-21T05:48:52.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.381+0000 7fa567fff640 1 --2- 172.21.15.70:0/3617755122 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa5540b65d0 0x7fa5540b8ae0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa5580058c0 tx=0x7fa558005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:52.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.383+0000 7fa565ffb640 1 -- 172.21.15.70:0/3617755122 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa5600cf0d0 con 0x7fa56810de30 2024-09-21T05:48:52.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.596+0000 7fa56e885640 1 -- 172.21.15.70:0/3617755122 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5681a6f90 con 0x7fa56810de30 2024-09-21T05:48:52.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.597+0000 7fa565ffb640 1 -- 172.21.15.70:0/3617755122 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11986 (secure 0 0 0) 0x7fa5600d34b0 con 0x7fa56810de30 2024-09-21T05:48:52.600 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:48:52.600 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":27,"btime":"2024-09-21T05:47:50:538503+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3519318330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3519318330},{"type":"v1","addr":"172.21.15.70:6835","nonce":3519318330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2706663460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2706663460},{"type":"v1","addr":"172.21.15.70:6837","nonce":2706663460}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:47:06.246985+0000","modified":"2024-09-21T05:47:50.538486+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24628,"mds_2":24611,"mds_3":24610,"mds_4":24598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/1914209867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1914209867},{"type":"v1","addr":"172.21.15.70:6839","nonce":1914209867}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3392175775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3392175775},{"type":"v1","addr":"172.21.15.70:6841","nonce":3392175775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/3543945704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3543945704},{"type":"v1","addr":"172.21.15.160:6833","nonce":3543945704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6833/283778129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":283778129},{"type":"v1","addr":"172.21.15.116:6833","nonce":283778129}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/3787256790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3787256790},{"type":"v1","addr":"172.21.15.116:6835","nonce":3787256790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.160:6835/2001692372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2001692372},{"type":"v1","addr":"172.21.15.160:6835","nonce":2001692372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.160:6837/2558120045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2558120045},{"type":"v1","addr":"172.21.15.160:6837","nonce":2558120045}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24611":{"gid":24611,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/444312934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":444312934},{"type":"v1","addr":"172.21.15.116:6837","nonce":444312934}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.160:6839/1339744282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1339744282},{"type":"v1","addr":"172.21.15.160:6839","nonce":1339744282}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/3952175670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3952175670},{"type":"v1","addr":"172.21.15.116:6839","nonce":3952175670}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24641,"qdb_cluster":[24641,24628,24610,24611,24598]},"id":1}]} 2024-09-21T05:48:52.600 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 27 2024-09-21T05:48:52.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.599+0000 7fa56e885640 1 -- 172.21.15.70:0/3617755122 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa5540b65d0 msgr2=0x7fa5540b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:52.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.599+0000 7fa56e885640 1 --2- 172.21.15.70:0/3617755122 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa5540b65d0 0x7fa5540b8ae0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa5580058c0 tx=0x7fa558005850 comp rx=0 tx=0).stop 2024-09-21T05:48:52.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.599+0000 7fa56e885640 1 -- 172.21.15.70:0/3617755122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa56810de30 msgr2=0x7fa56819fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:52.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.599+0000 7fa56e885640 1 --2- 172.21.15.70:0/3617755122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa56810de30 0x7fa56819fc50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa5600097b0 tx=0x7fa560032fe0 comp rx=0 tx=0).stop 2024-09-21T05:48:52.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.600+0000 7fa56e885640 1 -- 172.21.15.70:0/3617755122 shutdown_connections 2024-09-21T05:48:52.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.600+0000 7fa56e885640 1 --2- 172.21.15.70:0/3617755122 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa5540b65d0 0x7fa5540b8ae0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:52.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.600+0000 7fa56e885640 1 --2- 172.21.15.70:0/3617755122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5681052b0 0x7fa56819a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:52.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.600+0000 7fa56e885640 1 --2- 172.21.15.70:0/3617755122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa56810de30 0x7fa56819fc50 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:52.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.600+0000 7fa56e885640 1 --2- 172.21.15.70:0/3617755122 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa568104880 0x7fa56819a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:52.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.600+0000 7fa56e885640 1 -- 172.21.15.70:0/3617755122 >> 172.21.15.70:0/3617755122 conn(0x7fa568079730 msgr2=0x7fa568107960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:52.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.600+0000 7fa56e885640 1 -- 172.21.15.70:0/3617755122 shutdown_connections 2024-09-21T05:48:52.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:52.600+0000 7fa56e885640 1 -- 172.21.15.70:0/3617755122 wait complete. 2024-09-21T05:48:52.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:52 smithi070 ceph-mon[30981]: pgmap v352: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s; 11 B/s, 0 objects/s recovering 2024-09-21T05:48:52.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:52 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3617755122' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:48:53.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:52 smithi116 ceph-mon[34332]: pgmap v352: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s; 11 B/s, 0 objects/s recovering 2024-09-21T05:48:53.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:52 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3617755122' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:48:53.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:52 smithi160 ceph-mon[33979]: pgmap v352: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s; 11 B/s, 0 objects/s recovering 2024-09-21T05:48:53.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:52 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3617755122' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:48:53.518 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:48:53.765 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:54.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.253+0000 7f7470ada640 1 -- 172.21.15.70:0/2265398272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f746c103b60 msgr2=0x7f746c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:54.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.253+0000 7f7470ada640 1 --2- 172.21.15.70:0/2265398272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f746c103b60 0x7f746c103f70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f745c009900 tx=0x7f745c02a410 comp rx=0 tx=0).stop 2024-09-21T05:48:54.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.253+0000 7f7470ada640 1 -- 172.21.15.70:0/2265398272 shutdown_connections 2024-09-21T05:48:54.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.253+0000 7f7470ada640 1 --2- 172.21.15.70:0/2265398272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f746c1094a0 0x7f746c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:54.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.253+0000 7f7470ada640 1 --2- 172.21.15.70:0/2265398272 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f746c109df0 0x7f746c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:54.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.253+0000 7f7470ada640 1 --2- 172.21.15.70:0/2265398272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f746c103b60 0x7f746c103f70 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:54.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.253+0000 7f7470ada640 1 -- 172.21.15.70:0/2265398272 >> 172.21.15.70:0/2265398272 conn(0x7f746c07b850 msgr2=0x7f746c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:54.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.253+0000 7f7470ada640 1 -- 172.21.15.70:0/2265398272 shutdown_connections 2024-09-21T05:48:54.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.253+0000 7f7470ada640 1 -- 172.21.15.70:0/2265398272 wait complete. 2024-09-21T05:48:54.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.254+0000 7f7470ada640 1 Processor -- start 2024-09-21T05:48:54.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.254+0000 7f7470ada640 1 -- start start 2024-09-21T05:48:54.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.254+0000 7f7470ada640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f746c103b60 0x7f746c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:54.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.255+0000 7f7470ada640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f746c1094a0 0x7f746c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:54.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.255+0000 7f7470ada640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f746c109df0 0x7f746c076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:54.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.255+0000 7f7470ada640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f746c113b00 con 0x7f746c1094a0 2024-09-21T05:48:54.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.255+0000 7f7470ada640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f746c113980 con 0x7f746c109df0 2024-09-21T05:48:54.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.255+0000 7f7470ada640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f746c113c80 con 0x7f746c103b60 2024-09-21T05:48:54.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.255+0000 7f7461d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f746c1094a0 0x7f746c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:54.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.255+0000 7f7461d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f746c1094a0 0x7f746c075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55814/0 (socket says 172.21.15.70:55814) 2024-09-21T05:48:54.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.255+0000 7f7461d9b640 1 -- 172.21.15.70:0/1462435490 learned_addr learned my addr 172.21.15.70:0/1462435490 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:54.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.255+0000 7f746a59c640 1 --2- 172.21.15.70:0/1462435490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f746c103b60 0x7f746c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:54.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.255+0000 7f746ad9d640 1 --2- 172.21.15.70:0/1462435490 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f746c109df0 0x7f746c076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:54.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.255+0000 7f7461d9b640 1 -- 172.21.15.70:0/1462435490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f746c103b60 msgr2=0x7f746c075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:54.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.255+0000 7f7461d9b640 1 --2- 172.21.15.70:0/1462435490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f746c103b60 0x7f746c075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:54.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.255+0000 7f7461d9b640 1 -- 172.21.15.70:0/1462435490 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f746c109df0 msgr2=0x7f746c076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:54.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.255+0000 7f7461d9b640 1 --2- 172.21.15.70:0/1462435490 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f746c109df0 0x7f746c076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:54.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.255+0000 7f7461d9b640 1 -- 172.21.15.70:0/1462435490 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f746c1a8830 con 0x7f746c1094a0 2024-09-21T05:48:54.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.255+0000 7f746ad9d640 1 --2- 172.21.15.70:0/1462435490 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f746c109df0 0x7f746c076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:48:54.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.255+0000 7f7461d9b640 1 --2- 172.21.15.70:0/1462435490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f746c1094a0 0x7f746c075c50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f745400c970 tx=0x7f745400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:54.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.255+0000 7f7463fff640 1 -- 172.21.15.70:0/1462435490 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7454007bb0 con 0x7f746c1094a0 2024-09-21T05:48:54.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.255+0000 7f7470ada640 1 -- 172.21.15.70:0/1462435490 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f746c1a8b20 con 0x7f746c1094a0 2024-09-21T05:48:54.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.255+0000 7f7463fff640 1 -- 172.21.15.70:0/1462435490 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f7454007d50 con 0x7f746c1094a0 2024-09-21T05:48:54.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.255+0000 7f7463fff640 1 -- 172.21.15.70:0/1462435490 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7454004e50 con 0x7f746c1094a0 2024-09-21T05:48:54.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.255+0000 7f7470ada640 1 -- 172.21.15.70:0/1462435490 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f746c1a90b0 con 0x7f746c1094a0 2024-09-21T05:48:54.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.256+0000 7f7470ada640 1 -- 172.21.15.70:0/1462435490 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f746c103f70 con 0x7f746c1094a0 2024-09-21T05:48:54.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.258+0000 7f7463fff640 1 -- 172.21.15.70:0/1462435490 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f7454005000 con 0x7f746c1094a0 2024-09-21T05:48:54.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.259+0000 7f7463fff640 1 --2- 172.21.15.70:0/1462435490 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f74580b6740 0x7f74580b8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:54.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.259+0000 7f746a59c640 1 --2- 172.21.15.70:0/1462435490 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f74580b6740 0x7f74580b8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:54.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.259+0000 7f7463fff640 1 -- 172.21.15.70:0/1462435490 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f74540e79b0 con 0x7f746c1094a0 2024-09-21T05:48:54.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.259+0000 7f746a59c640 1 --2- 172.21.15.70:0/1462435490 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f74580b6740 0x7f74580b8c50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f745c000c00 tx=0x7f745c005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:54.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.262+0000 7f7463fff640 1 -- 172.21.15.70:0/1462435490 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7454014030 con 0x7f746c1094a0 2024-09-21T05:48:54.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.440+0000 7f7470ada640 1 -- 172.21.15.70:0/1462435490 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f746c076a10 con 0x7f746c1094a0 2024-09-21T05:48:54.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.441+0000 7f7463fff640 1 -- 172.21.15.70:0/1462435490 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24983 (secure 0 0 0) 0x7f746c076a10 con 0x7f746c1094a0 2024-09-21T05:48:54.444 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:48:54.444 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":85,"fsid":"96c6636e-77db-11ef-baf5-efdc52797490","created":"2024-09-21T05:38:42.297307+0000","modified":"2024-09-21T05:48:38.706309+0000","last_up_change":"2024-09-21T05:46:15.910344+0000","last_in_change":"2024-09-21T05:45:53.382766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:42:25.611590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:47:01.987981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:47:04.388107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T05:47:10.651871+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00be8b82-7cb1-443f-ad18-02916f734df7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6803","nonce":1667051447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6805","nonce":1667051447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6809","nonce":1667051447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6807","nonce":1667051447}]},"public_addr":"172.21.15.70:6803/1667051447","cluster_addr":"172.21.15.70:6805/1667051447","heartbeat_back_addr":"172.21.15.70:6809/1667051447","heartbeat_front_addr":"172.21.15.70:6807/1667051447","state":["exists","up"]},{"osd":1,"uuid":"28ca8c5c-5e81-4e64-ac0e-3c8c3c2d3930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6801","nonce":1037621846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6803","nonce":1037621846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6807","nonce":1037621846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6805","nonce":1037621846}]},"public_addr":"172.21.15.116:6801/1037621846","cluster_addr":"172.21.15.116:6803/1037621846","heartbeat_back_addr":"172.21.15.116:6807/1037621846","heartbeat_front_addr":"172.21.15.116:6805/1037621846","state":["exists","up"]},{"osd":2,"uuid":"e9b42bf2-a38b-4cf9-8774-4950de12d0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6801","nonce":69260815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6803","nonce":69260815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6807","nonce":69260815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6805","nonce":69260815}]},"public_addr":"172.21.15.160:6801/69260815","cluster_addr":"172.21.15.160:6803/69260815","heartbeat_back_addr":"172.21.15.160:6807/69260815","heartbeat_front_addr":"172.21.15.160:6805/69260815","state":["exists","up"]},{"osd":3,"uuid":"25d8e9a8-3c14-43d6-9bb1-b44cd377133f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6811","nonce":3849416072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6813","nonce":3849416072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6817","nonce":3849416072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6815","nonce":3849416072}]},"public_addr":"172.21.15.70:6811/3849416072","cluster_addr":"172.21.15.70:6813/3849416072","heartbeat_back_addr":"172.21.15.70:6817/3849416072","heartbeat_front_addr":"172.21.15.70:6815/3849416072","state":["exists","up"]},{"osd":4,"uuid":"bdb84cbd-d718-4f69-90d0-2e732e580df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6809","nonce":3444857438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6811","nonce":3444857438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6815","nonce":3444857438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6813","nonce":3444857438}]},"public_addr":"172.21.15.116:6809/3444857438","cluster_addr":"172.21.15.116:6811/3444857438","heartbeat_back_addr":"172.21.15.116:6815/3444857438","heartbeat_front_addr":"172.21.15.116:6813/3444857438","state":["exists","up"]},{"osd":5,"uuid":"a490eeba-549f-4caa-8cd5-4168a23dafa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6809","nonce":3063220427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6811","nonce":3063220427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6815","nonce":3063220427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6813","nonce":3063220427}]},"public_addr":"172.21.15.160:6809/3063220427","cluster_addr":"172.21.15.160:6811/3063220427","heartbeat_back_addr":"172.21.15.160:6815/3063220427","heartbeat_front_addr":"172.21.15.160:6813/3063220427","state":["exists","up"]},{"osd":6,"uuid":"1bf22f48-c02f-4f09-b0fe-2597a55fd795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6819","nonce":3650315688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6821","nonce":3650315688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6825","nonce":3650315688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6823","nonce":3650315688}]},"public_addr":"172.21.15.70:6819/3650315688","cluster_addr":"172.21.15.70:6821/3650315688","heartbeat_back_addr":"172.21.15.70:6825/3650315688","heartbeat_front_addr":"172.21.15.70:6823/3650315688","state":["exists","up"]},{"osd":7,"uuid":"40d59744-4860-4a92-aa21-3f33e575e5b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6817","nonce":2034132009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6819","nonce":2034132009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6823","nonce":2034132009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6821","nonce":2034132009}]},"public_addr":"172.21.15.116:6817/2034132009","cluster_addr":"172.21.15.116:6819/2034132009","heartbeat_back_addr":"172.21.15.116:6823/2034132009","heartbeat_front_addr":"172.21.15.116:6821/2034132009","state":["exists","up"]},{"osd":8,"uuid":"65dc02e7-0dcd-4fa7-955a-4d5c00fbe4cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6817","nonce":3381625184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6819","nonce":3381625184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6823","nonce":3381625184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6821","nonce":3381625184}]},"public_addr":"172.21.15.160:6817/3381625184","cluster_addr":"172.21.15.160:6819/3381625184","heartbeat_back_addr":"172.21.15.160:6823/3381625184","heartbeat_front_addr":"172.21.15.160:6821/3381625184","state":["exists","up"]},{"osd":9,"uuid":"d8438a9c-012f-4082-be3f-9653cdfaac78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6827","nonce":3555256209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6829","nonce":3555256209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6833","nonce":3555256209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6831","nonce":3555256209}]},"public_addr":"172.21.15.70:6827/3555256209","cluster_addr":"172.21.15.70:6829/3555256209","heartbeat_back_addr":"172.21.15.70:6833/3555256209","heartbeat_front_addr":"172.21.15.70:6831/3555256209","state":["exists","up"]},{"osd":10,"uuid":"871619b0-181e-4020-9511-2cec296bfe70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6825","nonce":541280433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6827","nonce":541280433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6831","nonce":541280433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6829","nonce":541280433}]},"public_addr":"172.21.15.116:6825/541280433","cluster_addr":"172.21.15.116:6827/541280433","heartbeat_back_addr":"172.21.15.116:6831/541280433","heartbeat_front_addr":"172.21.15.116:6829/541280433","state":["exists","up"]},{"osd":11,"uuid":"302da945-7929-4b0c-a20b-099175752c41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6825","nonce":2632369083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6827","nonce":2632369083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6831","nonce":2632369083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6829","nonce":2632369083}]},"public_addr":"172.21.15.160:6825/2632369083","cluster_addr":"172.21.15.160:6827/2632369083","heartbeat_back_addr":"172.21.15.160:6831/2632369083","heartbeat_front_addr":"172.21.15.160:6829/2632369083","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:41:34.446744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:41:59.336955+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:42:23.958219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:42:49.396007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:43:15.325344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:43:41.923141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:07.873970+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:33.897951+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:58.397680+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:24.568406+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:49.504565+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:14.698577+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.e","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6800/605055695":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/897886925":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/1968357524":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/693721445":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/2810307308":"2024-09-22T05:39:12.492271+0000","172.21.15.70:6801/605055695":"2024-09-22T05:39:37.296630+0000","172.21.15.70:6801/1668927582":"2024-09-22T05:39:12.492271+0000","172.21.15.70:6800/1668927582":"2024-09-22T05:39:12.492271+0000","172.21.15.70:0/1979536420":"2024-09-22T05:39:12.492271+0000","172.21.15.70:0/2674019604":"2024-09-22T05:39:12.492271+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:48:54.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.443+0000 7f7470ada640 1 -- 172.21.15.70:0/1462435490 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f74580b6740 msgr2=0x7f74580b8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:54.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.443+0000 7f7470ada640 1 --2- 172.21.15.70:0/1462435490 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f74580b6740 0x7f74580b8c50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f745c000c00 tx=0x7f745c005d50 comp rx=0 tx=0).stop 2024-09-21T05:48:54.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.443+0000 7f7470ada640 1 -- 172.21.15.70:0/1462435490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f746c1094a0 msgr2=0x7f746c075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:54.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.443+0000 7f7470ada640 1 --2- 172.21.15.70:0/1462435490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f746c1094a0 0x7f746c075c50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f745400c970 tx=0x7f745400ce30 comp rx=0 tx=0).stop 2024-09-21T05:48:54.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.444+0000 7f7470ada640 1 -- 172.21.15.70:0/1462435490 shutdown_connections 2024-09-21T05:48:54.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.444+0000 7f7470ada640 1 --2- 172.21.15.70:0/1462435490 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f74580b6740 0x7f74580b8c50 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:54.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.444+0000 7f7470ada640 1 --2- 172.21.15.70:0/1462435490 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f746c109df0 0x7f746c076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:54.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.444+0000 7f7470ada640 1 --2- 172.21.15.70:0/1462435490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f746c1094a0 0x7f746c075c50 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:54.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.444+0000 7f7470ada640 1 --2- 172.21.15.70:0/1462435490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f746c103b60 0x7f746c075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:54.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.444+0000 7f7470ada640 1 -- 172.21.15.70:0/1462435490 >> 172.21.15.70:0/1462435490 conn(0x7f746c07b850 msgr2=0x7f746c1075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:54.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.444+0000 7f7470ada640 1 -- 172.21.15.70:0/1462435490 shutdown_connections 2024-09-21T05:48:54.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:54.444+0000 7f7470ada640 1 -- 172.21.15.70:0/1462435490 wait complete. 2024-09-21T05:48:55.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:54 smithi116 ceph-mon[34332]: pgmap v353: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s; 11 B/s, 0 objects/s recovering 2024-09-21T05:48:55.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:54 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1462435490' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:48:55.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:54 smithi160 ceph-mon[33979]: pgmap v353: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s; 11 B/s, 0 objects/s recovering 2024-09-21T05:48:55.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:54 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1462435490' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:48:55.239 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:54 smithi070 ceph-mon[30981]: pgmap v353: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s; 11 B/s, 0 objects/s recovering 2024-09-21T05:48:55.239 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:54 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1462435490' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:48:55.273 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:48:55.525 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:56.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.055+0000 7f025b2be640 1 -- 172.21.15.70:0/2364314605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0254103b60 msgr2=0x7f0254103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:56.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.055+0000 7f025b2be640 1 --2- 172.21.15.70:0/2364314605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0254103b60 0x7f0254103f70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0244009900 tx=0x7f024402a410 comp rx=0 tx=0).stop 2024-09-21T05:48:56.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.055+0000 7f025b2be640 1 -- 172.21.15.70:0/2364314605 shutdown_connections 2024-09-21T05:48:56.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.055+0000 7f025b2be640 1 --2- 172.21.15.70:0/2364314605 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0254109df0 0x7f0254110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:56.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.055+0000 7f025b2be640 1 --2- 172.21.15.70:0/2364314605 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02541094a0 0x7f02541098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:56.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.055+0000 7f025b2be640 1 --2- 172.21.15.70:0/2364314605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0254103b60 0x7f0254103f70 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:56.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.055+0000 7f025b2be640 1 -- 172.21.15.70:0/2364314605 >> 172.21.15.70:0/2364314605 conn(0x7f025407b850 msgr2=0x7f025407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:56.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.055+0000 7f025b2be640 1 -- 172.21.15.70:0/2364314605 shutdown_connections 2024-09-21T05:48:56.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.055+0000 7f025b2be640 1 -- 172.21.15.70:0/2364314605 wait complete. 2024-09-21T05:48:56.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.055+0000 7f025b2be640 1 Processor -- start 2024-09-21T05:48:56.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.055+0000 7f025b2be640 1 -- start start 2024-09-21T05:48:56.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.056+0000 7f025b2be640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0254103b60 0x7f0254075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:56.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.056+0000 7f025b2be640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02541094a0 0x7f0254075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:56.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.056+0000 7f025b2be640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0254109df0 0x7f0254076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:56.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.056+0000 7f025b2be640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0254113a80 con 0x7f0254103b60 2024-09-21T05:48:56.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.056+0000 7f025b2be640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0254113900 con 0x7f0254109df0 2024-09-21T05:48:56.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.056+0000 7f025b2be640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0254113c00 con 0x7f02541094a0 2024-09-21T05:48:56.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.056+0000 7f025905a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0254103b60 0x7f0254075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:56.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.056+0000 7f025905a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0254103b60 0x7f0254075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55832/0 (socket says 172.21.15.70:55832) 2024-09-21T05:48:56.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.056+0000 7f025905a640 1 -- 172.21.15.70:0/1319911644 learned_addr learned my addr 172.21.15.70:0/1319911644 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:56.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.056+0000 7f025985b640 1 --2- 172.21.15.70:0/1319911644 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0254109df0 0x7f0254076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:56.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.056+0000 7f0258859640 1 --2- 172.21.15.70:0/1319911644 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02541094a0 0x7f0254075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:56.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.056+0000 7f025905a640 1 -- 172.21.15.70:0/1319911644 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02541094a0 msgr2=0x7f0254075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:56.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.056+0000 7f025905a640 1 --2- 172.21.15.70:0/1319911644 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02541094a0 0x7f0254075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:56.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.056+0000 7f025905a640 1 -- 172.21.15.70:0/1319911644 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0254109df0 msgr2=0x7f0254076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:56.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.056+0000 7f025905a640 1 --2- 172.21.15.70:0/1319911644 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0254109df0 0x7f0254076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:56.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.056+0000 7f025905a640 1 -- 172.21.15.70:0/1319911644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02541a86c0 con 0x7f0254103b60 2024-09-21T05:48:56.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.056+0000 7f0258859640 1 --2- 172.21.15.70:0/1319911644 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02541094a0 0x7f0254075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:48:56.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.056+0000 7f025985b640 1 --2- 172.21.15.70:0/1319911644 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0254109df0 0x7f0254076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:48:56.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.056+0000 7f025905a640 1 --2- 172.21.15.70:0/1319911644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0254103b60 0x7f0254075710 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0244005940 tx=0x7f02440042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:56.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.056+0000 7f02527fc640 1 -- 172.21.15.70:0/1319911644 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024403f030 con 0x7f0254103b60 2024-09-21T05:48:56.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.056+0000 7f025b2be640 1 -- 172.21.15.70:0/1319911644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02541a8950 con 0x7f0254103b60 2024-09-21T05:48:56.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.056+0000 7f02527fc640 1 -- 172.21.15.70:0/1319911644 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f0244003cb0 con 0x7f0254103b60 2024-09-21T05:48:56.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.056+0000 7f02527fc640 1 -- 172.21.15.70:0/1319911644 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244035070 con 0x7f0254103b60 2024-09-21T05:48:56.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.057+0000 7f025b2be640 1 -- 172.21.15.70:0/1319911644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02541a8e30 con 0x7f0254103b60 2024-09-21T05:48:56.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.057+0000 7f025b2be640 1 -- 172.21.15.70:0/1319911644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0254103f70 con 0x7f0254103b60 2024-09-21T05:48:56.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.060+0000 7f02527fc640 1 -- 172.21.15.70:0/1319911644 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f0244042030 con 0x7f0254103b60 2024-09-21T05:48:56.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.061+0000 7f02527fc640 1 --2- 172.21.15.70:0/1319911644 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f023c0b65a0 0x7f023c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:56.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.061+0000 7f0258859640 1 --2- 172.21.15.70:0/1319911644 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f023c0b65a0 0x7f023c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:56.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.061+0000 7f02527fc640 1 -- 172.21.15.70:0/1319911644 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f0244108520 con 0x7f0254103b60 2024-09-21T05:48:56.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.061+0000 7f0258859640 1 --2- 172.21.15.70:0/1319911644 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f023c0b65a0 0x7f023c0b8ab0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f02541064c0 tx=0x7f0248005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:56.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.064+0000 7f02527fc640 1 -- 172.21.15.70:0/1319911644 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f02440ce860 con 0x7f0254103b60 2024-09-21T05:48:56.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.277+0000 7f025b2be640 1 -- 172.21.15.70:0/1319911644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f025402e640 con 0x7f0254103b60 2024-09-21T05:48:56.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.277+0000 7f02527fc640 1 -- 172.21.15.70:0/1319911644 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11986 (secure 0 0 0) 0x7f02440d2c40 con 0x7f0254103b60 2024-09-21T05:48:56.280 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:48:56.280 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":27,"btime":"2024-09-21T05:47:50:538503+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3519318330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3519318330},{"type":"v1","addr":"172.21.15.70:6835","nonce":3519318330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2706663460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2706663460},{"type":"v1","addr":"172.21.15.70:6837","nonce":2706663460}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:47:06.246985+0000","modified":"2024-09-21T05:47:50.538486+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24628,"mds_2":24611,"mds_3":24610,"mds_4":24598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/1914209867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1914209867},{"type":"v1","addr":"172.21.15.70:6839","nonce":1914209867}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3392175775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3392175775},{"type":"v1","addr":"172.21.15.70:6841","nonce":3392175775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/3543945704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3543945704},{"type":"v1","addr":"172.21.15.160:6833","nonce":3543945704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6833/283778129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":283778129},{"type":"v1","addr":"172.21.15.116:6833","nonce":283778129}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/3787256790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3787256790},{"type":"v1","addr":"172.21.15.116:6835","nonce":3787256790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.160:6835/2001692372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2001692372},{"type":"v1","addr":"172.21.15.160:6835","nonce":2001692372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.160:6837/2558120045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2558120045},{"type":"v1","addr":"172.21.15.160:6837","nonce":2558120045}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24611":{"gid":24611,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/444312934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":444312934},{"type":"v1","addr":"172.21.15.116:6837","nonce":444312934}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.160:6839/1339744282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1339744282},{"type":"v1","addr":"172.21.15.160:6839","nonce":1339744282}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/3952175670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3952175670},{"type":"v1","addr":"172.21.15.116:6839","nonce":3952175670}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24641,"qdb_cluster":[24641,24628,24610,24611,24598]},"id":1}]} 2024-09-21T05:48:56.280 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 27 2024-09-21T05:48:56.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.280+0000 7f025b2be640 1 -- 172.21.15.70:0/1319911644 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f023c0b65a0 msgr2=0x7f023c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:56.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.280+0000 7f025b2be640 1 --2- 172.21.15.70:0/1319911644 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f023c0b65a0 0x7f023c0b8ab0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f02541064c0 tx=0x7f0248005e50 comp rx=0 tx=0).stop 2024-09-21T05:48:56.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.280+0000 7f025b2be640 1 -- 172.21.15.70:0/1319911644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0254103b60 msgr2=0x7f0254075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:56.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.280+0000 7f025b2be640 1 --2- 172.21.15.70:0/1319911644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0254103b60 0x7f0254075710 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0244005940 tx=0x7f02440042f0 comp rx=0 tx=0).stop 2024-09-21T05:48:56.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.280+0000 7f025b2be640 1 -- 172.21.15.70:0/1319911644 shutdown_connections 2024-09-21T05:48:56.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.280+0000 7f025b2be640 1 --2- 172.21.15.70:0/1319911644 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f023c0b65a0 0x7f023c0b8ab0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:56.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.280+0000 7f025b2be640 1 --2- 172.21.15.70:0/1319911644 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02541094a0 0x7f0254075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:56.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.280+0000 7f025b2be640 1 --2- 172.21.15.70:0/1319911644 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0254109df0 0x7f0254076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:56.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.280+0000 7f025b2be640 1 --2- 172.21.15.70:0/1319911644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0254103b60 0x7f0254075710 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:56.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.280+0000 7f025b2be640 1 -- 172.21.15.70:0/1319911644 >> 172.21.15.70:0/1319911644 conn(0x7f025407b850 msgr2=0x7f0254107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:56.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.280+0000 7f025b2be640 1 -- 172.21.15.70:0/1319911644 shutdown_connections 2024-09-21T05:48:56.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:56.280+0000 7f025b2be640 1 -- 172.21.15.70:0/1319911644 wait complete. 2024-09-21T05:48:56.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:56 smithi070 ceph-mon[30981]: pgmap v354: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T05:48:56.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:56 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1319911644' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:48:57.093 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T05:47:06.246985+0000', 'modified': '2024-09-21T05:47:50.538486+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24641, 'mds_1': 24628, 'mds_2': 24611, 'mds_3': 24610, 'mds_4': 24598}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14787': {'gid': 14787, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.70:6839/1914209867', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6838', 'nonce': 1914209867}, {'type': 'v1', 'addr': '172.21.15.70:6839', 'nonce': 1914209867}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14793': {'gid': 14793, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.70:6841/3392175775', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6840', 'nonce': 3392175775}, {'type': 'v1', 'addr': '172.21.15.70:6841', 'nonce': 3392175775}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24568': {'gid': 24568, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.160:6833/3543945704', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6832', 'nonce': 3543945704}, {'type': 'v1', 'addr': '172.21.15.160:6833', 'nonce': 3543945704}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24575': {'gid': 24575, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.116:6833/283778129', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6832', 'nonce': 283778129}, {'type': 'v1', 'addr': '172.21.15.116:6833', 'nonce': 283778129}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24590': {'gid': 24590, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.116:6835/3787256790', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6834', 'nonce': 3787256790}, {'type': 'v1', 'addr': '172.21.15.116:6835', 'nonce': 3787256790}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24598': {'gid': 24598, 'name': 'f', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.160:6835/2001692372', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6834', 'nonce': 2001692372}, {'type': 'v1', 'addr': '172.21.15.160:6835', 'nonce': 2001692372}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24610': {'gid': 24610, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.160:6837/2558120045', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6836', 'nonce': 2558120045}, {'type': 'v1', 'addr': '172.21.15.160:6837', 'nonce': 2558120045}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24611': {'gid': 24611, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.116:6837/444312934', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6836', 'nonce': 444312934}, {'type': 'v1', 'addr': '172.21.15.116:6837', 'nonce': 444312934}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24628': {'gid': 24628, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.160:6839/1339744282', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6838', 'nonce': 1339744282}, {'type': 'v1', 'addr': '172.21.15.160:6839', 'nonce': 1339744282}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24641': {'gid': 24641, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.116:6839/3952175670', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6838', 'nonce': 3952175670}, {'type': 'v1', 'addr': '172.21.15.116:6839', 'nonce': 3952175670}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24641, 'qdb_cluster': [24641, 24628, 24610, 24611, 24598]} 2024-09-21T05:48:57.093 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-21T05:48:57.094 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph tell mds.f status 2024-09-21T05:48:57.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:56 smithi160 ceph-mon[33979]: pgmap v354: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T05:48:57.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:56 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1319911644' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:48:57.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:56 smithi116 ceph-mon[34332]: pgmap v354: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T05:48:57.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:56 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1319911644' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:48:57.337 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:57.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.859+0000 7f6ba4574640 1 -- 172.21.15.70:0/408739186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b9c108db0 msgr2=0x7f6b9c10f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:57.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.859+0000 7f6ba4574640 1 --2- 172.21.15.70:0/408739186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b9c108db0 0x7f6b9c10f5e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6b94009ca0 tx=0x7f6b9402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.859+0000 7f6ba4574640 1 -- 172.21.15.70:0/408739186 shutdown_connections 2024-09-21T05:48:57.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.859+0000 7f6ba4574640 1 --2- 172.21.15.70:0/408739186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b9c108db0 0x7f6b9c10f5e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.859+0000 7f6ba4574640 1 --2- 172.21.15.70:0/408739186 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b9c108460 0x7f6b9c108870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.859+0000 7f6ba4574640 1 --2- 172.21.15.70:0/408739186 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b9c1031f0 0x7f6b9c103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.859+0000 7f6ba4574640 1 -- 172.21.15.70:0/408739186 >> 172.21.15.70:0/408739186 conn(0x7f6b9c079ec0 msgr2=0x7f6b9c07a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:57.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.859+0000 7f6ba4574640 1 -- 172.21.15.70:0/408739186 shutdown_connections 2024-09-21T05:48:57.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.859+0000 7f6ba4574640 1 -- 172.21.15.70:0/408739186 wait complete. 2024-09-21T05:48:57.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.860+0000 7f6ba4574640 1 Processor -- start 2024-09-21T05:48:57.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.860+0000 7f6ba4574640 1 -- start start 2024-09-21T05:48:57.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.860+0000 7f6ba4574640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b9c1031f0 0x7f6b9c0feef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:57.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.860+0000 7f6ba4574640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b9c108460 0x7f6b9c0ff430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:57.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.860+0000 7f6ba4574640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b9c108db0 0x7f6b9c0ff970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:57.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.860+0000 7f6ba4574640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c112a40 con 0x7f6b9c1031f0 2024-09-21T05:48:57.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.860+0000 7f6ba4574640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c1128c0 con 0x7f6b9c108db0 2024-09-21T05:48:57.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.860+0000 7f6ba4574640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c112bc0 con 0x7f6b9c108460 2024-09-21T05:48:57.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.860+0000 7f6ba2310640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b9c1031f0 0x7f6b9c0feef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:57.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.860+0000 7f6ba2310640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b9c1031f0 0x7f6b9c0feef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55852/0 (socket says 172.21.15.70:55852) 2024-09-21T05:48:57.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.860+0000 7f6ba2310640 1 -- 172.21.15.70:0/1139922364 learned_addr learned my addr 172.21.15.70:0/1139922364 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:57.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.861+0000 7f6ba1b0f640 1 --2- 172.21.15.70:0/1139922364 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b9c108460 0x7f6b9c0ff430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:57.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.861+0000 7f6ba2b11640 1 --2- 172.21.15.70:0/1139922364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b9c108db0 0x7f6b9c0ff970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:57.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.861+0000 7f6ba2310640 1 -- 172.21.15.70:0/1139922364 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b9c108460 msgr2=0x7f6b9c0ff430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:57.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.861+0000 7f6ba2310640 1 --2- 172.21.15.70:0/1139922364 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b9c108460 0x7f6b9c0ff430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.861+0000 7f6ba2310640 1 -- 172.21.15.70:0/1139922364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b9c108db0 msgr2=0x7f6b9c0ff970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:57.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.861+0000 7f6ba2310640 1 --2- 172.21.15.70:0/1139922364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b9c108db0 0x7f6b9c0ff970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.861+0000 7f6ba2310640 1 -- 172.21.15.70:0/1139922364 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9c1a8630 con 0x7f6b9c1031f0 2024-09-21T05:48:57.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.861+0000 7f6ba2b11640 1 --2- 172.21.15.70:0/1139922364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b9c108db0 0x7f6b9c0ff970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:48:57.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.861+0000 7f6ba2310640 1 --2- 172.21.15.70:0/1139922364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b9c1031f0 0x7f6b9c0feef0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c00c920 tx=0x7f6b8c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:57.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.861+0000 7f6b937fe640 1 -- 172.21.15.70:0/1139922364 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c007c70 con 0x7f6b9c1031f0 2024-09-21T05:48:57.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.861+0000 7f6b937fe640 1 -- 172.21.15.70:0/1139922364 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f6b8c007e10 con 0x7f6b9c1031f0 2024-09-21T05:48:57.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.861+0000 7f6ba4574640 1 -- 172.21.15.70:0/1139922364 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b9c1a8920 con 0x7f6b9c1031f0 2024-09-21T05:48:57.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.861+0000 7f6b937fe640 1 -- 172.21.15.70:0/1139922364 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c0187b0 con 0x7f6b9c1031f0 2024-09-21T05:48:57.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.861+0000 7f6ba4574640 1 -- 172.21.15.70:0/1139922364 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b9c1a8e60 con 0x7f6b9c1031f0 2024-09-21T05:48:57.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.863+0000 7f6baaae8740 1 Processor -- start 2024-09-21T05:48:57.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.864+0000 7f6baaae8740 1 -- start start 2024-09-21T05:48:57.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.864+0000 7f6baaae8740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560171365f60 0x56017170bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:57.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.864+0000 7f6baaae8740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56017133d0a0 0x56017170c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:57.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.864+0000 7f6baaae8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560171345280 0x56017170c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:57.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.864+0000 7f6baaae8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560171683c10 con 0x560171345280 2024-09-21T05:48:57.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.864+0000 7f6baaae8740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560171673040 con 0x56017133d0a0 2024-09-21T05:48:57.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.864+0000 7f6baaae8740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x560171676e50 con 0x560171365f60 2024-09-21T05:48:57.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.864+0000 7f6b937fe640 1 -- 172.21.15.70:0/1139922364 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f6b8c018990 con 0x7f6b9c1031f0 2024-09-21T05:48:57.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.864+0000 7f6ba1b0f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560171345280 0x56017170c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:57.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.864+0000 7f6ba1b0f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560171345280 0x56017170c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55856/0 (socket says 172.21.15.70:55856) 2024-09-21T05:48:57.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.864+0000 7f6ba1b0f640 1 -- 172.21.15.70:0/913470357 learned_addr learned my addr 172.21.15.70:0/913470357 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:57.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.864+0000 7f6ba2b11640 1 --2- 172.21.15.70:0/913470357 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560171365f60 0x56017170bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:57.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.864+0000 7f6ba2310640 1 --2- 172.21.15.70:0/913470357 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56017133d0a0 0x56017170c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:57.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.865+0000 7f6ba1b0f640 1 -- 172.21.15.70:0/913470357 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560171365f60 msgr2=0x56017170bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:48:57.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.865+0000 7f6ba1b0f640 1 --2- 172.21.15.70:0/913470357 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560171365f60 0x56017170bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.865+0000 7f6ba1b0f640 1 -- 172.21.15.70:0/913470357 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56017133d0a0 msgr2=0x56017170c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:48:57.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.865+0000 7f6ba1b0f640 1 --2- 172.21.15.70:0/913470357 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56017133d0a0 0x56017170c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.865+0000 7f6ba1b0f640 1 -- 172.21.15.70:0/913470357 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601713d1540 con 0x560171345280 2024-09-21T05:48:57.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.865+0000 7f6ba2310640 1 --2- 172.21.15.70:0/913470357 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56017133d0a0 0x56017170c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:48:57.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.865+0000 7f6ba1b0f640 1 --2- 172.21.15.70:0/913470357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560171345280 0x56017170c980 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800cbd0 tx=0x7f6b9800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55088b16f3a65778 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:57.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.865+0000 7f6b937fe640 1 --2- 172.21.15.70:0/1139922364 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f6b880b65a0 0x7f6b880b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:57.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.865+0000 7f6b90ff9640 1 -- 172.21.15.70:0/913470357 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b98005220 con 0x560171345280 2024-09-21T05:48:57.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.865+0000 7f6b90ff9640 1 -- 172.21.15.70:0/913470357 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f6b98004c50 con 0x560171345280 2024-09-21T05:48:57.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.865+0000 7f6b90ff9640 1 -- 172.21.15.70:0/913470357 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b98010690 con 0x560171345280 2024-09-21T05:48:57.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.865+0000 7f6ba2b11640 1 --2- 172.21.15.70:0/1139922364 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f6b880b65a0 0x7f6b880b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:57.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.865+0000 7f6b937fe640 1 -- 172.21.15.70:0/1139922364 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f6b8c0e7ac0 con 0x7f6b9c1031f0 2024-09-21T05:48:57.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.866+0000 7f6baaae8740 1 -- 172.21.15.70:0/913470357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560171345280 msgr2=0x56017170c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:57.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.866+0000 7f6ba2b11640 1 --2- 172.21.15.70:0/1139922364 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f6b880b65a0 0x7f6b880b8ab0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6b94006010 tx=0x7f6b94009970 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:57.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.866+0000 7f6baaae8740 1 --2- 172.21.15.70:0/913470357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560171345280 0x56017170c980 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800cbd0 tx=0x7f6b9800e720 comp rx=0 tx=0).stop 2024-09-21T05:48:57.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.866+0000 7f6baaae8740 1 -- 172.21.15.70:0/913470357 shutdown_connections 2024-09-21T05:48:57.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.866+0000 7f6baaae8740 1 --2- 172.21.15.70:0/913470357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560171345280 0x56017170c980 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.866+0000 7f6baaae8740 1 --2- 172.21.15.70:0/913470357 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56017133d0a0 0x56017170c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.866+0000 7f6baaae8740 1 --2- 172.21.15.70:0/913470357 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560171365f60 0x56017170bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.866+0000 7f6baaae8740 1 -- 172.21.15.70:0/913470357 >> 172.21.15.70:0/913470357 conn(0x56017135a350 msgr2=0x560171709df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:57.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.866+0000 7f6baaae8740 1 -- 172.21.15.70:0/913470357 shutdown_connections 2024-09-21T05:48:57.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.866+0000 7f6baaae8740 1 -- 172.21.15.70:0/913470357 wait complete. 2024-09-21T05:48:57.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.867+0000 7f6baaae8740 1 -- start start 2024-09-21T05:48:57.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.867+0000 7f6baaae8740 1 Processor -- start 2024-09-21T05:48:57.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.867+0000 7f6baaae8740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56017133d0a0 0x560171717750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:57.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.867+0000 7f6baaae8740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560171345280 0x560171717d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:57.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.867+0000 7f6baaae8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560171365f60 0x560171723a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:57.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.867+0000 7f6baaae8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5601714d45f0 con 0x560171365f60 2024-09-21T05:48:57.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.867+0000 7f6baaae8740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56017160e010 con 0x56017133d0a0 2024-09-21T05:48:57.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.867+0000 7f6baaae8740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x56017171a6e0 con 0x560171345280 2024-09-21T05:48:57.913 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:48:57.913 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "96c6636e-77db-11ef-baf5-efdc52797490", 2024-09-21T05:48:57.913 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 4, 2024-09-21T05:48:57.913 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24598, 2024-09-21T05:48:57.913 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-21T05:48:57.913 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-21T05:48:57.913 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-21T05:48:57.913 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 68.359647128999995, 2024-09-21T05:48:57.913 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2024-09-21T05:48:57.913 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 85, 2024-09-21T05:48:57.913 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 83, 2024-09-21T05:48:57.913 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 138.02077619799999 2024-09-21T05:48:57.913 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:48:57.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.867+0000 7f6baaae8740 10 client.0 _ll_register_callbacks cb 0x56017166d340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:48:57.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.867+0000 7f6ba2b11640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560171365f60 0x560171723a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:57.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.867+0000 7f6ba2b11640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560171365f60 0x560171723a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55862/0 (socket says 172.21.15.70:55862) 2024-09-21T05:48:57.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.867+0000 7f6ba2b11640 1 -- 172.21.15.70:0/3783636058 learned_addr learned my addr 172.21.15.70:0/3783636058 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:57.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.867+0000 7f6ba2310640 1 --2- 172.21.15.70:0/3783636058 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56017133d0a0 0x560171717750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:57.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.867+0000 7f6ba1b0f640 1 --2- 172.21.15.70:0/3783636058 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560171345280 0x560171717d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:57.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.867+0000 7f6ba2b11640 1 -- 172.21.15.70:0/3783636058 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560171345280 msgr2=0x560171717d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:48:57.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.867+0000 7f6ba2b11640 1 --2- 172.21.15.70:0/3783636058 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560171345280 0x560171717d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.867+0000 7f6ba2b11640 1 -- 172.21.15.70:0/3783636058 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56017133d0a0 msgr2=0x560171717750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:48:57.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.868+0000 7f6ba2b11640 1 --2- 172.21.15.70:0/3783636058 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56017133d0a0 0x560171717750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.868+0000 7f6ba2b11640 1 -- 172.21.15.70:0/3783636058 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56017163ba00 con 0x560171365f60 2024-09-21T05:48:57.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.868+0000 7f6ba2b11640 1 --2- 172.21.15.70:0/3783636058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560171365f60 0x560171723a00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6b94032d10 tx=0x7f6b9402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c746ff72efa7b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:57.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.868+0000 7f6b85ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:48:57.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.868+0000 7f6b85ffb640 1 -- 172.21.15.70:0/3783636058 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b940045c0 con 0x560171365f60 2024-09-21T05:48:57.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.868+0000 7f6b85ffb640 1 -- 172.21.15.70:0/3783636058 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f6b94004760 con 0x560171365f60 2024-09-21T05:48:57.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.868+0000 7f6baaae8740 1 -- 172.21.15.70:0/3783636058 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b98004c50 con 0x560171365f60 2024-09-21T05:48:57.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.868+0000 7f6b85ffb640 1 -- 172.21.15.70:0/3783636058 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6b94057580 con 0x560171365f60 2024-09-21T05:48:57.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.868+0000 7f6baaae8740 10 client.15249 fetch_fsmap learned FSMap version 27 2024-09-21T05:48:57.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.868+0000 7f6baaae8740 1 -- 172.21.15.70:0/3783636058 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560171726520 con 0x560171365f60 2024-09-21T05:48:57.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.868+0000 7f6b85ffb640 1 -- 172.21.15.70:0/3783636058 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f6b98004c50 con 0x560171365f60 2024-09-21T05:48:57.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.869+0000 7f6b85ffb640 1 -- 172.21.15.70:0/3783636058 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f6b94050070 con 0x560171365f60 2024-09-21T05:48:57.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.869+0000 7f6baaae8740 10 client.15249 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T05:48:57.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.869+0000 7f6baaae8740 10 client.15249 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T05:48:57.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.869+0000 7f6baaae8740 20 client.15249 populate_metadata read hostname 'smithi070' 2024-09-21T05:48:57.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.869+0000 7f6baaae8740 1 --2- 172.21.15.70:0/3783636058 >> [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] conn(0x5601713248e0 0x56017172a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:57.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.869+0000 7f6baaae8740 4 client.15249 mds_command: new command op to 24598 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:48:57.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.869+0000 7f6baaae8740 1 -- 172.21.15.70:0/3783636058 --> [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560171685b60 con 0x5601713248e0 2024-09-21T05:48:57.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.869+0000 7f6ba2310640 1 --2- 172.21.15.70:0/3783636058 >> [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] conn(0x5601713248e0 0x56017172a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:57.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.869+0000 7f6b85ffb640 10 client.15249 ms_handle_connect on v2:172.21.15.160:6834/2001692372 2024-09-21T05:48:57.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.869+0000 7f6ba2310640 1 --2- 172.21.15.70:0/3783636058 >> [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] conn(0x5601713248e0 0x56017172a040 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a2385d4d3c0c12d8 server_cookie=7709680d38f8bec0 in_seq=0 out_seq=0 2024-09-21T05:48:57.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.870+0000 7f6b85ffb640 1 -- 172.21.15.70:0/3783636058 <== mds.4 v2:172.21.15.160:6834/2001692372 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560171685b60 con 0x5601713248e0 2024-09-21T05:48:57.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.870+0000 7f6b85ffb640 10 client.15249 handle_command_reply: tid=0 2024-09-21T05:48:57.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.870+0000 7f6baaae8740 1 client.15249 shutdown 2024-09-21T05:48:57.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.870+0000 7f6baaae8740 1 -- 172.21.15.70:0/3783636058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560171365f60 msgr2=0x560171723a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:57.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.870+0000 7f6baaae8740 1 --2- 172.21.15.70:0/3783636058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560171365f60 0x560171723a00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6b94032d10 tx=0x7f6b9402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.870+0000 7f6baaae8740 1 -- 172.21.15.70:0/3783636058 shutdown_connections 2024-09-21T05:48:57.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.870+0000 7f6baaae8740 1 --2- 172.21.15.70:0/3783636058 >> [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] conn(0x5601713248e0 0x56017172a040 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.870+0000 7f6baaae8740 1 --2- 172.21.15.70:0/3783636058 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560171345280 0x560171717d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.870+0000 7f6b85ffb640 0 client.15249 ms_handle_reset on v2:172.21.15.160:6834/2001692372 2024-09-21T05:48:57.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.870+0000 7f6baaae8740 1 --2- 172.21.15.70:0/3783636058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560171365f60 0x560171723a00 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.870+0000 7f6baaae8740 1 --2- 172.21.15.70:0/3783636058 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56017133d0a0 0x560171717750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.871+0000 7f6baaae8740 1 -- 172.21.15.70:0/3783636058 >> 172.21.15.70:0/3783636058 conn(0x56017135a350 msgr2=0x56017170f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:57.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.871+0000 7f6baaae8740 1 -- 172.21.15.70:0/3783636058 shutdown_connections 2024-09-21T05:48:57.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.871+0000 7f6baaae8740 1 -- 172.21.15.70:0/3783636058 wait complete. 2024-09-21T05:48:57.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.871+0000 7f6baaae8740 20 client.15249 trim_cache size 0 max 16384 2024-09-21T05:48:57.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.888+0000 7f6baaae8740 1 Processor -- start 2024-09-21T05:48:57.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.888+0000 7f6baaae8740 1 -- start start 2024-09-21T05:48:57.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.889+0000 7f6baaae8740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5601713248e0 0x560171728bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:57.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.889+0000 7f6baaae8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56017133d0a0 0x560171712020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:57.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.889+0000 7f6baaae8740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560171345280 0x560171712900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:57.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.889+0000 7f6baaae8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560171728380 con 0x56017133d0a0 2024-09-21T05:48:57.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.889+0000 7f6baaae8740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560171728a50 con 0x5601713248e0 2024-09-21T05:48:57.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.889+0000 7f6baaae8740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x560171729120 con 0x560171345280 2024-09-21T05:48:57.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.889+0000 7f6ba1b0f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56017133d0a0 0x560171712020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:57.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.889+0000 7f6ba1b0f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56017133d0a0 0x560171712020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55874/0 (socket says 172.21.15.70:55874) 2024-09-21T05:48:57.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.889+0000 7f6ba1b0f640 1 -- 172.21.15.70:0/349234074 learned_addr learned my addr 172.21.15.70:0/349234074 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:57.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.889+0000 7f6ba2b11640 1 --2- 172.21.15.70:0/349234074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560171345280 0x560171712900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:57.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.889+0000 7f6ba2310640 1 --2- 172.21.15.70:0/349234074 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5601713248e0 0x560171728bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:57.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.889+0000 7f6ba1b0f640 1 -- 172.21.15.70:0/349234074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560171345280 msgr2=0x560171712900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:48:57.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.889+0000 7f6ba1b0f640 1 --2- 172.21.15.70:0/349234074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560171345280 0x560171712900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.889+0000 7f6ba1b0f640 1 -- 172.21.15.70:0/349234074 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5601713248e0 msgr2=0x560171728bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:48:57.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.889+0000 7f6ba1b0f640 1 --2- 172.21.15.70:0/349234074 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5601713248e0 0x560171728bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.889+0000 7f6ba1b0f640 1 -- 172.21.15.70:0/349234074 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56017170ed60 con 0x56017133d0a0 2024-09-21T05:48:57.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.889+0000 7f6ba2b11640 1 --2- 172.21.15.70:0/349234074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560171345280 0x560171712900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:48:57.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.889+0000 7f6ba1b0f640 1 --2- 172.21.15.70:0/349234074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56017133d0a0 0x560171712020 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6b98000c00 tx=0x7f6b9800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7874c92c14b56e85 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:57.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.889+0000 7f6b87fff640 1 -- 172.21.15.70:0/349234074 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b98029070 con 0x56017133d0a0 2024-09-21T05:48:57.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.890+0000 7f6b87fff640 1 -- 172.21.15.70:0/349234074 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f6b980054f0 con 0x56017133d0a0 2024-09-21T05:48:57.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.890+0000 7f6b87fff640 1 -- 172.21.15.70:0/349234074 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b98010430 con 0x56017133d0a0 2024-09-21T05:48:57.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.890+0000 7f6baaae8740 1 -- 172.21.15.70:0/349234074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56017133d0a0 msgr2=0x560171712020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:57.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.890+0000 7f6baaae8740 1 --2- 172.21.15.70:0/349234074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56017133d0a0 0x560171712020 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6b98000c00 tx=0x7f6b9800c8a0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.890+0000 7f6baaae8740 1 -- 172.21.15.70:0/349234074 shutdown_connections 2024-09-21T05:48:57.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.890+0000 7f6baaae8740 1 --2- 172.21.15.70:0/349234074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560171345280 0x560171712900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.890+0000 7f6baaae8740 1 --2- 172.21.15.70:0/349234074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56017133d0a0 0x560171712020 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.890+0000 7f6baaae8740 1 --2- 172.21.15.70:0/349234074 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5601713248e0 0x560171728bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.890+0000 7f6baaae8740 1 -- 172.21.15.70:0/349234074 >> 172.21.15.70:0/349234074 conn(0x56017135a350 msgr2=0x560171727870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:57.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.890+0000 7f6baaae8740 1 -- 172.21.15.70:0/349234074 shutdown_connections 2024-09-21T05:48:57.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.890+0000 7f6baaae8740 1 -- 172.21.15.70:0/349234074 wait complete. 2024-09-21T05:48:57.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.891+0000 7f6baaae8740 1 -- start start 2024-09-21T05:48:57.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.891+0000 7f6baaae8740 1 Processor -- start 2024-09-21T05:48:57.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.891+0000 7f6baaae8740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5601713248e0 0x5601717324f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:57.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.891+0000 7f6baaae8740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56017133d0a0 0x560171732ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:57.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.891+0000 7f6baaae8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560171345280 0x56017172cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:57.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.891+0000 7f6baaae8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560171729ec0 con 0x560171345280 2024-09-21T05:48:57.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.891+0000 7f6baaae8740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5601717297f0 con 0x5601713248e0 2024-09-21T05:48:57.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.891+0000 7f6baaae8740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x56017172a590 con 0x56017133d0a0 2024-09-21T05:48:57.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.891+0000 7f6baaae8740 10 client.0 _ll_register_callbacks cb 0x7f6b94031570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:48:57.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.891+0000 7f6ba2b11640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560171345280 0x56017172cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:57.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.891+0000 7f6ba2b11640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560171345280 0x56017172cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55878/0 (socket says 172.21.15.70:55878) 2024-09-21T05:48:57.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.891+0000 7f6ba2b11640 1 -- 172.21.15.70:0/393816049 learned_addr learned my addr 172.21.15.70:0/393816049 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:57.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.891+0000 7f6ba2310640 1 --2- 172.21.15.70:0/393816049 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5601713248e0 0x5601717324f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:57.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.891+0000 7f6ba2b11640 1 -- 172.21.15.70:0/393816049 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56017133d0a0 msgr2=0x560171732ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:48:57.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.891+0000 7f6ba2b11640 1 --2- 172.21.15.70:0/393816049 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56017133d0a0 0x560171732ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.891+0000 7f6ba2b11640 1 -- 172.21.15.70:0/393816049 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5601713248e0 msgr2=0x5601717324f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:48:57.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.891+0000 7f6ba2b11640 1 --2- 172.21.15.70:0/393816049 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5601713248e0 0x5601717324f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.891+0000 7f6ba2b11640 1 -- 172.21.15.70:0/393816049 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56017172d620 con 0x560171345280 2024-09-21T05:48:57.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.892+0000 7f6ba2b11640 1 --2- 172.21.15.70:0/393816049 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560171345280 0x56017172cf30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6b94009a60 tx=0x7f6b940093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2077fcc6c9098b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:57.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.892+0000 7f6b85ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:48:57.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.892+0000 7f6b85ffb640 1 -- 172.21.15.70:0/393816049 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b94031e40 con 0x560171345280 2024-09-21T05:48:57.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.892+0000 7f6b85ffb640 1 -- 172.21.15.70:0/393816049 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f6b94004410 con 0x560171345280 2024-09-21T05:48:57.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.892+0000 7f6baaae8740 1 -- 172.21.15.70:0/393816049 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b980054f0 con 0x560171345280 2024-09-21T05:48:57.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.892+0000 7f6b85ffb640 1 -- 172.21.15.70:0/393816049 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6b94067050 con 0x560171345280 2024-09-21T05:48:57.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.892+0000 7f6baaae8740 10 client.15255 fetch_fsmap learned FSMap version 27 2024-09-21T05:48:57.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.892+0000 7f6baaae8740 1 -- 172.21.15.70:0/393816049 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560171731a30 con 0x560171345280 2024-09-21T05:48:57.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.892+0000 7f6b85ffb640 1 -- 172.21.15.70:0/393816049 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f6b980054f0 con 0x560171345280 2024-09-21T05:48:57.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.892+0000 7f6b85ffb640 1 -- 172.21.15.70:0/393816049 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f6b94050040 con 0x560171345280 2024-09-21T05:48:57.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.892+0000 7f6baaae8740 10 client.15255 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T05:48:57.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.892+0000 7f6baaae8740 10 client.15255 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T05:48:57.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.892+0000 7f6baaae8740 20 client.15255 populate_metadata read hostname 'smithi070' 2024-09-21T05:48:57.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.892+0000 7f6baaae8740 1 --2- 172.21.15.70:0/393816049 >> [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] conn(0x560171365f60 0x5601717987d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:57.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.892+0000 7f6baaae8740 4 client.15255 mds_command: new command op to 24598 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T05:48:57.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.892+0000 7f6baaae8740 1 -- 172.21.15.70:0/393816049 --> [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] -- command(tid 0: {"prefix": "status"}) -- 0x560171681610 con 0x560171365f60 2024-09-21T05:48:57.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.893+0000 7f6ba2310640 1 --2- 172.21.15.70:0/393816049 >> [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] conn(0x560171365f60 0x5601717987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:57.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.893+0000 7f6b85ffb640 10 client.15255 ms_handle_connect on v2:172.21.15.160:6834/2001692372 2024-09-21T05:48:57.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.893+0000 7f6ba2310640 1 --2- 172.21.15.70:0/393816049 >> [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] conn(0x560171365f60 0x5601717987d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=aaeae5969b651d83 server_cookie=96a583a63e38a7b3 in_seq=0 out_seq=0 2024-09-21T05:48:57.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.893+0000 7f6b85ffb640 1 -- 172.21.15.70:0/393816049 <== mds.4 v2:172.21.15.160:6834/2001692372 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x560171681610 con 0x560171365f60 2024-09-21T05:48:57.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.893+0000 7f6b85ffb640 10 client.15255 handle_command_reply: tid=0 2024-09-21T05:48:57.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.893+0000 7f6baaae8740 1 client.15255 shutdown 2024-09-21T05:48:57.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.893+0000 7f6baaae8740 1 -- 172.21.15.70:0/393816049 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560171345280 msgr2=0x56017172cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:57.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.893+0000 7f6baaae8740 1 --2- 172.21.15.70:0/393816049 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560171345280 0x56017172cf30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6b94009a60 tx=0x7f6b940093d0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.893+0000 7f6baaae8740 1 -- 172.21.15.70:0/393816049 shutdown_connections 2024-09-21T05:48:57.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.893+0000 7f6baaae8740 1 --2- 172.21.15.70:0/393816049 >> [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] conn(0x560171365f60 0x5601717987d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.894+0000 7f6baaae8740 1 --2- 172.21.15.70:0/393816049 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56017133d0a0 0x560171732ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.894+0000 7f6baaae8740 1 --2- 172.21.15.70:0/393816049 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560171345280 0x56017172cf30 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.894+0000 7f6baaae8740 1 --2- 172.21.15.70:0/393816049 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5601713248e0 0x5601717324f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.894+0000 7f6baaae8740 1 -- 172.21.15.70:0/393816049 >> 172.21.15.70:0/393816049 conn(0x56017135a350 msgr2=0x560171712900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:57.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.894+0000 7f6b85ffb640 0 client.15255 ms_handle_reset on v2:172.21.15.160:6834/2001692372 2024-09-21T05:48:57.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.894+0000 7f6baaae8740 1 -- 172.21.15.70:0/393816049 shutdown_connections 2024-09-21T05:48:57.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.894+0000 7f6baaae8740 1 -- 172.21.15.70:0/393816049 wait complete. 2024-09-21T05:48:57.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.894+0000 7f6baaae8740 20 client.15255 trim_cache size 0 max 16384 2024-09-21T05:48:57.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.894+0000 7f6ba4574640 1 -- 172.21.15.70:0/1139922364 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f6b880b65a0 msgr2=0x7f6b880b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:57.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.894+0000 7f6ba4574640 1 --2- 172.21.15.70:0/1139922364 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f6b880b65a0 0x7f6b880b8ab0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6b94006010 tx=0x7f6b94009970 comp rx=0 tx=0).stop 2024-09-21T05:48:57.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.894+0000 7f6ba4574640 1 -- 172.21.15.70:0/1139922364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b9c1031f0 msgr2=0x7f6b9c0feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:57.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.894+0000 7f6ba4574640 1 --2- 172.21.15.70:0/1139922364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b9c1031f0 0x7f6b9c0feef0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c00c920 tx=0x7f6b8c00cde0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.894+0000 7f6ba4574640 1 -- 172.21.15.70:0/1139922364 shutdown_connections 2024-09-21T05:48:57.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.894+0000 7f6ba4574640 1 --2- 172.21.15.70:0/1139922364 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f6b880b65a0 0x7f6b880b8ab0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.894+0000 7f6ba4574640 1 --2- 172.21.15.70:0/1139922364 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b9c108460 0x7f6b9c0ff430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.894+0000 7f6ba4574640 1 --2- 172.21.15.70:0/1139922364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b9c108db0 0x7f6b9c0ff970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.894+0000 7f6ba4574640 1 --2- 172.21.15.70:0/1139922364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b9c1031f0 0x7f6b9c0feef0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:57.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.894+0000 7f6ba4574640 1 -- 172.21.15.70:0/1139922364 >> 172.21.15.70:0/1139922364 conn(0x7f6b9c079ec0 msgr2=0x7f6b9c101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:57.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.894+0000 7f6ba4574640 1 -- 172.21.15.70:0/1139922364 shutdown_connections 2024-09-21T05:48:57.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:57.894+0000 7f6ba4574640 1 -- 172.21.15.70:0/1139922364 wait complete. 2024-09-21T05:48:58.617 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T05:48:58.864 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:58.985 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:48:58 smithi070 ceph-mon[30981]: pgmap v355: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T05:48:59.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:48:58 smithi160 ceph-mon[33979]: pgmap v355: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T05:48:59.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:48:58 smithi116 ceph-mon[34332]: pgmap v355: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T05:48:59.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.380+0000 7fdcfc87f640 1 -- 172.21.15.70:0/3145857427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcf81083d0 msgr2=0x7fdcf81087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:59.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.380+0000 7fdcfc87f640 1 --2- 172.21.15.70:0/3145857427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcf81083d0 0x7fdcf81087e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fdcec009860 tx=0x7fdcec02a340 comp rx=0 tx=0).stop 2024-09-21T05:48:59.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.380+0000 7fdcfc87f640 1 -- 172.21.15.70:0/3145857427 shutdown_connections 2024-09-21T05:48:59.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.380+0000 7fdcfc87f640 1 --2- 172.21.15.70:0/3145857427 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdcf8108d20 0x7fdcf810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:59.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.380+0000 7fdcfc87f640 1 --2- 172.21.15.70:0/3145857427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcf81083d0 0x7fdcf81087e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:59.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.380+0000 7fdcfc87f640 1 --2- 172.21.15.70:0/3145857427 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdcf8102a90 0x7fdcf8102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:59.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.380+0000 7fdcfc87f640 1 -- 172.21.15.70:0/3145857427 >> 172.21.15.70:0/3145857427 conn(0x7fdcf8079750 msgr2=0x7fdcf8079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:59.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.380+0000 7fdcfc87f640 1 -- 172.21.15.70:0/3145857427 shutdown_connections 2024-09-21T05:48:59.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.380+0000 7fdcfc87f640 1 -- 172.21.15.70:0/3145857427 wait complete. 2024-09-21T05:48:59.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.381+0000 7fdcfc87f640 1 Processor -- start 2024-09-21T05:48:59.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.381+0000 7fdcfc87f640 1 -- start start 2024-09-21T05:48:59.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.381+0000 7fdcfc87f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcf8102a90 0x7fdcf819a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:59.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.381+0000 7fdcfc87f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdcf81083d0 0x7fdcf819aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:59.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.381+0000 7fdcfc87f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdcf8108d20 0x7fdcf819fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:59.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.381+0000 7fdcfc87f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf8112960 con 0x7fdcf8102a90 2024-09-21T05:48:59.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.381+0000 7fdcfc87f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf81127e0 con 0x7fdcf8108d20 2024-09-21T05:48:59.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.381+0000 7fdcfc87f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf8112ae0 con 0x7fdcf81083d0 2024-09-21T05:48:59.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.381+0000 7fdcf659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcf8102a90 0x7fdcf819a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:59.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.381+0000 7fdcf659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcf8102a90 0x7fdcf819a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55910/0 (socket says 172.21.15.70:55910) 2024-09-21T05:48:59.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.381+0000 7fdcf659c640 1 -- 172.21.15.70:0/3475247167 learned_addr learned my addr 172.21.15.70:0/3475247167 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:59.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.381+0000 7fdcf5d9b640 1 --2- 172.21.15.70:0/3475247167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdcf81083d0 0x7fdcf819aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:59.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.381+0000 7fdcf659c640 1 -- 172.21.15.70:0/3475247167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdcf81083d0 msgr2=0x7fdcf819aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:59.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.381+0000 7fdcf659c640 1 --2- 172.21.15.70:0/3475247167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdcf81083d0 0x7fdcf819aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:59.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.381+0000 7fdcf659c640 1 -- 172.21.15.70:0/3475247167 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdcf8108d20 msgr2=0x7fdcf819fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:59.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.381+0000 7fdcf659c640 1 --2- 172.21.15.70:0/3475247167 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdcf8108d20 0x7fdcf819fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:59.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.381+0000 7fdcf659c640 1 -- 172.21.15.70:0/3475247167 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcf81a0490 con 0x7fdcf8102a90 2024-09-21T05:48:59.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.381+0000 7fdcf5d9b640 1 --2- 172.21.15.70:0/3475247167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdcf81083d0 0x7fdcf819aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:48:59.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.381+0000 7fdcf659c640 1 --2- 172.21.15.70:0/3475247167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcf8102a90 0x7fdcf819a520 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fdce800e9c0 tx=0x7fdce800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:59.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.382+0000 7fdce77fe640 1 -- 172.21.15.70:0/3475247167 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce800ccc0 con 0x7fdcf8102a90 2024-09-21T05:48:59.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.382+0000 7fdce77fe640 1 -- 172.21.15.70:0/3475247167 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fdce80054d0 con 0x7fdcf8102a90 2024-09-21T05:48:59.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.382+0000 7fdcfc87f640 1 -- 172.21.15.70:0/3475247167 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcf81a0780 con 0x7fdcf8102a90 2024-09-21T05:48:59.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.382+0000 7fdce77fe640 1 -- 172.21.15.70:0/3475247167 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce8010430 con 0x7fdcf8102a90 2024-09-21T05:48:59.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.382+0000 7fdcfc87f640 1 -- 172.21.15.70:0/3475247167 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcf81a6ee0 con 0x7fdcf8102a90 2024-09-21T05:48:59.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.384+0000 7fdd02df3740 1 Processor -- start 2024-09-21T05:48:59.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.384+0000 7fdce77fe640 1 -- 172.21.15.70:0/3475247167 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fdce80046c0 con 0x7fdcf8102a90 2024-09-21T05:48:59.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.385+0000 7fdd02df3740 1 -- start start 2024-09-21T05:48:59.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.385+0000 7fdd02df3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b69f897f60 0x55b69fc3df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:59.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.385+0000 7fdd02df3740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b69f86f0a0 0x55b69fc3e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:59.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.385+0000 7fdd02df3740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b69f877280 0x55b69fc3e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:59.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.385+0000 7fdd02df3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b69fbb5c10 con 0x55b69f897f60 2024-09-21T05:48:59.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.385+0000 7fdd02df3740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b69fba5040 con 0x55b69f877280 2024-09-21T05:48:59.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.385+0000 7fdd02df3740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55b69fba8e50 con 0x55b69f86f0a0 2024-09-21T05:48:59.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.385+0000 7fdcf6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b69f897f60 0x55b69fc3df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:59.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.385+0000 7fdcf6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b69f897f60 0x55b69fc3df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55916/0 (socket says 172.21.15.70:55916) 2024-09-21T05:48:59.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.385+0000 7fdcf6d9d640 1 -- 172.21.15.70:0/1808779240 learned_addr learned my addr 172.21.15.70:0/1808779240 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:59.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.385+0000 7fdcf5d9b640 1 --2- 172.21.15.70:0/1808779240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b69f877280 0x55b69fc3e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:59.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.385+0000 7fdcf659c640 1 --2- 172.21.15.70:0/1808779240 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b69f86f0a0 0x55b69fc3e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:59.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.385+0000 7fdcf6d9d640 1 -- 172.21.15.70:0/1808779240 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b69f86f0a0 msgr2=0x55b69fc3e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:48:59.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.385+0000 7fdcf6d9d640 1 --2- 172.21.15.70:0/1808779240 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b69f86f0a0 0x55b69fc3e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:59.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.385+0000 7fdcf6d9d640 1 -- 172.21.15.70:0/1808779240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b69f877280 msgr2=0x55b69fc3e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:48:59.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.385+0000 7fdcf6d9d640 1 --2- 172.21.15.70:0/1808779240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b69f877280 0x55b69fc3e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:59.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.385+0000 7fdce77fe640 1 --2- 172.21.15.70:0/3475247167 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdce00b65a0 0x7fdce00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:59.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.385+0000 7fdcf6d9d640 1 -- 172.21.15.70:0/1808779240 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b69f903540 con 0x55b69f897f60 2024-09-21T05:48:59.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.386+0000 7fdcf6d9d640 1 --2- 172.21.15.70:0/3475247167 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdce00b65a0 0x7fdce00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:59.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.386+0000 7fdce77fe640 1 -- 172.21.15.70:0/3475247167 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fdce80e7c80 con 0x7fdcf8102a90 2024-09-21T05:48:59.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.386+0000 7fdcf6d9d640 1 --2- 172.21.15.70:0/1808779240 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b69f897f60 0x55b69fc3df00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0009d10 tx=0x7fdcf000e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c985e67fc915f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:59.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.386+0000 7fdce4ff9640 1 -- 172.21.15.70:0/1808779240 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf001e930 con 0x55b69f897f60 2024-09-21T05:48:59.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.386+0000 7fdce4ff9640 1 -- 172.21.15.70:0/1808779240 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fdcf0016070 con 0x55b69f897f60 2024-09-21T05:48:59.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.386+0000 7fdce4ff9640 1 -- 172.21.15.70:0/1808779240 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf001db30 con 0x55b69f897f60 2024-09-21T05:48:59.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.387+0000 7fdd02df3740 1 -- 172.21.15.70:0/1808779240 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b69f897f60 msgr2=0x55b69fc3df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:59.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.387+0000 7fdd02df3740 1 --2- 172.21.15.70:0/1808779240 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b69f897f60 0x55b69fc3df00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0009d10 tx=0x7fdcf000e6c0 comp rx=0 tx=0).stop 2024-09-21T05:48:59.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.387+0000 7fdcf6d9d640 1 --2- 172.21.15.70:0/3475247167 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdce00b65a0 0x7fdce00b8ab0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdcf001d000 tx=0x7fdcf0020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:59.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.387+0000 7fdd02df3740 1 -- 172.21.15.70:0/1808779240 shutdown_connections 2024-09-21T05:48:59.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.387+0000 7fdd02df3740 1 --2- 172.21.15.70:0/1808779240 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b69f86f0a0 0x55b69fc3e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:59.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.387+0000 7fdd02df3740 1 --2- 172.21.15.70:0/1808779240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b69f877280 0x55b69fc3e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:59.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.387+0000 7fdd02df3740 1 --2- 172.21.15.70:0/1808779240 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b69f897f60 0x55b69fc3df00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:59.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.387+0000 7fdd02df3740 1 -- 172.21.15.70:0/1808779240 >> 172.21.15.70:0/1808779240 conn(0x55b69f88c350 msgr2=0x55b69fc3bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:59.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.387+0000 7fdd02df3740 1 -- 172.21.15.70:0/1808779240 shutdown_connections 2024-09-21T05:48:59.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.387+0000 7fdd02df3740 1 -- 172.21.15.70:0/1808779240 wait complete. 2024-09-21T05:48:59.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.387+0000 7fdd02df3740 1 -- start start 2024-09-21T05:48:59.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.388+0000 7fdd02df3740 1 Processor -- start 2024-09-21T05:48:59.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.388+0000 7fdd02df3740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b69f86f0a0 0x55b69fc497a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:59.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.388+0000 7fdd02df3740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b69f877280 0x55b69fc49d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:59.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.388+0000 7fdd02df3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b69f897f60 0x55b69fc55a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:59.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.388+0000 7fdd02df3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b69fa065f0 con 0x55b69f897f60 2024-09-21T05:48:59.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.388+0000 7fdd02df3740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b69fb40010 con 0x55b69f877280 2024-09-21T05:48:59.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.388+0000 7fdd02df3740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55b69fc4c6e0 con 0x55b69f86f0a0 2024-09-21T05:48:59.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.388+0000 7fdd02df3740 10 client.0 _ll_register_callbacks cb 0x55b69fb9f340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:48:59.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.388+0000 7fdcf6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b69f897f60 0x55b69fc55a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:59.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.388+0000 7fdcf6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b69f897f60 0x55b69fc55a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55924/0 (socket says 172.21.15.70:55924) 2024-09-21T05:48:59.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.388+0000 7fdcf6d9d640 1 -- 172.21.15.70:0/1951368330 learned_addr learned my addr 172.21.15.70:0/1951368330 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:59.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.388+0000 7fdcf5d9b640 1 --2- 172.21.15.70:0/1951368330 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b69f877280 0x55b69fc49d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:59.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.388+0000 7fdcf659c640 1 --2- 172.21.15.70:0/1951368330 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b69f86f0a0 0x55b69fc497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:59.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.388+0000 7fdcf6d9d640 1 -- 172.21.15.70:0/1951368330 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b69f86f0a0 msgr2=0x55b69fc497a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:48:59.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.388+0000 7fdcf6d9d640 1 --2- 172.21.15.70:0/1951368330 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b69f86f0a0 0x55b69fc497a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:59.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.388+0000 7fdcf6d9d640 1 -- 172.21.15.70:0/1951368330 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b69f877280 msgr2=0x55b69fc49d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:48:59.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.388+0000 7fdcf6d9d640 1 --2- 172.21.15.70:0/1951368330 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b69f877280 0x55b69fc49d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:59.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.388+0000 7fdcf6d9d640 1 -- 172.21.15.70:0/1951368330 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b69fb6da00 con 0x55b69f897f60 2024-09-21T05:48:59.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.388+0000 7fdcf5d9b640 1 --2- 172.21.15.70:0/1951368330 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b69f877280 0x55b69fc49d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:48:59.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.388+0000 7fdcf6d9d640 1 --2- 172.21.15.70:0/1951368330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b69f897f60 0x55b69fc55a30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0006010 tx=0x7fdcf001e630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63fce8df524a71c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:59.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.388+0000 7fdcddffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:48:59.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.389+0000 7fdcddffb640 1 -- 172.21.15.70:0/1951368330 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf001d5d0 con 0x55b69f897f60 2024-09-21T05:48:59.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.389+0000 7fdcddffb640 1 -- 172.21.15.70:0/1951368330 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fdcf0011a00 con 0x55b69f897f60 2024-09-21T05:48:59.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.389+0000 7fdd02df3740 1 -- 172.21.15.70:0/1951368330 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcf0016070 con 0x55b69f897f60 2024-09-21T05:48:59.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.389+0000 7fdcddffb640 1 -- 172.21.15.70:0/1951368330 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdcf0011c00 con 0x55b69f897f60 2024-09-21T05:48:59.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.389+0000 7fdd02df3740 10 client.15267 fetch_fsmap learned FSMap version 27 2024-09-21T05:48:59.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.389+0000 7fdd02df3740 1 -- 172.21.15.70:0/1951368330 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b69fc58600 con 0x55b69f897f60 2024-09-21T05:48:59.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.389+0000 7fdcddffb640 1 -- 172.21.15.70:0/1951368330 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fdcf0016070 con 0x55b69f897f60 2024-09-21T05:48:59.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.389+0000 7fdcddffb640 1 -- 172.21.15.70:0/1951368330 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fdcf000f040 con 0x55b69f897f60 2024-09-21T05:48:59.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.389+0000 7fdd02df3740 10 client.15267 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T05:48:59.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.389+0000 7fdd02df3740 10 client.15267 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T05:48:59.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.389+0000 7fdd02df3740 20 client.15267 populate_metadata read hostname 'smithi070' 2024-09-21T05:48:59.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.389+0000 7fdd02df3740 1 --2- 172.21.15.70:0/1951368330 >> [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] conn(0x55b69f8568e0 0x55b69fc5bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:59.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.389+0000 7fdd02df3740 4 client.15267 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:48:59.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.389+0000 7fdd02df3740 1 -- 172.21.15.70:0/1951368330 --> [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b69fbb7b60 con 0x55b69f8568e0 2024-09-21T05:48:59.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.390+0000 7fdcf659c640 1 --2- 172.21.15.70:0/1951368330 >> [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] conn(0x55b69f8568e0 0x55b69fc5bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:59.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.390+0000 7fdcf659c640 1 --2- 172.21.15.70:0/1951368330 >> [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] conn(0x55b69f8568e0 0x55b69fc5bed0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6184ab0613df2e02 server_cookie=62f2155a7ae92966 in_seq=0 out_seq=0 2024-09-21T05:48:59.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.390+0000 7fdcddffb640 10 client.15267 ms_handle_connect on v2:172.21.15.160:6836/2558120045 2024-09-21T05:48:59.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.391+0000 7fdcddffb640 1 -- 172.21.15.70:0/1951368330 <== mds.3 v2:172.21.15.160:6836/2558120045 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b69fbb7b60 con 0x55b69f8568e0 2024-09-21T05:48:59.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.391+0000 7fdcddffb640 10 client.15267 handle_command_reply: tid=0 2024-09-21T05:48:59.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.391+0000 7fdd02df3740 1 client.15267 shutdown 2024-09-21T05:48:59.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.391+0000 7fdd02df3740 1 -- 172.21.15.70:0/1951368330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b69f897f60 msgr2=0x55b69fc55a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:59.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.391+0000 7fdd02df3740 1 --2- 172.21.15.70:0/1951368330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b69f897f60 0x55b69fc55a30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0006010 tx=0x7fdcf001e630 comp rx=0 tx=0).stop 2024-09-21T05:48:59.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.391+0000 7fdd02df3740 1 -- 172.21.15.70:0/1951368330 shutdown_connections 2024-09-21T05:48:59.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.391+0000 7fdd02df3740 1 --2- 172.21.15.70:0/1951368330 >> [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] conn(0x55b69f8568e0 0x55b69fc5bed0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:59.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.391+0000 7fdd02df3740 1 --2- 172.21.15.70:0/1951368330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b69f897f60 0x55b69fc55a30 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:59.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.391+0000 7fdd02df3740 1 --2- 172.21.15.70:0/1951368330 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b69f877280 0x55b69fc49d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:59.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.391+0000 7fdcddffb640 0 client.15267 ms_handle_reset on v2:172.21.15.160:6836/2558120045 2024-09-21T05:48:59.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.391+0000 7fdd02df3740 1 --2- 172.21.15.70:0/1951368330 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b69f86f0a0 0x55b69fc497a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:59.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.391+0000 7fdd02df3740 1 -- 172.21.15.70:0/1951368330 >> 172.21.15.70:0/1951368330 conn(0x55b69f88c350 msgr2=0x55b69fc410e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:59.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.391+0000 7fdd02df3740 1 -- 172.21.15.70:0/1951368330 shutdown_connections 2024-09-21T05:48:59.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.391+0000 7fdd02df3740 1 -- 172.21.15.70:0/1951368330 wait complete. 2024-09-21T05:48:59.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.392+0000 7fdd02df3740 20 client.15267 trim_cache size 0 max 16384 2024-09-21T05:48:59.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.410+0000 7fdd02df3740 1 Processor -- start 2024-09-21T05:48:59.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.410+0000 7fdd02df3740 1 -- start start 2024-09-21T05:48:59.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.410+0000 7fdd02df3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b69f86f0a0 0x55b69fc44020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:59.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.410+0000 7fdd02df3740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b69f877280 0x55b69fc59a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:59.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.410+0000 7fdd02df3740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b69f897f60 0x55b69fc559a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:59.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.410+0000 7fdd02df3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b69fc5a210 con 0x55b69f86f0a0 2024-09-21T05:48:59.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.410+0000 7fdd02df3740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b69fc5a8e0 con 0x55b69f877280 2024-09-21T05:48:59.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.410+0000 7fdd02df3740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55b69fc5afb0 con 0x55b69f897f60 2024-09-21T05:48:59.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.410+0000 7fdcf659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b69f86f0a0 0x55b69fc44020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:59.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.410+0000 7fdcf659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b69f86f0a0 0x55b69fc44020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55940/0 (socket says 172.21.15.70:55940) 2024-09-21T05:48:59.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.410+0000 7fdcf659c640 1 -- 172.21.15.70:0/428687739 learned_addr learned my addr 172.21.15.70:0/428687739 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:59.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.410+0000 7fdcf5d9b640 1 --2- 172.21.15.70:0/428687739 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b69f877280 0x55b69fc59a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:59.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.410+0000 7fdcf659c640 1 -- 172.21.15.70:0/428687739 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b69f897f60 msgr2=0x55b69fc559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:48:59.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.410+0000 7fdcf659c640 1 --2- 172.21.15.70:0/428687739 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b69f897f60 0x55b69fc559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:59.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.410+0000 7fdcf659c640 1 -- 172.21.15.70:0/428687739 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b69f877280 msgr2=0x55b69fc59a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:48:59.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.410+0000 7fdcf659c640 1 --2- 172.21.15.70:0/428687739 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b69f877280 0x55b69fc59a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:59.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.410+0000 7fdcf659c640 1 -- 172.21.15.70:0/428687739 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b69fc401f0 con 0x55b69f86f0a0 2024-09-21T05:48:59.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.411+0000 7fdcf659c640 1 --2- 172.21.15.70:0/428687739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b69f86f0a0 0x55b69fc44020 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fdce80e5270 tx=0x7fdce80a9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed819f11fbf8c9b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:59.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.411+0000 7fdcdffff640 1 -- 172.21.15.70:0/428687739 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce80ad3d0 con 0x55b69f86f0a0 2024-09-21T05:48:59.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.411+0000 7fdcdffff640 1 -- 172.21.15.70:0/428687739 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fdce80adfc0 con 0x55b69f86f0a0 2024-09-21T05:48:59.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.411+0000 7fdcdffff640 1 -- 172.21.15.70:0/428687739 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce80b6e50 con 0x55b69f86f0a0 2024-09-21T05:48:59.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.412+0000 7fdd02df3740 1 -- 172.21.15.70:0/428687739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b69f86f0a0 msgr2=0x55b69fc44020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:59.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.412+0000 7fdd02df3740 1 --2- 172.21.15.70:0/428687739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b69f86f0a0 0x55b69fc44020 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fdce80e5270 tx=0x7fdce80a9040 comp rx=0 tx=0).stop 2024-09-21T05:48:59.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.412+0000 7fdd02df3740 1 -- 172.21.15.70:0/428687739 shutdown_connections 2024-09-21T05:48:59.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.412+0000 7fdd02df3740 1 --2- 172.21.15.70:0/428687739 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b69f897f60 0x55b69fc559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:59.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.412+0000 7fdd02df3740 1 --2- 172.21.15.70:0/428687739 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b69f877280 0x55b69fc59a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:59.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.412+0000 7fdd02df3740 1 --2- 172.21.15.70:0/428687739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b69f86f0a0 0x55b69fc44020 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:59.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.412+0000 7fdd02df3740 1 -- 172.21.15.70:0/428687739 >> 172.21.15.70:0/428687739 conn(0x55b69f88c350 msgr2=0x55b69fc48020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:59.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.412+0000 7fdd02df3740 1 -- 172.21.15.70:0/428687739 shutdown_connections 2024-09-21T05:48:59.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.412+0000 7fdd02df3740 1 -- 172.21.15.70:0/428687739 wait complete. 2024-09-21T05:48:59.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.412+0000 7fdd02df3740 1 -- start start 2024-09-21T05:48:59.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.412+0000 7fdd02df3740 1 Processor -- start 2024-09-21T05:48:59.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.413+0000 7fdd02df3740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b69f86f0a0 0x55b69fc649a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:59.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.413+0000 7fdd02df3740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b69f877280 0x55b69fc5de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:59.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.413+0000 7fdd02df3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b69f897f60 0x55b69fc5e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:59.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.413+0000 7fdd02df3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b69fc5bd50 con 0x55b69f897f60 2024-09-21T05:48:59.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.413+0000 7fdd02df3740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b69fc5b680 con 0x55b69f877280 2024-09-21T05:48:59.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.413+0000 7fdd02df3740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55b69fc5c420 con 0x55b69f86f0a0 2024-09-21T05:48:59.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.413+0000 7fdd02df3740 10 client.0 _ll_register_callbacks cb 0x7fdcec035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:48:59.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.413+0000 7fdcf6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b69f897f60 0x55b69fc5e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:59.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.413+0000 7fdcf659c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b69f86f0a0 0x55b69fc649a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:59.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.413+0000 7fdcf6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b69f897f60 0x55b69fc5e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55944/0 (socket says 172.21.15.70:55944) 2024-09-21T05:48:59.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.413+0000 7fdcf6d9d640 1 -- 172.21.15.70:0/698546639 learned_addr learned my addr 172.21.15.70:0/698546639 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:48:59.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.413+0000 7fdcf5d9b640 1 --2- 172.21.15.70:0/698546639 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b69f877280 0x55b69fc5de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:59.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.413+0000 7fdcf6d9d640 1 -- 172.21.15.70:0/698546639 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b69f86f0a0 msgr2=0x55b69fc649a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:48:59.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.413+0000 7fdcf6d9d640 1 --2- 172.21.15.70:0/698546639 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b69f86f0a0 0x55b69fc649a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:59.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.413+0000 7fdcf6d9d640 1 -- 172.21.15.70:0/698546639 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b69f877280 msgr2=0x55b69fc5de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:48:59.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.413+0000 7fdcf6d9d640 1 --2- 172.21.15.70:0/698546639 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b69f877280 0x55b69fc5de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:59.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.413+0000 7fdcf6d9d640 1 -- 172.21.15.70:0/698546639 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b69fc5eb60 con 0x55b69f897f60 2024-09-21T05:48:59.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.413+0000 7fdcf6d9d640 1 --2- 172.21.15.70:0/698546639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b69f897f60 0x55b69fc5e3d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000efd0 tx=0x7fdcf000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6740327fb2a2016 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:59.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.413+0000 7fdcddffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:48:59.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.413+0000 7fdcddffb640 1 -- 172.21.15.70:0/698546639 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf0042020 con 0x55b69f897f60 2024-09-21T05:48:59.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.413+0000 7fdcddffb640 1 -- 172.21.15.70:0/698546639 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fdcf001d3d0 con 0x55b69f897f60 2024-09-21T05:48:59.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.413+0000 7fdd02df3740 1 -- 172.21.15.70:0/698546639 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdce80adfc0 con 0x55b69f897f60 2024-09-21T05:48:59.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.414+0000 7fdcddffb640 1 -- 172.21.15.70:0/698546639 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdcf004d050 con 0x55b69f897f60 2024-09-21T05:48:59.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.414+0000 7fdd02df3740 10 client.15273 fetch_fsmap learned FSMap version 27 2024-09-21T05:48:59.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.414+0000 7fdd02df3740 1 -- 172.21.15.70:0/698546639 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b69fcc73a0 con 0x55b69f897f60 2024-09-21T05:48:59.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.414+0000 7fdcddffb640 1 -- 172.21.15.70:0/698546639 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fdce80adfc0 con 0x55b69f897f60 2024-09-21T05:48:59.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.414+0000 7fdcddffb640 1 -- 172.21.15.70:0/698546639 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fdcf003d440 con 0x55b69f897f60 2024-09-21T05:48:59.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.414+0000 7fdd02df3740 10 client.15273 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T05:48:59.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.414+0000 7fdd02df3740 10 client.15273 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T05:48:59.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.414+0000 7fdd02df3740 20 client.15273 populate_metadata read hostname 'smithi070' 2024-09-21T05:48:59.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.414+0000 7fdd02df3740 1 --2- 172.21.15.70:0/698546639 >> [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] conn(0x55b69f82bc90 0x55b69fccaac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:59.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.414+0000 7fdd02df3740 4 client.15273 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T05:48:59.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.414+0000 7fdd02df3740 1 -- 172.21.15.70:0/698546639 --> [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] -- command(tid 0: {"prefix": "status"}) -- 0x55b69fc5a060 con 0x55b69f82bc90 2024-09-21T05:48:59.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.414+0000 7fdcf659c640 1 --2- 172.21.15.70:0/698546639 >> [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] conn(0x55b69f82bc90 0x55b69fccaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:59.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.415+0000 7fdcddffb640 10 client.15273 ms_handle_connect on v2:172.21.15.160:6836/2558120045 2024-09-21T05:48:59.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.415+0000 7fdcf659c640 1 --2- 172.21.15.70:0/698546639 >> [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] conn(0x55b69f82bc90 0x55b69fccaac0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b4e7d67a6dc775aa server_cookie=cbb85e143b72cf3c in_seq=0 out_seq=0 2024-09-21T05:48:59.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.415+0000 7fdcddffb640 1 -- 172.21.15.70:0/698546639 <== mds.3 v2:172.21.15.160:6836/2558120045 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55b69fc5a060 con 0x55b69f82bc90 2024-09-21T05:48:59.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.415+0000 7fdcddffb640 10 client.15273 handle_command_reply: tid=0 2024-09-21T05:48:59.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.415+0000 7fdd02df3740 1 client.15273 shutdown 2024-09-21T05:48:59.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.415+0000 7fdd02df3740 1 -- 172.21.15.70:0/698546639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b69f897f60 msgr2=0x55b69fc5e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:59.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.415+0000 7fdd02df3740 1 --2- 172.21.15.70:0/698546639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b69f897f60 0x55b69fc5e3d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000efd0 tx=0x7fdcf000ec40 comp rx=0 tx=0).stop 2024-09-21T05:48:59.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.415+0000 7fdd02df3740 1 -- 172.21.15.70:0/698546639 shutdown_connections 2024-09-21T05:48:59.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.415+0000 7fdd02df3740 1 --2- 172.21.15.70:0/698546639 >> [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] conn(0x55b69f82bc90 0x55b69fccaac0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:59.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.415+0000 7fdd02df3740 1 --2- 172.21.15.70:0/698546639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b69f897f60 0x55b69fc5e3d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:59.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.415+0000 7fdd02df3740 1 --2- 172.21.15.70:0/698546639 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b69f877280 0x55b69fc5de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:59.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.415+0000 7fdd02df3740 1 --2- 172.21.15.70:0/698546639 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b69f86f0a0 0x55b69fc649a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:59.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.415+0000 7fdcddffb640 0 client.15273 ms_handle_reset on v2:172.21.15.160:6836/2558120045 2024-09-21T05:48:59.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.415+0000 7fdd02df3740 1 -- 172.21.15.70:0/698546639 >> 172.21.15.70:0/698546639 conn(0x55b69f88c350 msgr2=0x55b69fc3a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:59.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.415+0000 7fdd02df3740 1 -- 172.21.15.70:0/698546639 shutdown_connections 2024-09-21T05:48:59.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.415+0000 7fdd02df3740 1 -- 172.21.15.70:0/698546639 wait complete. 2024-09-21T05:48:59.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.416+0000 7fdd02df3740 20 client.15273 trim_cache size 0 max 16384 2024-09-21T05:48:59.422 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:48:59.422 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "96c6636e-77db-11ef-baf5-efdc52797490", 2024-09-21T05:48:59.423 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 3, 2024-09-21T05:48:59.423 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24610, 2024-09-21T05:48:59.423 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-21T05:48:59.423 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-21T05:48:59.423 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-21T05:48:59.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 70.888910397000004, 2024-09-21T05:48:59.423 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2024-09-21T05:48:59.423 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 85, 2024-09-21T05:48:59.423 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 83, 2024-09-21T05:48:59.423 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 136.93606593499999 2024-09-21T05:48:59.423 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:48:59.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.416+0000 7fdcfc87f640 1 -- 172.21.15.70:0/3475247167 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdce00b65a0 msgr2=0x7fdce00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:59.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.416+0000 7fdcfc87f640 1 --2- 172.21.15.70:0/3475247167 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdce00b65a0 0x7fdce00b8ab0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdcf001d000 tx=0x7fdcf0020000 comp rx=0 tx=0).stop 2024-09-21T05:48:59.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.416+0000 7fdcfc87f640 1 -- 172.21.15.70:0/3475247167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcf8102a90 msgr2=0x7fdcf819a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:59.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.416+0000 7fdcfc87f640 1 --2- 172.21.15.70:0/3475247167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcf8102a90 0x7fdcf819a520 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fdce800e9c0 tx=0x7fdce800ee80 comp rx=0 tx=0).stop 2024-09-21T05:48:59.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.416+0000 7fdcfc87f640 1 -- 172.21.15.70:0/3475247167 shutdown_connections 2024-09-21T05:48:59.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.416+0000 7fdcfc87f640 1 --2- 172.21.15.70:0/3475247167 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdce00b65a0 0x7fdce00b8ab0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:59.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.416+0000 7fdcfc87f640 1 --2- 172.21.15.70:0/3475247167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdcf81083d0 0x7fdcf819aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:59.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.416+0000 7fdcfc87f640 1 --2- 172.21.15.70:0/3475247167 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdcf8108d20 0x7fdcf819fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:59.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.416+0000 7fdcfc87f640 1 --2- 172.21.15.70:0/3475247167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcf8102a90 0x7fdcf819a520 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:59.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.416+0000 7fdcfc87f640 1 -- 172.21.15.70:0/3475247167 >> 172.21.15.70:0/3475247167 conn(0x7fdcf8079750 msgr2=0x7fdcf806bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:59.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.416+0000 7fdcfc87f640 1 -- 172.21.15.70:0/3475247167 shutdown_connections 2024-09-21T05:48:59.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:48:59.416+0000 7fdcfc87f640 1 -- 172.21.15.70:0/3475247167 wait complete. 2024-09-21T05:49:00.317 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph tell mds.h status 2024-09-21T05:49:00.561 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:00.934 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:00 smithi070 ceph-mon[30981]: pgmap v356: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T05:49:01.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.023+0000 7f249f7d5640 1 -- 172.21.15.70:0/4144835398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2498102ae0 msgr2=0x7f2498102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:01.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.023+0000 7f249f7d5640 1 --2- 172.21.15.70:0/4144835398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2498102ae0 0x7f2498102ef0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2494009900 tx=0x7f249402a410 comp rx=0 tx=0).stop 2024-09-21T05:49:01.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.024+0000 7f249f7d5640 1 -- 172.21.15.70:0/4144835398 shutdown_connections 2024-09-21T05:49:01.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.024+0000 7f249f7d5640 1 --2- 172.21.15.70:0/4144835398 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2498108d70 0x7f249810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.024+0000 7f249f7d5640 1 --2- 172.21.15.70:0/4144835398 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2498108420 0x7f2498108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.024+0000 7f249f7d5640 1 --2- 172.21.15.70:0/4144835398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2498102ae0 0x7f2498102ef0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.024+0000 7f249f7d5640 1 -- 172.21.15.70:0/4144835398 >> 172.21.15.70:0/4144835398 conn(0x7f2498079770 msgr2=0x7f2498079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.024+0000 7f249f7d5640 1 -- 172.21.15.70:0/4144835398 shutdown_connections 2024-09-21T05:49:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.024+0000 7f249f7d5640 1 -- 172.21.15.70:0/4144835398 wait complete. 2024-09-21T05:49:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.024+0000 7f249f7d5640 1 Processor -- start 2024-09-21T05:49:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.024+0000 7f249f7d5640 1 -- start start 2024-09-21T05:49:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.025+0000 7f249f7d5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2498102ae0 0x7f2498199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.025+0000 7f249f7d5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2498108420 0x7f24981999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.025+0000 7f249f7d5640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2498108d70 0x7f249819ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.025+0000 7f249f7d5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2498112a80 con 0x7f2498102ae0 2024-09-21T05:49:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.025+0000 7f249f7d5640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2498112900 con 0x7f2498108420 2024-09-21T05:49:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.025+0000 7f249f7d5640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2498112c00 con 0x7f2498108d70 2024-09-21T05:49:01.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.025+0000 7f249d571640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2498102ae0 0x7f2498199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:01.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.025+0000 7f249d571640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2498102ae0 0x7f2498199450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33002/0 (socket says 172.21.15.70:33002) 2024-09-21T05:49:01.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.025+0000 7f249d571640 1 -- 172.21.15.70:0/2805314160 learned_addr learned my addr 172.21.15.70:0/2805314160 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:01.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.025+0000 7f249cd70640 1 --2- 172.21.15.70:0/2805314160 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2498108420 0x7f24981999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:01.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.025+0000 7f249dd72640 1 --2- 172.21.15.70:0/2805314160 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2498108d70 0x7f249819ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:01.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.025+0000 7f249d571640 1 -- 172.21.15.70:0/2805314160 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2498108d70 msgr2=0x7f249819ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:01.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.025+0000 7f249d571640 1 --2- 172.21.15.70:0/2805314160 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2498108d70 0x7f249819ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.025+0000 7f249d571640 1 -- 172.21.15.70:0/2805314160 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2498108420 msgr2=0x7f24981999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:01.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.025+0000 7f249d571640 1 --2- 172.21.15.70:0/2805314160 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2498108420 0x7f24981999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.025+0000 7f249d571640 1 -- 172.21.15.70:0/2805314160 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f249819f3c0 con 0x7f2498102ae0 2024-09-21T05:49:01.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.025+0000 7f249d571640 1 --2- 172.21.15.70:0/2805314160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2498102ae0 0x7f2498199450 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2494005940 tx=0x7f24940042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:01.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.025+0000 7f248e7fc640 1 -- 172.21.15.70:0/2805314160 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249403f030 con 0x7f2498102ae0 2024-09-21T05:49:01.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.026+0000 7f248e7fc640 1 -- 172.21.15.70:0/2805314160 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f2494003cb0 con 0x7f2498102ae0 2024-09-21T05:49:01.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.026+0000 7f249f7d5640 1 -- 172.21.15.70:0/2805314160 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f249819f650 con 0x7f2498102ae0 2024-09-21T05:49:01.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.026+0000 7f248e7fc640 1 -- 172.21.15.70:0/2805314160 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2494035070 con 0x7f2498102ae0 2024-09-21T05:49:01.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.026+0000 7f249f7d5640 1 -- 172.21.15.70:0/2805314160 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24981a5e10 con 0x7f2498102ae0 2024-09-21T05:49:01.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.028+0000 7f24a5d49740 1 Processor -- start 2024-09-21T05:49:01.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.028+0000 7f24a5d49740 1 -- start start 2024-09-21T05:49:01.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.028+0000 7f248e7fc640 1 -- 172.21.15.70:0/2805314160 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f2494042030 con 0x7f2498102ae0 2024-09-21T05:49:01.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.029+0000 7f24a5d49740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ba6c2af60 0x555ba6fd39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:01.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.029+0000 7f24a5d49740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ba6c020a0 0x555ba6fd0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:01.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.029+0000 7f24a5d49740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ba6c0a280 0x555ba6fd1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:01.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.029+0000 7f24a5d49740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555ba6f48c10 con 0x555ba6c0a280 2024-09-21T05:49:01.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.029+0000 7f24a5d49740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555ba6f38040 con 0x555ba6c2af60 2024-09-21T05:49:01.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.029+0000 7f24a5d49740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x555ba6f3be50 con 0x555ba6c020a0 2024-09-21T05:49:01.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.029+0000 7f249cd70640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ba6c0a280 0x555ba6fd1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:01.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.029+0000 7f249cd70640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ba6c0a280 0x555ba6fd1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33006/0 (socket says 172.21.15.70:33006) 2024-09-21T05:49:01.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.029+0000 7f249dd72640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ba6c2af60 0x555ba6fd39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:01.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.029+0000 7f249cd70640 1 -- 172.21.15.70:0/4159840429 learned_addr learned my addr 172.21.15.70:0/4159840429 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:01.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.029+0000 7f249d571640 1 --2- 172.21.15.70:0/4159840429 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ba6c020a0 0x555ba6fd0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:01.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.029+0000 7f249cd70640 1 -- 172.21.15.70:0/4159840429 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ba6c020a0 msgr2=0x555ba6fd0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:01.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.029+0000 7f249cd70640 1 --2- 172.21.15.70:0/4159840429 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ba6c020a0 0x555ba6fd0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.029+0000 7f249cd70640 1 -- 172.21.15.70:0/4159840429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ba6c2af60 msgr2=0x555ba6fd39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:01.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.029+0000 7f249cd70640 1 --2- 172.21.15.70:0/4159840429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ba6c2af60 0x555ba6fd39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.029+0000 7f249cd70640 1 -- 172.21.15.70:0/4159840429 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ba6c96540 con 0x555ba6c0a280 2024-09-21T05:49:01.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.029+0000 7f248e7fc640 1 --2- 172.21.15.70:0/2805314160 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f24840b65a0 0x7f24840b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:01.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.029+0000 7f249dd72640 1 --2- 172.21.15.70:0/4159840429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ba6c2af60 0x555ba6fd39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:49:01.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.030+0000 7f249dd72640 1 --2- 172.21.15.70:0/2805314160 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f24840b65a0 0x7f24840b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:01.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.030+0000 7f248e7fc640 1 -- 172.21.15.70:0/2805314160 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f24941081c0 con 0x7f2498102ae0 2024-09-21T05:49:01.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.030+0000 7f249cd70640 1 --2- 172.21.15.70:0/4159840429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ba6c0a280 0x555ba6fd1590 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f248800bc30 tx=0x7f24880107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd2c908cbcdd631e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:01.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.030+0000 7f24837fe640 1 -- 172.21.15.70:0/4159840429 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248801c480 con 0x555ba6c0a280 2024-09-21T05:49:01.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.030+0000 7f24837fe640 1 -- 172.21.15.70:0/4159840429 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f248801cad0 con 0x555ba6c0a280 2024-09-21T05:49:01.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.030+0000 7f24837fe640 1 -- 172.21.15.70:0/4159840429 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2488011ac0 con 0x555ba6c0a280 2024-09-21T05:49:01.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.031+0000 7f24a5d49740 1 -- 172.21.15.70:0/4159840429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ba6c0a280 msgr2=0x555ba6fd1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:01.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.031+0000 7f249dd72640 1 --2- 172.21.15.70:0/2805314160 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f24840b65a0 0x7f24840b8ab0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f249000b660 tx=0x7f249000e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:01.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.031+0000 7f24a5d49740 1 --2- 172.21.15.70:0/4159840429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ba6c0a280 0x555ba6fd1590 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f248800bc30 tx=0x7f24880107a0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.031+0000 7f24a5d49740 1 -- 172.21.15.70:0/4159840429 shutdown_connections 2024-09-21T05:49:01.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.031+0000 7f24a5d49740 1 --2- 172.21.15.70:0/4159840429 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ba6c020a0 0x555ba6fd0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.031+0000 7f24a5d49740 1 --2- 172.21.15.70:0/4159840429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ba6c0a280 0x555ba6fd1590 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.031+0000 7f24a5d49740 1 --2- 172.21.15.70:0/4159840429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ba6c2af60 0x555ba6fd39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.031+0000 7f24a5d49740 1 -- 172.21.15.70:0/4159840429 >> 172.21.15.70:0/4159840429 conn(0x555ba6c1f350 msgr2=0x555ba6fcedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:01.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.031+0000 7f24a5d49740 1 -- 172.21.15.70:0/4159840429 shutdown_connections 2024-09-21T05:49:01.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.031+0000 7f24a5d49740 1 -- 172.21.15.70:0/4159840429 wait complete. 2024-09-21T05:49:01.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.031+0000 7f24a5d49740 1 -- start start 2024-09-21T05:49:01.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.032+0000 7f24a5d49740 1 Processor -- start 2024-09-21T05:49:01.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.032+0000 7f24a5d49740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ba6c020a0 0x555ba6fe0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:01.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.032+0000 7f24a5d49740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ba6c0a280 0x555ba6fe14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:01.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.032+0000 7f24a5d49740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ba6c2af60 0x555ba6fece20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:01.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.032+0000 7f24a5d49740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555ba6d995f0 con 0x555ba6c2af60 2024-09-21T05:49:01.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.032+0000 7f24a5d49740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555ba6ed3010 con 0x555ba6c020a0 2024-09-21T05:49:01.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.032+0000 7f24a5d49740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x555ba6fe3a30 con 0x555ba6c0a280 2024-09-21T05:49:01.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.032+0000 7f24a5d49740 10 client.0 _ll_register_callbacks cb 0x555ba6f32340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:49:01.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.032+0000 7f249dd72640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ba6c2af60 0x555ba6fece20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:01.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.032+0000 7f249dd72640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ba6c2af60 0x555ba6fece20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33014/0 (socket says 172.21.15.70:33014) 2024-09-21T05:49:01.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.032+0000 7f249dd72640 1 -- 172.21.15.70:0/3365550070 learned_addr learned my addr 172.21.15.70:0/3365550070 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:01.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.032+0000 7f249cd70640 1 --2- 172.21.15.70:0/3365550070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ba6c0a280 0x555ba6fe14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:01.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.032+0000 7f249d571640 1 --2- 172.21.15.70:0/3365550070 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ba6c020a0 0x555ba6fe0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:01.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.033+0000 7f249dd72640 1 -- 172.21.15.70:0/3365550070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ba6c0a280 msgr2=0x555ba6fe14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:01.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.033+0000 7f249dd72640 1 --2- 172.21.15.70:0/3365550070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ba6c0a280 0x555ba6fe14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.033+0000 7f249dd72640 1 -- 172.21.15.70:0/3365550070 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ba6c020a0 msgr2=0x555ba6fe0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:01.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.033+0000 7f249dd72640 1 --2- 172.21.15.70:0/3365550070 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ba6c020a0 0x555ba6fe0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.033+0000 7f249dd72640 1 -- 172.21.15.70:0/3365550070 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ba6f00a00 con 0x555ba6c2af60 2024-09-21T05:49:01.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.033+0000 7f249d571640 1 --2- 172.21.15.70:0/3365550070 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ba6c020a0 0x555ba6fe0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:49:01.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.033+0000 7f249cd70640 1 --2- 172.21.15.70:0/3365550070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ba6c0a280 0x555ba6fe14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:01.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.033+0000 7f249dd72640 1 --2- 172.21.15.70:0/3365550070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ba6c2af60 0x555ba6fece20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f24900077b0 tx=0x7f2490004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67df7f5764fb9f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:01.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.033+0000 7f2480ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:49:01.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.033+0000 7f2480ff9640 1 -- 172.21.15.70:0/3365550070 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2490029060 con 0x555ba6c2af60 2024-09-21T05:49:01.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.033+0000 7f2480ff9640 1 -- 172.21.15.70:0/3365550070 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f2490007d30 con 0x555ba6c2af60 2024-09-21T05:49:01.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.033+0000 7f24a5d49740 1 -- 172.21.15.70:0/3365550070 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f248801cad0 con 0x555ba6c2af60 2024-09-21T05:49:01.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.033+0000 7f2480ff9640 1 -- 172.21.15.70:0/3365550070 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2490030050 con 0x555ba6c2af60 2024-09-21T05:49:01.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.033+0000 7f24a5d49740 10 client.15285 fetch_fsmap learned FSMap version 27 2024-09-21T05:49:01.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.033+0000 7f24a5d49740 1 -- 172.21.15.70:0/3365550070 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555ba6fefa90 con 0x555ba6c2af60 2024-09-21T05:49:01.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.033+0000 7f2480ff9640 1 -- 172.21.15.70:0/3365550070 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f248801cad0 con 0x555ba6c2af60 2024-09-21T05:49:01.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.034+0000 7f2480ff9640 1 -- 172.21.15.70:0/3365550070 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f2490015070 con 0x555ba6c2af60 2024-09-21T05:49:01.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.034+0000 7f24a5d49740 10 client.15285 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T05:49:01.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.034+0000 7f24a5d49740 10 client.15285 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T05:49:01.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.034+0000 7f24a5d49740 20 client.15285 populate_metadata read hostname 'smithi070' 2024-09-21T05:49:01.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.034+0000 7f24a5d49740 1 --2- 172.21.15.70:0/3365550070 >> [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] conn(0x555ba6be98e0 0x555ba6ff3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:01.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.034+0000 7f24a5d49740 4 client.15285 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:49:01.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.034+0000 7f24a5d49740 1 -- 172.21.15.70:0/3365550070 --> [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ba6f4ab60 con 0x555ba6be98e0 2024-09-21T05:49:01.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.034+0000 7f249d571640 1 --2- 172.21.15.70:0/3365550070 >> [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] conn(0x555ba6be98e0 0x555ba6ff3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:01.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.035+0000 7f249d571640 1 --2- 172.21.15.70:0/3365550070 >> [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] conn(0x555ba6be98e0 0x555ba6ff3540 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3287fa2eb054d412 server_cookie=9326ab9b53008fef in_seq=0 out_seq=0 2024-09-21T05:49:01.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.035+0000 7f2480ff9640 10 client.15285 ms_handle_connect on v2:172.21.15.116:6836/444312934 2024-09-21T05:49:01.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.035+0000 7f2480ff9640 1 -- 172.21.15.70:0/3365550070 <== mds.2 v2:172.21.15.116:6836/444312934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555ba6f4ab60 con 0x555ba6be98e0 2024-09-21T05:49:01.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.036+0000 7f2480ff9640 10 client.15285 handle_command_reply: tid=0 2024-09-21T05:49:01.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.036+0000 7f24a5d49740 1 client.15285 shutdown 2024-09-21T05:49:01.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.036+0000 7f24a5d49740 1 -- 172.21.15.70:0/3365550070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ba6c2af60 msgr2=0x555ba6fece20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:01.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.036+0000 7f24a5d49740 1 --2- 172.21.15.70:0/3365550070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ba6c2af60 0x555ba6fece20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f24900077b0 tx=0x7f2490004a40 comp rx=0 tx=0).stop 2024-09-21T05:49:01.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.036+0000 7f24a5d49740 1 -- 172.21.15.70:0/3365550070 shutdown_connections 2024-09-21T05:49:01.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.036+0000 7f24a5d49740 1 --2- 172.21.15.70:0/3365550070 >> [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] conn(0x555ba6be98e0 0x555ba6ff3540 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.036+0000 7f24a5d49740 1 --2- 172.21.15.70:0/3365550070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ba6c0a280 0x555ba6fe14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.036+0000 7f24a5d49740 1 --2- 172.21.15.70:0/3365550070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ba6c2af60 0x555ba6fece20 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.036+0000 7f24a5d49740 1 --2- 172.21.15.70:0/3365550070 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ba6c020a0 0x555ba6fe0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.036+0000 7f24a5d49740 1 -- 172.21.15.70:0/3365550070 >> 172.21.15.70:0/3365550070 conn(0x555ba6c1f350 msgr2=0x555ba6fd28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:01.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.036+0000 7f2480ff9640 0 client.15285 ms_handle_reset on v2:172.21.15.116:6836/444312934 2024-09-21T05:49:01.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.036+0000 7f24a5d49740 1 -- 172.21.15.70:0/3365550070 shutdown_connections 2024-09-21T05:49:01.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.036+0000 7f24a5d49740 1 -- 172.21.15.70:0/3365550070 wait complete. 2024-09-21T05:49:01.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.036+0000 7f24a5d49740 20 client.15285 trim_cache size 0 max 16384 2024-09-21T05:49:01.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.054+0000 7f24a5d49740 1 Processor -- start 2024-09-21T05:49:01.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.054+0000 7f24a5d49740 1 -- start start 2024-09-21T05:49:01.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.054+0000 7f24a5d49740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ba6c020a0 0x555ba6fe02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:01.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.054+0000 7f24a5d49740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ba6c0a280 0x555ba6fd6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:01.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.054+0000 7f24a5d49740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ba6c2af60 0x555ba6fe0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:01.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.054+0000 7f24a5d49740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555ba6ff1880 con 0x555ba6c020a0 2024-09-21T05:49:01.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.054+0000 7f24a5d49740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555ba6ff1f50 con 0x555ba6c2af60 2024-09-21T05:49:01.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.054+0000 7f24a5d49740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x555ba6ff2620 con 0x555ba6c0a280 2024-09-21T05:49:01.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.054+0000 7f249d571640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ba6c020a0 0x555ba6fe02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:01.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.054+0000 7f249d571640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ba6c020a0 0x555ba6fe02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33030/0 (socket says 172.21.15.70:33030) 2024-09-21T05:49:01.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.054+0000 7f249d571640 1 -- 172.21.15.70:0/4211267090 learned_addr learned my addr 172.21.15.70:0/4211267090 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:01.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.054+0000 7f249d571640 1 -- 172.21.15.70:0/4211267090 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ba6c0a280 msgr2=0x555ba6fd6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:01.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.054+0000 7f249d571640 1 --2- 172.21.15.70:0/4211267090 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ba6c0a280 0x555ba6fd6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.054+0000 7f249d571640 1 -- 172.21.15.70:0/4211267090 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ba6c2af60 msgr2=0x555ba6fe0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:01.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.055+0000 7f249d571640 1 --2- 172.21.15.70:0/4211267090 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ba6c2af60 0x555ba6fe0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.055+0000 7f249d571640 1 -- 172.21.15.70:0/4211267090 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ba6fdf2b0 con 0x555ba6c020a0 2024-09-21T05:49:01.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.055+0000 7f249d571640 1 --2- 172.21.15.70:0/4211267090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ba6c020a0 0x555ba6fe02a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f24940cdb00 tx=0x7f249410bd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e812dedcbd967ec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:01.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.055+0000 7f2482ffd640 1 -- 172.21.15.70:0/4211267090 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2494049040 con 0x555ba6c020a0 2024-09-21T05:49:01.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.055+0000 7f2482ffd640 1 -- 172.21.15.70:0/4211267090 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f24940cd910 con 0x555ba6c020a0 2024-09-21T05:49:01.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.055+0000 7f2482ffd640 1 -- 172.21.15.70:0/4211267090 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24940d28e0 con 0x555ba6c020a0 2024-09-21T05:49:01.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.056+0000 7f24a5d49740 1 -- 172.21.15.70:0/4211267090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ba6c020a0 msgr2=0x555ba6fe02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:01.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.056+0000 7f24a5d49740 1 --2- 172.21.15.70:0/4211267090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ba6c020a0 0x555ba6fe02a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f24940cdb00 tx=0x7f249410bd10 comp rx=0 tx=0).stop 2024-09-21T05:49:01.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.056+0000 7f24a5d49740 1 -- 172.21.15.70:0/4211267090 shutdown_connections 2024-09-21T05:49:01.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.056+0000 7f24a5d49740 1 --2- 172.21.15.70:0/4211267090 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ba6c0a280 0x555ba6fd6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.056+0000 7f24a5d49740 1 --2- 172.21.15.70:0/4211267090 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ba6c2af60 0x555ba6fe0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.056+0000 7f24a5d49740 1 --2- 172.21.15.70:0/4211267090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ba6c020a0 0x555ba6fe02a0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.056+0000 7f24a5d49740 1 -- 172.21.15.70:0/4211267090 >> 172.21.15.70:0/4211267090 conn(0x555ba6c1f350 msgr2=0x555ba6ff0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:01.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.056+0000 7f24a5d49740 1 -- 172.21.15.70:0/4211267090 shutdown_connections 2024-09-21T05:49:01.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.056+0000 7f24a5d49740 1 -- 172.21.15.70:0/4211267090 wait complete. 2024-09-21T05:49:01.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.056+0000 7f24a5d49740 1 -- start start 2024-09-21T05:49:01.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.056+0000 7f24a5d49740 1 Processor -- start 2024-09-21T05:49:01.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.057+0000 7f24a5d49740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ba6c020a0 0x555ba6fce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:01.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.057+0000 7f24a5d49740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ba6c0a280 0x555ba6fce900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:01.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.057+0000 7f24a5d49740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ba6c2af60 0x555ba6fcfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:01.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.057+0000 7f24a5d49740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555ba6ff33c0 con 0x555ba6c2af60 2024-09-21T05:49:01.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.057+0000 7f24a5d49740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555ba6ff2cf0 con 0x555ba6c020a0 2024-09-21T05:49:01.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.057+0000 7f24a5d49740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x555ba6ff3a90 con 0x555ba6c0a280 2024-09-21T05:49:01.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.057+0000 7f24a5d49740 10 client.0 _ll_register_callbacks cb 0x7f2490009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:49:01.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.057+0000 7f249dd72640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ba6c2af60 0x555ba6fcfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:01.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.057+0000 7f249dd72640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ba6c2af60 0x555ba6fcfe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33036/0 (socket says 172.21.15.70:33036) 2024-09-21T05:49:01.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.057+0000 7f249dd72640 1 -- 172.21.15.70:0/2409420880 learned_addr learned my addr 172.21.15.70:0/2409420880 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:01.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.057+0000 7f249cd70640 1 --2- 172.21.15.70:0/2409420880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ba6c0a280 0x555ba6fce900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:01.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.057+0000 7f249d571640 1 --2- 172.21.15.70:0/2409420880 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ba6c020a0 0x555ba6fce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:01.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.057+0000 7f249dd72640 1 -- 172.21.15.70:0/2409420880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ba6c0a280 msgr2=0x555ba6fce900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:01.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.057+0000 7f249dd72640 1 --2- 172.21.15.70:0/2409420880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ba6c0a280 0x555ba6fce900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.057+0000 7f249dd72640 1 -- 172.21.15.70:0/2409420880 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ba6c020a0 msgr2=0x555ba6fce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:01.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.057+0000 7f249dd72640 1 --2- 172.21.15.70:0/2409420880 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ba6c020a0 0x555ba6fce3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.057+0000 7f249dd72640 1 -- 172.21.15.70:0/2409420880 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ba6fd0390 con 0x555ba6c2af60 2024-09-21T05:49:01.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.057+0000 7f249dd72640 1 --2- 172.21.15.70:0/2409420880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ba6c2af60 0x555ba6fcfe20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f249000b0b0 tx=0x7f24900098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc6b1770c3f76eb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:01.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.057+0000 7f2480ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:49:01.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.057+0000 7f2480ff9640 1 -- 172.21.15.70:0/2409420880 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249000ae60 con 0x555ba6c2af60 2024-09-21T05:49:01.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.057+0000 7f2480ff9640 1 -- 172.21.15.70:0/2409420880 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f249000a400 con 0x555ba6c2af60 2024-09-21T05:49:01.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.057+0000 7f24a5d49740 1 -- 172.21.15.70:0/2409420880 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24940cd910 con 0x555ba6c2af60 2024-09-21T05:49:01.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.058+0000 7f2480ff9640 1 -- 172.21.15.70:0/2409420880 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2490029030 con 0x555ba6c2af60 2024-09-21T05:49:01.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.058+0000 7f24a5d49740 10 client.15291 fetch_fsmap learned FSMap version 27 2024-09-21T05:49:01.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.058+0000 7f24a5d49740 1 -- 172.21.15.70:0/2409420880 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555ba6ffbd50 con 0x555ba6c2af60 2024-09-21T05:49:01.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.058+0000 7f2480ff9640 1 -- 172.21.15.70:0/2409420880 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f24940cd910 con 0x555ba6c2af60 2024-09-21T05:49:01.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.058+0000 7f2480ff9640 1 -- 172.21.15.70:0/2409420880 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f2490015070 con 0x555ba6c2af60 2024-09-21T05:49:01.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.058+0000 7f24a5d49740 10 client.15291 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T05:49:01.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.058+0000 7f24a5d49740 10 client.15291 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T05:49:01.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.058+0000 7f24a5d49740 20 client.15291 populate_metadata read hostname 'smithi070' 2024-09-21T05:49:01.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.058+0000 7f24a5d49740 1 --2- 172.21.15.70:0/2409420880 >> [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] conn(0x555ba6bbec90 0x555ba7061830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:01.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.058+0000 7f24a5d49740 4 client.15291 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T05:49:01.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.058+0000 7f24a5d49740 1 -- 172.21.15.70:0/2409420880 --> [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] -- command(tid 0: {"prefix": "status"}) -- 0x555ba6f46610 con 0x555ba6bbec90 2024-09-21T05:49:01.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.058+0000 7f249d571640 1 --2- 172.21.15.70:0/2409420880 >> [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] conn(0x555ba6bbec90 0x555ba7061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:01.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.059+0000 7f2480ff9640 10 client.15291 ms_handle_connect on v2:172.21.15.116:6836/444312934 2024-09-21T05:49:01.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.059+0000 7f249d571640 1 --2- 172.21.15.70:0/2409420880 >> [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] conn(0x555ba6bbec90 0x555ba7061830 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a83eb991bb19d253 server_cookie=34ef767c56daaf16 in_seq=0 out_seq=0 2024-09-21T05:49:01.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.059+0000 7f2480ff9640 1 -- 172.21.15.70:0/2409420880 <== mds.2 v2:172.21.15.116:6836/444312934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x555ba6f46610 con 0x555ba6bbec90 2024-09-21T05:49:01.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.059+0000 7f2480ff9640 10 client.15291 handle_command_reply: tid=0 2024-09-21T05:49:01.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.059+0000 7f24a5d49740 1 client.15291 shutdown 2024-09-21T05:49:01.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.059+0000 7f24a5d49740 1 -- 172.21.15.70:0/2409420880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ba6c2af60 msgr2=0x555ba6fcfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:01.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.059+0000 7f24a5d49740 1 --2- 172.21.15.70:0/2409420880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ba6c2af60 0x555ba6fcfe20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f249000b0b0 tx=0x7f24900098b0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.059+0000 7f24a5d49740 1 -- 172.21.15.70:0/2409420880 shutdown_connections 2024-09-21T05:49:01.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.059+0000 7f24a5d49740 1 --2- 172.21.15.70:0/2409420880 >> [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] conn(0x555ba6bbec90 0x555ba7061830 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.059+0000 7f24a5d49740 1 --2- 172.21.15.70:0/2409420880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ba6c0a280 0x555ba6fce900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.059+0000 7f2480ff9640 0 client.15291 ms_handle_reset on v2:172.21.15.116:6836/444312934 2024-09-21T05:49:01.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.059+0000 7f24a5d49740 1 --2- 172.21.15.70:0/2409420880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ba6c2af60 0x555ba6fcfe20 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.059+0000 7f24a5d49740 1 --2- 172.21.15.70:0/2409420880 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ba6c020a0 0x555ba6fce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.059+0000 7f24a5d49740 1 -- 172.21.15.70:0/2409420880 >> 172.21.15.70:0/2409420880 conn(0x555ba6c1f350 msgr2=0x555ba6ff0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:01.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.059+0000 7f24a5d49740 1 -- 172.21.15.70:0/2409420880 shutdown_connections 2024-09-21T05:49:01.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.059+0000 7f24a5d49740 1 -- 172.21.15.70:0/2409420880 wait complete. 2024-09-21T05:49:01.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.059+0000 7f24a5d49740 20 client.15291 trim_cache size 0 max 16384 2024-09-21T05:49:01.067 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:49:01.067 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "96c6636e-77db-11ef-baf5-efdc52797490", 2024-09-21T05:49:01.067 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 2, 2024-09-21T05:49:01.067 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24611, 2024-09-21T05:49:01.067 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-21T05:49:01.067 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-21T05:49:01.067 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-21T05:49:01.067 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 73.541675660999999, 2024-09-21T05:49:01.067 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2024-09-21T05:49:01.067 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 85, 2024-09-21T05:49:01.067 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 83, 2024-09-21T05:49:01.068 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 135.94957728 2024-09-21T05:49:01.068 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:49:01.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.060+0000 7f249f7d5640 1 -- 172.21.15.70:0/2805314160 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f24840b65a0 msgr2=0x7f24840b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:01.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.060+0000 7f249f7d5640 1 --2- 172.21.15.70:0/2805314160 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f24840b65a0 0x7f24840b8ab0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f249000b660 tx=0x7f249000e040 comp rx=0 tx=0).stop 2024-09-21T05:49:01.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.060+0000 7f249f7d5640 1 -- 172.21.15.70:0/2805314160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2498102ae0 msgr2=0x7f2498199450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:01.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.060+0000 7f249f7d5640 1 --2- 172.21.15.70:0/2805314160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2498102ae0 0x7f2498199450 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2494005940 tx=0x7f24940042f0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.060+0000 7f249f7d5640 1 -- 172.21.15.70:0/2805314160 shutdown_connections 2024-09-21T05:49:01.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.060+0000 7f249f7d5640 1 --2- 172.21.15.70:0/2805314160 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f24840b65a0 0x7f24840b8ab0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.060+0000 7f249f7d5640 1 --2- 172.21.15.70:0/2805314160 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2498108d70 0x7f249819ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.060+0000 7f249f7d5640 1 --2- 172.21.15.70:0/2805314160 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2498108420 0x7f24981999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.060+0000 7f249f7d5640 1 --2- 172.21.15.70:0/2805314160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2498102ae0 0x7f2498199450 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:01.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.060+0000 7f249f7d5640 1 -- 172.21.15.70:0/2805314160 >> 172.21.15.70:0/2805314160 conn(0x7f2498079770 msgr2=0x7f24981064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:01.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.060+0000 7f249f7d5640 1 -- 172.21.15.70:0/2805314160 shutdown_connections 2024-09-21T05:49:01.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:01.060+0000 7f249f7d5640 1 -- 172.21.15.70:0/2805314160 wait complete. 2024-09-21T05:49:01.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:00 smithi160 ceph-mon[33979]: pgmap v356: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T05:49:01.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:00 smithi116 ceph-mon[34332]: pgmap v356: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T05:49:01.867 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T05:49:02.112 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:02.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.613+0000 7f3d56d51640 1 -- 172.21.15.70:0/3547372586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d50102ae0 msgr2=0x7f3d50102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:02.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.613+0000 7f3d56d51640 1 --2- 172.21.15.70:0/3547372586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d50102ae0 0x7f3d50102ef0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3d38009900 tx=0x7f3d3802a410 comp rx=0 tx=0).stop 2024-09-21T05:49:02.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.613+0000 7f3d56d51640 1 -- 172.21.15.70:0/3547372586 shutdown_connections 2024-09-21T05:49:02.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.613+0000 7f3d56d51640 1 --2- 172.21.15.70:0/3547372586 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d50108420 0x7f3d50108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.613+0000 7f3d56d51640 1 --2- 172.21.15.70:0/3547372586 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d50108d70 0x7f3d5010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.613+0000 7f3d56d51640 1 --2- 172.21.15.70:0/3547372586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d50102ae0 0x7f3d50102ef0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.613+0000 7f3d56d51640 1 -- 172.21.15.70:0/3547372586 >> 172.21.15.70:0/3547372586 conn(0x7f3d50079770 msgr2=0x7f3d50079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:02.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.613+0000 7f3d56d51640 1 -- 172.21.15.70:0/3547372586 shutdown_connections 2024-09-21T05:49:02.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.613+0000 7f3d56d51640 1 -- 172.21.15.70:0/3547372586 wait complete. 2024-09-21T05:49:02.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.614+0000 7f3d56d51640 1 Processor -- start 2024-09-21T05:49:02.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.614+0000 7f3d56d51640 1 -- start start 2024-09-21T05:49:02.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.614+0000 7f3d56d51640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d50102ae0 0x7f3d50199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:02.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.614+0000 7f3d56d51640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d50108420 0x7f3d501999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:02.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.614+0000 7f3d56d51640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d50108d70 0x7f3d5019ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:02.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.614+0000 7f3d56d51640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3d50112a00 con 0x7f3d50108420 2024-09-21T05:49:02.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.614+0000 7f3d56d51640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f3d50112880 con 0x7f3d50102ae0 2024-09-21T05:49:02.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.614+0000 7f3d56d51640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3d50112b80 con 0x7f3d50108d70 2024-09-21T05:49:02.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.615+0000 7f3d4ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d50108420 0x7f3d501999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:02.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.615+0000 7f3d4ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d50108420 0x7f3d501999f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33052/0 (socket says 172.21.15.70:33052) 2024-09-21T05:49:02.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.615+0000 7f3d4ffff640 1 -- 172.21.15.70:0/3401214084 learned_addr learned my addr 172.21.15.70:0/3401214084 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:02.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.615+0000 7f3d54aed640 1 --2- 172.21.15.70:0/3401214084 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d50102ae0 0x7f3d50199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:02.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.615+0000 7f3d552ee640 1 --2- 172.21.15.70:0/3401214084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d50108d70 0x7f3d5019ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:02.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.615+0000 7f3d4ffff640 1 -- 172.21.15.70:0/3401214084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d50108d70 msgr2=0x7f3d5019ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:02.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.615+0000 7f3d4ffff640 1 --2- 172.21.15.70:0/3401214084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d50108d70 0x7f3d5019ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.615+0000 7f3d4ffff640 1 -- 172.21.15.70:0/3401214084 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d50102ae0 msgr2=0x7f3d50199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:02.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.615+0000 7f3d4ffff640 1 --2- 172.21.15.70:0/3401214084 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d50102ae0 0x7f3d50199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.615+0000 7f3d4ffff640 1 -- 172.21.15.70:0/3401214084 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d5019f3c0 con 0x7f3d50108420 2024-09-21T05:49:02.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.615+0000 7f3d552ee640 1 --2- 172.21.15.70:0/3401214084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d50108d70 0x7f3d5019ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:02.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.615+0000 7f3d4ffff640 1 --2- 172.21.15.70:0/3401214084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d50108420 0x7f3d501999f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000cce0 tx=0x7f3d4000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:02.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.615+0000 7f3d4dffb640 1 -- 172.21.15.70:0/3401214084 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d40004b20 con 0x7f3d50108420 2024-09-21T05:49:02.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.615+0000 7f3d4dffb640 1 -- 172.21.15.70:0/3401214084 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f3d40004cc0 con 0x7f3d50108420 2024-09-21T05:49:02.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.615+0000 7f3d56d51640 1 -- 172.21.15.70:0/3401214084 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d5019f6b0 con 0x7f3d50108420 2024-09-21T05:49:02.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.615+0000 7f3d4dffb640 1 -- 172.21.15.70:0/3401214084 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4000f6b0 con 0x7f3d50108420 2024-09-21T05:49:02.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.615+0000 7f3d56d51640 1 -- 172.21.15.70:0/3401214084 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d501a5e10 con 0x7f3d50108420 2024-09-21T05:49:02.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.618+0000 7f3d5d2c5740 1 Processor -- start 2024-09-21T05:49:02.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.618+0000 7f3d5d2c5740 1 -- start start 2024-09-21T05:49:02.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.618+0000 7f3d4dffb640 1 -- 172.21.15.70:0/3401214084 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f3d4000f850 con 0x7f3d50108420 2024-09-21T05:49:02.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.618+0000 7f3d5d2c5740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d199244f60 0x55d1995eaf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:02.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.618+0000 7f3d5d2c5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19921c0a0 0x55d1995eb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:02.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.618+0000 7f3d5d2c5740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d199224280 0x55d1995eb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:02.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.618+0000 7f3d5d2c5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d199562c10 con 0x55d19921c0a0 2024-09-21T05:49:02.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.618+0000 7f3d5d2c5740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d199552040 con 0x55d199224280 2024-09-21T05:49:02.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.618+0000 7f3d5d2c5740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55d199555e50 con 0x55d199244f60 2024-09-21T05:49:02.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.618+0000 7f3d54aed640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19921c0a0 0x55d1995eb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:02.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.618+0000 7f3d54aed640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19921c0a0 0x55d1995eb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33064/0 (socket says 172.21.15.70:33064) 2024-09-21T05:49:02.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.619+0000 7f3d54aed640 1 -- 172.21.15.70:0/67606368 learned_addr learned my addr 172.21.15.70:0/67606368 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:02.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.619+0000 7f3d552ee640 1 --2- 172.21.15.70:0/67606368 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d199244f60 0x55d1995eaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:02.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.619+0000 7f3d4ffff640 1 --2- 172.21.15.70:0/67606368 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d199224280 0x55d1995eb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:02.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.619+0000 7f3d4dffb640 1 --2- 172.21.15.70:0/3401214084 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f3d3c0b6620 0x7f3d3c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:02.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.619+0000 7f3d54aed640 1 -- 172.21.15.70:0/67606368 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d199244f60 msgr2=0x55d1995eaf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:02.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.619+0000 7f3d54aed640 1 --2- 172.21.15.70:0/67606368 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d199244f60 0x55d1995eaf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.619+0000 7f3d54aed640 1 -- 172.21.15.70:0/67606368 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d199224280 msgr2=0x55d1995eb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:02.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.619+0000 7f3d54aed640 1 --2- 172.21.15.70:0/67606368 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d199224280 0x55d1995eb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.619+0000 7f3d54aed640 1 -- 172.21.15.70:0/67606368 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1992b0540 con 0x55d19921c0a0 2024-09-21T05:49:02.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.619+0000 7f3d552ee640 1 --2- 172.21.15.70:0/3401214084 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f3d3c0b6620 0x7f3d3c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:02.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.619+0000 7f3d4dffb640 1 -- 172.21.15.70:0/3401214084 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f3d400e7820 con 0x7f3d50108420 2024-09-21T05:49:02.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.619+0000 7f3d54aed640 1 --2- 172.21.15.70:0/67606368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19921c0a0 0x55d1995eb440 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3d38009900 tx=0x7f3d38032e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55ea5abb422d8b6d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:02.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.619+0000 7f3d46ffd640 1 -- 172.21.15.70:0/67606368 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d38035040 con 0x55d19921c0a0 2024-09-21T05:49:02.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.619+0000 7f3d46ffd640 1 -- 172.21.15.70:0/67606368 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f3d38031600 con 0x55d19921c0a0 2024-09-21T05:49:02.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.619+0000 7f3d46ffd640 1 -- 172.21.15.70:0/67606368 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d380047a0 con 0x55d19921c0a0 2024-09-21T05:49:02.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.620+0000 7f3d5d2c5740 1 -- 172.21.15.70:0/67606368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19921c0a0 msgr2=0x55d1995eb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:02.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.620+0000 7f3d552ee640 1 --2- 172.21.15.70:0/3401214084 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f3d3c0b6620 0x7f3d3c0b8b30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3d4800cce0 tx=0x7f3d480046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:02.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.620+0000 7f3d5d2c5740 1 --2- 172.21.15.70:0/67606368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19921c0a0 0x55d1995eb440 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3d38009900 tx=0x7f3d38032e10 comp rx=0 tx=0).stop 2024-09-21T05:49:02.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.620+0000 7f3d5d2c5740 1 -- 172.21.15.70:0/67606368 shutdown_connections 2024-09-21T05:49:02.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.620+0000 7f3d5d2c5740 1 --2- 172.21.15.70:0/67606368 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d199224280 0x55d1995eb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.620+0000 7f3d5d2c5740 1 --2- 172.21.15.70:0/67606368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19921c0a0 0x55d1995eb440 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.620+0000 7f3d5d2c5740 1 --2- 172.21.15.70:0/67606368 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d199244f60 0x55d1995eaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.620+0000 7f3d5d2c5740 1 -- 172.21.15.70:0/67606368 >> 172.21.15.70:0/67606368 conn(0x55d199239350 msgr2=0x55d1995e8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:02.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.620+0000 7f3d5d2c5740 1 -- 172.21.15.70:0/67606368 shutdown_connections 2024-09-21T05:49:02.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.621+0000 7f3d5d2c5740 1 -- 172.21.15.70:0/67606368 wait complete. 2024-09-21T05:49:02.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.621+0000 7f3d5d2c5740 1 -- start start 2024-09-21T05:49:02.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.621+0000 7f3d5d2c5740 1 Processor -- start 2024-09-21T05:49:02.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.621+0000 7f3d5d2c5740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d19921c0a0 0x55d1995f8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:02.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.621+0000 7f3d5d2c5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d199224280 0x55d1995f8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:02.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.621+0000 7f3d5d2c5740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d199244f60 0x55d199604b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:02.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.621+0000 7f3d5d2c5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d1993b35f0 con 0x55d199224280 2024-09-21T05:49:02.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.621+0000 7f3d5d2c5740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d1994ed010 con 0x55d199244f60 2024-09-21T05:49:02.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.621+0000 7f3d5d2c5740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55d1995fb7e0 con 0x55d19921c0a0 2024-09-21T05:49:02.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.621+0000 7f3d5d2c5740 10 client.0 _ll_register_callbacks cb 0x55d19954c340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:49:02.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.622+0000 7f3d4ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d199224280 0x55d1995f8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:02.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.622+0000 7f3d4ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d199224280 0x55d1995f8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33076/0 (socket says 172.21.15.70:33076) 2024-09-21T05:49:02.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.622+0000 7f3d4ffff640 1 -- 172.21.15.70:0/3118337720 learned_addr learned my addr 172.21.15.70:0/3118337720 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:02.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.622+0000 7f3d54aed640 1 --2- 172.21.15.70:0/3118337720 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d19921c0a0 0x55d1995f8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:02.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.622+0000 7f3d552ee640 1 --2- 172.21.15.70:0/3118337720 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d199244f60 0x55d199604b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:02.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.622+0000 7f3d4ffff640 1 -- 172.21.15.70:0/3118337720 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d19921c0a0 msgr2=0x55d1995f8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:02.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.622+0000 7f3d4ffff640 1 --2- 172.21.15.70:0/3118337720 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d19921c0a0 0x55d1995f8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.622+0000 7f3d4ffff640 1 -- 172.21.15.70:0/3118337720 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d199244f60 msgr2=0x55d199604b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:02.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.622+0000 7f3d4ffff640 1 --2- 172.21.15.70:0/3118337720 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d199244f60 0x55d199604b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.622+0000 7f3d4ffff640 1 -- 172.21.15.70:0/3118337720 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d19951aa00 con 0x55d199224280 2024-09-21T05:49:02.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.622+0000 7f3d552ee640 1 --2- 172.21.15.70:0/3118337720 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d199244f60 0x55d199604b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:02.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.622+0000 7f3d4ffff640 1 --2- 172.21.15.70:0/3118337720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d199224280 0x55d1995f8ec0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3d400a9a30 tx=0x7f3d4000ff10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb12c30c8d49cc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:02.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.622+0000 7f3d2ffff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:49:02.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.622+0000 7f3d2ffff640 1 -- 172.21.15.70:0/3118337720 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4001d040 con 0x55d199224280 2024-09-21T05:49:02.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.622+0000 7f3d2ffff640 1 -- 172.21.15.70:0/3118337720 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f3d400a8db0 con 0x55d199224280 2024-09-21T05:49:02.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.622+0000 7f3d5d2c5740 1 -- 172.21.15.70:0/3118337720 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d38031600 con 0x55d199224280 2024-09-21T05:49:02.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.622+0000 7f3d2ffff640 1 -- 172.21.15.70:0/3118337720 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3d400a9ab0 con 0x55d199224280 2024-09-21T05:49:02.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.622+0000 7f3d5d2c5740 10 client.15303 fetch_fsmap learned FSMap version 27 2024-09-21T05:49:02.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.622+0000 7f3d5d2c5740 1 -- 172.21.15.70:0/3118337720 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d199607710 con 0x55d199224280 2024-09-21T05:49:02.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.623+0000 7f3d2ffff640 1 -- 172.21.15.70:0/3118337720 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f3d38031600 con 0x55d199224280 2024-09-21T05:49:02.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.623+0000 7f3d2ffff640 1 -- 172.21.15.70:0/3118337720 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f3d400a8fb0 con 0x55d199224280 2024-09-21T05:49:02.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.623+0000 7f3d5d2c5740 10 client.15303 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T05:49:02.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.623+0000 7f3d5d2c5740 10 client.15303 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T05:49:02.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.623+0000 7f3d5d2c5740 20 client.15303 populate_metadata read hostname 'smithi070' 2024-09-21T05:49:02.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.623+0000 7f3d5d2c5740 1 --2- 172.21.15.70:0/3118337720 >> [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] conn(0x55d1992038e0 0x55d19960b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:02.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.623+0000 7f3d5d2c5740 4 client.15303 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:49:02.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.623+0000 7f3d5d2c5740 1 -- 172.21.15.70:0/3118337720 --> [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d199564b60 con 0x55d1992038e0 2024-09-21T05:49:02.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.624+0000 7f3d54aed640 1 --2- 172.21.15.70:0/3118337720 >> [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] conn(0x55d1992038e0 0x55d19960b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:02.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.624+0000 7f3d54aed640 1 --2- 172.21.15.70:0/3118337720 >> [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] conn(0x55d1992038e0 0x55d19960b140 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=91c38831313a9dd server_cookie=35cb91fb388c9fae in_seq=0 out_seq=0 2024-09-21T05:49:02.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.624+0000 7f3d2ffff640 10 client.15303 ms_handle_connect on v2:172.21.15.160:6838/1339744282 2024-09-21T05:49:02.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.625+0000 7f3d2ffff640 1 -- 172.21.15.70:0/3118337720 <== mds.1 v2:172.21.15.160:6838/1339744282 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d199564b60 con 0x55d1992038e0 2024-09-21T05:49:02.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.625+0000 7f3d2ffff640 10 client.15303 handle_command_reply: tid=0 2024-09-21T05:49:02.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.625+0000 7f3d5d2c5740 1 client.15303 shutdown 2024-09-21T05:49:02.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.625+0000 7f3d5d2c5740 1 -- 172.21.15.70:0/3118337720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d199224280 msgr2=0x55d1995f8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:02.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.625+0000 7f3d5d2c5740 1 --2- 172.21.15.70:0/3118337720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d199224280 0x55d1995f8ec0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3d400a9a30 tx=0x7f3d4000ff10 comp rx=0 tx=0).stop 2024-09-21T05:49:02.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.625+0000 7f3d5d2c5740 1 -- 172.21.15.70:0/3118337720 shutdown_connections 2024-09-21T05:49:02.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.625+0000 7f3d5d2c5740 1 --2- 172.21.15.70:0/3118337720 >> [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] conn(0x55d1992038e0 0x55d19960b140 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.625+0000 7f3d2ffff640 0 client.15303 ms_handle_reset on v2:172.21.15.160:6838/1339744282 2024-09-21T05:49:02.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.625+0000 7f3d5d2c5740 1 --2- 172.21.15.70:0/3118337720 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d199244f60 0x55d199604b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.625+0000 7f3d5d2c5740 1 --2- 172.21.15.70:0/3118337720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d199224280 0x55d1995f8ec0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.625+0000 7f3d5d2c5740 1 --2- 172.21.15.70:0/3118337720 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d19921c0a0 0x55d1995f8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.625+0000 7f3d5d2c5740 1 -- 172.21.15.70:0/3118337720 >> 172.21.15.70:0/3118337720 conn(0x55d199239350 msgr2=0x55d1995ec8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:02.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.626+0000 7f3d5d2c5740 1 -- 172.21.15.70:0/3118337720 shutdown_connections 2024-09-21T05:49:02.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.626+0000 7f3d5d2c5740 1 -- 172.21.15.70:0/3118337720 wait complete. 2024-09-21T05:49:02.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.626+0000 7f3d5d2c5740 20 client.15303 trim_cache size 0 max 16384 2024-09-21T05:49:02.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.643+0000 7f3d5d2c5740 1 Processor -- start 2024-09-21T05:49:02.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.643+0000 7f3d5d2c5740 1 -- start start 2024-09-21T05:49:02.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.643+0000 7f3d5d2c5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d1992038e0 0x55d1995f88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:02.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.643+0000 7f3d5d2c5740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d19921c0a0 0x55d1995f8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:02.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.644+0000 7f3d5d2c5740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d199224280 0x55d1995f3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:02.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.644+0000 7f3d5d2c5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d199609480 con 0x55d1992038e0 2024-09-21T05:49:02.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.644+0000 7f3d5d2c5740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d199609b50 con 0x55d199224280 2024-09-21T05:49:02.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.644+0000 7f3d5d2c5740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55d19960a220 con 0x55d19921c0a0 2024-09-21T05:49:02.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.644+0000 7f3d54aed640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d1992038e0 0x55d1995f88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:02.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.644+0000 7f3d54aed640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d1992038e0 0x55d1995f88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33086/0 (socket says 172.21.15.70:33086) 2024-09-21T05:49:02.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.644+0000 7f3d54aed640 1 -- 172.21.15.70:0/2934985977 learned_addr learned my addr 172.21.15.70:0/2934985977 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:02.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.644+0000 7f3d4ffff640 1 --2- 172.21.15.70:0/2934985977 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d19921c0a0 0x55d1995f8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:02.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.644+0000 7f3d552ee640 1 --2- 172.21.15.70:0/2934985977 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d199224280 0x55d1995f3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:02.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.644+0000 7f3d54aed640 1 -- 172.21.15.70:0/2934985977 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d19921c0a0 msgr2=0x55d1995f8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:02.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.644+0000 7f3d54aed640 1 --2- 172.21.15.70:0/2934985977 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d19921c0a0 0x55d1995f8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.644+0000 7f3d54aed640 1 -- 172.21.15.70:0/2934985977 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d199224280 msgr2=0x55d1995f3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:02.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.644+0000 7f3d54aed640 1 --2- 172.21.15.70:0/2934985977 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d199224280 0x55d1995f3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.644+0000 7f3d54aed640 1 -- 172.21.15.70:0/2934985977 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1995f6e40 con 0x55d1992038e0 2024-09-21T05:49:02.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.644+0000 7f3d552ee640 1 --2- 172.21.15.70:0/2934985977 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d199224280 0x55d1995f3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:49:02.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.644+0000 7f3d54aed640 1 --2- 172.21.15.70:0/2934985977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d1992038e0 0x55d1995f88b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3d38033000 tx=0x7f3d3802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d3fcafa995083ce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:02.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.644+0000 7f3d467fc640 1 -- 172.21.15.70:0/2934985977 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d38035040 con 0x55d1992038e0 2024-09-21T05:49:02.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.644+0000 7f3d467fc640 1 -- 172.21.15.70:0/2934985977 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f3d380047a0 con 0x55d1992038e0 2024-09-21T05:49:02.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.644+0000 7f3d467fc640 1 -- 172.21.15.70:0/2934985977 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d380044e0 con 0x55d1992038e0 2024-09-21T05:49:02.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.645+0000 7f3d5d2c5740 1 -- 172.21.15.70:0/2934985977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d1992038e0 msgr2=0x55d1995f88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:02.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.645+0000 7f3d5d2c5740 1 --2- 172.21.15.70:0/2934985977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d1992038e0 0x55d1995f88b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3d38033000 tx=0x7f3d3802a410 comp rx=0 tx=0).stop 2024-09-21T05:49:02.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.645+0000 7f3d5d2c5740 1 -- 172.21.15.70:0/2934985977 shutdown_connections 2024-09-21T05:49:02.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.645+0000 7f3d5d2c5740 1 --2- 172.21.15.70:0/2934985977 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d19921c0a0 0x55d1995f8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.645+0000 7f3d5d2c5740 1 --2- 172.21.15.70:0/2934985977 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d199224280 0x55d1995f3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.645+0000 7f3d5d2c5740 1 --2- 172.21.15.70:0/2934985977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d1992038e0 0x55d1995f88b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.645+0000 7f3d5d2c5740 1 -- 172.21.15.70:0/2934985977 >> 172.21.15.70:0/2934985977 conn(0x55d199239350 msgr2=0x55d1995e3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:02.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.645+0000 7f3d5d2c5740 1 -- 172.21.15.70:0/2934985977 shutdown_connections 2024-09-21T05:49:02.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.645+0000 7f3d5d2c5740 1 -- 172.21.15.70:0/2934985977 wait complete. 2024-09-21T05:49:02.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.645+0000 7f3d5d2c5740 1 -- start start 2024-09-21T05:49:02.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.646+0000 7f3d5d2c5740 1 Processor -- start 2024-09-21T05:49:02.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.646+0000 7f3d5d2c5740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d1992038e0 0x55d199613d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:02.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.646+0000 7f3d5d2c5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19921c0a0 0x55d199612a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:02.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.646+0000 7f3d5d2c5740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d199224280 0x55d1996130f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:02.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.646+0000 7f3d5d2c5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d19960afc0 con 0x55d19921c0a0 2024-09-21T05:49:02.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.646+0000 7f3d5d2c5740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d19960a8f0 con 0x55d199224280 2024-09-21T05:49:02.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.646+0000 7f3d5d2c5740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55d19960b690 con 0x55d1992038e0 2024-09-21T05:49:02.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.646+0000 7f3d5d2c5740 10 client.0 _ll_register_callbacks cb 0x7f3d4000cc30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:49:02.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.646+0000 7f3d4ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19921c0a0 0x55d199612a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:02.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.646+0000 7f3d4ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19921c0a0 0x55d199612a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33096/0 (socket says 172.21.15.70:33096) 2024-09-21T05:49:02.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.646+0000 7f3d4ffff640 1 -- 172.21.15.70:0/452077243 learned_addr learned my addr 172.21.15.70:0/452077243 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:02.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.646+0000 7f3d552ee640 1 --2- 172.21.15.70:0/452077243 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d199224280 0x55d1996130f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:02.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.647+0000 7f3d4ffff640 1 -- 172.21.15.70:0/452077243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d1992038e0 msgr2=0x55d199613d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:02.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.647+0000 7f3d54aed640 1 --2- 172.21.15.70:0/452077243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d1992038e0 0x55d199613d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:02.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.647+0000 7f3d4ffff640 1 --2- 172.21.15.70:0/452077243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d1992038e0 0x55d199613d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.647+0000 7f3d4ffff640 1 -- 172.21.15.70:0/452077243 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d199224280 msgr2=0x55d1996130f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:02.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.647+0000 7f3d4ffff640 1 --2- 172.21.15.70:0/452077243 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d199224280 0x55d1996130f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.647+0000 7f3d4ffff640 1 -- 172.21.15.70:0/452077243 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d199611960 con 0x55d19921c0a0 2024-09-21T05:49:02.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.647+0000 7f3d552ee640 1 --2- 172.21.15.70:0/452077243 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d199224280 0x55d1996130f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:49:02.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.647+0000 7f3d4ffff640 1 --2- 172.21.15.70:0/452077243 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19921c0a0 0x55d199612a00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3d400e5360 tx=0x7f3d400b6ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8f3382bcc0f3990 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:02.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.647+0000 7f3d2ffff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:49:02.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.647+0000 7f3d2ffff640 1 -- 172.21.15.70:0/452077243 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4001d070 con 0x55d19921c0a0 2024-09-21T05:49:02.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.647+0000 7f3d2ffff640 1 -- 172.21.15.70:0/452077243 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f3d400ed1c0 con 0x55d19921c0a0 2024-09-21T05:49:02.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.647+0000 7f3d5d2c5740 1 -- 172.21.15.70:0/452077243 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d380047a0 con 0x55d19921c0a0 2024-09-21T05:49:02.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.647+0000 7f3d2ffff640 1 -- 172.21.15.70:0/452077243 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3d400c8050 con 0x55d19921c0a0 2024-09-21T05:49:02.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.647+0000 7f3d5d2c5740 10 client.15309 fetch_fsmap learned FSMap version 27 2024-09-21T05:49:02.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.647+0000 7f3d5d2c5740 1 -- 172.21.15.70:0/452077243 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d199676670 con 0x55d19921c0a0 2024-09-21T05:49:02.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.647+0000 7f3d2ffff640 1 -- 172.21.15.70:0/452077243 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f3d380047a0 con 0x55d19921c0a0 2024-09-21T05:49:02.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.647+0000 7f3d2ffff640 1 -- 172.21.15.70:0/452077243 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f3d400ad460 con 0x55d19921c0a0 2024-09-21T05:49:02.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.648+0000 7f3d5d2c5740 10 client.15309 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T05:49:02.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.648+0000 7f3d5d2c5740 10 client.15309 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T05:49:02.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.648+0000 7f3d5d2c5740 20 client.15309 populate_metadata read hostname 'smithi070' 2024-09-21T05:49:02.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.648+0000 7f3d5d2c5740 1 --2- 172.21.15.70:0/452077243 >> [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] conn(0x55d199244f60 0x55d199679f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:02.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.648+0000 7f3d5d2c5740 4 client.15309 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T05:49:02.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.648+0000 7f3d5d2c5740 1 -- 172.21.15.70:0/452077243 --> [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] -- command(tid 0: {"prefix": "status"}) -- 0x55d199560610 con 0x55d199244f60 2024-09-21T05:49:02.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.648+0000 7f3d54aed640 1 --2- 172.21.15.70:0/452077243 >> [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] conn(0x55d199244f60 0x55d199679f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:02.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.648+0000 7f3d2ffff640 10 client.15309 ms_handle_connect on v2:172.21.15.160:6838/1339744282 2024-09-21T05:49:02.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.648+0000 7f3d54aed640 1 --2- 172.21.15.70:0/452077243 >> [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] conn(0x55d199244f60 0x55d199679f80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=28c5b3d1f42b1dd3 server_cookie=93c9c430f7ba2c4d in_seq=0 out_seq=0 2024-09-21T05:49:02.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.649+0000 7f3d2ffff640 1 -- 172.21.15.70:0/452077243 <== mds.1 v2:172.21.15.160:6838/1339744282 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55d199560610 con 0x55d199244f60 2024-09-21T05:49:02.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.649+0000 7f3d2ffff640 10 client.15309 handle_command_reply: tid=0 2024-09-21T05:49:02.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.649+0000 7f3d5d2c5740 1 client.15309 shutdown 2024-09-21T05:49:02.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.649+0000 7f3d5d2c5740 1 -- 172.21.15.70:0/452077243 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19921c0a0 msgr2=0x55d199612a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:02.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.649+0000 7f3d5d2c5740 1 --2- 172.21.15.70:0/452077243 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19921c0a0 0x55d199612a00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3d400e5360 tx=0x7f3d400b6ff0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.649+0000 7f3d5d2c5740 1 -- 172.21.15.70:0/452077243 shutdown_connections 2024-09-21T05:49:02.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.649+0000 7f3d5d2c5740 1 --2- 172.21.15.70:0/452077243 >> [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] conn(0x55d199244f60 0x55d199679f80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.649+0000 7f3d5d2c5740 1 --2- 172.21.15.70:0/452077243 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d199224280 0x55d1996130f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.649+0000 7f3d5d2c5740 1 --2- 172.21.15.70:0/452077243 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19921c0a0 0x55d199612a00 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.649+0000 7f3d5d2c5740 1 --2- 172.21.15.70:0/452077243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d1992038e0 0x55d199613d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.649+0000 7f3d5d2c5740 1 -- 172.21.15.70:0/452077243 >> 172.21.15.70:0/452077243 conn(0x55d199239350 msgr2=0x55d1995f88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:02.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.649+0000 7f3d2ffff640 0 client.15309 ms_handle_reset on v2:172.21.15.160:6838/1339744282 2024-09-21T05:49:02.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.649+0000 7f3d5d2c5740 1 -- 172.21.15.70:0/452077243 shutdown_connections 2024-09-21T05:49:02.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.649+0000 7f3d5d2c5740 1 -- 172.21.15.70:0/452077243 wait complete. 2024-09-21T05:49:02.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.649+0000 7f3d5d2c5740 20 client.15309 trim_cache size 0 max 16384 2024-09-21T05:49:02.657 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:49:02.657 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "96c6636e-77db-11ef-baf5-efdc52797490", 2024-09-21T05:49:02.657 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 1, 2024-09-21T05:49:02.657 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24628, 2024-09-21T05:49:02.657 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-21T05:49:02.657 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-21T05:49:02.657 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-21T05:49:02.657 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 76.141135779999999, 2024-09-21T05:49:02.657 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2024-09-21T05:49:02.657 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 85, 2024-09-21T05:49:02.657 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 83, 2024-09-21T05:49:02.658 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 134.989008738 2024-09-21T05:49:02.658 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:49:02.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.650+0000 7f3d56d51640 1 -- 172.21.15.70:0/3401214084 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f3d3c0b6620 msgr2=0x7f3d3c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:02.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.650+0000 7f3d56d51640 1 --2- 172.21.15.70:0/3401214084 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f3d3c0b6620 0x7f3d3c0b8b30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3d4800cce0 tx=0x7f3d480046c0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.650+0000 7f3d56d51640 1 -- 172.21.15.70:0/3401214084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d50108420 msgr2=0x7f3d501999f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:02.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.650+0000 7f3d56d51640 1 --2- 172.21.15.70:0/3401214084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d50108420 0x7f3d501999f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000cce0 tx=0x7f3d4000a620 comp rx=0 tx=0).stop 2024-09-21T05:49:02.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.650+0000 7f3d56d51640 1 -- 172.21.15.70:0/3401214084 shutdown_connections 2024-09-21T05:49:02.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.650+0000 7f3d56d51640 1 --2- 172.21.15.70:0/3401214084 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f3d3c0b6620 0x7f3d3c0b8b30 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.650+0000 7f3d56d51640 1 --2- 172.21.15.70:0/3401214084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d50108d70 0x7f3d5019ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.650+0000 7f3d56d51640 1 --2- 172.21.15.70:0/3401214084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d50108420 0x7f3d501999f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.650+0000 7f3d56d51640 1 --2- 172.21.15.70:0/3401214084 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d50102ae0 0x7f3d50199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:02.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.650+0000 7f3d56d51640 1 -- 172.21.15.70:0/3401214084 >> 172.21.15.70:0/3401214084 conn(0x7f3d50079770 msgr2=0x7f3d50106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:02.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.650+0000 7f3d56d51640 1 -- 172.21.15.70:0/3401214084 shutdown_connections 2024-09-21T05:49:02.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:02.650+0000 7f3d56d51640 1 -- 172.21.15.70:0/3401214084 wait complete. 2024-09-21T05:49:03.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:02 smithi160 ceph-mon[33979]: pgmap v357: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T05:49:03.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:02 smithi070 ceph-mon[30981]: pgmap v357: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T05:49:03.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:02 smithi116 ceph-mon[34332]: pgmap v357: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T05:49:03.391 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T05:49:03.636 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:04.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.172+0000 7f3e53824640 1 -- 172.21.15.70:0/3394669051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e4c102650 msgr2=0x7f3e4c102a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:04.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.172+0000 7f3e53824640 1 --2- 172.21.15.70:0/3394669051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e4c102650 0x7f3e4c102a60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3e48009900 tx=0x7f3e4802a480 comp rx=0 tx=0).stop 2024-09-21T05:49:04.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.172+0000 7f3e53824640 1 -- 172.21.15.70:0/3394669051 shutdown_connections 2024-09-21T05:49:04.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.172+0000 7f3e53824640 1 --2- 172.21.15.70:0/3394669051 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e4c102fa0 0x7f3e4c10fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.172+0000 7f3e53824640 1 --2- 172.21.15.70:0/3394669051 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3e4c110200 0x7f3e4c112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.172+0000 7f3e53824640 1 --2- 172.21.15.70:0/3394669051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e4c102650 0x7f3e4c102a60 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.172+0000 7f3e53824640 1 -- 172.21.15.70:0/3394669051 >> 172.21.15.70:0/3394669051 conn(0x7f3e4c0796b0 msgr2=0x7f3e4c079ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:04.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.172+0000 7f3e53824640 1 -- 172.21.15.70:0/3394669051 shutdown_connections 2024-09-21T05:49:04.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.172+0000 7f3e53824640 1 -- 172.21.15.70:0/3394669051 wait complete. 2024-09-21T05:49:04.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.172+0000 7f3e53824640 1 Processor -- start 2024-09-21T05:49:04.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.172+0000 7f3e53824640 1 -- start start 2024-09-21T05:49:04.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.173+0000 7f3e53824640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e4c102650 0x7f3e4c19c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:04.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.173+0000 7f3e53824640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e4c102fa0 0x7f3e4c19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:04.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.173+0000 7f3e53824640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3e4c110200 0x7f3e4c1a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:04.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.173+0000 7f3e53824640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4c115cc0 con 0x7f3e4c102650 2024-09-21T05:49:04.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.173+0000 7f3e53824640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4c115b40 con 0x7f3e4c110200 2024-09-21T05:49:04.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.173+0000 7f3e53824640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4c115e40 con 0x7f3e4c102fa0 2024-09-21T05:49:04.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.173+0000 7f3e515c0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e4c102650 0x7f3e4c19c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:04.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.173+0000 7f3e515c0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e4c102650 0x7f3e4c19c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33124/0 (socket says 172.21.15.70:33124) 2024-09-21T05:49:04.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.173+0000 7f3e515c0640 1 -- 172.21.15.70:0/1534815456 learned_addr learned my addr 172.21.15.70:0/1534815456 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:04.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.173+0000 7f3e50dbf640 1 --2- 172.21.15.70:0/1534815456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e4c102fa0 0x7f3e4c19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:04.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.173+0000 7f3e51dc1640 1 --2- 172.21.15.70:0/1534815456 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3e4c110200 0x7f3e4c1a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:04.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.173+0000 7f3e515c0640 1 -- 172.21.15.70:0/1534815456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e4c102fa0 msgr2=0x7f3e4c19ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:04.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.173+0000 7f3e515c0640 1 --2- 172.21.15.70:0/1534815456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e4c102fa0 0x7f3e4c19ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.173+0000 7f3e515c0640 1 -- 172.21.15.70:0/1534815456 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3e4c110200 msgr2=0x7f3e4c1a1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:04.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.173+0000 7f3e515c0640 1 --2- 172.21.15.70:0/1534815456 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3e4c110200 0x7f3e4c1a1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.173+0000 7f3e515c0640 1 -- 172.21.15.70:0/1534815456 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e4c1a2600 con 0x7f3e4c102650 2024-09-21T05:49:04.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.173+0000 7f3e51dc1640 1 --2- 172.21.15.70:0/1534815456 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3e4c110200 0x7f3e4c1a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:49:04.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.173+0000 7f3e515c0640 1 --2- 172.21.15.70:0/1534815456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e4c102650 0x7f3e4c19c750 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3e48005940 tx=0x7f3e480042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:04.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.174+0000 7f3e427fc640 1 -- 172.21.15.70:0/1534815456 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4803f030 con 0x7f3e4c102650 2024-09-21T05:49:04.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.174+0000 7f3e427fc640 1 -- 172.21.15.70:0/1534815456 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f3e48003cb0 con 0x7f3e4c102650 2024-09-21T05:49:04.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.174+0000 7f3e53824640 1 -- 172.21.15.70:0/1534815456 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e4c1a2890 con 0x7f3e4c102650 2024-09-21T05:49:04.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.174+0000 7f3e427fc640 1 -- 172.21.15.70:0/1534815456 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e48035070 con 0x7f3e4c102650 2024-09-21T05:49:04.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.174+0000 7f3e53824640 1 -- 172.21.15.70:0/1534815456 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e4c1a2dc0 con 0x7f3e4c102650 2024-09-21T05:49:04.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.177+0000 7f3e59d98740 1 Processor -- start 2024-09-21T05:49:04.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.177+0000 7f3e59d98740 1 -- start start 2024-09-21T05:49:04.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.177+0000 7f3e59d98740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55943094cf60 0x559430cf2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:04.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.177+0000 7f3e59d98740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5594309240a0 0x559430cf3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:04.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.177+0000 7f3e59d98740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55943092c280 0x559430cf3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:04.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.177+0000 7f3e59d98740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559430c6ac10 con 0x55943094cf60 2024-09-21T05:49:04.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.177+0000 7f3e59d98740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559430c5a040 con 0x55943092c280 2024-09-21T05:49:04.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.177+0000 7f3e59d98740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x559430c5de50 con 0x5594309240a0 2024-09-21T05:49:04.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.177+0000 7f3e427fc640 1 -- 172.21.15.70:0/1534815456 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f3e48042030 con 0x7f3e4c102650 2024-09-21T05:49:04.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.177+0000 7f3e51dc1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55943094cf60 0x559430cf2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:04.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.177+0000 7f3e51dc1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55943094cf60 0x559430cf2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33134/0 (socket says 172.21.15.70:33134) 2024-09-21T05:49:04.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.177+0000 7f3e51dc1640 1 -- 172.21.15.70:0/260514272 learned_addr learned my addr 172.21.15.70:0/260514272 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:04.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.178+0000 7f3e50dbf640 1 --2- 172.21.15.70:0/260514272 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55943092c280 0x559430cf3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:04.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.178+0000 7f3e51dc1640 1 -- 172.21.15.70:0/260514272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5594309240a0 msgr2=0x559430cf3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:04.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.178+0000 7f3e51dc1640 1 --2- 172.21.15.70:0/260514272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5594309240a0 0x559430cf3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.178+0000 7f3e51dc1640 1 -- 172.21.15.70:0/260514272 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55943092c280 msgr2=0x559430cf3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:04.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.178+0000 7f3e51dc1640 1 --2- 172.21.15.70:0/260514272 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55943092c280 0x559430cf3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.178+0000 7f3e51dc1640 1 -- 172.21.15.70:0/260514272 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594309b8540 con 0x55943094cf60 2024-09-21T05:49:04.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.178+0000 7f3e51dc1640 1 --2- 172.21.15.70:0/260514272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55943094cf60 0x559430cf2f00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3e44008de0 tx=0x7f3e4400d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eedf21fd3ae8114a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:04.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.178+0000 7f3e427fc640 1 --2- 172.21.15.70:0/1534815456 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f3e380b6650 0x7f3e380b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:04.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.178+0000 7f3e377fe640 1 -- 172.21.15.70:0/260514272 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4400f830 con 0x55943094cf60 2024-09-21T05:49:04.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.178+0000 7f3e377fe640 1 -- 172.21.15.70:0/260514272 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f3e4400de20 con 0x55943094cf60 2024-09-21T05:49:04.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.178+0000 7f3e377fe640 1 -- 172.21.15.70:0/260514272 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4400e3b0 con 0x55943094cf60 2024-09-21T05:49:04.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.178+0000 7f3e515c0640 1 --2- 172.21.15.70:0/1534815456 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f3e380b6650 0x7f3e380b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:04.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.178+0000 7f3e427fc640 1 -- 172.21.15.70:0/1534815456 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f3e48107e80 con 0x7f3e4c102650 2024-09-21T05:49:04.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.179+0000 7f3e59d98740 1 -- 172.21.15.70:0/260514272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55943094cf60 msgr2=0x559430cf2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:04.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.179+0000 7f3e515c0640 1 --2- 172.21.15.70:0/1534815456 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f3e380b6650 0x7f3e380b8b60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3e480ca030 tx=0x7f3e4802a480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:04.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.179+0000 7f3e59d98740 1 --2- 172.21.15.70:0/260514272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55943094cf60 0x559430cf2f00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3e44008de0 tx=0x7f3e4400d710 comp rx=0 tx=0).stop 2024-09-21T05:49:04.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.179+0000 7f3e59d98740 1 -- 172.21.15.70:0/260514272 shutdown_connections 2024-09-21T05:49:04.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.179+0000 7f3e59d98740 1 --2- 172.21.15.70:0/260514272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5594309240a0 0x559430cf3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.179+0000 7f3e59d98740 1 --2- 172.21.15.70:0/260514272 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55943092c280 0x559430cf3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.179+0000 7f3e59d98740 1 --2- 172.21.15.70:0/260514272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55943094cf60 0x559430cf2f00 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.179+0000 7f3e59d98740 1 -- 172.21.15.70:0/260514272 >> 172.21.15.70:0/260514272 conn(0x559430941350 msgr2=0x559430cf0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:04.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.179+0000 7f3e59d98740 1 -- 172.21.15.70:0/260514272 shutdown_connections 2024-09-21T05:49:04.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.179+0000 7f3e59d98740 1 -- 172.21.15.70:0/260514272 wait complete. 2024-09-21T05:49:04.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.180+0000 7f3e59d98740 1 -- start start 2024-09-21T05:49:04.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.180+0000 7f3e59d98740 1 Processor -- start 2024-09-21T05:49:04.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.180+0000 7f3e59d98740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594309240a0 0x559430cfe9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:04.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.180+0000 7f3e59d98740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55943092c280 0x559430cfef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:04.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.180+0000 7f3e59d98740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55943094cf60 0x559430d0aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:04.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.180+0000 7f3e59d98740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559430abb5f0 con 0x5594309240a0 2024-09-21T05:49:04.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.180+0000 7f3e59d98740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559430bf5010 con 0x55943094cf60 2024-09-21T05:49:04.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.180+0000 7f3e59d98740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x559430d016e0 con 0x55943092c280 2024-09-21T05:49:04.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.180+0000 7f3e59d98740 10 client.0 _ll_register_callbacks cb 0x559430c54340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:49:04.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.180+0000 7f3e51dc1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594309240a0 0x559430cfe9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:04.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.180+0000 7f3e51dc1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594309240a0 0x559430cfe9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33150/0 (socket says 172.21.15.70:33150) 2024-09-21T05:49:04.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.180+0000 7f3e51dc1640 1 -- 172.21.15.70:0/3150605892 learned_addr learned my addr 172.21.15.70:0/3150605892 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:04.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.181+0000 7f3e50dbf640 1 --2- 172.21.15.70:0/3150605892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55943092c280 0x559430cfef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:04.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.181+0000 7f3e51dc1640 1 -- 172.21.15.70:0/3150605892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55943092c280 msgr2=0x559430cfef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:04.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.181+0000 7f3e51dc1640 1 --2- 172.21.15.70:0/3150605892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55943092c280 0x559430cfef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.181+0000 7f3e51dc1640 1 -- 172.21.15.70:0/3150605892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55943094cf60 msgr2=0x559430d0aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:04.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.181+0000 7f3e51dc1640 1 --2- 172.21.15.70:0/3150605892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55943094cf60 0x559430d0aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.181+0000 7f3e51dc1640 1 -- 172.21.15.70:0/3150605892 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559430c22a00 con 0x5594309240a0 2024-09-21T05:49:04.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.181+0000 7f3e50dbf640 1 --2- 172.21.15.70:0/3150605892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55943092c280 0x559430cfef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:04.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.181+0000 7f3e51dc1640 1 --2- 172.21.15.70:0/3150605892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594309240a0 0x559430cfe9d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3e44005fb0 tx=0x7f3e440186b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7efbadaafea07eed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:04.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.181+0000 7f3e34ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:49:04.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.181+0000 7f3e34ff9640 1 -- 172.21.15.70:0/3150605892 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4400f830 con 0x5594309240a0 2024-09-21T05:49:04.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.181+0000 7f3e34ff9640 1 -- 172.21.15.70:0/3150605892 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f3e4400f9d0 con 0x5594309240a0 2024-09-21T05:49:04.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.181+0000 7f3e59d98740 1 -- 172.21.15.70:0/3150605892 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e4400de20 con 0x5594309240a0 2024-09-21T05:49:04.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.181+0000 7f3e34ff9640 1 -- 172.21.15.70:0/3150605892 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3e4402f050 con 0x5594309240a0 2024-09-21T05:49:04.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.181+0000 7f3e59d98740 10 client.15321 fetch_fsmap learned FSMap version 27 2024-09-21T05:49:04.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.181+0000 7f3e59d98740 1 -- 172.21.15.70:0/3150605892 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559430d0d630 con 0x5594309240a0 2024-09-21T05:49:04.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.182+0000 7f3e34ff9640 1 -- 172.21.15.70:0/3150605892 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f3e4400de20 con 0x5594309240a0 2024-09-21T05:49:04.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.182+0000 7f3e34ff9640 1 -- 172.21.15.70:0/3150605892 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f3e44026470 con 0x5594309240a0 2024-09-21T05:49:04.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.182+0000 7f3e59d98740 10 client.15321 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T05:49:04.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.182+0000 7f3e59d98740 10 client.15321 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T05:49:04.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.182+0000 7f3e59d98740 20 client.15321 populate_metadata read hostname 'smithi070' 2024-09-21T05:49:04.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.182+0000 7f3e59d98740 1 --2- 172.21.15.70:0/3150605892 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55943090b8e0 0x559430d0ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:04.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.182+0000 7f3e59d98740 4 client.15321 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:49:04.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.182+0000 7f3e59d98740 1 -- 172.21.15.70:0/3150605892 --> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559430c6cb60 con 0x55943090b8e0 2024-09-21T05:49:04.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.182+0000 7f3e50dbf640 1 --2- 172.21.15.70:0/3150605892 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55943090b8e0 0x559430d0ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:04.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.183+0000 7f3e50dbf640 1 --2- 172.21.15.70:0/3150605892 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55943090b8e0 0x559430d0ea90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fc4e5195028a4e3 server_cookie=1cc1e7b789a040b1 in_seq=0 out_seq=0 2024-09-21T05:49:04.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.183+0000 7f3e34ff9640 10 client.15321 ms_handle_connect on v2:172.21.15.116:6838/3952175670 2024-09-21T05:49:04.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.184+0000 7f3e34ff9640 1 -- 172.21.15.70:0/3150605892 <== mds.0 v2:172.21.15.116:6838/3952175670 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559430c6cb60 con 0x55943090b8e0 2024-09-21T05:49:04.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.184+0000 7f3e34ff9640 10 client.15321 handle_command_reply: tid=0 2024-09-21T05:49:04.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.184+0000 7f3e59d98740 1 client.15321 shutdown 2024-09-21T05:49:04.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.184+0000 7f3e59d98740 1 -- 172.21.15.70:0/3150605892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594309240a0 msgr2=0x559430cfe9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:04.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.184+0000 7f3e59d98740 1 --2- 172.21.15.70:0/3150605892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594309240a0 0x559430cfe9d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3e44005fb0 tx=0x7f3e440186b0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.184+0000 7f3e59d98740 1 -- 172.21.15.70:0/3150605892 shutdown_connections 2024-09-21T05:49:04.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.184+0000 7f3e59d98740 1 --2- 172.21.15.70:0/3150605892 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55943090b8e0 0x559430d0ea90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.184+0000 7f3e59d98740 1 --2- 172.21.15.70:0/3150605892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55943092c280 0x559430cfef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.184+0000 7f3e59d98740 1 --2- 172.21.15.70:0/3150605892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55943094cf60 0x559430d0aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.184+0000 7f3e59d98740 1 --2- 172.21.15.70:0/3150605892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594309240a0 0x559430cfe9d0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.184+0000 7f3e59d98740 1 -- 172.21.15.70:0/3150605892 >> 172.21.15.70:0/3150605892 conn(0x559430941350 msgr2=0x559430cf60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:04.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.184+0000 7f3e34ff9640 0 client.15321 ms_handle_reset on v2:172.21.15.116:6838/3952175670 2024-09-21T05:49:04.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.184+0000 7f3e59d98740 1 -- 172.21.15.70:0/3150605892 shutdown_connections 2024-09-21T05:49:04.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.184+0000 7f3e59d98740 1 -- 172.21.15.70:0/3150605892 wait complete. 2024-09-21T05:49:04.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.184+0000 7f3e59d98740 20 client.15321 trim_cache size 0 max 16384 2024-09-21T05:49:04.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.202+0000 7f3e59d98740 1 Processor -- start 2024-09-21T05:49:04.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.202+0000 7f3e59d98740 1 -- start start 2024-09-21T05:49:04.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.202+0000 7f3e59d98740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5594309240a0 0x559430cf9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:04.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.202+0000 7f3e59d98740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55943092c280 0x559430d0a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:04.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.202+0000 7f3e59d98740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55943094cf60 0x559430d0aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:04.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.202+0000 7f3e59d98740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559430d0efe0 con 0x55943094cf60 2024-09-21T05:49:04.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.202+0000 7f3e59d98740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559430d0f6b0 con 0x55943092c280 2024-09-21T05:49:04.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.202+0000 7f3e59d98740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x559430d0fd80 con 0x5594309240a0 2024-09-21T05:49:04.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.202+0000 7f3e51dc1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55943094cf60 0x559430d0aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:04.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.202+0000 7f3e51dc1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55943094cf60 0x559430d0aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33154/0 (socket says 172.21.15.70:33154) 2024-09-21T05:49:04.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.202+0000 7f3e51dc1640 1 -- 172.21.15.70:0/3913942535 learned_addr learned my addr 172.21.15.70:0/3913942535 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:04.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.202+0000 7f3e50dbf640 1 --2- 172.21.15.70:0/3913942535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55943092c280 0x559430d0a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:04.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.202+0000 7f3e51dc1640 1 --2- 172.21.15.70:0/3913942535 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5594309240a0 0x559430cf9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:04.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.202+0000 7f3e51dc1640 1 -- 172.21.15.70:0/3913942535 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5594309240a0 msgr2=0x559430cf9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:04.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.202+0000 7f3e51dc1640 1 --2- 172.21.15.70:0/3913942535 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5594309240a0 0x559430cf9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.202+0000 7f3e51dc1640 1 -- 172.21.15.70:0/3913942535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55943092c280 msgr2=0x559430d0a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:04.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.202+0000 7f3e51dc1640 1 --2- 172.21.15.70:0/3913942535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55943092c280 0x559430d0a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.202+0000 7f3e51dc1640 1 -- 172.21.15.70:0/3913942535 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559430cf5d60 con 0x55943094cf60 2024-09-21T05:49:04.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.203+0000 7f3e50dbf640 1 --2- 172.21.15.70:0/3913942535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55943092c280 0x559430d0a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:04.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.203+0000 7f3e51dc1640 1 --2- 172.21.15.70:0/3913942535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55943094cf60 0x559430d0aee0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3e44018c20 tx=0x7f3e4400d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c0a55c4c5136cc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:04.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.203+0000 7f3e36ffd640 1 -- 172.21.15.70:0/3913942535 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4402c040 con 0x55943094cf60 2024-09-21T05:49:04.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.203+0000 7f3e36ffd640 1 -- 172.21.15.70:0/3913942535 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f3e44021070 con 0x55943094cf60 2024-09-21T05:49:04.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.203+0000 7f3e36ffd640 1 -- 172.21.15.70:0/3913942535 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4400fd40 con 0x55943094cf60 2024-09-21T05:49:04.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.204+0000 7f3e59d98740 1 -- 172.21.15.70:0/3913942535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55943094cf60 msgr2=0x559430d0aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:04.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.204+0000 7f3e59d98740 1 --2- 172.21.15.70:0/3913942535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55943094cf60 0x559430d0aee0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3e44018c20 tx=0x7f3e4400d710 comp rx=0 tx=0).stop 2024-09-21T05:49:04.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.204+0000 7f3e59d98740 1 -- 172.21.15.70:0/3913942535 shutdown_connections 2024-09-21T05:49:04.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.204+0000 7f3e59d98740 1 --2- 172.21.15.70:0/3913942535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55943094cf60 0x559430d0aee0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.204+0000 7f3e59d98740 1 --2- 172.21.15.70:0/3913942535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55943092c280 0x559430d0a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.204+0000 7f3e59d98740 1 --2- 172.21.15.70:0/3913942535 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5594309240a0 0x559430cf9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.204+0000 7f3e59d98740 1 -- 172.21.15.70:0/3913942535 >> 172.21.15.70:0/3913942535 conn(0x559430941350 msgr2=0x559430cf9980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.204+0000 7f3e59d98740 1 -- 172.21.15.70:0/3913942535 shutdown_connections 2024-09-21T05:49:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.204+0000 7f3e59d98740 1 -- 172.21.15.70:0/3913942535 wait complete. 2024-09-21T05:49:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.204+0000 7f3e59d98740 1 -- start start 2024-09-21T05:49:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.204+0000 7f3e59d98740 1 Processor -- start 2024-09-21T05:49:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.205+0000 7f3e59d98740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594309240a0 0x559430d195c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.205+0000 7f3e59d98740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55943092c280 0x559430d12a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.205+0000 7f3e59d98740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55943094cf60 0x559430d12fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.205+0000 7f3e59d98740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559430d10b20 con 0x5594309240a0 2024-09-21T05:49:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.205+0000 7f3e59d98740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559430d10450 con 0x55943092c280 2024-09-21T05:49:04.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.205+0000 7f3e59d98740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x559430d111f0 con 0x55943094cf60 2024-09-21T05:49:04.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.205+0000 7f3e59d98740 10 client.0 _ll_register_callbacks cb 0x7f3e3c00b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:49:04.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.205+0000 7f3e51dc1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594309240a0 0x559430d195c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:04.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.205+0000 7f3e51dc1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594309240a0 0x559430d195c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33166/0 (socket says 172.21.15.70:33166) 2024-09-21T05:49:04.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.205+0000 7f3e51dc1640 1 -- 172.21.15.70:0/791832180 learned_addr learned my addr 172.21.15.70:0/791832180 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:04.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.205+0000 7f3e50dbf640 1 --2- 172.21.15.70:0/791832180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55943092c280 0x559430d12a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:04.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.205+0000 7f3e51dc1640 1 -- 172.21.15.70:0/791832180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55943094cf60 msgr2=0x559430d12fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:04.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.205+0000 7f3e51dc1640 1 --2- 172.21.15.70:0/791832180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55943094cf60 0x559430d12fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.205+0000 7f3e51dc1640 1 -- 172.21.15.70:0/791832180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55943092c280 msgr2=0x559430d12a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:04.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.205+0000 7f3e51dc1640 1 --2- 172.21.15.70:0/791832180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55943092c280 0x559430d12a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.205+0000 7f3e51dc1640 1 -- 172.21.15.70:0/791832180 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559430d135f0 con 0x5594309240a0 2024-09-21T05:49:04.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.205+0000 7f3e51dc1640 1 --2- 172.21.15.70:0/791832180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594309240a0 0x559430d195c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3e44008aa0 tx=0x7f3e44026e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d0446be93a6ab8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:04.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.205+0000 7f3e34ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:49:04.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.205+0000 7f3e34ff9640 1 -- 172.21.15.70:0/791832180 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4400de20 con 0x5594309240a0 2024-09-21T05:49:04.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.205+0000 7f3e34ff9640 1 -- 172.21.15.70:0/791832180 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f3e4400f630 con 0x5594309240a0 2024-09-21T05:49:04.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.205+0000 7f3e59d98740 1 -- 172.21.15.70:0/791832180 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e44021070 con 0x5594309240a0 2024-09-21T05:49:04.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.206+0000 7f3e34ff9640 1 -- 172.21.15.70:0/791832180 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3e4404b050 con 0x5594309240a0 2024-09-21T05:49:04.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.206+0000 7f3e59d98740 10 client.15327 fetch_fsmap learned FSMap version 27 2024-09-21T05:49:04.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.206+0000 7f3e59d98740 1 -- 172.21.15.70:0/791832180 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559430d18fd0 con 0x5594309240a0 2024-09-21T05:49:04.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.206+0000 7f3e34ff9640 1 -- 172.21.15.70:0/791832180 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f3e44021070 con 0x5594309240a0 2024-09-21T05:49:04.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.206+0000 7f3e34ff9640 1 -- 172.21.15.70:0/791832180 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f3e44046030 con 0x5594309240a0 2024-09-21T05:49:04.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.206+0000 7f3e59d98740 10 client.15327 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T05:49:04.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.206+0000 7f3e59d98740 10 client.15327 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T05:49:04.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.206+0000 7f3e59d98740 20 client.15327 populate_metadata read hostname 'smithi070' 2024-09-21T05:49:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.206+0000 7f3e59d98740 1 --2- 172.21.15.70:0/791832180 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x5594308e0c90 0x559430d7f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.206+0000 7f3e59d98740 4 client.15327 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T05:49:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.206+0000 7f3e59d98740 1 -- 172.21.15.70:0/791832180 --> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] -- command(tid 0: {"prefix": "status"}) -- 0x559430c68610 con 0x5594308e0c90 2024-09-21T05:49:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.207+0000 7f3e50dbf640 1 --2- 172.21.15.70:0/791832180 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x5594308e0c90 0x559430d7f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.207+0000 7f3e34ff9640 10 client.15327 ms_handle_connect on v2:172.21.15.116:6838/3952175670 2024-09-21T05:49:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.207+0000 7f3e50dbf640 1 --2- 172.21.15.70:0/791832180 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x5594308e0c90 0x559430d7f5b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc32ab09d42e5d20 server_cookie=80a661fad43dd16a in_seq=0 out_seq=0 2024-09-21T05:49:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.207+0000 7f3e34ff9640 1 -- 172.21.15.70:0/791832180 <== mds.0 v2:172.21.15.116:6838/3952175670 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x559430c68610 con 0x5594308e0c90 2024-09-21T05:49:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.207+0000 7f3e34ff9640 10 client.15327 handle_command_reply: tid=0 2024-09-21T05:49:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.207+0000 7f3e59d98740 1 client.15327 shutdown 2024-09-21T05:49:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.207+0000 7f3e59d98740 1 -- 172.21.15.70:0/791832180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594309240a0 msgr2=0x559430d195c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.207+0000 7f3e59d98740 1 --2- 172.21.15.70:0/791832180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594309240a0 0x559430d195c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3e44008aa0 tx=0x7f3e44026e10 comp rx=0 tx=0).stop 2024-09-21T05:49:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.207+0000 7f3e59d98740 1 -- 172.21.15.70:0/791832180 shutdown_connections 2024-09-21T05:49:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.207+0000 7f3e59d98740 1 --2- 172.21.15.70:0/791832180 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x5594308e0c90 0x559430d7f5b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.207+0000 7f3e59d98740 1 --2- 172.21.15.70:0/791832180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55943094cf60 0x559430d12fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.207+0000 7f3e34ff9640 0 client.15327 ms_handle_reset on v2:172.21.15.116:6838/3952175670 2024-09-21T05:49:04.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.207+0000 7f3e59d98740 1 --2- 172.21.15.70:0/791832180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55943092c280 0x559430d12a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.207+0000 7f3e59d98740 1 --2- 172.21.15.70:0/791832180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594309240a0 0x559430d195c0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.207+0000 7f3e59d98740 1 -- 172.21.15.70:0/791832180 >> 172.21.15.70:0/791832180 conn(0x559430941350 msgr2=0x559430cf0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:04.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.208+0000 7f3e59d98740 1 -- 172.21.15.70:0/791832180 shutdown_connections 2024-09-21T05:49:04.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.208+0000 7f3e59d98740 1 -- 172.21.15.70:0/791832180 wait complete. 2024-09-21T05:49:04.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.208+0000 7f3e59d98740 20 client.15327 trim_cache size 0 max 16384 2024-09-21T05:49:04.216 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:49:04.216 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "96c6636e-77db-11ef-baf5-efdc52797490", 2024-09-21T05:49:04.217 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 0, 2024-09-21T05:49:04.217 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24641, 2024-09-21T05:49:04.217 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-21T05:49:04.217 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-21T05:49:04.217 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-21T05:49:04.217 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 117.59109567599999, 2024-09-21T05:49:04.217 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2024-09-21T05:49:04.217 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 85, 2024-09-21T05:49:04.217 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 83, 2024-09-21T05:49:04.217 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 128.08379099999999 2024-09-21T05:49:04.217 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:49:04.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.208+0000 7f3e53824640 1 -- 172.21.15.70:0/1534815456 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f3e380b6650 msgr2=0x7f3e380b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:04.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.208+0000 7f3e53824640 1 --2- 172.21.15.70:0/1534815456 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f3e380b6650 0x7f3e380b8b60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3e480ca030 tx=0x7f3e4802a480 comp rx=0 tx=0).stop 2024-09-21T05:49:04.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.208+0000 7f3e53824640 1 -- 172.21.15.70:0/1534815456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e4c102650 msgr2=0x7f3e4c19c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:04.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.208+0000 7f3e53824640 1 --2- 172.21.15.70:0/1534815456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e4c102650 0x7f3e4c19c750 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3e48005940 tx=0x7f3e480042f0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.208+0000 7f3e53824640 1 -- 172.21.15.70:0/1534815456 shutdown_connections 2024-09-21T05:49:04.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.208+0000 7f3e53824640 1 --2- 172.21.15.70:0/1534815456 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f3e380b6650 0x7f3e380b8b60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.208+0000 7f3e53824640 1 --2- 172.21.15.70:0/1534815456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e4c102fa0 0x7f3e4c19ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.208+0000 7f3e53824640 1 --2- 172.21.15.70:0/1534815456 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3e4c110200 0x7f3e4c1a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.208+0000 7f3e53824640 1 --2- 172.21.15.70:0/1534815456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e4c102650 0x7f3e4c19c750 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:04.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.208+0000 7f3e53824640 1 -- 172.21.15.70:0/1534815456 >> 172.21.15.70:0/1534815456 conn(0x7f3e4c0796b0 msgr2=0x7f3e4c111750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:04.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.208+0000 7f3e53824640 1 -- 172.21.15.70:0/1534815456 shutdown_connections 2024-09-21T05:49:04.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:04.209+0000 7f3e53824640 1 -- 172.21.15.70:0/1534815456 wait complete. 2024-09-21T05:49:04.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:04 smithi070 ceph-mon[30981]: pgmap v358: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T05:49:05.079 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T05:49:05.079 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T05:49:05.089 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi070.front.sepia.ceph.com 2024-09-21T05:49:05.089 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T05:49:05.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:04 smithi160 ceph-mon[33979]: pgmap v358: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T05:49:05.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:04 smithi116 ceph-mon[34332]: pgmap v358: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T05:49:05.347 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:05.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:05 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:49:06.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:05 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:49:06.115 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:05 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:49:06.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.593+0000 7f3457819640 1 -- 172.21.15.70:0/3141598382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3450104080 msgr2=0x7f345010aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:06.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.593+0000 7f3457819640 1 --2- 172.21.15.70:0/3141598382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3450104080 0x7f345010aa20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3448009ca0 tx=0x7f344802a950 comp rx=0 tx=0).stop 2024-09-21T05:49:06.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.593+0000 7f3457819640 1 -- 172.21.15.70:0/3141598382 shutdown_connections 2024-09-21T05:49:06.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.593+0000 7f3457819640 1 --2- 172.21.15.70:0/3141598382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3450104080 0x7f345010aa20 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:06.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.593+0000 7f3457819640 1 --2- 172.21.15.70:0/3141598382 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34501036e0 0x7f3450103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:06.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.593+0000 7f3457819640 1 --2- 172.21.15.70:0/3141598382 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3450102650 0x7f3450102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:06.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.593+0000 7f3457819640 1 -- 172.21.15.70:0/3141598382 >> 172.21.15.70:0/3141598382 conn(0x7f34500fdfe0 msgr2=0x7f3450100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:06.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.593+0000 7f3457819640 1 -- 172.21.15.70:0/3141598382 shutdown_connections 2024-09-21T05:49:06.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.593+0000 7f3457819640 1 -- 172.21.15.70:0/3141598382 wait complete. 2024-09-21T05:49:06.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.594+0000 7f3457819640 1 Processor -- start 2024-09-21T05:49:06.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.594+0000 7f3457819640 1 -- start start 2024-09-21T05:49:06.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.594+0000 7f3457819640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3450102650 0x7f345010cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:06.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.594+0000 7f3457819640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34501036e0 0x7f345010b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:06.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.594+0000 7f3457819640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3450104080 0x7f345010bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:06.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.594+0000 7f3457819640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f345010f380 con 0x7f34501036e0 2024-09-21T05:49:06.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.594+0000 7f3457819640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f345010f200 con 0x7f3450104080 2024-09-21T05:49:06.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.594+0000 7f3457819640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f345010f500 con 0x7f3450102650 2024-09-21T05:49:06.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.594+0000 7f3454db4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34501036e0 0x7f345010b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:06.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.594+0000 7f3454db4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34501036e0 0x7f345010b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33174/0 (socket says 172.21.15.70:33174) 2024-09-21T05:49:06.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.594+0000 7f3454db4640 1 -- 172.21.15.70:0/2945679939 learned_addr learned my addr 172.21.15.70:0/2945679939 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:06.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.594+0000 7f34555b5640 1 --2- 172.21.15.70:0/2945679939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3450102650 0x7f345010cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:06.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.594+0000 7f3455db6640 1 --2- 172.21.15.70:0/2945679939 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3450104080 0x7f345010bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:06.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.595+0000 7f3454db4640 1 -- 172.21.15.70:0/2945679939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3450102650 msgr2=0x7f345010cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:06.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.595+0000 7f3454db4640 1 --2- 172.21.15.70:0/2945679939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3450102650 0x7f345010cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:06.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.595+0000 7f3454db4640 1 -- 172.21.15.70:0/2945679939 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3450104080 msgr2=0x7f345010bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:06.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.595+0000 7f3454db4640 1 --2- 172.21.15.70:0/2945679939 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3450104080 0x7f345010bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:06.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.595+0000 7f3454db4640 1 -- 172.21.15.70:0/2945679939 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f345010c2a0 con 0x7f34501036e0 2024-09-21T05:49:06.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.595+0000 7f3454db4640 1 --2- 172.21.15.70:0/2945679939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34501036e0 0x7f345010b660 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f344000d950 tx=0x7f344000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:06.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.595+0000 7f34467fc640 1 -- 172.21.15.70:0/2945679939 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3440017070 con 0x7f34501036e0 2024-09-21T05:49:06.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.595+0000 7f34467fc640 1 -- 172.21.15.70:0/2945679939 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f3440009c30 con 0x7f34501036e0 2024-09-21T05:49:06.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.595+0000 7f3457819640 1 -- 172.21.15.70:0/2945679939 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34501a3fe0 con 0x7f34501036e0 2024-09-21T05:49:06.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.595+0000 7f34467fc640 1 -- 172.21.15.70:0/2945679939 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344000f620 con 0x7f34501036e0 2024-09-21T05:49:06.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.595+0000 7f3457819640 1 -- 172.21.15.70:0/2945679939 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34501a4380 con 0x7f34501036e0 2024-09-21T05:49:06.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.596+0000 7f3457819640 1 -- 172.21.15.70:0/2945679939 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3450102ac0 con 0x7f34501036e0 2024-09-21T05:49:06.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.598+0000 7f34467fc640 1 -- 172.21.15.70:0/2945679939 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f34400109a0 con 0x7f34501036e0 2024-09-21T05:49:06.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.598+0000 7f34467fc640 1 --2- 172.21.15.70:0/2945679939 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f343c0b65a0 0x7f343c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:06.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.598+0000 7f34555b5640 1 --2- 172.21.15.70:0/2945679939 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f343c0b65a0 0x7f343c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:06.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.598+0000 7f34467fc640 1 -- 172.21.15.70:0/2945679939 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f34400e73c0 con 0x7f34501036e0 2024-09-21T05:49:06.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.599+0000 7f34555b5640 1 --2- 172.21.15.70:0/2945679939 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f343c0b65a0 0x7f343c0b8ab0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f344c005d00 tx=0x7f344c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:06.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.601+0000 7f34467fc640 1 -- 172.21.15.70:0/2945679939 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3440009de0 con 0x7f34501036e0 2024-09-21T05:49:06.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.855+0000 7f3457819640 1 -- 172.21.15.70:0/2945679939 --> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f34500638c0 con 0x7f343c0b65a0 2024-09-21T05:49:06.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.862+0000 7f34467fc640 1 -- 172.21.15.70:0/2945679939 <== mgr.14150 v2:172.21.15.70:6800/1366013939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f34500638c0 con 0x7f343c0b65a0 2024-09-21T05:49:06.864 INFO:teuthology.orchestra.run.smithi070.stdout:Backend: cephadm 2024-09-21T05:49:06.864 INFO:teuthology.orchestra.run.smithi070.stdout:Available: Yes 2024-09-21T05:49:06.864 INFO:teuthology.orchestra.run.smithi070.stdout:Paused: No 2024-09-21T05:49:06.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.865+0000 7f3457819640 1 -- 172.21.15.70:0/2945679939 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f343c0b65a0 msgr2=0x7f343c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:06.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.865+0000 7f3457819640 1 --2- 172.21.15.70:0/2945679939 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f343c0b65a0 0x7f343c0b8ab0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f344c005d00 tx=0x7f344c00b410 comp rx=0 tx=0).stop 2024-09-21T05:49:06.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.865+0000 7f3457819640 1 -- 172.21.15.70:0/2945679939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34501036e0 msgr2=0x7f345010b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:06.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.865+0000 7f3457819640 1 --2- 172.21.15.70:0/2945679939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34501036e0 0x7f345010b660 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f344000d950 tx=0x7f344000de10 comp rx=0 tx=0).stop 2024-09-21T05:49:06.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.865+0000 7f3457819640 1 -- 172.21.15.70:0/2945679939 shutdown_connections 2024-09-21T05:49:06.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.865+0000 7f3457819640 1 --2- 172.21.15.70:0/2945679939 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f343c0b65a0 0x7f343c0b8ab0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:06.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.865+0000 7f3457819640 1 --2- 172.21.15.70:0/2945679939 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3450104080 0x7f345010bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:06.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.865+0000 7f3457819640 1 --2- 172.21.15.70:0/2945679939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34501036e0 0x7f345010b660 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:06.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.865+0000 7f3457819640 1 --2- 172.21.15.70:0/2945679939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3450102650 0x7f345010cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:06.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.865+0000 7f3457819640 1 -- 172.21.15.70:0/2945679939 >> 172.21.15.70:0/2945679939 conn(0x7f34500fdfe0 msgr2=0x7f3450106a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:06.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.865+0000 7f3457819640 1 -- 172.21.15.70:0/2945679939 shutdown_connections 2024-09-21T05:49:06.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:06.865+0000 7f3457819640 1 -- 172.21.15.70:0/2945679939 wait complete. 2024-09-21T05:49:07.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:06 smithi160 ceph-mon[33979]: pgmap v359: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T05:49:07.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:06 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:49:07.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:06 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:49:07.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:06 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:49:07.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:06 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:49:07.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:06 smithi070 ceph-mon[30981]: pgmap v359: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T05:49:07.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:06 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:49:07.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:06 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:49:07.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:06 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:49:07.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:06 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:49:07.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:06 smithi116 ceph-mon[34332]: pgmap v359: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T05:49:07.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:06 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:49:07.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:06 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:49:07.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:06 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:49:07.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:06 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:49:07.678 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T05:49:07.944 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:07.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:07 smithi070 ceph-mon[30981]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:08.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:07 smithi160 ceph-mon[33979]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:08.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:07 smithi116 ceph-mon[34332]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:08.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.445+0000 7f8554594640 1 -- 172.21.15.70:0/2441093921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f854c104070 msgr2=0x7f854c10aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:08.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.445+0000 7f8554594640 1 --2- 172.21.15.70:0/2441093921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f854c104070 0x7f854c10aa10 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8544009900 tx=0x7f854402a480 comp rx=0 tx=0).stop 2024-09-21T05:49:08.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.445+0000 7f8554594640 1 -- 172.21.15.70:0/2441093921 shutdown_connections 2024-09-21T05:49:08.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.445+0000 7f8554594640 1 --2- 172.21.15.70:0/2441093921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f854c104070 0x7f854c10aa10 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:08.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.445+0000 7f8554594640 1 --2- 172.21.15.70:0/2441093921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f854c1036d0 0x7f854c103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:08.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.445+0000 7f8554594640 1 --2- 172.21.15.70:0/2441093921 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f854c102640 0x7f854c102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:08.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.445+0000 7f8554594640 1 -- 172.21.15.70:0/2441093921 >> 172.21.15.70:0/2441093921 conn(0x7f854c0fdfb0 msgr2=0x7f854c100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:08.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.445+0000 7f8554594640 1 -- 172.21.15.70:0/2441093921 shutdown_connections 2024-09-21T05:49:08.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.445+0000 7f8554594640 1 -- 172.21.15.70:0/2441093921 wait complete. 2024-09-21T05:49:08.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.446+0000 7f8554594640 1 Processor -- start 2024-09-21T05:49:08.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.446+0000 7f8554594640 1 -- start start 2024-09-21T05:49:08.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.446+0000 7f8554594640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f854c102640 0x7f854c199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:08.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.446+0000 7f8554594640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f854c1036d0 0x7f854c19a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:08.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.446+0000 7f8554594640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f854c104070 0x7f854c19b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:08.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.446+0000 7f8554594640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f854c10e2f0 con 0x7f854c104070 2024-09-21T05:49:08.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.446+0000 7f8554594640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f854c10e170 con 0x7f854c1036d0 2024-09-21T05:49:08.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.446+0000 7f8554594640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f854c10e470 con 0x7f854c102640 2024-09-21T05:49:08.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.446+0000 7f8552b31640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f854c104070 0x7f854c19b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:08.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.446+0000 7f8552b31640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f854c104070 0x7f854c19b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33190/0 (socket says 172.21.15.70:33190) 2024-09-21T05:49:08.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.446+0000 7f8552b31640 1 -- 172.21.15.70:0/2473708011 learned_addr learned my addr 172.21.15.70:0/2473708011 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:08.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.446+0000 7f8552330640 1 --2- 172.21.15.70:0/2473708011 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f854c102640 0x7f854c199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:08.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.446+0000 7f8552b31640 1 -- 172.21.15.70:0/2473708011 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f854c102640 msgr2=0x7f854c199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:08.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.446+0000 7f8551b2f640 1 --2- 172.21.15.70:0/2473708011 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f854c1036d0 0x7f854c19a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:08.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.446+0000 7f8552b31640 1 --2- 172.21.15.70:0/2473708011 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f854c102640 0x7f854c199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:08.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.446+0000 7f8552b31640 1 -- 172.21.15.70:0/2473708011 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f854c1036d0 msgr2=0x7f854c19a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:08.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.446+0000 7f8552b31640 1 --2- 172.21.15.70:0/2473708011 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f854c1036d0 0x7f854c19a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:08.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.446+0000 7f8552b31640 1 -- 172.21.15.70:0/2473708011 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854c19ba20 con 0x7f854c104070 2024-09-21T05:49:08.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.447+0000 7f8552b31640 1 --2- 172.21.15.70:0/2473708011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f854c104070 0x7f854c19b200 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f8544005940 tx=0x7f85440042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:08.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.447+0000 7f854b7fe640 1 -- 172.21.15.70:0/2473708011 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854403f030 con 0x7f854c104070 2024-09-21T05:49:08.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.447+0000 7f8554594640 1 -- 172.21.15.70:0/2473708011 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f854c19bcb0 con 0x7f854c104070 2024-09-21T05:49:08.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.447+0000 7f854b7fe640 1 -- 172.21.15.70:0/2473708011 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f8544003cb0 con 0x7f854c104070 2024-09-21T05:49:08.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.447+0000 7f854b7fe640 1 -- 172.21.15.70:0/2473708011 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8544035070 con 0x7f854c104070 2024-09-21T05:49:08.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.447+0000 7f8554594640 1 -- 172.21.15.70:0/2473708011 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f854c1a22c0 con 0x7f854c104070 2024-09-21T05:49:08.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.448+0000 7f8554594640 1 -- 172.21.15.70:0/2473708011 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f854c1a2520 con 0x7f854c104070 2024-09-21T05:49:08.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.449+0000 7f854b7fe640 1 -- 172.21.15.70:0/2473708011 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f8544042030 con 0x7f854c104070 2024-09-21T05:49:08.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.450+0000 7f854b7fe640 1 --2- 172.21.15.70:0/2473708011 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f85340b65a0 0x7f85340b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:08.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.450+0000 7f8552330640 1 --2- 172.21.15.70:0/2473708011 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f85340b65a0 0x7f85340b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:08.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.451+0000 7f854b7fe640 1 -- 172.21.15.70:0/2473708011 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f8544108390 con 0x7f854c104070 2024-09-21T05:49:08.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.451+0000 7f8552330640 1 --2- 172.21.15.70:0/2473708011 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f85340b65a0 0x7f85340b8ab0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f853c005fd0 tx=0x7f853c009870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:08.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.454+0000 7f854b7fe640 1 -- 172.21.15.70:0/2473708011 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f85440ce6d0 con 0x7f854c104070 2024-09-21T05:49:08.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.644+0000 7f8554594640 1 -- 172.21.15.70:0/2473708011 --> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f854c0fff80 con 0x7f85340b65a0 2024-09-21T05:49:08.659 INFO:teuthology.orchestra.run.smithi070.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:49:08.659 INFO:teuthology.orchestra.run.smithi070.stdout:mds.a smithi070 running (2m) 0s ago 2m 88.5M - 19.3.0-5120-g18432218 ddce307e1f32 95b517185a7a 2024-09-21T05:49:08.659 INFO:teuthology.orchestra.run.smithi070.stdout:mds.b smithi116 running (2m) 2s ago 2m 93.8M - 19.3.0-5120-g18432218 ddce307e1f32 2940e2ad1cf7 2024-09-21T05:49:08.660 INFO:teuthology.orchestra.run.smithi070.stdout:mds.c smithi160 running (2m) 2s ago 2m 87.3M - 19.3.0-5120-g18432218 ddce307e1f32 25de6995acab 2024-09-21T05:49:08.660 INFO:teuthology.orchestra.run.smithi070.stdout:mds.d smithi070 running (2m) 0s ago 2m 82.5M - 19.3.0-5120-g18432218 ddce307e1f32 29d06678f4d3 2024-09-21T05:49:08.660 INFO:teuthology.orchestra.run.smithi070.stdout:mds.e smithi116 running (2m) 2s ago 2m 86.9M - 19.3.0-5120-g18432218 ddce307e1f32 73c2382a2ce9 2024-09-21T05:49:08.660 INFO:teuthology.orchestra.run.smithi070.stdout:mds.f smithi160 running (2m) 2s ago 2m 87.4M - 19.3.0-5120-g18432218 ddce307e1f32 ce62691475ea 2024-09-21T05:49:08.660 INFO:teuthology.orchestra.run.smithi070.stdout:mds.g smithi070 running (2m) 0s ago 2m 85.6M - 19.3.0-5120-g18432218 ddce307e1f32 756f02344871 2024-09-21T05:49:08.660 INFO:teuthology.orchestra.run.smithi070.stdout:mds.h smithi116 running (2m) 2s ago 2m 86.9M - 19.3.0-5120-g18432218 ddce307e1f32 3a5bcda9a7b1 2024-09-21T05:49:08.660 INFO:teuthology.orchestra.run.smithi070.stdout:mds.i smithi160 running (2m) 2s ago 2m 89.8M - 19.3.0-5120-g18432218 ddce307e1f32 08c3ec97d572 2024-09-21T05:49:08.660 INFO:teuthology.orchestra.run.smithi070.stdout:mds.j smithi070 running (2m) 0s ago 2m 84.5M - 19.3.0-5120-g18432218 ddce307e1f32 d3d484dad732 2024-09-21T05:49:08.660 INFO:teuthology.orchestra.run.smithi070.stdout:mds.k smithi116 running (2m) 2s ago 2m 85.8M - 19.3.0-5120-g18432218 ddce307e1f32 bec904e55907 2024-09-21T05:49:08.660 INFO:teuthology.orchestra.run.smithi070.stdout:mds.l smithi160 running (2m) 2s ago 2m 86.0M - 19.3.0-5120-g18432218 ddce307e1f32 a3579c252d71 2024-09-21T05:49:08.660 INFO:teuthology.orchestra.run.smithi070.stdout:mgr.x smithi070 *:9283,8765 running (10m) 0s ago 10m 593M - 19.3.0-5120-g18432218 ddce307e1f32 85b0c3a2a650 2024-09-21T05:49:08.661 INFO:teuthology.orchestra.run.smithi070.stdout:mgr.y smithi116 *:8443,8765 running (8m) 2s ago 8m 524M - 19.3.0-5120-g18432218 ddce307e1f32 43281668584a 2024-09-21T05:49:08.661 INFO:teuthology.orchestra.run.smithi070.stdout:mgr.z smithi160 *:8443,8765 running (8m) 2s ago 8m 524M - 19.3.0-5120-g18432218 ddce307e1f32 bb38d8e43da1 2024-09-21T05:49:08.661 INFO:teuthology.orchestra.run.smithi070.stdout:mon.a smithi070 running (10m) 0s ago 10m 119M 2048M 19.3.0-5120-g18432218 ddce307e1f32 d741ecc9460f 2024-09-21T05:49:08.661 INFO:teuthology.orchestra.run.smithi070.stdout:mon.b smithi116 running (8m) 2s ago 8m 109M 2048M 19.3.0-5120-g18432218 ddce307e1f32 047d833cfc82 2024-09-21T05:49:08.661 INFO:teuthology.orchestra.run.smithi070.stdout:mon.c smithi160 running (8m) 2s ago 8m 110M 2048M 19.3.0-5120-g18432218 ddce307e1f32 e471412be309 2024-09-21T05:49:08.661 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0 smithi070 running (7m) 0s ago 7m 112M 4272M 19.3.0-5120-g18432218 ddce307e1f32 a568167a7353 2024-09-21T05:49:08.661 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1 smithi116 running (7m) 2s ago 7m 115M 4272M 19.3.0-5120-g18432218 ddce307e1f32 45ce5a7c592b 2024-09-21T05:49:08.661 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2 smithi160 running (6m) 2s ago 6m 115M 4272M 19.3.0-5120-g18432218 ddce307e1f32 185b6226c82f 2024-09-21T05:49:08.661 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3 smithi070 running (6m) 0s ago 6m 111M 4272M 19.3.0-5120-g18432218 ddce307e1f32 2a1b8545d4c4 2024-09-21T05:49:08.661 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4 smithi116 running (6m) 2s ago 6m 121M 4272M 19.3.0-5120-g18432218 ddce307e1f32 56ccd07abe03 2024-09-21T05:49:08.661 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5 smithi160 running (5m) 2s ago 5m 123M 4272M 19.3.0-5120-g18432218 ddce307e1f32 8eed5ff48e36 2024-09-21T05:49:08.662 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6 smithi070 running (5m) 0s ago 5m 111M 4272M 19.3.0-5120-g18432218 ddce307e1f32 33a2866e3567 2024-09-21T05:49:08.662 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7 smithi116 running (4m) 2s ago 4m 112M 4272M 19.3.0-5120-g18432218 ddce307e1f32 6c3c7c23db8f 2024-09-21T05:49:08.662 INFO:teuthology.orchestra.run.smithi070.stdout:osd.8 smithi160 running (4m) 2s ago 4m 126M 4272M 19.3.0-5120-g18432218 ddce307e1f32 a95f94c4a016 2024-09-21T05:49:08.662 INFO:teuthology.orchestra.run.smithi070.stdout:osd.9 smithi070 running (3m) 0s ago 3m 110M 4272M 19.3.0-5120-g18432218 ddce307e1f32 ced7b63b8ef9 2024-09-21T05:49:08.662 INFO:teuthology.orchestra.run.smithi070.stdout:osd.10 smithi116 running (3m) 2s ago 3m 114M 4272M 19.3.0-5120-g18432218 ddce307e1f32 fbf43b132fe5 2024-09-21T05:49:08.662 INFO:teuthology.orchestra.run.smithi070.stdout:osd.11 smithi160 running (3m) 2s ago 3m 110M 4272M 19.3.0-5120-g18432218 ddce307e1f32 359418d218e2 2024-09-21T05:49:08.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.657+0000 7f854b7fe640 1 -- 172.21.15.70:0/2473708011 <== mgr.14150 v2:172.21.15.70:6800/1366013939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7f854c0fff80 con 0x7f85340b65a0 2024-09-21T05:49:08.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.659+0000 7f8554594640 1 -- 172.21.15.70:0/2473708011 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f85340b65a0 msgr2=0x7f85340b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:08.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.659+0000 7f8554594640 1 --2- 172.21.15.70:0/2473708011 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f85340b65a0 0x7f85340b8ab0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f853c005fd0 tx=0x7f853c009870 comp rx=0 tx=0).stop 2024-09-21T05:49:08.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.659+0000 7f8554594640 1 -- 172.21.15.70:0/2473708011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f854c104070 msgr2=0x7f854c19b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:08.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.659+0000 7f8554594640 1 --2- 172.21.15.70:0/2473708011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f854c104070 0x7f854c19b200 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f8544005940 tx=0x7f85440042f0 comp rx=0 tx=0).stop 2024-09-21T05:49:08.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.660+0000 7f8554594640 1 -- 172.21.15.70:0/2473708011 shutdown_connections 2024-09-21T05:49:08.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.660+0000 7f8554594640 1 --2- 172.21.15.70:0/2473708011 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f85340b65a0 0x7f85340b8ab0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:08.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.660+0000 7f8554594640 1 --2- 172.21.15.70:0/2473708011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f854c104070 0x7f854c19b200 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:08.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.660+0000 7f8554594640 1 --2- 172.21.15.70:0/2473708011 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f854c1036d0 0x7f854c19a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:08.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.660+0000 7f8554594640 1 --2- 172.21.15.70:0/2473708011 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f854c102640 0x7f854c199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:08.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.660+0000 7f8554594640 1 -- 172.21.15.70:0/2473708011 >> 172.21.15.70:0/2473708011 conn(0x7f854c0fdfb0 msgr2=0x7f854c0ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:08.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.660+0000 7f8554594640 1 -- 172.21.15.70:0/2473708011 shutdown_connections 2024-09-21T05:49:08.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:08.660+0000 7f8554594640 1 -- 172.21.15.70:0/2473708011 wait complete. 2024-09-21T05:49:08.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:08 smithi070 ceph-mon[30981]: pgmap v360: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T05:49:08.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:08 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:49:08.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:08 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:49:08.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:08 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:08.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:08 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:08.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:08 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:49:09.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:08 smithi160 ceph-mon[33979]: pgmap v360: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T05:49:09.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:08 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:49:09.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:08 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:49:09.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:08 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:09.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:08 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:09.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:08 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:49:09.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:08 smithi116 ceph-mon[34332]: pgmap v360: 129 pgs: 129 active+clean; 648 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T05:49:09.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:08 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:49:09.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:08 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:49:09.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:08 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:09.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:08 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:09.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:08 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:49:09.488 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T05:49:09.734 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:10.134 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:09 smithi070 ceph-mon[30981]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:10.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:09 smithi160 ceph-mon[33979]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:10.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.222+0000 7f00f4b45640 1 -- 172.21.15.70:0/894675643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00f01094b0 msgr2=0x7f00f010b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:10.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.222+0000 7f00f4b45640 1 --2- 172.21.15.70:0/894675643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00f01094b0 0x7f00f010b9c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f00e8009ca0 tx=0x7f00e802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:49:10.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.222+0000 7f00f4b45640 1 -- 172.21.15.70:0/894675643 shutdown_connections 2024-09-21T05:49:10.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.222+0000 7f00f4b45640 1 --2- 172.21.15.70:0/894675643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00f01094b0 0x7f00f010b9c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:10.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.222+0000 7f00f4b45640 1 --2- 172.21.15.70:0/894675643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00f0102570 0x7f00f0108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:10.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.222+0000 7f00f4b45640 1 --2- 172.21.15.70:0/894675643 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f00f0101b40 0x7f00f0101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:10.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.222+0000 7f00f4b45640 1 -- 172.21.15.70:0/894675643 >> 172.21.15.70:0/894675643 conn(0x7f00f00fd770 msgr2=0x7f00f00ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:10.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.222+0000 7f00f4b45640 1 -- 172.21.15.70:0/894675643 shutdown_connections 2024-09-21T05:49:10.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.222+0000 7f00f4b45640 1 -- 172.21.15.70:0/894675643 wait complete. 2024-09-21T05:49:10.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.223+0000 7f00f4b45640 1 Processor -- start 2024-09-21T05:49:10.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.223+0000 7f00f4b45640 1 -- start start 2024-09-21T05:49:10.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.223+0000 7f00f4b45640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00f0101b40 0x7f00f0199f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:10.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.223+0000 7f00f4b45640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00f0102570 0x7f00f019a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:10.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.223+0000 7f00f4b45640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f00f01094b0 0x7f00f019b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:10.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.223+0000 7f00f4b45640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f00f010f3a0 con 0x7f00f0102570 2024-09-21T05:49:10.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.223+0000 7f00f4b45640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f00f010f220 con 0x7f00f0101b40 2024-09-21T05:49:10.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.223+0000 7f00f4b45640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f00f010f520 con 0x7f00f01094b0 2024-09-21T05:49:10.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.223+0000 7f00edd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00f0102570 0x7f00f019a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:10.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.223+0000 7f00edd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00f0102570 0x7f00f019a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33208/0 (socket says 172.21.15.70:33208) 2024-09-21T05:49:10.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.223+0000 7f00edd9b640 1 -- 172.21.15.70:0/2480308599 learned_addr learned my addr 172.21.15.70:0/2480308599 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:10.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.223+0000 7f00eed9d640 1 --2- 172.21.15.70:0/2480308599 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f00f01094b0 0x7f00f019b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:10.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.223+0000 7f00ee59c640 1 --2- 172.21.15.70:0/2480308599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00f0101b40 0x7f00f0199f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:10.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.223+0000 7f00edd9b640 1 -- 172.21.15.70:0/2480308599 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f00f01094b0 msgr2=0x7f00f019b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:10.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.223+0000 7f00edd9b640 1 --2- 172.21.15.70:0/2480308599 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f00f01094b0 0x7f00f019b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:10.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.223+0000 7f00edd9b640 1 -- 172.21.15.70:0/2480308599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00f0101b40 msgr2=0x7f00f0199f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:10.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.223+0000 7f00edd9b640 1 --2- 172.21.15.70:0/2480308599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00f0101b40 0x7f00f0199f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:10.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.223+0000 7f00edd9b640 1 -- 172.21.15.70:0/2480308599 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00f019b960 con 0x7f00f0102570 2024-09-21T05:49:10.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.223+0000 7f00ee59c640 1 --2- 172.21.15.70:0/2480308599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00f0101b40 0x7f00f0199f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:49:10.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.223+0000 7f00edd9b640 1 --2- 172.21.15.70:0/2480308599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00f0102570 0x7f00f019a5a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f00e400c890 tx=0x7f00e400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:10.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.224+0000 7f00df7fe640 1 -- 172.21.15.70:0/2480308599 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e4004220 con 0x7f00f0102570 2024-09-21T05:49:10.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.224+0000 7f00df7fe640 1 -- 172.21.15.70:0/2480308599 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f00e40043c0 con 0x7f00f0102570 2024-09-21T05:49:10.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.224+0000 7f00f4b45640 1 -- 172.21.15.70:0/2480308599 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00f019bc50 con 0x7f00f0102570 2024-09-21T05:49:10.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.224+0000 7f00df7fe640 1 -- 172.21.15.70:0/2480308599 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e4004a00 con 0x7f00f0102570 2024-09-21T05:49:10.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.224+0000 7f00f4b45640 1 -- 172.21.15.70:0/2480308599 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00f01a2350 con 0x7f00f0102570 2024-09-21T05:49:10.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.225+0000 7f00f4b45640 1 -- 172.21.15.70:0/2480308599 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00f00ff290 con 0x7f00f0102570 2024-09-21T05:49:10.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.226+0000 7f00df7fe640 1 -- 172.21.15.70:0/2480308599 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f00e40079b0 con 0x7f00f0102570 2024-09-21T05:49:10.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.227+0000 7f00df7fe640 1 --2- 172.21.15.70:0/2480308599 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f00d80b6510 0x7f00d80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:10.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.227+0000 7f00ee59c640 1 --2- 172.21.15.70:0/2480308599 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f00d80b6510 0x7f00d80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:10.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.227+0000 7f00df7fe640 1 -- 172.21.15.70:0/2480308599 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f00e40e7830 con 0x7f00f0102570 2024-09-21T05:49:10.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.227+0000 7f00ee59c640 1 --2- 172.21.15.70:0/2480308599 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f00d80b6510 0x7f00d80b8a20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f00e0009b40 tx=0x7f00e0005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:10.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.230+0000 7f00df7fe640 1 -- 172.21.15.70:0/2480308599 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f00e4014030 con 0x7f00f0102570 2024-09-21T05:49:10.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:09 smithi116 ceph-mon[34332]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:10.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.417+0000 7f00f4b45640 1 -- 172.21.15.70:0/2480308599 --> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f00f0063800 con 0x7f00d80b6510 2024-09-21T05:49:10.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.423+0000 7f00df7fe640 1 -- 172.21.15.70:0/2480308599 <== mgr.14150 v2:172.21.15.70:6800/1366013939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f00f0063800 con 0x7f00d80b6510 2024-09-21T05:49:10.425 INFO:teuthology.orchestra.run.smithi070.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T05:49:10.425 INFO:teuthology.orchestra.run.smithi070.stdout:mds.all 12/12 3s ago 2m smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi116=b;smithi116=e;smithi116=h;smithi116=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l;count:12 2024-09-21T05:49:10.425 INFO:teuthology.orchestra.run.smithi070.stdout:mgr 3/3 3s ago 8m smithi070=x;smithi116=y;smithi160=z;count:3 2024-09-21T05:49:10.425 INFO:teuthology.orchestra.run.smithi070.stdout:mon 3/3 3s ago 9m smithi070:172.21.15.70=a;smithi116:172.21.15.116=b;smithi160:172.21.15.160=c;count:3 2024-09-21T05:49:10.425 INFO:teuthology.orchestra.run.smithi070.stdout:osd 12 3s ago - 2024-09-21T05:49:10.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.425+0000 7f00f4b45640 1 -- 172.21.15.70:0/2480308599 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f00d80b6510 msgr2=0x7f00d80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:10.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.425+0000 7f00f4b45640 1 --2- 172.21.15.70:0/2480308599 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f00d80b6510 0x7f00d80b8a20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f00e0009b40 tx=0x7f00e0005e50 comp rx=0 tx=0).stop 2024-09-21T05:49:10.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.425+0000 7f00f4b45640 1 -- 172.21.15.70:0/2480308599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00f0102570 msgr2=0x7f00f019a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:10.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.425+0000 7f00f4b45640 1 --2- 172.21.15.70:0/2480308599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00f0102570 0x7f00f019a5a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f00e400c890 tx=0x7f00e400cd50 comp rx=0 tx=0).stop 2024-09-21T05:49:10.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.425+0000 7f00f4b45640 1 -- 172.21.15.70:0/2480308599 shutdown_connections 2024-09-21T05:49:10.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.425+0000 7f00f4b45640 1 --2- 172.21.15.70:0/2480308599 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f00d80b6510 0x7f00d80b8a20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:10.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.425+0000 7f00f4b45640 1 --2- 172.21.15.70:0/2480308599 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f00f01094b0 0x7f00f019b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:10.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.425+0000 7f00f4b45640 1 --2- 172.21.15.70:0/2480308599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00f0102570 0x7f00f019a5a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:10.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.425+0000 7f00f4b45640 1 --2- 172.21.15.70:0/2480308599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00f0101b40 0x7f00f0199f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:10.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.425+0000 7f00f4b45640 1 -- 172.21.15.70:0/2480308599 >> 172.21.15.70:0/2480308599 conn(0x7f00f00fd770 msgr2=0x7f00f0107740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:10.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.425+0000 7f00f4b45640 1 -- 172.21.15.70:0/2480308599 shutdown_connections 2024-09-21T05:49:10.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:10.425+0000 7f00f4b45640 1 -- 172.21.15.70:0/2480308599 wait complete. 2024-09-21T05:49:11.097 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:10 smithi070 ceph-mon[30981]: pgmap v361: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T05:49:11.097 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:10 smithi070 ceph-mon[30981]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T05:49:11.097 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:10 smithi070 ceph-mon[30981]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:11.126 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T05:49:11.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:10 smithi160 ceph-mon[33979]: pgmap v361: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T05:49:11.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:10 smithi160 ceph-mon[33979]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T05:49:11.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:10 smithi160 ceph-mon[33979]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:11.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:10 smithi116 ceph-mon[34332]: pgmap v361: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T05:49:11.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:10 smithi116 ceph-mon[34332]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T05:49:11.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:10 smithi116 ceph-mon[34332]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:11.372 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:11.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.857+0000 7f401901d640 1 -- 172.21.15.70:0/4284714853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4014104070 msgr2=0x7f401410aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:11.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.857+0000 7f401901d640 1 --2- 172.21.15.70:0/4284714853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4014104070 0x7f401410aa10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4004009900 tx=0x7f400402a480 comp rx=0 tx=0).stop 2024-09-21T05:49:11.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.857+0000 7f401901d640 1 -- 172.21.15.70:0/4284714853 shutdown_connections 2024-09-21T05:49:11.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.857+0000 7f401901d640 1 --2- 172.21.15.70:0/4284714853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4014104070 0x7f401410aa10 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:11.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.857+0000 7f401901d640 1 --2- 172.21.15.70:0/4284714853 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40141036d0 0x7f4014103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:11.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.857+0000 7f401901d640 1 --2- 172.21.15.70:0/4284714853 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4014102640 0x7f4014102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:11.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.857+0000 7f401901d640 1 -- 172.21.15.70:0/4284714853 >> 172.21.15.70:0/4284714853 conn(0x7f40140fdfb0 msgr2=0x7f4014100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:11.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.857+0000 7f401901d640 1 -- 172.21.15.70:0/4284714853 shutdown_connections 2024-09-21T05:49:11.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.857+0000 7f401901d640 1 -- 172.21.15.70:0/4284714853 wait complete. 2024-09-21T05:49:11.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.858+0000 7f401901d640 1 Processor -- start 2024-09-21T05:49:11.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.858+0000 7f401901d640 1 -- start start 2024-09-21T05:49:11.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.858+0000 7f401901d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4014102640 0x7f4014199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:11.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.858+0000 7f401901d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40141036d0 0x7f401419a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:11.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.858+0000 7f401901d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4014104070 0x7f401419b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:11.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.858+0000 7f401901d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f401410e270 con 0x7f4014102640 2024-09-21T05:49:11.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.858+0000 7f401901d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f401410e0f0 con 0x7f40141036d0 2024-09-21T05:49:11.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.858+0000 7f401901d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f401410e3f0 con 0x7f4014104070 2024-09-21T05:49:11.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.858+0000 7f4012d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4014102640 0x7f4014199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:11.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.858+0000 7f4012d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4014102640 0x7f4014199f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34968/0 (socket says 172.21.15.70:34968) 2024-09-21T05:49:11.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.858+0000 7f4012d9d640 1 -- 172.21.15.70:0/730552861 learned_addr learned my addr 172.21.15.70:0/730552861 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:11.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.858+0000 7f401259c640 1 --2- 172.21.15.70:0/730552861 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40141036d0 0x7f401419a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:11.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.858+0000 7f401359e640 1 --2- 172.21.15.70:0/730552861 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4014104070 0x7f401419b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:11.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.858+0000 7f4012d9d640 1 -- 172.21.15.70:0/730552861 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4014104070 msgr2=0x7f401419b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:11.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.858+0000 7f4012d9d640 1 --2- 172.21.15.70:0/730552861 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4014104070 0x7f401419b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:11.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.858+0000 7f4012d9d640 1 -- 172.21.15.70:0/730552861 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40141036d0 msgr2=0x7f401419a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:11.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.858+0000 7f4012d9d640 1 --2- 172.21.15.70:0/730552861 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40141036d0 0x7f401419a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:11.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.858+0000 7f4012d9d640 1 -- 172.21.15.70:0/730552861 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f401419b8a0 con 0x7f4014102640 2024-09-21T05:49:11.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.858+0000 7f401259c640 1 --2- 172.21.15.70:0/730552861 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40141036d0 0x7f401419a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:49:11.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.859+0000 7f4012d9d640 1 --2- 172.21.15.70:0/730552861 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4014102640 0x7f4014199f00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f400c00cce0 tx=0x7f400c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:11.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.859+0000 7f400bfff640 1 -- 172.21.15.70:0/730552861 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c004b20 con 0x7f4014102640 2024-09-21T05:49:11.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.859+0000 7f401901d640 1 -- 172.21.15.70:0/730552861 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f401419bb90 con 0x7f4014102640 2024-09-21T05:49:11.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.859+0000 7f400bfff640 1 -- 172.21.15.70:0/730552861 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f400c004cc0 con 0x7f4014102640 2024-09-21T05:49:11.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.859+0000 7f401901d640 1 -- 172.21.15.70:0/730552861 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40141a2320 con 0x7f4014102640 2024-09-21T05:49:11.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.859+0000 7f400bfff640 1 -- 172.21.15.70:0/730552861 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c00f6b0 con 0x7f4014102640 2024-09-21T05:49:11.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.860+0000 7f401901d640 1 -- 172.21.15.70:0/730552861 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4014102ab0 con 0x7f4014102640 2024-09-21T05:49:11.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.862+0000 7f400bfff640 1 -- 172.21.15.70:0/730552861 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f400c005560 con 0x7f4014102640 2024-09-21T05:49:11.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.862+0000 7f400bfff640 1 --2- 172.21.15.70:0/730552861 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f40000b6510 0x7f40000b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:11.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.862+0000 7f401259c640 1 --2- 172.21.15.70:0/730552861 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f40000b6510 0x7f40000b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:11.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.863+0000 7f400bfff640 1 -- 172.21.15.70:0/730552861 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f400c0e7c70 con 0x7f4014102640 2024-09-21T05:49:11.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.863+0000 7f401259c640 1 --2- 172.21.15.70:0/730552861 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f40000b6510 0x7f40000b8a20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc00baa0 tx=0x7f3ffc005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:11.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:11.866+0000 7f400bfff640 1 -- 172.21.15.70:0/730552861 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f400c014030 con 0x7f4014102640 2024-09-21T05:49:12.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:12.048+0000 7f401901d640 1 -- 172.21.15.70:0/730552861 --> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f40141a24f0 con 0x7f40000b6510 2024-09-21T05:49:12.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:12.050+0000 7f400bfff640 1 -- 172.21.15.70:0/730552861 <== mgr.14150 v2:172.21.15.70:6800/1366013939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f40141a24f0 con 0x7f40000b6510 2024-09-21T05:49:12.053 INFO:teuthology.orchestra.run.smithi070.stdout:HOST ADDR LABELS STATUS 2024-09-21T05:49:12.053 INFO:teuthology.orchestra.run.smithi070.stdout:smithi070 172.21.15.70 2024-09-21T05:49:12.053 INFO:teuthology.orchestra.run.smithi070.stdout:smithi116 172.21.15.116 2024-09-21T05:49:12.053 INFO:teuthology.orchestra.run.smithi070.stdout:smithi160 172.21.15.160 2024-09-21T05:49:12.053 INFO:teuthology.orchestra.run.smithi070.stdout:3 hosts in cluster 2024-09-21T05:49:12.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:12.052+0000 7f401901d640 1 -- 172.21.15.70:0/730552861 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f40000b6510 msgr2=0x7f40000b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:12.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:12.052+0000 7f401901d640 1 --2- 172.21.15.70:0/730552861 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f40000b6510 0x7f40000b8a20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc00baa0 tx=0x7f3ffc005d90 comp rx=0 tx=0).stop 2024-09-21T05:49:12.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:12.052+0000 7f401901d640 1 -- 172.21.15.70:0/730552861 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4014102640 msgr2=0x7f4014199f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:12.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:12.052+0000 7f401901d640 1 --2- 172.21.15.70:0/730552861 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4014102640 0x7f4014199f00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f400c00cce0 tx=0x7f400c00a620 comp rx=0 tx=0).stop 2024-09-21T05:49:12.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:12.052+0000 7f401901d640 1 -- 172.21.15.70:0/730552861 shutdown_connections 2024-09-21T05:49:12.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:12.052+0000 7f401901d640 1 --2- 172.21.15.70:0/730552861 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f40000b6510 0x7f40000b8a20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:12.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:12.052+0000 7f401901d640 1 --2- 172.21.15.70:0/730552861 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4014104070 0x7f401419b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:12.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:12.052+0000 7f401901d640 1 --2- 172.21.15.70:0/730552861 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40141036d0 0x7f401419a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:12.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:12.052+0000 7f401901d640 1 --2- 172.21.15.70:0/730552861 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4014102640 0x7f4014199f00 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:12.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:12.052+0000 7f401901d640 1 -- 172.21.15.70:0/730552861 >> 172.21.15.70:0/730552861 conn(0x7f40140fdfb0 msgr2=0x7f40140ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:12.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:12.053+0000 7f401901d640 1 -- 172.21.15.70:0/730552861 shutdown_connections 2024-09-21T05:49:12.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:12.053+0000 7f401901d640 1 -- 172.21.15.70:0/730552861 wait complete. 2024-09-21T05:49:12.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:12 smithi070 ceph-mon[30981]: pgmap v362: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T05:49:12.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:12 smithi070 ceph-mon[30981]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:12.928 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T05:49:13.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:12 smithi160 ceph-mon[33979]: pgmap v362: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T05:49:13.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:12 smithi160 ceph-mon[33979]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:13.174 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:13.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:12 smithi116 ceph-mon[34332]: pgmap v362: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T05:49:13.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:12 smithi116 ceph-mon[34332]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:13.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.749+0000 7f07e331a640 1 -- 172.21.15.70:0/407587041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07dc1036f0 msgr2=0x7f07dc103b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:13.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.749+0000 7f07e331a640 1 --2- 172.21.15.70:0/407587041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07dc1036f0 0x7f07dc103b00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f07cc009900 tx=0x7f07cc02a480 comp rx=0 tx=0).stop 2024-09-21T05:49:13.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.749+0000 7f07e331a640 1 -- 172.21.15.70:0/407587041 shutdown_connections 2024-09-21T05:49:13.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.749+0000 7f07e331a640 1 --2- 172.21.15.70:0/407587041 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07dc104090 0x7f07dc10aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:13.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.749+0000 7f07e331a640 1 --2- 172.21.15.70:0/407587041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07dc1036f0 0x7f07dc103b00 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:13.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.749+0000 7f07e331a640 1 --2- 172.21.15.70:0/407587041 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07dc102660 0x7f07dc102ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:13.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.749+0000 7f07e331a640 1 -- 172.21.15.70:0/407587041 >> 172.21.15.70:0/407587041 conn(0x7f07dc0fdfd0 msgr2=0x7f07dc100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:13.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.750+0000 7f07e331a640 1 -- 172.21.15.70:0/407587041 shutdown_connections 2024-09-21T05:49:13.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.750+0000 7f07e331a640 1 -- 172.21.15.70:0/407587041 wait complete. 2024-09-21T05:49:13.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.750+0000 7f07e331a640 1 Processor -- start 2024-09-21T05:49:13.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.750+0000 7f07e331a640 1 -- start start 2024-09-21T05:49:13.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.750+0000 7f07e331a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07dc102660 0x7f07dc06c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:13.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.750+0000 7f07e331a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07dc1036f0 0x7f07dc19ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:13.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.750+0000 7f07e331a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07dc104090 0x7f07dc1a1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:13.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.750+0000 7f07e331a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f07dc10e290 con 0x7f07dc1036f0 2024-09-21T05:49:13.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.750+0000 7f07e331a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f07dc10e110 con 0x7f07dc102660 2024-09-21T05:49:13.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.750+0000 7f07e331a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f07dc10e410 con 0x7f07dc104090 2024-09-21T05:49:13.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.751+0000 7f07e08b5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07dc1036f0 0x7f07dc19ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:13.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.751+0000 7f07e08b5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07dc1036f0 0x7f07dc19ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34986/0 (socket says 172.21.15.70:34986) 2024-09-21T05:49:13.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.751+0000 7f07e08b5640 1 -- 172.21.15.70:0/1892517206 learned_addr learned my addr 172.21.15.70:0/1892517206 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:13.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.751+0000 7f07e10b6640 1 --2- 172.21.15.70:0/1892517206 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07dc102660 0x7f07dc06c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:13.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.751+0000 7f07e18b7640 1 --2- 172.21.15.70:0/1892517206 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07dc104090 0x7f07dc1a1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.751+0000 7f07e08b5640 1 -- 172.21.15.70:0/1892517206 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07dc104090 msgr2=0x7f07dc1a1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.751+0000 7f07e08b5640 1 --2- 172.21.15.70:0/1892517206 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07dc104090 0x7f07dc1a1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.751+0000 7f07e08b5640 1 -- 172.21.15.70:0/1892517206 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07dc102660 msgr2=0x7f07dc06c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.751+0000 7f07e08b5640 1 --2- 172.21.15.70:0/1892517206 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07dc102660 0x7f07dc06c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.751+0000 7f07e08b5640 1 -- 172.21.15.70:0/1892517206 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07dc1a1a70 con 0x7f07dc1036f0 2024-09-21T05:49:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.751+0000 7f07e10b6640 1 --2- 172.21.15.70:0/1892517206 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07dc102660 0x7f07dc06c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.751+0000 7f07e08b5640 1 --2- 172.21.15.70:0/1892517206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07dc1036f0 0x7f07dc19ed20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f07cc005940 tx=0x7f07cc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.751+0000 7f07d27fc640 1 -- 172.21.15.70:0/1892517206 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07cc03f030 con 0x7f07dc1036f0 2024-09-21T05:49:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.751+0000 7f07d27fc640 1 -- 172.21.15.70:0/1892517206 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f07cc003cb0 con 0x7f07dc1036f0 2024-09-21T05:49:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.751+0000 7f07e331a640 1 -- 172.21.15.70:0/1892517206 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07dc1a1d00 con 0x7f07dc1036f0 2024-09-21T05:49:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.751+0000 7f07d27fc640 1 -- 172.21.15.70:0/1892517206 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07cc035070 con 0x7f07dc1036f0 2024-09-21T05:49:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.751+0000 7f07e331a640 1 -- 172.21.15.70:0/1892517206 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07dc1a2190 con 0x7f07dc1036f0 2024-09-21T05:49:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.752+0000 7f07e331a640 1 -- 172.21.15.70:0/1892517206 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07dc109840 con 0x7f07dc1036f0 2024-09-21T05:49:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.754+0000 7f07d27fc640 1 -- 172.21.15.70:0/1892517206 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f07cc042030 con 0x7f07dc1036f0 2024-09-21T05:49:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.754+0000 7f07d27fc640 1 --2- 172.21.15.70:0/1892517206 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f07c80b6510 0x7f07c80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:13.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.755+0000 7f07d27fc640 1 -- 172.21.15.70:0/1892517206 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f07cc108240 con 0x7f07dc1036f0 2024-09-21T05:49:13.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.755+0000 7f07e10b6640 1 --2- 172.21.15.70:0/1892517206 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f07c80b6510 0x7f07c80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:13.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.755+0000 7f07e10b6640 1 --2- 172.21.15.70:0/1892517206 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f07c80b6510 0x7f07c80b8a20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f07d80058c0 tx=0x7f07d8005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:13.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.758+0000 7f07d27fc640 1 -- 172.21.15.70:0/1892517206 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f07cc0ce6e0 con 0x7f07dc1036f0 2024-09-21T05:49:13.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.945+0000 7f07e331a640 1 -- 172.21.15.70:0/1892517206 --> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f07dc063800 con 0x7f07c80b6510 2024-09-21T05:49:13.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.946+0000 7f07d27fc640 1 -- 172.21.15.70:0/1892517206 <== mgr.14150 v2:172.21.15.70:6800/1366013939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f07dc063800 con 0x7f07c80b6510 2024-09-21T05:49:13.948 INFO:teuthology.orchestra.run.smithi070.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T05:49:13.948 INFO:teuthology.orchestra.run.smithi070.stdout:smithi070 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513002P480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-21T05:49:13.949 INFO:teuthology.orchestra.run.smithi070.stdout:smithi116 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400VJ400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-21T05:49:13.949 INFO:teuthology.orchestra.run.smithi070.stdout:smithi160 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300JY400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T05:49:13.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.948+0000 7f07e331a640 1 -- 172.21.15.70:0/1892517206 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f07c80b6510 msgr2=0x7f07c80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:13.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.948+0000 7f07e331a640 1 --2- 172.21.15.70:0/1892517206 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f07c80b6510 0x7f07c80b8a20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f07d80058c0 tx=0x7f07d8005ec0 comp rx=0 tx=0).stop 2024-09-21T05:49:13.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.949+0000 7f07e331a640 1 -- 172.21.15.70:0/1892517206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07dc1036f0 msgr2=0x7f07dc19ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:13.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.949+0000 7f07e331a640 1 --2- 172.21.15.70:0/1892517206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07dc1036f0 0x7f07dc19ed20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f07cc005940 tx=0x7f07cc0042f0 comp rx=0 tx=0).stop 2024-09-21T05:49:13.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.949+0000 7f07e331a640 1 -- 172.21.15.70:0/1892517206 shutdown_connections 2024-09-21T05:49:13.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.949+0000 7f07e331a640 1 --2- 172.21.15.70:0/1892517206 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f07c80b6510 0x7f07c80b8a20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:13.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.949+0000 7f07e331a640 1 --2- 172.21.15.70:0/1892517206 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07dc104090 0x7f07dc1a1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:13.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.949+0000 7f07e331a640 1 --2- 172.21.15.70:0/1892517206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07dc1036f0 0x7f07dc19ed20 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:13.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.949+0000 7f07e331a640 1 --2- 172.21.15.70:0/1892517206 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07dc102660 0x7f07dc06c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:13.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.949+0000 7f07e331a640 1 -- 172.21.15.70:0/1892517206 >> 172.21.15.70:0/1892517206 conn(0x7f07dc0fdfd0 msgr2=0x7f07dc106a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:13.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.949+0000 7f07e331a640 1 -- 172.21.15.70:0/1892517206 shutdown_connections 2024-09-21T05:49:13.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:13.949+0000 7f07e331a640 1 -- 172.21.15.70:0/1892517206 wait complete. 2024-09-21T05:49:14.659 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T05:49:14.675 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi070.front.sepia.ceph.com 2024-09-21T05:49:14.675 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T05:49:14.920 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:14.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:14 smithi070 ceph-mon[30981]: pgmap v363: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-21T05:49:14.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:14 smithi070 ceph-mon[30981]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:15.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:14 smithi160 ceph-mon[33979]: pgmap v363: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-21T05:49:15.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:14 smithi160 ceph-mon[33979]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:15.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:14 smithi116 ceph-mon[34332]: pgmap v363: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-21T05:49:15.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:14 smithi116 ceph-mon[34332]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:15.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.404+0000 7f076d8bb640 1 -- 172.21.15.70:0/425425871 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0768109540 msgr2=0x7f076810b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:15.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.404+0000 7f076d8bb640 1 --2- 172.21.15.70:0/425425871 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0768109540 0x7f076810b9c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0760009900 tx=0x7f076002a410 comp rx=0 tx=0).stop 2024-09-21T05:49:15.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.404+0000 7f076d8bb640 1 -- 172.21.15.70:0/425425871 shutdown_connections 2024-09-21T05:49:15.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.404+0000 7f076d8bb640 1 --2- 172.21.15.70:0/425425871 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0768106be0 0x7f0768109000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:15.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.404+0000 7f076d8bb640 1 --2- 172.21.15.70:0/425425871 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0768109540 0x7f076810b9c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:15.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.404+0000 7f076d8bb640 1 --2- 172.21.15.70:0/425425871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0768101b40 0x7f0768101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:15.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.404+0000 7f076d8bb640 1 -- 172.21.15.70:0/425425871 >> 172.21.15.70:0/425425871 conn(0x7f07680fd770 msgr2=0x7f07680ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:15.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.404+0000 7f076d8bb640 1 -- 172.21.15.70:0/425425871 shutdown_connections 2024-09-21T05:49:15.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.404+0000 7f076d8bb640 1 -- 172.21.15.70:0/425425871 wait complete. 2024-09-21T05:49:15.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.404+0000 7f076d8bb640 1 Processor -- start 2024-09-21T05:49:15.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.404+0000 7f076d8bb640 1 -- start start 2024-09-21T05:49:15.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.405+0000 7f076d8bb640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0768101b40 0x7f076819a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:15.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.405+0000 7f076d8bb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0768106be0 0x7f076819a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:15.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.405+0000 7f076d8bb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0768109540 0x7f076819b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:15.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.405+0000 7f076d8bb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f076810f480 con 0x7f0768109540 2024-09-21T05:49:15.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.405+0000 7f076d8bb640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f076810f300 con 0x7f0768106be0 2024-09-21T05:49:15.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.405+0000 7f076d8bb640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f076810f600 con 0x7f0768101b40 2024-09-21T05:49:15.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.405+0000 7f07677fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0768109540 0x7f076819b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:15.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.405+0000 7f07677fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0768109540 0x7f076819b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35000/0 (socket says 172.21.15.70:35000) 2024-09-21T05:49:15.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.405+0000 7f07677fe640 1 -- 172.21.15.70:0/1679039870 learned_addr learned my addr 172.21.15.70:0/1679039870 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:15.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.405+0000 7f07667fc640 1 --2- 172.21.15.70:0/1679039870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0768106be0 0x7f076819a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:15.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.405+0000 7f07677fe640 1 -- 172.21.15.70:0/1679039870 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0768101b40 msgr2=0x7f076819a100 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T05:49:15.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.405+0000 7f07677fe640 1 --2- 172.21.15.70:0/1679039870 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0768101b40 0x7f076819a100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:15.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.405+0000 7f07677fe640 1 -- 172.21.15.70:0/1679039870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0768106be0 msgr2=0x7f076819a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:15.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.405+0000 7f07677fe640 1 --2- 172.21.15.70:0/1679039870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0768106be0 0x7f076819a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:15.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.405+0000 7f07677fe640 1 -- 172.21.15.70:0/1679039870 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f076819bb30 con 0x7f0768109540 2024-09-21T05:49:15.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.405+0000 7f07667fc640 1 --2- 172.21.15.70:0/1679039870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0768106be0 0x7f076819a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:15.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.405+0000 7f07677fe640 1 --2- 172.21.15.70:0/1679039870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0768109540 0x7f076819b310 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0760005940 tx=0x7f07600043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:15.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.405+0000 7f076c8b9640 1 -- 172.21.15.70:0/1679039870 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076003f030 con 0x7f0768109540 2024-09-21T05:49:15.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.405+0000 7f076c8b9640 1 -- 172.21.15.70:0/1679039870 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f0760003cb0 con 0x7f0768109540 2024-09-21T05:49:15.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.406+0000 7f076d8bb640 1 -- 172.21.15.70:0/1679039870 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f076819bdc0 con 0x7f0768109540 2024-09-21T05:49:15.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.406+0000 7f076c8b9640 1 -- 172.21.15.70:0/1679039870 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0760035070 con 0x7f0768109540 2024-09-21T05:49:15.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.406+0000 7f076d8bb640 1 -- 172.21.15.70:0/1679039870 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07681a23d0 con 0x7f0768109540 2024-09-21T05:49:15.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.407+0000 7f076d8bb640 1 -- 172.21.15.70:0/1679039870 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07680ff290 con 0x7f0768109540 2024-09-21T05:49:15.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.409+0000 7f076c8b9640 1 -- 172.21.15.70:0/1679039870 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f0760042030 con 0x7f0768109540 2024-09-21T05:49:15.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.410+0000 7f076c8b9640 1 --2- 172.21.15.70:0/1679039870 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f07540b6510 0x7f07540b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:15.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.410+0000 7f0766ffd640 1 --2- 172.21.15.70:0/1679039870 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f07540b6510 0x7f07540b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:15.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.410+0000 7f076c8b9640 1 -- 172.21.15.70:0/1679039870 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f0760108310 con 0x7f0768109540 2024-09-21T05:49:15.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.411+0000 7f0766ffd640 1 --2- 172.21.15.70:0/1679039870 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f07540b6510 0x7f07540b8a20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f075800ab90 tx=0x7f0758009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:15.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.413+0000 7f076c8b9640 1 -- 172.21.15.70:0/1679039870 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f07600ce7b0 con 0x7f0768109540 2024-09-21T05:49:15.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.627+0000 7f076d8bb640 1 -- 172.21.15.70:0/1679039870 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f076802e800 con 0x7f0768109540 2024-09-21T05:49:15.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.628+0000 7f076c8b9640 1 -- 172.21.15.70:0/1679039870 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) ==== 76+0+3138 (secure 0 0 0) 0x7f076802e800 con 0x7f0768109540 2024-09-21T05:49:15.630 INFO:teuthology.orchestra.run.smithi070.stdout:e27 2024-09-21T05:49:15.630 INFO:teuthology.orchestra.run.smithi070.stdout:btime 2024-09-21T05:47:50:538503+0000 2024-09-21T05:49:15.630 INFO:teuthology.orchestra.run.smithi070.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T05:49:15.630 INFO:teuthology.orchestra.run.smithi070.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T05:49:15.630 INFO:teuthology.orchestra.run.smithi070.stdout:legacy client fscid: 1 2024-09-21T05:49:15.631 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:49:15.631 INFO:teuthology.orchestra.run.smithi070.stdout:Filesystem 'cephfs' (1) 2024-09-21T05:49:15.631 INFO:teuthology.orchestra.run.smithi070.stdout:fs_name cephfs 2024-09-21T05:49:15.631 INFO:teuthology.orchestra.run.smithi070.stdout:epoch 27 2024-09-21T05:49:15.631 INFO:teuthology.orchestra.run.smithi070.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T05:49:15.631 INFO:teuthology.orchestra.run.smithi070.stdout:created 2024-09-21T05:47:06.246985+0000 2024-09-21T05:49:15.631 INFO:teuthology.orchestra.run.smithi070.stdout:modified 2024-09-21T05:47:50.538486+0000 2024-09-21T05:49:15.631 INFO:teuthology.orchestra.run.smithi070.stdout:tableserver 0 2024-09-21T05:49:15.631 INFO:teuthology.orchestra.run.smithi070.stdout:root 0 2024-09-21T05:49:15.631 INFO:teuthology.orchestra.run.smithi070.stdout:session_timeout 300 2024-09-21T05:49:15.631 INFO:teuthology.orchestra.run.smithi070.stdout:session_autoclose 300 2024-09-21T05:49:15.631 INFO:teuthology.orchestra.run.smithi070.stdout:max_file_size 1099511627776 2024-09-21T05:49:15.631 INFO:teuthology.orchestra.run.smithi070.stdout:max_xattr_size 65536 2024-09-21T05:49:15.632 INFO:teuthology.orchestra.run.smithi070.stdout:required_client_features {} 2024-09-21T05:49:15.632 INFO:teuthology.orchestra.run.smithi070.stdout:last_failure 0 2024-09-21T05:49:15.632 INFO:teuthology.orchestra.run.smithi070.stdout:last_failure_osd_epoch 0 2024-09-21T05:49:15.632 INFO:teuthology.orchestra.run.smithi070.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T05:49:15.632 INFO:teuthology.orchestra.run.smithi070.stdout:max_mds 5 2024-09-21T05:49:15.632 INFO:teuthology.orchestra.run.smithi070.stdout:in 0,1,2,3,4 2024-09-21T05:49:15.632 INFO:teuthology.orchestra.run.smithi070.stdout:up {0=24641,1=24628,2=24611,3=24610,4=24598} 2024-09-21T05:49:15.632 INFO:teuthology.orchestra.run.smithi070.stdout:failed 2024-09-21T05:49:15.632 INFO:teuthology.orchestra.run.smithi070.stdout:damaged 2024-09-21T05:49:15.632 INFO:teuthology.orchestra.run.smithi070.stdout:stopped 2024-09-21T05:49:15.632 INFO:teuthology.orchestra.run.smithi070.stdout:data_pools [3,4] 2024-09-21T05:49:15.632 INFO:teuthology.orchestra.run.smithi070.stdout:metadata_pool 2 2024-09-21T05:49:15.632 INFO:teuthology.orchestra.run.smithi070.stdout:inline_data disabled 2024-09-21T05:49:15.632 INFO:teuthology.orchestra.run.smithi070.stdout:balancer 2024-09-21T05:49:15.632 INFO:teuthology.orchestra.run.smithi070.stdout:bal_rank_mask -1 2024-09-21T05:49:15.633 INFO:teuthology.orchestra.run.smithi070.stdout:standby_count_wanted 0 2024-09-21T05:49:15.633 INFO:teuthology.orchestra.run.smithi070.stdout:qdb_cluster leader: 24641 members: 24641,24628,24610,24611,24598 2024-09-21T05:49:15.633 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.b{0:24641} state up:active seq 4 addr [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:49:15.633 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.e{0:24590} state up:standby-replay seq 1 addr [v2:172.21.15.116:6834/3787256790,v1:172.21.15.116:6835/3787256790] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:49:15.633 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.i{1:24628} state up:active seq 16 addr [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:49:15.633 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.k{1:24575} state up:standby-replay seq 1 addr [v2:172.21.15.116:6832/283778129,v1:172.21.15.116:6833/283778129] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:49:15.633 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.h{2:24611} state up:active seq 17 addr [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:49:15.633 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.l{2:24568} state up:standby-replay seq 1 addr [v2:172.21.15.160:6832/3543945704,v1:172.21.15.160:6833/3543945704] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:49:15.633 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.c{3:24610} state up:active seq 18 addr [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:49:15.633 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.a{3:14793} state up:standby-replay seq 1 addr [v2:172.21.15.70:6840/3392175775,v1:172.21.15.70:6841/3392175775] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:49:15.633 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.f{4:24598} state up:active seq 19 addr [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:49:15.633 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.g{4:14787} state up:standby-replay seq 1 addr [v2:172.21.15.70:6838/1914209867,v1:172.21.15.70:6839/1914209867] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:49:15.634 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:49:15.634 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:49:15.634 INFO:teuthology.orchestra.run.smithi070.stdout:Standby daemons: 2024-09-21T05:49:15.634 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:49:15.634 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.j{-1:14718} state up:standby seq 1 addr [v2:172.21.15.70:6834/3519318330,v1:172.21.15.70:6835/3519318330] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:49:15.634 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.d{-1:14730} state up:standby seq 1 addr [v2:172.21.15.70:6836/2706663460,v1:172.21.15.70:6837/2706663460] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:49:15.634 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 27 2024-09-21T05:49:15.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.631+0000 7f076d8bb640 1 -- 172.21.15.70:0/1679039870 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f07540b6510 msgr2=0x7f07540b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:15.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.631+0000 7f076d8bb640 1 --2- 172.21.15.70:0/1679039870 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f07540b6510 0x7f07540b8a20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f075800ab90 tx=0x7f0758009250 comp rx=0 tx=0).stop 2024-09-21T05:49:15.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.631+0000 7f076d8bb640 1 -- 172.21.15.70:0/1679039870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0768109540 msgr2=0x7f076819b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:15.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.631+0000 7f076d8bb640 1 --2- 172.21.15.70:0/1679039870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0768109540 0x7f076819b310 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0760005940 tx=0x7f07600043b0 comp rx=0 tx=0).stop 2024-09-21T05:49:15.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.631+0000 7f076d8bb640 1 -- 172.21.15.70:0/1679039870 shutdown_connections 2024-09-21T05:49:15.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.631+0000 7f076d8bb640 1 --2- 172.21.15.70:0/1679039870 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f07540b6510 0x7f07540b8a20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:15.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.631+0000 7f076d8bb640 1 --2- 172.21.15.70:0/1679039870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0768109540 0x7f076819b310 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:15.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.631+0000 7f076d8bb640 1 --2- 172.21.15.70:0/1679039870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0768106be0 0x7f076819a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:15.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.631+0000 7f076d8bb640 1 --2- 172.21.15.70:0/1679039870 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0768101b40 0x7f076819a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:15.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.631+0000 7f076d8bb640 1 -- 172.21.15.70:0/1679039870 >> 172.21.15.70:0/1679039870 conn(0x7f07680fd770 msgr2=0x7f0768107a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:15.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.631+0000 7f076d8bb640 1 -- 172.21.15.70:0/1679039870 shutdown_connections 2024-09-21T05:49:15.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:15.631+0000 7f076d8bb640 1 -- 172.21.15.70:0/1679039870 wait complete. 2024-09-21T05:49:15.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:15 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1679039870' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T05:49:16.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:15 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1679039870' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T05:49:16.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:15 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1679039870' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T05:49:16.345 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- bash -c 'ceph osd dump' 2024-09-21T05:49:16.588 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:16.975 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:16 smithi070 ceph-mon[30981]: pgmap v364: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-21T05:49:17.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.065+0000 7f23f5b3f640 1 -- 172.21.15.70:0/2488000576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23f0102640 msgr2=0x7f23f0102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:17.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.065+0000 7f23f5b3f640 1 --2- 172.21.15.70:0/2488000576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23f0102640 0x7f23f0102ab0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f23e0009900 tx=0x7f23e002a480 comp rx=0 tx=0).stop 2024-09-21T05:49:17.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.065+0000 7f23f5b3f640 1 -- 172.21.15.70:0/2488000576 shutdown_connections 2024-09-21T05:49:17.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.065+0000 7f23f5b3f640 1 --2- 172.21.15.70:0/2488000576 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23f0104070 0x7f23f010aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:17.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.065+0000 7f23f5b3f640 1 --2- 172.21.15.70:0/2488000576 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23f01036d0 0x7f23f0103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:17.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.065+0000 7f23f5b3f640 1 --2- 172.21.15.70:0/2488000576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23f0102640 0x7f23f0102ab0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:17.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.065+0000 7f23f5b3f640 1 -- 172.21.15.70:0/2488000576 >> 172.21.15.70:0/2488000576 conn(0x7f23f00fdfb0 msgr2=0x7f23f0100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:17.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.065+0000 7f23f5b3f640 1 -- 172.21.15.70:0/2488000576 shutdown_connections 2024-09-21T05:49:17.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.065+0000 7f23f5b3f640 1 -- 172.21.15.70:0/2488000576 wait complete. 2024-09-21T05:49:17.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.066+0000 7f23f5b3f640 1 Processor -- start 2024-09-21T05:49:17.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.066+0000 7f23f5b3f640 1 -- start start 2024-09-21T05:49:17.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.066+0000 7f23f5b3f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23f0102640 0x7f23f006b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:17.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.066+0000 7f23f5b3f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23f01036d0 0x7f23f019ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:17.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.066+0000 7f23f5b3f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23f0104070 0x7f23f01a1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:17.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.066+0000 7f23f5b3f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f23f010e2c0 con 0x7f23f01036d0 2024-09-21T05:49:17.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.066+0000 7f23f5b3f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f23f010e140 con 0x7f23f0102640 2024-09-21T05:49:17.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.066+0000 7f23f5b3f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f23f010e440 con 0x7f23f0104070 2024-09-21T05:49:17.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.066+0000 7f23e6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23f01036d0 0x7f23f019ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:17.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.066+0000 7f23e6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23f01036d0 0x7f23f019ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35024/0 (socket says 172.21.15.70:35024) 2024-09-21T05:49:17.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.066+0000 7f23e6ffd640 1 -- 172.21.15.70:0/582899535 learned_addr learned my addr 172.21.15.70:0/582899535 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:17.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.066+0000 7f23ef7fe640 1 --2- 172.21.15.70:0/582899535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23f0102640 0x7f23f006b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:17.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.066+0000 7f23effff640 1 --2- 172.21.15.70:0/582899535 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23f0104070 0x7f23f01a1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:17.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.066+0000 7f23e6ffd640 1 -- 172.21.15.70:0/582899535 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23f0104070 msgr2=0x7f23f01a1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:17.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.066+0000 7f23e6ffd640 1 --2- 172.21.15.70:0/582899535 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23f0104070 0x7f23f01a1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:17.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.067+0000 7f23e6ffd640 1 -- 172.21.15.70:0/582899535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23f0102640 msgr2=0x7f23f006b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:17.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.067+0000 7f23e6ffd640 1 --2- 172.21.15.70:0/582899535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23f0102640 0x7f23f006b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:17.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.067+0000 7f23e6ffd640 1 -- 172.21.15.70:0/582899535 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23f01a1a80 con 0x7f23f01036d0 2024-09-21T05:49:17.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.067+0000 7f23effff640 1 --2- 172.21.15.70:0/582899535 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23f0104070 0x7f23f01a1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:17.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.067+0000 7f23e6ffd640 1 --2- 172.21.15.70:0/582899535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23f01036d0 0x7f23f019ecd0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f23d800d950 tx=0x7f23d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:17.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.067+0000 7f23ed7fa640 1 -- 172.21.15.70:0/582899535 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d8017070 con 0x7f23f01036d0 2024-09-21T05:49:17.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.067+0000 7f23ed7fa640 1 -- 172.21.15.70:0/582899535 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f23d8009c30 con 0x7f23f01036d0 2024-09-21T05:49:17.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.067+0000 7f23f5b3f640 1 -- 172.21.15.70:0/582899535 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23f01a1d70 con 0x7f23f01036d0 2024-09-21T05:49:17.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.067+0000 7f23ed7fa640 1 -- 172.21.15.70:0/582899535 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d800f620 con 0x7f23f01036d0 2024-09-21T05:49:17.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.067+0000 7f23f5b3f640 1 -- 172.21.15.70:0/582899535 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23f01a2250 con 0x7f23f01036d0 2024-09-21T05:49:17.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.068+0000 7f23f5b3f640 1 -- 172.21.15.70:0/582899535 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23f0109820 con 0x7f23f01036d0 2024-09-21T05:49:17.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.069+0000 7f23ed7fa640 1 -- 172.21.15.70:0/582899535 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f23d80109a0 con 0x7f23f01036d0 2024-09-21T05:49:17.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.070+0000 7f23ed7fa640 1 --2- 172.21.15.70:0/582899535 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f23dc0b6510 0x7f23dc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:17.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.070+0000 7f23ef7fe640 1 --2- 172.21.15.70:0/582899535 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f23dc0b6510 0x7f23dc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:17.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.070+0000 7f23ed7fa640 1 -- 172.21.15.70:0/582899535 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f23d80e72d0 con 0x7f23f01036d0 2024-09-21T05:49:17.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.071+0000 7f23ef7fe640 1 --2- 172.21.15.70:0/582899535 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f23dc0b6510 0x7f23dc0b8a20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f23e0005d90 tx=0x7f23e0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:17.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.073+0000 7f23ed7fa640 1 -- 172.21.15.70:0/582899535 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f23d8009de0 con 0x7f23f01036d0 2024-09-21T05:49:17.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:16 smithi160 ceph-mon[33979]: pgmap v364: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-21T05:49:17.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.252+0000 7f23f5b3f640 1 -- 172.21.15.70:0/582899535 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f23f002e640 con 0x7f23f01036d0 2024-09-21T05:49:17.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.253+0000 7f23ed7fa640 1 -- 172.21.15.70:0/582899535 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v85) ==== 56+0+5729 (secure 0 0 0) 0x7f23d80ad770 con 0x7f23f01036d0 2024-09-21T05:49:17.256 INFO:teuthology.orchestra.run.smithi070.stdout:epoch 85 2024-09-21T05:49:17.256 INFO:teuthology.orchestra.run.smithi070.stdout:fsid 96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:49:17.256 INFO:teuthology.orchestra.run.smithi070.stdout:created 2024-09-21T05:38:42.297307+0000 2024-09-21T05:49:17.256 INFO:teuthology.orchestra.run.smithi070.stdout:modified 2024-09-21T05:48:38.706309+0000 2024-09-21T05:49:17.256 INFO:teuthology.orchestra.run.smithi070.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-21T05:49:17.256 INFO:teuthology.orchestra.run.smithi070.stdout:crush_version 27 2024-09-21T05:49:17.256 INFO:teuthology.orchestra.run.smithi070.stdout:full_ratio 0.95 2024-09-21T05:49:17.256 INFO:teuthology.orchestra.run.smithi070.stdout:backfillfull_ratio 0.9 2024-09-21T05:49:17.257 INFO:teuthology.orchestra.run.smithi070.stdout:nearfull_ratio 0.85 2024-09-21T05:49:17.257 INFO:teuthology.orchestra.run.smithi070.stdout:require_min_compat_client luminous 2024-09-21T05:49:17.257 INFO:teuthology.orchestra.run.smithi070.stdout:min_compat_client luminous 2024-09-21T05:49:17.257 INFO:teuthology.orchestra.run.smithi070.stdout:require_osd_release squid 2024-09-21T05:49:17.257 INFO:teuthology.orchestra.run.smithi070.stdout:stretch_mode_enabled false 2024-09-21T05:49:17.257 INFO:teuthology.orchestra.run.smithi070.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-21T05:49:17.257 INFO:teuthology.orchestra.run.smithi070.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 75 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-21T05:49:17.257 INFO:teuthology.orchestra.run.smithi070.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 75 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-21T05:49:17.257 INFO:teuthology.orchestra.run.smithi070.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 81 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-21T05:49:17.257 INFO:teuthology.orchestra.run.smithi070.stdout:max_osd 12 2024-09-21T05:49:17.257 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0 up in weight 1 up_from 8 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6802/1667051447,v1:172.21.15.70:6803/1667051447] [v2:172.21.15.70:6804/1667051447,v1:172.21.15.70:6805/1667051447] exists,up 00be8b82-7cb1-443f-ad18-02916f734df7 2024-09-21T05:49:17.257 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1 up in weight 1 up_from 12 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6800/1037621846,v1:172.21.15.116:6801/1037621846] [v2:172.21.15.116:6802/1037621846,v1:172.21.15.116:6803/1037621846] exists,up 28ca8c5c-5e81-4e64-ac0e-3c8c3c2d3930 2024-09-21T05:49:17.257 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2 up in weight 1 up_from 17 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.160:6800/69260815,v1:172.21.15.160:6801/69260815] [v2:172.21.15.160:6802/69260815,v1:172.21.15.160:6803/69260815] exists,up e9b42bf2-a38b-4cf9-8774-4950de12d0f2 2024-09-21T05:49:17.258 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3 up in weight 1 up_from 23 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6810/3849416072,v1:172.21.15.70:6811/3849416072] [v2:172.21.15.70:6812/3849416072,v1:172.21.15.70:6813/3849416072] exists,up 25d8e9a8-3c14-43d6-9bb1-b44cd377133f 2024-09-21T05:49:17.258 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4 up in weight 1 up_from 29 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6808/3444857438,v1:172.21.15.116:6809/3444857438] [v2:172.21.15.116:6810/3444857438,v1:172.21.15.116:6811/3444857438] exists,up bdb84cbd-d718-4f69-90d0-2e732e580df6 2024-09-21T05:49:17.258 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5 up in weight 1 up_from 35 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.160:6808/3063220427,v1:172.21.15.160:6809/3063220427] [v2:172.21.15.160:6810/3063220427,v1:172.21.15.160:6811/3063220427] exists,up a490eeba-549f-4caa-8cd5-4168a23dafa8 2024-09-21T05:49:17.258 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6 up in weight 1 up_from 41 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6818/3650315688,v1:172.21.15.70:6819/3650315688] [v2:172.21.15.70:6820/3650315688,v1:172.21.15.70:6821/3650315688] exists,up 1bf22f48-c02f-4f09-b0fe-2597a55fd795 2024-09-21T05:49:17.258 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7 up in weight 1 up_from 46 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6816/2034132009,v1:172.21.15.116:6817/2034132009] [v2:172.21.15.116:6818/2034132009,v1:172.21.15.116:6819/2034132009] exists,up 40d59744-4860-4a92-aa21-3f33e575e5b7 2024-09-21T05:49:17.258 INFO:teuthology.orchestra.run.smithi070.stdout:osd.8 up in weight 1 up_from 52 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.160:6816/3381625184,v1:172.21.15.160:6817/3381625184] [v2:172.21.15.160:6818/3381625184,v1:172.21.15.160:6819/3381625184] exists,up 65dc02e7-0dcd-4fa7-955a-4d5c00fbe4cd 2024-09-21T05:49:17.258 INFO:teuthology.orchestra.run.smithi070.stdout:osd.9 up in weight 1 up_from 58 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6826/3555256209,v1:172.21.15.70:6827/3555256209] [v2:172.21.15.70:6828/3555256209,v1:172.21.15.70:6829/3555256209] exists,up d8438a9c-012f-4082-be3f-9653cdfaac78 2024-09-21T05:49:17.258 INFO:teuthology.orchestra.run.smithi070.stdout:osd.10 up in weight 1 up_from 63 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6824/541280433,v1:172.21.15.116:6825/541280433] [v2:172.21.15.116:6826/541280433,v1:172.21.15.116:6827/541280433] exists,up 871619b0-181e-4020-9511-2cec296bfe70 2024-09-21T05:49:17.258 INFO:teuthology.orchestra.run.smithi070.stdout:osd.11 up in weight 1 up_from 69 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.160:6824/2632369083,v1:172.21.15.160:6825/2632369083] [v2:172.21.15.160:6826/2632369083,v1:172.21.15.160:6827/2632369083] exists,up 302da945-7929-4b0c-a20b-099175752c41 2024-09-21T05:49:17.258 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 2.f [8,11] 2024-09-21T05:49:17.258 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 2.10 [8,11] 2024-09-21T05:49:17.258 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 2.16 [2,4] 2024-09-21T05:49:17.258 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 2.1b [2,1] 2024-09-21T05:49:17.258 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.17 [4,8] 2024-09-21T05:49:17.259 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.1b [4,6] 2024-09-21T05:49:17.259 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.21 [5,9] 2024-09-21T05:49:17.259 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.25 [5,9] 2024-09-21T05:49:17.259 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.27 [3,9] 2024-09-21T05:49:17.259 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.31 [4,7] 2024-09-21T05:49:17.259 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.3a [4,8] 2024-09-21T05:49:17.259 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 4.2 [9,1] 2024-09-21T05:49:17.259 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 4.6 [5,8] 2024-09-21T05:49:17.259 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 4.c [9,10] 2024-09-21T05:49:17.259 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 4.e [9,8] 2024-09-21T05:49:17.259 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:6800/605055695 expires 2024-09-22T05:39:37.296630+0000 2024-09-21T05:49:17.259 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/897886925 expires 2024-09-22T05:39:37.296630+0000 2024-09-21T05:49:17.259 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/1968357524 expires 2024-09-22T05:39:37.296630+0000 2024-09-21T05:49:17.259 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/693721445 expires 2024-09-22T05:39:37.296630+0000 2024-09-21T05:49:17.259 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/2810307308 expires 2024-09-22T05:39:12.492271+0000 2024-09-21T05:49:17.260 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:6801/605055695 expires 2024-09-22T05:39:37.296630+0000 2024-09-21T05:49:17.260 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:6801/1668927582 expires 2024-09-22T05:39:12.492271+0000 2024-09-21T05:49:17.260 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:6800/1668927582 expires 2024-09-22T05:39:12.492271+0000 2024-09-21T05:49:17.260 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/1979536420 expires 2024-09-22T05:39:12.492271+0000 2024-09-21T05:49:17.260 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/2674019604 expires 2024-09-22T05:39:12.492271+0000 2024-09-21T05:49:17.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.255+0000 7f23f5b3f640 1 -- 172.21.15.70:0/582899535 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f23dc0b6510 msgr2=0x7f23dc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:17.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.255+0000 7f23f5b3f640 1 --2- 172.21.15.70:0/582899535 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f23dc0b6510 0x7f23dc0b8a20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f23e0005d90 tx=0x7f23e0005a20 comp rx=0 tx=0).stop 2024-09-21T05:49:17.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.255+0000 7f23f5b3f640 1 -- 172.21.15.70:0/582899535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23f01036d0 msgr2=0x7f23f019ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:17.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.255+0000 7f23f5b3f640 1 --2- 172.21.15.70:0/582899535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23f01036d0 0x7f23f019ecd0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f23d800d950 tx=0x7f23d800de10 comp rx=0 tx=0).stop 2024-09-21T05:49:17.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.255+0000 7f23f5b3f640 1 -- 172.21.15.70:0/582899535 shutdown_connections 2024-09-21T05:49:17.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.255+0000 7f23f5b3f640 1 --2- 172.21.15.70:0/582899535 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f23dc0b6510 0x7f23dc0b8a20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:17.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.255+0000 7f23f5b3f640 1 --2- 172.21.15.70:0/582899535 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23f0104070 0x7f23f01a1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:17.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.255+0000 7f23f5b3f640 1 --2- 172.21.15.70:0/582899535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23f01036d0 0x7f23f019ecd0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:17.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.255+0000 7f23f5b3f640 1 --2- 172.21.15.70:0/582899535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23f0102640 0x7f23f006b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:17.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.255+0000 7f23f5b3f640 1 -- 172.21.15.70:0/582899535 >> 172.21.15.70:0/582899535 conn(0x7f23f00fdfb0 msgr2=0x7f23f01069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:17.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.255+0000 7f23f5b3f640 1 -- 172.21.15.70:0/582899535 shutdown_connections 2024-09-21T05:49:17.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:17.255+0000 7f23f5b3f640 1 -- 172.21.15.70:0/582899535 wait complete. 2024-09-21T05:49:17.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:16 smithi116 ceph-mon[34332]: pgmap v364: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-21T05:49:17.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:17 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/582899535' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T05:49:18.082 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-21T05:49:18.100 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:49:18.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:17 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/582899535' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T05:49:18.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:17 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/582899535' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T05:49:18.346 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:18.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.828+0000 7f4b445bf640 1 -- 172.21.15.70:0/623695825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b3c1094a0 msgr2=0x7f4b3c1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:18.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.828+0000 7f4b445bf640 1 --2- 172.21.15.70:0/623695825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b3c1094a0 0x7f4b3c1098b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c009900 tx=0x7f4b2c02a410 comp rx=0 tx=0).stop 2024-09-21T05:49:18.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.828+0000 7f4b445bf640 1 -- 172.21.15.70:0/623695825 shutdown_connections 2024-09-21T05:49:18.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.828+0000 7f4b445bf640 1 --2- 172.21.15.70:0/623695825 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b3c109df0 0x7f4b3c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:18.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.828+0000 7f4b445bf640 1 --2- 172.21.15.70:0/623695825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b3c1094a0 0x7f4b3c1098b0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:18.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.828+0000 7f4b445bf640 1 --2- 172.21.15.70:0/623695825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b3c103b60 0x7f4b3c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:18.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.828+0000 7f4b445bf640 1 -- 172.21.15.70:0/623695825 >> 172.21.15.70:0/623695825 conn(0x7f4b3c07b850 msgr2=0x7f4b3c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:18.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.828+0000 7f4b445bf640 1 -- 172.21.15.70:0/623695825 shutdown_connections 2024-09-21T05:49:18.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.828+0000 7f4b445bf640 1 -- 172.21.15.70:0/623695825 wait complete. 2024-09-21T05:49:18.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.829+0000 7f4b445bf640 1 Processor -- start 2024-09-21T05:49:18.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.829+0000 7f4b445bf640 1 -- start start 2024-09-21T05:49:18.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.829+0000 7f4b445bf640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b3c103b60 0x7f4b3c19a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:18.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.829+0000 7f4b445bf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b3c1094a0 0x7f4b3c19aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:18.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.829+0000 7f4b445bf640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b3c109df0 0x7f4b3c19fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:18.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.829+0000 7f4b445bf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c113a80 con 0x7f4b3c1094a0 2024-09-21T05:49:18.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.829+0000 7f4b445bf640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c113900 con 0x7f4b3c103b60 2024-09-21T05:49:18.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.829+0000 7f4b445bf640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c113c00 con 0x7f4b3c109df0 2024-09-21T05:49:18.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.829+0000 7f4b41b5a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b3c1094a0 0x7f4b3c19aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:18.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.829+0000 7f4b41b5a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b3c1094a0 0x7f4b3c19aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35050/0 (socket says 172.21.15.70:35050) 2024-09-21T05:49:18.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.829+0000 7f4b41b5a640 1 -- 172.21.15.70:0/2196436514 learned_addr learned my addr 172.21.15.70:0/2196436514 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:18.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.829+0000 7f4b42b5c640 1 --2- 172.21.15.70:0/2196436514 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b3c109df0 0x7f4b3c19fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:18.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.829+0000 7f4b4235b640 1 --2- 172.21.15.70:0/2196436514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b3c103b60 0x7f4b3c19a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:18.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.829+0000 7f4b41b5a640 1 -- 172.21.15.70:0/2196436514 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b3c109df0 msgr2=0x7f4b3c19fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:18.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.829+0000 7f4b41b5a640 1 --2- 172.21.15.70:0/2196436514 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b3c109df0 0x7f4b3c19fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:18.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.829+0000 7f4b41b5a640 1 -- 172.21.15.70:0/2196436514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b3c103b60 msgr2=0x7f4b3c19a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:18.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.829+0000 7f4b41b5a640 1 --2- 172.21.15.70:0/2196436514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b3c103b60 0x7f4b3c19a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:18.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.829+0000 7f4b41b5a640 1 -- 172.21.15.70:0/2196436514 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b3c1a0480 con 0x7f4b3c1094a0 2024-09-21T05:49:18.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.830+0000 7f4b41b5a640 1 --2- 172.21.15.70:0/2196436514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b3c1094a0 0x7f4b3c19aab0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c02a930 tx=0x7f4b2c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:18.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.830+0000 7f4b337fe640 1 -- 172.21.15.70:0/2196436514 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c03f030 con 0x7f4b3c1094a0 2024-09-21T05:49:18.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.830+0000 7f4b337fe640 1 -- 172.21.15.70:0/2196436514 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f4b2c004490 con 0x7f4b3c1094a0 2024-09-21T05:49:18.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.830+0000 7f4b445bf640 1 -- 172.21.15.70:0/2196436514 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b3c1a0710 con 0x7f4b3c1094a0 2024-09-21T05:49:18.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.830+0000 7f4b337fe640 1 -- 172.21.15.70:0/2196436514 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c035070 con 0x7f4b3c1094a0 2024-09-21T05:49:18.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.830+0000 7f4b445bf640 1 -- 172.21.15.70:0/2196436514 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b3c1a6ed0 con 0x7f4b3c1094a0 2024-09-21T05:49:18.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.831+0000 7f4b445bf640 1 -- 172.21.15.70:0/2196436514 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b3c104de0 con 0x7f4b3c1094a0 2024-09-21T05:49:18.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.832+0000 7f4b337fe640 1 -- 172.21.15.70:0/2196436514 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f4b2c042030 con 0x7f4b3c1094a0 2024-09-21T05:49:18.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.833+0000 7f4b337fe640 1 --2- 172.21.15.70:0/2196436514 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4b280b6590 0x7f4b280b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:18.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.833+0000 7f4b4235b640 1 --2- 172.21.15.70:0/2196436514 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4b280b6590 0x7f4b280b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:18.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.833+0000 7f4b337fe640 1 -- 172.21.15.70:0/2196436514 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f4b2c108000 con 0x7f4b3c1094a0 2024-09-21T05:49:18.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.834+0000 7f4b4235b640 1 --2- 172.21.15.70:0/2196436514 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4b280b6590 0x7f4b280b8aa0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4b38005fd0 tx=0x7f4b38005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:18.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:18.836+0000 7f4b337fe640 1 -- 172.21.15.70:0/2196436514 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4b2c0ce4a0 con 0x7f4b3c1094a0 2024-09-21T05:49:18.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:18 smithi070 ceph-mon[30981]: pgmap v365: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-21T05:49:19.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:19.054+0000 7f4b445bf640 1 -- 172.21.15.70:0/2196436514 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b3c103f70 con 0x7f4b3c1094a0 2024-09-21T05:49:19.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:19.054+0000 7f4b337fe640 1 -- 172.21.15.70:0/2196436514 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11986 (secure 0 0 0) 0x7f4b3c103f70 con 0x7f4b3c1094a0 2024-09-21T05:49:19.058 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:49:19.058 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":27,"btime":"2024-09-21T05:47:50:538503+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3519318330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3519318330},{"type":"v1","addr":"172.21.15.70:6835","nonce":3519318330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2706663460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2706663460},{"type":"v1","addr":"172.21.15.70:6837","nonce":2706663460}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:47:06.246985+0000","modified":"2024-09-21T05:47:50.538486+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24628,"mds_2":24611,"mds_3":24610,"mds_4":24598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/1914209867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1914209867},{"type":"v1","addr":"172.21.15.70:6839","nonce":1914209867}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3392175775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3392175775},{"type":"v1","addr":"172.21.15.70:6841","nonce":3392175775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/3543945704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3543945704},{"type":"v1","addr":"172.21.15.160:6833","nonce":3543945704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6833/283778129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":283778129},{"type":"v1","addr":"172.21.15.116:6833","nonce":283778129}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/3787256790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3787256790},{"type":"v1","addr":"172.21.15.116:6835","nonce":3787256790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.160:6835/2001692372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2001692372},{"type":"v1","addr":"172.21.15.160:6835","nonce":2001692372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.160:6837/2558120045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2558120045},{"type":"v1","addr":"172.21.15.160:6837","nonce":2558120045}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24611":{"gid":24611,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/444312934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":444312934},{"type":"v1","addr":"172.21.15.116:6837","nonce":444312934}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.160:6839/1339744282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1339744282},{"type":"v1","addr":"172.21.15.160:6839","nonce":1339744282}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/3952175670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3952175670},{"type":"v1","addr":"172.21.15.116:6839","nonce":3952175670}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24641,"qdb_cluster":[24641,24628,24610,24611,24598]},"id":1}]} 2024-09-21T05:49:19.058 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 27 2024-09-21T05:49:19.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:19.057+0000 7f4b445bf640 1 -- 172.21.15.70:0/2196436514 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4b280b6590 msgr2=0x7f4b280b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:19.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:19.057+0000 7f4b445bf640 1 --2- 172.21.15.70:0/2196436514 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4b280b6590 0x7f4b280b8aa0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4b38005fd0 tx=0x7f4b38005850 comp rx=0 tx=0).stop 2024-09-21T05:49:19.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:19.057+0000 7f4b445bf640 1 -- 172.21.15.70:0/2196436514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b3c1094a0 msgr2=0x7f4b3c19aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:19.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:19.057+0000 7f4b445bf640 1 --2- 172.21.15.70:0/2196436514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b3c1094a0 0x7f4b3c19aab0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c02a930 tx=0x7f4b2c004270 comp rx=0 tx=0).stop 2024-09-21T05:49:19.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:19.057+0000 7f4b445bf640 1 -- 172.21.15.70:0/2196436514 shutdown_connections 2024-09-21T05:49:19.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:19.057+0000 7f4b445bf640 1 --2- 172.21.15.70:0/2196436514 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4b280b6590 0x7f4b280b8aa0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:19.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:19.057+0000 7f4b445bf640 1 --2- 172.21.15.70:0/2196436514 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b3c109df0 0x7f4b3c19fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:19.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:19.057+0000 7f4b445bf640 1 --2- 172.21.15.70:0/2196436514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b3c1094a0 0x7f4b3c19aab0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:19.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:19.057+0000 7f4b445bf640 1 --2- 172.21.15.70:0/2196436514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b3c103b60 0x7f4b3c19a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:19.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:19.057+0000 7f4b445bf640 1 -- 172.21.15.70:0/2196436514 >> 172.21.15.70:0/2196436514 conn(0x7f4b3c07b850 msgr2=0x7f4b3c1075b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:19.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:19.057+0000 7f4b445bf640 1 -- 172.21.15.70:0/2196436514 shutdown_connections 2024-09-21T05:49:19.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:19.057+0000 7f4b445bf640 1 -- 172.21.15.70:0/2196436514 wait complete. 2024-09-21T05:49:19.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:18 smithi160 ceph-mon[33979]: pgmap v365: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-21T05:49:19.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:18 smithi116 ceph-mon[34332]: pgmap v365: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-21T05:49:19.795 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:49:19.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:19 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2196436514' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:49:20.060 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:20.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:19 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2196436514' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:49:20.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:19 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2196436514' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:49:20.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.547+0000 7fdc44f6c640 1 -- 172.21.15.70:0/222235692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc40103b70 msgr2=0x7fdc40103f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:20.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.547+0000 7fdc44f6c640 1 --2- 172.21.15.70:0/222235692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc40103b70 0x7fdc40103f80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fdc30009900 tx=0x7fdc3002a410 comp rx=0 tx=0).stop 2024-09-21T05:49:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.547+0000 7fdc44f6c640 1 -- 172.21.15.70:0/222235692 shutdown_connections 2024-09-21T05:49:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.547+0000 7fdc44f6c640 1 --2- 172.21.15.70:0/222235692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc401094b0 0x7fdc401098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.547+0000 7fdc44f6c640 1 --2- 172.21.15.70:0/222235692 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc40109e00 0x7fdc40110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.547+0000 7fdc44f6c640 1 --2- 172.21.15.70:0/222235692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc40103b70 0x7fdc40103f80 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.547+0000 7fdc44f6c640 1 -- 172.21.15.70:0/222235692 >> 172.21.15.70:0/222235692 conn(0x7fdc400ff5e0 msgr2=0x7fdc40101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.547+0000 7fdc44f6c640 1 -- 172.21.15.70:0/222235692 shutdown_connections 2024-09-21T05:49:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.547+0000 7fdc44f6c640 1 -- 172.21.15.70:0/222235692 wait complete. 2024-09-21T05:49:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.548+0000 7fdc44f6c640 1 Processor -- start 2024-09-21T05:49:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.548+0000 7fdc44f6c640 1 -- start start 2024-09-21T05:49:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.548+0000 7fdc44f6c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc40103b70 0x7fdc4019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.548+0000 7fdc44f6c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc401094b0 0x7fdc4019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.548+0000 7fdc44f6c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc40109e00 0x7fdc4019fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.548+0000 7fdc44f6c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdc40113b70 con 0x7fdc40109e00 2024-09-21T05:49:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.548+0000 7fdc44f6c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fdc401139f0 con 0x7fdc40103b70 2024-09-21T05:49:20.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.548+0000 7fdc44f6c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fdc40113cf0 con 0x7fdc401094b0 2024-09-21T05:49:20.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.548+0000 7fdc3ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc40109e00 0x7fdc4019fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:20.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.548+0000 7fdc3ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc40109e00 0x7fdc4019fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56098/0 (socket says 172.21.15.70:56098) 2024-09-21T05:49:20.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.548+0000 7fdc3ed9d640 1 -- 172.21.15.70:0/1791059301 learned_addr learned my addr 172.21.15.70:0/1791059301 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:20.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.548+0000 7fdc3e59c640 1 --2- 172.21.15.70:0/1791059301 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc40103b70 0x7fdc4019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:20.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.548+0000 7fdc3dd9b640 1 --2- 172.21.15.70:0/1791059301 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc401094b0 0x7fdc4019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:20.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.549+0000 7fdc3ed9d640 1 -- 172.21.15.70:0/1791059301 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc401094b0 msgr2=0x7fdc4019aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:20.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.549+0000 7fdc3ed9d640 1 --2- 172.21.15.70:0/1791059301 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc401094b0 0x7fdc4019aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:20.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.549+0000 7fdc3ed9d640 1 -- 172.21.15.70:0/1791059301 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc40103b70 msgr2=0x7fdc4019a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:20.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.549+0000 7fdc3ed9d640 1 --2- 172.21.15.70:0/1791059301 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc40103b70 0x7fdc4019a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:20.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.549+0000 7fdc3ed9d640 1 -- 172.21.15.70:0/1791059301 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc401a0570 con 0x7fdc40109e00 2024-09-21T05:49:20.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.549+0000 7fdc3ed9d640 1 --2- 172.21.15.70:0/1791059301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc40109e00 0x7fdc4019fe40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fdc3800b970 tx=0x7fdc3800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:20.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.549+0000 7fdc2f7fe640 1 -- 172.21.15.70:0/1791059301 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc38019070 con 0x7fdc40109e00 2024-09-21T05:49:20.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.549+0000 7fdc44f6c640 1 -- 172.21.15.70:0/1791059301 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc401a0860 con 0x7fdc40109e00 2024-09-21T05:49:20.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.549+0000 7fdc2f7fe640 1 -- 172.21.15.70:0/1791059301 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fdc38014440 con 0x7fdc40109e00 2024-09-21T05:49:20.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.549+0000 7fdc2f7fe640 1 -- 172.21.15.70:0/1791059301 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc380075d0 con 0x7fdc40109e00 2024-09-21T05:49:20.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.549+0000 7fdc44f6c640 1 -- 172.21.15.70:0/1791059301 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc401a6fc0 con 0x7fdc40109e00 2024-09-21T05:49:20.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.550+0000 7fdc44f6c640 1 -- 172.21.15.70:0/1791059301 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc40104000 con 0x7fdc40109e00 2024-09-21T05:49:20.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.551+0000 7fdc2f7fe640 1 -- 172.21.15.70:0/1791059301 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fdc3801c070 con 0x7fdc40109e00 2024-09-21T05:49:20.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.552+0000 7fdc2f7fe640 1 --2- 172.21.15.70:0/1791059301 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdc280b6590 0x7fdc280b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:20.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.552+0000 7fdc3e59c640 1 --2- 172.21.15.70:0/1791059301 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdc280b6590 0x7fdc280b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:20.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.552+0000 7fdc2f7fe640 1 -- 172.21.15.70:0/1791059301 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fdc380e6a80 con 0x7fdc40109e00 2024-09-21T05:49:20.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.553+0000 7fdc3e59c640 1 --2- 172.21.15.70:0/1791059301 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdc280b6590 0x7fdc280b8aa0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdc30005d90 tx=0x7fdc30005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:20.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.557+0000 7fdc2f7fe640 1 -- 172.21.15.70:0/1791059301 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdc380b1300 con 0x7fdc40109e00 2024-09-21T05:49:20.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.773+0000 7fdc44f6c640 1 -- 172.21.15.70:0/1791059301 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc4002e640 con 0x7fdc40109e00 2024-09-21T05:49:20.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.774+0000 7fdc2f7fe640 1 -- 172.21.15.70:0/1791059301 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11986 (secure 0 0 0) 0x7fdc380b6240 con 0x7fdc40109e00 2024-09-21T05:49:20.776 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:49:20.776 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":27,"btime":"2024-09-21T05:47:50:538503+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3519318330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3519318330},{"type":"v1","addr":"172.21.15.70:6835","nonce":3519318330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2706663460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2706663460},{"type":"v1","addr":"172.21.15.70:6837","nonce":2706663460}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:47:06.246985+0000","modified":"2024-09-21T05:47:50.538486+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24628,"mds_2":24611,"mds_3":24610,"mds_4":24598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/1914209867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1914209867},{"type":"v1","addr":"172.21.15.70:6839","nonce":1914209867}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3392175775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3392175775},{"type":"v1","addr":"172.21.15.70:6841","nonce":3392175775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/3543945704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3543945704},{"type":"v1","addr":"172.21.15.160:6833","nonce":3543945704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6833/283778129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":283778129},{"type":"v1","addr":"172.21.15.116:6833","nonce":283778129}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/3787256790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3787256790},{"type":"v1","addr":"172.21.15.116:6835","nonce":3787256790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.160:6835/2001692372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2001692372},{"type":"v1","addr":"172.21.15.160:6835","nonce":2001692372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.160:6837/2558120045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2558120045},{"type":"v1","addr":"172.21.15.160:6837","nonce":2558120045}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24611":{"gid":24611,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/444312934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":444312934},{"type":"v1","addr":"172.21.15.116:6837","nonce":444312934}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.160:6839/1339744282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1339744282},{"type":"v1","addr":"172.21.15.160:6839","nonce":1339744282}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/3952175670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3952175670},{"type":"v1","addr":"172.21.15.116:6839","nonce":3952175670}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24641,"qdb_cluster":[24641,24628,24610,24611,24598]},"id":1}]} 2024-09-21T05:49:20.777 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 27 2024-09-21T05:49:20.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.776+0000 7fdc44f6c640 1 -- 172.21.15.70:0/1791059301 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdc280b6590 msgr2=0x7fdc280b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:20.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.776+0000 7fdc44f6c640 1 --2- 172.21.15.70:0/1791059301 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdc280b6590 0x7fdc280b8aa0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdc30005d90 tx=0x7fdc30005e80 comp rx=0 tx=0).stop 2024-09-21T05:49:20.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.776+0000 7fdc44f6c640 1 -- 172.21.15.70:0/1791059301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc40109e00 msgr2=0x7fdc4019fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:20.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.776+0000 7fdc44f6c640 1 --2- 172.21.15.70:0/1791059301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc40109e00 0x7fdc4019fe40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fdc3800b970 tx=0x7fdc3800bd70 comp rx=0 tx=0).stop 2024-09-21T05:49:20.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.776+0000 7fdc44f6c640 1 -- 172.21.15.70:0/1791059301 shutdown_connections 2024-09-21T05:49:20.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.776+0000 7fdc44f6c640 1 --2- 172.21.15.70:0/1791059301 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdc280b6590 0x7fdc280b8aa0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:20.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.776+0000 7fdc44f6c640 1 --2- 172.21.15.70:0/1791059301 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc401094b0 0x7fdc4019aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:20.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.776+0000 7fdc44f6c640 1 --2- 172.21.15.70:0/1791059301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc40109e00 0x7fdc4019fe40 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:20.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.776+0000 7fdc44f6c640 1 --2- 172.21.15.70:0/1791059301 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc40103b70 0x7fdc4019a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:20.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.776+0000 7fdc44f6c640 1 -- 172.21.15.70:0/1791059301 >> 172.21.15.70:0/1791059301 conn(0x7fdc400ff5e0 msgr2=0x7fdc40101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:20.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.776+0000 7fdc44f6c640 1 -- 172.21.15.70:0/1791059301 shutdown_connections 2024-09-21T05:49:20.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:20.776+0000 7fdc44f6c640 1 -- 172.21.15.70:0/1791059301 wait complete. 2024-09-21T05:49:21.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:20 smithi160 ceph-mon[33979]: pgmap v366: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-21T05:49:21.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:20 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1791059301' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:49:21.153 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:20 smithi070 ceph-mon[30981]: pgmap v366: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-21T05:49:21.153 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:20 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1791059301' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:49:21.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:20 smithi116 ceph-mon[34332]: pgmap v366: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-21T05:49:21.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:20 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1791059301' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:49:21.491 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:49:21.742 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:22.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.234+0000 7f1d367b4640 1 -- 172.21.15.70:0/396597108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d30103b60 msgr2=0x7f1d30103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:22.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.234+0000 7f1d367b4640 1 --2- 172.21.15.70:0/396597108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d30103b60 0x7f1d30103f70 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1d20009900 tx=0x7f1d2002a410 comp rx=0 tx=0).stop 2024-09-21T05:49:22.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.234+0000 7f1d367b4640 1 -- 172.21.15.70:0/396597108 shutdown_connections 2024-09-21T05:49:22.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.234+0000 7f1d367b4640 1 --2- 172.21.15.70:0/396597108 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d301094a0 0x7f1d301098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:22.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.234+0000 7f1d367b4640 1 --2- 172.21.15.70:0/396597108 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d30109df0 0x7f1d30110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:22.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.234+0000 7f1d367b4640 1 --2- 172.21.15.70:0/396597108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d30103b60 0x7f1d30103f70 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:22.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.234+0000 7f1d367b4640 1 -- 172.21.15.70:0/396597108 >> 172.21.15.70:0/396597108 conn(0x7f1d3007b850 msgr2=0x7f1d3007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:22.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.234+0000 7f1d367b4640 1 -- 172.21.15.70:0/396597108 shutdown_connections 2024-09-21T05:49:22.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.234+0000 7f1d367b4640 1 -- 172.21.15.70:0/396597108 wait complete. 2024-09-21T05:49:22.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.235+0000 7f1d367b4640 1 Processor -- start 2024-09-21T05:49:22.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.235+0000 7f1d367b4640 1 -- start start 2024-09-21T05:49:22.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.236+0000 7f1d367b4640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d30103b60 0x7f1d3019a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:22.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.236+0000 7f1d367b4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d301094a0 0x7f1d3019aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:22.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.236+0000 7f1d367b4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d30109df0 0x7f1d3019fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:22.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.236+0000 7f1d367b4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1d30113ae0 con 0x7f1d30109df0 2024-09-21T05:49:22.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.236+0000 7f1d367b4640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1d30113960 con 0x7f1d30103b60 2024-09-21T05:49:22.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.236+0000 7f1d367b4640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1d30113c60 con 0x7f1d301094a0 2024-09-21T05:49:22.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.236+0000 7f1d34d51640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d30109df0 0x7f1d3019fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:22.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.236+0000 7f1d34d51640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d30109df0 0x7f1d3019fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56112/0 (socket says 172.21.15.70:56112) 2024-09-21T05:49:22.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.236+0000 7f1d34d51640 1 -- 172.21.15.70:0/655288365 learned_addr learned my addr 172.21.15.70:0/655288365 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:22.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.236+0000 7f1d2ffff640 1 --2- 172.21.15.70:0/655288365 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d30103b60 0x7f1d3019a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:22.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.236+0000 7f1d2f7fe640 1 --2- 172.21.15.70:0/655288365 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d301094a0 0x7f1d3019aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:22.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.236+0000 7f1d34d51640 1 -- 172.21.15.70:0/655288365 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d301094a0 msgr2=0x7f1d3019aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:22.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.236+0000 7f1d34d51640 1 --2- 172.21.15.70:0/655288365 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d301094a0 0x7f1d3019aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:22.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.236+0000 7f1d34d51640 1 -- 172.21.15.70:0/655288365 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d30103b60 msgr2=0x7f1d3019a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:22.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.236+0000 7f1d34d51640 1 --2- 172.21.15.70:0/655288365 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d30103b60 0x7f1d3019a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:22.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.236+0000 7f1d34d51640 1 -- 172.21.15.70:0/655288365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d301a0440 con 0x7f1d30109df0 2024-09-21T05:49:22.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.236+0000 7f1d34d51640 1 --2- 172.21.15.70:0/655288365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d30109df0 0x7f1d3019fd10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800eaa0 tx=0x7f1d2800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:22.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.237+0000 7f1d2d7fa640 1 -- 172.21.15.70:0/655288365 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d28004d20 con 0x7f1d30109df0 2024-09-21T05:49:22.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.237+0000 7f1d2d7fa640 1 -- 172.21.15.70:0/655288365 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f1d28005020 con 0x7f1d30109df0 2024-09-21T05:49:22.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.237+0000 7f1d367b4640 1 -- 172.21.15.70:0/655288365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d301a0730 con 0x7f1d30109df0 2024-09-21T05:49:22.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.237+0000 7f1d2d7fa640 1 -- 172.21.15.70:0/655288365 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d280116d0 con 0x7f1d30109df0 2024-09-21T05:49:22.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.237+0000 7f1d367b4640 1 -- 172.21.15.70:0/655288365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d301a6e90 con 0x7f1d30109df0 2024-09-21T05:49:22.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.238+0000 7f1d367b4640 1 -- 172.21.15.70:0/655288365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d30103f70 con 0x7f1d30109df0 2024-09-21T05:49:22.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.239+0000 7f1d2d7fa640 1 -- 172.21.15.70:0/655288365 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f1d280051d0 con 0x7f1d30109df0 2024-09-21T05:49:22.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.240+0000 7f1d2d7fa640 1 --2- 172.21.15.70:0/655288365 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1d180b6510 0x7f1d180b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:22.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.240+0000 7f1d2ffff640 1 --2- 172.21.15.70:0/655288365 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1d180b6510 0x7f1d180b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:22.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.240+0000 7f1d2d7fa640 1 -- 172.21.15.70:0/655288365 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f1d280e7c60 con 0x7f1d30109df0 2024-09-21T05:49:22.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.241+0000 7f1d2ffff640 1 --2- 172.21.15.70:0/655288365 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1d180b6510 0x7f1d180b8a20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1d20005d90 tx=0x7f1d20005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:22.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.243+0000 7f1d2d7fa640 1 -- 172.21.15.70:0/655288365 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1d28016030 con 0x7f1d30109df0 2024-09-21T05:49:22.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.422+0000 7f1d367b4640 1 -- 172.21.15.70:0/655288365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1d3019b600 con 0x7f1d30109df0 2024-09-21T05:49:22.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.424+0000 7f1d2d7fa640 1 -- 172.21.15.70:0/655288365 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24983 (secure 0 0 0) 0x7f1d3019b600 con 0x7f1d30109df0 2024-09-21T05:49:22.426 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:49:22.426 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":85,"fsid":"96c6636e-77db-11ef-baf5-efdc52797490","created":"2024-09-21T05:38:42.297307+0000","modified":"2024-09-21T05:48:38.706309+0000","last_up_change":"2024-09-21T05:46:15.910344+0000","last_in_change":"2024-09-21T05:45:53.382766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:42:25.611590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:47:01.987981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:47:04.388107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T05:47:10.651871+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00be8b82-7cb1-443f-ad18-02916f734df7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6803","nonce":1667051447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6805","nonce":1667051447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6809","nonce":1667051447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6807","nonce":1667051447}]},"public_addr":"172.21.15.70:6803/1667051447","cluster_addr":"172.21.15.70:6805/1667051447","heartbeat_back_addr":"172.21.15.70:6809/1667051447","heartbeat_front_addr":"172.21.15.70:6807/1667051447","state":["exists","up"]},{"osd":1,"uuid":"28ca8c5c-5e81-4e64-ac0e-3c8c3c2d3930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6801","nonce":1037621846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6803","nonce":1037621846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6807","nonce":1037621846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6805","nonce":1037621846}]},"public_addr":"172.21.15.116:6801/1037621846","cluster_addr":"172.21.15.116:6803/1037621846","heartbeat_back_addr":"172.21.15.116:6807/1037621846","heartbeat_front_addr":"172.21.15.116:6805/1037621846","state":["exists","up"]},{"osd":2,"uuid":"e9b42bf2-a38b-4cf9-8774-4950de12d0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6801","nonce":69260815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6803","nonce":69260815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6807","nonce":69260815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6805","nonce":69260815}]},"public_addr":"172.21.15.160:6801/69260815","cluster_addr":"172.21.15.160:6803/69260815","heartbeat_back_addr":"172.21.15.160:6807/69260815","heartbeat_front_addr":"172.21.15.160:6805/69260815","state":["exists","up"]},{"osd":3,"uuid":"25d8e9a8-3c14-43d6-9bb1-b44cd377133f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6811","nonce":3849416072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6813","nonce":3849416072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6817","nonce":3849416072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6815","nonce":3849416072}]},"public_addr":"172.21.15.70:6811/3849416072","cluster_addr":"172.21.15.70:6813/3849416072","heartbeat_back_addr":"172.21.15.70:6817/3849416072","heartbeat_front_addr":"172.21.15.70:6815/3849416072","state":["exists","up"]},{"osd":4,"uuid":"bdb84cbd-d718-4f69-90d0-2e732e580df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6809","nonce":3444857438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6811","nonce":3444857438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6815","nonce":3444857438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6813","nonce":3444857438}]},"public_addr":"172.21.15.116:6809/3444857438","cluster_addr":"172.21.15.116:6811/3444857438","heartbeat_back_addr":"172.21.15.116:6815/3444857438","heartbeat_front_addr":"172.21.15.116:6813/3444857438","state":["exists","up"]},{"osd":5,"uuid":"a490eeba-549f-4caa-8cd5-4168a23dafa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6809","nonce":3063220427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6811","nonce":3063220427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6815","nonce":3063220427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6813","nonce":3063220427}]},"public_addr":"172.21.15.160:6809/3063220427","cluster_addr":"172.21.15.160:6811/3063220427","heartbeat_back_addr":"172.21.15.160:6815/3063220427","heartbeat_front_addr":"172.21.15.160:6813/3063220427","state":["exists","up"]},{"osd":6,"uuid":"1bf22f48-c02f-4f09-b0fe-2597a55fd795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6819","nonce":3650315688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6821","nonce":3650315688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6825","nonce":3650315688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6823","nonce":3650315688}]},"public_addr":"172.21.15.70:6819/3650315688","cluster_addr":"172.21.15.70:6821/3650315688","heartbeat_back_addr":"172.21.15.70:6825/3650315688","heartbeat_front_addr":"172.21.15.70:6823/3650315688","state":["exists","up"]},{"osd":7,"uuid":"40d59744-4860-4a92-aa21-3f33e575e5b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6817","nonce":2034132009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6819","nonce":2034132009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6823","nonce":2034132009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6821","nonce":2034132009}]},"public_addr":"172.21.15.116:6817/2034132009","cluster_addr":"172.21.15.116:6819/2034132009","heartbeat_back_addr":"172.21.15.116:6823/2034132009","heartbeat_front_addr":"172.21.15.116:6821/2034132009","state":["exists","up"]},{"osd":8,"uuid":"65dc02e7-0dcd-4fa7-955a-4d5c00fbe4cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6817","nonce":3381625184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6819","nonce":3381625184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6823","nonce":3381625184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6821","nonce":3381625184}]},"public_addr":"172.21.15.160:6817/3381625184","cluster_addr":"172.21.15.160:6819/3381625184","heartbeat_back_addr":"172.21.15.160:6823/3381625184","heartbeat_front_addr":"172.21.15.160:6821/3381625184","state":["exists","up"]},{"osd":9,"uuid":"d8438a9c-012f-4082-be3f-9653cdfaac78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6827","nonce":3555256209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6829","nonce":3555256209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6833","nonce":3555256209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6831","nonce":3555256209}]},"public_addr":"172.21.15.70:6827/3555256209","cluster_addr":"172.21.15.70:6829/3555256209","heartbeat_back_addr":"172.21.15.70:6833/3555256209","heartbeat_front_addr":"172.21.15.70:6831/3555256209","state":["exists","up"]},{"osd":10,"uuid":"871619b0-181e-4020-9511-2cec296bfe70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6825","nonce":541280433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6827","nonce":541280433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6831","nonce":541280433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6829","nonce":541280433}]},"public_addr":"172.21.15.116:6825/541280433","cluster_addr":"172.21.15.116:6827/541280433","heartbeat_back_addr":"172.21.15.116:6831/541280433","heartbeat_front_addr":"172.21.15.116:6829/541280433","state":["exists","up"]},{"osd":11,"uuid":"302da945-7929-4b0c-a20b-099175752c41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6825","nonce":2632369083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6827","nonce":2632369083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6831","nonce":2632369083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6829","nonce":2632369083}]},"public_addr":"172.21.15.160:6825/2632369083","cluster_addr":"172.21.15.160:6827/2632369083","heartbeat_back_addr":"172.21.15.160:6831/2632369083","heartbeat_front_addr":"172.21.15.160:6829/2632369083","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:41:34.446744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:41:59.336955+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:42:23.958219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:42:49.396007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:43:15.325344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:43:41.923141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:07.873970+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:33.897951+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:58.397680+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:24.568406+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:49.504565+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:14.698577+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.e","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6800/605055695":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/897886925":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/1968357524":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/693721445":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/2810307308":"2024-09-22T05:39:12.492271+0000","172.21.15.70:6801/605055695":"2024-09-22T05:39:37.296630+0000","172.21.15.70:6801/1668927582":"2024-09-22T05:39:12.492271+0000","172.21.15.70:6800/1668927582":"2024-09-22T05:39:12.492271+0000","172.21.15.70:0/1979536420":"2024-09-22T05:39:12.492271+0000","172.21.15.70:0/2674019604":"2024-09-22T05:39:12.492271+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:49:22.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.426+0000 7f1d367b4640 1 -- 172.21.15.70:0/655288365 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1d180b6510 msgr2=0x7f1d180b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:22.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.426+0000 7f1d367b4640 1 --2- 172.21.15.70:0/655288365 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1d180b6510 0x7f1d180b8a20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1d20005d90 tx=0x7f1d20005e50 comp rx=0 tx=0).stop 2024-09-21T05:49:22.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.426+0000 7f1d367b4640 1 -- 172.21.15.70:0/655288365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d30109df0 msgr2=0x7f1d3019fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:22.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.426+0000 7f1d367b4640 1 --2- 172.21.15.70:0/655288365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d30109df0 0x7f1d3019fd10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800eaa0 tx=0x7f1d2800eea0 comp rx=0 tx=0).stop 2024-09-21T05:49:22.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.426+0000 7f1d367b4640 1 -- 172.21.15.70:0/655288365 shutdown_connections 2024-09-21T05:49:22.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.426+0000 7f1d367b4640 1 --2- 172.21.15.70:0/655288365 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1d180b6510 0x7f1d180b8a20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:22.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.426+0000 7f1d367b4640 1 --2- 172.21.15.70:0/655288365 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d301094a0 0x7f1d3019aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:22.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.426+0000 7f1d367b4640 1 --2- 172.21.15.70:0/655288365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d30109df0 0x7f1d3019fd10 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:22.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.426+0000 7f1d367b4640 1 --2- 172.21.15.70:0/655288365 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d30103b60 0x7f1d3019a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:22.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.426+0000 7f1d367b4640 1 -- 172.21.15.70:0/655288365 >> 172.21.15.70:0/655288365 conn(0x7f1d3007b850 msgr2=0x7f1d30107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:22.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.426+0000 7f1d367b4640 1 -- 172.21.15.70:0/655288365 shutdown_connections 2024-09-21T05:49:22.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:22.426+0000 7f1d367b4640 1 -- 172.21.15.70:0/655288365 wait complete. 2024-09-21T05:49:23.111 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:22 smithi070 ceph-mon[30981]: pgmap v367: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-21T05:49:23.111 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:22 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/655288365' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:49:23.140 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T05:47:06.246985+0000', 'modified': '2024-09-21T05:47:50.538486+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24641, 'mds_1': 24628, 'mds_2': 24611, 'mds_3': 24610, 'mds_4': 24598}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14787': {'gid': 14787, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.70:6839/1914209867', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6838', 'nonce': 1914209867}, {'type': 'v1', 'addr': '172.21.15.70:6839', 'nonce': 1914209867}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14793': {'gid': 14793, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.70:6841/3392175775', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6840', 'nonce': 3392175775}, {'type': 'v1', 'addr': '172.21.15.70:6841', 'nonce': 3392175775}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24568': {'gid': 24568, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.160:6833/3543945704', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6832', 'nonce': 3543945704}, {'type': 'v1', 'addr': '172.21.15.160:6833', 'nonce': 3543945704}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24575': {'gid': 24575, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.116:6833/283778129', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6832', 'nonce': 283778129}, {'type': 'v1', 'addr': '172.21.15.116:6833', 'nonce': 283778129}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24590': {'gid': 24590, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.116:6835/3787256790', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6834', 'nonce': 3787256790}, {'type': 'v1', 'addr': '172.21.15.116:6835', 'nonce': 3787256790}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24598': {'gid': 24598, 'name': 'f', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.160:6835/2001692372', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6834', 'nonce': 2001692372}, {'type': 'v1', 'addr': '172.21.15.160:6835', 'nonce': 2001692372}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24610': {'gid': 24610, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.160:6837/2558120045', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6836', 'nonce': 2558120045}, {'type': 'v1', 'addr': '172.21.15.160:6837', 'nonce': 2558120045}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24611': {'gid': 24611, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.116:6837/444312934', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6836', 'nonce': 444312934}, {'type': 'v1', 'addr': '172.21.15.116:6837', 'nonce': 444312934}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24628': {'gid': 24628, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.160:6839/1339744282', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6838', 'nonce': 1339744282}, {'type': 'v1', 'addr': '172.21.15.160:6839', 'nonce': 1339744282}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24641': {'gid': 24641, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.116:6839/3952175670', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6838', 'nonce': 3952175670}, {'type': 'v1', 'addr': '172.21.15.116:6839', 'nonce': 3952175670}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24641, 'qdb_cluster': [24641, 24628, 24610, 24611, 24598]} 2024-09-21T05:49:23.140 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-21T05:49:23.140 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph tell mds.f status 2024-09-21T05:49:23.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:22 smithi160 ceph-mon[33979]: pgmap v367: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-21T05:49:23.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:22 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/655288365' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:49:23.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:22 smithi116 ceph-mon[34332]: pgmap v367: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-21T05:49:23.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:22 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/655288365' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:49:23.386 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:23.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.903+0000 7fa3c0cf6640 1 -- 172.21.15.70:0/2699199964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3bc102ae0 msgr2=0x7fa3bc102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:23.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.903+0000 7fa3c0cf6640 1 --2- 172.21.15.70:0/2699199964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3bc102ae0 0x7fa3bc102ef0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac009900 tx=0x7fa3ac02a3f0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.903+0000 7fa3c0cf6640 1 -- 172.21.15.70:0/2699199964 shutdown_connections 2024-09-21T05:49:23.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.903+0000 7fa3c0cf6640 1 --2- 172.21.15.70:0/2699199964 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3bc108d70 0x7fa3bc10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.903+0000 7fa3c0cf6640 1 --2- 172.21.15.70:0/2699199964 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3bc108420 0x7fa3bc108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.903+0000 7fa3c0cf6640 1 --2- 172.21.15.70:0/2699199964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3bc102ae0 0x7fa3bc102ef0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.903+0000 7fa3c0cf6640 1 -- 172.21.15.70:0/2699199964 >> 172.21.15.70:0/2699199964 conn(0x7fa3bc079770 msgr2=0x7fa3bc079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:23.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.903+0000 7fa3c0cf6640 1 -- 172.21.15.70:0/2699199964 shutdown_connections 2024-09-21T05:49:23.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.903+0000 7fa3c0cf6640 1 -- 172.21.15.70:0/2699199964 wait complete. 2024-09-21T05:49:23.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.904+0000 7fa3c0cf6640 1 Processor -- start 2024-09-21T05:49:23.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.904+0000 7fa3c0cf6640 1 -- start start 2024-09-21T05:49:23.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.905+0000 7fa3c0cf6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3bc102ae0 0x7fa3bc199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:23.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.905+0000 7fa3c0cf6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3bc108420 0x7fa3bc199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:23.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.905+0000 7fa3c0cf6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3bc108d70 0x7fa3bc199b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:23.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.905+0000 7fa3c0cf6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa3bc112a00 con 0x7fa3bc102ae0 2024-09-21T05:49:23.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.905+0000 7fa3c0cf6640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa3bc112880 con 0x7fa3bc108d70 2024-09-21T05:49:23.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.905+0000 7fa3c0cf6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa3bc112b80 con 0x7fa3bc108420 2024-09-21T05:49:23.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.905+0000 7fa3ba59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3bc102ae0 0x7fa3bc199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:23.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.905+0000 7fa3ba59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3bc102ae0 0x7fa3bc199100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56128/0 (socket says 172.21.15.70:56128) 2024-09-21T05:49:23.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.905+0000 7fa3ba59c640 1 -- 172.21.15.70:0/2577465974 learned_addr learned my addr 172.21.15.70:0/2577465974 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:23.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.905+0000 7fa3bad9d640 1 --2- 172.21.15.70:0/2577465974 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3bc108d70 0x7fa3bc199b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:23.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.905+0000 7fa3b3fff640 1 --2- 172.21.15.70:0/2577465974 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3bc108420 0x7fa3bc199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:23.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.905+0000 7fa3ba59c640 1 -- 172.21.15.70:0/2577465974 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3bc108420 msgr2=0x7fa3bc199640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:23.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.905+0000 7fa3ba59c640 1 --2- 172.21.15.70:0/2577465974 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3bc108420 0x7fa3bc199640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.905+0000 7fa3ba59c640 1 -- 172.21.15.70:0/2577465974 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3bc108d70 msgr2=0x7fa3bc199b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:23.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.905+0000 7fa3ba59c640 1 --2- 172.21.15.70:0/2577465974 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3bc108d70 0x7fa3bc199b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.905+0000 7fa3ba59c640 1 -- 172.21.15.70:0/2577465974 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3bc1a8780 con 0x7fa3bc102ae0 2024-09-21T05:49:23.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.905+0000 7fa3ba59c640 1 --2- 172.21.15.70:0/2577465974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3bc102ae0 0x7fa3bc199100 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac005940 tx=0x7fa3ac0042d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:23.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.905+0000 7fa3b37fe640 1 -- 172.21.15.70:0/2577465974 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac03f070 con 0x7fa3bc102ae0 2024-09-21T05:49:23.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.905+0000 7fa3c0cf6640 1 -- 172.21.15.70:0/2577465974 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3bc1a89b0 con 0x7fa3bc102ae0 2024-09-21T05:49:23.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.905+0000 7fa3b37fe640 1 -- 172.21.15.70:0/2577465974 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fa3ac003aa0 con 0x7fa3bc102ae0 2024-09-21T05:49:23.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.905+0000 7fa3b37fe640 1 -- 172.21.15.70:0/2577465974 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac035030 con 0x7fa3bc102ae0 2024-09-21T05:49:23.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.905+0000 7fa3c0cf6640 1 -- 172.21.15.70:0/2577465974 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3bc1a8e90 con 0x7fa3bc102ae0 2024-09-21T05:49:23.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.908+0000 7fa3c726a740 1 Processor -- start 2024-09-21T05:49:23.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.908+0000 7fa3b37fe640 1 -- 172.21.15.70:0/2577465974 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fa3ac042070 con 0x7fa3bc102ae0 2024-09-21T05:49:23.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.908+0000 7fa3c726a740 1 -- start start 2024-09-21T05:49:23.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.909+0000 7fa3c726a740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5640a0aacf60 0x5640a0e52f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:23.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.909+0000 7fa3c726a740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5640a0a840a0 0x5640a0e53440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:23.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.909+0000 7fa3c726a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5640a0a8c280 0x5640a0e53980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:23.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.909+0000 7fa3c726a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5640a0dcac10 con 0x5640a0a8c280 2024-09-21T05:49:23.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.909+0000 7fa3c726a740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5640a0dba040 con 0x5640a0a840a0 2024-09-21T05:49:23.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.909+0000 7fa3c726a740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5640a0dbde50 con 0x5640a0aacf60 2024-09-21T05:49:23.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.909+0000 7fa3b3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5640a0a8c280 0x5640a0e53980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:23.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.909+0000 7fa3b3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5640a0a8c280 0x5640a0e53980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56138/0 (socket says 172.21.15.70:56138) 2024-09-21T05:49:23.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.909+0000 7fa3b3fff640 1 -- 172.21.15.70:0/1931947341 learned_addr learned my addr 172.21.15.70:0/1931947341 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:23.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.909+0000 7fa3ba59c640 1 --2- 172.21.15.70:0/1931947341 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5640a0a840a0 0x5640a0e53440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:23.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.909+0000 7fa3bad9d640 1 --2- 172.21.15.70:0/1931947341 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5640a0aacf60 0x5640a0e52f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:23.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.909+0000 7fa3b3fff640 1 -- 172.21.15.70:0/1931947341 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5640a0aacf60 msgr2=0x5640a0e52f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:23.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.909+0000 7fa3b3fff640 1 --2- 172.21.15.70:0/1931947341 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5640a0aacf60 0x5640a0e52f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.909+0000 7fa3b3fff640 1 -- 172.21.15.70:0/1931947341 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5640a0a840a0 msgr2=0x5640a0e53440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:23.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.909+0000 7fa3b3fff640 1 --2- 172.21.15.70:0/1931947341 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5640a0a840a0 0x5640a0e53440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.909+0000 7fa3b3fff640 1 -- 172.21.15.70:0/1931947341 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640a0b18540 con 0x5640a0a8c280 2024-09-21T05:49:23.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.909+0000 7fa3bad9d640 1 --2- 172.21.15.70:0/1931947341 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5640a0aacf60 0x5640a0e52f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:49:23.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.909+0000 7fa3b3fff640 1 --2- 172.21.15.70:0/1931947341 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5640a0a8c280 0x5640a0e53980 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400cbd0 tx=0x7fa3a400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a7f3e6ca5bbea78 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:23.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.909+0000 7fa3b37fe640 1 --2- 172.21.15.70:0/2577465974 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa3a80b6510 0x7fa3a80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:23.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.909+0000 7fa3b0ff9640 1 -- 172.21.15.70:0/1931947341 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4005220 con 0x5640a0a8c280 2024-09-21T05:49:23.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.910+0000 7fa3bad9d640 1 --2- 172.21.15.70:0/2577465974 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa3a80b6510 0x7fa3a80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:23.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.910+0000 7fa3b0ff9640 1 -- 172.21.15.70:0/1931947341 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fa3a4004c50 con 0x5640a0a8c280 2024-09-21T05:49:23.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.910+0000 7fa3b0ff9640 1 -- 172.21.15.70:0/1931947341 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4010690 con 0x5640a0a8c280 2024-09-21T05:49:23.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.910+0000 7fa3b37fe640 1 -- 172.21.15.70:0/2577465974 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fa3ac108070 con 0x7fa3bc102ae0 2024-09-21T05:49:23.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.910+0000 7fa3c726a740 1 -- 172.21.15.70:0/1931947341 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5640a0a8c280 msgr2=0x5640a0e53980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:23.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.910+0000 7fa3bad9d640 1 --2- 172.21.15.70:0/2577465974 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa3a80b6510 0x7fa3a80b8a20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4007ec0 tx=0x7fa3b4007520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:23.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.910+0000 7fa3c726a740 1 --2- 172.21.15.70:0/1931947341 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5640a0a8c280 0x5640a0e53980 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400cbd0 tx=0x7fa3a400e720 comp rx=0 tx=0).stop 2024-09-21T05:49:23.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.911+0000 7fa3c726a740 1 -- 172.21.15.70:0/1931947341 shutdown_connections 2024-09-21T05:49:23.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.911+0000 7fa3c726a740 1 --2- 172.21.15.70:0/1931947341 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5640a0a8c280 0x5640a0e53980 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.911+0000 7fa3c726a740 1 --2- 172.21.15.70:0/1931947341 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5640a0a840a0 0x5640a0e53440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.911+0000 7fa3c726a740 1 --2- 172.21.15.70:0/1931947341 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5640a0aacf60 0x5640a0e52f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.911+0000 7fa3c726a740 1 -- 172.21.15.70:0/1931947341 >> 172.21.15.70:0/1931947341 conn(0x5640a0aa1350 msgr2=0x5640a0e50df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:23.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.911+0000 7fa3c726a740 1 -- 172.21.15.70:0/1931947341 shutdown_connections 2024-09-21T05:49:23.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.911+0000 7fa3c726a740 1 -- 172.21.15.70:0/1931947341 wait complete. 2024-09-21T05:49:23.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.911+0000 7fa3c726a740 1 -- start start 2024-09-21T05:49:23.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.911+0000 7fa3c726a740 1 Processor -- start 2024-09-21T05:49:23.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.911+0000 7fa3c726a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5640a0a840a0 0x5640a0e5e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:23.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.912+0000 7fa3c726a740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5640a0a8c280 0x5640a0e5ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:23.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.912+0000 7fa3c726a740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5640a0aacf60 0x5640a0e6aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:23.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.912+0000 7fa3c726a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5640a0c1b5f0 con 0x5640a0a840a0 2024-09-21T05:49:23.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.912+0000 7fa3c726a740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5640a0d55010 con 0x5640a0aacf60 2024-09-21T05:49:23.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.912+0000 7fa3c726a740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5640a0e616e0 con 0x5640a0a8c280 2024-09-21T05:49:23.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.912+0000 7fa3c726a740 10 client.0 _ll_register_callbacks cb 0x5640a0db4340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:49:23.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.912+0000 7fa3ba59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5640a0a840a0 0x5640a0e5e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:23.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.912+0000 7fa3ba59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5640a0a840a0 0x5640a0e5e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56150/0 (socket says 172.21.15.70:56150) 2024-09-21T05:49:23.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.912+0000 7fa3ba59c640 1 -- 172.21.15.70:0/1782231979 learned_addr learned my addr 172.21.15.70:0/1782231979 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:23.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.912+0000 7fa3b3fff640 1 --2- 172.21.15.70:0/1782231979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5640a0a8c280 0x5640a0e5ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:23.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.912+0000 7fa3ba59c640 1 -- 172.21.15.70:0/1782231979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5640a0a8c280 msgr2=0x5640a0e5ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:23.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.912+0000 7fa3ba59c640 1 --2- 172.21.15.70:0/1782231979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5640a0a8c280 0x5640a0e5ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.912+0000 7fa3bad9d640 1 --2- 172.21.15.70:0/1782231979 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5640a0aacf60 0x5640a0e6aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:23.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.912+0000 7fa3ba59c640 1 -- 172.21.15.70:0/1782231979 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5640a0aacf60 msgr2=0x5640a0e6aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:23.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.912+0000 7fa3ba59c640 1 --2- 172.21.15.70:0/1782231979 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5640a0aacf60 0x5640a0e6aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.912+0000 7fa3ba59c640 1 -- 172.21.15.70:0/1782231979 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640a0d82a00 con 0x5640a0a840a0 2024-09-21T05:49:23.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.912+0000 7fa3bad9d640 1 --2- 172.21.15.70:0/1782231979 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5640a0aacf60 0x5640a0e6aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:49:23.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.912+0000 7fa3ba59c640 1 --2- 172.21.15.70:0/1782231979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5640a0a840a0 0x5640a0e5e9f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac0cb080 tx=0x7fa3ac10b740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7faf6a59ac5ccd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:23.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.912+0000 7fa3a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:49:23.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.912+0000 7fa3a1ffb640 1 -- 172.21.15.70:0/1782231979 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac049070 con 0x5640a0a840a0 2024-09-21T05:49:23.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.912+0000 7fa3a1ffb640 1 -- 172.21.15.70:0/1782231979 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fa3ac0b50b0 con 0x5640a0a840a0 2024-09-21T05:49:23.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.912+0000 7fa3c726a740 1 -- 172.21.15.70:0/1782231979 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3a4004c50 con 0x5640a0a840a0 2024-09-21T05:49:23.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.912+0000 7fa3a1ffb640 1 -- 172.21.15.70:0/1782231979 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa3ac0ca460 con 0x5640a0a840a0 2024-09-21T05:49:23.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.912+0000 7fa3c726a740 10 client.15399 fetch_fsmap learned FSMap version 27 2024-09-21T05:49:23.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.913+0000 7fa3c726a740 1 -- 172.21.15.70:0/1782231979 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5640a0e6d5c0 con 0x5640a0a840a0 2024-09-21T05:49:23.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.913+0000 7fa3a1ffb640 1 -- 172.21.15.70:0/1782231979 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fa3a4004c50 con 0x5640a0a840a0 2024-09-21T05:49:23.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.913+0000 7fa3a1ffb640 1 -- 172.21.15.70:0/1782231979 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fa3ac0d73a0 con 0x5640a0a840a0 2024-09-21T05:49:23.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.913+0000 7fa3c726a740 10 client.15399 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T05:49:23.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.913+0000 7fa3c726a740 10 client.15399 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T05:49:23.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.913+0000 7fa3c726a740 20 client.15399 populate_metadata read hostname 'smithi070' 2024-09-21T05:49:23.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.913+0000 7fa3c726a740 1 --2- 172.21.15.70:0/1782231979 >> [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] conn(0x5640a0a6b8e0 0x5640a0e71050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:23.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.913+0000 7fa3c726a740 4 client.15399 mds_command: new command op to 24598 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:49:23.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.913+0000 7fa3c726a740 1 -- 172.21.15.70:0/1782231979 --> [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640a0dccb60 con 0x5640a0a6b8e0 2024-09-21T05:49:23.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.913+0000 7fa3b3fff640 1 --2- 172.21.15.70:0/1782231979 >> [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] conn(0x5640a0a6b8e0 0x5640a0e71050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:23.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.914+0000 7fa3b3fff640 1 --2- 172.21.15.70:0/1782231979 >> [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] conn(0x5640a0a6b8e0 0x5640a0e71050 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8eb2c8f03c83434a server_cookie=771d21e6d6c6c433 in_seq=0 out_seq=0 2024-09-21T05:49:23.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.914+0000 7fa3a1ffb640 10 client.15399 ms_handle_connect on v2:172.21.15.160:6834/2001692372 2024-09-21T05:49:23.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.915+0000 7fa3a1ffb640 1 -- 172.21.15.70:0/1782231979 <== mds.4 v2:172.21.15.160:6834/2001692372 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5640a0dccb60 con 0x5640a0a6b8e0 2024-09-21T05:49:23.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.915+0000 7fa3a1ffb640 10 client.15399 handle_command_reply: tid=0 2024-09-21T05:49:23.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.915+0000 7fa3c726a740 1 client.15399 shutdown 2024-09-21T05:49:23.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.915+0000 7fa3c726a740 1 -- 172.21.15.70:0/1782231979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5640a0a840a0 msgr2=0x5640a0e5e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:23.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.915+0000 7fa3c726a740 1 --2- 172.21.15.70:0/1782231979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5640a0a840a0 0x5640a0e5e9f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac0cb080 tx=0x7fa3ac10b740 comp rx=0 tx=0).stop 2024-09-21T05:49:23.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.915+0000 7fa3c726a740 1 -- 172.21.15.70:0/1782231979 shutdown_connections 2024-09-21T05:49:23.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.915+0000 7fa3c726a740 1 --2- 172.21.15.70:0/1782231979 >> [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] conn(0x5640a0a6b8e0 0x5640a0e71050 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.915+0000 7fa3c726a740 1 --2- 172.21.15.70:0/1782231979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5640a0a8c280 0x5640a0e5ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.915+0000 7fa3c726a740 1 --2- 172.21.15.70:0/1782231979 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5640a0aacf60 0x5640a0e6aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.915+0000 7fa3c726a740 1 --2- 172.21.15.70:0/1782231979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5640a0a840a0 0x5640a0e5e9f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.915+0000 7fa3a1ffb640 0 client.15399 ms_handle_reset on v2:172.21.15.160:6834/2001692372 2024-09-21T05:49:23.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.915+0000 7fa3c726a740 1 -- 172.21.15.70:0/1782231979 >> 172.21.15.70:0/1782231979 conn(0x5640a0aa1350 msgr2=0x5640a0e56090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:23.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.915+0000 7fa3c726a740 1 -- 172.21.15.70:0/1782231979 shutdown_connections 2024-09-21T05:49:23.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.915+0000 7fa3c726a740 1 -- 172.21.15.70:0/1782231979 wait complete. 2024-09-21T05:49:23.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.915+0000 7fa3c726a740 20 client.15399 trim_cache size 0 max 16384 2024-09-21T05:49:23.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.933+0000 7fa3c726a740 1 Processor -- start 2024-09-21T05:49:23.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.933+0000 7fa3c726a740 1 -- start start 2024-09-21T05:49:23.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.933+0000 7fa3c726a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5640a0a6b8e0 0x5640a0e5e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:23.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.933+0000 7fa3c726a740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5640a0a840a0 0x5640a0e5ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:23.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.933+0000 7fa3c726a740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5640a0a8c280 0x5640a0e599a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:23.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.933+0000 7fa3c726a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5640a0e6f390 con 0x5640a0a6b8e0 2024-09-21T05:49:23.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.933+0000 7fa3c726a740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5640a0e6fa60 con 0x5640a0a8c280 2024-09-21T05:49:23.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.933+0000 7fa3c726a740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5640a0e70130 con 0x5640a0a840a0 2024-09-21T05:49:23.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.933+0000 7fa3ba59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5640a0a6b8e0 0x5640a0e5e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:23.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.933+0000 7fa3ba59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5640a0a6b8e0 0x5640a0e5e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56152/0 (socket says 172.21.15.70:56152) 2024-09-21T05:49:23.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.933+0000 7fa3ba59c640 1 -- 172.21.15.70:0/2544670979 learned_addr learned my addr 172.21.15.70:0/2544670979 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:23.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.934+0000 7fa3b3fff640 1 --2- 172.21.15.70:0/2544670979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5640a0a840a0 0x5640a0e5ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:23.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.934+0000 7fa3ba59c640 1 -- 172.21.15.70:0/2544670979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5640a0a840a0 msgr2=0x5640a0e5ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:23.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.934+0000 7fa3ba59c640 1 --2- 172.21.15.70:0/2544670979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5640a0a840a0 0x5640a0e5ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.934+0000 7fa3ba59c640 1 -- 172.21.15.70:0/2544670979 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5640a0a8c280 msgr2=0x5640a0e599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:23.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.934+0000 7fa3ba59c640 1 --2- 172.21.15.70:0/2544670979 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5640a0a8c280 0x5640a0e599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.934+0000 7fa3ba59c640 1 -- 172.21.15.70:0/2544670979 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640a0e551f0 con 0x5640a0a6b8e0 2024-09-21T05:49:23.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.934+0000 7fa3ba59c640 1 --2- 172.21.15.70:0/2544670979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5640a0a6b8e0 0x5640a0e5e9d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac0cdda0 tx=0x7fa3ac108400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5efc18bc75890404 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:23.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.934+0000 7fa3a3fff640 1 -- 172.21.15.70:0/2544670979 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac049070 con 0x5640a0a6b8e0 2024-09-21T05:49:23.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.934+0000 7fa3a3fff640 1 -- 172.21.15.70:0/2544670979 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fa3ac0ce510 con 0x5640a0a6b8e0 2024-09-21T05:49:23.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.934+0000 7fa3a3fff640 1 -- 172.21.15.70:0/2544670979 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac0cd580 con 0x5640a0a6b8e0 2024-09-21T05:49:23.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.935+0000 7fa3c726a740 1 -- 172.21.15.70:0/2544670979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5640a0a6b8e0 msgr2=0x5640a0e5e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:23.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.935+0000 7fa3c726a740 1 --2- 172.21.15.70:0/2544670979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5640a0a6b8e0 0x5640a0e5e9d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac0cdda0 tx=0x7fa3ac108400 comp rx=0 tx=0).stop 2024-09-21T05:49:23.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.935+0000 7fa3c726a740 1 -- 172.21.15.70:0/2544670979 shutdown_connections 2024-09-21T05:49:23.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.935+0000 7fa3c726a740 1 --2- 172.21.15.70:0/2544670979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5640a0a840a0 0x5640a0e5ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.935+0000 7fa3c726a740 1 --2- 172.21.15.70:0/2544670979 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5640a0a8c280 0x5640a0e599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.935+0000 7fa3c726a740 1 --2- 172.21.15.70:0/2544670979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5640a0a6b8e0 0x5640a0e5e9d0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.935+0000 7fa3c726a740 1 -- 172.21.15.70:0/2544670979 >> 172.21.15.70:0/2544670979 conn(0x5640a0aa1350 msgr2=0x5640a0e4bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:23.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.935+0000 7fa3c726a740 1 -- 172.21.15.70:0/2544670979 shutdown_connections 2024-09-21T05:49:23.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.935+0000 7fa3c726a740 1 -- 172.21.15.70:0/2544670979 wait complete. 2024-09-21T05:49:23.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.935+0000 7fa3c726a740 1 -- start start 2024-09-21T05:49:23.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.935+0000 7fa3c726a740 1 Processor -- start 2024-09-21T05:49:23.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.936+0000 7fa3c726a740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5640a0a6b8e0 0x5640a0e768a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:23.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.936+0000 7fa3c726a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5640a0a840a0 0x5640a0e76de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:23.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.936+0000 7fa3c726a740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5640a0a8c280 0x5640a0e77320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:23.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.936+0000 7fa3c726a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5640a0e70ed0 con 0x5640a0a840a0 2024-09-21T05:49:23.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.936+0000 7fa3c726a740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5640a0e70800 con 0x5640a0a6b8e0 2024-09-21T05:49:23.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.936+0000 7fa3c726a740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5640a0e715a0 con 0x5640a0a8c280 2024-09-21T05:49:23.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.936+0000 7fa3c726a740 10 client.0 _ll_register_callbacks cb 0x7fa3ac10b840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:49:23.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.936+0000 7fa3b3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5640a0a840a0 0x5640a0e76de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:23.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.936+0000 7fa3b3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5640a0a840a0 0x5640a0e76de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56156/0 (socket says 172.21.15.70:56156) 2024-09-21T05:49:23.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.936+0000 7fa3b3fff640 1 -- 172.21.15.70:0/3556205196 learned_addr learned my addr 172.21.15.70:0/3556205196 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:23.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.936+0000 7fa3bad9d640 1 --2- 172.21.15.70:0/3556205196 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5640a0a8c280 0x5640a0e77320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:23.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.936+0000 7fa3ba59c640 1 --2- 172.21.15.70:0/3556205196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5640a0a6b8e0 0x5640a0e768a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:23.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.936+0000 7fa3b3fff640 1 -- 172.21.15.70:0/3556205196 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5640a0a8c280 msgr2=0x5640a0e77320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:23.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.936+0000 7fa3b3fff640 1 --2- 172.21.15.70:0/3556205196 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5640a0a8c280 0x5640a0e77320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.936+0000 7fa3b3fff640 1 -- 172.21.15.70:0/3556205196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5640a0a6b8e0 msgr2=0x5640a0e768a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:23.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.936+0000 7fa3b3fff640 1 --2- 172.21.15.70:0/3556205196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5640a0a6b8e0 0x5640a0e768a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.936+0000 7fa3b3fff640 1 -- 172.21.15.70:0/3556205196 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640a0e75850 con 0x5640a0a840a0 2024-09-21T05:49:23.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.936+0000 7fa3ba59c640 1 --2- 172.21.15.70:0/3556205196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5640a0a6b8e0 0x5640a0e768a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:23.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.936+0000 7fa3b3fff640 1 --2- 172.21.15.70:0/3556205196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5640a0a840a0 0x5640a0e76de0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4000c00 tx=0x7fa3a400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c94feace17cd03 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:23.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.936+0000 7fa3a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:49:23.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.937+0000 7fa3a1ffb640 1 -- 172.21.15.70:0/3556205196 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4027680 con 0x5640a0a840a0 2024-09-21T05:49:23.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.937+0000 7fa3a1ffb640 1 -- 172.21.15.70:0/3556205196 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fa3a4027820 con 0x5640a0a840a0 2024-09-21T05:49:23.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.937+0000 7fa3c726a740 1 -- 172.21.15.70:0/3556205196 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3ac0ce510 con 0x5640a0a840a0 2024-09-21T05:49:23.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.937+0000 7fa3a1ffb640 1 -- 172.21.15.70:0/3556205196 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa3a4036050 con 0x5640a0a840a0 2024-09-21T05:49:23.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.937+0000 7fa3c726a740 10 client.15405 fetch_fsmap learned FSMap version 27 2024-09-21T05:49:23.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.937+0000 7fa3c726a740 1 -- 172.21.15.70:0/3556205196 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5640a0edc750 con 0x5640a0a840a0 2024-09-21T05:49:23.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.937+0000 7fa3a1ffb640 1 -- 172.21.15.70:0/3556205196 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fa3ac0ce510 con 0x5640a0a840a0 2024-09-21T05:49:23.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.937+0000 7fa3a1ffb640 1 -- 172.21.15.70:0/3556205196 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fa3a4010ae0 con 0x5640a0a840a0 2024-09-21T05:49:23.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.937+0000 7fa3c726a740 10 client.15405 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T05:49:23.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.937+0000 7fa3c726a740 10 client.15405 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T05:49:23.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.937+0000 7fa3c726a740 20 client.15405 populate_metadata read hostname 'smithi070' 2024-09-21T05:49:23.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.937+0000 7fa3c726a740 1 --2- 172.21.15.70:0/3556205196 >> [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] conn(0x5640a0aacf60 0x5640a0edfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:23.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.937+0000 7fa3c726a740 4 client.15405 mds_command: new command op to 24598 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T05:49:23.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.937+0000 7fa3c726a740 1 -- 172.21.15.70:0/3556205196 --> [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] -- command(tid 0: {"prefix": "status"}) -- 0x5640a0dc8610 con 0x5640a0aacf60 2024-09-21T05:49:23.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.938+0000 7fa3ba59c640 1 --2- 172.21.15.70:0/3556205196 >> [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] conn(0x5640a0aacf60 0x5640a0edfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:23.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.938+0000 7fa3a1ffb640 10 client.15405 ms_handle_connect on v2:172.21.15.160:6834/2001692372 2024-09-21T05:49:23.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.938+0000 7fa3ba59c640 1 --2- 172.21.15.70:0/3556205196 >> [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] conn(0x5640a0aacf60 0x5640a0edfc90 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=cc43d6b2c27cc91c server_cookie=133061024da0a78f in_seq=0 out_seq=0 2024-09-21T05:49:23.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.938+0000 7fa3a1ffb640 1 -- 172.21.15.70:0/3556205196 <== mds.4 v2:172.21.15.160:6834/2001692372 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5640a0dc8610 con 0x5640a0aacf60 2024-09-21T05:49:23.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.938+0000 7fa3a1ffb640 10 client.15405 handle_command_reply: tid=0 2024-09-21T05:49:23.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.938+0000 7fa3c726a740 1 client.15405 shutdown 2024-09-21T05:49:23.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.938+0000 7fa3c726a740 1 -- 172.21.15.70:0/3556205196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5640a0a840a0 msgr2=0x5640a0e76de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:23.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.938+0000 7fa3c726a740 1 --2- 172.21.15.70:0/3556205196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5640a0a840a0 0x5640a0e76de0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4000c00 tx=0x7fa3a400c850 comp rx=0 tx=0).stop 2024-09-21T05:49:23.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.939+0000 7fa3c726a740 1 -- 172.21.15.70:0/3556205196 shutdown_connections 2024-09-21T05:49:23.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.939+0000 7fa3c726a740 1 --2- 172.21.15.70:0/3556205196 >> [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] conn(0x5640a0aacf60 0x5640a0edfc90 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.939+0000 7fa3c726a740 1 --2- 172.21.15.70:0/3556205196 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5640a0a8c280 0x5640a0e77320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.939+0000 7fa3c726a740 1 --2- 172.21.15.70:0/3556205196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5640a0a840a0 0x5640a0e76de0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.939+0000 7fa3c726a740 1 --2- 172.21.15.70:0/3556205196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5640a0a6b8e0 0x5640a0e768a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.939+0000 7fa3a1ffb640 0 client.15405 ms_handle_reset on v2:172.21.15.160:6834/2001692372 2024-09-21T05:49:23.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.939+0000 7fa3c726a740 1 -- 172.21.15.70:0/3556205196 >> 172.21.15.70:0/3556205196 conn(0x5640a0aa1350 msgr2=0x5640a0e4bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:23.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.939+0000 7fa3c726a740 1 -- 172.21.15.70:0/3556205196 shutdown_connections 2024-09-21T05:49:23.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.939+0000 7fa3c726a740 1 -- 172.21.15.70:0/3556205196 wait complete. 2024-09-21T05:49:23.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.939+0000 7fa3c726a740 20 client.15405 trim_cache size 0 max 16384 2024-09-21T05:49:23.945 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:49:23.945 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "96c6636e-77db-11ef-baf5-efdc52797490", 2024-09-21T05:49:23.945 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 4, 2024-09-21T05:49:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24598, 2024-09-21T05:49:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-21T05:49:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-21T05:49:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-21T05:49:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 94.404719306999993, 2024-09-21T05:49:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2024-09-21T05:49:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 85, 2024-09-21T05:49:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 83, 2024-09-21T05:49:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 164.065848176 2024-09-21T05:49:23.946 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:49:23.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.939+0000 7fa3c0cf6640 1 -- 172.21.15.70:0/2577465974 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa3a80b6510 msgr2=0x7fa3a80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:23.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.939+0000 7fa3c0cf6640 1 --2- 172.21.15.70:0/2577465974 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa3a80b6510 0x7fa3a80b8a20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4007ec0 tx=0x7fa3b4007520 comp rx=0 tx=0).stop 2024-09-21T05:49:23.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.939+0000 7fa3c0cf6640 1 -- 172.21.15.70:0/2577465974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3bc102ae0 msgr2=0x7fa3bc199100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:23.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.939+0000 7fa3c0cf6640 1 --2- 172.21.15.70:0/2577465974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3bc102ae0 0x7fa3bc199100 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac005940 tx=0x7fa3ac0042d0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.939+0000 7fa3c0cf6640 1 -- 172.21.15.70:0/2577465974 shutdown_connections 2024-09-21T05:49:23.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.939+0000 7fa3c0cf6640 1 --2- 172.21.15.70:0/2577465974 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa3a80b6510 0x7fa3a80b8a20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.939+0000 7fa3c0cf6640 1 --2- 172.21.15.70:0/2577465974 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3bc108420 0x7fa3bc199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.940+0000 7fa3c0cf6640 1 --2- 172.21.15.70:0/2577465974 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3bc108d70 0x7fa3bc199b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.940+0000 7fa3c0cf6640 1 --2- 172.21.15.70:0/2577465974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3bc102ae0 0x7fa3bc199100 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:23.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.940+0000 7fa3c0cf6640 1 -- 172.21.15.70:0/2577465974 >> 172.21.15.70:0/2577465974 conn(0x7fa3bc079770 msgr2=0x7fa3bc1064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:23.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.940+0000 7fa3c0cf6640 1 -- 172.21.15.70:0/2577465974 shutdown_connections 2024-09-21T05:49:23.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:23.940+0000 7fa3c0cf6640 1 -- 172.21.15.70:0/2577465974 wait complete. 2024-09-21T05:49:24.707 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T05:49:24.952 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:25.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:24 smithi160 ceph-mon[33979]: pgmap v368: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-21T05:49:25.207 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:24 smithi070 ceph-mon[30981]: pgmap v368: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-21T05:49:25.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:24 smithi116 ceph-mon[34332]: pgmap v368: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-21T05:49:25.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.423+0000 7fe8b9f3d640 1 -- 172.21.15.70:0/1376666779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8b4102230 msgr2=0x7fe8b4102640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:25.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.423+0000 7fe8b9f3d640 1 --2- 172.21.15.70:0/1376666779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8b4102230 0x7fe8b4102640 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4009900 tx=0x7fe8a402a410 comp rx=0 tx=0).stop 2024-09-21T05:49:25.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.423+0000 7fe8b9f3d640 1 -- 172.21.15.70:0/1376666779 shutdown_connections 2024-09-21T05:49:25.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.423+0000 7fe8b9f3d640 1 --2- 172.21.15.70:0/1376666779 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8b4107b70 0x7fe8b4107f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.423+0000 7fe8b9f3d640 1 --2- 172.21.15.70:0/1376666779 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8b41084c0 0x7fe8b410ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.423+0000 7fe8b9f3d640 1 --2- 172.21.15.70:0/1376666779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8b4102230 0x7fe8b4102640 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.423+0000 7fe8b9f3d640 1 -- 172.21.15.70:0/1376666779 >> 172.21.15.70:0/1376666779 conn(0x7fe8b4079e10 msgr2=0x7fe8b407a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:25.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.423+0000 7fe8b9f3d640 1 -- 172.21.15.70:0/1376666779 shutdown_connections 2024-09-21T05:49:25.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.423+0000 7fe8b9f3d640 1 -- 172.21.15.70:0/1376666779 wait complete. 2024-09-21T05:49:25.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.424+0000 7fe8b9f3d640 1 Processor -- start 2024-09-21T05:49:25.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.424+0000 7fe8b9f3d640 1 -- start start 2024-09-21T05:49:25.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.424+0000 7fe8b9f3d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8b4102230 0x7fe8b419a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:25.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.424+0000 7fe8b9f3d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8b4107b70 0x7fe8b419ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:25.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.424+0000 7fe8b9f3d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8b41084c0 0x7fe8b419fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:25.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.424+0000 7fe8b9f3d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b4112a50 con 0x7fe8b41084c0 2024-09-21T05:49:25.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.424+0000 7fe8b9f3d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b41128d0 con 0x7fe8b4107b70 2024-09-21T05:49:25.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.424+0000 7fe8b9f3d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b4112bd0 con 0x7fe8b4102230 2024-09-21T05:49:25.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.424+0000 7fe8b3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8b41084c0 0x7fe8b419fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:25.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.424+0000 7fe8b3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8b41084c0 0x7fe8b419fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56170/0 (socket says 172.21.15.70:56170) 2024-09-21T05:49:25.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.424+0000 7fe8b3fff640 1 -- 172.21.15.70:0/3939940228 learned_addr learned my addr 172.21.15.70:0/3939940228 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:25.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.424+0000 7fe8b37fe640 1 --2- 172.21.15.70:0/3939940228 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8b4102230 0x7fe8b419a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:25.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.424+0000 7fe8abfff640 1 --2- 172.21.15.70:0/3939940228 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8b4107b70 0x7fe8b419ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:25.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.424+0000 7fe8b3fff640 1 -- 172.21.15.70:0/3939940228 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8b4102230 msgr2=0x7fe8b419a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:25.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.424+0000 7fe8b3fff640 1 --2- 172.21.15.70:0/3939940228 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8b4102230 0x7fe8b419a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.424+0000 7fe8b3fff640 1 -- 172.21.15.70:0/3939940228 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8b4107b70 msgr2=0x7fe8b419ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:25.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.424+0000 7fe8b3fff640 1 --2- 172.21.15.70:0/3939940228 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8b4107b70 0x7fe8b419ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.424+0000 7fe8b3fff640 1 -- 172.21.15.70:0/3939940228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8b41a04e0 con 0x7fe8b41084c0 2024-09-21T05:49:25.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.425+0000 7fe8b3fff640 1 --2- 172.21.15.70:0/3939940228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8b41084c0 0x7fe8b419fdb0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac00b970 tx=0x7fe8ac00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:25.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.425+0000 7fe8b17fa640 1 -- 172.21.15.70:0/3939940228 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac019070 con 0x7fe8b41084c0 2024-09-21T05:49:25.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.425+0000 7fe8b17fa640 1 -- 172.21.15.70:0/3939940228 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fe8ac014440 con 0x7fe8b41084c0 2024-09-21T05:49:25.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.425+0000 7fe8b9f3d640 1 -- 172.21.15.70:0/3939940228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8b41a07d0 con 0x7fe8b41084c0 2024-09-21T05:49:25.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.425+0000 7fe8b17fa640 1 -- 172.21.15.70:0/3939940228 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac0075d0 con 0x7fe8b41084c0 2024-09-21T05:49:25.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.425+0000 7fe8b9f3d640 1 -- 172.21.15.70:0/3939940228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8b41a6f30 con 0x7fe8b41084c0 2024-09-21T05:49:25.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.428+0000 7fe8c04b1740 1 Processor -- start 2024-09-21T05:49:25.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.428+0000 7fe8b17fa640 1 -- 172.21.15.70:0/3939940228 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fe8ac01c070 con 0x7fe8b41084c0 2024-09-21T05:49:25.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.428+0000 7fe8c04b1740 1 -- start start 2024-09-21T05:49:25.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.429+0000 7fe8c04b1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564d6db77f60 0x564d6df1df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:25.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.429+0000 7fe8c04b1740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d6db4f0a0 0x564d6df1e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:25.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.429+0000 7fe8c04b1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d6db57280 0x564d6df1e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:25.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.429+0000 7fe8c04b1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564d6de95c10 con 0x564d6db57280 2024-09-21T05:49:25.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.429+0000 7fe8c04b1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x564d6de85040 con 0x564d6db77f60 2024-09-21T05:49:25.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.429+0000 7fe8c04b1740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x564d6de88e50 con 0x564d6db4f0a0 2024-09-21T05:49:25.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.429+0000 7fe8abfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d6db57280 0x564d6df1e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:25.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.429+0000 7fe8b37fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d6db4f0a0 0x564d6df1e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:25.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.429+0000 7fe8abfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d6db57280 0x564d6df1e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56184/0 (socket says 172.21.15.70:56184) 2024-09-21T05:49:25.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.429+0000 7fe8abfff640 1 -- 172.21.15.70:0/2053916266 learned_addr learned my addr 172.21.15.70:0/2053916266 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:25.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.429+0000 7fe8abfff640 1 --2- 172.21.15.70:0/2053916266 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564d6db77f60 0x564d6df1df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:25.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.429+0000 7fe8abfff640 1 -- 172.21.15.70:0/2053916266 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d6db4f0a0 msgr2=0x564d6df1e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:25.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.429+0000 7fe8abfff640 1 --2- 172.21.15.70:0/2053916266 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d6db4f0a0 0x564d6df1e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.429+0000 7fe8abfff640 1 -- 172.21.15.70:0/2053916266 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564d6db77f60 msgr2=0x564d6df1df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:25.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.429+0000 7fe8abfff640 1 --2- 172.21.15.70:0/2053916266 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564d6db77f60 0x564d6df1df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.429+0000 7fe8abfff640 1 -- 172.21.15.70:0/2053916266 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d6dbe3540 con 0x564d6db57280 2024-09-21T05:49:25.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.429+0000 7fe8b17fa640 1 --2- 172.21.15.70:0/3939940228 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe8a00b6510 0x7fe8a00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:25.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.429+0000 7fe8abfff640 1 --2- 172.21.15.70:0/2053916266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d6db57280 0x564d6df1e980 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe89c013800 tx=0x7fe89c00ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ff9a62f5e712f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:25.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.429+0000 7fe8b37fe640 1 --2- 172.21.15.70:0/3939940228 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe8a00b6510 0x7fe8a00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:25.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.430+0000 7fe8b17fa640 1 -- 172.21.15.70:0/3939940228 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fe8ac0e6ba0 con 0x7fe8b41084c0 2024-09-21T05:49:25.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.430+0000 7fe8a9ffb640 1 -- 172.21.15.70:0/2053916266 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89c00b860 con 0x564d6db57280 2024-09-21T05:49:25.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.430+0000 7fe8a9ffb640 1 -- 172.21.15.70:0/2053916266 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fe89c013e40 con 0x564d6db57280 2024-09-21T05:49:25.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.430+0000 7fe8a9ffb640 1 -- 172.21.15.70:0/2053916266 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89c01dcc0 con 0x564d6db57280 2024-09-21T05:49:25.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.431+0000 7fe8c04b1740 1 -- 172.21.15.70:0/2053916266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d6db57280 msgr2=0x564d6df1e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:25.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.431+0000 7fe8c04b1740 1 --2- 172.21.15.70:0/2053916266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d6db57280 0x564d6df1e980 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe89c013800 tx=0x7fe89c00ef90 comp rx=0 tx=0).stop 2024-09-21T05:49:25.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.431+0000 7fe8b37fe640 1 --2- 172.21.15.70:0/3939940228 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe8a00b6510 0x7fe8a00b8a20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4005d90 tx=0x7fe8a4005f30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:25.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.431+0000 7fe8c04b1740 1 -- 172.21.15.70:0/2053916266 shutdown_connections 2024-09-21T05:49:25.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.431+0000 7fe8c04b1740 1 --2- 172.21.15.70:0/2053916266 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d6db4f0a0 0x564d6df1e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.431+0000 7fe8c04b1740 1 --2- 172.21.15.70:0/2053916266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d6db57280 0x564d6df1e980 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.431+0000 7fe8c04b1740 1 --2- 172.21.15.70:0/2053916266 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564d6db77f60 0x564d6df1df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.431+0000 7fe8c04b1740 1 -- 172.21.15.70:0/2053916266 >> 172.21.15.70:0/2053916266 conn(0x564d6db6c350 msgr2=0x564d6df1bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:25.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.431+0000 7fe8c04b1740 1 -- 172.21.15.70:0/2053916266 shutdown_connections 2024-09-21T05:49:25.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.431+0000 7fe8c04b1740 1 -- 172.21.15.70:0/2053916266 wait complete. 2024-09-21T05:49:25.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.431+0000 7fe8c04b1740 1 -- start start 2024-09-21T05:49:25.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.431+0000 7fe8c04b1740 1 Processor -- start 2024-09-21T05:49:25.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.432+0000 7fe8c04b1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564d6db4f0a0 0x564d6df29760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:25.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.432+0000 7fe8c04b1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d6db57280 0x564d6df29d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:25.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.432+0000 7fe8c04b1740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d6db77f60 0x564d6df35a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:25.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.432+0000 7fe8c04b1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564d6dce65f0 con 0x564d6db57280 2024-09-21T05:49:25.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.432+0000 7fe8c04b1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x564d6de20010 con 0x564d6db4f0a0 2024-09-21T05:49:25.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.432+0000 7fe8c04b1740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x564d6df2c6e0 con 0x564d6db77f60 2024-09-21T05:49:25.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.432+0000 7fe8c04b1740 10 client.0 _ll_register_callbacks cb 0x564d6de7f340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:49:25.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.432+0000 7fe8abfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d6db57280 0x564d6df29d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:25.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.432+0000 7fe8abfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d6db57280 0x564d6df29d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56200/0 (socket says 172.21.15.70:56200) 2024-09-21T05:49:25.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.432+0000 7fe8abfff640 1 -- 172.21.15.70:0/1333353326 learned_addr learned my addr 172.21.15.70:0/1333353326 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:25.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.432+0000 7fe8b3fff640 1 --2- 172.21.15.70:0/1333353326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d6db77f60 0x564d6df35a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:25.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.432+0000 7fe8b37fe640 1 --2- 172.21.15.70:0/1333353326 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564d6db4f0a0 0x564d6df29760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:25.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.432+0000 7fe8abfff640 1 -- 172.21.15.70:0/1333353326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d6db77f60 msgr2=0x564d6df35a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:25.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.432+0000 7fe8abfff640 1 --2- 172.21.15.70:0/1333353326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d6db77f60 0x564d6df35a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.432+0000 7fe8abfff640 1 -- 172.21.15.70:0/1333353326 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564d6db4f0a0 msgr2=0x564d6df29760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:25.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.432+0000 7fe8abfff640 1 --2- 172.21.15.70:0/1333353326 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564d6db4f0a0 0x564d6df29760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.432+0000 7fe8abfff640 1 -- 172.21.15.70:0/1333353326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d6de4da00 con 0x564d6db57280 2024-09-21T05:49:25.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.432+0000 7fe8abfff640 1 --2- 172.21.15.70:0/1333353326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d6db57280 0x564d6df29d40 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe89c006010 tx=0x7fe89c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f265704af9cca174 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:25.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.432+0000 7fe892ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:49:25.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.433+0000 7fe892ffd640 1 -- 172.21.15.70:0/1333353326 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89c01de50 con 0x564d6db57280 2024-09-21T05:49:25.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.433+0000 7fe892ffd640 1 -- 172.21.15.70:0/1333353326 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fe89c005040 con 0x564d6db57280 2024-09-21T05:49:25.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.433+0000 7fe8c04b1740 1 -- 172.21.15.70:0/1333353326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564d6de97b60 con 0x564d6db57280 2024-09-21T05:49:25.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.433+0000 7fe892ffd640 1 -- 172.21.15.70:0/1333353326 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe89c030050 con 0x564d6db57280 2024-09-21T05:49:25.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.433+0000 7fe8c04b1740 10 client.15417 fetch_fsmap learned FSMap version 27 2024-09-21T05:49:25.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.433+0000 7fe8c04b1740 1 -- 172.21.15.70:0/1333353326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564d6df385d0 con 0x564d6db57280 2024-09-21T05:49:25.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.433+0000 7fe892ffd640 1 -- 172.21.15.70:0/1333353326 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x564d6de97b60 con 0x564d6db57280 2024-09-21T05:49:25.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.434+0000 7fe892ffd640 1 -- 172.21.15.70:0/1333353326 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fe89c00f040 con 0x564d6db57280 2024-09-21T05:49:25.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.434+0000 7fe8c04b1740 10 client.15417 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T05:49:25.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.434+0000 7fe8c04b1740 10 client.15417 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T05:49:25.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.434+0000 7fe8c04b1740 20 client.15417 populate_metadata read hostname 'smithi070' 2024-09-21T05:49:25.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.434+0000 7fe8c04b1740 1 --2- 172.21.15.70:0/1333353326 >> [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] conn(0x564d6db368e0 0x564d6df3bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:25.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.434+0000 7fe8c04b1740 4 client.15417 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:49:25.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.434+0000 7fe8c04b1740 1 -- 172.21.15.70:0/1333353326 --> [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d6de93610 con 0x564d6db368e0 2024-09-21T05:49:25.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.434+0000 7fe8b37fe640 1 --2- 172.21.15.70:0/1333353326 >> [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] conn(0x564d6db368e0 0x564d6df3bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:25.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.434+0000 7fe892ffd640 10 client.15417 ms_handle_connect on v2:172.21.15.160:6836/2558120045 2024-09-21T05:49:25.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.434+0000 7fe8b37fe640 1 --2- 172.21.15.70:0/1333353326 >> [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] conn(0x564d6db368e0 0x564d6df3bce0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=826802faeb995d37 server_cookie=8c4e2a700e51efd6 in_seq=0 out_seq=0 2024-09-21T05:49:25.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.435+0000 7fe892ffd640 1 -- 172.21.15.70:0/1333353326 <== mds.3 v2:172.21.15.160:6836/2558120045 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564d6de93610 con 0x564d6db368e0 2024-09-21T05:49:25.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.435+0000 7fe892ffd640 10 client.15417 handle_command_reply: tid=0 2024-09-21T05:49:25.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.435+0000 7fe8c04b1740 1 client.15417 shutdown 2024-09-21T05:49:25.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.435+0000 7fe8c04b1740 1 -- 172.21.15.70:0/1333353326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d6db57280 msgr2=0x564d6df29d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:25.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.435+0000 7fe8c04b1740 1 --2- 172.21.15.70:0/1333353326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d6db57280 0x564d6df29d40 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe89c006010 tx=0x7fe89c00eb20 comp rx=0 tx=0).stop 2024-09-21T05:49:25.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.435+0000 7fe8c04b1740 1 -- 172.21.15.70:0/1333353326 shutdown_connections 2024-09-21T05:49:25.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.435+0000 7fe8c04b1740 1 --2- 172.21.15.70:0/1333353326 >> [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] conn(0x564d6db368e0 0x564d6df3bce0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.435+0000 7fe8c04b1740 1 --2- 172.21.15.70:0/1333353326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d6db77f60 0x564d6df35a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.435+0000 7fe8c04b1740 1 --2- 172.21.15.70:0/1333353326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d6db57280 0x564d6df29d40 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.435+0000 7fe8c04b1740 1 --2- 172.21.15.70:0/1333353326 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564d6db4f0a0 0x564d6df29760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.435+0000 7fe892ffd640 0 client.15417 ms_handle_reset on v2:172.21.15.160:6836/2558120045 2024-09-21T05:49:25.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.435+0000 7fe8c04b1740 1 -- 172.21.15.70:0/1333353326 >> 172.21.15.70:0/1333353326 conn(0x564d6db6c350 msgr2=0x564d6df21090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:25.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.435+0000 7fe8c04b1740 1 -- 172.21.15.70:0/1333353326 shutdown_connections 2024-09-21T05:49:25.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.435+0000 7fe8c04b1740 1 -- 172.21.15.70:0/1333353326 wait complete. 2024-09-21T05:49:25.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.435+0000 7fe8c04b1740 20 client.15417 trim_cache size 0 max 16384 2024-09-21T05:49:25.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.453+0000 7fe8c04b1740 1 Processor -- start 2024-09-21T05:49:25.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.453+0000 7fe8c04b1740 1 -- start start 2024-09-21T05:49:25.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.453+0000 7fe8c04b1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564d6db4f0a0 0x564d6df16d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:25.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.453+0000 7fe8c04b1740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d6db57280 0x564d6df35970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:25.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.453+0000 7fe8c04b1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d6db77f60 0x564d6df35eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:25.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.453+0000 7fe8c04b1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564d6df3a020 con 0x564d6db77f60 2024-09-21T05:49:25.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.453+0000 7fe8c04b1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x564d6df3a6f0 con 0x564d6db4f0a0 2024-09-21T05:49:25.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.453+0000 7fe8c04b1740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x564d6df3adc0 con 0x564d6db57280 2024-09-21T05:49:25.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.454+0000 7fe8b3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d6db77f60 0x564d6df35eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:25.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.454+0000 7fe8b3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d6db77f60 0x564d6df35eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56216/0 (socket says 172.21.15.70:56216) 2024-09-21T05:49:25.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.454+0000 7fe8b3fff640 1 -- 172.21.15.70:0/2106334710 learned_addr learned my addr 172.21.15.70:0/2106334710 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:25.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.454+0000 7fe8abfff640 1 --2- 172.21.15.70:0/2106334710 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d6db57280 0x564d6df35970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:25.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.454+0000 7fe8b37fe640 1 --2- 172.21.15.70:0/2106334710 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564d6db4f0a0 0x564d6df16d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:25.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.454+0000 7fe8b3fff640 1 -- 172.21.15.70:0/2106334710 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d6db57280 msgr2=0x564d6df35970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:25.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.454+0000 7fe8b3fff640 1 --2- 172.21.15.70:0/2106334710 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d6db57280 0x564d6df35970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.454+0000 7fe8b3fff640 1 -- 172.21.15.70:0/2106334710 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564d6db4f0a0 msgr2=0x564d6df16d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:25.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.454+0000 7fe8b3fff640 1 --2- 172.21.15.70:0/2106334710 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564d6db4f0a0 0x564d6df16d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.454+0000 7fe8b3fff640 1 -- 172.21.15.70:0/2106334710 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d6df201f0 con 0x564d6db77f60 2024-09-21T05:49:25.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.454+0000 7fe8b3fff640 1 --2- 172.21.15.70:0/2106334710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d6db77f60 0x564d6df35eb0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac0e4300 tx=0x7fe8ac0d0040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c705218d2b5f0a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:25.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.454+0000 7fe8a97fa640 1 -- 172.21.15.70:0/2106334710 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac0b1420 con 0x564d6db77f60 2024-09-21T05:49:25.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.454+0000 7fe8a97fa640 1 -- 172.21.15.70:0/2106334710 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fe8ac095020 con 0x564d6db77f60 2024-09-21T05:49:25.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.454+0000 7fe8a97fa640 1 -- 172.21.15.70:0/2106334710 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac0a8c60 con 0x564d6db77f60 2024-09-21T05:49:25.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.455+0000 7fe8c04b1740 1 -- 172.21.15.70:0/2106334710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d6db77f60 msgr2=0x564d6df35eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:25.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.455+0000 7fe8c04b1740 1 --2- 172.21.15.70:0/2106334710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d6db77f60 0x564d6df35eb0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac0e4300 tx=0x7fe8ac0d0040 comp rx=0 tx=0).stop 2024-09-21T05:49:25.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.455+0000 7fe8c04b1740 1 -- 172.21.15.70:0/2106334710 shutdown_connections 2024-09-21T05:49:25.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.455+0000 7fe8c04b1740 1 --2- 172.21.15.70:0/2106334710 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d6db57280 0x564d6df35970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.455+0000 7fe8c04b1740 1 --2- 172.21.15.70:0/2106334710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d6db77f60 0x564d6df35eb0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.455+0000 7fe8c04b1740 1 --2- 172.21.15.70:0/2106334710 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564d6db4f0a0 0x564d6df16d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.455+0000 7fe8c04b1740 1 -- 172.21.15.70:0/2106334710 >> 172.21.15.70:0/2106334710 conn(0x564d6db6c350 msgr2=0x564d6df24910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:25.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.455+0000 7fe8c04b1740 1 -- 172.21.15.70:0/2106334710 shutdown_connections 2024-09-21T05:49:25.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.455+0000 7fe8c04b1740 1 -- 172.21.15.70:0/2106334710 wait complete. 2024-09-21T05:49:25.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.456+0000 7fe8c04b1740 1 -- start start 2024-09-21T05:49:25.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.456+0000 7fe8c04b1740 1 Processor -- start 2024-09-21T05:49:25.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.456+0000 7fe8c04b1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564d6db4f0a0 0x564d6df3e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:25.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.456+0000 7fe8c04b1740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d6db57280 0x564d6df3e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:25.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.456+0000 7fe8c04b1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d6db77f60 0x564d6df439f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:25.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.456+0000 7fe8c04b1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564d6df3bb60 con 0x564d6db77f60 2024-09-21T05:49:25.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.456+0000 7fe8c04b1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x564d6df3b490 con 0x564d6db4f0a0 2024-09-21T05:49:25.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.456+0000 7fe8c04b1740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x564d6df3c230 con 0x564d6db57280 2024-09-21T05:49:25.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.456+0000 7fe8c04b1740 10 client.0 _ll_register_callbacks cb 0x7fe89c00edd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:49:25.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.456+0000 7fe8b3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d6db77f60 0x564d6df439f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:25.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.456+0000 7fe8b3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d6db77f60 0x564d6df439f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56230/0 (socket says 172.21.15.70:56230) 2024-09-21T05:49:25.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.456+0000 7fe8b3fff640 1 -- 172.21.15.70:0/4103614956 learned_addr learned my addr 172.21.15.70:0/4103614956 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:25.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.456+0000 7fe8abfff640 1 --2- 172.21.15.70:0/4103614956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d6db57280 0x564d6df3e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:25.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.456+0000 7fe8b37fe640 1 --2- 172.21.15.70:0/4103614956 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564d6db4f0a0 0x564d6df3e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:25.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.457+0000 7fe8b3fff640 1 -- 172.21.15.70:0/4103614956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d6db57280 msgr2=0x564d6df3e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:25.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.457+0000 7fe8b3fff640 1 --2- 172.21.15.70:0/4103614956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d6db57280 0x564d6df3e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.457+0000 7fe8b3fff640 1 -- 172.21.15.70:0/4103614956 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564d6db4f0a0 msgr2=0x564d6df3e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:25.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.457+0000 7fe8b3fff640 1 --2- 172.21.15.70:0/4103614956 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564d6db4f0a0 0x564d6df3e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.457+0000 7fe8b3fff640 1 -- 172.21.15.70:0/4103614956 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d6df3f040 con 0x564d6db77f60 2024-09-21T05:49:25.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.457+0000 7fe8b3fff640 1 --2- 172.21.15.70:0/4103614956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d6db77f60 0x564d6df439f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac014d40 tx=0x7fe8ac004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb332535e8d6c488 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:25.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.457+0000 7fe892ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:49:25.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.457+0000 7fe892ffd640 1 -- 172.21.15.70:0/4103614956 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac0c6020 con 0x564d6db77f60 2024-09-21T05:49:25.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.457+0000 7fe892ffd640 1 -- 172.21.15.70:0/4103614956 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fe8ac00cb40 con 0x564d6db77f60 2024-09-21T05:49:25.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.457+0000 7fe8c04b1740 1 -- 172.21.15.70:0/4103614956 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8ac095020 con 0x564d6db77f60 2024-09-21T05:49:25.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.457+0000 7fe892ffd640 1 -- 172.21.15.70:0/4103614956 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe8ac00cd40 con 0x564d6db77f60 2024-09-21T05:49:25.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.457+0000 7fe8c04b1740 10 client.15423 fetch_fsmap learned FSMap version 27 2024-09-21T05:49:25.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.457+0000 7fe8c04b1740 1 -- 172.21.15.70:0/4103614956 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564d6dfa7740 con 0x564d6db77f60 2024-09-21T05:49:25.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.457+0000 7fe892ffd640 1 -- 172.21.15.70:0/4103614956 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fe8ac095020 con 0x564d6db77f60 2024-09-21T05:49:25.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.458+0000 7fe892ffd640 1 -- 172.21.15.70:0/4103614956 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fe8ac0a8340 con 0x564d6db77f60 2024-09-21T05:49:25.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.458+0000 7fe8c04b1740 10 client.15423 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T05:49:25.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.458+0000 7fe8c04b1740 10 client.15423 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T05:49:25.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.458+0000 7fe8c04b1740 20 client.15423 populate_metadata read hostname 'smithi070' 2024-09-21T05:49:25.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.458+0000 7fe8c04b1740 1 --2- 172.21.15.70:0/4103614956 >> [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] conn(0x564d6db0bc90 0x564d6dfaab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:25.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.458+0000 7fe8c04b1740 4 client.15423 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T05:49:25.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.458+0000 7fe8c04b1740 1 -- 172.21.15.70:0/4103614956 --> [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] -- command(tid 0: {"prefix": "status"}) -- 0x564d6de90a40 con 0x564d6db0bc90 2024-09-21T05:49:25.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.458+0000 7fe8b37fe640 1 --2- 172.21.15.70:0/4103614956 >> [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] conn(0x564d6db0bc90 0x564d6dfaab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:25.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.458+0000 7fe8b37fe640 1 --2- 172.21.15.70:0/4103614956 >> [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] conn(0x564d6db0bc90 0x564d6dfaab30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=aa505ed75bc66caf server_cookie=455c0af426375446 in_seq=0 out_seq=0 2024-09-21T05:49:25.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.458+0000 7fe892ffd640 10 client.15423 ms_handle_connect on v2:172.21.15.160:6836/2558120045 2024-09-21T05:49:25.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.459+0000 7fe892ffd640 1 -- 172.21.15.70:0/4103614956 <== mds.3 v2:172.21.15.160:6836/2558120045 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x564d6de90a40 con 0x564d6db0bc90 2024-09-21T05:49:25.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.459+0000 7fe892ffd640 10 client.15423 handle_command_reply: tid=0 2024-09-21T05:49:25.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.459+0000 7fe8c04b1740 1 client.15423 shutdown 2024-09-21T05:49:25.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.459+0000 7fe8c04b1740 1 -- 172.21.15.70:0/4103614956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d6db77f60 msgr2=0x564d6df439f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:25.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.459+0000 7fe8c04b1740 1 --2- 172.21.15.70:0/4103614956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d6db77f60 0x564d6df439f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac014d40 tx=0x7fe8ac004b50 comp rx=0 tx=0).stop 2024-09-21T05:49:25.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.459+0000 7fe8c04b1740 1 -- 172.21.15.70:0/4103614956 shutdown_connections 2024-09-21T05:49:25.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.459+0000 7fe8c04b1740 1 --2- 172.21.15.70:0/4103614956 >> [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] conn(0x564d6db0bc90 0x564d6dfaab30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.459+0000 7fe8c04b1740 1 --2- 172.21.15.70:0/4103614956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d6db57280 0x564d6df3e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.459+0000 7fe8c04b1740 1 --2- 172.21.15.70:0/4103614956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d6db77f60 0x564d6df439f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.459+0000 7fe8c04b1740 1 --2- 172.21.15.70:0/4103614956 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564d6db4f0a0 0x564d6df3e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.459+0000 7fe8c04b1740 1 -- 172.21.15.70:0/4103614956 >> 172.21.15.70:0/4103614956 conn(0x564d6db6c350 msgr2=0x564d6df29510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:25.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.459+0000 7fe892ffd640 0 client.15423 ms_handle_reset on v2:172.21.15.160:6836/2558120045 2024-09-21T05:49:25.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.459+0000 7fe8c04b1740 1 -- 172.21.15.70:0/4103614956 shutdown_connections 2024-09-21T05:49:25.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.459+0000 7fe8c04b1740 1 -- 172.21.15.70:0/4103614956 wait complete. 2024-09-21T05:49:25.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.459+0000 7fe8c04b1740 20 client.15423 trim_cache size 0 max 16384 2024-09-21T05:49:25.466 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:49:25.466 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "96c6636e-77db-11ef-baf5-efdc52797490", 2024-09-21T05:49:25.466 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 3, 2024-09-21T05:49:25.466 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24610, 2024-09-21T05:49:25.466 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-21T05:49:25.466 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-21T05:49:25.466 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-21T05:49:25.466 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 96.932312189000001, 2024-09-21T05:49:25.466 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2024-09-21T05:49:25.466 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 85, 2024-09-21T05:49:25.466 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 83, 2024-09-21T05:49:25.466 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 162.979468244 2024-09-21T05:49:25.467 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:49:25.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.459+0000 7fe8b9f3d640 1 -- 172.21.15.70:0/3939940228 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe8a00b6510 msgr2=0x7fe8a00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:25.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.459+0000 7fe8b9f3d640 1 --2- 172.21.15.70:0/3939940228 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe8a00b6510 0x7fe8a00b8a20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4005d90 tx=0x7fe8a4005f30 comp rx=0 tx=0).stop 2024-09-21T05:49:25.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.459+0000 7fe8b9f3d640 1 -- 172.21.15.70:0/3939940228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8b41084c0 msgr2=0x7fe8b419fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:25.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.459+0000 7fe8b9f3d640 1 --2- 172.21.15.70:0/3939940228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8b41084c0 0x7fe8b419fdb0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac00b970 tx=0x7fe8ac00be30 comp rx=0 tx=0).stop 2024-09-21T05:49:25.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.460+0000 7fe8b9f3d640 1 -- 172.21.15.70:0/3939940228 shutdown_connections 2024-09-21T05:49:25.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.460+0000 7fe8b9f3d640 1 --2- 172.21.15.70:0/3939940228 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe8a00b6510 0x7fe8a00b8a20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.460+0000 7fe8b9f3d640 1 --2- 172.21.15.70:0/3939940228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8b41084c0 0x7fe8b419fdb0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.460+0000 7fe8b9f3d640 1 --2- 172.21.15.70:0/3939940228 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8b4107b70 0x7fe8b419ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.460+0000 7fe8b9f3d640 1 --2- 172.21.15.70:0/3939940228 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8b4102230 0x7fe8b419a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.460+0000 7fe8b9f3d640 1 -- 172.21.15.70:0/3939940228 >> 172.21.15.70:0/3939940228 conn(0x7fe8b4079e10 msgr2=0x7fe8b410fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:25.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.460+0000 7fe8b9f3d640 1 -- 172.21.15.70:0/3939940228 shutdown_connections 2024-09-21T05:49:25.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:25.460+0000 7fe8b9f3d640 1 -- 172.21.15.70:0/3939940228 wait complete. 2024-09-21T05:49:26.189 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph tell mds.h status 2024-09-21T05:49:26.433 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:26.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.920+0000 7f89b7e60640 1 -- 172.21.15.70:0/2248925219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89b0109e20 msgr2=0x7f89b0110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:26.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.920+0000 7f89b7e60640 1 --2- 172.21.15.70:0/2248925219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89b0109e20 0x7f89b0110650 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f89a8009ca0 tx=0x7f89a802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.921+0000 7f89b7e60640 1 -- 172.21.15.70:0/2248925219 shutdown_connections 2024-09-21T05:49:26.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.921+0000 7f89b7e60640 1 --2- 172.21.15.70:0/2248925219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89b0109e20 0x7f89b0110650 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.921+0000 7f89b7e60640 1 --2- 172.21.15.70:0/2248925219 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89b01094d0 0x7f89b01098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.921+0000 7f89b7e60640 1 --2- 172.21.15.70:0/2248925219 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89b0103b90 0x7f89b0103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.921+0000 7f89b7e60640 1 -- 172.21.15.70:0/2248925219 >> 172.21.15.70:0/2248925219 conn(0x7f89b00ff600 msgr2=0x7f89b0101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:26.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.921+0000 7f89b7e60640 1 -- 172.21.15.70:0/2248925219 shutdown_connections 2024-09-21T05:49:26.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.921+0000 7f89b7e60640 1 -- 172.21.15.70:0/2248925219 wait complete. 2024-09-21T05:49:26.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.921+0000 7f89b7e60640 1 Processor -- start 2024-09-21T05:49:26.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.921+0000 7f89b7e60640 1 -- start start 2024-09-21T05:49:26.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.922+0000 7f89b7e60640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89b0103b90 0x7f89b01a1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:26.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.922+0000 7f89b7e60640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89b01094d0 0x7f89b01a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:26.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.922+0000 7f89b7e60640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89b0109e20 0x7f89b01ac810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:26.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.922+0000 7f89b7e60640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f89b0113ab0 con 0x7f89b01094d0 2024-09-21T05:49:26.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.922+0000 7f89b7e60640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f89b0113930 con 0x7f89b0103b90 2024-09-21T05:49:26.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.922+0000 7f89b7e60640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f89b0113c30 con 0x7f89b0109e20 2024-09-21T05:49:26.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.922+0000 7f89b53fb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89b01094d0 0x7f89b01a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:26.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.922+0000 7f89b53fb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89b01094d0 0x7f89b01a1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56244/0 (socket says 172.21.15.70:56244) 2024-09-21T05:49:26.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.922+0000 7f89b53fb640 1 -- 172.21.15.70:0/298451780 learned_addr learned my addr 172.21.15.70:0/298451780 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:26.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.922+0000 7f89b5bfc640 1 --2- 172.21.15.70:0/298451780 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89b0103b90 0x7f89b01a1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:26.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.922+0000 7f89b63fd640 1 --2- 172.21.15.70:0/298451780 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89b0109e20 0x7f89b01ac810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:26.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.922+0000 7f89b53fb640 1 -- 172.21.15.70:0/298451780 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89b0109e20 msgr2=0x7f89b01ac810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:26.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.922+0000 7f89b53fb640 1 --2- 172.21.15.70:0/298451780 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89b0109e20 0x7f89b01ac810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.922+0000 7f89b53fb640 1 -- 172.21.15.70:0/298451780 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89b0103b90 msgr2=0x7f89b01a1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:26.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.922+0000 7f89b53fb640 1 --2- 172.21.15.70:0/298451780 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89b0103b90 0x7f89b01a1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.922+0000 7f89b53fb640 1 -- 172.21.15.70:0/298451780 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89b01a2550 con 0x7f89b01094d0 2024-09-21T05:49:26.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.922+0000 7f89b53fb640 1 --2- 172.21.15.70:0/298451780 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89b01094d0 0x7f89b01a1cd0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f89a400e9f0 tx=0x7f89a400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:26.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.922+0000 7f89a2ffd640 1 -- 172.21.15.70:0/298451780 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a400ccc0 con 0x7f89b01094d0 2024-09-21T05:49:26.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.922+0000 7f89a2ffd640 1 -- 172.21.15.70:0/298451780 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f89a40108e0 con 0x7f89b01094d0 2024-09-21T05:49:26.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.922+0000 7f89a2ffd640 1 -- 172.21.15.70:0/298451780 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a4018840 con 0x7f89b01094d0 2024-09-21T05:49:26.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.922+0000 7f89b7e60640 1 -- 172.21.15.70:0/298451780 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89b01ace10 con 0x7f89b01094d0 2024-09-21T05:49:26.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.923+0000 7f89b7e60640 1 -- 172.21.15.70:0/298451780 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89b01ad1b0 con 0x7f89b01094d0 2024-09-21T05:49:26.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.925+0000 7f89be3d4740 1 Processor -- start 2024-09-21T05:49:26.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.925+0000 7f89be3d4740 1 -- start start 2024-09-21T05:49:26.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.925+0000 7f89a2ffd640 1 -- 172.21.15.70:0/298451780 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f89a4010a90 con 0x7f89b01094d0 2024-09-21T05:49:26.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.925+0000 7f89be3d4740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af5a174f60 0x55af5a51af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:26.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.925+0000 7f89be3d4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af5a14c0a0 0x55af5a51b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:26.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.925+0000 7f89be3d4740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55af5a154280 0x55af5a51b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:26.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.925+0000 7f89be3d4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55af5a492c10 con 0x55af5a14c0a0 2024-09-21T05:49:26.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.925+0000 7f89be3d4740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55af5a482040 con 0x55af5a174f60 2024-09-21T05:49:26.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.925+0000 7f89be3d4740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55af5a485e50 con 0x55af5a154280 2024-09-21T05:49:26.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.926+0000 7f89b5bfc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af5a14c0a0 0x55af5a51b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:26.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.926+0000 7f89b5bfc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af5a14c0a0 0x55af5a51b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56250/0 (socket says 172.21.15.70:56250) 2024-09-21T05:49:26.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.926+0000 7f89b63fd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af5a174f60 0x55af5a51af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:26.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.926+0000 7f89b5bfc640 1 -- 172.21.15.70:0/1993481506 learned_addr learned my addr 172.21.15.70:0/1993481506 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:26.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.926+0000 7f89b53fb640 1 --2- 172.21.15.70:0/1993481506 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55af5a154280 0x55af5a51b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:26.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.926+0000 7f89b5bfc640 1 -- 172.21.15.70:0/1993481506 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55af5a154280 msgr2=0x55af5a51b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:26.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.926+0000 7f89b5bfc640 1 --2- 172.21.15.70:0/1993481506 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55af5a154280 0x55af5a51b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.926+0000 7f89b5bfc640 1 -- 172.21.15.70:0/1993481506 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af5a174f60 msgr2=0x55af5a51af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:26.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.926+0000 7f89b5bfc640 1 --2- 172.21.15.70:0/1993481506 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af5a174f60 0x55af5a51af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.926+0000 7f89b5bfc640 1 -- 172.21.15.70:0/1993481506 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af5a1e0540 con 0x55af5a14c0a0 2024-09-21T05:49:26.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.926+0000 7f89b63fd640 1 --2- 172.21.15.70:0/1993481506 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af5a174f60 0x55af5a51af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:49:26.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.926+0000 7f89b53fb640 1 --2- 172.21.15.70:0/1993481506 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55af5a154280 0x55af5a51b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:26.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.926+0000 7f89a2ffd640 1 --2- 172.21.15.70:0/298451780 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f899c0b6510 0x7f899c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:26.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.926+0000 7f89b5bfc640 1 --2- 172.21.15.70:0/1993481506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af5a14c0a0 0x55af5a51b440 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f89ac00abe0 tx=0x7f89ac00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=113af111a465f6e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:26.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.926+0000 7f89b63fd640 1 --2- 172.21.15.70:0/298451780 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f899c0b6510 0x7f899c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:26.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.926+0000 7f89a2ffd640 1 -- 172.21.15.70:0/298451780 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f89a40e7a40 con 0x7f89b01094d0 2024-09-21T05:49:26.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.926+0000 7f899bfff640 1 -- 172.21.15.70:0/1993481506 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ac005220 con 0x55af5a14c0a0 2024-09-21T05:49:26.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.926+0000 7f899bfff640 1 -- 172.21.15.70:0/1993481506 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f89ac004c50 con 0x55af5a14c0a0 2024-09-21T05:49:26.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.927+0000 7f899bfff640 1 -- 172.21.15.70:0/1993481506 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ac018680 con 0x55af5a14c0a0 2024-09-21T05:49:26.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.927+0000 7f89be3d4740 1 -- 172.21.15.70:0/1993481506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af5a14c0a0 msgr2=0x55af5a51b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:26.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.927+0000 7f89b63fd640 1 --2- 172.21.15.70:0/298451780 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f899c0b6510 0x7f899c0b8a20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f89a8006010 tx=0x7f89a8009920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:26.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.927+0000 7f89be3d4740 1 --2- 172.21.15.70:0/1993481506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af5a14c0a0 0x55af5a51b440 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f89ac00abe0 tx=0x7f89ac00f790 comp rx=0 tx=0).stop 2024-09-21T05:49:26.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.927+0000 7f89be3d4740 1 -- 172.21.15.70:0/1993481506 shutdown_connections 2024-09-21T05:49:26.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.927+0000 7f89be3d4740 1 --2- 172.21.15.70:0/1993481506 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55af5a154280 0x55af5a51b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.927+0000 7f89be3d4740 1 --2- 172.21.15.70:0/1993481506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af5a14c0a0 0x55af5a51b440 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.927+0000 7f89be3d4740 1 --2- 172.21.15.70:0/1993481506 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af5a174f60 0x55af5a51af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.927+0000 7f89be3d4740 1 -- 172.21.15.70:0/1993481506 >> 172.21.15.70:0/1993481506 conn(0x55af5a169350 msgr2=0x55af5a518df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:26.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.928+0000 7f89be3d4740 1 -- 172.21.15.70:0/1993481506 shutdown_connections 2024-09-21T05:49:26.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.928+0000 7f89be3d4740 1 -- 172.21.15.70:0/1993481506 wait complete. 2024-09-21T05:49:26.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.928+0000 7f89be3d4740 1 -- start start 2024-09-21T05:49:26.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.928+0000 7f89be3d4740 1 Processor -- start 2024-09-21T05:49:26.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.928+0000 7f89be3d4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af5a14c0a0 0x55af5a526780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:26.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.928+0000 7f89be3d4740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55af5a154280 0x55af5a526d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:26.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.929+0000 7f89be3d4740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af5a174f60 0x55af5a532a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:26.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.929+0000 7f89be3d4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55af5a2e35f0 con 0x55af5a14c0a0 2024-09-21T05:49:26.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.929+0000 7f89be3d4740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55af5a41d010 con 0x55af5a174f60 2024-09-21T05:49:26.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.929+0000 7f89be3d4740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55af5a5296e0 con 0x55af5a154280 2024-09-21T05:49:26.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.929+0000 7f89b5bfc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af5a14c0a0 0x55af5a526780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:26.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.929+0000 7f89be3d4740 10 client.0 _ll_register_callbacks cb 0x55af5a47c340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:49:26.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.929+0000 7f89b5bfc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af5a14c0a0 0x55af5a526780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56254/0 (socket says 172.21.15.70:56254) 2024-09-21T05:49:26.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.929+0000 7f89b5bfc640 1 -- 172.21.15.70:0/257181407 learned_addr learned my addr 172.21.15.70:0/257181407 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:26.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.929+0000 7f89b63fd640 1 --2- 172.21.15.70:0/257181407 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af5a174f60 0x55af5a532a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:26.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.929+0000 7f89b53fb640 1 --2- 172.21.15.70:0/257181407 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55af5a154280 0x55af5a526d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:26.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.929+0000 7f89b5bfc640 1 -- 172.21.15.70:0/257181407 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55af5a154280 msgr2=0x55af5a526d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:26.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.929+0000 7f89b5bfc640 1 --2- 172.21.15.70:0/257181407 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55af5a154280 0x55af5a526d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.929+0000 7f89b5bfc640 1 -- 172.21.15.70:0/257181407 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af5a174f60 msgr2=0x55af5a532a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:26.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.929+0000 7f89b5bfc640 1 --2- 172.21.15.70:0/257181407 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af5a174f60 0x55af5a532a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.929+0000 7f89b5bfc640 1 -- 172.21.15.70:0/257181407 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af5a44aa00 con 0x55af5a14c0a0 2024-09-21T05:49:26.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.929+0000 7f89b53fb640 1 --2- 172.21.15.70:0/257181407 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55af5a154280 0x55af5a526d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:26.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.929+0000 7f89b5bfc640 1 --2- 172.21.15.70:0/257181407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af5a14c0a0 0x55af5a526780 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0050b0 tx=0x7f89ac0050e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c1409a61ee756d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:26.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.929+0000 7f89997fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:49:26.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.929+0000 7f89997fa640 1 -- 172.21.15.70:0/257181407 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ac027070 con 0x55af5a14c0a0 2024-09-21T05:49:26.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.929+0000 7f89997fa640 1 -- 172.21.15.70:0/257181407 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f89ac018440 con 0x55af5a14c0a0 2024-09-21T05:49:26.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.929+0000 7f89be3d4740 1 -- 172.21.15.70:0/257181407 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89ac004c50 con 0x55af5a14c0a0 2024-09-21T05:49:26.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.929+0000 7f89997fa640 1 -- 172.21.15.70:0/257181407 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f89ac033050 con 0x55af5a14c0a0 2024-09-21T05:49:26.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.929+0000 7f89be3d4740 10 client.15435 fetch_fsmap learned FSMap version 27 2024-09-21T05:49:26.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.929+0000 7f89be3d4740 1 -- 172.21.15.70:0/257181407 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55af5a5355a0 con 0x55af5a14c0a0 2024-09-21T05:49:26.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.930+0000 7f89997fa640 1 -- 172.21.15.70:0/257181407 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f89ac004c50 con 0x55af5a14c0a0 2024-09-21T05:49:26.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.930+0000 7f89997fa640 1 -- 172.21.15.70:0/257181407 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f89ac023430 con 0x55af5a14c0a0 2024-09-21T05:49:26.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.930+0000 7f89be3d4740 10 client.15435 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T05:49:26.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.930+0000 7f89be3d4740 10 client.15435 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T05:49:26.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.930+0000 7f89be3d4740 20 client.15435 populate_metadata read hostname 'smithi070' 2024-09-21T05:49:26.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.930+0000 7f89be3d4740 1 --2- 172.21.15.70:0/257181407 >> [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] conn(0x55af5a1338e0 0x55af5a538cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:26.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.930+0000 7f89be3d4740 4 client.15435 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:49:26.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.930+0000 7f89be3d4740 1 -- 172.21.15.70:0/257181407 --> [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af5a494b60 con 0x55af5a1338e0 2024-09-21T05:49:26.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.930+0000 7f89b53fb640 1 --2- 172.21.15.70:0/257181407 >> [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] conn(0x55af5a1338e0 0x55af5a538cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:26.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.931+0000 7f89997fa640 10 client.15435 ms_handle_connect on v2:172.21.15.116:6836/444312934 2024-09-21T05:49:26.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.931+0000 7f89b53fb640 1 --2- 172.21.15.70:0/257181407 >> [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] conn(0x55af5a1338e0 0x55af5a538cb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=17cf5035f7f9f0b server_cookie=68973bb89f48605c in_seq=0 out_seq=0 2024-09-21T05:49:26.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.931+0000 7f89997fa640 1 -- 172.21.15.70:0/257181407 <== mds.2 v2:172.21.15.116:6836/444312934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55af5a494b60 con 0x55af5a1338e0 2024-09-21T05:49:26.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.931+0000 7f89997fa640 10 client.15435 handle_command_reply: tid=0 2024-09-21T05:49:26.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.931+0000 7f89be3d4740 1 client.15435 shutdown 2024-09-21T05:49:26.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.931+0000 7f89be3d4740 1 -- 172.21.15.70:0/257181407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af5a14c0a0 msgr2=0x55af5a526780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:26.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.931+0000 7f89be3d4740 1 --2- 172.21.15.70:0/257181407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af5a14c0a0 0x55af5a526780 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0050b0 tx=0x7f89ac0050e0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.932+0000 7f89be3d4740 1 -- 172.21.15.70:0/257181407 shutdown_connections 2024-09-21T05:49:26.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.932+0000 7f89be3d4740 1 --2- 172.21.15.70:0/257181407 >> [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] conn(0x55af5a1338e0 0x55af5a538cb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.932+0000 7f89be3d4740 1 --2- 172.21.15.70:0/257181407 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55af5a154280 0x55af5a526d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.932+0000 7f89be3d4740 1 --2- 172.21.15.70:0/257181407 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af5a174f60 0x55af5a532a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.932+0000 7f89997fa640 0 client.15435 ms_handle_reset on v2:172.21.15.116:6836/444312934 2024-09-21T05:49:26.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.932+0000 7f89be3d4740 1 --2- 172.21.15.70:0/257181407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af5a14c0a0 0x55af5a526780 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.932+0000 7f89be3d4740 1 -- 172.21.15.70:0/257181407 >> 172.21.15.70:0/257181407 conn(0x55af5a169350 msgr2=0x55af5a51e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:26.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.932+0000 7f89be3d4740 1 -- 172.21.15.70:0/257181407 shutdown_connections 2024-09-21T05:49:26.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.932+0000 7f89be3d4740 1 -- 172.21.15.70:0/257181407 wait complete. 2024-09-21T05:49:26.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.932+0000 7f89be3d4740 20 client.15435 trim_cache size 0 max 16384 2024-09-21T05:49:26.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.950+0000 7f89be3d4740 1 Processor -- start 2024-09-21T05:49:26.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.950+0000 7f89be3d4740 1 -- start start 2024-09-21T05:49:26.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.950+0000 7f89be3d4740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af5a14c0a0 0x55af5a521020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:26.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.950+0000 7f89be3d4740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55af5a154280 0x55af5a532970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:26.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.950+0000 7f89be3d4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af5a174f60 0x55af5a532eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:26.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.950+0000 7f89be3d4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55af5a536ff0 con 0x55af5a174f60 2024-09-21T05:49:26.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.950+0000 7f89be3d4740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55af5a5376c0 con 0x55af5a14c0a0 2024-09-21T05:49:26.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.950+0000 7f89be3d4740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55af5a537d90 con 0x55af5a154280 2024-09-21T05:49:26.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.950+0000 7f89b63fd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af5a174f60 0x55af5a532eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:26.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.950+0000 7f89b63fd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af5a174f60 0x55af5a532eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56266/0 (socket says 172.21.15.70:56266) 2024-09-21T05:49:26.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.950+0000 7f89b63fd640 1 -- 172.21.15.70:0/2100746997 learned_addr learned my addr 172.21.15.70:0/2100746997 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:26.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.950+0000 7f89b5bfc640 1 --2- 172.21.15.70:0/2100746997 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af5a14c0a0 0x55af5a521020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:26.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.950+0000 7f89b53fb640 1 --2- 172.21.15.70:0/2100746997 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55af5a154280 0x55af5a532970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:26.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.950+0000 7f89b63fd640 1 -- 172.21.15.70:0/2100746997 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55af5a154280 msgr2=0x55af5a532970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:26.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.950+0000 7f89b63fd640 1 --2- 172.21.15.70:0/2100746997 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55af5a154280 0x55af5a532970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.950+0000 7f89b63fd640 1 -- 172.21.15.70:0/2100746997 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af5a14c0a0 msgr2=0x55af5a521020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:26.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.950+0000 7f89b63fd640 1 --2- 172.21.15.70:0/2100746997 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af5a14c0a0 0x55af5a521020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.950+0000 7f89b63fd640 1 -- 172.21.15.70:0/2100746997 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af5a522010 con 0x55af5a174f60 2024-09-21T05:49:26.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.950+0000 7f89b5bfc640 1 --2- 172.21.15.70:0/2100746997 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af5a14c0a0 0x55af5a521020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:49:26.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.950+0000 7f89b53fb640 1 --2- 172.21.15.70:0/2100746997 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55af5a154280 0x55af5a532970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:49:26.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.951+0000 7f89b63fd640 1 --2- 172.21.15.70:0/2100746997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af5a174f60 0x55af5a532eb0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f89a8031860 tx=0x7f89a8043000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fedb65f2709a6727 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:26.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.951+0000 7f899b7fe640 1 -- 172.21.15.70:0/2100746997 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a8004040 con 0x55af5a174f60 2024-09-21T05:49:26.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.951+0000 7f899b7fe640 1 -- 172.21.15.70:0/2100746997 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f89a8036050 con 0x55af5a174f60 2024-09-21T05:49:26.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.951+0000 7f899b7fe640 1 -- 172.21.15.70:0/2100746997 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a8030b80 con 0x55af5a174f60 2024-09-21T05:49:26.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.952+0000 7f89be3d4740 1 -- 172.21.15.70:0/2100746997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af5a174f60 msgr2=0x55af5a532eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:26.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.952+0000 7f89be3d4740 1 --2- 172.21.15.70:0/2100746997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af5a174f60 0x55af5a532eb0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f89a8031860 tx=0x7f89a8043000 comp rx=0 tx=0).stop 2024-09-21T05:49:26.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.952+0000 7f89be3d4740 1 -- 172.21.15.70:0/2100746997 shutdown_connections 2024-09-21T05:49:26.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.952+0000 7f89be3d4740 1 --2- 172.21.15.70:0/2100746997 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55af5a154280 0x55af5a532970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.952+0000 7f89be3d4740 1 --2- 172.21.15.70:0/2100746997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af5a174f60 0x55af5a532eb0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.952+0000 7f89be3d4740 1 --2- 172.21.15.70:0/2100746997 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af5a14c0a0 0x55af5a521020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.952+0000 7f89be3d4740 1 -- 172.21.15.70:0/2100746997 >> 172.21.15.70:0/2100746997 conn(0x55af5a169350 msgr2=0x55af5a526530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:26.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.952+0000 7f89be3d4740 1 -- 172.21.15.70:0/2100746997 shutdown_connections 2024-09-21T05:49:26.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.952+0000 7f89be3d4740 1 -- 172.21.15.70:0/2100746997 wait complete. 2024-09-21T05:49:26.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.952+0000 7f89be3d4740 1 -- start start 2024-09-21T05:49:26.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.952+0000 7f89be3d4740 1 Processor -- start 2024-09-21T05:49:26.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.953+0000 7f89be3d4740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af5a14c0a0 0x55af5a53b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:26.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.953+0000 7f89be3d4740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55af5a154280 0x55af5a53b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:26.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.953+0000 7f89be3d4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af5a174f60 0x55af5a540ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:26.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.953+0000 7f89b63fd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af5a174f60 0x55af5a540ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:26.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.953+0000 7f89be3d4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55af5a538b30 con 0x55af5a174f60 2024-09-21T05:49:26.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.953+0000 7f89b5bfc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af5a14c0a0 0x55af5a53b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:26.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.953+0000 7f89b63fd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af5a174f60 0x55af5a540ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56270/0 (socket says 172.21.15.70:56270) 2024-09-21T05:49:26.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.953+0000 7f89be3d4740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55af5a538460 con 0x55af5a14c0a0 2024-09-21T05:49:26.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.953+0000 7f89b63fd640 1 -- 172.21.15.70:0/4166030217 learned_addr learned my addr 172.21.15.70:0/4166030217 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:26.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.953+0000 7f89be3d4740 1 -- 172.21.15.70:0/4166030217 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55af5a539200 con 0x55af5a154280 2024-09-21T05:49:26.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.953+0000 7f89be3d4740 10 client.0 _ll_register_callbacks cb 0x7f89a4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:49:26.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.953+0000 7f89b53fb640 1 --2- 172.21.15.70:0/4166030217 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55af5a154280 0x55af5a53b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:26.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.953+0000 7f89b5bfc640 1 -- 172.21.15.70:0/4166030217 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55af5a154280 msgr2=0x55af5a53b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:26.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.953+0000 7f89b5bfc640 1 --2- 172.21.15.70:0/4166030217 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55af5a154280 0x55af5a53b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.953+0000 7f89b5bfc640 1 -- 172.21.15.70:0/4166030217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af5a174f60 msgr2=0x55af5a540ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:26.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.953+0000 7f89b5bfc640 1 --2- 172.21.15.70:0/4166030217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af5a174f60 0x55af5a540ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.953+0000 7f89b5bfc640 1 -- 172.21.15.70:0/4166030217 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af5a540ff0 con 0x55af5a14c0a0 2024-09-21T05:49:26.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.954+0000 7f89b5bfc640 1 --2- 172.21.15.70:0/4166030217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af5a14c0a0 0x55af5a53b320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f89ac00abe0 tx=0x7f89ac00aae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dab8dd3152a3b5a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:26.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.954+0000 7f89997fa640 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2024-09-21T05:49:26.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.954+0000 7f89997fa640 1 -- 172.21.15.70:0/4166030217 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ac03b020 con 0x55af5a14c0a0 2024-09-21T05:49:26.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.954+0000 7f89997fa640 1 -- 172.21.15.70:0/4166030217 <== mon.2 v2:172.21.15.116:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f89ac005510 con 0x55af5a14c0a0 2024-09-21T05:49:26.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.954+0000 7f89be3d4740 1 -- 172.21.15.70:0/4166030217 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89a8036050 con 0x55af5a14c0a0 2024-09-21T05:49:26.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.954+0000 7f89997fa640 1 -- 172.21.15.70:0/4166030217 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f89ac046050 con 0x55af5a14c0a0 2024-09-21T05:49:26.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.954+0000 7f89be3d4740 10 client.25067 fetch_fsmap learned FSMap version 27 2024-09-21T05:49:26.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.954+0000 7f89be3d4740 1 -- 172.21.15.70:0/4166030217 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55af5a5a4730 con 0x55af5a14c0a0 2024-09-21T05:49:26.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.954+0000 7f89997fa640 1 -- 172.21.15.70:0/4166030217 <== mon.2 v2:172.21.15.116:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f89a8036050 con 0x55af5a14c0a0 2024-09-21T05:49:26.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.955+0000 7f89997fa640 1 -- 172.21.15.70:0/4166030217 <== mon.2 v2:172.21.15.116:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f89ac023a40 con 0x55af5a14c0a0 2024-09-21T05:49:26.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.955+0000 7f89be3d4740 10 client.25067 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T05:49:26.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.955+0000 7f89be3d4740 10 client.25067 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T05:49:26.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.955+0000 7f89be3d4740 20 client.25067 populate_metadata read hostname 'smithi070' 2024-09-21T05:49:26.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.955+0000 7f89be3d4740 1 --2- 172.21.15.70:0/4166030217 >> [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] conn(0x55af5a108c90 0x55af5a5a8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:26.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.955+0000 7f89be3d4740 4 client.25067 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T05:49:26.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.955+0000 7f89be3d4740 1 -- 172.21.15.70:0/4166030217 --> [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] -- command(tid 0: {"prefix": "status"}) -- 0x55af5a490610 con 0x55af5a108c90 2024-09-21T05:49:26.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.955+0000 7f89b53fb640 1 --2- 172.21.15.70:0/4166030217 >> [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] conn(0x55af5a108c90 0x55af5a5a8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:26.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.955+0000 7f89997fa640 10 client.25067 ms_handle_connect on v2:172.21.15.116:6836/444312934 2024-09-21T05:49:26.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.955+0000 7f89b53fb640 1 --2- 172.21.15.70:0/4166030217 >> [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] conn(0x55af5a108c90 0x55af5a5a8020 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f8bc573bc718bc9f server_cookie=a607c7be7978f010 in_seq=0 out_seq=0 2024-09-21T05:49:26.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.955+0000 7f89997fa640 1 -- 172.21.15.70:0/4166030217 <== mds.2 v2:172.21.15.116:6836/444312934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55af5a490610 con 0x55af5a108c90 2024-09-21T05:49:26.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.955+0000 7f89997fa640 10 client.25067 handle_command_reply: tid=0 2024-09-21T05:49:26.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.956+0000 7f89be3d4740 1 client.25067 shutdown 2024-09-21T05:49:26.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.956+0000 7f89be3d4740 1 -- 172.21.15.70:0/4166030217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af5a14c0a0 msgr2=0x55af5a53b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:26.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.956+0000 7f89be3d4740 1 --2- 172.21.15.70:0/4166030217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af5a14c0a0 0x55af5a53b320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f89ac00abe0 tx=0x7f89ac00aae0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.956+0000 7f89be3d4740 1 -- 172.21.15.70:0/4166030217 shutdown_connections 2024-09-21T05:49:26.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.956+0000 7f89be3d4740 1 --2- 172.21.15.70:0/4166030217 >> [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] conn(0x55af5a108c90 0x55af5a5a8020 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.956+0000 7f89be3d4740 1 --2- 172.21.15.70:0/4166030217 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55af5a154280 0x55af5a53b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.956+0000 7f89be3d4740 1 --2- 172.21.15.70:0/4166030217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af5a174f60 0x55af5a540ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.956+0000 7f89be3d4740 1 --2- 172.21.15.70:0/4166030217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af5a14c0a0 0x55af5a53b320 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.956+0000 7f89997fa640 0 client.25067 ms_handle_reset on v2:172.21.15.116:6836/444312934 2024-09-21T05:49:26.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.956+0000 7f89be3d4740 1 -- 172.21.15.70:0/4166030217 >> 172.21.15.70:0/4166030217 conn(0x55af5a169350 msgr2=0x55af5a526530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:26.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.956+0000 7f89be3d4740 1 -- 172.21.15.70:0/4166030217 shutdown_connections 2024-09-21T05:49:26.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.956+0000 7f89be3d4740 1 -- 172.21.15.70:0/4166030217 wait complete. 2024-09-21T05:49:26.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.956+0000 7f89be3d4740 20 client.25067 trim_cache size 0 max 16384 2024-09-21T05:49:26.963 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:49:26.963 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "96c6636e-77db-11ef-baf5-efdc52797490", 2024-09-21T05:49:26.963 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 2, 2024-09-21T05:49:26.963 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24611, 2024-09-21T05:49:26.963 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-21T05:49:26.963 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-21T05:49:26.963 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-21T05:49:26.963 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 99.438168509999997, 2024-09-21T05:49:26.964 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2024-09-21T05:49:26.964 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 85, 2024-09-21T05:49:26.964 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 83, 2024-09-21T05:49:26.965 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 161.846070994 2024-09-21T05:49:26.965 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:49:26.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.956+0000 7f89b7e60640 1 -- 172.21.15.70:0/298451780 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f899c0b6510 msgr2=0x7f899c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:26.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.956+0000 7f89b7e60640 1 --2- 172.21.15.70:0/298451780 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f899c0b6510 0x7f899c0b8a20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f89a8006010 tx=0x7f89a8009920 comp rx=0 tx=0).stop 2024-09-21T05:49:26.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.956+0000 7f89b7e60640 1 -- 172.21.15.70:0/298451780 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89b01094d0 msgr2=0x7f89b01a1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:26.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.956+0000 7f89b7e60640 1 --2- 172.21.15.70:0/298451780 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89b01094d0 0x7f89b01a1cd0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f89a400e9f0 tx=0x7f89a400eeb0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.957+0000 7f89b7e60640 1 -- 172.21.15.70:0/298451780 shutdown_connections 2024-09-21T05:49:26.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.957+0000 7f89b7e60640 1 --2- 172.21.15.70:0/298451780 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f899c0b6510 0x7f899c0b8a20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.957+0000 7f89b7e60640 1 --2- 172.21.15.70:0/298451780 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89b0109e20 0x7f89b01ac810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.957+0000 7f89b7e60640 1 --2- 172.21.15.70:0/298451780 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89b01094d0 0x7f89b01a1cd0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.957+0000 7f89b7e60640 1 --2- 172.21.15.70:0/298451780 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89b0103b90 0x7f89b01a1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:26.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.957+0000 7f89b7e60640 1 -- 172.21.15.70:0/298451780 >> 172.21.15.70:0/298451780 conn(0x7f89b00ff600 msgr2=0x7f89b00ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:26.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.957+0000 7f89b7e60640 1 -- 172.21.15.70:0/298451780 shutdown_connections 2024-09-21T05:49:26.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:26.957+0000 7f89b7e60640 1 -- 172.21.15.70:0/298451780 wait complete. 2024-09-21T05:49:27.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:26 smithi160 ceph-mon[33979]: pgmap v369: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T05:49:27.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:26 smithi070 ceph-mon[30981]: pgmap v369: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T05:49:27.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:26 smithi116 ceph-mon[34332]: pgmap v369: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T05:49:27.706 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T05:49:27.951 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:28.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.429+0000 7f7a7199e640 1 -- 172.21.15.70:0/3546646073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a6c104850 msgr2=0x7f7a6c104c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:28.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.429+0000 7f7a7199e640 1 --2- 172.21.15.70:0/3546646073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a6c104850 0x7f7a6c104c60 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c009900 tx=0x7f7a5c02a410 comp rx=0 tx=0).stop 2024-09-21T05:49:28.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.429+0000 7f7a7199e640 1 -- 172.21.15.70:0/3546646073 shutdown_connections 2024-09-21T05:49:28.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.429+0000 7f7a7199e640 1 --2- 172.21.15.70:0/3546646073 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a6c105280 0x7f7a6c10d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.429+0000 7f7a7199e640 1 --2- 172.21.15.70:0/3546646073 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a6c10de00 0x7f7a6c110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.429+0000 7f7a7199e640 1 --2- 172.21.15.70:0/3546646073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a6c104850 0x7f7a6c104c60 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.429+0000 7f7a7199e640 1 -- 172.21.15.70:0/3546646073 >> 172.21.15.70:0/3546646073 conn(0x7f7a6c079710 msgr2=0x7f7a6c079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:28.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.429+0000 7f7a7199e640 1 -- 172.21.15.70:0/3546646073 shutdown_connections 2024-09-21T05:49:28.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.429+0000 7f7a7199e640 1 -- 172.21.15.70:0/3546646073 wait complete. 2024-09-21T05:49:28.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.430+0000 7f7a7199e640 1 Processor -- start 2024-09-21T05:49:28.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.430+0000 7f7a7199e640 1 -- start start 2024-09-21T05:49:28.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.430+0000 7f7a7199e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a6c104850 0x7f7a6c19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:28.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.430+0000 7f7a7199e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a6c105280 0x7f7a6c19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:28.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.430+0000 7f7a7199e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a6c10de00 0x7f7a6c19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:28.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.430+0000 7f7a7199e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6c113a70 con 0x7f7a6c105280 2024-09-21T05:49:28.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.430+0000 7f7a7199e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6c1138f0 con 0x7f7a6c10de00 2024-09-21T05:49:28.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.430+0000 7f7a7199e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6c113bf0 con 0x7f7a6c104850 2024-09-21T05:49:28.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.430+0000 7f7a63fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a6c105280 0x7f7a6c19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:28.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.430+0000 7f7a63fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a6c105280 0x7f7a6c19aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56286/0 (socket says 172.21.15.70:56286) 2024-09-21T05:49:28.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.430+0000 7f7a63fff640 1 -- 172.21.15.70:0/3286700190 learned_addr learned my addr 172.21.15.70:0/3286700190 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:28.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.430+0000 7f7a6affd640 1 --2- 172.21.15.70:0/3286700190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a6c104850 0x7f7a6c19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:28.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.430+0000 7f7a6b7fe640 1 --2- 172.21.15.70:0/3286700190 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a6c10de00 0x7f7a6c19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:28.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.430+0000 7f7a63fff640 1 -- 172.21.15.70:0/3286700190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a6c104850 msgr2=0x7f7a6c19a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:28.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.430+0000 7f7a63fff640 1 --2- 172.21.15.70:0/3286700190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a6c104850 0x7f7a6c19a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.430+0000 7f7a63fff640 1 -- 172.21.15.70:0/3286700190 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a6c10de00 msgr2=0x7f7a6c19fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:28.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.430+0000 7f7a63fff640 1 --2- 172.21.15.70:0/3286700190 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a6c10de00 0x7f7a6c19fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.430+0000 7f7a63fff640 1 -- 172.21.15.70:0/3286700190 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a6c1a03f0 con 0x7f7a6c105280 2024-09-21T05:49:28.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.430+0000 7f7a6b7fe640 1 --2- 172.21.15.70:0/3286700190 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a6c10de00 0x7f7a6c19fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:28.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.430+0000 7f7a6affd640 1 --2- 172.21.15.70:0/3286700190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a6c104850 0x7f7a6c19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:28.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.431+0000 7f7a63fff640 1 --2- 172.21.15.70:0/3286700190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a6c105280 0x7f7a6c19aa20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400d740 tx=0x7f7a5400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:28.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.431+0000 7f7a7099c640 1 -- 172.21.15.70:0/3286700190 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a54017070 con 0x7f7a6c105280 2024-09-21T05:49:28.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.431+0000 7f7a7099c640 1 -- 172.21.15.70:0/3286700190 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f7a5400de50 con 0x7f7a6c105280 2024-09-21T05:49:28.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.431+0000 7f7a7199e640 1 -- 172.21.15.70:0/3286700190 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a6c1a06e0 con 0x7f7a6c105280 2024-09-21T05:49:28.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.431+0000 7f7a7099c640 1 -- 172.21.15.70:0/3286700190 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5400f620 con 0x7f7a6c105280 2024-09-21T05:49:28.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.431+0000 7f7a7199e640 1 -- 172.21.15.70:0/3286700190 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a6c1a6e40 con 0x7f7a6c105280 2024-09-21T05:49:28.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.433+0000 7f7a77f12740 1 Processor -- start 2024-09-21T05:49:28.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.433+0000 7f7a7099c640 1 -- 172.21.15.70:0/3286700190 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f7a5401a070 con 0x7f7a6c105280 2024-09-21T05:49:28.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.433+0000 7f7a77f12740 1 -- start start 2024-09-21T05:49:28.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.434+0000 7f7a77f12740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e61c53f60 0x562e61ff9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:28.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.434+0000 7f7a77f12740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e61c2b0a0 0x562e61ffa440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:28.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.434+0000 7f7a77f12740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562e61c33280 0x562e61ffa980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:28.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.434+0000 7f7a77f12740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562e61f71c10 con 0x562e61c2b0a0 2024-09-21T05:49:28.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.434+0000 7f7a77f12740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562e61f61040 con 0x562e61c33280 2024-09-21T05:49:28.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.434+0000 7f7a77f12740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x562e61f64e50 con 0x562e61c53f60 2024-09-21T05:49:28.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.434+0000 7f7a6affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e61c2b0a0 0x562e61ffa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:28.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.434+0000 7f7a6affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e61c2b0a0 0x562e61ffa440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56296/0 (socket says 172.21.15.70:56296) 2024-09-21T05:49:28.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.434+0000 7f7a6affd640 1 -- 172.21.15.70:0/2457842316 learned_addr learned my addr 172.21.15.70:0/2457842316 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:28.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.434+0000 7f7a6b7fe640 1 --2- 172.21.15.70:0/2457842316 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e61c53f60 0x562e61ff9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:28.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.434+0000 7f7a63fff640 1 --2- 172.21.15.70:0/2457842316 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562e61c33280 0x562e61ffa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:28.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.434+0000 7f7a6affd640 1 -- 172.21.15.70:0/2457842316 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e61c53f60 msgr2=0x562e61ff9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:28.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.434+0000 7f7a6affd640 1 --2- 172.21.15.70:0/2457842316 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e61c53f60 0x562e61ff9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.434+0000 7f7a6affd640 1 -- 172.21.15.70:0/2457842316 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562e61c33280 msgr2=0x562e61ffa980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:28.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.434+0000 7f7a6affd640 1 --2- 172.21.15.70:0/2457842316 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562e61c33280 0x562e61ffa980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.434+0000 7f7a6affd640 1 -- 172.21.15.70:0/2457842316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e61cbf540 con 0x562e61c2b0a0 2024-09-21T05:49:28.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.434+0000 7f7a63fff640 1 --2- 172.21.15.70:0/2457842316 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562e61c33280 0x562e61ffa980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:28.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.434+0000 7f7a6affd640 1 --2- 172.21.15.70:0/2457842316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e61c2b0a0 0x562e61ffa440 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c02a930 tx=0x7f7a5c032de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99cf185fef589510 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:28.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.434+0000 7f7a7099c640 1 --2- 172.21.15.70:0/3286700190 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7a580b6510 0x7f7a580b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:28.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.434+0000 7f7a61ffb640 1 -- 172.21.15.70:0/2457842316 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c03f070 con 0x562e61c2b0a0 2024-09-21T05:49:28.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.435+0000 7f7a61ffb640 1 -- 172.21.15.70:0/2457842316 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f7a5c031600 con 0x562e61c2b0a0 2024-09-21T05:49:28.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.435+0000 7f7a61ffb640 1 -- 172.21.15.70:0/2457842316 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c035070 con 0x562e61c2b0a0 2024-09-21T05:49:28.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.435+0000 7f7a6b7fe640 1 --2- 172.21.15.70:0/3286700190 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7a580b6510 0x7f7a580b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:28.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.435+0000 7f7a7099c640 1 -- 172.21.15.70:0/3286700190 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f7a540e7160 con 0x7f7a6c105280 2024-09-21T05:49:28.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.436+0000 7f7a77f12740 1 -- 172.21.15.70:0/2457842316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e61c2b0a0 msgr2=0x562e61ffa440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:28.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.436+0000 7f7a6b7fe640 1 --2- 172.21.15.70:0/3286700190 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7a580b6510 0x7f7a580b8a20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7a64005fd0 tx=0x7f7a64009800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:28.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.436+0000 7f7a77f12740 1 --2- 172.21.15.70:0/2457842316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e61c2b0a0 0x562e61ffa440 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c02a930 tx=0x7f7a5c032de0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.436+0000 7f7a77f12740 1 -- 172.21.15.70:0/2457842316 shutdown_connections 2024-09-21T05:49:28.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.436+0000 7f7a77f12740 1 --2- 172.21.15.70:0/2457842316 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562e61c33280 0x562e61ffa980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.436+0000 7f7a77f12740 1 --2- 172.21.15.70:0/2457842316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e61c2b0a0 0x562e61ffa440 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.436+0000 7f7a77f12740 1 --2- 172.21.15.70:0/2457842316 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e61c53f60 0x562e61ff9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.436+0000 7f7a77f12740 1 -- 172.21.15.70:0/2457842316 >> 172.21.15.70:0/2457842316 conn(0x562e61c48350 msgr2=0x562e61ff7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:28.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.436+0000 7f7a77f12740 1 -- 172.21.15.70:0/2457842316 shutdown_connections 2024-09-21T05:49:28.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.436+0000 7f7a77f12740 1 -- 172.21.15.70:0/2457842316 wait complete. 2024-09-21T05:49:28.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.436+0000 7f7a77f12740 1 -- start start 2024-09-21T05:49:28.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.436+0000 7f7a77f12740 1 Processor -- start 2024-09-21T05:49:28.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.437+0000 7f7a77f12740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e61c2b0a0 0x562e620059d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:28.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.437+0000 7f7a77f12740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562e61c33280 0x562e62005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:28.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.437+0000 7f7a77f12740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e61c53f60 0x562e620119a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:28.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.437+0000 7f7a77f12740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562e61dc25f0 con 0x562e61c2b0a0 2024-09-21T05:49:28.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.437+0000 7f7a77f12740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562e61efc010 con 0x562e61c33280 2024-09-21T05:49:28.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.437+0000 7f7a77f12740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x562e62008680 con 0x562e61c53f60 2024-09-21T05:49:28.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.437+0000 7f7a77f12740 10 client.0 _ll_register_callbacks cb 0x562e61f5b340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:49:28.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.437+0000 7f7a6affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e61c2b0a0 0x562e620059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:28.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.437+0000 7f7a6affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e61c2b0a0 0x562e620059d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56312/0 (socket says 172.21.15.70:56312) 2024-09-21T05:49:28.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.437+0000 7f7a6affd640 1 -- 172.21.15.70:0/778195401 learned_addr learned my addr 172.21.15.70:0/778195401 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:28.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.437+0000 7f7a63fff640 1 --2- 172.21.15.70:0/778195401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562e61c33280 0x562e62005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:28.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.437+0000 7f7a6b7fe640 1 --2- 172.21.15.70:0/778195401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e61c53f60 0x562e620119a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:28.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.437+0000 7f7a6affd640 1 -- 172.21.15.70:0/778195401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e61c53f60 msgr2=0x562e620119a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:28.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.437+0000 7f7a6affd640 1 --2- 172.21.15.70:0/778195401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e61c53f60 0x562e620119a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.437+0000 7f7a6affd640 1 -- 172.21.15.70:0/778195401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562e61c33280 msgr2=0x562e62005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:28.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.437+0000 7f7a6affd640 1 --2- 172.21.15.70:0/778195401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562e61c33280 0x562e62005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.437+0000 7f7a6affd640 1 -- 172.21.15.70:0/778195401 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e61f29a00 con 0x562e61c2b0a0 2024-09-21T05:49:28.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.437+0000 7f7a6affd640 1 --2- 172.21.15.70:0/778195401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e61c2b0a0 0x562e620059d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c005940 tx=0x7f7a5c0319c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a9252a98e9a04ff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:28.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.437+0000 7f7a4affd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:49:28.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.437+0000 7f7a4affd640 1 -- 172.21.15.70:0/778195401 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c04a020 con 0x562e61c2b0a0 2024-09-21T05:49:28.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.437+0000 7f7a4affd640 1 -- 172.21.15.70:0/778195401 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f7a5c03b840 con 0x562e61c2b0a0 2024-09-21T05:49:28.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.437+0000 7f7a77f12740 1 -- 172.21.15.70:0/778195401 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a5c031600 con 0x562e61c2b0a0 2024-09-21T05:49:28.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.438+0000 7f7a4affd640 1 -- 172.21.15.70:0/778195401 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7a5c055050 con 0x562e61c2b0a0 2024-09-21T05:49:28.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.438+0000 7f7a77f12740 10 client.15453 fetch_fsmap learned FSMap version 27 2024-09-21T05:49:28.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.438+0000 7f7a77f12740 1 -- 172.21.15.70:0/778195401 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562e620145a0 con 0x562e61c2b0a0 2024-09-21T05:49:28.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.438+0000 7f7a4affd640 1 -- 172.21.15.70:0/778195401 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f7a5c031600 con 0x562e61c2b0a0 2024-09-21T05:49:28.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.438+0000 7f7a4affd640 1 -- 172.21.15.70:0/778195401 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f7a5c043b20 con 0x562e61c2b0a0 2024-09-21T05:49:28.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.438+0000 7f7a77f12740 10 client.15453 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T05:49:28.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.438+0000 7f7a77f12740 10 client.15453 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T05:49:28.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.438+0000 7f7a77f12740 20 client.15453 populate_metadata read hostname 'smithi070' 2024-09-21T05:49:28.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.438+0000 7f7a77f12740 1 --2- 172.21.15.70:0/778195401 >> [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] conn(0x562e61c128e0 0x562e62017bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:28.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.438+0000 7f7a77f12740 4 client.15453 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:49:28.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.438+0000 7f7a77f12740 1 -- 172.21.15.70:0/778195401 --> [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e61f73b60 con 0x562e61c128e0 2024-09-21T05:49:28.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.438+0000 7f7a63fff640 1 --2- 172.21.15.70:0/778195401 >> [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] conn(0x562e61c128e0 0x562e62017bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:28.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.439+0000 7f7a4affd640 10 client.15453 ms_handle_connect on v2:172.21.15.160:6838/1339744282 2024-09-21T05:49:28.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.439+0000 7f7a63fff640 1 --2- 172.21.15.70:0/778195401 >> [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] conn(0x562e61c128e0 0x562e62017bf0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ac4e31d4521ce2dc server_cookie=56804180a2990ff8 in_seq=0 out_seq=0 2024-09-21T05:49:28.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.440+0000 7f7a4affd640 1 -- 172.21.15.70:0/778195401 <== mds.1 v2:172.21.15.160:6838/1339744282 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562e61f73b60 con 0x562e61c128e0 2024-09-21T05:49:28.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.440+0000 7f7a4affd640 10 client.15453 handle_command_reply: tid=0 2024-09-21T05:49:28.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.440+0000 7f7a77f12740 1 client.15453 shutdown 2024-09-21T05:49:28.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.440+0000 7f7a77f12740 1 -- 172.21.15.70:0/778195401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e61c2b0a0 msgr2=0x562e620059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:28.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.440+0000 7f7a77f12740 1 --2- 172.21.15.70:0/778195401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e61c2b0a0 0x562e620059d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c005940 tx=0x7f7a5c0319c0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.440+0000 7f7a77f12740 1 -- 172.21.15.70:0/778195401 shutdown_connections 2024-09-21T05:49:28.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.440+0000 7f7a77f12740 1 --2- 172.21.15.70:0/778195401 >> [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] conn(0x562e61c128e0 0x562e62017bf0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.440+0000 7f7a77f12740 1 --2- 172.21.15.70:0/778195401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e61c53f60 0x562e620119a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.440+0000 7f7a77f12740 1 --2- 172.21.15.70:0/778195401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562e61c33280 0x562e62005f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.440+0000 7f7a4affd640 0 client.15453 ms_handle_reset on v2:172.21.15.160:6838/1339744282 2024-09-21T05:49:28.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.440+0000 7f7a77f12740 1 --2- 172.21.15.70:0/778195401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e61c2b0a0 0x562e620059d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.440+0000 7f7a77f12740 1 -- 172.21.15.70:0/778195401 >> 172.21.15.70:0/778195401 conn(0x562e61c48350 msgr2=0x562e61ffd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:28.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.440+0000 7f7a77f12740 1 -- 172.21.15.70:0/778195401 shutdown_connections 2024-09-21T05:49:28.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.440+0000 7f7a77f12740 1 -- 172.21.15.70:0/778195401 wait complete. 2024-09-21T05:49:28.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.440+0000 7f7a77f12740 20 client.15453 trim_cache size 0 max 16384 2024-09-21T05:49:28.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.458+0000 7f7a77f12740 1 Processor -- start 2024-09-21T05:49:28.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.458+0000 7f7a77f12740 1 -- start start 2024-09-21T05:49:28.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.458+0000 7f7a77f12740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562e61c2b0a0 0x562e62016e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:28.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.458+0000 7f7a77f12740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e61c33280 0x562e62000020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:28.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.458+0000 7f7a77f12740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e61c53f60 0x562e62011910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:28.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.458+0000 7f7a77f12740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562e62015f30 con 0x562e61c33280 2024-09-21T05:49:28.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.458+0000 7f7a77f12740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562e62016600 con 0x562e61c2b0a0 2024-09-21T05:49:28.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.458+0000 7f7a77f12740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x562e62016cd0 con 0x562e61c53f60 2024-09-21T05:49:28.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.459+0000 7f7a63fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e61c33280 0x562e62000020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:28.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.459+0000 7f7a63fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e61c33280 0x562e62000020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56316/0 (socket says 172.21.15.70:56316) 2024-09-21T05:49:28.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.459+0000 7f7a63fff640 1 -- 172.21.15.70:0/2511838943 learned_addr learned my addr 172.21.15.70:0/2511838943 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:28.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.459+0000 7f7a6b7fe640 1 --2- 172.21.15.70:0/2511838943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e61c53f60 0x562e62011910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:28.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.459+0000 7f7a6affd640 1 --2- 172.21.15.70:0/2511838943 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562e61c2b0a0 0x562e62016e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:28.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.459+0000 7f7a63fff640 1 -- 172.21.15.70:0/2511838943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e61c53f60 msgr2=0x562e62011910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:28.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.459+0000 7f7a63fff640 1 --2- 172.21.15.70:0/2511838943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e61c53f60 0x562e62011910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.459+0000 7f7a63fff640 1 -- 172.21.15.70:0/2511838943 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562e61c2b0a0 msgr2=0x562e62016e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:28.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.459+0000 7f7a63fff640 1 --2- 172.21.15.70:0/2511838943 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562e61c2b0a0 0x562e62016e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.459+0000 7f7a63fff640 1 -- 172.21.15.70:0/2511838943 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e61ffc1f0 con 0x562e61c33280 2024-09-21T05:49:28.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.459+0000 7f7a6affd640 1 --2- 172.21.15.70:0/2511838943 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562e61c2b0a0 0x562e62016e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:49:28.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.459+0000 7f7a6b7fe640 1 --2- 172.21.15.70:0/2511838943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e61c53f60 0x562e62011910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:28.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.459+0000 7f7a63fff640 1 --2- 172.21.15.70:0/2511838943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e61c33280 0x562e62000020 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7a540ace90 tx=0x7f7a540e4740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf96c227870b0e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:28.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.459+0000 7f7a617fa640 1 -- 172.21.15.70:0/2511838943 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a54021040 con 0x562e61c33280 2024-09-21T05:49:28.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.459+0000 7f7a617fa640 1 -- 172.21.15.70:0/2511838943 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f7a540aca10 con 0x562e61c33280 2024-09-21T05:49:28.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.459+0000 7f7a617fa640 1 -- 172.21.15.70:0/2511838943 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a540e9110 con 0x562e61c33280 2024-09-21T05:49:28.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.460+0000 7f7a77f12740 1 -- 172.21.15.70:0/2511838943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e61c33280 msgr2=0x562e62000020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:28.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.460+0000 7f7a77f12740 1 --2- 172.21.15.70:0/2511838943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e61c33280 0x562e62000020 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7a540ace90 tx=0x7f7a540e4740 comp rx=0 tx=0).stop 2024-09-21T05:49:28.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.460+0000 7f7a77f12740 1 -- 172.21.15.70:0/2511838943 shutdown_connections 2024-09-21T05:49:28.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.460+0000 7f7a77f12740 1 --2- 172.21.15.70:0/2511838943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e61c53f60 0x562e62011910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.460+0000 7f7a77f12740 1 --2- 172.21.15.70:0/2511838943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e61c33280 0x562e62000020 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.460+0000 7f7a77f12740 1 --2- 172.21.15.70:0/2511838943 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562e61c2b0a0 0x562e62016e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.460+0000 7f7a77f12740 1 -- 172.21.15.70:0/2511838943 >> 172.21.15.70:0/2511838943 conn(0x562e61c48350 msgr2=0x562e62000980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:28.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.460+0000 7f7a77f12740 1 -- 172.21.15.70:0/2511838943 shutdown_connections 2024-09-21T05:49:28.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.460+0000 7f7a77f12740 1 -- 172.21.15.70:0/2511838943 wait complete. 2024-09-21T05:49:28.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.460+0000 7f7a77f12740 1 -- start start 2024-09-21T05:49:28.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.461+0000 7f7a77f12740 1 Processor -- start 2024-09-21T05:49:28.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.461+0000 7f7a77f12740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e61c2b0a0 0x562e62020710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:28.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.461+0000 7f7a77f12740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e61c33280 0x562e62019c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:28.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.461+0000 7f7a77f12740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562e61c53f60 0x562e6201a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:28.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.461+0000 7f7a77f12740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562e62017a70 con 0x562e61c33280 2024-09-21T05:49:28.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.461+0000 7f7a77f12740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562e620173a0 con 0x562e61c53f60 2024-09-21T05:49:28.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.461+0000 7f7a77f12740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x562e62018140 con 0x562e61c2b0a0 2024-09-21T05:49:28.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.461+0000 7f7a77f12740 10 client.0 _ll_register_callbacks cb 0x7f7a640096a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:49:28.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.461+0000 7f7a63fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e61c33280 0x562e62019c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:28.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.461+0000 7f7a63fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e61c33280 0x562e62019c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56328/0 (socket says 172.21.15.70:56328) 2024-09-21T05:49:28.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.461+0000 7f7a63fff640 1 -- 172.21.15.70:0/1059712041 learned_addr learned my addr 172.21.15.70:0/1059712041 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:28.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.461+0000 7f7a6affd640 1 --2- 172.21.15.70:0/1059712041 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e61c2b0a0 0x562e62020710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:28.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.461+0000 7f7a6b7fe640 1 --2- 172.21.15.70:0/1059712041 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562e61c53f60 0x562e6201a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:28.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.462+0000 7f7a63fff640 1 -- 172.21.15.70:0/1059712041 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e61c2b0a0 msgr2=0x562e62020710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:28.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.462+0000 7f7a63fff640 1 --2- 172.21.15.70:0/1059712041 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e61c2b0a0 0x562e62020710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.462+0000 7f7a63fff640 1 -- 172.21.15.70:0/1059712041 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562e61c53f60 msgr2=0x562e6201a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:28.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.462+0000 7f7a63fff640 1 --2- 172.21.15.70:0/1059712041 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562e61c53f60 0x562e6201a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.462+0000 7f7a63fff640 1 -- 172.21.15.70:0/1059712041 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e6201a970 con 0x562e61c33280 2024-09-21T05:49:28.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.462+0000 7f7a6affd640 1 --2- 172.21.15.70:0/1059712041 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e61c2b0a0 0x562e62020710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:28.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.462+0000 7f7a63fff640 1 --2- 172.21.15.70:0/1059712041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e61c33280 0x562e62019c10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7a540e48c0 tx=0x7f7a540e7480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de4ad9620ee3b27b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:28.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.462+0000 7f7a4affd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:49:28.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.462+0000 7f7a4affd640 1 -- 172.21.15.70:0/1059712041 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a54021070 con 0x562e61c33280 2024-09-21T05:49:28.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.462+0000 7f7a4affd640 1 -- 172.21.15.70:0/1059712041 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f7a540ac360 con 0x562e61c33280 2024-09-21T05:49:28.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.462+0000 7f7a77f12740 1 -- 172.21.15.70:0/1059712041 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a540aca10 con 0x562e61c33280 2024-09-21T05:49:28.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.462+0000 7f7a4affd640 1 -- 172.21.15.70:0/1059712041 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7a540ad600 con 0x562e61c33280 2024-09-21T05:49:28.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.462+0000 7f7a77f12740 10 client.15459 fetch_fsmap learned FSMap version 27 2024-09-21T05:49:28.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.462+0000 7f7a77f12740 1 -- 172.21.15.70:0/1059712041 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562e620830c0 con 0x562e61c33280 2024-09-21T05:49:28.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.462+0000 7f7a4affd640 1 -- 172.21.15.70:0/1059712041 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f7a540c6080 con 0x562e61c33280 2024-09-21T05:49:28.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.462+0000 7f7a4affd640 1 -- 172.21.15.70:0/1059712041 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f7a540e9110 con 0x562e61c33280 2024-09-21T05:49:28.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.463+0000 7f7a77f12740 10 client.15459 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T05:49:28.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.463+0000 7f7a77f12740 10 client.15459 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T05:49:28.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.463+0000 7f7a77f12740 20 client.15459 populate_metadata read hostname 'smithi070' 2024-09-21T05:49:28.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.463+0000 7f7a77f12740 1 --2- 172.21.15.70:0/1059712041 >> [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] conn(0x562e61be7c90 0x562e62086380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:28.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.463+0000 7f7a77f12740 4 client.15459 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T05:49:28.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.463+0000 7f7a77f12740 1 -- 172.21.15.70:0/1059712041 --> [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] -- command(tid 0: {"prefix": "status"}) -- 0x562e61f6f610 con 0x562e61be7c90 2024-09-21T05:49:28.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.463+0000 7f7a6affd640 1 --2- 172.21.15.70:0/1059712041 >> [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] conn(0x562e61be7c90 0x562e62086380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:28.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.463+0000 7f7a4affd640 10 client.15459 ms_handle_connect on v2:172.21.15.160:6838/1339744282 2024-09-21T05:49:28.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.463+0000 7f7a6affd640 1 --2- 172.21.15.70:0/1059712041 >> [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] conn(0x562e61be7c90 0x562e62086380 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=29b82e0d4ecfab8 server_cookie=fb2bedb115585d96 in_seq=0 out_seq=0 2024-09-21T05:49:28.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.463+0000 7f7a4affd640 1 -- 172.21.15.70:0/1059712041 <== mds.1 v2:172.21.15.160:6838/1339744282 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x562e61f6f610 con 0x562e61be7c90 2024-09-21T05:49:28.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.463+0000 7f7a4affd640 10 client.15459 handle_command_reply: tid=0 2024-09-21T05:49:28.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.463+0000 7f7a77f12740 1 client.15459 shutdown 2024-09-21T05:49:28.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.464+0000 7f7a77f12740 1 -- 172.21.15.70:0/1059712041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e61c33280 msgr2=0x562e62019c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:28.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.464+0000 7f7a77f12740 1 --2- 172.21.15.70:0/1059712041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e61c33280 0x562e62019c10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7a540e48c0 tx=0x7f7a540e7480 comp rx=0 tx=0).stop 2024-09-21T05:49:28.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.464+0000 7f7a77f12740 1 -- 172.21.15.70:0/1059712041 shutdown_connections 2024-09-21T05:49:28.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.464+0000 7f7a77f12740 1 --2- 172.21.15.70:0/1059712041 >> [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] conn(0x562e61be7c90 0x562e62086380 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.464+0000 7f7a4affd640 0 client.15459 ms_handle_reset on v2:172.21.15.160:6838/1339744282 2024-09-21T05:49:28.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.464+0000 7f7a77f12740 1 --2- 172.21.15.70:0/1059712041 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562e61c53f60 0x562e6201a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.464+0000 7f7a77f12740 1 --2- 172.21.15.70:0/1059712041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e61c33280 0x562e62019c10 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.464+0000 7f7a77f12740 1 --2- 172.21.15.70:0/1059712041 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e61c2b0a0 0x562e62020710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.464+0000 7f7a77f12740 1 -- 172.21.15.70:0/1059712041 >> 172.21.15.70:0/1059712041 conn(0x562e61c48350 msgr2=0x562e61ff7600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:28.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.464+0000 7f7a77f12740 1 -- 172.21.15.70:0/1059712041 shutdown_connections 2024-09-21T05:49:28.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.464+0000 7f7a77f12740 1 -- 172.21.15.70:0/1059712041 wait complete. 2024-09-21T05:49:28.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.464+0000 7f7a77f12740 20 client.15459 trim_cache size 0 max 16384 2024-09-21T05:49:28.473 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:49:28.473 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "96c6636e-77db-11ef-baf5-efdc52797490", 2024-09-21T05:49:28.473 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 1, 2024-09-21T05:49:28.473 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24628, 2024-09-21T05:49:28.473 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-21T05:49:28.473 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-21T05:49:28.474 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-21T05:49:28.474 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 101.955978499, 2024-09-21T05:49:28.474 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2024-09-21T05:49:28.474 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 85, 2024-09-21T05:49:28.474 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 83, 2024-09-21T05:49:28.474 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 160.80385168399999 2024-09-21T05:49:28.474 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:49:28.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.464+0000 7f7a7199e640 1 -- 172.21.15.70:0/3286700190 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7a580b6510 msgr2=0x7f7a580b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:28.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.465+0000 7f7a7199e640 1 --2- 172.21.15.70:0/3286700190 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7a580b6510 0x7f7a580b8a20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7a64005fd0 tx=0x7f7a64009800 comp rx=0 tx=0).stop 2024-09-21T05:49:28.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.465+0000 7f7a7199e640 1 -- 172.21.15.70:0/3286700190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a6c105280 msgr2=0x7f7a6c19aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:28.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.465+0000 7f7a7199e640 1 --2- 172.21.15.70:0/3286700190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a6c105280 0x7f7a6c19aa20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400d740 tx=0x7f7a5400dc00 comp rx=0 tx=0).stop 2024-09-21T05:49:28.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.465+0000 7f7a7199e640 1 -- 172.21.15.70:0/3286700190 shutdown_connections 2024-09-21T05:49:28.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.465+0000 7f7a7199e640 1 --2- 172.21.15.70:0/3286700190 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f7a580b6510 0x7f7a580b8a20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.465+0000 7f7a7199e640 1 --2- 172.21.15.70:0/3286700190 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a6c10de00 0x7f7a6c19fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.465+0000 7f7a7199e640 1 --2- 172.21.15.70:0/3286700190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a6c105280 0x7f7a6c19aa20 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.465+0000 7f7a7199e640 1 --2- 172.21.15.70:0/3286700190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a6c104850 0x7f7a6c19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:28.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.465+0000 7f7a7199e640 1 -- 172.21.15.70:0/3286700190 >> 172.21.15.70:0/3286700190 conn(0x7f7a6c079710 msgr2=0x7f7a6c1007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:28.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.465+0000 7f7a7199e640 1 -- 172.21.15.70:0/3286700190 shutdown_connections 2024-09-21T05:49:28.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:28.465+0000 7f7a7199e640 1 -- 172.21.15.70:0/3286700190 wait complete. 2024-09-21T05:49:29.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:28 smithi160 ceph-mon[33979]: pgmap v370: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T05:49:29.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:28 smithi070 ceph-mon[30981]: pgmap v370: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T05:49:29.284 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T05:49:29.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:28 smithi116 ceph-mon[34332]: pgmap v370: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T05:49:29.534 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:30.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.004+0000 7f1442b86640 1 -- 172.21.15.70:0/3561062738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f143c109e00 msgr2=0x7f143c110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:30.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.004+0000 7f1442b86640 1 --2- 172.21.15.70:0/3561062738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f143c109e00 0x7f143c110630 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1434009900 tx=0x7f143402a410 comp rx=0 tx=0).stop 2024-09-21T05:49:30.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.004+0000 7f1442b86640 1 -- 172.21.15.70:0/3561062738 shutdown_connections 2024-09-21T05:49:30.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.004+0000 7f1442b86640 1 --2- 172.21.15.70:0/3561062738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f143c109e00 0x7f143c110630 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.004+0000 7f1442b86640 1 --2- 172.21.15.70:0/3561062738 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f143c1094b0 0x7f143c1098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.004+0000 7f1442b86640 1 --2- 172.21.15.70:0/3561062738 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f143c103bc0 0x7f143c103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.004+0000 7f1442b86640 1 -- 172.21.15.70:0/3561062738 >> 172.21.15.70:0/3561062738 conn(0x7f143c07b910 msgr2=0x7f143c07bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:30.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.004+0000 7f1442b86640 1 -- 172.21.15.70:0/3561062738 shutdown_connections 2024-09-21T05:49:30.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.004+0000 7f1442b86640 1 -- 172.21.15.70:0/3561062738 wait complete. 2024-09-21T05:49:30.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.004+0000 7f1442b86640 1 Processor -- start 2024-09-21T05:49:30.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.004+0000 7f1442b86640 1 -- start start 2024-09-21T05:49:30.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.005+0000 7f1442b86640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f143c103bc0 0x7f143c19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:30.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.005+0000 7f1442b86640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f143c1094b0 0x7f143c19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:30.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.005+0000 7f1442b86640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f143c109e00 0x7f143c19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:30.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.005+0000 7f1442b86640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f143c113b10 con 0x7f143c109e00 2024-09-21T05:49:30.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.005+0000 7f1442b86640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f143c113990 con 0x7f143c103bc0 2024-09-21T05:49:30.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.005+0000 7f1442b86640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f143c113c90 con 0x7f143c1094b0 2024-09-21T05:49:30.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.005+0000 7f1441123640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f143c109e00 0x7f143c19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:30.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.005+0000 7f1441123640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f143c109e00 0x7f143c19fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56344/0 (socket says 172.21.15.70:56344) 2024-09-21T05:49:30.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.005+0000 7f1441123640 1 -- 172.21.15.70:0/2807676775 learned_addr learned my addr 172.21.15.70:0/2807676775 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:30.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.005+0000 7f143bfff640 1 --2- 172.21.15.70:0/2807676775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f143c1094b0 0x7f143c19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:30.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.005+0000 7f1440922640 1 --2- 172.21.15.70:0/2807676775 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f143c103bc0 0x7f143c19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:30.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.005+0000 7f1441123640 1 -- 172.21.15.70:0/2807676775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f143c1094b0 msgr2=0x7f143c19aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:30.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.005+0000 7f1441123640 1 --2- 172.21.15.70:0/2807676775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f143c1094b0 0x7f143c19aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.005+0000 7f1441123640 1 -- 172.21.15.70:0/2807676775 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f143c103bc0 msgr2=0x7f143c19a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:30.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.005+0000 7f1441123640 1 --2- 172.21.15.70:0/2807676775 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f143c103bc0 0x7f143c19a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.005+0000 7f1441123640 1 -- 172.21.15.70:0/2807676775 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f143c1a03f0 con 0x7f143c109e00 2024-09-21T05:49:30.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.005+0000 7f1441123640 1 --2- 172.21.15.70:0/2807676775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f143c109e00 0x7f143c19fcc0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1434009a20 tx=0x7f1434004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:30.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.005+0000 7f1439ffb640 1 -- 172.21.15.70:0/2807676775 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143403f070 con 0x7f143c109e00 2024-09-21T05:49:30.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.006+0000 7f1442b86640 1 -- 172.21.15.70:0/2807676775 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f143c1a0680 con 0x7f143c109e00 2024-09-21T05:49:30.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.006+0000 7f1439ffb640 1 -- 172.21.15.70:0/2807676775 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f1434003aa0 con 0x7f143c109e00 2024-09-21T05:49:30.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.006+0000 7f1439ffb640 1 -- 172.21.15.70:0/2807676775 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1434035070 con 0x7f143c109e00 2024-09-21T05:49:30.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.006+0000 7f1442b86640 1 -- 172.21.15.70:0/2807676775 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f143c1a6e40 con 0x7f143c109e00 2024-09-21T05:49:30.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.008+0000 7f14490fa740 1 Processor -- start 2024-09-21T05:49:30.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.009+0000 7f1439ffb640 1 -- 172.21.15.70:0/2807676775 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f1434042070 con 0x7f143c109e00 2024-09-21T05:49:30.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.009+0000 7f14490fa740 1 -- start start 2024-09-21T05:49:30.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.009+0000 7f14490fa740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55762b521f60 0x55762b8c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:30.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.009+0000 7f14490fa740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55762b4f90a0 0x55762b8c8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:30.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.009+0000 7f14490fa740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55762b501280 0x55762b8c8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:30.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.009+0000 7f14490fa740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55762b83fc10 con 0x55762b4f90a0 2024-09-21T05:49:30.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.009+0000 7f14490fa740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55762b82f040 con 0x55762b501280 2024-09-21T05:49:30.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.009+0000 7f14490fa740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55762b832e50 con 0x55762b521f60 2024-09-21T05:49:30.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.009+0000 7f1440922640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55762b4f90a0 0x55762b8c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:30.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.009+0000 7f1440922640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55762b4f90a0 0x55762b8c8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56354/0 (socket says 172.21.15.70:56354) 2024-09-21T05:49:30.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.009+0000 7f1440922640 1 -- 172.21.15.70:0/745649137 learned_addr learned my addr 172.21.15.70:0/745649137 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:30.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.009+0000 7f143bfff640 1 --2- 172.21.15.70:0/745649137 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55762b521f60 0x55762b8c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:30.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.009+0000 7f143bfff640 1 --2- 172.21.15.70:0/745649137 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55762b501280 0x55762b8c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:30.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.009+0000 7f1439ffb640 1 --2- 172.21.15.70:0/2807676775 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f14280b6510 0x7f14280b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:30.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.009+0000 7f1440922640 1 -- 172.21.15.70:0/745649137 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55762b521f60 msgr2=0x55762b8c7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:30.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.009+0000 7f1440922640 1 --2- 172.21.15.70:0/745649137 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55762b521f60 0x55762b8c7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.009+0000 7f1440922640 1 -- 172.21.15.70:0/745649137 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55762b501280 msgr2=0x55762b8c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:30.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.009+0000 7f1440922640 1 --2- 172.21.15.70:0/745649137 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55762b501280 0x55762b8c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.010+0000 7f1440922640 1 -- 172.21.15.70:0/745649137 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55762b58d540 con 0x55762b4f90a0 2024-09-21T05:49:30.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.010+0000 7f143bfff640 1 --2- 172.21.15.70:0/745649137 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55762b501280 0x55762b8c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:30.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.010+0000 7f1441123640 1 --2- 172.21.15.70:0/2807676775 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f14280b6510 0x7f14280b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:30.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.010+0000 7f1439ffb640 1 -- 172.21.15.70:0/2807676775 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f1434107fd0 con 0x7f143c109e00 2024-09-21T05:49:30.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.010+0000 7f1440922640 1 --2- 172.21.15.70:0/745649137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55762b4f90a0 0x55762b8c8440 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1424009fa0 tx=0x7f142400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f6b330ef01dd137 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:30.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.010+0000 7f1432ffd640 1 -- 172.21.15.70:0/745649137 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142401a070 con 0x55762b4f90a0 2024-09-21T05:49:30.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.010+0000 7f1432ffd640 1 -- 172.21.15.70:0/745649137 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f14240158c0 con 0x55762b4f90a0 2024-09-21T05:49:30.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.010+0000 7f1432ffd640 1 -- 172.21.15.70:0/745649137 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142400a8a0 con 0x55762b4f90a0 2024-09-21T05:49:30.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.011+0000 7f14490fa740 1 -- 172.21.15.70:0/745649137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55762b4f90a0 msgr2=0x55762b8c8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:30.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.011+0000 7f1441123640 1 --2- 172.21.15.70:0/2807676775 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f14280b6510 0x7f14280b8a20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f14340d1560 tx=0x7f1434099970 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:30.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.011+0000 7f14490fa740 1 --2- 172.21.15.70:0/745649137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55762b4f90a0 0x55762b8c8440 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1424009fa0 tx=0x7f142400c8b0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.011+0000 7f14490fa740 1 -- 172.21.15.70:0/745649137 shutdown_connections 2024-09-21T05:49:30.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.011+0000 7f14490fa740 1 --2- 172.21.15.70:0/745649137 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55762b501280 0x55762b8c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.011+0000 7f14490fa740 1 --2- 172.21.15.70:0/745649137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55762b4f90a0 0x55762b8c8440 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.011+0000 7f14490fa740 1 --2- 172.21.15.70:0/745649137 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55762b521f60 0x55762b8c7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.011+0000 7f14490fa740 1 -- 172.21.15.70:0/745649137 >> 172.21.15.70:0/745649137 conn(0x55762b516350 msgr2=0x55762b8c5df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:30.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.011+0000 7f14490fa740 1 -- 172.21.15.70:0/745649137 shutdown_connections 2024-09-21T05:49:30.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.011+0000 7f14490fa740 1 -- 172.21.15.70:0/745649137 wait complete. 2024-09-21T05:49:30.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.011+0000 7f14490fa740 1 -- start start 2024-09-21T05:49:30.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.011+0000 7f14490fa740 1 Processor -- start 2024-09-21T05:49:30.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.012+0000 7f14490fa740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55762b4f90a0 0x55762b8d3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:30.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.012+0000 7f14490fa740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55762b501280 0x55762b8d3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:30.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.012+0000 7f14490fa740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55762b521f60 0x55762b8dfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:30.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.012+0000 7f14490fa740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55762b6905f0 con 0x55762b4f90a0 2024-09-21T05:49:30.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.012+0000 7f14490fa740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55762b7ca010 con 0x55762b521f60 2024-09-21T05:49:30.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.012+0000 7f14490fa740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55762b8d66e0 con 0x55762b501280 2024-09-21T05:49:30.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.012+0000 7f14490fa740 10 client.0 _ll_register_callbacks cb 0x55762b829340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:49:30.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.012+0000 7f143bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55762b4f90a0 0x55762b8d3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:30.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.012+0000 7f143bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55762b4f90a0 0x55762b8d3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56356/0 (socket says 172.21.15.70:56356) 2024-09-21T05:49:30.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.012+0000 7f143bfff640 1 -- 172.21.15.70:0/301759047 learned_addr learned my addr 172.21.15.70:0/301759047 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:30.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.012+0000 7f1440922640 1 --2- 172.21.15.70:0/301759047 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55762b501280 0x55762b8d3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:30.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.012+0000 7f143bfff640 1 -- 172.21.15.70:0/301759047 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55762b501280 msgr2=0x55762b8d3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:30.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.012+0000 7f143bfff640 1 --2- 172.21.15.70:0/301759047 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55762b501280 0x55762b8d3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.012+0000 7f143bfff640 1 -- 172.21.15.70:0/301759047 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55762b521f60 msgr2=0x55762b8dfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:30.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.012+0000 7f143bfff640 1 --2- 172.21.15.70:0/301759047 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55762b521f60 0x55762b8dfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.012+0000 7f143bfff640 1 -- 172.21.15.70:0/301759047 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55762b7f7a00 con 0x55762b4f90a0 2024-09-21T05:49:30.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.012+0000 7f1440922640 1 --2- 172.21.15.70:0/301759047 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55762b501280 0x55762b8d3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:30.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.013+0000 7f143bfff640 1 --2- 172.21.15.70:0/301759047 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55762b4f90a0 0x55762b8d3aa0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f142c013e40 tx=0x7f142c00f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e33dc2c6ca899c1b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:30.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.013+0000 7f141bfff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:49:30.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.013+0000 7f141bfff640 1 -- 172.21.15.70:0/301759047 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142c01d440 con 0x55762b4f90a0 2024-09-21T05:49:30.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.013+0000 7f141bfff640 1 -- 172.21.15.70:0/301759047 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f142c010430 con 0x55762b4f90a0 2024-09-21T05:49:30.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.013+0000 7f14490fa740 1 -- 172.21.15.70:0/301759047 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14240158c0 con 0x55762b4f90a0 2024-09-21T05:49:30.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.013+0000 7f141bfff640 1 -- 172.21.15.70:0/301759047 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f142c010630 con 0x55762b4f90a0 2024-09-21T05:49:30.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.013+0000 7f14490fa740 10 client.15471 fetch_fsmap learned FSMap version 27 2024-09-21T05:49:30.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.013+0000 7f14490fa740 1 -- 172.21.15.70:0/301759047 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55762b8e2730 con 0x55762b4f90a0 2024-09-21T05:49:30.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.013+0000 7f141bfff640 1 -- 172.21.15.70:0/301759047 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f14240158c0 con 0x55762b4f90a0 2024-09-21T05:49:30.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.013+0000 7f141bfff640 1 -- 172.21.15.70:0/301759047 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f142c01b070 con 0x55762b4f90a0 2024-09-21T05:49:30.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.013+0000 7f14490fa740 10 client.15471 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T05:49:30.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.013+0000 7f14490fa740 10 client.15471 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T05:49:30.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.013+0000 7f14490fa740 20 client.15471 populate_metadata read hostname 'smithi070' 2024-09-21T05:49:30.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.013+0000 7f14490fa740 1 --2- 172.21.15.70:0/301759047 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55762b4e08e0 0x55762b8e6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:30.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.013+0000 7f14490fa740 4 client.15471 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:49:30.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.013+0000 7f14490fa740 1 -- 172.21.15.70:0/301759047 --> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55762b841b60 con 0x55762b4e08e0 2024-09-21T05:49:30.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.014+0000 7f1440922640 1 --2- 172.21.15.70:0/301759047 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55762b4e08e0 0x55762b8e6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:30.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.014+0000 7f141bfff640 10 client.15471 ms_handle_connect on v2:172.21.15.116:6838/3952175670 2024-09-21T05:49:30.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.014+0000 7f1440922640 1 --2- 172.21.15.70:0/301759047 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55762b4e08e0 0x55762b8e6200 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffeae1ef2b88405 server_cookie=7bf49d3e812e36f5 in_seq=0 out_seq=0 2024-09-21T05:49:30.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.015+0000 7f141bfff640 1 -- 172.21.15.70:0/301759047 <== mds.0 v2:172.21.15.116:6838/3952175670 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55762b841b60 con 0x55762b4e08e0 2024-09-21T05:49:30.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.015+0000 7f141bfff640 10 client.15471 handle_command_reply: tid=0 2024-09-21T05:49:30.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.015+0000 7f14490fa740 1 client.15471 shutdown 2024-09-21T05:49:30.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.015+0000 7f14490fa740 1 -- 172.21.15.70:0/301759047 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55762b4f90a0 msgr2=0x55762b8d3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:30.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.015+0000 7f14490fa740 1 --2- 172.21.15.70:0/301759047 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55762b4f90a0 0x55762b8d3aa0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f142c013e40 tx=0x7f142c00f7f0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.015+0000 7f14490fa740 1 -- 172.21.15.70:0/301759047 shutdown_connections 2024-09-21T05:49:30.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.015+0000 7f14490fa740 1 --2- 172.21.15.70:0/301759047 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55762b4e08e0 0x55762b8e6200 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.015+0000 7f14490fa740 1 --2- 172.21.15.70:0/301759047 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55762b501280 0x55762b8d3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.015+0000 7f14490fa740 1 --2- 172.21.15.70:0/301759047 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55762b521f60 0x55762b8dfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.015+0000 7f141bfff640 0 client.15471 ms_handle_reset on v2:172.21.15.116:6838/3952175670 2024-09-21T05:49:30.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.015+0000 7f14490fa740 1 --2- 172.21.15.70:0/301759047 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55762b4f90a0 0x55762b8d3aa0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.015+0000 7f14490fa740 1 -- 172.21.15.70:0/301759047 >> 172.21.15.70:0/301759047 conn(0x55762b516350 msgr2=0x55762b8cb090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:30.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.015+0000 7f14490fa740 1 -- 172.21.15.70:0/301759047 shutdown_connections 2024-09-21T05:49:30.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.015+0000 7f14490fa740 1 -- 172.21.15.70:0/301759047 wait complete. 2024-09-21T05:49:30.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.015+0000 7f14490fa740 20 client.15471 trim_cache size 0 max 16384 2024-09-21T05:49:30.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.033+0000 7f14490fa740 1 Processor -- start 2024-09-21T05:49:30.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.033+0000 7f14490fa740 1 -- start start 2024-09-21T05:49:30.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.034+0000 7f14490fa740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55762b4f90a0 0x55762b8d3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:30.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.034+0000 7f14490fa740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55762b501280 0x55762b8d3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:30.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.034+0000 7f14490fa740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55762b521f60 0x55762b8cea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:30.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.034+0000 7f14490fa740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55762b8e4540 con 0x55762b4f90a0 2024-09-21T05:49:30.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.034+0000 7f14490fa740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55762b8e4c10 con 0x55762b501280 2024-09-21T05:49:30.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.034+0000 7f14490fa740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55762b8e52e0 con 0x55762b521f60 2024-09-21T05:49:30.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.034+0000 7f143bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55762b4f90a0 0x55762b8d3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:30.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.034+0000 7f143bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55762b4f90a0 0x55762b8d3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56358/0 (socket says 172.21.15.70:56358) 2024-09-21T05:49:30.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.034+0000 7f143bfff640 1 -- 172.21.15.70:0/3037036308 learned_addr learned my addr 172.21.15.70:0/3037036308 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:30.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.034+0000 7f143bfff640 1 -- 172.21.15.70:0/3037036308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55762b521f60 msgr2=0x55762b8cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:30.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.034+0000 7f143bfff640 1 --2- 172.21.15.70:0/3037036308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55762b521f60 0x55762b8cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.034+0000 7f143bfff640 1 -- 172.21.15.70:0/3037036308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55762b501280 msgr2=0x55762b8d3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:30.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.034+0000 7f1440922640 1 --2- 172.21.15.70:0/3037036308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55762b501280 0x55762b8d3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:30.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.034+0000 7f143bfff640 1 --2- 172.21.15.70:0/3037036308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55762b501280 0x55762b8d3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.034+0000 7f143bfff640 1 -- 172.21.15.70:0/3037036308 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55762b8c0080 con 0x55762b4f90a0 2024-09-21T05:49:30.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.034+0000 7f1440922640 1 --2- 172.21.15.70:0/3037036308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55762b501280 0x55762b8d3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:49:30.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.034+0000 7f143bfff640 1 --2- 172.21.15.70:0/3037036308 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55762b4f90a0 0x55762b8d3a80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f142c00a6e0 tx=0x7f142c013a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e08f819c5b14cd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:30.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.034+0000 7f14327fc640 1 -- 172.21.15.70:0/3037036308 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142c030070 con 0x55762b4f90a0 2024-09-21T05:49:30.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.034+0000 7f14327fc640 1 -- 172.21.15.70:0/3037036308 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f142c005040 con 0x55762b4f90a0 2024-09-21T05:49:30.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.034+0000 7f14327fc640 1 -- 172.21.15.70:0/3037036308 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142c010bc0 con 0x55762b4f90a0 2024-09-21T05:49:30.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.035+0000 7f14490fa740 1 -- 172.21.15.70:0/3037036308 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55762b4f90a0 msgr2=0x55762b8d3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:30.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.035+0000 7f14490fa740 1 --2- 172.21.15.70:0/3037036308 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55762b4f90a0 0x55762b8d3a80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f142c00a6e0 tx=0x7f142c013a30 comp rx=0 tx=0).stop 2024-09-21T05:49:30.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.035+0000 7f14490fa740 1 -- 172.21.15.70:0/3037036308 shutdown_connections 2024-09-21T05:49:30.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.035+0000 7f14490fa740 1 --2- 172.21.15.70:0/3037036308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55762b521f60 0x55762b8cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.035+0000 7f14490fa740 1 --2- 172.21.15.70:0/3037036308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55762b501280 0x55762b8d3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.035+0000 7f14490fa740 1 --2- 172.21.15.70:0/3037036308 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55762b4f90a0 0x55762b8d3a80 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.035+0000 7f14490fa740 1 -- 172.21.15.70:0/3037036308 >> 172.21.15.70:0/3037036308 conn(0x55762b516350 msgr2=0x55762b8cdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:30.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.035+0000 7f14490fa740 1 -- 172.21.15.70:0/3037036308 shutdown_connections 2024-09-21T05:49:30.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.035+0000 7f14490fa740 1 -- 172.21.15.70:0/3037036308 wait complete. 2024-09-21T05:49:30.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.036+0000 7f14490fa740 1 -- start start 2024-09-21T05:49:30.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.036+0000 7f14490fa740 1 Processor -- start 2024-09-21T05:49:30.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.036+0000 7f14490fa740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55762b4f90a0 0x55762b8eeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:30.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.036+0000 7f14490fa740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55762b501280 0x55762b8e8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:30.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.036+0000 7f14490fa740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55762b521f60 0x55762b8e88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:30.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.036+0000 7f14490fa740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55762b8e6080 con 0x55762b521f60 2024-09-21T05:49:30.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.036+0000 7f14490fa740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55762b8e59b0 con 0x55762b501280 2024-09-21T05:49:30.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.036+0000 7f14490fa740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55762b8e6750 con 0x55762b4f90a0 2024-09-21T05:49:30.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.036+0000 7f14490fa740 10 client.0 _ll_register_callbacks cb 0x7f142c00ac50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:49:30.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.036+0000 7f143bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55762b521f60 0x55762b8e88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:30.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.036+0000 7f143bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55762b521f60 0x55762b8e88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56368/0 (socket says 172.21.15.70:56368) 2024-09-21T05:49:30.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.036+0000 7f143bfff640 1 -- 172.21.15.70:0/3677985856 learned_addr learned my addr 172.21.15.70:0/3677985856 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:30.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.037+0000 7f143bfff640 1 --2- 172.21.15.70:0/3677985856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55762b4f90a0 0x55762b8eeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:30.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.037+0000 7f1440922640 1 --2- 172.21.15.70:0/3677985856 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55762b501280 0x55762b8e8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:30.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.037+0000 7f143bfff640 1 -- 172.21.15.70:0/3677985856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55762b4f90a0 msgr2=0x55762b8eeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:30.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.037+0000 7f143bfff640 1 --2- 172.21.15.70:0/3677985856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55762b4f90a0 0x55762b8eeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.037+0000 7f143bfff640 1 -- 172.21.15.70:0/3677985856 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55762b501280 msgr2=0x55762b8e8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:30.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.037+0000 7f143bfff640 1 --2- 172.21.15.70:0/3677985856 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55762b501280 0x55762b8e8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.037+0000 7f143bfff640 1 -- 172.21.15.70:0/3677985856 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55762b8e9030 con 0x55762b521f60 2024-09-21T05:49:30.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.037+0000 7f143bfff640 1 --2- 172.21.15.70:0/3677985856 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55762b521f60 0x55762b8e88a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f142c010520 tx=0x7f142c013da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5815aca50d9db7a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:30.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.037+0000 7f141bfff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:49:30.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.037+0000 7f141bfff640 1 -- 172.21.15.70:0/3677985856 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142c030070 con 0x55762b521f60 2024-09-21T05:49:30.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.037+0000 7f141bfff640 1 -- 172.21.15.70:0/3677985856 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f142c0051f0 con 0x55762b521f60 2024-09-21T05:49:30.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.037+0000 7f14490fa740 1 -- 172.21.15.70:0/3677985856 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f142c005040 con 0x55762b521f60 2024-09-21T05:49:30.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.037+0000 7f141bfff640 1 -- 172.21.15.70:0/3677985856 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f142c005430 con 0x55762b521f60 2024-09-21T05:49:30.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.037+0000 7f14490fa740 10 client.15477 fetch_fsmap learned FSMap version 27 2024-09-21T05:49:30.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.037+0000 7f14490fa740 1 -- 172.21.15.70:0/3677985856 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55762b9516d0 con 0x55762b521f60 2024-09-21T05:49:30.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.038+0000 7f141bfff640 1 -- 172.21.15.70:0/3677985856 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f142c005040 con 0x55762b521f60 2024-09-21T05:49:30.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.038+0000 7f141bfff640 1 -- 172.21.15.70:0/3677985856 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f142c01b070 con 0x55762b521f60 2024-09-21T05:49:30.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.038+0000 7f14490fa740 10 client.15477 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T05:49:30.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.038+0000 7f14490fa740 10 client.15477 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T05:49:30.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.038+0000 7f14490fa740 20 client.15477 populate_metadata read hostname 'smithi070' 2024-09-21T05:49:30.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.038+0000 7f14490fa740 1 --2- 172.21.15.70:0/3677985856 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55762b4b5c90 0x55762b9549b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:30.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.038+0000 7f14490fa740 4 client.15477 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T05:49:30.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.038+0000 7f14490fa740 1 -- 172.21.15.70:0/3677985856 --> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] -- command(tid 0: {"prefix": "status"}) -- 0x55762b83d610 con 0x55762b4b5c90 2024-09-21T05:49:30.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.038+0000 7f1440922640 1 --2- 172.21.15.70:0/3677985856 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55762b4b5c90 0x55762b9549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:30.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.038+0000 7f1440922640 1 --2- 172.21.15.70:0/3677985856 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55762b4b5c90 0x55762b9549b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7939012b363f6d server_cookie=d3214d1f921ad2a9 in_seq=0 out_seq=0 2024-09-21T05:49:30.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.038+0000 7f141bfff640 10 client.15477 ms_handle_connect on v2:172.21.15.116:6838/3952175670 2024-09-21T05:49:30.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.039+0000 7f141bfff640 1 -- 172.21.15.70:0/3677985856 <== mds.0 v2:172.21.15.116:6838/3952175670 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55762b83d610 con 0x55762b4b5c90 2024-09-21T05:49:30.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.039+0000 7f141bfff640 10 client.15477 handle_command_reply: tid=0 2024-09-21T05:49:30.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.039+0000 7f14490fa740 1 client.15477 shutdown 2024-09-21T05:49:30.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.039+0000 7f14490fa740 1 -- 172.21.15.70:0/3677985856 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55762b521f60 msgr2=0x55762b8e88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:30.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.039+0000 7f14490fa740 1 --2- 172.21.15.70:0/3677985856 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55762b521f60 0x55762b8e88a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f142c010520 tx=0x7f142c013da0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.039+0000 7f14490fa740 1 -- 172.21.15.70:0/3677985856 shutdown_connections 2024-09-21T05:49:30.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.039+0000 7f14490fa740 1 --2- 172.21.15.70:0/3677985856 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55762b4b5c90 0x55762b9549b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.039+0000 7f14490fa740 1 --2- 172.21.15.70:0/3677985856 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55762b521f60 0x55762b8e88a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.039+0000 7f14490fa740 1 --2- 172.21.15.70:0/3677985856 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55762b501280 0x55762b8e8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.039+0000 7f141bfff640 0 client.15477 ms_handle_reset on v2:172.21.15.116:6838/3952175670 2024-09-21T05:49:30.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.039+0000 7f14490fa740 1 --2- 172.21.15.70:0/3677985856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55762b4f90a0 0x55762b8eeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.039+0000 7f14490fa740 1 -- 172.21.15.70:0/3677985856 >> 172.21.15.70:0/3677985856 conn(0x55762b516350 msgr2=0x55762b8cea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:30.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.039+0000 7f14490fa740 1 -- 172.21.15.70:0/3677985856 shutdown_connections 2024-09-21T05:49:30.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.039+0000 7f14490fa740 1 -- 172.21.15.70:0/3677985856 wait complete. 2024-09-21T05:49:30.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.039+0000 7f14490fa740 20 client.15477 trim_cache size 0 max 16384 2024-09-21T05:49:30.048 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:49:30.049 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "96c6636e-77db-11ef-baf5-efdc52797490", 2024-09-21T05:49:30.049 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 0, 2024-09-21T05:49:30.049 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24641, 2024-09-21T05:49:30.049 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-21T05:49:30.049 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-21T05:49:30.049 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-21T05:49:30.049 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 143.422579326, 2024-09-21T05:49:30.049 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2024-09-21T05:49:30.049 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 85, 2024-09-21T05:49:30.049 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 83, 2024-09-21T05:49:30.049 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 153.915274622 2024-09-21T05:49:30.049 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:49:30.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.040+0000 7f1442b86640 1 -- 172.21.15.70:0/2807676775 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f14280b6510 msgr2=0x7f14280b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:30.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.040+0000 7f1442b86640 1 --2- 172.21.15.70:0/2807676775 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f14280b6510 0x7f14280b8a20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f14340d1560 tx=0x7f1434099970 comp rx=0 tx=0).stop 2024-09-21T05:49:30.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.040+0000 7f1442b86640 1 -- 172.21.15.70:0/2807676775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f143c109e00 msgr2=0x7f143c19fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:30.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.040+0000 7f1442b86640 1 --2- 172.21.15.70:0/2807676775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f143c109e00 0x7f143c19fcc0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1434009a20 tx=0x7f1434004250 comp rx=0 tx=0).stop 2024-09-21T05:49:30.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.040+0000 7f1442b86640 1 -- 172.21.15.70:0/2807676775 shutdown_connections 2024-09-21T05:49:30.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.040+0000 7f1442b86640 1 --2- 172.21.15.70:0/2807676775 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f14280b6510 0x7f14280b8a20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.040+0000 7f1442b86640 1 --2- 172.21.15.70:0/2807676775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f143c1094b0 0x7f143c19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.040+0000 7f1442b86640 1 --2- 172.21.15.70:0/2807676775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f143c109e00 0x7f143c19fcc0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.040+0000 7f1442b86640 1 --2- 172.21.15.70:0/2807676775 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f143c103bc0 0x7f143c19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.040+0000 7f1442b86640 1 -- 172.21.15.70:0/2807676775 >> 172.21.15.70:0/2807676775 conn(0x7f143c07b910 msgr2=0x7f143c1074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:30.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.040+0000 7f1442b86640 1 -- 172.21.15.70:0/2807676775 shutdown_connections 2024-09-21T05:49:30.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:30.040+0000 7f1442b86640 1 -- 172.21.15.70:0/2807676775 wait complete. 2024-09-21T05:49:30.747 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-21T05:49:30.761 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-21T05:49:30.761 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-21T05:49:30.761 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-09-21T05:49:30.762 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T05:49:30.762 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T05:49:30.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:49:30.762 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2024-09-21T05:49:30.778 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-21T05:49:30.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:49:30.779 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T05:49:30.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:49:30.844 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link delete ceph-brx 2024-09-21T05:49:30.933 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-21T05:49:30.933 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-21T05:49:30.934 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T05:49:30.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:30 smithi070 ceph-mon[30981]: pgmap v371: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T05:49:31.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:30 smithi160 ceph-mon[33979]: pgmap v371: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T05:49:31.182 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:31.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:30 smithi116 ceph-mon[34332]: pgmap v371: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T05:49:31.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.662+0000 7fb3662ea640 1 -- 172.21.15.70:0/2629074744 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb360103b60 msgr2=0x7fb360103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:31.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.662+0000 7fb3662ea640 1 --2- 172.21.15.70:0/2629074744 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb360103b60 0x7fb360103f70 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb350009900 tx=0x7fb35002a410 comp rx=0 tx=0).stop 2024-09-21T05:49:31.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.662+0000 7fb3662ea640 1 -- 172.21.15.70:0/2629074744 shutdown_connections 2024-09-21T05:49:31.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.662+0000 7fb3662ea640 1 --2- 172.21.15.70:0/2629074744 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb360109df0 0x7fb360110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:31.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.662+0000 7fb3662ea640 1 --2- 172.21.15.70:0/2629074744 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3601094a0 0x7fb3601098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:31.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.662+0000 7fb3662ea640 1 --2- 172.21.15.70:0/2629074744 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb360103b60 0x7fb360103f70 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:31.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.662+0000 7fb3662ea640 1 -- 172.21.15.70:0/2629074744 >> 172.21.15.70:0/2629074744 conn(0x7fb36007b850 msgr2=0x7fb36007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:31.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.662+0000 7fb3662ea640 1 -- 172.21.15.70:0/2629074744 shutdown_connections 2024-09-21T05:49:31.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.662+0000 7fb3662ea640 1 -- 172.21.15.70:0/2629074744 wait complete. 2024-09-21T05:49:31.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.663+0000 7fb3662ea640 1 Processor -- start 2024-09-21T05:49:31.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.663+0000 7fb3662ea640 1 -- start start 2024-09-21T05:49:31.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.663+0000 7fb3662ea640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb360103b60 0x7fb36019a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:31.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.663+0000 7fb3662ea640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3601094a0 0x7fb36019aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:31.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.663+0000 7fb3662ea640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb360109df0 0x7fb36019fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:31.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.663+0000 7fb3662ea640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb360113ae0 con 0x7fb3601094a0 2024-09-21T05:49:31.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.663+0000 7fb3662ea640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb360113960 con 0x7fb360103b60 2024-09-21T05:49:31.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.663+0000 7fb3662ea640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb360113c60 con 0x7fb360109df0 2024-09-21T05:49:31.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.663+0000 7fb357fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3601094a0 0x7fb36019aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:31.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.663+0000 7fb357fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3601094a0 0x7fb36019aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48292/0 (socket says 172.21.15.70:48292) 2024-09-21T05:49:31.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.663+0000 7fb357fff640 1 -- 172.21.15.70:0/1510295091 learned_addr learned my addr 172.21.15.70:0/1510295091 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:31.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.663+0000 7fb35ffff640 1 --2- 172.21.15.70:0/1510295091 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb360103b60 0x7fb36019a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:31.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.664+0000 7fb357fff640 1 -- 172.21.15.70:0/1510295091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb360109df0 msgr2=0x7fb36019fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:31.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.664+0000 7fb357fff640 1 --2- 172.21.15.70:0/1510295091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb360109df0 0x7fb36019fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:31.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.664+0000 7fb357fff640 1 -- 172.21.15.70:0/1510295091 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb360103b60 msgr2=0x7fb36019a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:31.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.664+0000 7fb357fff640 1 --2- 172.21.15.70:0/1510295091 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb360103b60 0x7fb36019a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:31.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.664+0000 7fb357fff640 1 -- 172.21.15.70:0/1510295091 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3601a04a0 con 0x7fb3601094a0 2024-09-21T05:49:31.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.664+0000 7fb357fff640 1 --2- 172.21.15.70:0/1510295091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3601094a0 0x7fb36019aad0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb348006fd0 tx=0x7fb34800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:31.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.664+0000 7fb35dffb640 1 -- 172.21.15.70:0/1510295091 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb348011830 con 0x7fb3601094a0 2024-09-21T05:49:31.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.664+0000 7fb3662ea640 1 -- 172.21.15.70:0/1510295091 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3601a0790 con 0x7fb3601094a0 2024-09-21T05:49:31.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.664+0000 7fb35dffb640 1 -- 172.21.15.70:0/1510295091 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fb348016070 con 0x7fb3601094a0 2024-09-21T05:49:31.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.664+0000 7fb35dffb640 1 -- 172.21.15.70:0/1510295091 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb348010df0 con 0x7fb3601094a0 2024-09-21T05:49:31.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.664+0000 7fb3662ea640 1 -- 172.21.15.70:0/1510295091 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3601a6f70 con 0x7fb3601094a0 2024-09-21T05:49:31.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.665+0000 7fb3662ea640 1 -- 172.21.15.70:0/1510295091 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb360103f70 con 0x7fb3601094a0 2024-09-21T05:49:31.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.667+0000 7fb35dffb640 1 -- 172.21.15.70:0/1510295091 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fb3480119d0 con 0x7fb3601094a0 2024-09-21T05:49:31.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.667+0000 7fb35dffb640 1 --2- 172.21.15.70:0/1510295091 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb34c0b6510 0x7fb34c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:31.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.667+0000 7fb35ffff640 1 --2- 172.21.15.70:0/1510295091 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb34c0b6510 0x7fb34c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:31.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.668+0000 7fb35dffb640 1 -- 172.21.15.70:0/1510295091 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fb3480e7330 con 0x7fb3601094a0 2024-09-21T05:49:31.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.668+0000 7fb35ffff640 1 --2- 172.21.15.70:0/1510295091 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb34c0b6510 0x7fb34c0b8a20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb350005d90 tx=0x7fb350031ca0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:31.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.670+0000 7fb35dffb640 1 -- 172.21.15.70:0/1510295091 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb3480ad7d0 con 0x7fb3601094a0 2024-09-21T05:49:31.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.889+0000 7fb3662ea640 1 -- 172.21.15.70:0/1510295091 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb36019b660 con 0x7fb3601094a0 2024-09-21T05:49:31.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.890+0000 7fb35dffb640 1 -- 172.21.15.70:0/1510295091 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+88 (secure 0 0 0) 0x7fb36019b660 con 0x7fb3601094a0 2024-09-21T05:49:31.892 INFO:teuthology.orchestra.run.smithi070.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T05:49:31.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.892+0000 7fb3662ea640 1 -- 172.21.15.70:0/1510295091 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb34c0b6510 msgr2=0x7fb34c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:31.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.892+0000 7fb3662ea640 1 --2- 172.21.15.70:0/1510295091 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb34c0b6510 0x7fb34c0b8a20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb350005d90 tx=0x7fb350031ca0 comp rx=0 tx=0).stop 2024-09-21T05:49:31.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.892+0000 7fb3662ea640 1 -- 172.21.15.70:0/1510295091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3601094a0 msgr2=0x7fb36019aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:31.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.892+0000 7fb3662ea640 1 --2- 172.21.15.70:0/1510295091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3601094a0 0x7fb36019aad0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb348006fd0 tx=0x7fb34800b8e0 comp rx=0 tx=0).stop 2024-09-21T05:49:31.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.892+0000 7fb3662ea640 1 -- 172.21.15.70:0/1510295091 shutdown_connections 2024-09-21T05:49:31.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.892+0000 7fb3662ea640 1 --2- 172.21.15.70:0/1510295091 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb34c0b6510 0x7fb34c0b8a20 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:31.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.892+0000 7fb3662ea640 1 --2- 172.21.15.70:0/1510295091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb360109df0 0x7fb36019fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.892+0000 7fb3662ea640 1 --2- 172.21.15.70:0/1510295091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3601094a0 0x7fb36019aad0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.892+0000 7fb3662ea640 1 --2- 172.21.15.70:0/1510295091 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb360103b60 0x7fb36019a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.892+0000 7fb3662ea640 1 -- 172.21.15.70:0/1510295091 >> 172.21.15.70:0/1510295091 conn(0x7fb36007b850 msgr2=0x7fb360107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.892+0000 7fb3662ea640 1 -- 172.21.15.70:0/1510295091 shutdown_connections 2024-09-21T05:49:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:31.892+0000 7fb3662ea640 1 -- 172.21.15.70:0/1510295091 wait complete. 2024-09-21T05:49:32.581 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T05:49:32.581 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T05:49:32.581 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi070.front.sepia.ceph.com 2024-09-21T05:49:32.581 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T05:49:32.581 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T05:49:32.582 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T05:49:32.582 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T05:49:32.582 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T05:49:32.582 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T05:49:32.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:49:32.582 DEBUG:teuthology.orchestra.run.smithi070:> ip addr 2024-09-21T05:49:32.598 INFO:teuthology.orchestra.run.smithi070.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T05:49:32.599 INFO:teuthology.orchestra.run.smithi070.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T05:49:32.599 INFO:teuthology.orchestra.run.smithi070.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T05:49:32.599 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-21T05:49:32.599 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 ::1/128 scope host 2024-09-21T05:49:32.599 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-21T05:49:32.599 INFO:teuthology.orchestra.run.smithi070.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T05:49:32.599 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b2 brd ff:ff:ff:ff:ff:ff 2024-09-21T05:49:32.599 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f0 2024-09-21T05:49:32.599 INFO:teuthology.orchestra.run.smithi070.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T05:49:32.599 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b3 brd ff:ff:ff:ff:ff:ff 2024-09-21T05:49:32.599 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f1 2024-09-21T05:49:32.599 INFO:teuthology.orchestra.run.smithi070.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T05:49:32.600 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e6 brd ff:ff:ff:ff:ff:ff 2024-09-21T05:49:32.600 INFO:teuthology.orchestra.run.smithi070.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T05:49:32.600 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e7 brd ff:ff:ff:ff:ff:ff 2024-09-21T05:49:32.600 INFO:teuthology.orchestra.run.smithi070.stdout: inet 172.21.15.70/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T05:49:32.600 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft 42122sec preferred_lft 42122sec 2024-09-21T05:49:32.600 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::ec4:7aff:fe8f:d3e7/64 scope link noprefixroute 2024-09-21T05:49:32.600 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-21T05:49:32.600 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T05:49:32.600 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T05:49:32.600 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-21T05:49:32.600 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link add name ceph-brx type bridge 2024-09-21T05:49:32.600 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip addr flush dev ceph-brx 2024-09-21T05:49:32.601 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set ceph-brx up 2024-09-21T05:49:32.601 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T05:49:32.601 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-21T05:49:32.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T05:49:32.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:49:32.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:49:32.739 DEBUG:teuthology.orchestra.run.smithi070:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T05:49:32.763 INFO:teuthology.orchestra.run.smithi070.stdout:1 2024-09-21T05:49:32.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:49:32.765 DEBUG:teuthology.orchestra.run.smithi070:> route 2024-09-21T05:49:32.823 INFO:teuthology.orchestra.run.smithi070.stdout:Kernel IP routing table 2024-09-21T05:49:32.823 INFO:teuthology.orchestra.run.smithi070.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T05:49:32.823 INFO:teuthology.orchestra.run.smithi070.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T05:49:32.823 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T05:49:32.823 INFO:teuthology.orchestra.run.smithi070.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T05:49:32.824 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T05:49:32.824 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-21T05:49:32.824 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T05:49:32.824 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T05:49:32.824 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T05:49:32.824 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-21T05:49:32.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T05:49:32.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:49:32.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:49:32.951 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2024-09-21T05:49:32.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:49:32.967 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list-id 2024-09-21T05:49:33.022 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T05:49:33.022 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-21T05:49:33.022 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T05:49:33.022 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T05:49:33.022 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-21T05:49:33.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T05:49:33.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:49:33.139 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T05:49:33.139 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T05:49:33.139 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-21T05:49:33.139 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T05:49:33.139 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T05:49:33.139 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T05:49:33.139 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T05:49:33.139 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T05:49:33.139 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-21T05:49:33.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:32 smithi160 ceph-mon[33979]: pgmap v372: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T05:49:33.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:32 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1510295091' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T05:49:33.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T05:49:33.195 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:32 smithi070 ceph-mon[30981]: pgmap v372: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T05:49:33.195 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:32 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1510295091' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T05:49:33.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:49:33.251 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T05:49:33.251 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-21T05:49:33.251 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set brx.0 up 2024-09-21T05:49:33.252 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T05:49:33.252 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-21T05:49:33.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T05:49:33.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:32 smithi116 ceph-mon[34332]: pgmap v372: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T05:49:33.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:32 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1510295091' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T05:49:33.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:49:33.327 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-09-21T05:49:33.327 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T05:49:33.327 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T05:49:33.342 INFO:teuthology.orchestra.run.smithi070.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T05:49:33.342 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T05:49:33.342 DEBUG:teuthology.orchestra.run.smithi070:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T05:49:33.397 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2024-09-21T05:49:33.462 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T05:49:33.519 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2024-09-21T05:49:33.519 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2024-09-21T05:49:33.519 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2024-09-21T05:49:33.519 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2024-09-21T05:49:33.519 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2024-09-21T05:49:33.519 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2024-09-21T05:49:33.520 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2024-09-21T05:49:33.520 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2024-09-21T05:49:33.520 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2024-09-21T05:49:33.520 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2024-09-21T05:49:33.520 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2024-09-21T05:49:33.520 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/selinux 2024-09-21T05:49:33.520 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T05:49:33.520 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2024-09-21T05:49:33.520 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2024-09-21T05:49:33.520 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2024-09-21T05:49:33.520 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2024-09-21T05:49:33.520 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2024-09-21T05:49:33.520 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2024-09-21T05:49:33.520 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T05:49:33.520 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T05:49:33.520 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T05:49:33.521 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T05:49:33.521 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2024-09-21T05:49:33.521 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2024-09-21T05:49:33.521 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay 2024-09-21T05:49:33.521 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/fad86dacc6d81e2357a9d7fbf94f31c7906a85205450ddb070b2817c1d7a3c72/merged 2024-09-21T05:49:33.521 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/112c94bd545f83607f3a398b0c853adfb16870b0d6bb5e01da09816b76ec01f1/merged 2024-09-21T05:49:33.521 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/0 2024-09-21T05:49:33.521 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T05:49:33.521 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/3158184ff0d6b360edd4efc8679c0d6388e07c805bad49a2044f743b33bc9efb/merged 2024-09-21T05:49:33.521 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/8dc3c8a75edc2930af19d1a338106e6b7e5d400a87e3a3f2a8a92bdd0b303d50/merged 2024-09-21T05:49:33.522 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/2e0400c7ff3f3fbfb1aebf6fdc32885b2ad1b6d971c63ad1a2b83a8635a43b98/merged 2024-09-21T05:49:33.522 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/f734a5f5a5d834c755088a682ffe36a348fb2c4371bf5b6f3cab5cd1178571b8/merged 2024-09-21T05:49:33.522 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/2f06906d75765921aaf9c4c634f9269b62a5d0a0b007e5a8d35e6565a148c04e/merged 2024-09-21T05:49:33.522 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/f29e6e8ce35c8597744acf71b29cb2d214c2b00c0811d3265f871088d506645d/merged 2024-09-21T05:49:33.522 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/6ef259590ae4201710d8bc97d43061915d15b22719b0dd82c5c2a93b437111ca/merged 2024-09-21T05:49:33.522 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/b13634ff1d7eb232a4dc652289147809920c7b2d2b16f7909befaafa0d523336/merged 2024-09-21T05:49:33.522 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2024-09-21T05:49:33.522 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T05:49:33.522 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T05:49:33.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:49:33.522 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2024-09-21T05:49:33.575 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-21T05:49:33.575 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/0289a4fa-d155-4080-a593-4fa6d2bff74b --client_fs=cephfs) 2024-09-21T05:49:33.618 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2024-09-21T05:49:33.642 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T05:49:33.700 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2024-09-21T05:49:33.700 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2024-09-21T05:49:33.700 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2024-09-21T05:49:33.700 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2024-09-21T05:49:33.701 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2024-09-21T05:49:33.701 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2024-09-21T05:49:33.701 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2024-09-21T05:49:33.701 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2024-09-21T05:49:33.701 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2024-09-21T05:49:33.701 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2024-09-21T05:49:33.701 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2024-09-21T05:49:33.701 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/selinux 2024-09-21T05:49:33.701 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T05:49:33.701 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2024-09-21T05:49:33.701 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2024-09-21T05:49:33.701 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2024-09-21T05:49:33.701 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2024-09-21T05:49:33.701 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2024-09-21T05:49:33.701 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2024-09-21T05:49:33.702 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T05:49:33.702 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T05:49:33.702 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T05:49:33.702 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T05:49:33.702 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2024-09-21T05:49:33.702 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2024-09-21T05:49:33.702 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay 2024-09-21T05:49:33.702 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/fad86dacc6d81e2357a9d7fbf94f31c7906a85205450ddb070b2817c1d7a3c72/merged 2024-09-21T05:49:33.702 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/112c94bd545f83607f3a398b0c853adfb16870b0d6bb5e01da09816b76ec01f1/merged 2024-09-21T05:49:33.702 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/0 2024-09-21T05:49:33.702 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T05:49:33.702 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/3158184ff0d6b360edd4efc8679c0d6388e07c805bad49a2044f743b33bc9efb/merged 2024-09-21T05:49:33.702 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/8dc3c8a75edc2930af19d1a338106e6b7e5d400a87e3a3f2a8a92bdd0b303d50/merged 2024-09-21T05:49:33.702 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/2e0400c7ff3f3fbfb1aebf6fdc32885b2ad1b6d971c63ad1a2b83a8635a43b98/merged 2024-09-21T05:49:33.702 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/f734a5f5a5d834c755088a682ffe36a348fb2c4371bf5b6f3cab5cd1178571b8/merged 2024-09-21T05:49:33.703 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/2f06906d75765921aaf9c4c634f9269b62a5d0a0b007e5a8d35e6565a148c04e/merged 2024-09-21T05:49:33.703 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/f29e6e8ce35c8597744acf71b29cb2d214c2b00c0811d3265f871088d506645d/merged 2024-09-21T05:49:33.703 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/6ef259590ae4201710d8bc97d43061915d15b22719b0dd82c5c2a93b437111ca/merged 2024-09-21T05:49:33.703 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/b13634ff1d7eb232a4dc652289147809920c7b2d2b16f7909befaafa0d523336/merged 2024-09-21T05:49:33.703 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2024-09-21T05:49:33.703 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T05:49:33.703 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T05:49:33.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:49:33.703 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2024-09-21T05:49:33.709 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:2024-09-21T05:49:33.707+0000 7f58b9482480 -1 init, newargv = 0x7f58a8004360 newargc=15 2024-09-21T05:49:33.709 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:ceph-fuse[85834]: starting ceph client 2024-09-21T05:49:33.731 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:ceph-fuse[85834]: starting fuse 2024-09-21T05:49:34.825 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2024-09-21T05:49:34.856 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T05:49:34.914 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2024-09-21T05:49:34.914 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2024-09-21T05:49:34.914 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2024-09-21T05:49:34.915 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2024-09-21T05:49:34.915 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2024-09-21T05:49:34.915 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2024-09-21T05:49:34.915 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2024-09-21T05:49:34.915 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2024-09-21T05:49:34.915 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2024-09-21T05:49:34.915 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2024-09-21T05:49:34.915 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2024-09-21T05:49:34.915 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/selinux 2024-09-21T05:49:34.915 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T05:49:34.915 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2024-09-21T05:49:34.915 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2024-09-21T05:49:34.915 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2024-09-21T05:49:34.915 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2024-09-21T05:49:34.915 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2024-09-21T05:49:34.916 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2024-09-21T05:49:34.916 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T05:49:34.916 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T05:49:34.916 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T05:49:34.916 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T05:49:34.916 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2024-09-21T05:49:34.916 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2024-09-21T05:49:34.916 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay 2024-09-21T05:49:34.916 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/fad86dacc6d81e2357a9d7fbf94f31c7906a85205450ddb070b2817c1d7a3c72/merged 2024-09-21T05:49:34.916 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/112c94bd545f83607f3a398b0c853adfb16870b0d6bb5e01da09816b76ec01f1/merged 2024-09-21T05:49:34.916 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/0 2024-09-21T05:49:34.916 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T05:49:34.916 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/3158184ff0d6b360edd4efc8679c0d6388e07c805bad49a2044f743b33bc9efb/merged 2024-09-21T05:49:34.916 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/8dc3c8a75edc2930af19d1a338106e6b7e5d400a87e3a3f2a8a92bdd0b303d50/merged 2024-09-21T05:49:34.916 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/2e0400c7ff3f3fbfb1aebf6fdc32885b2ad1b6d971c63ad1a2b83a8635a43b98/merged 2024-09-21T05:49:34.917 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/f734a5f5a5d834c755088a682ffe36a348fb2c4371bf5b6f3cab5cd1178571b8/merged 2024-09-21T05:49:34.917 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/2f06906d75765921aaf9c4c634f9269b62a5d0a0b007e5a8d35e6565a148c04e/merged 2024-09-21T05:49:34.917 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/f29e6e8ce35c8597744acf71b29cb2d214c2b00c0811d3265f871088d506645d/merged 2024-09-21T05:49:34.917 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/6ef259590ae4201710d8bc97d43061915d15b22719b0dd82c5c2a93b437111ca/merged 2024-09-21T05:49:34.917 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/b13634ff1d7eb232a4dc652289147809920c7b2d2b16f7909befaafa0d523336/merged 2024-09-21T05:49:34.917 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2024-09-21T05:49:34.917 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T05:49:34.917 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T05:49:34.917 INFO:teuthology.orchestra.run.smithi070.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-21T05:49:34.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:49:34.917 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2024-09-21T05:49:34.971 INFO:teuthology.orchestra.run.smithi070.stdout:120 2024-09-21T05:49:34.972 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-21T05:49:34.972 DEBUG:teuthology.orchestra.run.smithi070:> sudo stdin-killer -- python3 -c ' 2024-09-21T05:49:34.972 DEBUG:teuthology.orchestra.run.smithi070:> import glob 2024-09-21T05:49:34.972 DEBUG:teuthology.orchestra.run.smithi070:> import re 2024-09-21T05:49:34.972 DEBUG:teuthology.orchestra.run.smithi070:> import os 2024-09-21T05:49:34.972 DEBUG:teuthology.orchestra.run.smithi070:> import subprocess 2024-09-21T05:49:34.972 DEBUG:teuthology.orchestra.run.smithi070:> 2024-09-21T05:49:34.972 DEBUG:teuthology.orchestra.run.smithi070:> def _find_admin_socket(client_name): 2024-09-21T05:49:34.972 DEBUG:teuthology.orchestra.run.smithi070:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-21T05:49:34.972 DEBUG:teuthology.orchestra.run.smithi070:> files = glob.glob(asok_path) 2024-09-21T05:49:34.972 DEBUG:teuthology.orchestra.run.smithi070:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-21T05:49:34.973 DEBUG:teuthology.orchestra.run.smithi070:> 2024-09-21T05:49:34.973 DEBUG:teuthology.orchestra.run.smithi070:> # Given a non-glob path, it better be there 2024-09-21T05:49:34.973 DEBUG:teuthology.orchestra.run.smithi070:> if "*" not in asok_path: 2024-09-21T05:49:34.973 DEBUG:teuthology.orchestra.run.smithi070:> assert(len(files) == 1) 2024-09-21T05:49:34.973 DEBUG:teuthology.orchestra.run.smithi070:> return files[0] 2024-09-21T05:49:34.973 DEBUG:teuthology.orchestra.run.smithi070:> 2024-09-21T05:49:34.973 DEBUG:teuthology.orchestra.run.smithi070:> for f in files: 2024-09-21T05:49:34.973 DEBUG:teuthology.orchestra.run.smithi070:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-21T05:49:34.973 DEBUG:teuthology.orchestra.run.smithi070:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-21T05:49:34.973 DEBUG:teuthology.orchestra.run.smithi070:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-21T05:49:34.973 DEBUG:teuthology.orchestra.run.smithi070:> contents = proc_f.read() 2024-09-21T05:49:34.973 DEBUG:teuthology.orchestra.run.smithi070:> if mountpoint in contents: 2024-09-21T05:49:34.973 DEBUG:teuthology.orchestra.run.smithi070:> return f 2024-09-21T05:49:34.973 DEBUG:teuthology.orchestra.run.smithi070:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-21T05:49:34.974 DEBUG:teuthology.orchestra.run.smithi070:> 2024-09-21T05:49:34.974 DEBUG:teuthology.orchestra.run.smithi070:> print(_find_admin_socket("client.0")) 2024-09-21T05:49:34.974 DEBUG:teuthology.orchestra.run.smithi070:> ' 2024-09-21T05:49:35.092 INFO:teuthology.orchestra.run.smithi070.stdout:/var/run/ceph/ceph-client.0.85834.asok 2024-09-21T05:49:35.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:49:35.102 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:34 smithi070 ceph-mon[30981]: pgmap v373: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T05:49:35.103 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.85834.asok 2024-09-21T05:49:35.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:49:35.104 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.85834.asok status 2024-09-21T05:49:35.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:34 smithi160 ceph-mon[33979]: pgmap v373: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T05:49:35.244 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:49:35.244 INFO:teuthology.orchestra.run.smithi070.stdout: "metadata": { 2024-09-21T05:49:35.245 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_sha1": "1843221895adccfb3b692060251dd6a0183bc410", 2024-09-21T05:49:35.245 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T05:49:35.245 INFO:teuthology.orchestra.run.smithi070.stdout: "entity_id": "0", 2024-09-21T05:49:35.245 INFO:teuthology.orchestra.run.smithi070.stdout: "hostname": "smithi070", 2024-09-21T05:49:35.245 INFO:teuthology.orchestra.run.smithi070.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-21T05:49:35.245 INFO:teuthology.orchestra.run.smithi070.stdout: "pid": "85834", 2024-09-21T05:49:35.245 INFO:teuthology.orchestra.run.smithi070.stdout: "root": "/volumes/qa/sv_0/0289a4fa-d155-4080-a593-4fa6d2bff74b" 2024-09-21T05:49:35.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:49:35.245 INFO:teuthology.orchestra.run.smithi070.stdout: "dentry_count": 0, 2024-09-21T05:49:35.245 INFO:teuthology.orchestra.run.smithi070.stdout: "dentry_pinned_count": 0, 2024-09-21T05:49:35.245 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 15489, 2024-09-21T05:49:35.245 INFO:teuthology.orchestra.run.smithi070.stdout: "inst": { 2024-09-21T05:49:35.245 INFO:teuthology.orchestra.run.smithi070.stdout: "name": { 2024-09-21T05:49:35.246 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "client", 2024-09-21T05:49:35.246 INFO:teuthology.orchestra.run.smithi070.stdout: "num": 15489 2024-09-21T05:49:35.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:49:35.246 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": { 2024-09-21T05:49:35.246 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-21T05:49:35.246 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "192.168.0.1:0", 2024-09-21T05:49:35.246 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2602164282 2024-09-21T05:49:35.246 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:49:35.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:49:35.246 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": { 2024-09-21T05:49:35.246 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-21T05:49:35.246 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "192.168.0.1:0", 2024-09-21T05:49:35.246 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2602164282 2024-09-21T05:49:35.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:49:35.247 INFO:teuthology.orchestra.run.smithi070.stdout: "inst_str": "client.15489 192.168.0.1:0/2602164282", 2024-09-21T05:49:35.247 INFO:teuthology.orchestra.run.smithi070.stdout: "addr_str": "192.168.0.1:0/2602164282", 2024-09-21T05:49:35.247 INFO:teuthology.orchestra.run.smithi070.stdout: "inode_count": 5, 2024-09-21T05:49:35.247 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_epoch": 27, 2024-09-21T05:49:35.247 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_epoch": 85, 2024-09-21T05:49:35.247 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_epoch_barrier": 0, 2024-09-21T05:49:35.247 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklisted": false, 2024-09-21T05:49:35.247 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs" 2024-09-21T05:49:35.247 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:49:35.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:49:35.253 DEBUG:teuthology.orchestra.run.smithi070:> stat --file-system '--printf=%T 2024-09-21T05:49:35.253 DEBUG:teuthology.orchestra.run.smithi070:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-21T05:49:35.269 INFO:teuthology.orchestra.run.smithi070.stdout:fuseblk 2024-09-21T05:49:35.269 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-21T05:49:35.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:49:35.269 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T05:49:35.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:34 smithi116 ceph-mon[34332]: pgmap v373: 129 pgs: 129 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T05:49:35.336 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T05:49:35.349 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T05:49:35.349 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi070.front.sepia.ceph.com 2024-09-21T05:49:35.349 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-21T05:49:35.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.485+0000 7f38ffd00640 1 -- 172.21.15.70:0/559054126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38f8108300 msgr2=0x7f38f810a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:35.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.485+0000 7f38ffd00640 1 --2- 172.21.15.70:0/559054126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38f8108300 0x7f38f810a810 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f38f0009900 tx=0x7f38f002a410 comp rx=0 tx=0).stop 2024-09-21T05:49:35.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.485+0000 7f38ffd00640 1 -- 172.21.15.70:0/559054126 shutdown_connections 2024-09-21T05:49:35.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.485+0000 7f38ffd00640 1 --2- 172.21.15.70:0/559054126 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38f81056e0 0x7f38f8107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:35.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.485+0000 7f38ffd00640 1 --2- 172.21.15.70:0/559054126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38f8108300 0x7f38f810a810 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:35.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.485+0000 7f38ffd00640 1 --2- 172.21.15.70:0/559054126 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38f8102c60 0x7f38f81050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:35.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.485+0000 7f38ffd00640 1 -- 172.21.15.70:0/559054126 >> 172.21.15.70:0/559054126 conn(0x7f38f80fd6d0 msgr2=0x7f38f80ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:35.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.485+0000 7f38ffd00640 1 -- 172.21.15.70:0/559054126 shutdown_connections 2024-09-21T05:49:35.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.485+0000 7f38ffd00640 1 -- 172.21.15.70:0/559054126 wait complete. 2024-09-21T05:49:35.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.486+0000 7f38ffd00640 1 Processor -- start 2024-09-21T05:49:35.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.486+0000 7f38ffd00640 1 -- start start 2024-09-21T05:49:35.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.486+0000 7f38ffd00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38f8102c60 0x7f38f8102160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:35.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.486+0000 7f38ffd00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38f81056e0 0x7f38f819ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:35.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.486+0000 7f38ffd00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38f8108300 0x7f38f81a1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:35.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.486+0000 7f38ffd00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f38f810e1f0 con 0x7f38f8108300 2024-09-21T05:49:35.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.486+0000 7f38ffd00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f38f810e070 con 0x7f38f8102c60 2024-09-21T05:49:35.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.486+0000 7f38ffd00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f38f810e370 con 0x7f38f81056e0 2024-09-21T05:49:35.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.486+0000 7f38fe29d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38f8108300 0x7f38f81a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:35.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.486+0000 7f38fe29d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38f8108300 0x7f38f81a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48302/0 (socket says 172.21.15.70:48302) 2024-09-21T05:49:35.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.486+0000 7f38fe29d640 1 -- 172.21.15.70:0/1026474913 learned_addr learned my addr 172.21.15.70:0/1026474913 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:35.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.486+0000 7f38fd29b640 1 --2- 172.21.15.70:0/1026474913 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38f81056e0 0x7f38f819ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:35.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.486+0000 7f38fda9c640 1 --2- 172.21.15.70:0/1026474913 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38f8102c60 0x7f38f8102160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:35.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.486+0000 7f38fe29d640 1 -- 172.21.15.70:0/1026474913 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38f81056e0 msgr2=0x7f38f819ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:35.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.486+0000 7f38fe29d640 1 --2- 172.21.15.70:0/1026474913 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38f81056e0 0x7f38f819ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:35.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.486+0000 7f38fe29d640 1 -- 172.21.15.70:0/1026474913 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38f8102c60 msgr2=0x7f38f8102160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:35.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.486+0000 7f38fe29d640 1 --2- 172.21.15.70:0/1026474913 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38f8102c60 0x7f38f8102160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:35.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.486+0000 7f38fe29d640 1 -- 172.21.15.70:0/1026474913 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38f81a19a0 con 0x7f38f8108300 2024-09-21T05:49:35.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.486+0000 7f38fd29b640 1 --2- 172.21.15.70:0/1026474913 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38f81056e0 0x7f38f819ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:35.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.486+0000 7f38fe29d640 1 --2- 172.21.15.70:0/1026474913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38f8108300 0x7f38f81a1180 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f38f0005940 tx=0x7f38f00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:35.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.487+0000 7f38f6ffd640 1 -- 172.21.15.70:0/1026474913 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f003f030 con 0x7f38f8108300 2024-09-21T05:49:35.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.487+0000 7f38f6ffd640 1 -- 172.21.15.70:0/1026474913 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f38f0003cb0 con 0x7f38f8108300 2024-09-21T05:49:35.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.487+0000 7f38ffd00640 1 -- 172.21.15.70:0/1026474913 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38f81a1c30 con 0x7f38f8108300 2024-09-21T05:49:35.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.487+0000 7f38f6ffd640 1 -- 172.21.15.70:0/1026474913 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f0035070 con 0x7f38f8108300 2024-09-21T05:49:35.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.487+0000 7f38ffd00640 1 -- 172.21.15.70:0/1026474913 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38f81a2170 con 0x7f38f8108300 2024-09-21T05:49:35.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.488+0000 7f38ffd00640 1 -- 172.21.15.70:0/1026474913 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38f80ff1f0 con 0x7f38f8108300 2024-09-21T05:49:35.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.489+0000 7f38f6ffd640 1 -- 172.21.15.70:0/1026474913 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f38f0042030 con 0x7f38f8108300 2024-09-21T05:49:35.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.490+0000 7f38f6ffd640 1 --2- 172.21.15.70:0/1026474913 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f38e00b6590 0x7f38e00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:35.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.490+0000 7f38fda9c640 1 --2- 172.21.15.70:0/1026474913 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f38e00b6590 0x7f38e00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:35.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.490+0000 7f38f6ffd640 1 -- 172.21.15.70:0/1026474913 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f38f0107da0 con 0x7f38f8108300 2024-09-21T05:49:35.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.490+0000 7f38fda9c640 1 --2- 172.21.15.70:0/1026474913 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f38e00b6590 0x7f38e00b8aa0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f38e8005c40 tx=0x7f38e800a780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:35.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.494+0000 7f38f6ffd640 1 -- 172.21.15.70:0/1026474913 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f38f00ce240 con 0x7f38f8108300 2024-09-21T05:49:35.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.711+0000 7f38ffd00640 1 -- 172.21.15.70:0/1026474913 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f38f8063fc0 con 0x7f38f8108300 2024-09-21T05:49:35.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.892+0000 7f38f6ffd640 1 -- 172.21.15.70:0/1026474913 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v28) ==== 118+0+0 (secure 0 0 0) 0x7f38f00d2620 con 0x7f38f8108300 2024-09-21T05:49:35.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.895+0000 7f38ffd00640 1 -- 172.21.15.70:0/1026474913 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f38e00b6590 msgr2=0x7f38e00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:35.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.895+0000 7f38ffd00640 1 --2- 172.21.15.70:0/1026474913 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f38e00b6590 0x7f38e00b8aa0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f38e8005c40 tx=0x7f38e800a780 comp rx=0 tx=0).stop 2024-09-21T05:49:35.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.895+0000 7f38ffd00640 1 -- 172.21.15.70:0/1026474913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38f8108300 msgr2=0x7f38f81a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:35.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.895+0000 7f38ffd00640 1 --2- 172.21.15.70:0/1026474913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38f8108300 0x7f38f81a1180 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f38f0005940 tx=0x7f38f00042f0 comp rx=0 tx=0).stop 2024-09-21T05:49:35.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.895+0000 7f38ffd00640 1 -- 172.21.15.70:0/1026474913 shutdown_connections 2024-09-21T05:49:35.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.895+0000 7f38ffd00640 1 --2- 172.21.15.70:0/1026474913 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f38e00b6590 0x7f38e00b8aa0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:35.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.895+0000 7f38ffd00640 1 --2- 172.21.15.70:0/1026474913 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38f81056e0 0x7f38f819ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:35.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.895+0000 7f38ffd00640 1 --2- 172.21.15.70:0/1026474913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38f8108300 0x7f38f81a1180 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:35.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.895+0000 7f38ffd00640 1 --2- 172.21.15.70:0/1026474913 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38f8102c60 0x7f38f8102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:35.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.895+0000 7f38ffd00640 1 -- 172.21.15.70:0/1026474913 >> 172.21.15.70:0/1026474913 conn(0x7f38f80fd6d0 msgr2=0x7f38f8103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:35.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.895+0000 7f38ffd00640 1 -- 172.21.15.70:0/1026474913 shutdown_connections 2024-09-21T05:49:35.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:35.895+0000 7f38ffd00640 1 -- 172.21.15.70:0/1026474913 wait complete. 2024-09-21T05:49:35.909 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-21T05:49:36.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.018+0000 7f75745e6640 1 -- 172.21.15.70:0/4091004485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f756c101d50 msgr2=0x7f756c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:36.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.018+0000 7f75745e6640 1 --2- 172.21.15.70:0/4091004485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f756c101d50 0x7f756c1021c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7568009900 tx=0x7f756802a410 comp rx=0 tx=0).stop 2024-09-21T05:49:36.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.018+0000 7f75745e6640 1 -- 172.21.15.70:0/4091004485 shutdown_connections 2024-09-21T05:49:36.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.018+0000 7f75745e6640 1 --2- 172.21.15.70:0/4091004485 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f756c102dd0 0x7f756c1031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:36.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.018+0000 7f75745e6640 1 --2- 172.21.15.70:0/4091004485 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f756c103770 0x7f756c10a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:36.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.018+0000 7f75745e6640 1 --2- 172.21.15.70:0/4091004485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f756c101d50 0x7f756c1021c0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:36.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.018+0000 7f75745e6640 1 -- 172.21.15.70:0/4091004485 >> 172.21.15.70:0/4091004485 conn(0x7f756c0fd6d0 msgr2=0x7f756c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:36.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.018+0000 7f75745e6640 1 -- 172.21.15.70:0/4091004485 shutdown_connections 2024-09-21T05:49:36.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.018+0000 7f75745e6640 1 -- 172.21.15.70:0/4091004485 wait complete. 2024-09-21T05:49:36.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.019+0000 7f75745e6640 1 Processor -- start 2024-09-21T05:49:36.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.019+0000 7f75745e6640 1 -- start start 2024-09-21T05:49:36.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.019+0000 7f75745e6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f756c101d50 0x7f756c199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:36.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.019+0000 7f75745e6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f756c102dd0 0x7f756c19a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:36.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.019+0000 7f75745e6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f756c103770 0x7f756c19b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:36.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.019+0000 7f75745e6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f756c10d120 con 0x7f756c102dd0 2024-09-21T05:49:36.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.019+0000 7f75745e6640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f756c10cfa0 con 0x7f756c103770 2024-09-21T05:49:36.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.019+0000 7f75745e6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f756c10d2a0 con 0x7f756c101d50 2024-09-21T05:49:36.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.019+0000 7f7571b81640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f756c102dd0 0x7f756c19a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:36.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.019+0000 7f7571b81640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f756c102dd0 0x7f756c19a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48328/0 (socket says 172.21.15.70:48328) 2024-09-21T05:49:36.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.019+0000 7f7571b81640 1 -- 172.21.15.70:0/1504341764 learned_addr learned my addr 172.21.15.70:0/1504341764 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:36.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.019+0000 7f7572382640 1 --2- 172.21.15.70:0/1504341764 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f756c101d50 0x7f756c199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:36.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.019+0000 7f7572b83640 1 --2- 172.21.15.70:0/1504341764 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f756c103770 0x7f756c19b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:36.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.019+0000 7f7571b81640 1 -- 172.21.15.70:0/1504341764 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f756c101d50 msgr2=0x7f756c199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:36.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.019+0000 7f7571b81640 1 --2- 172.21.15.70:0/1504341764 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f756c101d50 0x7f756c199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:36.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.019+0000 7f7571b81640 1 -- 172.21.15.70:0/1504341764 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f756c103770 msgr2=0x7f756c19b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:36.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.019+0000 7f7571b81640 1 --2- 172.21.15.70:0/1504341764 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f756c103770 0x7f756c19b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:36.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.019+0000 7f7571b81640 1 -- 172.21.15.70:0/1504341764 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f756c19b9c0 con 0x7f756c102dd0 2024-09-21T05:49:36.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.020+0000 7f7571b81640 1 --2- 172.21.15.70:0/1504341764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f756c102dd0 0x7f756c19a660 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f755c00d770 tx=0x7f755c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:36.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.020+0000 7f75637fe640 1 -- 172.21.15.70:0/1504341764 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c017070 con 0x7f756c102dd0 2024-09-21T05:49:36.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.020+0000 7f75637fe640 1 -- 172.21.15.70:0/1504341764 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f755c0054d0 con 0x7f756c102dd0 2024-09-21T05:49:36.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.020+0000 7f75637fe640 1 -- 172.21.15.70:0/1504341764 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c004c80 con 0x7f756c102dd0 2024-09-21T05:49:36.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.020+0000 7f75745e6640 1 -- 172.21.15.70:0/1504341764 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f756c19bcb0 con 0x7f756c102dd0 2024-09-21T05:49:36.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.020+0000 7f75745e6640 1 -- 172.21.15.70:0/1504341764 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f756c1a23a0 con 0x7f756c102dd0 2024-09-21T05:49:36.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.021+0000 7f75745e6640 1 -- 172.21.15.70:0/1504341764 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f756c1a2570 con 0x7f756c102dd0 2024-09-21T05:49:36.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.023+0000 7f75637fe640 1 -- 172.21.15.70:0/1504341764 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f755c004e20 con 0x7f756c102dd0 2024-09-21T05:49:36.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.023+0000 7f75637fe640 1 --2- 172.21.15.70:0/1504341764 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f75580b6510 0x7f75580b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:36.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.023+0000 7f75637fe640 1 -- 172.21.15.70:0/1504341764 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f755c0e74f0 con 0x7f756c102dd0 2024-09-21T05:49:36.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.023+0000 7f7572382640 1 --2- 172.21.15.70:0/1504341764 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f75580b6510 0x7f75580b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:36.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.024+0000 7f7572382640 1 --2- 172.21.15.70:0/1504341764 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f75580b6510 0x7f75580b8a20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7568006010 tx=0x7f7568000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:36.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.026+0000 7f75637fe640 1 -- 172.21.15.70:0/1504341764 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f755c0b1d70 con 0x7f756c102dd0 2024-09-21T05:49:36.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:35 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1026474913' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-21T05:49:36.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.228+0000 7f75745e6640 1 -- 172.21.15.70:0/1504341764 --> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f756c109ac0 con 0x7f75580b6510 2024-09-21T05:49:36.237 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:35 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1026474913' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-21T05:49:36.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.248+0000 7f75637fe640 1 -- 172.21.15.70:0/1504341764 <== mgr.14150 v2:172.21.15.70:6800/1366013939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f756c109ac0 con 0x7f75580b6510 2024-09-21T05:49:36.250 INFO:teuthology.orchestra.run.smithi070.stdout:{} 2024-09-21T05:49:36.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.250+0000 7f75745e6640 1 -- 172.21.15.70:0/1504341764 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f75580b6510 msgr2=0x7f75580b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:36.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.250+0000 7f75745e6640 1 --2- 172.21.15.70:0/1504341764 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f75580b6510 0x7f75580b8a20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7568006010 tx=0x7f7568000bc0 comp rx=0 tx=0).stop 2024-09-21T05:49:36.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.250+0000 7f75745e6640 1 -- 172.21.15.70:0/1504341764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f756c102dd0 msgr2=0x7f756c19a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:36.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.250+0000 7f75745e6640 1 --2- 172.21.15.70:0/1504341764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f756c102dd0 0x7f756c19a660 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f755c00d770 tx=0x7f755c00dc30 comp rx=0 tx=0).stop 2024-09-21T05:49:36.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.250+0000 7f75745e6640 1 -- 172.21.15.70:0/1504341764 shutdown_connections 2024-09-21T05:49:36.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.250+0000 7f75745e6640 1 --2- 172.21.15.70:0/1504341764 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f75580b6510 0x7f75580b8a20 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:36.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.250+0000 7f75745e6640 1 --2- 172.21.15.70:0/1504341764 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f756c103770 0x7f756c19b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:36.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.250+0000 7f75745e6640 1 --2- 172.21.15.70:0/1504341764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f756c102dd0 0x7f756c19a660 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:36.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.250+0000 7f75745e6640 1 --2- 172.21.15.70:0/1504341764 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f756c101d50 0x7f756c199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:36.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.250+0000 7f75745e6640 1 -- 172.21.15.70:0/1504341764 >> 172.21.15.70:0/1504341764 conn(0x7f756c0fd6d0 msgr2=0x7f756c108300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:36.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.250+0000 7f75745e6640 1 -- 172.21.15.70:0/1504341764 shutdown_connections 2024-09-21T05:49:36.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:36.250+0000 7f75745e6640 1 -- 172.21.15.70:0/1504341764 wait complete. 2024-09-21T05:49:36.264 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-21T05:49:36.274 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-21T05:49:36.285 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T05:49:36.286 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T05:49:36.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:35 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1026474913' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-21T05:49:36.495 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:49:36 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T05:49:36.234+0000 7f996f119640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T05:49:36.495 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:49:36 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T05:49:36.234+0000 7f996f119640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T05:49:36.495 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:49:36 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T05:49:36.234+0000 7f996f119640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T05:49:36.495 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:49:36 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T05:49:36.234+0000 7f996f119640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T05:49:36.495 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:49:36 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T05:49:36.234+0000 7f996f119640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T05:49:36.531 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:36.942 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:36 smithi070 ceph-mon[30981]: pgmap v374: 129 pgs: 129 active+clean; 649 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-21T05:49:36.942 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:36 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1026474913' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-21T05:49:36.942 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:36 smithi070 ceph-mon[30981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:49:36.942 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:36 smithi070 ceph-mon[30981]: from='client.15501 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:37.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.030+0000 7fa08d415640 1 -- 172.21.15.70:0/2835560915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0881083e0 msgr2=0x7fa0881087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:37.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.030+0000 7fa08d415640 1 --2- 172.21.15.70:0/2835560915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0881083e0 0x7fa0881087f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa070009900 tx=0x7fa07002a410 comp rx=0 tx=0).stop 2024-09-21T05:49:37.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.030+0000 7fa08d415640 1 -- 172.21.15.70:0/2835560915 shutdown_connections 2024-09-21T05:49:37.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.030+0000 7fa08d415640 1 --2- 172.21.15.70:0/2835560915 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa088108d30 0x7fa08810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:37.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.030+0000 7fa08d415640 1 --2- 172.21.15.70:0/2835560915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0881083e0 0x7fa0881087f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:37.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.030+0000 7fa08d415640 1 --2- 172.21.15.70:0/2835560915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa088102aa0 0x7fa088102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:37.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.030+0000 7fa08d415640 1 -- 172.21.15.70:0/2835560915 >> 172.21.15.70:0/2835560915 conn(0x7fa0880797e0 msgr2=0x7fa088079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:37.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.030+0000 7fa08d415640 1 -- 172.21.15.70:0/2835560915 shutdown_connections 2024-09-21T05:49:37.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.030+0000 7fa08d415640 1 -- 172.21.15.70:0/2835560915 wait complete. 2024-09-21T05:49:37.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.031+0000 7fa08d415640 1 Processor -- start 2024-09-21T05:49:37.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.031+0000 7fa08d415640 1 -- start start 2024-09-21T05:49:37.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.032+0000 7fa08d415640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa088102aa0 0x7fa088199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:37.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.032+0000 7fa08d415640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0881083e0 0x7fa088199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:37.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.032+0000 7fa08d415640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa088108d30 0x7fa08819eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:37.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.032+0000 7fa08d415640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa088112970 con 0x7fa0881083e0 2024-09-21T05:49:37.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.032+0000 7fa08d415640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa0881127f0 con 0x7fa088108d30 2024-09-21T05:49:37.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.032+0000 7fa08d415640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa088112af0 con 0x7fa088102aa0 2024-09-21T05:49:37.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.032+0000 7fa0867fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0881083e0 0x7fa088199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:37.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.032+0000 7fa0867fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0881083e0 0x7fa088199900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48362/0 (socket says 172.21.15.70:48362) 2024-09-21T05:49:37.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.032+0000 7fa0867fc640 1 -- 172.21.15.70:0/3158002872 learned_addr learned my addr 172.21.15.70:0/3158002872 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:37.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.032+0000 7fa0877fe640 1 --2- 172.21.15.70:0/3158002872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa088108d30 0x7fa08819eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:37.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.032+0000 7fa086ffd640 1 --2- 172.21.15.70:0/3158002872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa088102aa0 0x7fa088199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:37.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.032+0000 7fa0867fc640 1 -- 172.21.15.70:0/3158002872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa088102aa0 msgr2=0x7fa088199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:37.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.032+0000 7fa0867fc640 1 --2- 172.21.15.70:0/3158002872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa088102aa0 0x7fa088199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:37.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.032+0000 7fa0867fc640 1 -- 172.21.15.70:0/3158002872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa088108d30 msgr2=0x7fa08819eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:37.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.032+0000 7fa0867fc640 1 --2- 172.21.15.70:0/3158002872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa088108d30 0x7fa08819eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:37.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.032+0000 7fa0867fc640 1 -- 172.21.15.70:0/3158002872 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa08819f2d0 con 0x7fa0881083e0 2024-09-21T05:49:37.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.032+0000 7fa086ffd640 1 --2- 172.21.15.70:0/3158002872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa088102aa0 0x7fa088199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:37.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.032+0000 7fa0867fc640 1 --2- 172.21.15.70:0/3158002872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0881083e0 0x7fa088199900 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa070004270 tx=0x7fa0700042a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:37.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.032+0000 7fa07ffff640 1 -- 172.21.15.70:0/3158002872 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07003f030 con 0x7fa0881083e0 2024-09-21T05:49:37.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.032+0000 7fa07ffff640 1 -- 172.21.15.70:0/3158002872 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fa0700044c0 con 0x7fa0881083e0 2024-09-21T05:49:37.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.032+0000 7fa07ffff640 1 -- 172.21.15.70:0/3158002872 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa070035070 con 0x7fa0881083e0 2024-09-21T05:49:37.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.032+0000 7fa08d415640 1 -- 172.21.15.70:0/3158002872 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa08819f560 con 0x7fa0881083e0 2024-09-21T05:49:37.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.033+0000 7fa08d415640 1 -- 172.21.15.70:0/3158002872 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0881a5d20 con 0x7fa0881083e0 2024-09-21T05:49:37.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.034+0000 7fa08d415640 1 -- 172.21.15.70:0/3158002872 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa088103d20 con 0x7fa0881083e0 2024-09-21T05:49:37.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.036+0000 7fa07ffff640 1 -- 172.21.15.70:0/3158002872 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fa070042030 con 0x7fa0881083e0 2024-09-21T05:49:37.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.036+0000 7fa07ffff640 1 --2- 172.21.15.70:0/3158002872 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa0740b6510 0x7fa0740b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:37.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.036+0000 7fa086ffd640 1 --2- 172.21.15.70:0/3158002872 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa0740b6510 0x7fa0740b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:37.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.037+0000 7fa07ffff640 1 -- 172.21.15.70:0/3158002872 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fa070107fd0 con 0x7fa0881083e0 2024-09-21T05:49:37.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.037+0000 7fa086ffd640 1 --2- 172.21.15.70:0/3158002872 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa0740b6510 0x7fa0740b8a20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa078005fd0 tx=0x7fa078009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:37.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.040+0000 7fa07ffff640 1 -- 172.21.15.70:0/3158002872 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa0700ce470 con 0x7fa0881083e0 2024-09-21T05:49:37.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:36 smithi160 ceph-mon[33979]: pgmap v374: 129 pgs: 129 active+clean; 649 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-21T05:49:37.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:36 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1026474913' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-21T05:49:37.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:36 smithi160 ceph-mon[33979]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:49:37.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:36 smithi160 ceph-mon[33979]: from='client.15501 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:37.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.214+0000 7fa08d415640 1 -- 172.21.15.70:0/3158002872 --> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa088063800 con 0x7fa0740b6510 2024-09-21T05:49:37.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.220+0000 7fa07ffff640 1 -- 172.21.15.70:0/3158002872 <== mgr.14150 v2:172.21.15.70:6800/1366013939 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340777 (secure 0 0 0) 0x7fa088063800 con 0x7fa0740b6510 2024-09-21T05:49:37.226 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:49:37.227 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-21T05:49:37.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.225+0000 7fa08d415640 1 -- 172.21.15.70:0/3158002872 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa0740b6510 msgr2=0x7fa0740b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:37.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.225+0000 7fa08d415640 1 --2- 172.21.15.70:0/3158002872 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa0740b6510 0x7fa0740b8a20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa078005fd0 tx=0x7fa078009520 comp rx=0 tx=0).stop 2024-09-21T05:49:37.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.225+0000 7fa08d415640 1 -- 172.21.15.70:0/3158002872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0881083e0 msgr2=0x7fa088199900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:37.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.225+0000 7fa08d415640 1 --2- 172.21.15.70:0/3158002872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0881083e0 0x7fa088199900 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa070004270 tx=0x7fa0700042a0 comp rx=0 tx=0).stop 2024-09-21T05:49:37.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.225+0000 7fa08d415640 1 -- 172.21.15.70:0/3158002872 shutdown_connections 2024-09-21T05:49:37.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.225+0000 7fa08d415640 1 --2- 172.21.15.70:0/3158002872 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fa0740b6510 0x7fa0740b8a20 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:37.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.225+0000 7fa08d415640 1 --2- 172.21.15.70:0/3158002872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa088108d30 0x7fa08819eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:37.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.225+0000 7fa08d415640 1 --2- 172.21.15.70:0/3158002872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0881083e0 0x7fa088199900 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:37.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.225+0000 7fa08d415640 1 --2- 172.21.15.70:0/3158002872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa088102aa0 0x7fa088199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:37.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.225+0000 7fa08d415640 1 -- 172.21.15.70:0/3158002872 >> 172.21.15.70:0/3158002872 conn(0x7fa0880797e0 msgr2=0x7fa088101450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:37.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.225+0000 7fa08d415640 1 -- 172.21.15.70:0/3158002872 shutdown_connections 2024-09-21T05:49:37.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:37.225+0000 7fa08d415640 1 -- 172.21.15.70:0/3158002872 wait complete. 2024-09-21T05:49:37.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:36 smithi116 ceph-mon[34332]: pgmap v374: 129 pgs: 129 active+clean; 649 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-21T05:49:37.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:36 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1026474913' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-21T05:49:37.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:36 smithi116 ceph-mon[34332]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:49:37.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:36 smithi116 ceph-mon[34332]: from='client.15501 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:37.910 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":374,"stamp":"2024-09-21T05:49:35.436723+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665003,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1135,"num_read_kb":675,"num_write":384,"num_write_kb":2305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":2952596,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":816,"ondisk_log_size":816,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":352576,"kb_used_data":11648,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124589248,"statfs":{"total":1151940427776,"available":1151579389952,"internally_reserved":0,"allocated":11927552,"data_stored":7837676,"data_compressed":461514,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19143,"internal_metadata":348894521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":986,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":57,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003641"},"pg_stats":[{"pgid":"2.1f","version":"83'13","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:30.722305+0000","last_change":"2024-09-21T05:47:03.620705+0000","last_active":"2024-09-21T05:49:30.722305+0000","last_peered":"2024-09-21T05:49:30.722305+0000","last_clean":"2024-09-21T05:49:30.722305+0000","last_became_active":"2024-09-21T05:47:03.620320+0000","last_became_peered":"2024-09-21T05:47:03.620320+0000","last_unstale":"2024-09-21T05:49:30.722305+0000","last_undegraded":"2024-09-21T05:49:30.722305+0000","last_fullsized":"2024-09-21T05:49:30.722305+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:31.684225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.610588+0000","last_change":"2024-09-21T05:47:05.637251+0000","last_active":"2024-09-21T05:49:07.610588+0000","last_peered":"2024-09-21T05:49:07.610588+0000","last_clean":"2024-09-21T05:49:07.610588+0000","last_became_active":"2024-09-21T05:47:05.636867+0000","last_became_peered":"2024-09-21T05:47:05.636867+0000","last_unstale":"2024-09-21T05:49:07.610588+0000","last_undegraded":"2024-09-21T05:49:07.610588+0000","last_fullsized":"2024-09-21T05:49:07.610588+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:08.538209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715529+0000","last_change":"2024-09-21T05:47:12.676224+0000","last_active":"2024-09-21T05:48:38.715529+0000","last_peered":"2024-09-21T05:48:38.715529+0000","last_clean":"2024-09-21T05:48:38.715529+0000","last_became_active":"2024-09-21T05:47:12.675565+0000","last_became_peered":"2024-09-21T05:47:12.675565+0000","last_unstale":"2024-09-21T05:48:38.715529+0000","last_undegraded":"2024-09-21T05:48:38.715529+0000","last_fullsized":"2024-09-21T05:48:38.715529+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:37.684953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285902+0000","last_change":"2024-09-21T05:47:03.670289+0000","last_active":"2024-09-21T05:48:39.285902+0000","last_peered":"2024-09-21T05:48:39.285902+0000","last_clean":"2024-09-21T05:48:39.285902+0000","last_became_active":"2024-09-21T05:47:03.669881+0000","last_became_peered":"2024-09-21T05:47:03.669881+0000","last_unstale":"2024-09-21T05:48:39.285902+0000","last_undegraded":"2024-09-21T05:48:39.285902+0000","last_fullsized":"2024-09-21T05:48:39.285902+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:12.597766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.641716+0000","last_change":"2024-09-21T05:47:05.640826+0000","last_active":"2024-09-21T05:49:07.641716+0000","last_peered":"2024-09-21T05:49:07.641716+0000","last_clean":"2024-09-21T05:49:07.641716+0000","last_became_active":"2024-09-21T05:47:05.640357+0000","last_became_peered":"2024-09-21T05:47:05.640357+0000","last_unstale":"2024-09-21T05:49:07.641716+0000","last_undegraded":"2024-09-21T05:49:07.641716+0000","last_fullsized":"2024-09-21T05:49:07.641716+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:16.434030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721134+0000","last_change":"2024-09-21T05:47:12.677260+0000","last_active":"2024-09-21T05:48:38.721134+0000","last_peered":"2024-09-21T05:48:38.721134+0000","last_clean":"2024-09-21T05:48:38.721134+0000","last_became_active":"2024-09-21T05:47:12.676599+0000","last_became_peered":"2024-09-21T05:47:12.676599+0000","last_unstale":"2024-09-21T05:48:38.721134+0000","last_undegraded":"2024-09-21T05:48:38.721134+0000","last_fullsized":"2024-09-21T05:48:38.721134+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:10.644801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.722446+0000","last_change":"2024-09-21T05:47:03.619903+0000","last_active":"2024-09-21T05:48:38.722446+0000","last_peered":"2024-09-21T05:48:38.722446+0000","last_clean":"2024-09-21T05:48:38.722446+0000","last_became_active":"2024-09-21T05:47:03.619476+0000","last_became_peered":"2024-09-21T05:47:03.619476+0000","last_unstale":"2024-09-21T05:48:38.722446+0000","last_undegraded":"2024-09-21T05:48:38.722446+0000","last_fullsized":"2024-09-21T05:48:38.722446+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:09.717552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.639586+0000","last_change":"2024-09-21T05:47:05.646017+0000","last_active":"2024-09-21T05:49:07.639586+0000","last_peered":"2024-09-21T05:49:07.639586+0000","last_clean":"2024-09-21T05:49:07.639586+0000","last_became_active":"2024-09-21T05:47:05.644118+0000","last_became_peered":"2024-09-21T05:47:05.644118+0000","last_unstale":"2024-09-21T05:49:07.639586+0000","last_undegraded":"2024-09-21T05:49:07.639586+0000","last_fullsized":"2024-09-21T05:49:07.639586+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:52.908664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721813+0000","last_change":"2024-09-21T05:47:12.677555+0000","last_active":"2024-09-21T05:48:38.721813+0000","last_peered":"2024-09-21T05:48:38.721813+0000","last_clean":"2024-09-21T05:48:38.721813+0000","last_became_active":"2024-09-21T05:47:12.676886+0000","last_became_peered":"2024-09-21T05:47:12.676886+0000","last_unstale":"2024-09-21T05:48:38.721813+0000","last_undegraded":"2024-09-21T05:48:38.721813+0000","last_fullsized":"2024-09-21T05:48:38.721813+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:10:24.516641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.723105+0000","last_change":"2024-09-21T05:47:03.621556+0000","last_active":"2024-09-21T05:48:38.723105+0000","last_peered":"2024-09-21T05:48:38.723105+0000","last_clean":"2024-09-21T05:48:38.723105+0000","last_became_active":"2024-09-21T05:47:03.621101+0000","last_became_peered":"2024-09-21T05:47:03.621101+0000","last_unstale":"2024-09-21T05:48:38.723105+0000","last_undegraded":"2024-09-21T05:48:38.723105+0000","last_fullsized":"2024-09-21T05:48:38.723105+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:39:23.639431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.636755+0000","last_change":"2024-09-21T05:47:05.646328+0000","last_active":"2024-09-21T05:49:07.636755+0000","last_peered":"2024-09-21T05:49:07.636755+0000","last_clean":"2024-09-21T05:49:07.636755+0000","last_became_active":"2024-09-21T05:47:05.645922+0000","last_became_peered":"2024-09-21T05:47:05.645922+0000","last_unstale":"2024-09-21T05:49:07.636755+0000","last_undegraded":"2024-09-21T05:49:07.636755+0000","last_fullsized":"2024-09-21T05:49:07.636755+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:43.801707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721553+0000","last_change":"2024-09-21T05:47:12.673555+0000","last_active":"2024-09-21T05:48:38.721553+0000","last_peered":"2024-09-21T05:48:38.721553+0000","last_clean":"2024-09-21T05:48:38.721553+0000","last_became_active":"2024-09-21T05:47:12.673065+0000","last_became_peered":"2024-09-21T05:47:12.673065+0000","last_unstale":"2024-09-21T05:48:38.721553+0000","last_undegraded":"2024-09-21T05:48:38.721553+0000","last_fullsized":"2024-09-21T05:48:38.721553+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:53.548779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.642240+0000","last_change":"2024-09-21T05:47:05.645376+0000","last_active":"2024-09-21T05:49:07.642240+0000","last_peered":"2024-09-21T05:49:07.642240+0000","last_clean":"2024-09-21T05:49:07.642240+0000","last_became_active":"2024-09-21T05:47:05.644800+0000","last_became_peered":"2024-09-21T05:47:05.644800+0000","last_unstale":"2024-09-21T05:49:07.642240+0000","last_undegraded":"2024-09-21T05:49:07.642240+0000","last_fullsized":"2024-09-21T05:49:07.642240+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:10.460407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720709+0000","last_change":"2024-09-21T05:47:03.619926+0000","last_active":"2024-09-21T05:48:38.720709+0000","last_peered":"2024-09-21T05:48:38.720709+0000","last_clean":"2024-09-21T05:48:38.720709+0000","last_became_active":"2024-09-21T05:47:03.619433+0000","last_became_peered":"2024-09-21T05:47:03.619433+0000","last_unstale":"2024-09-21T05:48:38.720709+0000","last_undegraded":"2024-09-21T05:48:38.720709+0000","last_fullsized":"2024-09-21T05:48:38.720709+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:33.792874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721980+0000","last_change":"2024-09-21T05:47:12.874200+0000","last_active":"2024-09-21T05:48:38.721980+0000","last_peered":"2024-09-21T05:48:38.721980+0000","last_clean":"2024-09-21T05:48:38.721980+0000","last_became_active":"2024-09-21T05:47:12.873563+0000","last_became_peered":"2024-09-21T05:47:12.873563+0000","last_unstale":"2024-09-21T05:48:38.721980+0000","last_undegraded":"2024-09-21T05:48:38.721980+0000","last_fullsized":"2024-09-21T05:48:38.721980+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:34.839934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.628678+0000","last_change":"2024-09-21T05:47:05.639033+0000","last_active":"2024-09-21T05:49:07.628678+0000","last_peered":"2024-09-21T05:49:07.628678+0000","last_clean":"2024-09-21T05:49:07.628678+0000","last_became_active":"2024-09-21T05:47:05.637433+0000","last_became_peered":"2024-09-21T05:47:05.637433+0000","last_unstale":"2024-09-21T05:49:07.628678+0000","last_undegraded":"2024-09-21T05:49:07.628678+0000","last_fullsized":"2024-09-21T05:49:07.628678+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:55.181025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"85'4","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:15.090942+0000","last_change":"2024-09-21T05:47:03.614460+0000","last_active":"2024-09-21T05:49:15.090942+0000","last_peered":"2024-09-21T05:49:15.090942+0000","last_clean":"2024-09-21T05:49:15.090942+0000","last_became_active":"2024-09-21T05:47:03.613975+0000","last_became_peered":"2024-09-21T05:47:03.613975+0000","last_unstale":"2024-09-21T05:49:15.090942+0000","last_undegraded":"2024-09-21T05:49:15.090942+0000","last_fullsized":"2024-09-21T05:49:15.090942+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:26.838907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721823+0000","last_change":"2024-09-21T05:47:38.733044+0000","last_active":"2024-09-21T05:48:38.721823+0000","last_peered":"2024-09-21T05:48:38.721823+0000","last_clean":"2024-09-21T05:48:38.721823+0000","last_became_active":"2024-09-21T05:47:38.732327+0000","last_became_peered":"2024-09-21T05:47:38.732327+0000","last_unstale":"2024-09-21T05:48:38.721823+0000","last_undegraded":"2024-09-21T05:48:38.721823+0000","last_fullsized":"2024-09-21T05:48:38.721823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:59.462529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.636196+0000","last_change":"2024-09-21T05:47:05.631831+0000","last_active":"2024-09-21T05:49:07.636196+0000","last_peered":"2024-09-21T05:49:07.636196+0000","last_clean":"2024-09-21T05:49:07.636196+0000","last_became_active":"2024-09-21T05:47:05.630403+0000","last_became_peered":"2024-09-21T05:47:05.630403+0000","last_unstale":"2024-09-21T05:49:07.636196+0000","last_undegraded":"2024-09-21T05:49:07.636196+0000","last_fullsized":"2024-09-21T05:49:07.636196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:21.163262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285563+0000","last_change":"2024-09-21T05:47:03.618888+0000","last_active":"2024-09-21T05:48:39.285563+0000","last_peered":"2024-09-21T05:48:39.285563+0000","last_clean":"2024-09-21T05:48:39.285563+0000","last_became_active":"2024-09-21T05:47:03.618506+0000","last_became_peered":"2024-09-21T05:47:03.618506+0000","last_unstale":"2024-09-21T05:48:39.285563+0000","last_undegraded":"2024-09-21T05:48:39.285563+0000","last_fullsized":"2024-09-21T05:48:39.285563+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:52.711976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714872+0000","last_change":"2024-09-21T05:47:12.675649+0000","last_active":"2024-09-21T05:48:38.714872+0000","last_peered":"2024-09-21T05:48:38.714872+0000","last_clean":"2024-09-21T05:48:38.714872+0000","last_became_active":"2024-09-21T05:47:12.675268+0000","last_became_peered":"2024-09-21T05:47:12.675268+0000","last_unstale":"2024-09-21T05:48:38.714872+0000","last_undegraded":"2024-09-21T05:48:38.714872+0000","last_fullsized":"2024-09-21T05:48:38.714872+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:48:31.481292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.622094+0000","last_change":"2024-09-21T05:47:05.622838+0000","last_active":"2024-09-21T05:49:07.622094+0000","last_peered":"2024-09-21T05:49:07.622094+0000","last_clean":"2024-09-21T05:49:07.622094+0000","last_became_active":"2024-09-21T05:47:05.622216+0000","last_became_peered":"2024-09-21T05:47:05.622216+0000","last_unstale":"2024-09-21T05:49:07.622094+0000","last_undegraded":"2024-09-21T05:49:07.622094+0000","last_fullsized":"2024-09-21T05:49:07.622094+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:55.446747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715282+0000","last_change":"2024-09-21T05:47:03.670405+0000","last_active":"2024-09-21T05:48:38.715282+0000","last_peered":"2024-09-21T05:48:38.715282+0000","last_clean":"2024-09-21T05:48:38.715282+0000","last_became_active":"2024-09-21T05:47:03.669958+0000","last_became_peered":"2024-09-21T05:47:03.669958+0000","last_unstale":"2024-09-21T05:48:38.715282+0000","last_undegraded":"2024-09-21T05:48:38.715282+0000","last_fullsized":"2024-09-21T05:48:38.715282+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:25.702903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.722260+0000","last_change":"2024-09-21T05:47:38.399039+0000","last_active":"2024-09-21T05:48:38.722260+0000","last_peered":"2024-09-21T05:48:38.722260+0000","last_clean":"2024-09-21T05:48:38.722260+0000","last_became_active":"2024-09-21T05:47:38.398441+0000","last_became_peered":"2024-09-21T05:47:38.398441+0000","last_unstale":"2024-09-21T05:48:38.722260+0000","last_undegraded":"2024-09-21T05:48:38.722260+0000","last_fullsized":"2024-09-21T05:48:38.722260+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:11.095516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,8],"acting":[4,5,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.628678+0000","last_change":"2024-09-21T05:47:05.632911+0000","last_active":"2024-09-21T05:49:07.628678+0000","last_peered":"2024-09-21T05:49:07.628678+0000","last_clean":"2024-09-21T05:49:07.628678+0000","last_became_active":"2024-09-21T05:47:05.632256+0000","last_became_peered":"2024-09-21T05:47:05.632256+0000","last_unstale":"2024-09-21T05:49:07.628678+0000","last_undegraded":"2024-09-21T05:49:07.628678+0000","last_fullsized":"2024-09-21T05:49:07.628678+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:41.014253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.722379+0000","last_change":"2024-09-21T05:47:04.411753+0000","last_active":"2024-09-21T05:48:38.722379+0000","last_peered":"2024-09-21T05:48:38.722379+0000","last_clean":"2024-09-21T05:48:38.722379+0000","last_became_active":"2024-09-21T05:47:04.411225+0000","last_became_peered":"2024-09-21T05:47:04.411225+0000","last_unstale":"2024-09-21T05:48:38.722379+0000","last_undegraded":"2024-09-21T05:48:38.722379+0000","last_fullsized":"2024-09-21T05:48:38.722379+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:07.964184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715699+0000","last_change":"2024-09-21T05:47:12.670157+0000","last_active":"2024-09-21T05:48:38.715699+0000","last_peered":"2024-09-21T05:48:38.715699+0000","last_clean":"2024-09-21T05:48:38.715699+0000","last_became_active":"2024-09-21T05:47:12.669710+0000","last_became_peered":"2024-09-21T05:47:12.669710+0000","last_unstale":"2024-09-21T05:48:38.715699+0000","last_undegraded":"2024-09-21T05:48:38.715699+0000","last_fullsized":"2024-09-21T05:48:38.715699+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:31.023624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.635898+0000","last_change":"2024-09-21T05:47:05.637982+0000","last_active":"2024-09-21T05:49:07.635898+0000","last_peered":"2024-09-21T05:49:07.635898+0000","last_clean":"2024-09-21T05:49:07.635898+0000","last_became_active":"2024-09-21T05:47:05.637357+0000","last_became_peered":"2024-09-21T05:47:05.637357+0000","last_unstale":"2024-09-21T05:49:07.635898+0000","last_undegraded":"2024-09-21T05:49:07.635898+0000","last_fullsized":"2024-09-21T05:49:07.635898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:41:12.986231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'16","reported_seq":55,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.640929+0000","last_change":"2024-09-21T05:47:03.611556+0000","last_active":"2024-09-21T05:49:07.640929+0000","last_peered":"2024-09-21T05:49:07.640929+0000","last_clean":"2024-09-21T05:49:07.640929+0000","last_became_active":"2024-09-21T05:47:03.611192+0000","last_became_peered":"2024-09-21T05:47:03.611192+0000","last_unstale":"2024-09-21T05:49:07.640929+0000","last_undegraded":"2024-09-21T05:49:07.640929+0000","last_fullsized":"2024-09-21T05:49:07.640929+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:20.047405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285259+0000","last_change":"2024-09-21T05:47:12.874796+0000","last_active":"2024-09-21T05:48:39.285259+0000","last_peered":"2024-09-21T05:48:39.285259+0000","last_clean":"2024-09-21T05:48:39.285259+0000","last_became_active":"2024-09-21T05:47:12.873648+0000","last_became_peered":"2024-09-21T05:47:12.873648+0000","last_unstale":"2024-09-21T05:48:39.285259+0000","last_undegraded":"2024-09-21T05:48:39.285259+0000","last_fullsized":"2024-09-21T05:48:39.285259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:50.591584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.624967+0000","last_change":"2024-09-21T05:47:05.634289+0000","last_active":"2024-09-21T05:49:07.624967+0000","last_peered":"2024-09-21T05:49:07.624967+0000","last_clean":"2024-09-21T05:49:07.624967+0000","last_became_active":"2024-09-21T05:47:05.633971+0000","last_became_peered":"2024-09-21T05:47:05.633971+0000","last_unstale":"2024-09-21T05:49:07.624967+0000","last_undegraded":"2024-09-21T05:49:07.624967+0000","last_fullsized":"2024-09-21T05:49:07.624967+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:53.819753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.722647+0000","last_change":"2024-09-21T05:47:03.671877+0000","last_active":"2024-09-21T05:48:38.722647+0000","last_peered":"2024-09-21T05:48:38.722647+0000","last_clean":"2024-09-21T05:48:38.722647+0000","last_became_active":"2024-09-21T05:47:03.671443+0000","last_became_peered":"2024-09-21T05:47:03.671443+0000","last_unstale":"2024-09-21T05:48:38.722647+0000","last_undegraded":"2024-09-21T05:48:38.722647+0000","last_fullsized":"2024-09-21T05:48:38.722647+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:00.114953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.717912+0000","last_change":"2024-09-21T05:47:12.673004+0000","last_active":"2024-09-21T05:48:38.717912+0000","last_peered":"2024-09-21T05:48:38.717912+0000","last_clean":"2024-09-21T05:48:38.717912+0000","last_became_active":"2024-09-21T05:47:12.671784+0000","last_became_peered":"2024-09-21T05:47:12.671784+0000","last_unstale":"2024-09-21T05:48:38.717912+0000","last_undegraded":"2024-09-21T05:48:38.717912+0000","last_fullsized":"2024-09-21T05:48:38.717912+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:38.672438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"85'4","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.624238+0000","last_change":"2024-09-21T05:47:05.635204+0000","last_active":"2024-09-21T05:49:07.624238+0000","last_peered":"2024-09-21T05:49:07.624238+0000","last_clean":"2024-09-21T05:49:07.624238+0000","last_became_active":"2024-09-21T05:47:05.634794+0000","last_became_peered":"2024-09-21T05:47:05.634794+0000","last_unstale":"2024-09-21T05:49:07.624238+0000","last_undegraded":"2024-09-21T05:49:07.624238+0000","last_fullsized":"2024-09-21T05:49:07.624238+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:08.208843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714687+0000","last_change":"2024-09-21T05:47:03.671864+0000","last_active":"2024-09-21T05:48:38.714687+0000","last_peered":"2024-09-21T05:48:38.714687+0000","last_clean":"2024-09-21T05:48:38.714687+0000","last_became_active":"2024-09-21T05:47:03.671510+0000","last_became_peered":"2024-09-21T05:47:03.671510+0000","last_unstale":"2024-09-21T05:48:38.714687+0000","last_undegraded":"2024-09-21T05:48:38.714687+0000","last_fullsized":"2024-09-21T05:48:38.714687+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:12.831235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720724+0000","last_change":"2024-09-21T05:47:38.398708+0000","last_active":"2024-09-21T05:48:38.720724+0000","last_peered":"2024-09-21T05:48:38.720724+0000","last_clean":"2024-09-21T05:48:38.720724+0000","last_became_active":"2024-09-21T05:47:38.398211+0000","last_became_peered":"2024-09-21T05:47:38.398211+0000","last_unstale":"2024-09-21T05:48:38.720724+0000","last_undegraded":"2024-09-21T05:48:38.720724+0000","last_fullsized":"2024-09-21T05:48:38.720724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:29.250191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.621266+0000","last_change":"2024-09-21T05:47:05.633069+0000","last_active":"2024-09-21T05:49:07.621266+0000","last_peered":"2024-09-21T05:49:07.621266+0000","last_clean":"2024-09-21T05:49:07.621266+0000","last_became_active":"2024-09-21T05:47:05.632698+0000","last_became_peered":"2024-09-21T05:47:05.632698+0000","last_unstale":"2024-09-21T05:49:07.621266+0000","last_undegraded":"2024-09-21T05:49:07.621266+0000","last_fullsized":"2024-09-21T05:49:07.621266+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:04.081062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'5","reported_seq":147,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:29.721457+0000","last_change":"2024-09-21T05:47:03.622490+0000","last_active":"2024-09-21T05:49:29.721457+0000","last_peered":"2024-09-21T05:49:29.721457+0000","last_clean":"2024-09-21T05:49:29.721457+0000","last_became_active":"2024-09-21T05:47:03.622093+0000","last_became_peered":"2024-09-21T05:47:03.622093+0000","last_unstale":"2024-09-21T05:49:29.721457+0000","last_undegraded":"2024-09-21T05:49:29.721457+0000","last_fullsized":"2024-09-21T05:49:29.721457+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:40.500152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.432807+0000","last_change":"2024-09-21T05:47:12.670060+0000","last_active":"2024-09-21T05:48:39.432807+0000","last_peered":"2024-09-21T05:48:39.432807+0000","last_clean":"2024-09-21T05:48:39.432807+0000","last_became_active":"2024-09-21T05:47:12.669635+0000","last_became_peered":"2024-09-21T05:47:12.669635+0000","last_unstale":"2024-09-21T05:48:39.432807+0000","last_undegraded":"2024-09-21T05:48:39.432807+0000","last_fullsized":"2024-09-21T05:48:39.432807+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:14.786984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.633745+0000","last_change":"2024-09-21T05:47:05.640553+0000","last_active":"2024-09-21T05:49:07.633745+0000","last_peered":"2024-09-21T05:49:07.633745+0000","last_clean":"2024-09-21T05:49:07.633745+0000","last_became_active":"2024-09-21T05:47:05.640151+0000","last_became_peered":"2024-09-21T05:47:05.640151+0000","last_unstale":"2024-09-21T05:49:07.633745+0000","last_undegraded":"2024-09-21T05:49:07.633745+0000","last_fullsized":"2024-09-21T05:49:07.633745+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:39.904129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'7","reported_seq":152,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:33.719448+0000","last_change":"2024-09-21T05:47:03.670178+0000","last_active":"2024-09-21T05:49:33.719448+0000","last_peered":"2024-09-21T05:49:33.719448+0000","last_clean":"2024-09-21T05:49:33.719448+0000","last_became_active":"2024-09-21T05:47:03.669715+0000","last_became_peered":"2024-09-21T05:47:03.669715+0000","last_unstale":"2024-09-21T05:49:33.719448+0000","last_undegraded":"2024-09-21T05:49:33.719448+0000","last_fullsized":"2024-09-21T05:49:33.719448+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:31.457820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.433018+0000","last_change":"2024-09-21T05:47:12.875173+0000","last_active":"2024-09-21T05:48:39.433018+0000","last_peered":"2024-09-21T05:48:39.433018+0000","last_clean":"2024-09-21T05:48:39.433018+0000","last_became_active":"2024-09-21T05:47:12.873749+0000","last_became_peered":"2024-09-21T05:47:12.873749+0000","last_unstale":"2024-09-21T05:48:39.433018+0000","last_undegraded":"2024-09-21T05:48:39.433018+0000","last_fullsized":"2024-09-21T05:48:39.433018+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:33.473645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.625006+0000","last_change":"2024-09-21T05:47:05.634346+0000","last_active":"2024-09-21T05:49:07.625006+0000","last_peered":"2024-09-21T05:49:07.625006+0000","last_clean":"2024-09-21T05:49:07.625006+0000","last_became_active":"2024-09-21T05:47:05.634004+0000","last_became_peered":"2024-09-21T05:47:05.634004+0000","last_unstale":"2024-09-21T05:49:07.625006+0000","last_undegraded":"2024-09-21T05:49:07.625006+0000","last_fullsized":"2024-09-21T05:49:07.625006+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:16.328729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.717785+0000","last_change":"2024-09-21T05:47:03.619472+0000","last_active":"2024-09-21T05:48:38.717785+0000","last_peered":"2024-09-21T05:48:38.717785+0000","last_clean":"2024-09-21T05:48:38.717785+0000","last_became_active":"2024-09-21T05:47:03.619077+0000","last_became_peered":"2024-09-21T05:47:03.619077+0000","last_unstale":"2024-09-21T05:48:38.717785+0000","last_undegraded":"2024-09-21T05:48:38.717785+0000","last_fullsized":"2024-09-21T05:48:38.717785+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:17.774462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.722547+0000","last_change":"2024-09-21T05:47:38.730714+0000","last_active":"2024-09-21T05:48:38.722547+0000","last_peered":"2024-09-21T05:48:38.722547+0000","last_clean":"2024-09-21T05:48:38.722547+0000","last_became_active":"2024-09-21T05:47:38.730271+0000","last_became_peered":"2024-09-21T05:47:38.730271+0000","last_unstale":"2024-09-21T05:48:38.722547+0000","last_undegraded":"2024-09-21T05:48:38.722547+0000","last_fullsized":"2024-09-21T05:48:38.722547+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:53.391967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.624355+0000","last_change":"2024-09-21T05:47:05.642487+0000","last_active":"2024-09-21T05:49:07.624355+0000","last_peered":"2024-09-21T05:49:07.624355+0000","last_clean":"2024-09-21T05:49:07.624355+0000","last_became_active":"2024-09-21T05:47:05.642022+0000","last_became_peered":"2024-09-21T05:47:05.642022+0000","last_unstale":"2024-09-21T05:49:07.624355+0000","last_undegraded":"2024-09-21T05:49:07.624355+0000","last_fullsized":"2024-09-21T05:49:07.624355+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:50:38.435444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721983+0000","last_change":"2024-09-21T05:47:03.618333+0000","last_active":"2024-09-21T05:48:38.721983+0000","last_peered":"2024-09-21T05:48:38.721983+0000","last_clean":"2024-09-21T05:48:38.721983+0000","last_became_active":"2024-09-21T05:47:03.617843+0000","last_became_peered":"2024-09-21T05:47:03.617843+0000","last_unstale":"2024-09-21T05:48:38.721983+0000","last_undegraded":"2024-09-21T05:48:38.721983+0000","last_fullsized":"2024-09-21T05:48:38.721983+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:01.647913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":115,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718194+0000","last_change":"2024-09-21T05:45:52.661435+0000","last_active":"2024-09-21T05:48:38.718194+0000","last_peered":"2024-09-21T05:48:38.718194+0000","last_clean":"2024-09-21T05:48:38.718194+0000","last_became_active":"2024-09-21T05:45:52.656767+0000","last_became_peered":"2024-09-21T05:45:52.656767+0000","last_unstale":"2024-09-21T05:48:38.718194+0000","last_undegraded":"2024-09-21T05:48:38.718194+0000","last_fullsized":"2024-09-21T05:48:38.718194+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:42:26.045146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:42:26.045146+0000","last_clean_scrub_stamp":"2024-09-21T05:42:26.045146+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:40:12.152499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718152+0000","last_change":"2024-09-21T05:47:12.675435+0000","last_active":"2024-09-21T05:48:38.718152+0000","last_peered":"2024-09-21T05:48:38.718152+0000","last_clean":"2024-09-21T05:48:38.718152+0000","last_became_active":"2024-09-21T05:47:12.674955+0000","last_became_peered":"2024-09-21T05:47:12.674955+0000","last_unstale":"2024-09-21T05:48:38.718152+0000","last_undegraded":"2024-09-21T05:48:38.718152+0000","last_fullsized":"2024-09-21T05:48:38.718152+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:18.758498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.641204+0000","last_change":"2024-09-21T05:47:05.640952+0000","last_active":"2024-09-21T05:49:07.641204+0000","last_peered":"2024-09-21T05:49:07.641204+0000","last_clean":"2024-09-21T05:49:07.641204+0000","last_became_active":"2024-09-21T05:47:05.640554+0000","last_became_peered":"2024-09-21T05:47:05.640554+0000","last_unstale":"2024-09-21T05:49:07.641204+0000","last_undegraded":"2024-09-21T05:49:07.641204+0000","last_fullsized":"2024-09-21T05:49:07.641204+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:15:08.553651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'6","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:33.731323+0000","last_change":"2024-09-21T05:47:04.411605+0000","last_active":"2024-09-21T05:49:33.731323+0000","last_peered":"2024-09-21T05:49:33.731323+0000","last_clean":"2024-09-21T05:49:33.731323+0000","last_became_active":"2024-09-21T05:47:04.411129+0000","last_became_peered":"2024-09-21T05:47:04.411129+0000","last_unstale":"2024-09-21T05:49:33.731323+0000","last_undegraded":"2024-09-21T05:49:33.731323+0000","last_fullsized":"2024-09-21T05:49:33.731323+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:25.469148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1663,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715316+0000","last_change":"2024-09-21T05:47:12.670479+0000","last_active":"2024-09-21T05:48:38.715316+0000","last_peered":"2024-09-21T05:48:38.715316+0000","last_clean":"2024-09-21T05:48:38.715316+0000","last_became_active":"2024-09-21T05:47:12.669925+0000","last_became_peered":"2024-09-21T05:47:12.669925+0000","last_unstale":"2024-09-21T05:48:38.715316+0000","last_undegraded":"2024-09-21T05:48:38.715316+0000","last_fullsized":"2024-09-21T05:48:38.715316+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:50.506063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.624710+0000","last_change":"2024-09-21T05:47:05.634519+0000","last_active":"2024-09-21T05:49:07.624710+0000","last_peered":"2024-09-21T05:49:07.624710+0000","last_clean":"2024-09-21T05:49:07.624710+0000","last_became_active":"2024-09-21T05:47:05.634134+0000","last_became_peered":"2024-09-21T05:47:05.634134+0000","last_unstale":"2024-09-21T05:49:07.624710+0000","last_undegraded":"2024-09-21T05:49:07.624710+0000","last_fullsized":"2024-09-21T05:49:07.624710+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:57.464884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721394+0000","last_change":"2024-09-21T05:47:03.622860+0000","last_active":"2024-09-21T05:48:38.721394+0000","last_peered":"2024-09-21T05:48:38.721394+0000","last_clean":"2024-09-21T05:48:38.721394+0000","last_became_active":"2024-09-21T05:47:03.622435+0000","last_became_peered":"2024-09-21T05:47:03.622435+0000","last_unstale":"2024-09-21T05:48:38.721394+0000","last_undegraded":"2024-09-21T05:48:38.721394+0000","last_fullsized":"2024-09-21T05:48:38.721394+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:03.352140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720211+0000","last_change":"2024-09-21T05:47:12.673518+0000","last_active":"2024-09-21T05:48:38.720211+0000","last_peered":"2024-09-21T05:48:38.720211+0000","last_clean":"2024-09-21T05:48:38.720211+0000","last_became_active":"2024-09-21T05:47:12.673000+0000","last_became_peered":"2024-09-21T05:47:12.673000+0000","last_unstale":"2024-09-21T05:48:38.720211+0000","last_undegraded":"2024-09-21T05:48:38.720211+0000","last_fullsized":"2024-09-21T05:48:38.720211+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:37.859801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.628136+0000","last_change":"2024-09-21T05:47:05.625144+0000","last_active":"2024-09-21T05:49:07.628136+0000","last_peered":"2024-09-21T05:49:07.628136+0000","last_clean":"2024-09-21T05:49:07.628136+0000","last_became_active":"2024-09-21T05:47:05.624593+0000","last_became_peered":"2024-09-21T05:47:05.624593+0000","last_unstale":"2024-09-21T05:49:07.628136+0000","last_undegraded":"2024-09-21T05:49:07.628136+0000","last_fullsized":"2024-09-21T05:49:07.628136+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:04.332686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.433072+0000","last_change":"2024-09-21T05:47:03.612389+0000","last_active":"2024-09-21T05:48:39.433072+0000","last_peered":"2024-09-21T05:48:39.433072+0000","last_clean":"2024-09-21T05:48:39.433072+0000","last_became_active":"2024-09-21T05:47:03.612023+0000","last_became_peered":"2024-09-21T05:47:03.612023+0000","last_unstale":"2024-09-21T05:48:39.433072+0000","last_undegraded":"2024-09-21T05:48:39.433072+0000","last_fullsized":"2024-09-21T05:48:39.433072+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:32.571903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721160+0000","last_change":"2024-09-21T05:47:12.674963+0000","last_active":"2024-09-21T05:48:38.721160+0000","last_peered":"2024-09-21T05:48:38.721160+0000","last_clean":"2024-09-21T05:48:38.721160+0000","last_became_active":"2024-09-21T05:47:12.673883+0000","last_became_peered":"2024-09-21T05:47:12.673883+0000","last_unstale":"2024-09-21T05:48:38.721160+0000","last_undegraded":"2024-09-21T05:48:38.721160+0000","last_fullsized":"2024-09-21T05:48:38.721160+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:29.843443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.634245+0000","last_change":"2024-09-21T05:47:05.638440+0000","last_active":"2024-09-21T05:49:07.634245+0000","last_peered":"2024-09-21T05:49:07.634245+0000","last_clean":"2024-09-21T05:49:07.634245+0000","last_became_active":"2024-09-21T05:47:05.638010+0000","last_became_peered":"2024-09-21T05:47:05.638010+0000","last_unstale":"2024-09-21T05:49:07.634245+0000","last_undegraded":"2024-09-21T05:49:07.634245+0000","last_fullsized":"2024-09-21T05:49:07.634245+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:47.921461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.742870+0000","last_change":"2024-09-21T05:48:38.742314+0000","last_active":"2024-09-21T05:48:38.742870+0000","last_peered":"2024-09-21T05:48:38.742870+0000","last_clean":"2024-09-21T05:48:38.742870+0000","last_became_active":"2024-09-21T05:48:38.723546+0000","last_became_peered":"2024-09-21T05:48:38.723546+0000","last_unstale":"2024-09-21T05:48:38.742870+0000","last_undegraded":"2024-09-21T05:48:38.742870+0000","last_fullsized":"2024-09-21T05:48:38.742870+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:12.911309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.719825+0000","last_change":"2024-09-21T05:47:12.675362+0000","last_active":"2024-09-21T05:48:38.719825+0000","last_peered":"2024-09-21T05:48:38.719825+0000","last_clean":"2024-09-21T05:48:38.719825+0000","last_became_active":"2024-09-21T05:47:12.674578+0000","last_became_peered":"2024-09-21T05:47:12.674578+0000","last_unstale":"2024-09-21T05:48:38.719825+0000","last_undegraded":"2024-09-21T05:48:38.719825+0000","last_fullsized":"2024-09-21T05:48:38.719825+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:56.654323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.636309+0000","last_change":"2024-09-21T05:47:05.641130+0000","last_active":"2024-09-21T05:49:07.636309+0000","last_peered":"2024-09-21T05:49:07.636309+0000","last_clean":"2024-09-21T05:49:07.636309+0000","last_became_active":"2024-09-21T05:47:05.640794+0000","last_became_peered":"2024-09-21T05:47:05.640794+0000","last_unstale":"2024-09-21T05:49:07.636309+0000","last_undegraded":"2024-09-21T05:49:07.636309+0000","last_fullsized":"2024-09-21T05:49:07.636309+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:29:18.243240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.738576+0000","last_change":"2024-09-21T05:48:38.737941+0000","last_active":"2024-09-21T05:48:38.738576+0000","last_peered":"2024-09-21T05:48:38.738576+0000","last_clean":"2024-09-21T05:48:38.738576+0000","last_became_active":"2024-09-21T05:48:38.722769+0000","last_became_peered":"2024-09-21T05:48:38.722769+0000","last_unstale":"2024-09-21T05:48:38.738576+0000","last_undegraded":"2024-09-21T05:48:38.738576+0000","last_fullsized":"2024-09-21T05:48:38.738576+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:24.258822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.432974+0000","last_change":"2024-09-21T05:47:12.671181+0000","last_active":"2024-09-21T05:48:39.432974+0000","last_peered":"2024-09-21T05:48:39.432974+0000","last_clean":"2024-09-21T05:48:39.432974+0000","last_became_active":"2024-09-21T05:47:12.670522+0000","last_became_peered":"2024-09-21T05:47:12.670522+0000","last_unstale":"2024-09-21T05:48:39.432974+0000","last_undegraded":"2024-09-21T05:48:39.432974+0000","last_fullsized":"2024-09-21T05:48:39.432974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:52.165812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.631652+0000","last_change":"2024-09-21T05:47:05.629167+0000","last_active":"2024-09-21T05:49:07.631652+0000","last_peered":"2024-09-21T05:49:07.631652+0000","last_clean":"2024-09-21T05:49:07.631652+0000","last_became_active":"2024-09-21T05:47:05.628794+0000","last_became_peered":"2024-09-21T05:47:05.628794+0000","last_unstale":"2024-09-21T05:49:07.631652+0000","last_undegraded":"2024-09-21T05:49:07.631652+0000","last_fullsized":"2024-09-21T05:49:07.631652+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:51.469247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'7","reported_seq":154,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:31.720341+0000","last_change":"2024-09-21T05:47:03.621479+0000","last_active":"2024-09-21T05:49:31.720341+0000","last_peered":"2024-09-21T05:49:31.720341+0000","last_clean":"2024-09-21T05:49:31.720341+0000","last_became_active":"2024-09-21T05:47:03.621041+0000","last_became_peered":"2024-09-21T05:47:03.621041+0000","last_unstale":"2024-09-21T05:49:31.720341+0000","last_undegraded":"2024-09-21T05:49:31.720341+0000","last_fullsized":"2024-09-21T05:49:31.720341+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:33.092750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714842+0000","last_change":"2024-09-21T05:47:12.669821+0000","last_active":"2024-09-21T05:48:38.714842+0000","last_peered":"2024-09-21T05:48:38.714842+0000","last_clean":"2024-09-21T05:48:38.714842+0000","last_became_active":"2024-09-21T05:47:12.669418+0000","last_became_peered":"2024-09-21T05:47:12.669418+0000","last_unstale":"2024-09-21T05:48:38.714842+0000","last_undegraded":"2024-09-21T05:48:38.714842+0000","last_fullsized":"2024-09-21T05:48:38.714842+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:57.082509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.625480+0000","last_change":"2024-09-21T05:47:05.631182+0000","last_active":"2024-09-21T05:49:07.625480+0000","last_peered":"2024-09-21T05:49:07.625480+0000","last_clean":"2024-09-21T05:49:07.625480+0000","last_became_active":"2024-09-21T05:47:05.630716+0000","last_became_peered":"2024-09-21T05:47:05.630716+0000","last_unstale":"2024-09-21T05:49:07.625480+0000","last_undegraded":"2024-09-21T05:49:07.625480+0000","last_fullsized":"2024-09-21T05:49:07.625480+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:17.946858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720774+0000","last_change":"2024-09-21T05:47:03.620897+0000","last_active":"2024-09-21T05:48:38.720774+0000","last_peered":"2024-09-21T05:48:38.720774+0000","last_clean":"2024-09-21T05:48:38.720774+0000","last_became_active":"2024-09-21T05:47:03.620003+0000","last_became_peered":"2024-09-21T05:47:03.620003+0000","last_unstale":"2024-09-21T05:48:38.720774+0000","last_undegraded":"2024-09-21T05:48:38.720774+0000","last_fullsized":"2024-09-21T05:48:38.720774+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:51:07.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718144+0000","last_change":"2024-09-21T05:47:12.675320+0000","last_active":"2024-09-21T05:48:38.718144+0000","last_peered":"2024-09-21T05:48:38.718144+0000","last_clean":"2024-09-21T05:48:38.718144+0000","last_became_active":"2024-09-21T05:47:12.674715+0000","last_became_peered":"2024-09-21T05:47:12.674715+0000","last_unstale":"2024-09-21T05:48:38.718144+0000","last_undegraded":"2024-09-21T05:48:38.718144+0000","last_fullsized":"2024-09-21T05:48:38.718144+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:28.151947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.624754+0000","last_change":"2024-09-21T05:47:05.630786+0000","last_active":"2024-09-21T05:49:07.624754+0000","last_peered":"2024-09-21T05:49:07.624754+0000","last_clean":"2024-09-21T05:49:07.624754+0000","last_became_active":"2024-09-21T05:47:05.630433+0000","last_became_peered":"2024-09-21T05:47:05.630433+0000","last_unstale":"2024-09-21T05:49:07.624754+0000","last_undegraded":"2024-09-21T05:49:07.624754+0000","last_fullsized":"2024-09-21T05:49:07.624754+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:54.481462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.716342+0000","last_change":"2024-09-21T05:47:03.618990+0000","last_active":"2024-09-21T05:48:38.716342+0000","last_peered":"2024-09-21T05:48:38.716342+0000","last_clean":"2024-09-21T05:48:38.716342+0000","last_became_active":"2024-09-21T05:47:03.618679+0000","last_became_peered":"2024-09-21T05:47:03.618679+0000","last_unstale":"2024-09-21T05:48:38.716342+0000","last_undegraded":"2024-09-21T05:48:38.716342+0000","last_fullsized":"2024-09-21T05:48:38.716342+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:10.193233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721027+0000","last_change":"2024-09-21T05:47:12.675012+0000","last_active":"2024-09-21T05:48:38.721027+0000","last_peered":"2024-09-21T05:48:38.721027+0000","last_clean":"2024-09-21T05:48:38.721027+0000","last_became_active":"2024-09-21T05:47:12.674266+0000","last_became_peered":"2024-09-21T05:47:12.674266+0000","last_unstale":"2024-09-21T05:48:38.721027+0000","last_undegraded":"2024-09-21T05:48:38.721027+0000","last_fullsized":"2024-09-21T05:48:38.721027+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:43.525084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.623333+0000","last_change":"2024-09-21T05:47:05.625457+0000","last_active":"2024-09-21T05:49:07.623333+0000","last_peered":"2024-09-21T05:49:07.623333+0000","last_clean":"2024-09-21T05:49:07.623333+0000","last_became_active":"2024-09-21T05:47:05.625058+0000","last_became_peered":"2024-09-21T05:47:05.625058+0000","last_unstale":"2024-09-21T05:49:07.623333+0000","last_undegraded":"2024-09-21T05:49:07.623333+0000","last_fullsized":"2024-09-21T05:49:07.623333+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:29:09.352152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'37","reported_seq":288,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:30.800677+0000","last_change":"2024-09-21T05:47:03.621535+0000","last_active":"2024-09-21T05:49:30.800677+0000","last_peered":"2024-09-21T05:49:30.800677+0000","last_clean":"2024-09-21T05:49:30.800677+0000","last_became_active":"2024-09-21T05:47:03.621109+0000","last_became_peered":"2024-09-21T05:47:03.621109+0000","last_unstale":"2024-09-21T05:49:30.800677+0000","last_undegraded":"2024-09-21T05:49:30.800677+0000","last_fullsized":"2024-09-21T05:49:30.800677+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:31:12.135760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66461,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":212,"num_read_kb":171,"num_write":39,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714429+0000","last_change":"2024-09-21T05:47:12.676827+0000","last_active":"2024-09-21T05:48:38.714429+0000","last_peered":"2024-09-21T05:48:38.714429+0000","last_clean":"2024-09-21T05:48:38.714429+0000","last_became_active":"2024-09-21T05:47:12.676256+0000","last_became_peered":"2024-09-21T05:47:12.676256+0000","last_unstale":"2024-09-21T05:48:38.714429+0000","last_undegraded":"2024-09-21T05:48:38.714429+0000","last_fullsized":"2024-09-21T05:48:38.714429+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:40.932328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.642888+0000","last_change":"2024-09-21T05:47:05.636507+0000","last_active":"2024-09-21T05:49:07.642888+0000","last_peered":"2024-09-21T05:49:07.642888+0000","last_clean":"2024-09-21T05:49:07.642888+0000","last_became_active":"2024-09-21T05:47:05.636140+0000","last_became_peered":"2024-09-21T05:47:05.636140+0000","last_unstale":"2024-09-21T05:49:07.642888+0000","last_undegraded":"2024-09-21T05:49:07.642888+0000","last_fullsized":"2024-09-21T05:49:07.642888+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:16.879274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721493+0000","last_change":"2024-09-21T05:47:03.670425+0000","last_active":"2024-09-21T05:48:38.721493+0000","last_peered":"2024-09-21T05:48:38.721493+0000","last_clean":"2024-09-21T05:48:38.721493+0000","last_became_active":"2024-09-21T05:47:03.669973+0000","last_became_peered":"2024-09-21T05:47:03.669973+0000","last_unstale":"2024-09-21T05:48:38.721493+0000","last_undegraded":"2024-09-21T05:48:38.721493+0000","last_fullsized":"2024-09-21T05:48:38.721493+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:04.212044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721656+0000","last_change":"2024-09-21T05:47:12.677600+0000","last_active":"2024-09-21T05:48:38.721656+0000","last_peered":"2024-09-21T05:48:38.721656+0000","last_clean":"2024-09-21T05:48:38.721656+0000","last_became_active":"2024-09-21T05:47:12.677037+0000","last_became_peered":"2024-09-21T05:47:12.677037+0000","last_unstale":"2024-09-21T05:48:38.721656+0000","last_undegraded":"2024-09-21T05:48:38.721656+0000","last_fullsized":"2024-09-21T05:48:38.721656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:36.502821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.632646+0000","last_change":"2024-09-21T05:47:38.398403+0000","last_active":"2024-09-21T05:49:07.632646+0000","last_peered":"2024-09-21T05:49:07.632646+0000","last_clean":"2024-09-21T05:49:07.632646+0000","last_became_active":"2024-09-21T05:47:38.397953+0000","last_became_peered":"2024-09-21T05:47:38.397953+0000","last_unstale":"2024-09-21T05:49:07.632646+0000","last_undegraded":"2024-09-21T05:49:07.632646+0000","last_fullsized":"2024-09-21T05:49:07.632646+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:01.550222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":57,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.728525+0000","last_change":"2024-09-21T05:48:38.727813+0000","last_active":"2024-09-21T05:48:38.728525+0000","last_peered":"2024-09-21T05:48:38.728525+0000","last_clean":"2024-09-21T05:48:38.728525+0000","last_became_active":"2024-09-21T05:48:38.722709+0000","last_became_peered":"2024-09-21T05:48:38.722709+0000","last_unstale":"2024-09-21T05:48:38.728525+0000","last_undegraded":"2024-09-21T05:48:38.728525+0000","last_fullsized":"2024-09-21T05:48:38.728525+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:22.544711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714262+0000","last_change":"2024-09-21T05:47:12.670466+0000","last_active":"2024-09-21T05:48:38.714262+0000","last_peered":"2024-09-21T05:48:38.714262+0000","last_clean":"2024-09-21T05:48:38.714262+0000","last_became_active":"2024-09-21T05:47:12.670032+0000","last_became_peered":"2024-09-21T05:47:12.670032+0000","last_unstale":"2024-09-21T05:48:38.714262+0000","last_undegraded":"2024-09-21T05:48:38.714262+0000","last_fullsized":"2024-09-21T05:48:38.714262+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:18.860347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.642591+0000","last_change":"2024-09-21T05:47:05.645093+0000","last_active":"2024-09-21T05:49:07.642591+0000","last_peered":"2024-09-21T05:49:07.642591+0000","last_clean":"2024-09-21T05:49:07.642591+0000","last_became_active":"2024-09-21T05:47:05.644739+0000","last_became_peered":"2024-09-21T05:47:05.644739+0000","last_unstale":"2024-09-21T05:49:07.642591+0000","last_undegraded":"2024-09-21T05:49:07.642591+0000","last_fullsized":"2024-09-21T05:49:07.642591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:43.895574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":245,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:30.800589+0000","last_change":"2024-09-21T05:47:03.619070+0000","last_active":"2024-09-21T05:49:30.800589+0000","last_peered":"2024-09-21T05:49:30.800589+0000","last_clean":"2024-09-21T05:49:30.800589+0000","last_became_active":"2024-09-21T05:47:03.618655+0000","last_became_peered":"2024-09-21T05:47:03.618655+0000","last_unstale":"2024-09-21T05:49:30.800589+0000","last_undegraded":"2024-09-21T05:49:30.800589+0000","last_fullsized":"2024-09-21T05:49:30.800589+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:29.206109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":202,"num_read_kb":202,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285302+0000","last_change":"2024-09-21T05:47:12.672677+0000","last_active":"2024-09-21T05:48:39.285302+0000","last_peered":"2024-09-21T05:48:39.285302+0000","last_clean":"2024-09-21T05:48:39.285302+0000","last_became_active":"2024-09-21T05:47:12.672264+0000","last_became_peered":"2024-09-21T05:47:12.672264+0000","last_unstale":"2024-09-21T05:48:39.285302+0000","last_undegraded":"2024-09-21T05:48:39.285302+0000","last_fullsized":"2024-09-21T05:48:39.285302+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:31.680678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720292+0000","last_change":"2024-09-21T05:47:12.672702+0000","last_active":"2024-09-21T05:48:38.720292+0000","last_peered":"2024-09-21T05:48:38.720292+0000","last_clean":"2024-09-21T05:48:38.720292+0000","last_became_active":"2024-09-21T05:47:12.672233+0000","last_became_peered":"2024-09-21T05:47:12.672233+0000","last_unstale":"2024-09-21T05:48:38.720292+0000","last_undegraded":"2024-09-21T05:48:38.720292+0000","last_fullsized":"2024-09-21T05:48:38.720292+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:04.235603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.622178+0000","last_change":"2024-09-21T05:47:05.633566+0000","last_active":"2024-09-21T05:49:07.622178+0000","last_peered":"2024-09-21T05:49:07.622178+0000","last_clean":"2024-09-21T05:49:07.622178+0000","last_became_active":"2024-09-21T05:47:05.633240+0000","last_became_peered":"2024-09-21T05:47:05.633240+0000","last_unstale":"2024-09-21T05:49:07.622178+0000","last_undegraded":"2024-09-21T05:49:07.622178+0000","last_fullsized":"2024-09-21T05:49:07.622178+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:10.106647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721511+0000","last_change":"2024-09-21T05:47:03.621788+0000","last_active":"2024-09-21T05:48:38.721511+0000","last_peered":"2024-09-21T05:48:38.721511+0000","last_clean":"2024-09-21T05:48:38.721511+0000","last_became_active":"2024-09-21T05:47:03.621425+0000","last_became_peered":"2024-09-21T05:47:03.621425+0000","last_unstale":"2024-09-21T05:48:38.721511+0000","last_undegraded":"2024-09-21T05:48:38.721511+0000","last_fullsized":"2024-09-21T05:48:38.721511+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:51.069361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718187+0000","last_change":"2024-09-21T05:47:12.670670+0000","last_active":"2024-09-21T05:48:38.718187+0000","last_peered":"2024-09-21T05:48:38.718187+0000","last_clean":"2024-09-21T05:48:38.718187+0000","last_became_active":"2024-09-21T05:47:12.670192+0000","last_became_peered":"2024-09-21T05:47:12.670192+0000","last_unstale":"2024-09-21T05:48:38.718187+0000","last_undegraded":"2024-09-21T05:48:38.718187+0000","last_fullsized":"2024-09-21T05:48:38.718187+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:59.430991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.635898+0000","last_change":"2024-09-21T05:47:05.637775+0000","last_active":"2024-09-21T05:49:07.635898+0000","last_peered":"2024-09-21T05:49:07.635898+0000","last_clean":"2024-09-21T05:49:07.635898+0000","last_became_active":"2024-09-21T05:47:05.637436+0000","last_became_peered":"2024-09-21T05:47:05.637436+0000","last_unstale":"2024-09-21T05:49:07.635898+0000","last_undegraded":"2024-09-21T05:49:07.635898+0000","last_fullsized":"2024-09-21T05:49:07.635898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:45:59.041879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.432553+0000","last_change":"2024-09-21T05:47:03.611317+0000","last_active":"2024-09-21T05:48:39.432553+0000","last_peered":"2024-09-21T05:48:39.432553+0000","last_clean":"2024-09-21T05:48:39.432553+0000","last_became_active":"2024-09-21T05:47:03.610967+0000","last_became_peered":"2024-09-21T05:47:03.610967+0000","last_unstale":"2024-09-21T05:48:39.432553+0000","last_undegraded":"2024-09-21T05:48:39.432553+0000","last_fullsized":"2024-09-21T05:48:39.432553+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:44.263380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.286079+0000","last_change":"2024-09-21T05:47:03.624584+0000","last_active":"2024-09-21T05:48:39.286079+0000","last_peered":"2024-09-21T05:48:39.286079+0000","last_clean":"2024-09-21T05:48:39.286079+0000","last_became_active":"2024-09-21T05:47:03.623886+0000","last_became_peered":"2024-09-21T05:47:03.623886+0000","last_unstale":"2024-09-21T05:48:39.286079+0000","last_undegraded":"2024-09-21T05:48:39.286079+0000","last_fullsized":"2024-09-21T05:48:39.286079+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:55.451732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.628759+0000","last_change":"2024-09-21T05:47:38.731762+0000","last_active":"2024-09-21T05:49:07.628759+0000","last_peered":"2024-09-21T05:49:07.628759+0000","last_clean":"2024-09-21T05:49:07.628759+0000","last_became_active":"2024-09-21T05:47:38.731325+0000","last_became_peered":"2024-09-21T05:47:38.731325+0000","last_unstale":"2024-09-21T05:49:07.628759+0000","last_undegraded":"2024-09-21T05:49:07.628759+0000","last_fullsized":"2024-09-21T05:49:07.628759+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:42.516434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715948+0000","last_change":"2024-09-21T05:47:12.677198+0000","last_active":"2024-09-21T05:48:38.715948+0000","last_peered":"2024-09-21T05:48:38.715948+0000","last_clean":"2024-09-21T05:48:38.715948+0000","last_became_active":"2024-09-21T05:47:12.676673+0000","last_became_peered":"2024-09-21T05:47:12.676673+0000","last_unstale":"2024-09-21T05:48:38.715948+0000","last_undegraded":"2024-09-21T05:48:38.715948+0000","last_fullsized":"2024-09-21T05:48:38.715948+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:58.861348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":165,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:33.806517+0000","last_change":"2024-09-21T05:48:38.730420+0000","last_active":"2024-09-21T05:49:33.806517+0000","last_peered":"2024-09-21T05:49:33.806517+0000","last_clean":"2024-09-21T05:49:33.806517+0000","last_became_active":"2024-09-21T05:48:38.722303+0000","last_became_peered":"2024-09-21T05:48:38.722303+0000","last_unstale":"2024-09-21T05:49:33.806517+0000","last_undegraded":"2024-09-21T05:49:33.806517+0000","last_fullsized":"2024-09-21T05:49:33.806517+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:37.846446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1115,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.625373+0000","last_change":"2024-09-21T05:47:05.641444+0000","last_active":"2024-09-21T05:49:07.625373+0000","last_peered":"2024-09-21T05:49:07.625373+0000","last_clean":"2024-09-21T05:49:07.625373+0000","last_became_active":"2024-09-21T05:47:05.640967+0000","last_became_peered":"2024-09-21T05:47:05.640967+0000","last_unstale":"2024-09-21T05:49:07.625373+0000","last_undegraded":"2024-09-21T05:49:07.625373+0000","last_fullsized":"2024-09-21T05:49:07.625373+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:20.698467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.716537+0000","last_change":"2024-09-21T05:47:12.680157+0000","last_active":"2024-09-21T05:48:38.716537+0000","last_peered":"2024-09-21T05:48:38.716537+0000","last_clean":"2024-09-21T05:48:38.716537+0000","last_became_active":"2024-09-21T05:47:12.679604+0000","last_became_peered":"2024-09-21T05:47:12.679604+0000","last_unstale":"2024-09-21T05:48:38.716537+0000","last_undegraded":"2024-09-21T05:48:38.716537+0000","last_fullsized":"2024-09-21T05:48:38.716537+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:15.381901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.636056+0000","last_change":"2024-09-21T05:47:05.635022+0000","last_active":"2024-09-21T05:49:07.636056+0000","last_peered":"2024-09-21T05:49:07.636056+0000","last_clean":"2024-09-21T05:49:07.636056+0000","last_became_active":"2024-09-21T05:47:05.634592+0000","last_became_peered":"2024-09-21T05:47:05.634592+0000","last_unstale":"2024-09-21T05:49:07.636056+0000","last_undegraded":"2024-09-21T05:49:07.636056+0000","last_fullsized":"2024-09-21T05:49:07.636056+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:48.159339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.634884+0000","last_change":"2024-09-21T05:48:38.722629+0000","last_active":"2024-09-21T05:49:07.634884+0000","last_peered":"2024-09-21T05:49:07.634884+0000","last_clean":"2024-09-21T05:49:07.634884+0000","last_became_active":"2024-09-21T05:48:38.722198+0000","last_became_peered":"2024-09-21T05:48:38.722198+0000","last_unstale":"2024-09-21T05:49:07.634884+0000","last_undegraded":"2024-09-21T05:49:07.634884+0000","last_fullsized":"2024-09-21T05:49:07.634884+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:26.126710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.628191+0000","last_change":"2024-09-21T05:47:05.637359+0000","last_active":"2024-09-21T05:49:07.628191+0000","last_peered":"2024-09-21T05:49:07.628191+0000","last_clean":"2024-09-21T05:49:07.628191+0000","last_became_active":"2024-09-21T05:47:05.636998+0000","last_became_peered":"2024-09-21T05:47:05.636998+0000","last_unstale":"2024-09-21T05:49:07.628191+0000","last_undegraded":"2024-09-21T05:49:07.628191+0000","last_fullsized":"2024-09-21T05:49:07.628191+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:06.186344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.629417+0000","last_change":"2024-09-21T05:47:05.633304+0000","last_active":"2024-09-21T05:49:07.629417+0000","last_peered":"2024-09-21T05:49:07.629417+0000","last_clean":"2024-09-21T05:49:07.629417+0000","last_became_active":"2024-09-21T05:47:05.632919+0000","last_became_peered":"2024-09-21T05:47:05.632919+0000","last_unstale":"2024-09-21T05:49:07.629417+0000","last_undegraded":"2024-09-21T05:49:07.629417+0000","last_fullsized":"2024-09-21T05:49:07.629417+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:16.108908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.629183+0000","last_change":"2024-09-21T05:47:05.631091+0000","last_active":"2024-09-21T05:49:07.629183+0000","last_peered":"2024-09-21T05:49:07.629183+0000","last_clean":"2024-09-21T05:49:07.629183+0000","last_became_active":"2024-09-21T05:47:05.630740+0000","last_became_peered":"2024-09-21T05:47:05.630740+0000","last_unstale":"2024-09-21T05:49:07.629183+0000","last_undegraded":"2024-09-21T05:49:07.629183+0000","last_fullsized":"2024-09-21T05:49:07.629183+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:36:41.136890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.631663+0000","last_change":"2024-09-21T05:47:38.398773+0000","last_active":"2024-09-21T05:49:07.631663+0000","last_peered":"2024-09-21T05:49:07.631663+0000","last_clean":"2024-09-21T05:49:07.631663+0000","last_became_active":"2024-09-21T05:47:38.398378+0000","last_became_peered":"2024-09-21T05:47:38.398378+0000","last_unstale":"2024-09-21T05:49:07.631663+0000","last_undegraded":"2024-09-21T05:49:07.631663+0000","last_fullsized":"2024-09-21T05:49:07.631663+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:32.247222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.636377+0000","last_change":"2024-09-21T05:47:05.641782+0000","last_active":"2024-09-21T05:49:07.636377+0000","last_peered":"2024-09-21T05:49:07.636377+0000","last_clean":"2024-09-21T05:49:07.636377+0000","last_became_active":"2024-09-21T05:47:05.641422+0000","last_became_peered":"2024-09-21T05:47:05.641422+0000","last_unstale":"2024-09-21T05:49:07.636377+0000","last_undegraded":"2024-09-21T05:49:07.636377+0000","last_fullsized":"2024-09-21T05:49:07.636377+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:33.819329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.621247+0000","last_change":"2024-09-21T05:47:38.396070+0000","last_active":"2024-09-21T05:49:07.621247+0000","last_peered":"2024-09-21T05:49:07.621247+0000","last_clean":"2024-09-21T05:49:07.621247+0000","last_became_active":"2024-09-21T05:47:38.395727+0000","last_became_peered":"2024-09-21T05:47:38.395727+0000","last_unstale":"2024-09-21T05:49:07.621247+0000","last_undegraded":"2024-09-21T05:49:07.621247+0000","last_fullsized":"2024-09-21T05:49:07.621247+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:41.816692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.628368+0000","last_change":"2024-09-21T05:47:05.633701+0000","last_active":"2024-09-21T05:49:07.628368+0000","last_peered":"2024-09-21T05:49:07.628368+0000","last_clean":"2024-09-21T05:49:07.628368+0000","last_became_active":"2024-09-21T05:47:05.632671+0000","last_became_peered":"2024-09-21T05:47:05.632671+0000","last_unstale":"2024-09-21T05:49:07.628368+0000","last_undegraded":"2024-09-21T05:49:07.628368+0000","last_fullsized":"2024-09-21T05:49:07.628368+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:56.180731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.635725+0000","last_change":"2024-09-21T05:47:05.639419+0000","last_active":"2024-09-21T05:49:07.635725+0000","last_peered":"2024-09-21T05:49:07.635725+0000","last_clean":"2024-09-21T05:49:07.635725+0000","last_became_active":"2024-09-21T05:47:05.639060+0000","last_became_peered":"2024-09-21T05:47:05.639060+0000","last_unstale":"2024-09-21T05:49:07.635725+0000","last_undegraded":"2024-09-21T05:49:07.635725+0000","last_fullsized":"2024-09-21T05:49:07.635725+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:09.562359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.642658+0000","last_change":"2024-09-21T05:47:05.641218+0000","last_active":"2024-09-21T05:49:07.642658+0000","last_peered":"2024-09-21T05:49:07.642658+0000","last_clean":"2024-09-21T05:49:07.642658+0000","last_became_active":"2024-09-21T05:47:05.640813+0000","last_became_peered":"2024-09-21T05:47:05.640813+0000","last_unstale":"2024-09-21T05:49:07.642658+0000","last_undegraded":"2024-09-21T05:49:07.642658+0000","last_fullsized":"2024-09-21T05:49:07.642658+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:21.057096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.629873+0000","last_change":"2024-09-21T05:47:05.627711+0000","last_active":"2024-09-21T05:49:07.629873+0000","last_peered":"2024-09-21T05:49:07.629873+0000","last_clean":"2024-09-21T05:49:07.629873+0000","last_became_active":"2024-09-21T05:47:05.626394+0000","last_became_peered":"2024-09-21T05:47:05.626394+0000","last_unstale":"2024-09-21T05:49:07.629873+0000","last_undegraded":"2024-09-21T05:49:07.629873+0000","last_fullsized":"2024-09-21T05:49:07.629873+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:31.038727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.636028+0000","last_change":"2024-09-21T05:47:05.632835+0000","last_active":"2024-09-21T05:49:07.636028+0000","last_peered":"2024-09-21T05:49:07.636028+0000","last_clean":"2024-09-21T05:49:07.636028+0000","last_became_active":"2024-09-21T05:47:05.632486+0000","last_became_peered":"2024-09-21T05:47:05.632486+0000","last_unstale":"2024-09-21T05:49:07.636028+0000","last_undegraded":"2024-09-21T05:49:07.636028+0000","last_fullsized":"2024-09-21T05:49:07.636028+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:04.365517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.626287+0000","last_change":"2024-09-21T05:47:05.638381+0000","last_active":"2024-09-21T05:49:07.626287+0000","last_peered":"2024-09-21T05:49:07.626287+0000","last_clean":"2024-09-21T05:49:07.626287+0000","last_became_active":"2024-09-21T05:47:05.638007+0000","last_became_peered":"2024-09-21T05:47:05.638007+0000","last_unstale":"2024-09-21T05:49:07.626287+0000","last_undegraded":"2024-09-21T05:49:07.626287+0000","last_fullsized":"2024-09-21T05:49:07.626287+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:06.615367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.640701+0000","last_change":"2024-09-21T05:47:05.644624+0000","last_active":"2024-09-21T05:49:07.640701+0000","last_peered":"2024-09-21T05:49:07.640701+0000","last_clean":"2024-09-21T05:49:07.640701+0000","last_became_active":"2024-09-21T05:47:05.644257+0000","last_became_peered":"2024-09-21T05:47:05.644257+0000","last_unstale":"2024-09-21T05:49:07.640701+0000","last_undegraded":"2024-09-21T05:49:07.640701+0000","last_fullsized":"2024-09-21T05:49:07.640701+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:31.385313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.642691+0000","last_change":"2024-09-21T05:47:05.646368+0000","last_active":"2024-09-21T05:49:07.642691+0000","last_peered":"2024-09-21T05:49:07.642691+0000","last_clean":"2024-09-21T05:49:07.642691+0000","last_became_active":"2024-09-21T05:47:05.645952+0000","last_became_peered":"2024-09-21T05:47:05.645952+0000","last_unstale":"2024-09-21T05:49:07.642691+0000","last_undegraded":"2024-09-21T05:49:07.642691+0000","last_fullsized":"2024-09-21T05:49:07.642691+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:56.585911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.642261+0000","last_change":"2024-09-21T05:47:05.640167+0000","last_active":"2024-09-21T05:49:07.642261+0000","last_peered":"2024-09-21T05:49:07.642261+0000","last_clean":"2024-09-21T05:49:07.642261+0000","last_became_active":"2024-09-21T05:47:05.639770+0000","last_became_peered":"2024-09-21T05:47:05.639770+0000","last_unstale":"2024-09-21T05:49:07.642261+0000","last_undegraded":"2024-09-21T05:49:07.642261+0000","last_fullsized":"2024-09-21T05:49:07.642261+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:45.661131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.626064+0000","last_change":"2024-09-21T05:47:38.732677+0000","last_active":"2024-09-21T05:49:07.626064+0000","last_peered":"2024-09-21T05:49:07.626064+0000","last_clean":"2024-09-21T05:49:07.626064+0000","last_became_active":"2024-09-21T05:47:38.732236+0000","last_became_peered":"2024-09-21T05:47:38.732236+0000","last_unstale":"2024-09-21T05:49:07.626064+0000","last_undegraded":"2024-09-21T05:49:07.626064+0000","last_fullsized":"2024-09-21T05:49:07.626064+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:41.474677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.631162+0000","last_change":"2024-09-21T05:47:05.629814+0000","last_active":"2024-09-21T05:49:07.631162+0000","last_peered":"2024-09-21T05:49:07.631162+0000","last_clean":"2024-09-21T05:49:07.631162+0000","last_became_active":"2024-09-21T05:47:05.629464+0000","last_became_peered":"2024-09-21T05:47:05.629464+0000","last_unstale":"2024-09-21T05:49:07.631162+0000","last_undegraded":"2024-09-21T05:49:07.631162+0000","last_fullsized":"2024-09-21T05:49:07.631162+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:58.222820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.627810+0000","last_change":"2024-09-21T05:47:05.629643+0000","last_active":"2024-09-21T05:49:07.627810+0000","last_peered":"2024-09-21T05:49:07.627810+0000","last_clean":"2024-09-21T05:49:07.627810+0000","last_became_active":"2024-09-21T05:47:05.629248+0000","last_became_peered":"2024-09-21T05:47:05.629248+0000","last_unstale":"2024-09-21T05:49:07.627810+0000","last_undegraded":"2024-09-21T05:49:07.627810+0000","last_fullsized":"2024-09-21T05:49:07.627810+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:31.569209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.618090+0000","last_change":"2024-09-21T05:47:05.632188+0000","last_active":"2024-09-21T05:49:07.618090+0000","last_peered":"2024-09-21T05:49:07.618090+0000","last_clean":"2024-09-21T05:49:07.618090+0000","last_became_active":"2024-09-21T05:47:05.631799+0000","last_became_peered":"2024-09-21T05:47:05.631799+0000","last_unstale":"2024-09-21T05:49:07.618090+0000","last_undegraded":"2024-09-21T05:49:07.618090+0000","last_fullsized":"2024-09-21T05:49:07.618090+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:09.762405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.641141+0000","last_change":"2024-09-21T05:47:05.644746+0000","last_active":"2024-09-21T05:49:07.641141+0000","last_peered":"2024-09-21T05:49:07.641141+0000","last_clean":"2024-09-21T05:49:07.641141+0000","last_became_active":"2024-09-21T05:47:05.644326+0000","last_became_peered":"2024-09-21T05:47:05.644326+0000","last_unstale":"2024-09-21T05:49:07.641141+0000","last_undegraded":"2024-09-21T05:49:07.641141+0000","last_fullsized":"2024-09-21T05:49:07.641141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:22.937783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.634476+0000","last_change":"2024-09-21T05:47:05.639214+0000","last_active":"2024-09-21T05:49:07.634476+0000","last_peered":"2024-09-21T05:49:07.634476+0000","last_clean":"2024-09-21T05:49:07.634476+0000","last_became_active":"2024-09-21T05:47:05.638443+0000","last_became_peered":"2024-09-21T05:47:05.638443+0000","last_unstale":"2024-09-21T05:49:07.634476+0000","last_undegraded":"2024-09-21T05:49:07.634476+0000","last_fullsized":"2024-09-21T05:49:07.634476+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:30.134020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.641271+0000","last_change":"2024-09-21T05:47:05.644233+0000","last_active":"2024-09-21T05:49:07.641271+0000","last_peered":"2024-09-21T05:49:07.641271+0000","last_clean":"2024-09-21T05:49:07.641271+0000","last_became_active":"2024-09-21T05:47:05.643820+0000","last_became_peered":"2024-09-21T05:47:05.643820+0000","last_unstale":"2024-09-21T05:49:07.641271+0000","last_undegraded":"2024-09-21T05:49:07.641271+0000","last_fullsized":"2024-09-21T05:49:07.641271+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:42.695997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.627033+0000","last_change":"2024-09-21T05:47:05.637569+0000","last_active":"2024-09-21T05:49:07.627033+0000","last_peered":"2024-09-21T05:49:07.627033+0000","last_clean":"2024-09-21T05:49:07.627033+0000","last_became_active":"2024-09-21T05:47:05.637269+0000","last_became_peered":"2024-09-21T05:47:05.637269+0000","last_unstale":"2024-09-21T05:49:07.627033+0000","last_undegraded":"2024-09-21T05:49:07.627033+0000","last_fullsized":"2024-09-21T05:49:07.627033+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:28:26.335398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.619263+0000","last_change":"2024-09-21T05:47:05.633457+0000","last_active":"2024-09-21T05:49:07.619263+0000","last_peered":"2024-09-21T05:49:07.619263+0000","last_clean":"2024-09-21T05:49:07.619263+0000","last_became_active":"2024-09-21T05:47:05.633066+0000","last_became_peered":"2024-09-21T05:47:05.633066+0000","last_unstale":"2024-09-21T05:49:07.619263+0000","last_undegraded":"2024-09-21T05:49:07.619263+0000","last_fullsized":"2024-09-21T05:49:07.619263+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:45.904152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.623492+0000","last_change":"2024-09-21T05:47:38.399914+0000","last_active":"2024-09-21T05:49:07.623492+0000","last_peered":"2024-09-21T05:49:07.623492+0000","last_clean":"2024-09-21T05:49:07.623492+0000","last_became_active":"2024-09-21T05:47:38.399480+0000","last_became_peered":"2024-09-21T05:47:38.399480+0000","last_unstale":"2024-09-21T05:49:07.623492+0000","last_undegraded":"2024-09-21T05:49:07.623492+0000","last_fullsized":"2024-09-21T05:49:07.623492+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:51.281796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.623723+0000","last_change":"2024-09-21T05:47:05.630944+0000","last_active":"2024-09-21T05:49:07.623723+0000","last_peered":"2024-09-21T05:49:07.623723+0000","last_clean":"2024-09-21T05:49:07.623723+0000","last_became_active":"2024-09-21T05:47:05.630498+0000","last_became_peered":"2024-09-21T05:47:05.630498+0000","last_unstale":"2024-09-21T05:49:07.623723+0000","last_undegraded":"2024-09-21T05:49:07.623723+0000","last_fullsized":"2024-09-21T05:49:07.623723+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:20.185094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.632028+0000","last_change":"2024-09-21T05:47:05.636134+0000","last_active":"2024-09-21T05:49:07.632028+0000","last_peered":"2024-09-21T05:49:07.632028+0000","last_clean":"2024-09-21T05:49:07.632028+0000","last_became_active":"2024-09-21T05:47:05.635724+0000","last_became_peered":"2024-09-21T05:47:05.635724+0000","last_unstale":"2024-09-21T05:49:07.632028+0000","last_undegraded":"2024-09-21T05:49:07.632028+0000","last_fullsized":"2024-09-21T05:49:07.632028+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:55.455819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.635816+0000","last_change":"2024-09-21T05:47:05.641209+0000","last_active":"2024-09-21T05:49:07.635816+0000","last_peered":"2024-09-21T05:49:07.635816+0000","last_clean":"2024-09-21T05:49:07.635816+0000","last_became_active":"2024-09-21T05:47:05.640543+0000","last_became_peered":"2024-09-21T05:47:05.640543+0000","last_unstale":"2024-09-21T05:49:07.635816+0000","last_undegraded":"2024-09-21T05:49:07.635816+0000","last_fullsized":"2024-09-21T05:49:07.635816+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:49.579724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.629794+0000","last_change":"2024-09-21T05:47:05.634158+0000","last_active":"2024-09-21T05:49:07.629794+0000","last_peered":"2024-09-21T05:49:07.629794+0000","last_clean":"2024-09-21T05:49:07.629794+0000","last_became_active":"2024-09-21T05:47:05.633657+0000","last_became_peered":"2024-09-21T05:47:05.633657+0000","last_unstale":"2024-09-21T05:49:07.629794+0000","last_undegraded":"2024-09-21T05:49:07.629794+0000","last_fullsized":"2024-09-21T05:49:07.629794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:37.868206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.642715+0000","last_change":"2024-09-21T05:47:05.641358+0000","last_active":"2024-09-21T05:49:07.642715+0000","last_peered":"2024-09-21T05:49:07.642715+0000","last_clean":"2024-09-21T05:49:07.642715+0000","last_became_active":"2024-09-21T05:47:05.641025+0000","last_became_peered":"2024-09-21T05:47:05.641025+0000","last_unstale":"2024-09-21T05:49:07.642715+0000","last_undegraded":"2024-09-21T05:49:07.642715+0000","last_fullsized":"2024-09-21T05:49:07.642715+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:01.654621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74401,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1059,"num_read_kb":611,"num_write":259,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":756,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":222217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":248927,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743467,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":489762,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939696,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1105920,"data_stored":1147533,"data_compressed":65650,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103221,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":489558,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299450,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":954368,"data_stored":489802,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495679,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":1086574,"data_compressed":65650,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659204,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":485062,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855434,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1028096,"data_stored":1082117,"data_compressed":65650,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051663,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":954368,"data_stored":489668,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247891,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":484770,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444121,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":553137,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607645,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":553175,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738466,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":486518,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34637,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34637,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34637,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36254,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36254,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36254,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36254,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":68835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":68729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T05:49:37.915 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T05:49:38.161 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:38.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:37 smithi070 ceph-mon[30981]: from='client.15513 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:49:38.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:37 smithi116 ceph-mon[34332]: from='client.15513 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:49:38.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:37 smithi160 ceph-mon[33979]: from='client.15513 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:49:38.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.663+0000 7fe6a56bd640 1 -- 172.21.15.70:0/2173963314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6a01083c0 msgr2=0x7fe6a01087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:38.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.663+0000 7fe6a56bd640 1 --2- 172.21.15.70:0/2173963314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6a01083c0 0x7fe6a01087d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe688009900 tx=0x7fe68802a410 comp rx=0 tx=0).stop 2024-09-21T05:49:38.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.663+0000 7fe6a56bd640 1 -- 172.21.15.70:0/2173963314 shutdown_connections 2024-09-21T05:49:38.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.663+0000 7fe6a56bd640 1 --2- 172.21.15.70:0/2173963314 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6a0108d10 0x7fe6a010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:38.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.663+0000 7fe6a56bd640 1 --2- 172.21.15.70:0/2173963314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6a01083c0 0x7fe6a01087d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:38.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.663+0000 7fe6a56bd640 1 --2- 172.21.15.70:0/2173963314 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe6a0102a80 0x7fe6a0102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:38.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.663+0000 7fe6a56bd640 1 -- 172.21.15.70:0/2173963314 >> 172.21.15.70:0/2173963314 conn(0x7fe6a0079740 msgr2=0x7fe6a0079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:38.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.663+0000 7fe6a56bd640 1 -- 172.21.15.70:0/2173963314 shutdown_connections 2024-09-21T05:49:38.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.663+0000 7fe6a56bd640 1 -- 172.21.15.70:0/2173963314 wait complete. 2024-09-21T05:49:38.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.664+0000 7fe6a56bd640 1 Processor -- start 2024-09-21T05:49:38.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.664+0000 7fe6a56bd640 1 -- start start 2024-09-21T05:49:38.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.664+0000 7fe6a56bd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6a0102a80 0x7fe6a019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:38.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.664+0000 7fe6a56bd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe6a01083c0 0x7fe6a019aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:38.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.664+0000 7fe6a56bd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6a0108d10 0x7fe6a019fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:38.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.665+0000 7fe6a56bd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a0112950 con 0x7fe6a0102a80 2024-09-21T05:49:38.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.665+0000 7fe6a56bd640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a01127d0 con 0x7fe6a01083c0 2024-09-21T05:49:38.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.665+0000 7fe6a56bd640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a0112ad0 con 0x7fe6a0108d10 2024-09-21T05:49:38.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.665+0000 7fe69effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6a0102a80 0x7fe6a019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:38.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.665+0000 7fe69effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6a0102a80 0x7fe6a019a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48376/0 (socket says 172.21.15.70:48376) 2024-09-21T05:49:38.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.665+0000 7fe69effd640 1 -- 172.21.15.70:0/2154986195 learned_addr learned my addr 172.21.15.70:0/2154986195 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:38.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.665+0000 7fe6967fc640 1 --2- 172.21.15.70:0/2154986195 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe6a01083c0 0x7fe6a019aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:38.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.665+0000 7fe69f7fe640 1 --2- 172.21.15.70:0/2154986195 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6a0108d10 0x7fe6a019fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:38.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.665+0000 7fe69effd640 1 -- 172.21.15.70:0/2154986195 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6a0108d10 msgr2=0x7fe6a019fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:38.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.665+0000 7fe69effd640 1 --2- 172.21.15.70:0/2154986195 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6a0108d10 0x7fe6a019fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:38.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.665+0000 7fe69effd640 1 -- 172.21.15.70:0/2154986195 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe6a01083c0 msgr2=0x7fe6a019aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:38.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.665+0000 7fe69effd640 1 --2- 172.21.15.70:0/2154986195 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe6a01083c0 0x7fe6a019aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:38.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.665+0000 7fe69effd640 1 -- 172.21.15.70:0/2154986195 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a01a03e0 con 0x7fe6a0102a80 2024-09-21T05:49:38.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.665+0000 7fe69f7fe640 1 --2- 172.21.15.70:0/2154986195 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6a0108d10 0x7fe6a019fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:38.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.665+0000 7fe69effd640 1 --2- 172.21.15.70:0/2154986195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6a0102a80 0x7fe6a019a470 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe69000eab0 tx=0x7fe69000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:38.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.665+0000 7fe69cff9640 1 -- 172.21.15.70:0/2154986195 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69000ce40 con 0x7fe6a0102a80 2024-09-21T05:49:38.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.665+0000 7fe69cff9640 1 -- 172.21.15.70:0/2154986195 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fe690011920 con 0x7fe6a0102a80 2024-09-21T05:49:38.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.665+0000 7fe6a56bd640 1 -- 172.21.15.70:0/2154986195 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6a01a06d0 con 0x7fe6a0102a80 2024-09-21T05:49:38.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.665+0000 7fe69cff9640 1 -- 172.21.15.70:0/2154986195 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6900109e0 con 0x7fe6a0102a80 2024-09-21T05:49:38.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.665+0000 7fe6a56bd640 1 -- 172.21.15.70:0/2154986195 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6a00ff570 con 0x7fe6a0102a80 2024-09-21T05:49:38.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.666+0000 7fe6a56bd640 1 -- 172.21.15.70:0/2154986195 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6a0103d00 con 0x7fe6a0102a80 2024-09-21T05:49:38.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.668+0000 7fe69cff9640 1 -- 172.21.15.70:0/2154986195 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) ==== 154563+0+0 (secure 0 0 0) 0x7fe690011ad0 con 0x7fe6a0102a80 2024-09-21T05:49:38.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.669+0000 7fe69cff9640 1 --2- 172.21.15.70:0/2154986195 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe68c0b65a0 0x7fe68c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:38.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.669+0000 7fe6967fc640 1 --2- 172.21.15.70:0/2154986195 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe68c0b65a0 0x7fe68c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:38.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.669+0000 7fe69cff9640 1 -- 172.21.15.70:0/2154986195 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fe6900e7eb0 con 0x7fe6a0102a80 2024-09-21T05:49:38.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.669+0000 7fe6967fc640 1 --2- 172.21.15.70:0/2154986195 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe68c0b65a0 0x7fe68c0b8ab0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe688000c00 tx=0x7fe688005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:38.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.672+0000 7fe69cff9640 1 -- 172.21.15.70:0/2154986195 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe690016030 con 0x7fe6a0102a80 2024-09-21T05:49:38.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.848+0000 7fe6a56bd640 1 -- 172.21.15.70:0/2154986195 --> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe6a010bb50 con 0x7fe68c0b65a0 2024-09-21T05:49:38.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.853+0000 7fe69cff9640 1 -- 172.21.15.70:0/2154986195 <== mgr.14150 v2:172.21.15.70:6800/1366013939 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340781 (secure 0 0 0) 0x7fe6a010bb50 con 0x7fe68c0b65a0 2024-09-21T05:49:38.859 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:49:38.860 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-21T05:49:38.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.857+0000 7fe6a56bd640 1 -- 172.21.15.70:0/2154986195 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe68c0b65a0 msgr2=0x7fe68c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:38.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.857+0000 7fe6a56bd640 1 --2- 172.21.15.70:0/2154986195 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe68c0b65a0 0x7fe68c0b8ab0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe688000c00 tx=0x7fe688005d50 comp rx=0 tx=0).stop 2024-09-21T05:49:38.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.857+0000 7fe6a56bd640 1 -- 172.21.15.70:0/2154986195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6a0102a80 msgr2=0x7fe6a019a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:38.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.857+0000 7fe6a56bd640 1 --2- 172.21.15.70:0/2154986195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6a0102a80 0x7fe6a019a470 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe69000eab0 tx=0x7fe69000ef70 comp rx=0 tx=0).stop 2024-09-21T05:49:38.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.857+0000 7fe6a56bd640 1 -- 172.21.15.70:0/2154986195 shutdown_connections 2024-09-21T05:49:38.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.857+0000 7fe6a56bd640 1 --2- 172.21.15.70:0/2154986195 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fe68c0b65a0 0x7fe68c0b8ab0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:38.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.857+0000 7fe6a56bd640 1 --2- 172.21.15.70:0/2154986195 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6a0108d10 0x7fe6a019fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:38.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.857+0000 7fe6a56bd640 1 --2- 172.21.15.70:0/2154986195 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe6a01083c0 0x7fe6a019aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:38.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.857+0000 7fe6a56bd640 1 --2- 172.21.15.70:0/2154986195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6a0102a80 0x7fe6a019a470 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:38.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.857+0000 7fe6a56bd640 1 -- 172.21.15.70:0/2154986195 >> 172.21.15.70:0/2154986195 conn(0x7fe6a0079740 msgr2=0x7fe6a006bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:38.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.857+0000 7fe6a56bd640 1 -- 172.21.15.70:0/2154986195 shutdown_connections 2024-09-21T05:49:38.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:38.857+0000 7fe6a56bd640 1 -- 172.21.15.70:0/2154986195 wait complete. 2024-09-21T05:49:39.154 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:38 smithi070 ceph-mon[30981]: pgmap v375: 129 pgs: 129 active+clean; 655 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-09-21T05:49:39.154 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:38 smithi070 ceph-mon[30981]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-09-21T05:49:39.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:38 smithi116 ceph-mon[34332]: pgmap v375: 129 pgs: 129 active+clean; 655 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-09-21T05:49:39.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:38 smithi116 ceph-mon[34332]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-09-21T05:49:39.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:38 smithi160 ceph-mon[33979]: pgmap v375: 129 pgs: 129 active+clean; 655 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-09-21T05:49:39.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:38 smithi160 ceph-mon[33979]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-09-21T05:49:39.507 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":375,"stamp":"2024-09-21T05:49:37.437188+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":670729,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1162,"num_read_kb":692,"num_write":393,"num_write_kb":2317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":2952596,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":824,"ondisk_log_size":824,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":352576,"kb_used_data":11648,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124589248,"statfs":{"total":1151940427776,"available":1151579389952,"internally_reserved":0,"allocated":11927552,"data_stored":7842113,"data_compressed":461514,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19143,"internal_metadata":348894521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6712,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":69,"num_write":14,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003418"},"pg_stats":[{"pgid":"2.1f","version":"83'13","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:30.722305+0000","last_change":"2024-09-21T05:47:03.620705+0000","last_active":"2024-09-21T05:49:30.722305+0000","last_peered":"2024-09-21T05:49:30.722305+0000","last_clean":"2024-09-21T05:49:30.722305+0000","last_became_active":"2024-09-21T05:47:03.620320+0000","last_became_peered":"2024-09-21T05:47:03.620320+0000","last_unstale":"2024-09-21T05:49:30.722305+0000","last_undegraded":"2024-09-21T05:49:30.722305+0000","last_fullsized":"2024-09-21T05:49:30.722305+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:31.684225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.610588+0000","last_change":"2024-09-21T05:47:05.637251+0000","last_active":"2024-09-21T05:49:07.610588+0000","last_peered":"2024-09-21T05:49:07.610588+0000","last_clean":"2024-09-21T05:49:07.610588+0000","last_became_active":"2024-09-21T05:47:05.636867+0000","last_became_peered":"2024-09-21T05:47:05.636867+0000","last_unstale":"2024-09-21T05:49:07.610588+0000","last_undegraded":"2024-09-21T05:49:07.610588+0000","last_fullsized":"2024-09-21T05:49:07.610588+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:08.538209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715529+0000","last_change":"2024-09-21T05:47:12.676224+0000","last_active":"2024-09-21T05:48:38.715529+0000","last_peered":"2024-09-21T05:48:38.715529+0000","last_clean":"2024-09-21T05:48:38.715529+0000","last_became_active":"2024-09-21T05:47:12.675565+0000","last_became_peered":"2024-09-21T05:47:12.675565+0000","last_unstale":"2024-09-21T05:48:38.715529+0000","last_undegraded":"2024-09-21T05:48:38.715529+0000","last_fullsized":"2024-09-21T05:48:38.715529+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:37.684953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285902+0000","last_change":"2024-09-21T05:47:03.670289+0000","last_active":"2024-09-21T05:48:39.285902+0000","last_peered":"2024-09-21T05:48:39.285902+0000","last_clean":"2024-09-21T05:48:39.285902+0000","last_became_active":"2024-09-21T05:47:03.669881+0000","last_became_peered":"2024-09-21T05:47:03.669881+0000","last_unstale":"2024-09-21T05:48:39.285902+0000","last_undegraded":"2024-09-21T05:48:39.285902+0000","last_fullsized":"2024-09-21T05:48:39.285902+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:12.597766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.641716+0000","last_change":"2024-09-21T05:47:05.640826+0000","last_active":"2024-09-21T05:49:07.641716+0000","last_peered":"2024-09-21T05:49:07.641716+0000","last_clean":"2024-09-21T05:49:07.641716+0000","last_became_active":"2024-09-21T05:47:05.640357+0000","last_became_peered":"2024-09-21T05:47:05.640357+0000","last_unstale":"2024-09-21T05:49:07.641716+0000","last_undegraded":"2024-09-21T05:49:07.641716+0000","last_fullsized":"2024-09-21T05:49:07.641716+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:16.434030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721134+0000","last_change":"2024-09-21T05:47:12.677260+0000","last_active":"2024-09-21T05:48:38.721134+0000","last_peered":"2024-09-21T05:48:38.721134+0000","last_clean":"2024-09-21T05:48:38.721134+0000","last_became_active":"2024-09-21T05:47:12.676599+0000","last_became_peered":"2024-09-21T05:47:12.676599+0000","last_unstale":"2024-09-21T05:48:38.721134+0000","last_undegraded":"2024-09-21T05:48:38.721134+0000","last_fullsized":"2024-09-21T05:48:38.721134+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:10.644801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.722508+0000","last_change":"2024-09-21T05:47:03.619903+0000","last_active":"2024-09-21T05:48:38.722508+0000","last_peered":"2024-09-21T05:48:38.722508+0000","last_clean":"2024-09-21T05:48:38.722508+0000","last_became_active":"2024-09-21T05:47:03.619476+0000","last_became_peered":"2024-09-21T05:47:03.619476+0000","last_unstale":"2024-09-21T05:48:38.722508+0000","last_undegraded":"2024-09-21T05:48:38.722508+0000","last_fullsized":"2024-09-21T05:48:38.722508+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:09.717552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.639721+0000","last_change":"2024-09-21T05:47:05.646017+0000","last_active":"2024-09-21T05:49:07.639721+0000","last_peered":"2024-09-21T05:49:07.639721+0000","last_clean":"2024-09-21T05:49:07.639721+0000","last_became_active":"2024-09-21T05:47:05.644118+0000","last_became_peered":"2024-09-21T05:47:05.644118+0000","last_unstale":"2024-09-21T05:49:07.639721+0000","last_undegraded":"2024-09-21T05:49:07.639721+0000","last_fullsized":"2024-09-21T05:49:07.639721+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:52.908664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721813+0000","last_change":"2024-09-21T05:47:12.677555+0000","last_active":"2024-09-21T05:48:38.721813+0000","last_peered":"2024-09-21T05:48:38.721813+0000","last_clean":"2024-09-21T05:48:38.721813+0000","last_became_active":"2024-09-21T05:47:12.676886+0000","last_became_peered":"2024-09-21T05:47:12.676886+0000","last_unstale":"2024-09-21T05:48:38.721813+0000","last_undegraded":"2024-09-21T05:48:38.721813+0000","last_fullsized":"2024-09-21T05:48:38.721813+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:10:24.516641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.723169+0000","last_change":"2024-09-21T05:47:03.621556+0000","last_active":"2024-09-21T05:48:38.723169+0000","last_peered":"2024-09-21T05:48:38.723169+0000","last_clean":"2024-09-21T05:48:38.723169+0000","last_became_active":"2024-09-21T05:47:03.621101+0000","last_became_peered":"2024-09-21T05:47:03.621101+0000","last_unstale":"2024-09-21T05:48:38.723169+0000","last_undegraded":"2024-09-21T05:48:38.723169+0000","last_fullsized":"2024-09-21T05:48:38.723169+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:39:23.639431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.636755+0000","last_change":"2024-09-21T05:47:05.646328+0000","last_active":"2024-09-21T05:49:07.636755+0000","last_peered":"2024-09-21T05:49:07.636755+0000","last_clean":"2024-09-21T05:49:07.636755+0000","last_became_active":"2024-09-21T05:47:05.645922+0000","last_became_peered":"2024-09-21T05:47:05.645922+0000","last_unstale":"2024-09-21T05:49:07.636755+0000","last_undegraded":"2024-09-21T05:49:07.636755+0000","last_fullsized":"2024-09-21T05:49:07.636755+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:43.801707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721553+0000","last_change":"2024-09-21T05:47:12.673555+0000","last_active":"2024-09-21T05:48:38.721553+0000","last_peered":"2024-09-21T05:48:38.721553+0000","last_clean":"2024-09-21T05:48:38.721553+0000","last_became_active":"2024-09-21T05:47:12.673065+0000","last_became_peered":"2024-09-21T05:47:12.673065+0000","last_unstale":"2024-09-21T05:48:38.721553+0000","last_undegraded":"2024-09-21T05:48:38.721553+0000","last_fullsized":"2024-09-21T05:48:38.721553+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:53.548779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.642240+0000","last_change":"2024-09-21T05:47:05.645376+0000","last_active":"2024-09-21T05:49:07.642240+0000","last_peered":"2024-09-21T05:49:07.642240+0000","last_clean":"2024-09-21T05:49:07.642240+0000","last_became_active":"2024-09-21T05:47:05.644800+0000","last_became_peered":"2024-09-21T05:47:05.644800+0000","last_unstale":"2024-09-21T05:49:07.642240+0000","last_undegraded":"2024-09-21T05:49:07.642240+0000","last_fullsized":"2024-09-21T05:49:07.642240+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:10.460407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720709+0000","last_change":"2024-09-21T05:47:03.619926+0000","last_active":"2024-09-21T05:48:38.720709+0000","last_peered":"2024-09-21T05:48:38.720709+0000","last_clean":"2024-09-21T05:48:38.720709+0000","last_became_active":"2024-09-21T05:47:03.619433+0000","last_became_peered":"2024-09-21T05:47:03.619433+0000","last_unstale":"2024-09-21T05:48:38.720709+0000","last_undegraded":"2024-09-21T05:48:38.720709+0000","last_fullsized":"2024-09-21T05:48:38.720709+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:33.792874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721980+0000","last_change":"2024-09-21T05:47:12.874200+0000","last_active":"2024-09-21T05:48:38.721980+0000","last_peered":"2024-09-21T05:48:38.721980+0000","last_clean":"2024-09-21T05:48:38.721980+0000","last_became_active":"2024-09-21T05:47:12.873563+0000","last_became_peered":"2024-09-21T05:47:12.873563+0000","last_unstale":"2024-09-21T05:48:38.721980+0000","last_undegraded":"2024-09-21T05:48:38.721980+0000","last_fullsized":"2024-09-21T05:48:38.721980+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:34.839934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.628678+0000","last_change":"2024-09-21T05:47:05.639033+0000","last_active":"2024-09-21T05:49:07.628678+0000","last_peered":"2024-09-21T05:49:07.628678+0000","last_clean":"2024-09-21T05:49:07.628678+0000","last_became_active":"2024-09-21T05:47:05.637433+0000","last_became_peered":"2024-09-21T05:47:05.637433+0000","last_unstale":"2024-09-21T05:49:07.628678+0000","last_undegraded":"2024-09-21T05:49:07.628678+0000","last_fullsized":"2024-09-21T05:49:07.628678+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:55.181025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"85'4","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:15.090942+0000","last_change":"2024-09-21T05:47:03.614460+0000","last_active":"2024-09-21T05:49:15.090942+0000","last_peered":"2024-09-21T05:49:15.090942+0000","last_clean":"2024-09-21T05:49:15.090942+0000","last_became_active":"2024-09-21T05:47:03.613975+0000","last_became_peered":"2024-09-21T05:47:03.613975+0000","last_unstale":"2024-09-21T05:49:15.090942+0000","last_undegraded":"2024-09-21T05:49:15.090942+0000","last_fullsized":"2024-09-21T05:49:15.090942+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:26.838907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721823+0000","last_change":"2024-09-21T05:47:38.733044+0000","last_active":"2024-09-21T05:48:38.721823+0000","last_peered":"2024-09-21T05:48:38.721823+0000","last_clean":"2024-09-21T05:48:38.721823+0000","last_became_active":"2024-09-21T05:47:38.732327+0000","last_became_peered":"2024-09-21T05:47:38.732327+0000","last_unstale":"2024-09-21T05:48:38.721823+0000","last_undegraded":"2024-09-21T05:48:38.721823+0000","last_fullsized":"2024-09-21T05:48:38.721823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:59.462529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.636196+0000","last_change":"2024-09-21T05:47:05.631831+0000","last_active":"2024-09-21T05:49:07.636196+0000","last_peered":"2024-09-21T05:49:07.636196+0000","last_clean":"2024-09-21T05:49:07.636196+0000","last_became_active":"2024-09-21T05:47:05.630403+0000","last_became_peered":"2024-09-21T05:47:05.630403+0000","last_unstale":"2024-09-21T05:49:07.636196+0000","last_undegraded":"2024-09-21T05:49:07.636196+0000","last_fullsized":"2024-09-21T05:49:07.636196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:21.163262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285563+0000","last_change":"2024-09-21T05:47:03.618888+0000","last_active":"2024-09-21T05:48:39.285563+0000","last_peered":"2024-09-21T05:48:39.285563+0000","last_clean":"2024-09-21T05:48:39.285563+0000","last_became_active":"2024-09-21T05:47:03.618506+0000","last_became_peered":"2024-09-21T05:47:03.618506+0000","last_unstale":"2024-09-21T05:48:39.285563+0000","last_undegraded":"2024-09-21T05:48:39.285563+0000","last_fullsized":"2024-09-21T05:48:39.285563+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:52.711976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714872+0000","last_change":"2024-09-21T05:47:12.675649+0000","last_active":"2024-09-21T05:48:38.714872+0000","last_peered":"2024-09-21T05:48:38.714872+0000","last_clean":"2024-09-21T05:48:38.714872+0000","last_became_active":"2024-09-21T05:47:12.675268+0000","last_became_peered":"2024-09-21T05:47:12.675268+0000","last_unstale":"2024-09-21T05:48:38.714872+0000","last_undegraded":"2024-09-21T05:48:38.714872+0000","last_fullsized":"2024-09-21T05:48:38.714872+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:48:31.481292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.622094+0000","last_change":"2024-09-21T05:47:05.622838+0000","last_active":"2024-09-21T05:49:07.622094+0000","last_peered":"2024-09-21T05:49:07.622094+0000","last_clean":"2024-09-21T05:49:07.622094+0000","last_became_active":"2024-09-21T05:47:05.622216+0000","last_became_peered":"2024-09-21T05:47:05.622216+0000","last_unstale":"2024-09-21T05:49:07.622094+0000","last_undegraded":"2024-09-21T05:49:07.622094+0000","last_fullsized":"2024-09-21T05:49:07.622094+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:55.446747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715282+0000","last_change":"2024-09-21T05:47:03.670405+0000","last_active":"2024-09-21T05:48:38.715282+0000","last_peered":"2024-09-21T05:48:38.715282+0000","last_clean":"2024-09-21T05:48:38.715282+0000","last_became_active":"2024-09-21T05:47:03.669958+0000","last_became_peered":"2024-09-21T05:47:03.669958+0000","last_unstale":"2024-09-21T05:48:38.715282+0000","last_undegraded":"2024-09-21T05:48:38.715282+0000","last_fullsized":"2024-09-21T05:48:38.715282+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:25.702903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.722260+0000","last_change":"2024-09-21T05:47:38.399039+0000","last_active":"2024-09-21T05:48:38.722260+0000","last_peered":"2024-09-21T05:48:38.722260+0000","last_clean":"2024-09-21T05:48:38.722260+0000","last_became_active":"2024-09-21T05:47:38.398441+0000","last_became_peered":"2024-09-21T05:47:38.398441+0000","last_unstale":"2024-09-21T05:48:38.722260+0000","last_undegraded":"2024-09-21T05:48:38.722260+0000","last_fullsized":"2024-09-21T05:48:38.722260+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:11.095516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,8],"acting":[4,5,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.628678+0000","last_change":"2024-09-21T05:47:05.632911+0000","last_active":"2024-09-21T05:49:07.628678+0000","last_peered":"2024-09-21T05:49:07.628678+0000","last_clean":"2024-09-21T05:49:07.628678+0000","last_became_active":"2024-09-21T05:47:05.632256+0000","last_became_peered":"2024-09-21T05:47:05.632256+0000","last_unstale":"2024-09-21T05:49:07.628678+0000","last_undegraded":"2024-09-21T05:49:07.628678+0000","last_fullsized":"2024-09-21T05:49:07.628678+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:41.014253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.722379+0000","last_change":"2024-09-21T05:47:04.411753+0000","last_active":"2024-09-21T05:48:38.722379+0000","last_peered":"2024-09-21T05:48:38.722379+0000","last_clean":"2024-09-21T05:48:38.722379+0000","last_became_active":"2024-09-21T05:47:04.411225+0000","last_became_peered":"2024-09-21T05:47:04.411225+0000","last_unstale":"2024-09-21T05:48:38.722379+0000","last_undegraded":"2024-09-21T05:48:38.722379+0000","last_fullsized":"2024-09-21T05:48:38.722379+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:07.964184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715699+0000","last_change":"2024-09-21T05:47:12.670157+0000","last_active":"2024-09-21T05:48:38.715699+0000","last_peered":"2024-09-21T05:48:38.715699+0000","last_clean":"2024-09-21T05:48:38.715699+0000","last_became_active":"2024-09-21T05:47:12.669710+0000","last_became_peered":"2024-09-21T05:47:12.669710+0000","last_unstale":"2024-09-21T05:48:38.715699+0000","last_undegraded":"2024-09-21T05:48:38.715699+0000","last_fullsized":"2024-09-21T05:48:38.715699+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:31.023624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.635898+0000","last_change":"2024-09-21T05:47:05.637982+0000","last_active":"2024-09-21T05:49:07.635898+0000","last_peered":"2024-09-21T05:49:07.635898+0000","last_clean":"2024-09-21T05:49:07.635898+0000","last_became_active":"2024-09-21T05:47:05.637357+0000","last_became_peered":"2024-09-21T05:47:05.637357+0000","last_unstale":"2024-09-21T05:49:07.635898+0000","last_undegraded":"2024-09-21T05:49:07.635898+0000","last_fullsized":"2024-09-21T05:49:07.635898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:41:12.986231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'16","reported_seq":55,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.640929+0000","last_change":"2024-09-21T05:47:03.611556+0000","last_active":"2024-09-21T05:49:07.640929+0000","last_peered":"2024-09-21T05:49:07.640929+0000","last_clean":"2024-09-21T05:49:07.640929+0000","last_became_active":"2024-09-21T05:47:03.611192+0000","last_became_peered":"2024-09-21T05:47:03.611192+0000","last_unstale":"2024-09-21T05:49:07.640929+0000","last_undegraded":"2024-09-21T05:49:07.640929+0000","last_fullsized":"2024-09-21T05:49:07.640929+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:20.047405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285259+0000","last_change":"2024-09-21T05:47:12.874796+0000","last_active":"2024-09-21T05:48:39.285259+0000","last_peered":"2024-09-21T05:48:39.285259+0000","last_clean":"2024-09-21T05:48:39.285259+0000","last_became_active":"2024-09-21T05:47:12.873648+0000","last_became_peered":"2024-09-21T05:47:12.873648+0000","last_unstale":"2024-09-21T05:48:39.285259+0000","last_undegraded":"2024-09-21T05:48:39.285259+0000","last_fullsized":"2024-09-21T05:48:39.285259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:50.591584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.624967+0000","last_change":"2024-09-21T05:47:05.634289+0000","last_active":"2024-09-21T05:49:07.624967+0000","last_peered":"2024-09-21T05:49:07.624967+0000","last_clean":"2024-09-21T05:49:07.624967+0000","last_became_active":"2024-09-21T05:47:05.633971+0000","last_became_peered":"2024-09-21T05:47:05.633971+0000","last_unstale":"2024-09-21T05:49:07.624967+0000","last_undegraded":"2024-09-21T05:49:07.624967+0000","last_fullsized":"2024-09-21T05:49:07.624967+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:53.819753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.722647+0000","last_change":"2024-09-21T05:47:03.671877+0000","last_active":"2024-09-21T05:48:38.722647+0000","last_peered":"2024-09-21T05:48:38.722647+0000","last_clean":"2024-09-21T05:48:38.722647+0000","last_became_active":"2024-09-21T05:47:03.671443+0000","last_became_peered":"2024-09-21T05:47:03.671443+0000","last_unstale":"2024-09-21T05:48:38.722647+0000","last_undegraded":"2024-09-21T05:48:38.722647+0000","last_fullsized":"2024-09-21T05:48:38.722647+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:00.114953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.717912+0000","last_change":"2024-09-21T05:47:12.673004+0000","last_active":"2024-09-21T05:48:38.717912+0000","last_peered":"2024-09-21T05:48:38.717912+0000","last_clean":"2024-09-21T05:48:38.717912+0000","last_became_active":"2024-09-21T05:47:12.671784+0000","last_became_peered":"2024-09-21T05:47:12.671784+0000","last_unstale":"2024-09-21T05:48:38.717912+0000","last_undegraded":"2024-09-21T05:48:38.717912+0000","last_fullsized":"2024-09-21T05:48:38.717912+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:38.672438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"85'4","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.624238+0000","last_change":"2024-09-21T05:47:05.635204+0000","last_active":"2024-09-21T05:49:07.624238+0000","last_peered":"2024-09-21T05:49:07.624238+0000","last_clean":"2024-09-21T05:49:07.624238+0000","last_became_active":"2024-09-21T05:47:05.634794+0000","last_became_peered":"2024-09-21T05:47:05.634794+0000","last_unstale":"2024-09-21T05:49:07.624238+0000","last_undegraded":"2024-09-21T05:49:07.624238+0000","last_fullsized":"2024-09-21T05:49:07.624238+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:08.208843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714687+0000","last_change":"2024-09-21T05:47:03.671864+0000","last_active":"2024-09-21T05:48:38.714687+0000","last_peered":"2024-09-21T05:48:38.714687+0000","last_clean":"2024-09-21T05:48:38.714687+0000","last_became_active":"2024-09-21T05:47:03.671510+0000","last_became_peered":"2024-09-21T05:47:03.671510+0000","last_unstale":"2024-09-21T05:48:38.714687+0000","last_undegraded":"2024-09-21T05:48:38.714687+0000","last_fullsized":"2024-09-21T05:48:38.714687+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:12.831235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720724+0000","last_change":"2024-09-21T05:47:38.398708+0000","last_active":"2024-09-21T05:48:38.720724+0000","last_peered":"2024-09-21T05:48:38.720724+0000","last_clean":"2024-09-21T05:48:38.720724+0000","last_became_active":"2024-09-21T05:47:38.398211+0000","last_became_peered":"2024-09-21T05:47:38.398211+0000","last_unstale":"2024-09-21T05:48:38.720724+0000","last_undegraded":"2024-09-21T05:48:38.720724+0000","last_fullsized":"2024-09-21T05:48:38.720724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:29.250191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.621266+0000","last_change":"2024-09-21T05:47:05.633069+0000","last_active":"2024-09-21T05:49:07.621266+0000","last_peered":"2024-09-21T05:49:07.621266+0000","last_clean":"2024-09-21T05:49:07.621266+0000","last_became_active":"2024-09-21T05:47:05.632698+0000","last_became_peered":"2024-09-21T05:47:05.632698+0000","last_unstale":"2024-09-21T05:49:07.621266+0000","last_undegraded":"2024-09-21T05:49:07.621266+0000","last_fullsized":"2024-09-21T05:49:07.621266+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:04.081062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'6","reported_seq":154,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:34.728120+0000","last_change":"2024-09-21T05:47:03.622490+0000","last_active":"2024-09-21T05:49:34.728120+0000","last_peered":"2024-09-21T05:49:34.728120+0000","last_clean":"2024-09-21T05:49:34.728120+0000","last_became_active":"2024-09-21T05:47:03.622093+0000","last_became_peered":"2024-09-21T05:47:03.622093+0000","last_unstale":"2024-09-21T05:49:34.728120+0000","last_undegraded":"2024-09-21T05:49:34.728120+0000","last_fullsized":"2024-09-21T05:49:34.728120+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:40.500152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.432807+0000","last_change":"2024-09-21T05:47:12.670060+0000","last_active":"2024-09-21T05:48:39.432807+0000","last_peered":"2024-09-21T05:48:39.432807+0000","last_clean":"2024-09-21T05:48:39.432807+0000","last_became_active":"2024-09-21T05:47:12.669635+0000","last_became_peered":"2024-09-21T05:47:12.669635+0000","last_unstale":"2024-09-21T05:48:39.432807+0000","last_undegraded":"2024-09-21T05:48:39.432807+0000","last_fullsized":"2024-09-21T05:48:39.432807+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:14.786984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.633745+0000","last_change":"2024-09-21T05:47:05.640553+0000","last_active":"2024-09-21T05:49:07.633745+0000","last_peered":"2024-09-21T05:49:07.633745+0000","last_clean":"2024-09-21T05:49:07.633745+0000","last_became_active":"2024-09-21T05:47:05.640151+0000","last_became_peered":"2024-09-21T05:47:05.640151+0000","last_unstale":"2024-09-21T05:49:07.633745+0000","last_undegraded":"2024-09-21T05:49:07.633745+0000","last_fullsized":"2024-09-21T05:49:07.633745+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:39.904129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'7","reported_seq":152,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:33.719448+0000","last_change":"2024-09-21T05:47:03.670178+0000","last_active":"2024-09-21T05:49:33.719448+0000","last_peered":"2024-09-21T05:49:33.719448+0000","last_clean":"2024-09-21T05:49:33.719448+0000","last_became_active":"2024-09-21T05:47:03.669715+0000","last_became_peered":"2024-09-21T05:47:03.669715+0000","last_unstale":"2024-09-21T05:49:33.719448+0000","last_undegraded":"2024-09-21T05:49:33.719448+0000","last_fullsized":"2024-09-21T05:49:33.719448+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:31.457820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.433018+0000","last_change":"2024-09-21T05:47:12.875173+0000","last_active":"2024-09-21T05:48:39.433018+0000","last_peered":"2024-09-21T05:48:39.433018+0000","last_clean":"2024-09-21T05:48:39.433018+0000","last_became_active":"2024-09-21T05:47:12.873749+0000","last_became_peered":"2024-09-21T05:47:12.873749+0000","last_unstale":"2024-09-21T05:48:39.433018+0000","last_undegraded":"2024-09-21T05:48:39.433018+0000","last_fullsized":"2024-09-21T05:48:39.433018+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:33.473645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.625006+0000","last_change":"2024-09-21T05:47:05.634346+0000","last_active":"2024-09-21T05:49:07.625006+0000","last_peered":"2024-09-21T05:49:07.625006+0000","last_clean":"2024-09-21T05:49:07.625006+0000","last_became_active":"2024-09-21T05:47:05.634004+0000","last_became_peered":"2024-09-21T05:47:05.634004+0000","last_unstale":"2024-09-21T05:49:07.625006+0000","last_undegraded":"2024-09-21T05:49:07.625006+0000","last_fullsized":"2024-09-21T05:49:07.625006+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:16.328729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.717785+0000","last_change":"2024-09-21T05:47:03.619472+0000","last_active":"2024-09-21T05:48:38.717785+0000","last_peered":"2024-09-21T05:48:38.717785+0000","last_clean":"2024-09-21T05:48:38.717785+0000","last_became_active":"2024-09-21T05:47:03.619077+0000","last_became_peered":"2024-09-21T05:47:03.619077+0000","last_unstale":"2024-09-21T05:48:38.717785+0000","last_undegraded":"2024-09-21T05:48:38.717785+0000","last_fullsized":"2024-09-21T05:48:38.717785+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:17.774462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.722547+0000","last_change":"2024-09-21T05:47:38.730714+0000","last_active":"2024-09-21T05:48:38.722547+0000","last_peered":"2024-09-21T05:48:38.722547+0000","last_clean":"2024-09-21T05:48:38.722547+0000","last_became_active":"2024-09-21T05:47:38.730271+0000","last_became_peered":"2024-09-21T05:47:38.730271+0000","last_unstale":"2024-09-21T05:48:38.722547+0000","last_undegraded":"2024-09-21T05:48:38.722547+0000","last_fullsized":"2024-09-21T05:48:38.722547+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:53.391967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.624355+0000","last_change":"2024-09-21T05:47:05.642487+0000","last_active":"2024-09-21T05:49:07.624355+0000","last_peered":"2024-09-21T05:49:07.624355+0000","last_clean":"2024-09-21T05:49:07.624355+0000","last_became_active":"2024-09-21T05:47:05.642022+0000","last_became_peered":"2024-09-21T05:47:05.642022+0000","last_unstale":"2024-09-21T05:49:07.624355+0000","last_undegraded":"2024-09-21T05:49:07.624355+0000","last_fullsized":"2024-09-21T05:49:07.624355+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:50:38.435444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721983+0000","last_change":"2024-09-21T05:47:03.618333+0000","last_active":"2024-09-21T05:48:38.721983+0000","last_peered":"2024-09-21T05:48:38.721983+0000","last_clean":"2024-09-21T05:48:38.721983+0000","last_became_active":"2024-09-21T05:47:03.617843+0000","last_became_peered":"2024-09-21T05:47:03.617843+0000","last_unstale":"2024-09-21T05:48:38.721983+0000","last_undegraded":"2024-09-21T05:48:38.721983+0000","last_fullsized":"2024-09-21T05:48:38.721983+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:01.647913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":115,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718194+0000","last_change":"2024-09-21T05:45:52.661435+0000","last_active":"2024-09-21T05:48:38.718194+0000","last_peered":"2024-09-21T05:48:38.718194+0000","last_clean":"2024-09-21T05:48:38.718194+0000","last_became_active":"2024-09-21T05:45:52.656767+0000","last_became_peered":"2024-09-21T05:45:52.656767+0000","last_unstale":"2024-09-21T05:48:38.718194+0000","last_undegraded":"2024-09-21T05:48:38.718194+0000","last_fullsized":"2024-09-21T05:48:38.718194+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:42:26.045146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:42:26.045146+0000","last_clean_scrub_stamp":"2024-09-21T05:42:26.045146+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:40:12.152499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718152+0000","last_change":"2024-09-21T05:47:12.675435+0000","last_active":"2024-09-21T05:48:38.718152+0000","last_peered":"2024-09-21T05:48:38.718152+0000","last_clean":"2024-09-21T05:48:38.718152+0000","last_became_active":"2024-09-21T05:47:12.674955+0000","last_became_peered":"2024-09-21T05:47:12.674955+0000","last_unstale":"2024-09-21T05:48:38.718152+0000","last_undegraded":"2024-09-21T05:48:38.718152+0000","last_fullsized":"2024-09-21T05:48:38.718152+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:18.758498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.641204+0000","last_change":"2024-09-21T05:47:05.640952+0000","last_active":"2024-09-21T05:49:07.641204+0000","last_peered":"2024-09-21T05:49:07.641204+0000","last_clean":"2024-09-21T05:49:07.641204+0000","last_became_active":"2024-09-21T05:47:05.640554+0000","last_became_peered":"2024-09-21T05:47:05.640554+0000","last_unstale":"2024-09-21T05:49:07.641204+0000","last_undegraded":"2024-09-21T05:49:07.641204+0000","last_fullsized":"2024-09-21T05:49:07.641204+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:15:08.553651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'6","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:33.731323+0000","last_change":"2024-09-21T05:47:04.411605+0000","last_active":"2024-09-21T05:49:33.731323+0000","last_peered":"2024-09-21T05:49:33.731323+0000","last_clean":"2024-09-21T05:49:33.731323+0000","last_became_active":"2024-09-21T05:47:04.411129+0000","last_became_peered":"2024-09-21T05:47:04.411129+0000","last_unstale":"2024-09-21T05:49:33.731323+0000","last_undegraded":"2024-09-21T05:49:33.731323+0000","last_fullsized":"2024-09-21T05:49:33.731323+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:25.469148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1663,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715316+0000","last_change":"2024-09-21T05:47:12.670479+0000","last_active":"2024-09-21T05:48:38.715316+0000","last_peered":"2024-09-21T05:48:38.715316+0000","last_clean":"2024-09-21T05:48:38.715316+0000","last_became_active":"2024-09-21T05:47:12.669925+0000","last_became_peered":"2024-09-21T05:47:12.669925+0000","last_unstale":"2024-09-21T05:48:38.715316+0000","last_undegraded":"2024-09-21T05:48:38.715316+0000","last_fullsized":"2024-09-21T05:48:38.715316+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:50.506063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.624710+0000","last_change":"2024-09-21T05:47:05.634519+0000","last_active":"2024-09-21T05:49:07.624710+0000","last_peered":"2024-09-21T05:49:07.624710+0000","last_clean":"2024-09-21T05:49:07.624710+0000","last_became_active":"2024-09-21T05:47:05.634134+0000","last_became_peered":"2024-09-21T05:47:05.634134+0000","last_unstale":"2024-09-21T05:49:07.624710+0000","last_undegraded":"2024-09-21T05:49:07.624710+0000","last_fullsized":"2024-09-21T05:49:07.624710+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:57.464884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721394+0000","last_change":"2024-09-21T05:47:03.622860+0000","last_active":"2024-09-21T05:48:38.721394+0000","last_peered":"2024-09-21T05:48:38.721394+0000","last_clean":"2024-09-21T05:48:38.721394+0000","last_became_active":"2024-09-21T05:47:03.622435+0000","last_became_peered":"2024-09-21T05:47:03.622435+0000","last_unstale":"2024-09-21T05:48:38.721394+0000","last_undegraded":"2024-09-21T05:48:38.721394+0000","last_fullsized":"2024-09-21T05:48:38.721394+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:03.352140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720211+0000","last_change":"2024-09-21T05:47:12.673518+0000","last_active":"2024-09-21T05:48:38.720211+0000","last_peered":"2024-09-21T05:48:38.720211+0000","last_clean":"2024-09-21T05:48:38.720211+0000","last_became_active":"2024-09-21T05:47:12.673000+0000","last_became_peered":"2024-09-21T05:47:12.673000+0000","last_unstale":"2024-09-21T05:48:38.720211+0000","last_undegraded":"2024-09-21T05:48:38.720211+0000","last_fullsized":"2024-09-21T05:48:38.720211+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:37.859801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.628136+0000","last_change":"2024-09-21T05:47:05.625144+0000","last_active":"2024-09-21T05:49:07.628136+0000","last_peered":"2024-09-21T05:49:07.628136+0000","last_clean":"2024-09-21T05:49:07.628136+0000","last_became_active":"2024-09-21T05:47:05.624593+0000","last_became_peered":"2024-09-21T05:47:05.624593+0000","last_unstale":"2024-09-21T05:49:07.628136+0000","last_undegraded":"2024-09-21T05:49:07.628136+0000","last_fullsized":"2024-09-21T05:49:07.628136+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:04.332686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.433072+0000","last_change":"2024-09-21T05:47:03.612389+0000","last_active":"2024-09-21T05:48:39.433072+0000","last_peered":"2024-09-21T05:48:39.433072+0000","last_clean":"2024-09-21T05:48:39.433072+0000","last_became_active":"2024-09-21T05:47:03.612023+0000","last_became_peered":"2024-09-21T05:47:03.612023+0000","last_unstale":"2024-09-21T05:48:39.433072+0000","last_undegraded":"2024-09-21T05:48:39.433072+0000","last_fullsized":"2024-09-21T05:48:39.433072+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:32.571903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721160+0000","last_change":"2024-09-21T05:47:12.674963+0000","last_active":"2024-09-21T05:48:38.721160+0000","last_peered":"2024-09-21T05:48:38.721160+0000","last_clean":"2024-09-21T05:48:38.721160+0000","last_became_active":"2024-09-21T05:47:12.673883+0000","last_became_peered":"2024-09-21T05:47:12.673883+0000","last_unstale":"2024-09-21T05:48:38.721160+0000","last_undegraded":"2024-09-21T05:48:38.721160+0000","last_fullsized":"2024-09-21T05:48:38.721160+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:29.843443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.634245+0000","last_change":"2024-09-21T05:47:05.638440+0000","last_active":"2024-09-21T05:49:07.634245+0000","last_peered":"2024-09-21T05:49:07.634245+0000","last_clean":"2024-09-21T05:49:07.634245+0000","last_became_active":"2024-09-21T05:47:05.638010+0000","last_became_peered":"2024-09-21T05:47:05.638010+0000","last_unstale":"2024-09-21T05:49:07.634245+0000","last_undegraded":"2024-09-21T05:49:07.634245+0000","last_fullsized":"2024-09-21T05:49:07.634245+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:47.921461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:41.931234+0000","last_change":"2024-09-21T05:48:38.742314+0000","last_active":"2024-09-21T05:48:41.931234+0000","last_peered":"2024-09-21T05:48:41.931234+0000","last_clean":"2024-09-21T05:48:41.931234+0000","last_became_active":"2024-09-21T05:48:38.723546+0000","last_became_peered":"2024-09-21T05:48:38.723546+0000","last_unstale":"2024-09-21T05:48:41.931234+0000","last_undegraded":"2024-09-21T05:48:41.931234+0000","last_fullsized":"2024-09-21T05:48:41.931234+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:12.911309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.719825+0000","last_change":"2024-09-21T05:47:12.675362+0000","last_active":"2024-09-21T05:48:38.719825+0000","last_peered":"2024-09-21T05:48:38.719825+0000","last_clean":"2024-09-21T05:48:38.719825+0000","last_became_active":"2024-09-21T05:47:12.674578+0000","last_became_peered":"2024-09-21T05:47:12.674578+0000","last_unstale":"2024-09-21T05:48:38.719825+0000","last_undegraded":"2024-09-21T05:48:38.719825+0000","last_fullsized":"2024-09-21T05:48:38.719825+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:56.654323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.636309+0000","last_change":"2024-09-21T05:47:05.641130+0000","last_active":"2024-09-21T05:49:07.636309+0000","last_peered":"2024-09-21T05:49:07.636309+0000","last_clean":"2024-09-21T05:49:07.636309+0000","last_became_active":"2024-09-21T05:47:05.640794+0000","last_became_peered":"2024-09-21T05:47:05.640794+0000","last_unstale":"2024-09-21T05:49:07.636309+0000","last_undegraded":"2024-09-21T05:49:07.636309+0000","last_fullsized":"2024-09-21T05:49:07.636309+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:29:18.243240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.738576+0000","last_change":"2024-09-21T05:48:38.737941+0000","last_active":"2024-09-21T05:48:38.738576+0000","last_peered":"2024-09-21T05:48:38.738576+0000","last_clean":"2024-09-21T05:48:38.738576+0000","last_became_active":"2024-09-21T05:48:38.722769+0000","last_became_peered":"2024-09-21T05:48:38.722769+0000","last_unstale":"2024-09-21T05:48:38.738576+0000","last_undegraded":"2024-09-21T05:48:38.738576+0000","last_fullsized":"2024-09-21T05:48:38.738576+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:24.258822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.432974+0000","last_change":"2024-09-21T05:47:12.671181+0000","last_active":"2024-09-21T05:48:39.432974+0000","last_peered":"2024-09-21T05:48:39.432974+0000","last_clean":"2024-09-21T05:48:39.432974+0000","last_became_active":"2024-09-21T05:47:12.670522+0000","last_became_peered":"2024-09-21T05:47:12.670522+0000","last_unstale":"2024-09-21T05:48:39.432974+0000","last_undegraded":"2024-09-21T05:48:39.432974+0000","last_fullsized":"2024-09-21T05:48:39.432974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:52.165812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.631652+0000","last_change":"2024-09-21T05:47:05.629167+0000","last_active":"2024-09-21T05:49:07.631652+0000","last_peered":"2024-09-21T05:49:07.631652+0000","last_clean":"2024-09-21T05:49:07.631652+0000","last_became_active":"2024-09-21T05:47:05.628794+0000","last_became_peered":"2024-09-21T05:47:05.628794+0000","last_unstale":"2024-09-21T05:49:07.631652+0000","last_undegraded":"2024-09-21T05:49:07.631652+0000","last_fullsized":"2024-09-21T05:49:07.631652+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:51.469247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'7","reported_seq":154,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:31.720341+0000","last_change":"2024-09-21T05:47:03.621479+0000","last_active":"2024-09-21T05:49:31.720341+0000","last_peered":"2024-09-21T05:49:31.720341+0000","last_clean":"2024-09-21T05:49:31.720341+0000","last_became_active":"2024-09-21T05:47:03.621041+0000","last_became_peered":"2024-09-21T05:47:03.621041+0000","last_unstale":"2024-09-21T05:49:31.720341+0000","last_undegraded":"2024-09-21T05:49:31.720341+0000","last_fullsized":"2024-09-21T05:49:31.720341+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:33.092750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714842+0000","last_change":"2024-09-21T05:47:12.669821+0000","last_active":"2024-09-21T05:48:38.714842+0000","last_peered":"2024-09-21T05:48:38.714842+0000","last_clean":"2024-09-21T05:48:38.714842+0000","last_became_active":"2024-09-21T05:47:12.669418+0000","last_became_peered":"2024-09-21T05:47:12.669418+0000","last_unstale":"2024-09-21T05:48:38.714842+0000","last_undegraded":"2024-09-21T05:48:38.714842+0000","last_fullsized":"2024-09-21T05:48:38.714842+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:57.082509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.625480+0000","last_change":"2024-09-21T05:47:05.631182+0000","last_active":"2024-09-21T05:49:07.625480+0000","last_peered":"2024-09-21T05:49:07.625480+0000","last_clean":"2024-09-21T05:49:07.625480+0000","last_became_active":"2024-09-21T05:47:05.630716+0000","last_became_peered":"2024-09-21T05:47:05.630716+0000","last_unstale":"2024-09-21T05:49:07.625480+0000","last_undegraded":"2024-09-21T05:49:07.625480+0000","last_fullsized":"2024-09-21T05:49:07.625480+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:17.946858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720774+0000","last_change":"2024-09-21T05:47:03.620897+0000","last_active":"2024-09-21T05:48:38.720774+0000","last_peered":"2024-09-21T05:48:38.720774+0000","last_clean":"2024-09-21T05:48:38.720774+0000","last_became_active":"2024-09-21T05:47:03.620003+0000","last_became_peered":"2024-09-21T05:47:03.620003+0000","last_unstale":"2024-09-21T05:48:38.720774+0000","last_undegraded":"2024-09-21T05:48:38.720774+0000","last_fullsized":"2024-09-21T05:48:38.720774+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:51:07.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718144+0000","last_change":"2024-09-21T05:47:12.675320+0000","last_active":"2024-09-21T05:48:38.718144+0000","last_peered":"2024-09-21T05:48:38.718144+0000","last_clean":"2024-09-21T05:48:38.718144+0000","last_became_active":"2024-09-21T05:47:12.674715+0000","last_became_peered":"2024-09-21T05:47:12.674715+0000","last_unstale":"2024-09-21T05:48:38.718144+0000","last_undegraded":"2024-09-21T05:48:38.718144+0000","last_fullsized":"2024-09-21T05:48:38.718144+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:28.151947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.624754+0000","last_change":"2024-09-21T05:47:05.630786+0000","last_active":"2024-09-21T05:49:07.624754+0000","last_peered":"2024-09-21T05:49:07.624754+0000","last_clean":"2024-09-21T05:49:07.624754+0000","last_became_active":"2024-09-21T05:47:05.630433+0000","last_became_peered":"2024-09-21T05:47:05.630433+0000","last_unstale":"2024-09-21T05:49:07.624754+0000","last_undegraded":"2024-09-21T05:49:07.624754+0000","last_fullsized":"2024-09-21T05:49:07.624754+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:54.481462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.716342+0000","last_change":"2024-09-21T05:47:03.618990+0000","last_active":"2024-09-21T05:48:38.716342+0000","last_peered":"2024-09-21T05:48:38.716342+0000","last_clean":"2024-09-21T05:48:38.716342+0000","last_became_active":"2024-09-21T05:47:03.618679+0000","last_became_peered":"2024-09-21T05:47:03.618679+0000","last_unstale":"2024-09-21T05:48:38.716342+0000","last_undegraded":"2024-09-21T05:48:38.716342+0000","last_fullsized":"2024-09-21T05:48:38.716342+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:10.193233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721027+0000","last_change":"2024-09-21T05:47:12.675012+0000","last_active":"2024-09-21T05:48:38.721027+0000","last_peered":"2024-09-21T05:48:38.721027+0000","last_clean":"2024-09-21T05:48:38.721027+0000","last_became_active":"2024-09-21T05:47:12.674266+0000","last_became_peered":"2024-09-21T05:47:12.674266+0000","last_unstale":"2024-09-21T05:48:38.721027+0000","last_undegraded":"2024-09-21T05:48:38.721027+0000","last_fullsized":"2024-09-21T05:48:38.721027+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:43.525084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.623333+0000","last_change":"2024-09-21T05:47:05.625457+0000","last_active":"2024-09-21T05:49:07.623333+0000","last_peered":"2024-09-21T05:49:07.623333+0000","last_clean":"2024-09-21T05:49:07.623333+0000","last_became_active":"2024-09-21T05:47:05.625058+0000","last_became_peered":"2024-09-21T05:47:05.625058+0000","last_unstale":"2024-09-21T05:49:07.623333+0000","last_undegraded":"2024-09-21T05:49:07.623333+0000","last_fullsized":"2024-09-21T05:49:07.623333+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:29:09.352152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'41","reported_seq":303,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:36.132254+0000","last_change":"2024-09-21T05:47:03.621535+0000","last_active":"2024-09-21T05:49:36.132254+0000","last_peered":"2024-09-21T05:49:36.132254+0000","last_clean":"2024-09-21T05:49:36.132254+0000","last_became_active":"2024-09-21T05:47:03.621109+0000","last_became_peered":"2024-09-21T05:47:03.621109+0000","last_unstale":"2024-09-21T05:49:36.132254+0000","last_undegraded":"2024-09-21T05:49:36.132254+0000","last_fullsized":"2024-09-21T05:49:36.132254+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:31:12.135760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71694,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":223,"num_read_kb":177,"num_write":43,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714429+0000","last_change":"2024-09-21T05:47:12.676827+0000","last_active":"2024-09-21T05:48:38.714429+0000","last_peered":"2024-09-21T05:48:38.714429+0000","last_clean":"2024-09-21T05:48:38.714429+0000","last_became_active":"2024-09-21T05:47:12.676256+0000","last_became_peered":"2024-09-21T05:47:12.676256+0000","last_unstale":"2024-09-21T05:48:38.714429+0000","last_undegraded":"2024-09-21T05:48:38.714429+0000","last_fullsized":"2024-09-21T05:48:38.714429+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:40.932328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.642888+0000","last_change":"2024-09-21T05:47:05.636507+0000","last_active":"2024-09-21T05:49:07.642888+0000","last_peered":"2024-09-21T05:49:07.642888+0000","last_clean":"2024-09-21T05:49:07.642888+0000","last_became_active":"2024-09-21T05:47:05.636140+0000","last_became_peered":"2024-09-21T05:47:05.636140+0000","last_unstale":"2024-09-21T05:49:07.642888+0000","last_undegraded":"2024-09-21T05:49:07.642888+0000","last_fullsized":"2024-09-21T05:49:07.642888+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:16.879274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721493+0000","last_change":"2024-09-21T05:47:03.670425+0000","last_active":"2024-09-21T05:48:38.721493+0000","last_peered":"2024-09-21T05:48:38.721493+0000","last_clean":"2024-09-21T05:48:38.721493+0000","last_became_active":"2024-09-21T05:47:03.669973+0000","last_became_peered":"2024-09-21T05:47:03.669973+0000","last_unstale":"2024-09-21T05:48:38.721493+0000","last_undegraded":"2024-09-21T05:48:38.721493+0000","last_fullsized":"2024-09-21T05:48:38.721493+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:04.212044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721656+0000","last_change":"2024-09-21T05:47:12.677600+0000","last_active":"2024-09-21T05:48:38.721656+0000","last_peered":"2024-09-21T05:48:38.721656+0000","last_clean":"2024-09-21T05:48:38.721656+0000","last_became_active":"2024-09-21T05:47:12.677037+0000","last_became_peered":"2024-09-21T05:47:12.677037+0000","last_unstale":"2024-09-21T05:48:38.721656+0000","last_undegraded":"2024-09-21T05:48:38.721656+0000","last_fullsized":"2024-09-21T05:48:38.721656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:36.502821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.632646+0000","last_change":"2024-09-21T05:47:38.398403+0000","last_active":"2024-09-21T05:49:07.632646+0000","last_peered":"2024-09-21T05:49:07.632646+0000","last_clean":"2024-09-21T05:49:07.632646+0000","last_became_active":"2024-09-21T05:47:38.397953+0000","last_became_peered":"2024-09-21T05:47:38.397953+0000","last_unstale":"2024-09-21T05:49:07.632646+0000","last_undegraded":"2024-09-21T05:49:07.632646+0000","last_fullsized":"2024-09-21T05:49:07.632646+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:01.550222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":57,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.728525+0000","last_change":"2024-09-21T05:48:38.727813+0000","last_active":"2024-09-21T05:48:38.728525+0000","last_peered":"2024-09-21T05:48:38.728525+0000","last_clean":"2024-09-21T05:48:38.728525+0000","last_became_active":"2024-09-21T05:48:38.722709+0000","last_became_peered":"2024-09-21T05:48:38.722709+0000","last_unstale":"2024-09-21T05:48:38.728525+0000","last_undegraded":"2024-09-21T05:48:38.728525+0000","last_fullsized":"2024-09-21T05:48:38.728525+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:22.544711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714262+0000","last_change":"2024-09-21T05:47:12.670466+0000","last_active":"2024-09-21T05:48:38.714262+0000","last_peered":"2024-09-21T05:48:38.714262+0000","last_clean":"2024-09-21T05:48:38.714262+0000","last_became_active":"2024-09-21T05:47:12.670032+0000","last_became_peered":"2024-09-21T05:47:12.670032+0000","last_unstale":"2024-09-21T05:48:38.714262+0000","last_undegraded":"2024-09-21T05:48:38.714262+0000","last_fullsized":"2024-09-21T05:48:38.714262+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:18.860347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.642591+0000","last_change":"2024-09-21T05:47:05.645093+0000","last_active":"2024-09-21T05:49:07.642591+0000","last_peered":"2024-09-21T05:49:07.642591+0000","last_clean":"2024-09-21T05:49:07.642591+0000","last_became_active":"2024-09-21T05:47:05.644739+0000","last_became_peered":"2024-09-21T05:47:05.644739+0000","last_unstale":"2024-09-21T05:49:07.642591+0000","last_undegraded":"2024-09-21T05:49:07.642591+0000","last_fullsized":"2024-09-21T05:49:07.642591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:43.895574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"85'6","reported_seq":257,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:35.733384+0000","last_change":"2024-09-21T05:47:03.619070+0000","last_active":"2024-09-21T05:49:35.733384+0000","last_peered":"2024-09-21T05:49:35.733384+0000","last_clean":"2024-09-21T05:49:35.733384+0000","last_became_active":"2024-09-21T05:47:03.618655+0000","last_became_peered":"2024-09-21T05:47:03.618655+0000","last_unstale":"2024-09-21T05:49:35.733384+0000","last_undegraded":"2024-09-21T05:49:35.733384+0000","last_fullsized":"2024-09-21T05:49:35.733384+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:29.206109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":212,"num_read_kb":212,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285369+0000","last_change":"2024-09-21T05:47:12.672677+0000","last_active":"2024-09-21T05:48:39.285369+0000","last_peered":"2024-09-21T05:48:39.285369+0000","last_clean":"2024-09-21T05:48:39.285369+0000","last_became_active":"2024-09-21T05:47:12.672264+0000","last_became_peered":"2024-09-21T05:47:12.672264+0000","last_unstale":"2024-09-21T05:48:39.285369+0000","last_undegraded":"2024-09-21T05:48:39.285369+0000","last_fullsized":"2024-09-21T05:48:39.285369+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:31.680678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720292+0000","last_change":"2024-09-21T05:47:12.672702+0000","last_active":"2024-09-21T05:48:38.720292+0000","last_peered":"2024-09-21T05:48:38.720292+0000","last_clean":"2024-09-21T05:48:38.720292+0000","last_became_active":"2024-09-21T05:47:12.672233+0000","last_became_peered":"2024-09-21T05:47:12.672233+0000","last_unstale":"2024-09-21T05:48:38.720292+0000","last_undegraded":"2024-09-21T05:48:38.720292+0000","last_fullsized":"2024-09-21T05:48:38.720292+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:04.235603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.622178+0000","last_change":"2024-09-21T05:47:05.633566+0000","last_active":"2024-09-21T05:49:07.622178+0000","last_peered":"2024-09-21T05:49:07.622178+0000","last_clean":"2024-09-21T05:49:07.622178+0000","last_became_active":"2024-09-21T05:47:05.633240+0000","last_became_peered":"2024-09-21T05:47:05.633240+0000","last_unstale":"2024-09-21T05:49:07.622178+0000","last_undegraded":"2024-09-21T05:49:07.622178+0000","last_fullsized":"2024-09-21T05:49:07.622178+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:10.106647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721511+0000","last_change":"2024-09-21T05:47:03.621788+0000","last_active":"2024-09-21T05:48:38.721511+0000","last_peered":"2024-09-21T05:48:38.721511+0000","last_clean":"2024-09-21T05:48:38.721511+0000","last_became_active":"2024-09-21T05:47:03.621425+0000","last_became_peered":"2024-09-21T05:47:03.621425+0000","last_unstale":"2024-09-21T05:48:38.721511+0000","last_undegraded":"2024-09-21T05:48:38.721511+0000","last_fullsized":"2024-09-21T05:48:38.721511+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:51.069361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718187+0000","last_change":"2024-09-21T05:47:12.670670+0000","last_active":"2024-09-21T05:48:38.718187+0000","last_peered":"2024-09-21T05:48:38.718187+0000","last_clean":"2024-09-21T05:48:38.718187+0000","last_became_active":"2024-09-21T05:47:12.670192+0000","last_became_peered":"2024-09-21T05:47:12.670192+0000","last_unstale":"2024-09-21T05:48:38.718187+0000","last_undegraded":"2024-09-21T05:48:38.718187+0000","last_fullsized":"2024-09-21T05:48:38.718187+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:59.430991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.635898+0000","last_change":"2024-09-21T05:47:05.637775+0000","last_active":"2024-09-21T05:49:07.635898+0000","last_peered":"2024-09-21T05:49:07.635898+0000","last_clean":"2024-09-21T05:49:07.635898+0000","last_became_active":"2024-09-21T05:47:05.637436+0000","last_became_peered":"2024-09-21T05:47:05.637436+0000","last_unstale":"2024-09-21T05:49:07.635898+0000","last_undegraded":"2024-09-21T05:49:07.635898+0000","last_fullsized":"2024-09-21T05:49:07.635898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:45:59.041879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.432553+0000","last_change":"2024-09-21T05:47:03.611317+0000","last_active":"2024-09-21T05:48:39.432553+0000","last_peered":"2024-09-21T05:48:39.432553+0000","last_clean":"2024-09-21T05:48:39.432553+0000","last_became_active":"2024-09-21T05:47:03.610967+0000","last_became_peered":"2024-09-21T05:47:03.610967+0000","last_unstale":"2024-09-21T05:48:39.432553+0000","last_undegraded":"2024-09-21T05:48:39.432553+0000","last_fullsized":"2024-09-21T05:48:39.432553+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:44.263380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.286190+0000","last_change":"2024-09-21T05:47:03.624584+0000","last_active":"2024-09-21T05:48:39.286190+0000","last_peered":"2024-09-21T05:48:39.286190+0000","last_clean":"2024-09-21T05:48:39.286190+0000","last_became_active":"2024-09-21T05:47:03.623886+0000","last_became_peered":"2024-09-21T05:47:03.623886+0000","last_unstale":"2024-09-21T05:48:39.286190+0000","last_undegraded":"2024-09-21T05:48:39.286190+0000","last_fullsized":"2024-09-21T05:48:39.286190+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:55.451732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.628759+0000","last_change":"2024-09-21T05:47:38.731762+0000","last_active":"2024-09-21T05:49:07.628759+0000","last_peered":"2024-09-21T05:49:07.628759+0000","last_clean":"2024-09-21T05:49:07.628759+0000","last_became_active":"2024-09-21T05:47:38.731325+0000","last_became_peered":"2024-09-21T05:47:38.731325+0000","last_unstale":"2024-09-21T05:49:07.628759+0000","last_undegraded":"2024-09-21T05:49:07.628759+0000","last_fullsized":"2024-09-21T05:49:07.628759+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:42.516434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715948+0000","last_change":"2024-09-21T05:47:12.677198+0000","last_active":"2024-09-21T05:48:38.715948+0000","last_peered":"2024-09-21T05:48:38.715948+0000","last_clean":"2024-09-21T05:48:38.715948+0000","last_became_active":"2024-09-21T05:47:12.676673+0000","last_became_peered":"2024-09-21T05:47:12.676673+0000","last_unstale":"2024-09-21T05:48:38.715948+0000","last_undegraded":"2024-09-21T05:48:38.715948+0000","last_fullsized":"2024-09-21T05:48:38.715948+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:58.861348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":165,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:33.806517+0000","last_change":"2024-09-21T05:48:38.730420+0000","last_active":"2024-09-21T05:49:33.806517+0000","last_peered":"2024-09-21T05:49:33.806517+0000","last_clean":"2024-09-21T05:49:33.806517+0000","last_became_active":"2024-09-21T05:48:38.722303+0000","last_became_peered":"2024-09-21T05:48:38.722303+0000","last_unstale":"2024-09-21T05:49:33.806517+0000","last_undegraded":"2024-09-21T05:49:33.806517+0000","last_fullsized":"2024-09-21T05:49:33.806517+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:37.846446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1115,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.626911+0000","last_change":"2024-09-21T05:47:05.641444+0000","last_active":"2024-09-21T05:49:07.626911+0000","last_peered":"2024-09-21T05:49:07.626911+0000","last_clean":"2024-09-21T05:49:07.626911+0000","last_became_active":"2024-09-21T05:47:05.640967+0000","last_became_peered":"2024-09-21T05:47:05.640967+0000","last_unstale":"2024-09-21T05:49:07.626911+0000","last_undegraded":"2024-09-21T05:49:07.626911+0000","last_fullsized":"2024-09-21T05:49:07.626911+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:20.698467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.716537+0000","last_change":"2024-09-21T05:47:12.680157+0000","last_active":"2024-09-21T05:48:38.716537+0000","last_peered":"2024-09-21T05:48:38.716537+0000","last_clean":"2024-09-21T05:48:38.716537+0000","last_became_active":"2024-09-21T05:47:12.679604+0000","last_became_peered":"2024-09-21T05:47:12.679604+0000","last_unstale":"2024-09-21T05:48:38.716537+0000","last_undegraded":"2024-09-21T05:48:38.716537+0000","last_fullsized":"2024-09-21T05:48:38.716537+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:15.381901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.636056+0000","last_change":"2024-09-21T05:47:05.635022+0000","last_active":"2024-09-21T05:49:07.636056+0000","last_peered":"2024-09-21T05:49:07.636056+0000","last_clean":"2024-09-21T05:49:07.636056+0000","last_became_active":"2024-09-21T05:47:05.634592+0000","last_became_peered":"2024-09-21T05:47:05.634592+0000","last_unstale":"2024-09-21T05:49:07.636056+0000","last_undegraded":"2024-09-21T05:49:07.636056+0000","last_fullsized":"2024-09-21T05:49:07.636056+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:48.159339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.634884+0000","last_change":"2024-09-21T05:48:38.722629+0000","last_active":"2024-09-21T05:49:07.634884+0000","last_peered":"2024-09-21T05:49:07.634884+0000","last_clean":"2024-09-21T05:49:07.634884+0000","last_became_active":"2024-09-21T05:48:38.722198+0000","last_became_peered":"2024-09-21T05:48:38.722198+0000","last_unstale":"2024-09-21T05:49:07.634884+0000","last_undegraded":"2024-09-21T05:49:07.634884+0000","last_fullsized":"2024-09-21T05:49:07.634884+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:26.126710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.628191+0000","last_change":"2024-09-21T05:47:05.637359+0000","last_active":"2024-09-21T05:49:07.628191+0000","last_peered":"2024-09-21T05:49:07.628191+0000","last_clean":"2024-09-21T05:49:07.628191+0000","last_became_active":"2024-09-21T05:47:05.636998+0000","last_became_peered":"2024-09-21T05:47:05.636998+0000","last_unstale":"2024-09-21T05:49:07.628191+0000","last_undegraded":"2024-09-21T05:49:07.628191+0000","last_fullsized":"2024-09-21T05:49:07.628191+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:06.186344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.629417+0000","last_change":"2024-09-21T05:47:05.633304+0000","last_active":"2024-09-21T05:49:07.629417+0000","last_peered":"2024-09-21T05:49:07.629417+0000","last_clean":"2024-09-21T05:49:07.629417+0000","last_became_active":"2024-09-21T05:47:05.632919+0000","last_became_peered":"2024-09-21T05:47:05.632919+0000","last_unstale":"2024-09-21T05:49:07.629417+0000","last_undegraded":"2024-09-21T05:49:07.629417+0000","last_fullsized":"2024-09-21T05:49:07.629417+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:16.108908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.629183+0000","last_change":"2024-09-21T05:47:05.631091+0000","last_active":"2024-09-21T05:49:07.629183+0000","last_peered":"2024-09-21T05:49:07.629183+0000","last_clean":"2024-09-21T05:49:07.629183+0000","last_became_active":"2024-09-21T05:47:05.630740+0000","last_became_peered":"2024-09-21T05:47:05.630740+0000","last_unstale":"2024-09-21T05:49:07.629183+0000","last_undegraded":"2024-09-21T05:49:07.629183+0000","last_fullsized":"2024-09-21T05:49:07.629183+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:36:41.136890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.631663+0000","last_change":"2024-09-21T05:47:38.398773+0000","last_active":"2024-09-21T05:49:07.631663+0000","last_peered":"2024-09-21T05:49:07.631663+0000","last_clean":"2024-09-21T05:49:07.631663+0000","last_became_active":"2024-09-21T05:47:38.398378+0000","last_became_peered":"2024-09-21T05:47:38.398378+0000","last_unstale":"2024-09-21T05:49:07.631663+0000","last_undegraded":"2024-09-21T05:49:07.631663+0000","last_fullsized":"2024-09-21T05:49:07.631663+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:32.247222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.636377+0000","last_change":"2024-09-21T05:47:05.641782+0000","last_active":"2024-09-21T05:49:07.636377+0000","last_peered":"2024-09-21T05:49:07.636377+0000","last_clean":"2024-09-21T05:49:07.636377+0000","last_became_active":"2024-09-21T05:47:05.641422+0000","last_became_peered":"2024-09-21T05:47:05.641422+0000","last_unstale":"2024-09-21T05:49:07.636377+0000","last_undegraded":"2024-09-21T05:49:07.636377+0000","last_fullsized":"2024-09-21T05:49:07.636377+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:33.819329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.621247+0000","last_change":"2024-09-21T05:47:38.396070+0000","last_active":"2024-09-21T05:49:07.621247+0000","last_peered":"2024-09-21T05:49:07.621247+0000","last_clean":"2024-09-21T05:49:07.621247+0000","last_became_active":"2024-09-21T05:47:38.395727+0000","last_became_peered":"2024-09-21T05:47:38.395727+0000","last_unstale":"2024-09-21T05:49:07.621247+0000","last_undegraded":"2024-09-21T05:49:07.621247+0000","last_fullsized":"2024-09-21T05:49:07.621247+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:41.816692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.628368+0000","last_change":"2024-09-21T05:47:05.633701+0000","last_active":"2024-09-21T05:49:07.628368+0000","last_peered":"2024-09-21T05:49:07.628368+0000","last_clean":"2024-09-21T05:49:07.628368+0000","last_became_active":"2024-09-21T05:47:05.632671+0000","last_became_peered":"2024-09-21T05:47:05.632671+0000","last_unstale":"2024-09-21T05:49:07.628368+0000","last_undegraded":"2024-09-21T05:49:07.628368+0000","last_fullsized":"2024-09-21T05:49:07.628368+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:56.180731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.635725+0000","last_change":"2024-09-21T05:47:05.639419+0000","last_active":"2024-09-21T05:49:07.635725+0000","last_peered":"2024-09-21T05:49:07.635725+0000","last_clean":"2024-09-21T05:49:07.635725+0000","last_became_active":"2024-09-21T05:47:05.639060+0000","last_became_peered":"2024-09-21T05:47:05.639060+0000","last_unstale":"2024-09-21T05:49:07.635725+0000","last_undegraded":"2024-09-21T05:49:07.635725+0000","last_fullsized":"2024-09-21T05:49:07.635725+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:09.562359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.642658+0000","last_change":"2024-09-21T05:47:05.641218+0000","last_active":"2024-09-21T05:49:07.642658+0000","last_peered":"2024-09-21T05:49:07.642658+0000","last_clean":"2024-09-21T05:49:07.642658+0000","last_became_active":"2024-09-21T05:47:05.640813+0000","last_became_peered":"2024-09-21T05:47:05.640813+0000","last_unstale":"2024-09-21T05:49:07.642658+0000","last_undegraded":"2024-09-21T05:49:07.642658+0000","last_fullsized":"2024-09-21T05:49:07.642658+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:21.057096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.629873+0000","last_change":"2024-09-21T05:47:05.627711+0000","last_active":"2024-09-21T05:49:07.629873+0000","last_peered":"2024-09-21T05:49:07.629873+0000","last_clean":"2024-09-21T05:49:07.629873+0000","last_became_active":"2024-09-21T05:47:05.626394+0000","last_became_peered":"2024-09-21T05:47:05.626394+0000","last_unstale":"2024-09-21T05:49:07.629873+0000","last_undegraded":"2024-09-21T05:49:07.629873+0000","last_fullsized":"2024-09-21T05:49:07.629873+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:31.038727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.636028+0000","last_change":"2024-09-21T05:47:05.632835+0000","last_active":"2024-09-21T05:49:07.636028+0000","last_peered":"2024-09-21T05:49:07.636028+0000","last_clean":"2024-09-21T05:49:07.636028+0000","last_became_active":"2024-09-21T05:47:05.632486+0000","last_became_peered":"2024-09-21T05:47:05.632486+0000","last_unstale":"2024-09-21T05:49:07.636028+0000","last_undegraded":"2024-09-21T05:49:07.636028+0000","last_fullsized":"2024-09-21T05:49:07.636028+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:04.365517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.626287+0000","last_change":"2024-09-21T05:47:05.638381+0000","last_active":"2024-09-21T05:49:07.626287+0000","last_peered":"2024-09-21T05:49:07.626287+0000","last_clean":"2024-09-21T05:49:07.626287+0000","last_became_active":"2024-09-21T05:47:05.638007+0000","last_became_peered":"2024-09-21T05:47:05.638007+0000","last_unstale":"2024-09-21T05:49:07.626287+0000","last_undegraded":"2024-09-21T05:49:07.626287+0000","last_fullsized":"2024-09-21T05:49:07.626287+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:06.615367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.640701+0000","last_change":"2024-09-21T05:47:05.644624+0000","last_active":"2024-09-21T05:49:07.640701+0000","last_peered":"2024-09-21T05:49:07.640701+0000","last_clean":"2024-09-21T05:49:07.640701+0000","last_became_active":"2024-09-21T05:47:05.644257+0000","last_became_peered":"2024-09-21T05:47:05.644257+0000","last_unstale":"2024-09-21T05:49:07.640701+0000","last_undegraded":"2024-09-21T05:49:07.640701+0000","last_fullsized":"2024-09-21T05:49:07.640701+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:31.385313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.642691+0000","last_change":"2024-09-21T05:47:05.646368+0000","last_active":"2024-09-21T05:49:07.642691+0000","last_peered":"2024-09-21T05:49:07.642691+0000","last_clean":"2024-09-21T05:49:07.642691+0000","last_became_active":"2024-09-21T05:47:05.645952+0000","last_became_peered":"2024-09-21T05:47:05.645952+0000","last_unstale":"2024-09-21T05:49:07.642691+0000","last_undegraded":"2024-09-21T05:49:07.642691+0000","last_fullsized":"2024-09-21T05:49:07.642691+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:56.585911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.642261+0000","last_change":"2024-09-21T05:47:05.640167+0000","last_active":"2024-09-21T05:49:07.642261+0000","last_peered":"2024-09-21T05:49:07.642261+0000","last_clean":"2024-09-21T05:49:07.642261+0000","last_became_active":"2024-09-21T05:47:05.639770+0000","last_became_peered":"2024-09-21T05:47:05.639770+0000","last_unstale":"2024-09-21T05:49:07.642261+0000","last_undegraded":"2024-09-21T05:49:07.642261+0000","last_fullsized":"2024-09-21T05:49:07.642261+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:45.661131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.626064+0000","last_change":"2024-09-21T05:47:38.732677+0000","last_active":"2024-09-21T05:49:07.626064+0000","last_peered":"2024-09-21T05:49:07.626064+0000","last_clean":"2024-09-21T05:49:07.626064+0000","last_became_active":"2024-09-21T05:47:38.732236+0000","last_became_peered":"2024-09-21T05:47:38.732236+0000","last_unstale":"2024-09-21T05:49:07.626064+0000","last_undegraded":"2024-09-21T05:49:07.626064+0000","last_fullsized":"2024-09-21T05:49:07.626064+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:41.474677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.631162+0000","last_change":"2024-09-21T05:47:05.629814+0000","last_active":"2024-09-21T05:49:07.631162+0000","last_peered":"2024-09-21T05:49:07.631162+0000","last_clean":"2024-09-21T05:49:07.631162+0000","last_became_active":"2024-09-21T05:47:05.629464+0000","last_became_peered":"2024-09-21T05:47:05.629464+0000","last_unstale":"2024-09-21T05:49:07.631162+0000","last_undegraded":"2024-09-21T05:49:07.631162+0000","last_fullsized":"2024-09-21T05:49:07.631162+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:58.222820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.627810+0000","last_change":"2024-09-21T05:47:05.629643+0000","last_active":"2024-09-21T05:49:07.627810+0000","last_peered":"2024-09-21T05:49:07.627810+0000","last_clean":"2024-09-21T05:49:07.627810+0000","last_became_active":"2024-09-21T05:47:05.629248+0000","last_became_peered":"2024-09-21T05:47:05.629248+0000","last_unstale":"2024-09-21T05:49:07.627810+0000","last_undegraded":"2024-09-21T05:49:07.627810+0000","last_fullsized":"2024-09-21T05:49:07.627810+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:31.569209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.618090+0000","last_change":"2024-09-21T05:47:05.632188+0000","last_active":"2024-09-21T05:49:07.618090+0000","last_peered":"2024-09-21T05:49:07.618090+0000","last_clean":"2024-09-21T05:49:07.618090+0000","last_became_active":"2024-09-21T05:47:05.631799+0000","last_became_peered":"2024-09-21T05:47:05.631799+0000","last_unstale":"2024-09-21T05:49:07.618090+0000","last_undegraded":"2024-09-21T05:49:07.618090+0000","last_fullsized":"2024-09-21T05:49:07.618090+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:09.762405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.641141+0000","last_change":"2024-09-21T05:47:05.644746+0000","last_active":"2024-09-21T05:49:07.641141+0000","last_peered":"2024-09-21T05:49:07.641141+0000","last_clean":"2024-09-21T05:49:07.641141+0000","last_became_active":"2024-09-21T05:47:05.644326+0000","last_became_peered":"2024-09-21T05:47:05.644326+0000","last_unstale":"2024-09-21T05:49:07.641141+0000","last_undegraded":"2024-09-21T05:49:07.641141+0000","last_fullsized":"2024-09-21T05:49:07.641141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:22.937783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.634476+0000","last_change":"2024-09-21T05:47:05.639214+0000","last_active":"2024-09-21T05:49:07.634476+0000","last_peered":"2024-09-21T05:49:07.634476+0000","last_clean":"2024-09-21T05:49:07.634476+0000","last_became_active":"2024-09-21T05:47:05.638443+0000","last_became_peered":"2024-09-21T05:47:05.638443+0000","last_unstale":"2024-09-21T05:49:07.634476+0000","last_undegraded":"2024-09-21T05:49:07.634476+0000","last_fullsized":"2024-09-21T05:49:07.634476+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:30.134020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.641271+0000","last_change":"2024-09-21T05:47:05.644233+0000","last_active":"2024-09-21T05:49:07.641271+0000","last_peered":"2024-09-21T05:49:07.641271+0000","last_clean":"2024-09-21T05:49:07.641271+0000","last_became_active":"2024-09-21T05:47:05.643820+0000","last_became_peered":"2024-09-21T05:47:05.643820+0000","last_unstale":"2024-09-21T05:49:07.641271+0000","last_undegraded":"2024-09-21T05:49:07.641271+0000","last_fullsized":"2024-09-21T05:49:07.641271+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:42.695997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.627216+0000","last_change":"2024-09-21T05:47:05.637569+0000","last_active":"2024-09-21T05:49:07.627216+0000","last_peered":"2024-09-21T05:49:07.627216+0000","last_clean":"2024-09-21T05:49:07.627216+0000","last_became_active":"2024-09-21T05:47:05.637269+0000","last_became_peered":"2024-09-21T05:47:05.637269+0000","last_unstale":"2024-09-21T05:49:07.627216+0000","last_undegraded":"2024-09-21T05:49:07.627216+0000","last_fullsized":"2024-09-21T05:49:07.627216+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:28:26.335398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.624908+0000","last_change":"2024-09-21T05:47:05.633457+0000","last_active":"2024-09-21T05:49:07.624908+0000","last_peered":"2024-09-21T05:49:07.624908+0000","last_clean":"2024-09-21T05:49:07.624908+0000","last_became_active":"2024-09-21T05:47:05.633066+0000","last_became_peered":"2024-09-21T05:47:05.633066+0000","last_unstale":"2024-09-21T05:49:07.624908+0000","last_undegraded":"2024-09-21T05:49:07.624908+0000","last_fullsized":"2024-09-21T05:49:07.624908+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:45.904152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.624760+0000","last_change":"2024-09-21T05:47:38.399914+0000","last_active":"2024-09-21T05:49:07.624760+0000","last_peered":"2024-09-21T05:49:07.624760+0000","last_clean":"2024-09-21T05:49:07.624760+0000","last_became_active":"2024-09-21T05:47:38.399480+0000","last_became_peered":"2024-09-21T05:47:38.399480+0000","last_unstale":"2024-09-21T05:49:07.624760+0000","last_undegraded":"2024-09-21T05:49:07.624760+0000","last_fullsized":"2024-09-21T05:49:07.624760+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:51.281796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.623866+0000","last_change":"2024-09-21T05:47:05.630944+0000","last_active":"2024-09-21T05:49:07.623866+0000","last_peered":"2024-09-21T05:49:07.623866+0000","last_clean":"2024-09-21T05:49:07.623866+0000","last_became_active":"2024-09-21T05:47:05.630498+0000","last_became_peered":"2024-09-21T05:47:05.630498+0000","last_unstale":"2024-09-21T05:49:07.623866+0000","last_undegraded":"2024-09-21T05:49:07.623866+0000","last_fullsized":"2024-09-21T05:49:07.623866+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:20.185094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.632028+0000","last_change":"2024-09-21T05:47:05.636134+0000","last_active":"2024-09-21T05:49:07.632028+0000","last_peered":"2024-09-21T05:49:07.632028+0000","last_clean":"2024-09-21T05:49:07.632028+0000","last_became_active":"2024-09-21T05:47:05.635724+0000","last_became_peered":"2024-09-21T05:47:05.635724+0000","last_unstale":"2024-09-21T05:49:07.632028+0000","last_undegraded":"2024-09-21T05:49:07.632028+0000","last_fullsized":"2024-09-21T05:49:07.632028+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:55.455819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.635816+0000","last_change":"2024-09-21T05:47:05.641209+0000","last_active":"2024-09-21T05:49:07.635816+0000","last_peered":"2024-09-21T05:49:07.635816+0000","last_clean":"2024-09-21T05:49:07.635816+0000","last_became_active":"2024-09-21T05:47:05.640543+0000","last_became_peered":"2024-09-21T05:47:05.640543+0000","last_unstale":"2024-09-21T05:49:07.635816+0000","last_undegraded":"2024-09-21T05:49:07.635816+0000","last_fullsized":"2024-09-21T05:49:07.635816+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:49.579724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.629794+0000","last_change":"2024-09-21T05:47:05.634158+0000","last_active":"2024-09-21T05:49:07.629794+0000","last_peered":"2024-09-21T05:49:07.629794+0000","last_clean":"2024-09-21T05:49:07.629794+0000","last_became_active":"2024-09-21T05:47:05.633657+0000","last_became_peered":"2024-09-21T05:47:05.633657+0000","last_unstale":"2024-09-21T05:49:07.629794+0000","last_undegraded":"2024-09-21T05:49:07.629794+0000","last_fullsized":"2024-09-21T05:49:07.629794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:37.868206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.642715+0000","last_change":"2024-09-21T05:47:05.641358+0000","last_active":"2024-09-21T05:49:07.642715+0000","last_peered":"2024-09-21T05:49:07.642715+0000","last_clean":"2024-09-21T05:49:07.642715+0000","last_became_active":"2024-09-21T05:47:05.641025+0000","last_became_peered":"2024-09-21T05:47:05.641025+0000","last_unstale":"2024-09-21T05:49:07.642715+0000","last_undegraded":"2024-09-21T05:49:07.642715+0000","last_fullsized":"2024-09-21T05:49:07.642715+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:01.654621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":80127,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1086,"num_read_kb":628,"num_write":268,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":756,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":231394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":248927,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743468,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":490255,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939697,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1105920,"data_stored":1148519,"data_compressed":65650,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103221,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":489558,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299451,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":954368,"data_stored":489802,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495680,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":1088053,"data_compressed":65650,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659204,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":485062,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855434,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1028096,"data_stored":1082117,"data_compressed":65650,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051663,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":954368,"data_stored":489668,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247892,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":484770,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444121,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":553137,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607646,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":554654,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738466,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":486518,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34637,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34637,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34637,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36254,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36254,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36254,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36254,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":70314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":74455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T05:49:39.512 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T05:49:39.512 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T05:49:39.755 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:40.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:39 smithi070 ceph-mon[30981]: from='client.15519 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:49:40.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.212+0000 7f3579458640 1 -- 172.21.15.70:0/1928858530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3574108d00 msgr2=0x7f357410f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:40.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.212+0000 7f3579458640 1 --2- 172.21.15.70:0/1928858530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3574108d00 0x7f357410f530 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f356c009900 tx=0x7f356c02a410 comp rx=0 tx=0).stop 2024-09-21T05:49:40.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.212+0000 7f3579458640 1 -- 172.21.15.70:0/1928858530 shutdown_connections 2024-09-21T05:49:40.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.212+0000 7f3579458640 1 --2- 172.21.15.70:0/1928858530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3574108d00 0x7f357410f530 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:40.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.212+0000 7f3579458640 1 --2- 172.21.15.70:0/1928858530 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35741083b0 0x7f35741087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:40.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.212+0000 7f3579458640 1 --2- 172.21.15.70:0/1928858530 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3574103140 0x7f3574103550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:40.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.212+0000 7f3579458640 1 -- 172.21.15.70:0/1928858530 >> 172.21.15.70:0/1928858530 conn(0x7f3574077c60 msgr2=0x7f35740780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:40.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.212+0000 7f3579458640 1 -- 172.21.15.70:0/1928858530 shutdown_connections 2024-09-21T05:49:40.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.212+0000 7f3579458640 1 -- 172.21.15.70:0/1928858530 wait complete. 2024-09-21T05:49:40.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.213+0000 7f3579458640 1 Processor -- start 2024-09-21T05:49:40.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.213+0000 7f3579458640 1 -- start start 2024-09-21T05:49:40.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.213+0000 7f3579458640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3574103140 0x7f3574199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:40.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.213+0000 7f3579458640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35741083b0 0x7f35741998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:40.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.213+0000 7f3579458640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3574108d00 0x7f357419eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:40.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.213+0000 7f3579458640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f35741129b0 con 0x7f35741083b0 2024-09-21T05:49:40.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.213+0000 7f3579458640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f3574112830 con 0x7f3574108d00 2024-09-21T05:49:40.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.213+0000 7f3579458640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3574112b30 con 0x7f3574103140 2024-09-21T05:49:40.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.213+0000 7f35727fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35741083b0 0x7f35741998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:40.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.213+0000 7f35727fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35741083b0 0x7f35741998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48396/0 (socket says 172.21.15.70:48396) 2024-09-21T05:49:40.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.213+0000 7f35727fc640 1 -- 172.21.15.70:0/3640432185 learned_addr learned my addr 172.21.15.70:0/3640432185 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:40.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.213+0000 7f35737fe640 1 --2- 172.21.15.70:0/3640432185 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3574108d00 0x7f357419eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:40.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.213+0000 7f3572ffd640 1 --2- 172.21.15.70:0/3640432185 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3574103140 0x7f3574199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:40.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.213+0000 7f35727fc640 1 -- 172.21.15.70:0/3640432185 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3574103140 msgr2=0x7f3574199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:40.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.213+0000 7f35727fc640 1 --2- 172.21.15.70:0/3640432185 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3574103140 0x7f3574199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:40.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.213+0000 7f35727fc640 1 -- 172.21.15.70:0/3640432185 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3574108d00 msgr2=0x7f357419eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:40.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.213+0000 7f35727fc640 1 --2- 172.21.15.70:0/3640432185 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3574108d00 0x7f357419eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:40.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.214+0000 7f35727fc640 1 -- 172.21.15.70:0/3640432185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f357419f2b0 con 0x7f35741083b0 2024-09-21T05:49:40.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.214+0000 7f35727fc640 1 --2- 172.21.15.70:0/3640432185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35741083b0 0x7f35741998e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f356800e9f0 tx=0x7f356800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:40.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.214+0000 7f355bfff640 1 -- 172.21.15.70:0/3640432185 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f356800ccc0 con 0x7f35741083b0 2024-09-21T05:49:40.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.214+0000 7f355bfff640 1 -- 172.21.15.70:0/3640432185 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f35680108e0 con 0x7f35741083b0 2024-09-21T05:49:40.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.214+0000 7f3579458640 1 -- 172.21.15.70:0/3640432185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f357419f5a0 con 0x7f35741083b0 2024-09-21T05:49:40.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.214+0000 7f355bfff640 1 -- 172.21.15.70:0/3640432185 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3568018840 con 0x7f35741083b0 2024-09-21T05:49:40.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.214+0000 7f3579458640 1 -- 172.21.15.70:0/3640432185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35741a5d00 con 0x7f35741083b0 2024-09-21T05:49:40.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.215+0000 7f3579458640 1 -- 172.21.15.70:0/3640432185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3574103550 con 0x7f35741083b0 2024-09-21T05:49:40.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.217+0000 7f355bfff640 1 -- 172.21.15.70:0/3640432185 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) ==== 154563+0+0 (secure 0 0 0) 0x7f3568010a90 con 0x7f35741083b0 2024-09-21T05:49:40.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.218+0000 7f355bfff640 1 --2- 172.21.15.70:0/3640432185 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f355c0b65a0 0x7f355c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:40.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.218+0000 7f355bfff640 1 -- 172.21.15.70:0/3640432185 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f35680e8130 con 0x7f35741083b0 2024-09-21T05:49:40.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.218+0000 7f3572ffd640 1 --2- 172.21.15.70:0/3640432185 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f355c0b65a0 0x7f355c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:40.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.219+0000 7f3572ffd640 1 --2- 172.21.15.70:0/3640432185 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f355c0b65a0 0x7f355c0b8ab0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3564005fd0 tx=0x7f3564009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:40.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.221+0000 7f355bfff640 1 -- 172.21.15.70:0/3640432185 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f35680ae470 con 0x7f35741083b0 2024-09-21T05:49:40.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:39 smithi116 ceph-mon[34332]: from='client.15519 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:49:40.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.395+0000 7f3579458640 1 -- 172.21.15.70:0/3640432185 --> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3574063800 con 0x7f355c0b65a0 2024-09-21T05:49:40.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:39 smithi160 ceph-mon[33979]: from='client.15519 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:49:40.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.401+0000 7f355bfff640 1 -- 172.21.15.70:0/3640432185 <== mgr.14150 v2:172.21.15.70:6800/1366013939 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340781 (secure 0 0 0) 0x7f3574063800 con 0x7f355c0b65a0 2024-09-21T05:49:40.406 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:49:40.407 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-21T05:49:40.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.404+0000 7f3579458640 1 -- 172.21.15.70:0/3640432185 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f355c0b65a0 msgr2=0x7f355c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:40.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.404+0000 7f3579458640 1 --2- 172.21.15.70:0/3640432185 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f355c0b65a0 0x7f355c0b8ab0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3564005fd0 tx=0x7f3564009500 comp rx=0 tx=0).stop 2024-09-21T05:49:40.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.404+0000 7f3579458640 1 -- 172.21.15.70:0/3640432185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35741083b0 msgr2=0x7f35741998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:40.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.404+0000 7f3579458640 1 --2- 172.21.15.70:0/3640432185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35741083b0 0x7f35741998e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f356800e9f0 tx=0x7f356800eeb0 comp rx=0 tx=0).stop 2024-09-21T05:49:40.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.404+0000 7f3579458640 1 -- 172.21.15.70:0/3640432185 shutdown_connections 2024-09-21T05:49:40.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.404+0000 7f3579458640 1 --2- 172.21.15.70:0/3640432185 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f355c0b65a0 0x7f355c0b8ab0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:40.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.404+0000 7f3579458640 1 --2- 172.21.15.70:0/3640432185 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3574108d00 0x7f357419eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:40.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.404+0000 7f3579458640 1 --2- 172.21.15.70:0/3640432185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35741083b0 0x7f35741998e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:40.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.404+0000 7f3579458640 1 --2- 172.21.15.70:0/3640432185 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3574103140 0x7f3574199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:40.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.404+0000 7f3579458640 1 -- 172.21.15.70:0/3640432185 >> 172.21.15.70:0/3640432185 conn(0x7f3574077c60 msgr2=0x7f35741063c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:40.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.404+0000 7f3579458640 1 -- 172.21.15.70:0/3640432185 shutdown_connections 2024-09-21T05:49:40.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:40.404+0000 7f3579458640 1 -- 172.21.15.70:0/3640432185 wait complete. 2024-09-21T05:49:40.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:40 smithi070 ceph-mon[30981]: pgmap v376: 129 pgs: 129 active+clean; 656 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-21T05:49:40.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:40 smithi070 ceph-mon[30981]: from='client.15525 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:49:41.125 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":376,"stamp":"2024-09-21T05:49:39.437727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":671613,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1184,"num_read_kb":704,"num_write":400,"num_write_kb":2322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":2952596,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":829,"ondisk_log_size":829,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":352576,"kb_used_data":11648,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124589248,"statfs":{"total":1151940427776,"available":1151579389952,"internally_reserved":0,"allocated":11927552,"data_stored":7844374,"data_compressed":461514,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19143,"internal_metadata":348894521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7596,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":66,"num_write":21,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003445"},"pg_stats":[{"pgid":"2.1f","version":"85'14","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:35.728761+0000","last_change":"2024-09-21T05:47:03.620705+0000","last_active":"2024-09-21T05:49:35.728761+0000","last_peered":"2024-09-21T05:49:35.728761+0000","last_clean":"2024-09-21T05:49:35.728761+0000","last_became_active":"2024-09-21T05:47:03.620320+0000","last_became_peered":"2024-09-21T05:47:03.620320+0000","last_unstale":"2024-09-21T05:49:35.728761+0000","last_undegraded":"2024-09-21T05:49:35.728761+0000","last_fullsized":"2024-09-21T05:49:35.728761+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:31.684225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.610588+0000","last_change":"2024-09-21T05:47:05.637251+0000","last_active":"2024-09-21T05:49:07.610588+0000","last_peered":"2024-09-21T05:49:07.610588+0000","last_clean":"2024-09-21T05:49:07.610588+0000","last_became_active":"2024-09-21T05:47:05.636867+0000","last_became_peered":"2024-09-21T05:47:05.636867+0000","last_unstale":"2024-09-21T05:49:07.610588+0000","last_undegraded":"2024-09-21T05:49:07.610588+0000","last_fullsized":"2024-09-21T05:49:07.610588+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:08.538209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715529+0000","last_change":"2024-09-21T05:47:12.676224+0000","last_active":"2024-09-21T05:48:38.715529+0000","last_peered":"2024-09-21T05:48:38.715529+0000","last_clean":"2024-09-21T05:48:38.715529+0000","last_became_active":"2024-09-21T05:47:12.675565+0000","last_became_peered":"2024-09-21T05:47:12.675565+0000","last_unstale":"2024-09-21T05:48:38.715529+0000","last_undegraded":"2024-09-21T05:48:38.715529+0000","last_fullsized":"2024-09-21T05:48:38.715529+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:37.684953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285902+0000","last_change":"2024-09-21T05:47:03.670289+0000","last_active":"2024-09-21T05:48:39.285902+0000","last_peered":"2024-09-21T05:48:39.285902+0000","last_clean":"2024-09-21T05:48:39.285902+0000","last_became_active":"2024-09-21T05:47:03.669881+0000","last_became_peered":"2024-09-21T05:47:03.669881+0000","last_unstale":"2024-09-21T05:48:39.285902+0000","last_undegraded":"2024-09-21T05:48:39.285902+0000","last_fullsized":"2024-09-21T05:48:39.285902+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:12.597766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.641716+0000","last_change":"2024-09-21T05:47:05.640826+0000","last_active":"2024-09-21T05:49:07.641716+0000","last_peered":"2024-09-21T05:49:07.641716+0000","last_clean":"2024-09-21T05:49:07.641716+0000","last_became_active":"2024-09-21T05:47:05.640357+0000","last_became_peered":"2024-09-21T05:47:05.640357+0000","last_unstale":"2024-09-21T05:49:07.641716+0000","last_undegraded":"2024-09-21T05:49:07.641716+0000","last_fullsized":"2024-09-21T05:49:07.641716+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:16.434030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721189+0000","last_change":"2024-09-21T05:47:12.677260+0000","last_active":"2024-09-21T05:48:38.721189+0000","last_peered":"2024-09-21T05:48:38.721189+0000","last_clean":"2024-09-21T05:48:38.721189+0000","last_became_active":"2024-09-21T05:47:12.676599+0000","last_became_peered":"2024-09-21T05:47:12.676599+0000","last_unstale":"2024-09-21T05:48:38.721189+0000","last_undegraded":"2024-09-21T05:48:38.721189+0000","last_fullsized":"2024-09-21T05:48:38.721189+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:10.644801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.722508+0000","last_change":"2024-09-21T05:47:03.619903+0000","last_active":"2024-09-21T05:48:38.722508+0000","last_peered":"2024-09-21T05:48:38.722508+0000","last_clean":"2024-09-21T05:48:38.722508+0000","last_became_active":"2024-09-21T05:47:03.619476+0000","last_became_peered":"2024-09-21T05:47:03.619476+0000","last_unstale":"2024-09-21T05:48:38.722508+0000","last_undegraded":"2024-09-21T05:48:38.722508+0000","last_fullsized":"2024-09-21T05:48:38.722508+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:09.717552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.639721+0000","last_change":"2024-09-21T05:47:05.646017+0000","last_active":"2024-09-21T05:49:07.639721+0000","last_peered":"2024-09-21T05:49:07.639721+0000","last_clean":"2024-09-21T05:49:07.639721+0000","last_became_active":"2024-09-21T05:47:05.644118+0000","last_became_peered":"2024-09-21T05:47:05.644118+0000","last_unstale":"2024-09-21T05:49:07.639721+0000","last_undegraded":"2024-09-21T05:49:07.639721+0000","last_fullsized":"2024-09-21T05:49:07.639721+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:52.908664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721813+0000","last_change":"2024-09-21T05:47:12.677555+0000","last_active":"2024-09-21T05:48:38.721813+0000","last_peered":"2024-09-21T05:48:38.721813+0000","last_clean":"2024-09-21T05:48:38.721813+0000","last_became_active":"2024-09-21T05:47:12.676886+0000","last_became_peered":"2024-09-21T05:47:12.676886+0000","last_unstale":"2024-09-21T05:48:38.721813+0000","last_undegraded":"2024-09-21T05:48:38.721813+0000","last_fullsized":"2024-09-21T05:48:38.721813+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:10:24.516641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.723169+0000","last_change":"2024-09-21T05:47:03.621556+0000","last_active":"2024-09-21T05:48:38.723169+0000","last_peered":"2024-09-21T05:48:38.723169+0000","last_clean":"2024-09-21T05:48:38.723169+0000","last_became_active":"2024-09-21T05:47:03.621101+0000","last_became_peered":"2024-09-21T05:47:03.621101+0000","last_unstale":"2024-09-21T05:48:38.723169+0000","last_undegraded":"2024-09-21T05:48:38.723169+0000","last_fullsized":"2024-09-21T05:48:38.723169+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:39:23.639431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.636833+0000","last_change":"2024-09-21T05:47:05.646328+0000","last_active":"2024-09-21T05:49:07.636833+0000","last_peered":"2024-09-21T05:49:07.636833+0000","last_clean":"2024-09-21T05:49:07.636833+0000","last_became_active":"2024-09-21T05:47:05.645922+0000","last_became_peered":"2024-09-21T05:47:05.645922+0000","last_unstale":"2024-09-21T05:49:07.636833+0000","last_undegraded":"2024-09-21T05:49:07.636833+0000","last_fullsized":"2024-09-21T05:49:07.636833+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:43.801707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721553+0000","last_change":"2024-09-21T05:47:12.673555+0000","last_active":"2024-09-21T05:48:38.721553+0000","last_peered":"2024-09-21T05:48:38.721553+0000","last_clean":"2024-09-21T05:48:38.721553+0000","last_became_active":"2024-09-21T05:47:12.673065+0000","last_became_peered":"2024-09-21T05:47:12.673065+0000","last_unstale":"2024-09-21T05:48:38.721553+0000","last_undegraded":"2024-09-21T05:48:38.721553+0000","last_fullsized":"2024-09-21T05:48:38.721553+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:53.548779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.642240+0000","last_change":"2024-09-21T05:47:05.645376+0000","last_active":"2024-09-21T05:49:07.642240+0000","last_peered":"2024-09-21T05:49:07.642240+0000","last_clean":"2024-09-21T05:49:07.642240+0000","last_became_active":"2024-09-21T05:47:05.644800+0000","last_became_peered":"2024-09-21T05:47:05.644800+0000","last_unstale":"2024-09-21T05:49:07.642240+0000","last_undegraded":"2024-09-21T05:49:07.642240+0000","last_fullsized":"2024-09-21T05:49:07.642240+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:10.460407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720709+0000","last_change":"2024-09-21T05:47:03.619926+0000","last_active":"2024-09-21T05:48:38.720709+0000","last_peered":"2024-09-21T05:48:38.720709+0000","last_clean":"2024-09-21T05:48:38.720709+0000","last_became_active":"2024-09-21T05:47:03.619433+0000","last_became_peered":"2024-09-21T05:47:03.619433+0000","last_unstale":"2024-09-21T05:48:38.720709+0000","last_undegraded":"2024-09-21T05:48:38.720709+0000","last_fullsized":"2024-09-21T05:48:38.720709+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:33.792874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721980+0000","last_change":"2024-09-21T05:47:12.874200+0000","last_active":"2024-09-21T05:48:38.721980+0000","last_peered":"2024-09-21T05:48:38.721980+0000","last_clean":"2024-09-21T05:48:38.721980+0000","last_became_active":"2024-09-21T05:47:12.873563+0000","last_became_peered":"2024-09-21T05:47:12.873563+0000","last_unstale":"2024-09-21T05:48:38.721980+0000","last_undegraded":"2024-09-21T05:48:38.721980+0000","last_fullsized":"2024-09-21T05:48:38.721980+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:34.839934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.628678+0000","last_change":"2024-09-21T05:47:05.639033+0000","last_active":"2024-09-21T05:49:07.628678+0000","last_peered":"2024-09-21T05:49:07.628678+0000","last_clean":"2024-09-21T05:49:07.628678+0000","last_became_active":"2024-09-21T05:47:05.637433+0000","last_became_peered":"2024-09-21T05:47:05.637433+0000","last_unstale":"2024-09-21T05:49:07.628678+0000","last_undegraded":"2024-09-21T05:49:07.628678+0000","last_fullsized":"2024-09-21T05:49:07.628678+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:55.181025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"85'4","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:15.090942+0000","last_change":"2024-09-21T05:47:03.614460+0000","last_active":"2024-09-21T05:49:15.090942+0000","last_peered":"2024-09-21T05:49:15.090942+0000","last_clean":"2024-09-21T05:49:15.090942+0000","last_became_active":"2024-09-21T05:47:03.613975+0000","last_became_peered":"2024-09-21T05:47:03.613975+0000","last_unstale":"2024-09-21T05:49:15.090942+0000","last_undegraded":"2024-09-21T05:49:15.090942+0000","last_fullsized":"2024-09-21T05:49:15.090942+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:26.838907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721823+0000","last_change":"2024-09-21T05:47:38.733044+0000","last_active":"2024-09-21T05:48:38.721823+0000","last_peered":"2024-09-21T05:48:38.721823+0000","last_clean":"2024-09-21T05:48:38.721823+0000","last_became_active":"2024-09-21T05:47:38.732327+0000","last_became_peered":"2024-09-21T05:47:38.732327+0000","last_unstale":"2024-09-21T05:48:38.721823+0000","last_undegraded":"2024-09-21T05:48:38.721823+0000","last_fullsized":"2024-09-21T05:48:38.721823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:59.462529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.636196+0000","last_change":"2024-09-21T05:47:05.631831+0000","last_active":"2024-09-21T05:49:07.636196+0000","last_peered":"2024-09-21T05:49:07.636196+0000","last_clean":"2024-09-21T05:49:07.636196+0000","last_became_active":"2024-09-21T05:47:05.630403+0000","last_became_peered":"2024-09-21T05:47:05.630403+0000","last_unstale":"2024-09-21T05:49:07.636196+0000","last_undegraded":"2024-09-21T05:49:07.636196+0000","last_fullsized":"2024-09-21T05:49:07.636196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:21.163262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285563+0000","last_change":"2024-09-21T05:47:03.618888+0000","last_active":"2024-09-21T05:48:39.285563+0000","last_peered":"2024-09-21T05:48:39.285563+0000","last_clean":"2024-09-21T05:48:39.285563+0000","last_became_active":"2024-09-21T05:47:03.618506+0000","last_became_peered":"2024-09-21T05:47:03.618506+0000","last_unstale":"2024-09-21T05:48:39.285563+0000","last_undegraded":"2024-09-21T05:48:39.285563+0000","last_fullsized":"2024-09-21T05:48:39.285563+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:52.711976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714872+0000","last_change":"2024-09-21T05:47:12.675649+0000","last_active":"2024-09-21T05:48:38.714872+0000","last_peered":"2024-09-21T05:48:38.714872+0000","last_clean":"2024-09-21T05:48:38.714872+0000","last_became_active":"2024-09-21T05:47:12.675268+0000","last_became_peered":"2024-09-21T05:47:12.675268+0000","last_unstale":"2024-09-21T05:48:38.714872+0000","last_undegraded":"2024-09-21T05:48:38.714872+0000","last_fullsized":"2024-09-21T05:48:38.714872+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:48:31.481292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.622094+0000","last_change":"2024-09-21T05:47:05.622838+0000","last_active":"2024-09-21T05:49:07.622094+0000","last_peered":"2024-09-21T05:49:07.622094+0000","last_clean":"2024-09-21T05:49:07.622094+0000","last_became_active":"2024-09-21T05:47:05.622216+0000","last_became_peered":"2024-09-21T05:47:05.622216+0000","last_unstale":"2024-09-21T05:49:07.622094+0000","last_undegraded":"2024-09-21T05:49:07.622094+0000","last_fullsized":"2024-09-21T05:49:07.622094+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:55.446747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715282+0000","last_change":"2024-09-21T05:47:03.670405+0000","last_active":"2024-09-21T05:48:38.715282+0000","last_peered":"2024-09-21T05:48:38.715282+0000","last_clean":"2024-09-21T05:48:38.715282+0000","last_became_active":"2024-09-21T05:47:03.669958+0000","last_became_peered":"2024-09-21T05:47:03.669958+0000","last_unstale":"2024-09-21T05:48:38.715282+0000","last_undegraded":"2024-09-21T05:48:38.715282+0000","last_fullsized":"2024-09-21T05:48:38.715282+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:25.702903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.722260+0000","last_change":"2024-09-21T05:47:38.399039+0000","last_active":"2024-09-21T05:48:38.722260+0000","last_peered":"2024-09-21T05:48:38.722260+0000","last_clean":"2024-09-21T05:48:38.722260+0000","last_became_active":"2024-09-21T05:47:38.398441+0000","last_became_peered":"2024-09-21T05:47:38.398441+0000","last_unstale":"2024-09-21T05:48:38.722260+0000","last_undegraded":"2024-09-21T05:48:38.722260+0000","last_fullsized":"2024-09-21T05:48:38.722260+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:11.095516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,8],"acting":[4,5,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.628678+0000","last_change":"2024-09-21T05:47:05.632911+0000","last_active":"2024-09-21T05:49:07.628678+0000","last_peered":"2024-09-21T05:49:07.628678+0000","last_clean":"2024-09-21T05:49:07.628678+0000","last_became_active":"2024-09-21T05:47:05.632256+0000","last_became_peered":"2024-09-21T05:47:05.632256+0000","last_unstale":"2024-09-21T05:49:07.628678+0000","last_undegraded":"2024-09-21T05:49:07.628678+0000","last_fullsized":"2024-09-21T05:49:07.628678+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:41.014253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.722379+0000","last_change":"2024-09-21T05:47:04.411753+0000","last_active":"2024-09-21T05:48:38.722379+0000","last_peered":"2024-09-21T05:48:38.722379+0000","last_clean":"2024-09-21T05:48:38.722379+0000","last_became_active":"2024-09-21T05:47:04.411225+0000","last_became_peered":"2024-09-21T05:47:04.411225+0000","last_unstale":"2024-09-21T05:48:38.722379+0000","last_undegraded":"2024-09-21T05:48:38.722379+0000","last_fullsized":"2024-09-21T05:48:38.722379+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:07.964184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715699+0000","last_change":"2024-09-21T05:47:12.670157+0000","last_active":"2024-09-21T05:48:38.715699+0000","last_peered":"2024-09-21T05:48:38.715699+0000","last_clean":"2024-09-21T05:48:38.715699+0000","last_became_active":"2024-09-21T05:47:12.669710+0000","last_became_peered":"2024-09-21T05:47:12.669710+0000","last_unstale":"2024-09-21T05:48:38.715699+0000","last_undegraded":"2024-09-21T05:48:38.715699+0000","last_fullsized":"2024-09-21T05:48:38.715699+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:31.023624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.635898+0000","last_change":"2024-09-21T05:47:05.637982+0000","last_active":"2024-09-21T05:49:07.635898+0000","last_peered":"2024-09-21T05:49:07.635898+0000","last_clean":"2024-09-21T05:49:07.635898+0000","last_became_active":"2024-09-21T05:47:05.637357+0000","last_became_peered":"2024-09-21T05:47:05.637357+0000","last_unstale":"2024-09-21T05:49:07.635898+0000","last_undegraded":"2024-09-21T05:49:07.635898+0000","last_fullsized":"2024-09-21T05:49:07.635898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:41:12.986231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'18","reported_seq":57,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:34.645131+0000","last_change":"2024-09-21T05:47:03.611556+0000","last_active":"2024-09-21T05:49:34.645131+0000","last_peered":"2024-09-21T05:49:34.645131+0000","last_clean":"2024-09-21T05:49:34.645131+0000","last_became_active":"2024-09-21T05:47:03.611192+0000","last_became_peered":"2024-09-21T05:47:03.611192+0000","last_unstale":"2024-09-21T05:49:34.645131+0000","last_undegraded":"2024-09-21T05:49:34.645131+0000","last_fullsized":"2024-09-21T05:49:34.645131+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:20.047405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285259+0000","last_change":"2024-09-21T05:47:12.874796+0000","last_active":"2024-09-21T05:48:39.285259+0000","last_peered":"2024-09-21T05:48:39.285259+0000","last_clean":"2024-09-21T05:48:39.285259+0000","last_became_active":"2024-09-21T05:47:12.873648+0000","last_became_peered":"2024-09-21T05:47:12.873648+0000","last_unstale":"2024-09-21T05:48:39.285259+0000","last_undegraded":"2024-09-21T05:48:39.285259+0000","last_fullsized":"2024-09-21T05:48:39.285259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:50.591584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.624967+0000","last_change":"2024-09-21T05:47:05.634289+0000","last_active":"2024-09-21T05:49:07.624967+0000","last_peered":"2024-09-21T05:49:07.624967+0000","last_clean":"2024-09-21T05:49:07.624967+0000","last_became_active":"2024-09-21T05:47:05.633971+0000","last_became_peered":"2024-09-21T05:47:05.633971+0000","last_unstale":"2024-09-21T05:49:07.624967+0000","last_undegraded":"2024-09-21T05:49:07.624967+0000","last_fullsized":"2024-09-21T05:49:07.624967+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:53.819753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.722647+0000","last_change":"2024-09-21T05:47:03.671877+0000","last_active":"2024-09-21T05:48:38.722647+0000","last_peered":"2024-09-21T05:48:38.722647+0000","last_clean":"2024-09-21T05:48:38.722647+0000","last_became_active":"2024-09-21T05:47:03.671443+0000","last_became_peered":"2024-09-21T05:47:03.671443+0000","last_unstale":"2024-09-21T05:48:38.722647+0000","last_undegraded":"2024-09-21T05:48:38.722647+0000","last_fullsized":"2024-09-21T05:48:38.722647+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:00.114953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.717912+0000","last_change":"2024-09-21T05:47:12.673004+0000","last_active":"2024-09-21T05:48:38.717912+0000","last_peered":"2024-09-21T05:48:38.717912+0000","last_clean":"2024-09-21T05:48:38.717912+0000","last_became_active":"2024-09-21T05:47:12.671784+0000","last_became_peered":"2024-09-21T05:47:12.671784+0000","last_unstale":"2024-09-21T05:48:38.717912+0000","last_undegraded":"2024-09-21T05:48:38.717912+0000","last_fullsized":"2024-09-21T05:48:38.717912+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:38.672438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"85'4","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.624238+0000","last_change":"2024-09-21T05:47:05.635204+0000","last_active":"2024-09-21T05:49:07.624238+0000","last_peered":"2024-09-21T05:49:07.624238+0000","last_clean":"2024-09-21T05:49:07.624238+0000","last_became_active":"2024-09-21T05:47:05.634794+0000","last_became_peered":"2024-09-21T05:47:05.634794+0000","last_unstale":"2024-09-21T05:49:07.624238+0000","last_undegraded":"2024-09-21T05:49:07.624238+0000","last_fullsized":"2024-09-21T05:49:07.624238+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:08.208843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714687+0000","last_change":"2024-09-21T05:47:03.671864+0000","last_active":"2024-09-21T05:48:38.714687+0000","last_peered":"2024-09-21T05:48:38.714687+0000","last_clean":"2024-09-21T05:48:38.714687+0000","last_became_active":"2024-09-21T05:47:03.671510+0000","last_became_peered":"2024-09-21T05:47:03.671510+0000","last_unstale":"2024-09-21T05:48:38.714687+0000","last_undegraded":"2024-09-21T05:48:38.714687+0000","last_fullsized":"2024-09-21T05:48:38.714687+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:12.831235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720724+0000","last_change":"2024-09-21T05:47:38.398708+0000","last_active":"2024-09-21T05:48:38.720724+0000","last_peered":"2024-09-21T05:48:38.720724+0000","last_clean":"2024-09-21T05:48:38.720724+0000","last_became_active":"2024-09-21T05:47:38.398211+0000","last_became_peered":"2024-09-21T05:47:38.398211+0000","last_unstale":"2024-09-21T05:48:38.720724+0000","last_undegraded":"2024-09-21T05:48:38.720724+0000","last_fullsized":"2024-09-21T05:48:38.720724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:29.250191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.621266+0000","last_change":"2024-09-21T05:47:05.633069+0000","last_active":"2024-09-21T05:49:07.621266+0000","last_peered":"2024-09-21T05:49:07.621266+0000","last_clean":"2024-09-21T05:49:07.621266+0000","last_became_active":"2024-09-21T05:47:05.632698+0000","last_became_peered":"2024-09-21T05:47:05.632698+0000","last_unstale":"2024-09-21T05:49:07.621266+0000","last_undegraded":"2024-09-21T05:49:07.621266+0000","last_fullsized":"2024-09-21T05:49:07.621266+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:04.081062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'6","reported_seq":154,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:34.728120+0000","last_change":"2024-09-21T05:47:03.622490+0000","last_active":"2024-09-21T05:49:34.728120+0000","last_peered":"2024-09-21T05:49:34.728120+0000","last_clean":"2024-09-21T05:49:34.728120+0000","last_became_active":"2024-09-21T05:47:03.622093+0000","last_became_peered":"2024-09-21T05:47:03.622093+0000","last_unstale":"2024-09-21T05:49:34.728120+0000","last_undegraded":"2024-09-21T05:49:34.728120+0000","last_fullsized":"2024-09-21T05:49:34.728120+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:40.500152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.432807+0000","last_change":"2024-09-21T05:47:12.670060+0000","last_active":"2024-09-21T05:48:39.432807+0000","last_peered":"2024-09-21T05:48:39.432807+0000","last_clean":"2024-09-21T05:48:39.432807+0000","last_became_active":"2024-09-21T05:47:12.669635+0000","last_became_peered":"2024-09-21T05:47:12.669635+0000","last_unstale":"2024-09-21T05:48:39.432807+0000","last_undegraded":"2024-09-21T05:48:39.432807+0000","last_fullsized":"2024-09-21T05:48:39.432807+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:14.786984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.633745+0000","last_change":"2024-09-21T05:47:05.640553+0000","last_active":"2024-09-21T05:49:07.633745+0000","last_peered":"2024-09-21T05:49:07.633745+0000","last_clean":"2024-09-21T05:49:07.633745+0000","last_became_active":"2024-09-21T05:47:05.640151+0000","last_became_peered":"2024-09-21T05:47:05.640151+0000","last_unstale":"2024-09-21T05:49:07.633745+0000","last_undegraded":"2024-09-21T05:49:07.633745+0000","last_fullsized":"2024-09-21T05:49:07.633745+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:39.904129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'7","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:37.730123+0000","last_change":"2024-09-21T05:47:03.670178+0000","last_active":"2024-09-21T05:49:37.730123+0000","last_peered":"2024-09-21T05:49:37.730123+0000","last_clean":"2024-09-21T05:49:37.730123+0000","last_became_active":"2024-09-21T05:47:03.669715+0000","last_became_peered":"2024-09-21T05:47:03.669715+0000","last_unstale":"2024-09-21T05:49:37.730123+0000","last_undegraded":"2024-09-21T05:49:37.730123+0000","last_fullsized":"2024-09-21T05:49:37.730123+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:31.457820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":110,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.433018+0000","last_change":"2024-09-21T05:47:12.875173+0000","last_active":"2024-09-21T05:48:39.433018+0000","last_peered":"2024-09-21T05:48:39.433018+0000","last_clean":"2024-09-21T05:48:39.433018+0000","last_became_active":"2024-09-21T05:47:12.873749+0000","last_became_peered":"2024-09-21T05:47:12.873749+0000","last_unstale":"2024-09-21T05:48:39.433018+0000","last_undegraded":"2024-09-21T05:48:39.433018+0000","last_fullsized":"2024-09-21T05:48:39.433018+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:33.473645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.625006+0000","last_change":"2024-09-21T05:47:05.634346+0000","last_active":"2024-09-21T05:49:07.625006+0000","last_peered":"2024-09-21T05:49:07.625006+0000","last_clean":"2024-09-21T05:49:07.625006+0000","last_became_active":"2024-09-21T05:47:05.634004+0000","last_became_peered":"2024-09-21T05:47:05.634004+0000","last_unstale":"2024-09-21T05:49:07.625006+0000","last_undegraded":"2024-09-21T05:49:07.625006+0000","last_fullsized":"2024-09-21T05:49:07.625006+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:16.328729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.717785+0000","last_change":"2024-09-21T05:47:03.619472+0000","last_active":"2024-09-21T05:48:38.717785+0000","last_peered":"2024-09-21T05:48:38.717785+0000","last_clean":"2024-09-21T05:48:38.717785+0000","last_became_active":"2024-09-21T05:47:03.619077+0000","last_became_peered":"2024-09-21T05:47:03.619077+0000","last_unstale":"2024-09-21T05:48:38.717785+0000","last_undegraded":"2024-09-21T05:48:38.717785+0000","last_fullsized":"2024-09-21T05:48:38.717785+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:17.774462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.722547+0000","last_change":"2024-09-21T05:47:38.730714+0000","last_active":"2024-09-21T05:48:38.722547+0000","last_peered":"2024-09-21T05:48:38.722547+0000","last_clean":"2024-09-21T05:48:38.722547+0000","last_became_active":"2024-09-21T05:47:38.730271+0000","last_became_peered":"2024-09-21T05:47:38.730271+0000","last_unstale":"2024-09-21T05:48:38.722547+0000","last_undegraded":"2024-09-21T05:48:38.722547+0000","last_fullsized":"2024-09-21T05:48:38.722547+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:53.391967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.624355+0000","last_change":"2024-09-21T05:47:05.642487+0000","last_active":"2024-09-21T05:49:07.624355+0000","last_peered":"2024-09-21T05:49:07.624355+0000","last_clean":"2024-09-21T05:49:07.624355+0000","last_became_active":"2024-09-21T05:47:05.642022+0000","last_became_peered":"2024-09-21T05:47:05.642022+0000","last_unstale":"2024-09-21T05:49:07.624355+0000","last_undegraded":"2024-09-21T05:49:07.624355+0000","last_fullsized":"2024-09-21T05:49:07.624355+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:50:38.435444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721983+0000","last_change":"2024-09-21T05:47:03.618333+0000","last_active":"2024-09-21T05:48:38.721983+0000","last_peered":"2024-09-21T05:48:38.721983+0000","last_clean":"2024-09-21T05:48:38.721983+0000","last_became_active":"2024-09-21T05:47:03.617843+0000","last_became_peered":"2024-09-21T05:47:03.617843+0000","last_unstale":"2024-09-21T05:48:38.721983+0000","last_undegraded":"2024-09-21T05:48:38.721983+0000","last_fullsized":"2024-09-21T05:48:38.721983+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:01.647913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":115,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718194+0000","last_change":"2024-09-21T05:45:52.661435+0000","last_active":"2024-09-21T05:48:38.718194+0000","last_peered":"2024-09-21T05:48:38.718194+0000","last_clean":"2024-09-21T05:48:38.718194+0000","last_became_active":"2024-09-21T05:45:52.656767+0000","last_became_peered":"2024-09-21T05:45:52.656767+0000","last_unstale":"2024-09-21T05:48:38.718194+0000","last_undegraded":"2024-09-21T05:48:38.718194+0000","last_fullsized":"2024-09-21T05:48:38.718194+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:42:26.045146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:42:26.045146+0000","last_clean_scrub_stamp":"2024-09-21T05:42:26.045146+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:40:12.152499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718152+0000","last_change":"2024-09-21T05:47:12.675435+0000","last_active":"2024-09-21T05:48:38.718152+0000","last_peered":"2024-09-21T05:48:38.718152+0000","last_clean":"2024-09-21T05:48:38.718152+0000","last_became_active":"2024-09-21T05:47:12.674955+0000","last_became_peered":"2024-09-21T05:47:12.674955+0000","last_unstale":"2024-09-21T05:48:38.718152+0000","last_undegraded":"2024-09-21T05:48:38.718152+0000","last_fullsized":"2024-09-21T05:48:38.718152+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:18.758498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.641204+0000","last_change":"2024-09-21T05:47:05.640952+0000","last_active":"2024-09-21T05:49:07.641204+0000","last_peered":"2024-09-21T05:49:07.641204+0000","last_clean":"2024-09-21T05:49:07.641204+0000","last_became_active":"2024-09-21T05:47:05.640554+0000","last_became_peered":"2024-09-21T05:47:05.640554+0000","last_unstale":"2024-09-21T05:49:07.641204+0000","last_undegraded":"2024-09-21T05:49:07.641204+0000","last_fullsized":"2024-09-21T05:49:07.641204+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:15:08.553651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'6","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:33.731323+0000","last_change":"2024-09-21T05:47:04.411605+0000","last_active":"2024-09-21T05:49:33.731323+0000","last_peered":"2024-09-21T05:49:33.731323+0000","last_clean":"2024-09-21T05:49:33.731323+0000","last_became_active":"2024-09-21T05:47:04.411129+0000","last_became_peered":"2024-09-21T05:47:04.411129+0000","last_unstale":"2024-09-21T05:49:33.731323+0000","last_undegraded":"2024-09-21T05:49:33.731323+0000","last_fullsized":"2024-09-21T05:49:33.731323+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:25.469148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1663,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715316+0000","last_change":"2024-09-21T05:47:12.670479+0000","last_active":"2024-09-21T05:48:38.715316+0000","last_peered":"2024-09-21T05:48:38.715316+0000","last_clean":"2024-09-21T05:48:38.715316+0000","last_became_active":"2024-09-21T05:47:12.669925+0000","last_became_peered":"2024-09-21T05:47:12.669925+0000","last_unstale":"2024-09-21T05:48:38.715316+0000","last_undegraded":"2024-09-21T05:48:38.715316+0000","last_fullsized":"2024-09-21T05:48:38.715316+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:50.506063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.624710+0000","last_change":"2024-09-21T05:47:05.634519+0000","last_active":"2024-09-21T05:49:07.624710+0000","last_peered":"2024-09-21T05:49:07.624710+0000","last_clean":"2024-09-21T05:49:07.624710+0000","last_became_active":"2024-09-21T05:47:05.634134+0000","last_became_peered":"2024-09-21T05:47:05.634134+0000","last_unstale":"2024-09-21T05:49:07.624710+0000","last_undegraded":"2024-09-21T05:49:07.624710+0000","last_fullsized":"2024-09-21T05:49:07.624710+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:57.464884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721394+0000","last_change":"2024-09-21T05:47:03.622860+0000","last_active":"2024-09-21T05:48:38.721394+0000","last_peered":"2024-09-21T05:48:38.721394+0000","last_clean":"2024-09-21T05:48:38.721394+0000","last_became_active":"2024-09-21T05:47:03.622435+0000","last_became_peered":"2024-09-21T05:47:03.622435+0000","last_unstale":"2024-09-21T05:48:38.721394+0000","last_undegraded":"2024-09-21T05:48:38.721394+0000","last_fullsized":"2024-09-21T05:48:38.721394+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:03.352140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720211+0000","last_change":"2024-09-21T05:47:12.673518+0000","last_active":"2024-09-21T05:48:38.720211+0000","last_peered":"2024-09-21T05:48:38.720211+0000","last_clean":"2024-09-21T05:48:38.720211+0000","last_became_active":"2024-09-21T05:47:12.673000+0000","last_became_peered":"2024-09-21T05:47:12.673000+0000","last_unstale":"2024-09-21T05:48:38.720211+0000","last_undegraded":"2024-09-21T05:48:38.720211+0000","last_fullsized":"2024-09-21T05:48:38.720211+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:37.859801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.628136+0000","last_change":"2024-09-21T05:47:05.625144+0000","last_active":"2024-09-21T05:49:07.628136+0000","last_peered":"2024-09-21T05:49:07.628136+0000","last_clean":"2024-09-21T05:49:07.628136+0000","last_became_active":"2024-09-21T05:47:05.624593+0000","last_became_peered":"2024-09-21T05:47:05.624593+0000","last_unstale":"2024-09-21T05:49:07.628136+0000","last_undegraded":"2024-09-21T05:49:07.628136+0000","last_fullsized":"2024-09-21T05:49:07.628136+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:04.332686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.433072+0000","last_change":"2024-09-21T05:47:03.612389+0000","last_active":"2024-09-21T05:48:39.433072+0000","last_peered":"2024-09-21T05:48:39.433072+0000","last_clean":"2024-09-21T05:48:39.433072+0000","last_became_active":"2024-09-21T05:47:03.612023+0000","last_became_peered":"2024-09-21T05:47:03.612023+0000","last_unstale":"2024-09-21T05:48:39.433072+0000","last_undegraded":"2024-09-21T05:48:39.433072+0000","last_fullsized":"2024-09-21T05:48:39.433072+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:32.571903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721160+0000","last_change":"2024-09-21T05:47:12.674963+0000","last_active":"2024-09-21T05:48:38.721160+0000","last_peered":"2024-09-21T05:48:38.721160+0000","last_clean":"2024-09-21T05:48:38.721160+0000","last_became_active":"2024-09-21T05:47:12.673883+0000","last_became_peered":"2024-09-21T05:47:12.673883+0000","last_unstale":"2024-09-21T05:48:38.721160+0000","last_undegraded":"2024-09-21T05:48:38.721160+0000","last_fullsized":"2024-09-21T05:48:38.721160+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:29.843443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.634245+0000","last_change":"2024-09-21T05:47:05.638440+0000","last_active":"2024-09-21T05:49:07.634245+0000","last_peered":"2024-09-21T05:49:07.634245+0000","last_clean":"2024-09-21T05:49:07.634245+0000","last_became_active":"2024-09-21T05:47:05.638010+0000","last_became_peered":"2024-09-21T05:47:05.638010+0000","last_unstale":"2024-09-21T05:49:07.634245+0000","last_undegraded":"2024-09-21T05:49:07.634245+0000","last_fullsized":"2024-09-21T05:49:07.634245+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:47.921461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:41.931234+0000","last_change":"2024-09-21T05:48:38.742314+0000","last_active":"2024-09-21T05:48:41.931234+0000","last_peered":"2024-09-21T05:48:41.931234+0000","last_clean":"2024-09-21T05:48:41.931234+0000","last_became_active":"2024-09-21T05:48:38.723546+0000","last_became_peered":"2024-09-21T05:48:38.723546+0000","last_unstale":"2024-09-21T05:48:41.931234+0000","last_undegraded":"2024-09-21T05:48:41.931234+0000","last_fullsized":"2024-09-21T05:48:41.931234+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:12.911309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.719825+0000","last_change":"2024-09-21T05:47:12.675362+0000","last_active":"2024-09-21T05:48:38.719825+0000","last_peered":"2024-09-21T05:48:38.719825+0000","last_clean":"2024-09-21T05:48:38.719825+0000","last_became_active":"2024-09-21T05:47:12.674578+0000","last_became_peered":"2024-09-21T05:47:12.674578+0000","last_unstale":"2024-09-21T05:48:38.719825+0000","last_undegraded":"2024-09-21T05:48:38.719825+0000","last_fullsized":"2024-09-21T05:48:38.719825+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:56.654323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.636309+0000","last_change":"2024-09-21T05:47:05.641130+0000","last_active":"2024-09-21T05:49:07.636309+0000","last_peered":"2024-09-21T05:49:07.636309+0000","last_clean":"2024-09-21T05:49:07.636309+0000","last_became_active":"2024-09-21T05:47:05.640794+0000","last_became_peered":"2024-09-21T05:47:05.640794+0000","last_unstale":"2024-09-21T05:49:07.636309+0000","last_undegraded":"2024-09-21T05:49:07.636309+0000","last_fullsized":"2024-09-21T05:49:07.636309+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:29:18.243240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.738576+0000","last_change":"2024-09-21T05:48:38.737941+0000","last_active":"2024-09-21T05:48:38.738576+0000","last_peered":"2024-09-21T05:48:38.738576+0000","last_clean":"2024-09-21T05:48:38.738576+0000","last_became_active":"2024-09-21T05:48:38.722769+0000","last_became_peered":"2024-09-21T05:48:38.722769+0000","last_unstale":"2024-09-21T05:48:38.738576+0000","last_undegraded":"2024-09-21T05:48:38.738576+0000","last_fullsized":"2024-09-21T05:48:38.738576+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:24.258822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.433002+0000","last_change":"2024-09-21T05:47:12.671181+0000","last_active":"2024-09-21T05:48:39.433002+0000","last_peered":"2024-09-21T05:48:39.433002+0000","last_clean":"2024-09-21T05:48:39.433002+0000","last_became_active":"2024-09-21T05:47:12.670522+0000","last_became_peered":"2024-09-21T05:47:12.670522+0000","last_unstale":"2024-09-21T05:48:39.433002+0000","last_undegraded":"2024-09-21T05:48:39.433002+0000","last_fullsized":"2024-09-21T05:48:39.433002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:52.165812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.631652+0000","last_change":"2024-09-21T05:47:05.629167+0000","last_active":"2024-09-21T05:49:07.631652+0000","last_peered":"2024-09-21T05:49:07.631652+0000","last_clean":"2024-09-21T05:49:07.631652+0000","last_became_active":"2024-09-21T05:47:05.628794+0000","last_became_peered":"2024-09-21T05:47:05.628794+0000","last_unstale":"2024-09-21T05:49:07.631652+0000","last_undegraded":"2024-09-21T05:49:07.631652+0000","last_fullsized":"2024-09-21T05:49:07.631652+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:51.469247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'8","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:36.729255+0000","last_change":"2024-09-21T05:47:03.621479+0000","last_active":"2024-09-21T05:49:36.729255+0000","last_peered":"2024-09-21T05:49:36.729255+0000","last_clean":"2024-09-21T05:49:36.729255+0000","last_became_active":"2024-09-21T05:47:03.621041+0000","last_became_peered":"2024-09-21T05:47:03.621041+0000","last_unstale":"2024-09-21T05:49:36.729255+0000","last_undegraded":"2024-09-21T05:49:36.729255+0000","last_fullsized":"2024-09-21T05:49:36.729255+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:33.092750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":114,"num_read_kb":6,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714869+0000","last_change":"2024-09-21T05:47:12.669821+0000","last_active":"2024-09-21T05:48:38.714869+0000","last_peered":"2024-09-21T05:48:38.714869+0000","last_clean":"2024-09-21T05:48:38.714869+0000","last_became_active":"2024-09-21T05:47:12.669418+0000","last_became_peered":"2024-09-21T05:47:12.669418+0000","last_unstale":"2024-09-21T05:48:38.714869+0000","last_undegraded":"2024-09-21T05:48:38.714869+0000","last_fullsized":"2024-09-21T05:48:38.714869+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:57.082509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.625480+0000","last_change":"2024-09-21T05:47:05.631182+0000","last_active":"2024-09-21T05:49:07.625480+0000","last_peered":"2024-09-21T05:49:07.625480+0000","last_clean":"2024-09-21T05:49:07.625480+0000","last_became_active":"2024-09-21T05:47:05.630716+0000","last_became_peered":"2024-09-21T05:47:05.630716+0000","last_unstale":"2024-09-21T05:49:07.625480+0000","last_undegraded":"2024-09-21T05:49:07.625480+0000","last_fullsized":"2024-09-21T05:49:07.625480+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:17.946858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720774+0000","last_change":"2024-09-21T05:47:03.620897+0000","last_active":"2024-09-21T05:48:38.720774+0000","last_peered":"2024-09-21T05:48:38.720774+0000","last_clean":"2024-09-21T05:48:38.720774+0000","last_became_active":"2024-09-21T05:47:03.620003+0000","last_became_peered":"2024-09-21T05:47:03.620003+0000","last_unstale":"2024-09-21T05:48:38.720774+0000","last_undegraded":"2024-09-21T05:48:38.720774+0000","last_fullsized":"2024-09-21T05:48:38.720774+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:51:07.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718144+0000","last_change":"2024-09-21T05:47:12.675320+0000","last_active":"2024-09-21T05:48:38.718144+0000","last_peered":"2024-09-21T05:48:38.718144+0000","last_clean":"2024-09-21T05:48:38.718144+0000","last_became_active":"2024-09-21T05:47:12.674715+0000","last_became_peered":"2024-09-21T05:47:12.674715+0000","last_unstale":"2024-09-21T05:48:38.718144+0000","last_undegraded":"2024-09-21T05:48:38.718144+0000","last_fullsized":"2024-09-21T05:48:38.718144+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:28.151947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.624754+0000","last_change":"2024-09-21T05:47:05.630786+0000","last_active":"2024-09-21T05:49:07.624754+0000","last_peered":"2024-09-21T05:49:07.624754+0000","last_clean":"2024-09-21T05:49:07.624754+0000","last_became_active":"2024-09-21T05:47:05.630433+0000","last_became_peered":"2024-09-21T05:47:05.630433+0000","last_unstale":"2024-09-21T05:49:07.624754+0000","last_undegraded":"2024-09-21T05:49:07.624754+0000","last_fullsized":"2024-09-21T05:49:07.624754+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:54.481462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.716342+0000","last_change":"2024-09-21T05:47:03.618990+0000","last_active":"2024-09-21T05:48:38.716342+0000","last_peered":"2024-09-21T05:48:38.716342+0000","last_clean":"2024-09-21T05:48:38.716342+0000","last_became_active":"2024-09-21T05:47:03.618679+0000","last_became_peered":"2024-09-21T05:47:03.618679+0000","last_unstale":"2024-09-21T05:48:38.716342+0000","last_undegraded":"2024-09-21T05:48:38.716342+0000","last_fullsized":"2024-09-21T05:48:38.716342+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:10.193233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721087+0000","last_change":"2024-09-21T05:47:12.675012+0000","last_active":"2024-09-21T05:48:38.721087+0000","last_peered":"2024-09-21T05:48:38.721087+0000","last_clean":"2024-09-21T05:48:38.721087+0000","last_became_active":"2024-09-21T05:47:12.674266+0000","last_became_peered":"2024-09-21T05:47:12.674266+0000","last_unstale":"2024-09-21T05:48:38.721087+0000","last_undegraded":"2024-09-21T05:48:38.721087+0000","last_fullsized":"2024-09-21T05:48:38.721087+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:43.525084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.623333+0000","last_change":"2024-09-21T05:47:05.625457+0000","last_active":"2024-09-21T05:49:07.623333+0000","last_peered":"2024-09-21T05:49:07.623333+0000","last_clean":"2024-09-21T05:49:07.623333+0000","last_became_active":"2024-09-21T05:47:05.625058+0000","last_became_peered":"2024-09-21T05:47:05.625058+0000","last_unstale":"2024-09-21T05:49:07.623333+0000","last_undegraded":"2024-09-21T05:49:07.623333+0000","last_fullsized":"2024-09-21T05:49:07.623333+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:29:09.352152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'41","reported_seq":303,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:36.132254+0000","last_change":"2024-09-21T05:47:03.621535+0000","last_active":"2024-09-21T05:49:36.132254+0000","last_peered":"2024-09-21T05:49:36.132254+0000","last_clean":"2024-09-21T05:49:36.132254+0000","last_became_active":"2024-09-21T05:47:03.621109+0000","last_became_peered":"2024-09-21T05:47:03.621109+0000","last_unstale":"2024-09-21T05:49:36.132254+0000","last_undegraded":"2024-09-21T05:49:36.132254+0000","last_fullsized":"2024-09-21T05:49:36.132254+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:31:12.135760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71694,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":223,"num_read_kb":177,"num_write":43,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714429+0000","last_change":"2024-09-21T05:47:12.676827+0000","last_active":"2024-09-21T05:48:38.714429+0000","last_peered":"2024-09-21T05:48:38.714429+0000","last_clean":"2024-09-21T05:48:38.714429+0000","last_became_active":"2024-09-21T05:47:12.676256+0000","last_became_peered":"2024-09-21T05:47:12.676256+0000","last_unstale":"2024-09-21T05:48:38.714429+0000","last_undegraded":"2024-09-21T05:48:38.714429+0000","last_fullsized":"2024-09-21T05:48:38.714429+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:40.932328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.642888+0000","last_change":"2024-09-21T05:47:05.636507+0000","last_active":"2024-09-21T05:49:07.642888+0000","last_peered":"2024-09-21T05:49:07.642888+0000","last_clean":"2024-09-21T05:49:07.642888+0000","last_became_active":"2024-09-21T05:47:05.636140+0000","last_became_peered":"2024-09-21T05:47:05.636140+0000","last_unstale":"2024-09-21T05:49:07.642888+0000","last_undegraded":"2024-09-21T05:49:07.642888+0000","last_fullsized":"2024-09-21T05:49:07.642888+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:16.879274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721493+0000","last_change":"2024-09-21T05:47:03.670425+0000","last_active":"2024-09-21T05:48:38.721493+0000","last_peered":"2024-09-21T05:48:38.721493+0000","last_clean":"2024-09-21T05:48:38.721493+0000","last_became_active":"2024-09-21T05:47:03.669973+0000","last_became_peered":"2024-09-21T05:47:03.669973+0000","last_unstale":"2024-09-21T05:48:38.721493+0000","last_undegraded":"2024-09-21T05:48:38.721493+0000","last_fullsized":"2024-09-21T05:48:38.721493+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:04.212044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721656+0000","last_change":"2024-09-21T05:47:12.677600+0000","last_active":"2024-09-21T05:48:38.721656+0000","last_peered":"2024-09-21T05:48:38.721656+0000","last_clean":"2024-09-21T05:48:38.721656+0000","last_became_active":"2024-09-21T05:47:12.677037+0000","last_became_peered":"2024-09-21T05:47:12.677037+0000","last_unstale":"2024-09-21T05:48:38.721656+0000","last_undegraded":"2024-09-21T05:48:38.721656+0000","last_fullsized":"2024-09-21T05:48:38.721656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:36.502821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.632646+0000","last_change":"2024-09-21T05:47:38.398403+0000","last_active":"2024-09-21T05:49:07.632646+0000","last_peered":"2024-09-21T05:49:07.632646+0000","last_clean":"2024-09-21T05:49:07.632646+0000","last_became_active":"2024-09-21T05:47:38.397953+0000","last_became_peered":"2024-09-21T05:47:38.397953+0000","last_unstale":"2024-09-21T05:49:07.632646+0000","last_undegraded":"2024-09-21T05:49:07.632646+0000","last_fullsized":"2024-09-21T05:49:07.632646+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:01.550222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":57,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.728525+0000","last_change":"2024-09-21T05:48:38.727813+0000","last_active":"2024-09-21T05:48:38.728525+0000","last_peered":"2024-09-21T05:48:38.728525+0000","last_clean":"2024-09-21T05:48:38.728525+0000","last_became_active":"2024-09-21T05:48:38.722709+0000","last_became_peered":"2024-09-21T05:48:38.722709+0000","last_unstale":"2024-09-21T05:48:38.728525+0000","last_undegraded":"2024-09-21T05:48:38.728525+0000","last_fullsized":"2024-09-21T05:48:38.728525+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:22.544711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.714262+0000","last_change":"2024-09-21T05:47:12.670466+0000","last_active":"2024-09-21T05:48:38.714262+0000","last_peered":"2024-09-21T05:48:38.714262+0000","last_clean":"2024-09-21T05:48:38.714262+0000","last_became_active":"2024-09-21T05:47:12.670032+0000","last_became_peered":"2024-09-21T05:47:12.670032+0000","last_unstale":"2024-09-21T05:48:38.714262+0000","last_undegraded":"2024-09-21T05:48:38.714262+0000","last_fullsized":"2024-09-21T05:48:38.714262+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:18.860347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.642591+0000","last_change":"2024-09-21T05:47:05.645093+0000","last_active":"2024-09-21T05:49:07.642591+0000","last_peered":"2024-09-21T05:49:07.642591+0000","last_clean":"2024-09-21T05:49:07.642591+0000","last_became_active":"2024-09-21T05:47:05.644739+0000","last_became_peered":"2024-09-21T05:47:05.644739+0000","last_unstale":"2024-09-21T05:49:07.642591+0000","last_undegraded":"2024-09-21T05:49:07.642591+0000","last_fullsized":"2024-09-21T05:49:07.642591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:43.895574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"85'6","reported_seq":257,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:35.733384+0000","last_change":"2024-09-21T05:47:03.619070+0000","last_active":"2024-09-21T05:49:35.733384+0000","last_peered":"2024-09-21T05:49:35.733384+0000","last_clean":"2024-09-21T05:49:35.733384+0000","last_became_active":"2024-09-21T05:47:03.618655+0000","last_became_peered":"2024-09-21T05:47:03.618655+0000","last_unstale":"2024-09-21T05:49:35.733384+0000","last_undegraded":"2024-09-21T05:49:35.733384+0000","last_fullsized":"2024-09-21T05:49:35.733384+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:29.206109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":212,"num_read_kb":212,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.285369+0000","last_change":"2024-09-21T05:47:12.672677+0000","last_active":"2024-09-21T05:48:39.285369+0000","last_peered":"2024-09-21T05:48:39.285369+0000","last_clean":"2024-09-21T05:48:39.285369+0000","last_became_active":"2024-09-21T05:47:12.672264+0000","last_became_peered":"2024-09-21T05:47:12.672264+0000","last_unstale":"2024-09-21T05:48:39.285369+0000","last_undegraded":"2024-09-21T05:48:39.285369+0000","last_fullsized":"2024-09-21T05:48:39.285369+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:31.680678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.720292+0000","last_change":"2024-09-21T05:47:12.672702+0000","last_active":"2024-09-21T05:48:38.720292+0000","last_peered":"2024-09-21T05:48:38.720292+0000","last_clean":"2024-09-21T05:48:38.720292+0000","last_became_active":"2024-09-21T05:47:12.672233+0000","last_became_peered":"2024-09-21T05:47:12.672233+0000","last_unstale":"2024-09-21T05:48:38.720292+0000","last_undegraded":"2024-09-21T05:48:38.720292+0000","last_fullsized":"2024-09-21T05:48:38.720292+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:04.235603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.622178+0000","last_change":"2024-09-21T05:47:05.633566+0000","last_active":"2024-09-21T05:49:07.622178+0000","last_peered":"2024-09-21T05:49:07.622178+0000","last_clean":"2024-09-21T05:49:07.622178+0000","last_became_active":"2024-09-21T05:47:05.633240+0000","last_became_peered":"2024-09-21T05:47:05.633240+0000","last_unstale":"2024-09-21T05:49:07.622178+0000","last_undegraded":"2024-09-21T05:49:07.622178+0000","last_fullsized":"2024-09-21T05:49:07.622178+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:10.106647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.721511+0000","last_change":"2024-09-21T05:47:03.621788+0000","last_active":"2024-09-21T05:48:38.721511+0000","last_peered":"2024-09-21T05:48:38.721511+0000","last_clean":"2024-09-21T05:48:38.721511+0000","last_became_active":"2024-09-21T05:47:03.621425+0000","last_became_peered":"2024-09-21T05:47:03.621425+0000","last_unstale":"2024-09-21T05:48:38.721511+0000","last_undegraded":"2024-09-21T05:48:38.721511+0000","last_fullsized":"2024-09-21T05:48:38.721511+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:51.069361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.718187+0000","last_change":"2024-09-21T05:47:12.670670+0000","last_active":"2024-09-21T05:48:38.718187+0000","last_peered":"2024-09-21T05:48:38.718187+0000","last_clean":"2024-09-21T05:48:38.718187+0000","last_became_active":"2024-09-21T05:47:12.670192+0000","last_became_peered":"2024-09-21T05:47:12.670192+0000","last_unstale":"2024-09-21T05:48:38.718187+0000","last_undegraded":"2024-09-21T05:48:38.718187+0000","last_fullsized":"2024-09-21T05:48:38.718187+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:59.430991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.635898+0000","last_change":"2024-09-21T05:47:05.637775+0000","last_active":"2024-09-21T05:49:07.635898+0000","last_peered":"2024-09-21T05:49:07.635898+0000","last_clean":"2024-09-21T05:49:07.635898+0000","last_became_active":"2024-09-21T05:47:05.637436+0000","last_became_peered":"2024-09-21T05:47:05.637436+0000","last_unstale":"2024-09-21T05:49:07.635898+0000","last_undegraded":"2024-09-21T05:49:07.635898+0000","last_fullsized":"2024-09-21T05:49:07.635898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:45:59.041879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.432553+0000","last_change":"2024-09-21T05:47:03.611317+0000","last_active":"2024-09-21T05:48:39.432553+0000","last_peered":"2024-09-21T05:48:39.432553+0000","last_clean":"2024-09-21T05:48:39.432553+0000","last_became_active":"2024-09-21T05:47:03.610967+0000","last_became_peered":"2024-09-21T05:47:03.610967+0000","last_unstale":"2024-09-21T05:48:39.432553+0000","last_undegraded":"2024-09-21T05:48:39.432553+0000","last_fullsized":"2024-09-21T05:48:39.432553+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:44.263380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:39.286190+0000","last_change":"2024-09-21T05:47:03.624584+0000","last_active":"2024-09-21T05:48:39.286190+0000","last_peered":"2024-09-21T05:48:39.286190+0000","last_clean":"2024-09-21T05:48:39.286190+0000","last_became_active":"2024-09-21T05:47:03.623886+0000","last_became_peered":"2024-09-21T05:47:03.623886+0000","last_unstale":"2024-09-21T05:48:39.286190+0000","last_undegraded":"2024-09-21T05:48:39.286190+0000","last_fullsized":"2024-09-21T05:48:39.286190+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:55.451732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.628968+0000","last_change":"2024-09-21T05:47:38.731762+0000","last_active":"2024-09-21T05:49:07.628968+0000","last_peered":"2024-09-21T05:49:07.628968+0000","last_clean":"2024-09-21T05:49:07.628968+0000","last_became_active":"2024-09-21T05:47:38.731325+0000","last_became_peered":"2024-09-21T05:47:38.731325+0000","last_unstale":"2024-09-21T05:49:07.628968+0000","last_undegraded":"2024-09-21T05:49:07.628968+0000","last_fullsized":"2024-09-21T05:49:07.628968+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:42.516434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.715948+0000","last_change":"2024-09-21T05:47:12.677198+0000","last_active":"2024-09-21T05:48:38.715948+0000","last_peered":"2024-09-21T05:48:38.715948+0000","last_clean":"2024-09-21T05:48:38.715948+0000","last_became_active":"2024-09-21T05:47:12.676673+0000","last_became_peered":"2024-09-21T05:47:12.676673+0000","last_unstale":"2024-09-21T05:48:38.715948+0000","last_undegraded":"2024-09-21T05:48:38.715948+0000","last_fullsized":"2024-09-21T05:48:38.715948+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:58.861348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'7","reported_seq":172,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:37.813453+0000","last_change":"2024-09-21T05:48:38.730420+0000","last_active":"2024-09-21T05:49:37.813453+0000","last_peered":"2024-09-21T05:49:37.813453+0000","last_clean":"2024-09-21T05:49:37.813453+0000","last_became_active":"2024-09-21T05:48:38.722303+0000","last_became_peered":"2024-09-21T05:48:38.722303+0000","last_unstale":"2024-09-21T05:49:37.813453+0000","last_undegraded":"2024-09-21T05:49:37.813453+0000","last_fullsized":"2024-09-21T05:49:37.813453+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:02.589475+0000","last_clean_scrub_stamp":"2024-09-21T05:47:02.589475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:37.846446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1506,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.626911+0000","last_change":"2024-09-21T05:47:05.641444+0000","last_active":"2024-09-21T05:49:07.626911+0000","last_peered":"2024-09-21T05:49:07.626911+0000","last_clean":"2024-09-21T05:49:07.626911+0000","last_became_active":"2024-09-21T05:47:05.640967+0000","last_became_peered":"2024-09-21T05:47:05.640967+0000","last_unstale":"2024-09-21T05:49:07.626911+0000","last_undegraded":"2024-09-21T05:49:07.626911+0000","last_fullsized":"2024-09-21T05:49:07.626911+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:20.698467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:48:38.716537+0000","last_change":"2024-09-21T05:47:12.680157+0000","last_active":"2024-09-21T05:48:38.716537+0000","last_peered":"2024-09-21T05:48:38.716537+0000","last_clean":"2024-09-21T05:48:38.716537+0000","last_became_active":"2024-09-21T05:47:12.679604+0000","last_became_peered":"2024-09-21T05:47:12.679604+0000","last_unstale":"2024-09-21T05:48:38.716537+0000","last_undegraded":"2024-09-21T05:48:38.716537+0000","last_fullsized":"2024-09-21T05:48:38.716537+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:11.645897+0000","last_clean_scrub_stamp":"2024-09-21T05:47:11.645897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:15.381901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.636056+0000","last_change":"2024-09-21T05:47:05.635022+0000","last_active":"2024-09-21T05:49:07.636056+0000","last_peered":"2024-09-21T05:49:07.636056+0000","last_clean":"2024-09-21T05:49:07.636056+0000","last_became_active":"2024-09-21T05:47:05.634592+0000","last_became_peered":"2024-09-21T05:47:05.634592+0000","last_unstale":"2024-09-21T05:49:07.636056+0000","last_undegraded":"2024-09-21T05:49:07.636056+0000","last_fullsized":"2024-09-21T05:49:07.636056+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:48.159339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.634884+0000","last_change":"2024-09-21T05:48:38.722629+0000","last_active":"2024-09-21T05:49:07.634884+0000","last_peered":"2024-09-21T05:49:07.634884+0000","last_clean":"2024-09-21T05:49:07.634884+0000","last_became_active":"2024-09-21T05:48:38.722198+0000","last_became_peered":"2024-09-21T05:48:38.722198+0000","last_unstale":"2024-09-21T05:49:07.634884+0000","last_undegraded":"2024-09-21T05:49:07.634884+0000","last_fullsized":"2024-09-21T05:49:07.634884+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:26.126710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.628191+0000","last_change":"2024-09-21T05:47:05.637359+0000","last_active":"2024-09-21T05:49:07.628191+0000","last_peered":"2024-09-21T05:49:07.628191+0000","last_clean":"2024-09-21T05:49:07.628191+0000","last_became_active":"2024-09-21T05:47:05.636998+0000","last_became_peered":"2024-09-21T05:47:05.636998+0000","last_unstale":"2024-09-21T05:49:07.628191+0000","last_undegraded":"2024-09-21T05:49:07.628191+0000","last_fullsized":"2024-09-21T05:49:07.628191+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:06.186344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.629417+0000","last_change":"2024-09-21T05:47:05.633304+0000","last_active":"2024-09-21T05:49:07.629417+0000","last_peered":"2024-09-21T05:49:07.629417+0000","last_clean":"2024-09-21T05:49:07.629417+0000","last_became_active":"2024-09-21T05:47:05.632919+0000","last_became_peered":"2024-09-21T05:47:05.632919+0000","last_unstale":"2024-09-21T05:49:07.629417+0000","last_undegraded":"2024-09-21T05:49:07.629417+0000","last_fullsized":"2024-09-21T05:49:07.629417+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:16.108908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.629183+0000","last_change":"2024-09-21T05:47:05.631091+0000","last_active":"2024-09-21T05:49:07.629183+0000","last_peered":"2024-09-21T05:49:07.629183+0000","last_clean":"2024-09-21T05:49:07.629183+0000","last_became_active":"2024-09-21T05:47:05.630740+0000","last_became_peered":"2024-09-21T05:47:05.630740+0000","last_unstale":"2024-09-21T05:49:07.629183+0000","last_undegraded":"2024-09-21T05:49:07.629183+0000","last_fullsized":"2024-09-21T05:49:07.629183+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:36:41.136890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.631663+0000","last_change":"2024-09-21T05:47:38.398773+0000","last_active":"2024-09-21T05:49:07.631663+0000","last_peered":"2024-09-21T05:49:07.631663+0000","last_clean":"2024-09-21T05:49:07.631663+0000","last_became_active":"2024-09-21T05:47:38.398378+0000","last_became_peered":"2024-09-21T05:47:38.398378+0000","last_unstale":"2024-09-21T05:49:07.631663+0000","last_undegraded":"2024-09-21T05:49:07.631663+0000","last_fullsized":"2024-09-21T05:49:07.631663+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:32.247222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.636377+0000","last_change":"2024-09-21T05:47:05.641782+0000","last_active":"2024-09-21T05:49:07.636377+0000","last_peered":"2024-09-21T05:49:07.636377+0000","last_clean":"2024-09-21T05:49:07.636377+0000","last_became_active":"2024-09-21T05:47:05.641422+0000","last_became_peered":"2024-09-21T05:47:05.641422+0000","last_unstale":"2024-09-21T05:49:07.636377+0000","last_undegraded":"2024-09-21T05:49:07.636377+0000","last_fullsized":"2024-09-21T05:49:07.636377+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:33.819329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.621247+0000","last_change":"2024-09-21T05:47:38.396070+0000","last_active":"2024-09-21T05:49:07.621247+0000","last_peered":"2024-09-21T05:49:07.621247+0000","last_clean":"2024-09-21T05:49:07.621247+0000","last_became_active":"2024-09-21T05:47:38.395727+0000","last_became_peered":"2024-09-21T05:47:38.395727+0000","last_unstale":"2024-09-21T05:49:07.621247+0000","last_undegraded":"2024-09-21T05:49:07.621247+0000","last_fullsized":"2024-09-21T05:49:07.621247+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:41.816692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.628368+0000","last_change":"2024-09-21T05:47:05.633701+0000","last_active":"2024-09-21T05:49:07.628368+0000","last_peered":"2024-09-21T05:49:07.628368+0000","last_clean":"2024-09-21T05:49:07.628368+0000","last_became_active":"2024-09-21T05:47:05.632671+0000","last_became_peered":"2024-09-21T05:47:05.632671+0000","last_unstale":"2024-09-21T05:49:07.628368+0000","last_undegraded":"2024-09-21T05:49:07.628368+0000","last_fullsized":"2024-09-21T05:49:07.628368+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:56.180731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.635725+0000","last_change":"2024-09-21T05:47:05.639419+0000","last_active":"2024-09-21T05:49:07.635725+0000","last_peered":"2024-09-21T05:49:07.635725+0000","last_clean":"2024-09-21T05:49:07.635725+0000","last_became_active":"2024-09-21T05:47:05.639060+0000","last_became_peered":"2024-09-21T05:47:05.639060+0000","last_unstale":"2024-09-21T05:49:07.635725+0000","last_undegraded":"2024-09-21T05:49:07.635725+0000","last_fullsized":"2024-09-21T05:49:07.635725+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:09.562359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.642658+0000","last_change":"2024-09-21T05:47:05.641218+0000","last_active":"2024-09-21T05:49:07.642658+0000","last_peered":"2024-09-21T05:49:07.642658+0000","last_clean":"2024-09-21T05:49:07.642658+0000","last_became_active":"2024-09-21T05:47:05.640813+0000","last_became_peered":"2024-09-21T05:47:05.640813+0000","last_unstale":"2024-09-21T05:49:07.642658+0000","last_undegraded":"2024-09-21T05:49:07.642658+0000","last_fullsized":"2024-09-21T05:49:07.642658+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:21.057096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.629873+0000","last_change":"2024-09-21T05:47:05.627711+0000","last_active":"2024-09-21T05:49:07.629873+0000","last_peered":"2024-09-21T05:49:07.629873+0000","last_clean":"2024-09-21T05:49:07.629873+0000","last_became_active":"2024-09-21T05:47:05.626394+0000","last_became_peered":"2024-09-21T05:47:05.626394+0000","last_unstale":"2024-09-21T05:49:07.629873+0000","last_undegraded":"2024-09-21T05:49:07.629873+0000","last_fullsized":"2024-09-21T05:49:07.629873+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:31.038727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.636028+0000","last_change":"2024-09-21T05:47:05.632835+0000","last_active":"2024-09-21T05:49:07.636028+0000","last_peered":"2024-09-21T05:49:07.636028+0000","last_clean":"2024-09-21T05:49:07.636028+0000","last_became_active":"2024-09-21T05:47:05.632486+0000","last_became_peered":"2024-09-21T05:47:05.632486+0000","last_unstale":"2024-09-21T05:49:07.636028+0000","last_undegraded":"2024-09-21T05:49:07.636028+0000","last_fullsized":"2024-09-21T05:49:07.636028+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:04.365517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.626287+0000","last_change":"2024-09-21T05:47:05.638381+0000","last_active":"2024-09-21T05:49:07.626287+0000","last_peered":"2024-09-21T05:49:07.626287+0000","last_clean":"2024-09-21T05:49:07.626287+0000","last_became_active":"2024-09-21T05:47:05.638007+0000","last_became_peered":"2024-09-21T05:47:05.638007+0000","last_unstale":"2024-09-21T05:49:07.626287+0000","last_undegraded":"2024-09-21T05:49:07.626287+0000","last_fullsized":"2024-09-21T05:49:07.626287+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:06.615367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.640701+0000","last_change":"2024-09-21T05:47:05.644624+0000","last_active":"2024-09-21T05:49:07.640701+0000","last_peered":"2024-09-21T05:49:07.640701+0000","last_clean":"2024-09-21T05:49:07.640701+0000","last_became_active":"2024-09-21T05:47:05.644257+0000","last_became_peered":"2024-09-21T05:47:05.644257+0000","last_unstale":"2024-09-21T05:49:07.640701+0000","last_undegraded":"2024-09-21T05:49:07.640701+0000","last_fullsized":"2024-09-21T05:49:07.640701+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:31.385313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.642691+0000","last_change":"2024-09-21T05:47:05.646368+0000","last_active":"2024-09-21T05:49:07.642691+0000","last_peered":"2024-09-21T05:49:07.642691+0000","last_clean":"2024-09-21T05:49:07.642691+0000","last_became_active":"2024-09-21T05:47:05.645952+0000","last_became_peered":"2024-09-21T05:47:05.645952+0000","last_unstale":"2024-09-21T05:49:07.642691+0000","last_undegraded":"2024-09-21T05:49:07.642691+0000","last_fullsized":"2024-09-21T05:49:07.642691+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:56.585911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.642261+0000","last_change":"2024-09-21T05:47:05.640167+0000","last_active":"2024-09-21T05:49:07.642261+0000","last_peered":"2024-09-21T05:49:07.642261+0000","last_clean":"2024-09-21T05:49:07.642261+0000","last_became_active":"2024-09-21T05:47:05.639770+0000","last_became_peered":"2024-09-21T05:47:05.639770+0000","last_unstale":"2024-09-21T05:49:07.642261+0000","last_undegraded":"2024-09-21T05:49:07.642261+0000","last_fullsized":"2024-09-21T05:49:07.642261+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:45.661131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.626064+0000","last_change":"2024-09-21T05:47:38.732677+0000","last_active":"2024-09-21T05:49:07.626064+0000","last_peered":"2024-09-21T05:49:07.626064+0000","last_clean":"2024-09-21T05:49:07.626064+0000","last_became_active":"2024-09-21T05:47:38.732236+0000","last_became_peered":"2024-09-21T05:47:38.732236+0000","last_unstale":"2024-09-21T05:49:07.626064+0000","last_undegraded":"2024-09-21T05:49:07.626064+0000","last_fullsized":"2024-09-21T05:49:07.626064+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:41.474677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.631162+0000","last_change":"2024-09-21T05:47:05.629814+0000","last_active":"2024-09-21T05:49:07.631162+0000","last_peered":"2024-09-21T05:49:07.631162+0000","last_clean":"2024-09-21T05:49:07.631162+0000","last_became_active":"2024-09-21T05:47:05.629464+0000","last_became_peered":"2024-09-21T05:47:05.629464+0000","last_unstale":"2024-09-21T05:49:07.631162+0000","last_undegraded":"2024-09-21T05:49:07.631162+0000","last_fullsized":"2024-09-21T05:49:07.631162+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:58.222820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.627810+0000","last_change":"2024-09-21T05:47:05.629643+0000","last_active":"2024-09-21T05:49:07.627810+0000","last_peered":"2024-09-21T05:49:07.627810+0000","last_clean":"2024-09-21T05:49:07.627810+0000","last_became_active":"2024-09-21T05:47:05.629248+0000","last_became_peered":"2024-09-21T05:47:05.629248+0000","last_unstale":"2024-09-21T05:49:07.627810+0000","last_undegraded":"2024-09-21T05:49:07.627810+0000","last_fullsized":"2024-09-21T05:49:07.627810+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:31.569209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.618090+0000","last_change":"2024-09-21T05:47:05.632188+0000","last_active":"2024-09-21T05:49:07.618090+0000","last_peered":"2024-09-21T05:49:07.618090+0000","last_clean":"2024-09-21T05:49:07.618090+0000","last_became_active":"2024-09-21T05:47:05.631799+0000","last_became_peered":"2024-09-21T05:47:05.631799+0000","last_unstale":"2024-09-21T05:49:07.618090+0000","last_undegraded":"2024-09-21T05:49:07.618090+0000","last_fullsized":"2024-09-21T05:49:07.618090+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:09.762405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.641141+0000","last_change":"2024-09-21T05:47:05.644746+0000","last_active":"2024-09-21T05:49:07.641141+0000","last_peered":"2024-09-21T05:49:07.641141+0000","last_clean":"2024-09-21T05:49:07.641141+0000","last_became_active":"2024-09-21T05:47:05.644326+0000","last_became_peered":"2024-09-21T05:47:05.644326+0000","last_unstale":"2024-09-21T05:49:07.641141+0000","last_undegraded":"2024-09-21T05:49:07.641141+0000","last_fullsized":"2024-09-21T05:49:07.641141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:22.937783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.634476+0000","last_change":"2024-09-21T05:47:05.639214+0000","last_active":"2024-09-21T05:49:07.634476+0000","last_peered":"2024-09-21T05:49:07.634476+0000","last_clean":"2024-09-21T05:49:07.634476+0000","last_became_active":"2024-09-21T05:47:05.638443+0000","last_became_peered":"2024-09-21T05:47:05.638443+0000","last_unstale":"2024-09-21T05:49:07.634476+0000","last_undegraded":"2024-09-21T05:49:07.634476+0000","last_fullsized":"2024-09-21T05:49:07.634476+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:30.134020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.641271+0000","last_change":"2024-09-21T05:47:05.644233+0000","last_active":"2024-09-21T05:49:07.641271+0000","last_peered":"2024-09-21T05:49:07.641271+0000","last_clean":"2024-09-21T05:49:07.641271+0000","last_became_active":"2024-09-21T05:47:05.643820+0000","last_became_peered":"2024-09-21T05:47:05.643820+0000","last_unstale":"2024-09-21T05:49:07.641271+0000","last_undegraded":"2024-09-21T05:49:07.641271+0000","last_fullsized":"2024-09-21T05:49:07.641271+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:42.695997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.627216+0000","last_change":"2024-09-21T05:47:05.637569+0000","last_active":"2024-09-21T05:49:07.627216+0000","last_peered":"2024-09-21T05:49:07.627216+0000","last_clean":"2024-09-21T05:49:07.627216+0000","last_became_active":"2024-09-21T05:47:05.637269+0000","last_became_peered":"2024-09-21T05:47:05.637269+0000","last_unstale":"2024-09-21T05:49:07.627216+0000","last_undegraded":"2024-09-21T05:49:07.627216+0000","last_fullsized":"2024-09-21T05:49:07.627216+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:28:26.335398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.624908+0000","last_change":"2024-09-21T05:47:05.633457+0000","last_active":"2024-09-21T05:49:07.624908+0000","last_peered":"2024-09-21T05:49:07.624908+0000","last_clean":"2024-09-21T05:49:07.624908+0000","last_became_active":"2024-09-21T05:47:05.633066+0000","last_became_peered":"2024-09-21T05:47:05.633066+0000","last_unstale":"2024-09-21T05:49:07.624908+0000","last_undegraded":"2024-09-21T05:49:07.624908+0000","last_fullsized":"2024-09-21T05:49:07.624908+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:45.904152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.624760+0000","last_change":"2024-09-21T05:47:38.399914+0000","last_active":"2024-09-21T05:49:07.624760+0000","last_peered":"2024-09-21T05:49:07.624760+0000","last_clean":"2024-09-21T05:49:07.624760+0000","last_became_active":"2024-09-21T05:47:38.399480+0000","last_became_peered":"2024-09-21T05:47:38.399480+0000","last_unstale":"2024-09-21T05:49:07.624760+0000","last_undegraded":"2024-09-21T05:49:07.624760+0000","last_fullsized":"2024-09-21T05:49:07.624760+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:51.281796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.623866+0000","last_change":"2024-09-21T05:47:05.630944+0000","last_active":"2024-09-21T05:49:07.623866+0000","last_peered":"2024-09-21T05:49:07.623866+0000","last_clean":"2024-09-21T05:49:07.623866+0000","last_became_active":"2024-09-21T05:47:05.630498+0000","last_became_peered":"2024-09-21T05:47:05.630498+0000","last_unstale":"2024-09-21T05:49:07.623866+0000","last_undegraded":"2024-09-21T05:49:07.623866+0000","last_fullsized":"2024-09-21T05:49:07.623866+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:20.185094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.632028+0000","last_change":"2024-09-21T05:47:05.636134+0000","last_active":"2024-09-21T05:49:07.632028+0000","last_peered":"2024-09-21T05:49:07.632028+0000","last_clean":"2024-09-21T05:49:07.632028+0000","last_became_active":"2024-09-21T05:47:05.635724+0000","last_became_peered":"2024-09-21T05:47:05.635724+0000","last_unstale":"2024-09-21T05:49:07.632028+0000","last_undegraded":"2024-09-21T05:49:07.632028+0000","last_fullsized":"2024-09-21T05:49:07.632028+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:55.455819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.635816+0000","last_change":"2024-09-21T05:47:05.641209+0000","last_active":"2024-09-21T05:49:07.635816+0000","last_peered":"2024-09-21T05:49:07.635816+0000","last_clean":"2024-09-21T05:49:07.635816+0000","last_became_active":"2024-09-21T05:47:05.640543+0000","last_became_peered":"2024-09-21T05:47:05.640543+0000","last_unstale":"2024-09-21T05:49:07.635816+0000","last_undegraded":"2024-09-21T05:49:07.635816+0000","last_fullsized":"2024-09-21T05:49:07.635816+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:49.579724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.629794+0000","last_change":"2024-09-21T05:47:05.634158+0000","last_active":"2024-09-21T05:49:07.629794+0000","last_peered":"2024-09-21T05:49:07.629794+0000","last_clean":"2024-09-21T05:49:07.629794+0000","last_became_active":"2024-09-21T05:47:05.633657+0000","last_became_peered":"2024-09-21T05:47:05.633657+0000","last_unstale":"2024-09-21T05:49:07.629794+0000","last_undegraded":"2024-09-21T05:49:07.629794+0000","last_fullsized":"2024-09-21T05:49:07.629794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:37.868206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T05:49:07.642715+0000","last_change":"2024-09-21T05:47:05.641358+0000","last_active":"2024-09-21T05:49:07.642715+0000","last_peered":"2024-09-21T05:49:07.642715+0000","last_clean":"2024-09-21T05:49:07.642715+0000","last_became_active":"2024-09-21T05:47:05.641025+0000","last_became_peered":"2024-09-21T05:47:05.641025+0000","last_unstale":"2024-09-21T05:49:07.642715+0000","last_undegraded":"2024-09-21T05:49:07.642715+0000","last_fullsized":"2024-09-21T05:49:07.642715+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:04.602164+0000","last_clean_scrub_stamp":"2024-09-21T05:47:04.602164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:01.654621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":81011,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1108,"num_read_kb":640,"num_write":275,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":756,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":233162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":235,"ondisk_log_size":235,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":248927,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743468,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":490255,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939697,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1105920,"data_stored":1148519,"data_compressed":65650,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103222,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":489558,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299451,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":954368,"data_stored":489802,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495680,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":1088053,"data_compressed":65650,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659205,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":485946,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855435,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1028096,"data_stored":1082508,"data_compressed":65650,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051664,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":954368,"data_stored":490161,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247892,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":484770,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444121,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":553137,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607646,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":554654,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738467,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":487011,"data_compressed":29396,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34637,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34637,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34637,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36254,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36254,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36254,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36254,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":70314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":74455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T05:49:41.130 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:49:41.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:40 smithi116 ceph-mon[34332]: pgmap v376: 129 pgs: 129 active+clean; 656 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-21T05:49:41.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:40 smithi116 ceph-mon[34332]: from='client.15525 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:49:41.375 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:41.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:40 smithi160 ceph-mon[33979]: pgmap v376: 129 pgs: 129 active+clean; 656 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-21T05:49:41.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:40 smithi160 ceph-mon[33979]: from='client.15525 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:49:41.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.845+0000 7fac173bb640 1 -- 172.21.15.70:0/265166268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac10108cf0 msgr2=0x7fac1010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:41.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.845+0000 7fac173bb640 1 --2- 172.21.15.70:0/265166268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac10108cf0 0x7fac1010f520 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fac08009ca0 tx=0x7fac0802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:49:41.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.845+0000 7fac173bb640 1 -- 172.21.15.70:0/265166268 shutdown_connections 2024-09-21T05:49:41.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.845+0000 7fac173bb640 1 --2- 172.21.15.70:0/265166268 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac101083a0 0x7fac101087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:41.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.845+0000 7fac173bb640 1 --2- 172.21.15.70:0/265166268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac10108cf0 0x7fac1010f520 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:41.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.845+0000 7fac173bb640 1 --2- 172.21.15.70:0/265166268 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fac10102a60 0x7fac10102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:41.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.845+0000 7fac173bb640 1 -- 172.21.15.70:0/265166268 >> 172.21.15.70:0/265166268 conn(0x7fac10079730 msgr2=0x7fac10079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:41.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.846+0000 7fac173bb640 1 -- 172.21.15.70:0/265166268 shutdown_connections 2024-09-21T05:49:41.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.846+0000 7fac173bb640 1 -- 172.21.15.70:0/265166268 wait complete. 2024-09-21T05:49:41.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.846+0000 7fac173bb640 1 Processor -- start 2024-09-21T05:49:41.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.846+0000 7fac173bb640 1 -- start start 2024-09-21T05:49:41.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.846+0000 7fac173bb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fac10102a60 0x7fac1019a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:41.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.846+0000 7fac173bb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac101083a0 0x7fac1019a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:41.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.847+0000 7fac173bb640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac10108cf0 0x7fac1019fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:41.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.847+0000 7fac173bb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fac10112950 con 0x7fac101083a0 2024-09-21T05:49:41.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.847+0000 7fac173bb640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fac101127d0 con 0x7fac10102a60 2024-09-21T05:49:41.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.847+0000 7fac173bb640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fac10112ad0 con 0x7fac10108cf0 2024-09-21T05:49:41.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.847+0000 7fac14956640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac101083a0 0x7fac1019a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:41.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.847+0000 7fac14956640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac101083a0 0x7fac1019a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55264/0 (socket says 172.21.15.70:55264) 2024-09-21T05:49:41.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.847+0000 7fac14956640 1 -- 172.21.15.70:0/3986124546 learned_addr learned my addr 172.21.15.70:0/3986124546 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:41.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.847+0000 7fac15157640 1 --2- 172.21.15.70:0/3986124546 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fac10102a60 0x7fac1019a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:41.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.847+0000 7fac15958640 1 --2- 172.21.15.70:0/3986124546 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac10108cf0 0x7fac1019fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:41.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.847+0000 7fac14956640 1 -- 172.21.15.70:0/3986124546 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac10108cf0 msgr2=0x7fac1019fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:41.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.847+0000 7fac14956640 1 --2- 172.21.15.70:0/3986124546 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac10108cf0 0x7fac1019fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:41.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.847+0000 7fac14956640 1 -- 172.21.15.70:0/3986124546 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fac10102a60 msgr2=0x7fac1019a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:41.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.847+0000 7fac14956640 1 --2- 172.21.15.70:0/3986124546 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fac10102a60 0x7fac1019a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:41.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.847+0000 7fac14956640 1 -- 172.21.15.70:0/3986124546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac101a0340 con 0x7fac101083a0 2024-09-21T05:49:41.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.847+0000 7fac14956640 1 --2- 172.21.15.70:0/3986124546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac101083a0 0x7fac1019a970 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fac0000e9f0 tx=0x7fac0000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:41.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.847+0000 7fac067fc640 1 -- 172.21.15.70:0/3986124546 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac0000ccc0 con 0x7fac101083a0 2024-09-21T05:49:41.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.847+0000 7fac067fc640 1 -- 172.21.15.70:0/3986124546 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fac000054d0 con 0x7fac101083a0 2024-09-21T05:49:41.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.847+0000 7fac173bb640 1 -- 172.21.15.70:0/3986124546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac101a0630 con 0x7fac101083a0 2024-09-21T05:49:41.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.847+0000 7fac067fc640 1 -- 172.21.15.70:0/3986124546 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac00010430 con 0x7fac101083a0 2024-09-21T05:49:41.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.847+0000 7fac173bb640 1 -- 172.21.15.70:0/3986124546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac101a6d90 con 0x7fac101083a0 2024-09-21T05:49:41.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.848+0000 7fac173bb640 1 -- 172.21.15.70:0/3986124546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac10102e70 con 0x7fac101083a0 2024-09-21T05:49:41.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.850+0000 7fac067fc640 1 -- 172.21.15.70:0/3986124546 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) ==== 154563+0+0 (secure 0 0 0) 0x7fac000046c0 con 0x7fac101083a0 2024-09-21T05:49:41.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.851+0000 7fac067fc640 1 --2- 172.21.15.70:0/3986124546 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fabfc0b6620 0x7fabfc0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:41.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.851+0000 7fac15157640 1 --2- 172.21.15.70:0/3986124546 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fabfc0b6620 0x7fabfc0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:41.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.851+0000 7fac067fc640 1 -- 172.21.15.70:0/3986124546 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fac000e7e50 con 0x7fac101083a0 2024-09-21T05:49:41.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.851+0000 7fac15157640 1 --2- 172.21.15.70:0/3986124546 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fabfc0b6620 0x7fabfc0b8b30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00bbe0 tx=0x7fac0c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:41.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:41.854+0000 7fac067fc640 1 -- 172.21.15.70:0/3986124546 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fac00056710 con 0x7fac101083a0 2024-09-21T05:49:42.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:42.065+0000 7fac173bb640 1 -- 172.21.15.70:0/3986124546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac1019b500 con 0x7fac101083a0 2024-09-21T05:49:42.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:42.066+0000 7fac067fc640 1 -- 172.21.15.70:0/3986124546 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11986 (secure 0 0 0) 0x7fac000ae190 con 0x7fac101083a0 2024-09-21T05:49:42.068 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:49:42.068 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"btime":"2024-09-21T05:49:35:887363+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3519318330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3519318330},{"type":"v1","addr":"172.21.15.70:6835","nonce":3519318330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2706663460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2706663460},{"type":"v1","addr":"172.21.15.70:6837","nonce":2706663460}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:47:06.246985+0000","modified":"2024-09-21T05:49:35.712686+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24628,"mds_2":24611,"mds_3":24610,"mds_4":24598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/1914209867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1914209867},{"type":"v1","addr":"172.21.15.70:6839","nonce":1914209867}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3392175775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3392175775},{"type":"v1","addr":"172.21.15.70:6841","nonce":3392175775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/3543945704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3543945704},{"type":"v1","addr":"172.21.15.160:6833","nonce":3543945704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6833/283778129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":283778129},{"type":"v1","addr":"172.21.15.116:6833","nonce":283778129}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/3787256790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3787256790},{"type":"v1","addr":"172.21.15.116:6835","nonce":3787256790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.160:6835/2001692372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2001692372},{"type":"v1","addr":"172.21.15.160:6835","nonce":2001692372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.160:6837/2558120045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2558120045},{"type":"v1","addr":"172.21.15.160:6837","nonce":2558120045}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24611":{"gid":24611,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/444312934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":444312934},{"type":"v1","addr":"172.21.15.116:6837","nonce":444312934}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.160:6839/1339744282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1339744282},{"type":"v1","addr":"172.21.15.160:6839","nonce":1339744282}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/3952175670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3952175670},{"type":"v1","addr":"172.21.15.116:6839","nonce":3952175670}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24641,"qdb_cluster":[24598,24611,24610,24628,24641]},"id":1}]} 2024-09-21T05:49:42.069 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-09-21T05:49:42.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:42.068+0000 7fac173bb640 1 -- 172.21.15.70:0/3986124546 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fabfc0b6620 msgr2=0x7fabfc0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:42.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:42.068+0000 7fac173bb640 1 --2- 172.21.15.70:0/3986124546 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fabfc0b6620 0x7fabfc0b8b30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00bbe0 tx=0x7fac0c00b390 comp rx=0 tx=0).stop 2024-09-21T05:49:42.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:42.068+0000 7fac173bb640 1 -- 172.21.15.70:0/3986124546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac101083a0 msgr2=0x7fac1019a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:42.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:42.068+0000 7fac173bb640 1 --2- 172.21.15.70:0/3986124546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac101083a0 0x7fac1019a970 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fac0000e9f0 tx=0x7fac0000eeb0 comp rx=0 tx=0).stop 2024-09-21T05:49:42.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:42.068+0000 7fac173bb640 1 -- 172.21.15.70:0/3986124546 shutdown_connections 2024-09-21T05:49:42.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:42.068+0000 7fac173bb640 1 --2- 172.21.15.70:0/3986124546 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fabfc0b6620 0x7fabfc0b8b30 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:42.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:42.068+0000 7fac173bb640 1 --2- 172.21.15.70:0/3986124546 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac10108cf0 0x7fac1019fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:42.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:42.068+0000 7fac173bb640 1 --2- 172.21.15.70:0/3986124546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac101083a0 0x7fac1019a970 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:42.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:42.068+0000 7fac173bb640 1 --2- 172.21.15.70:0/3986124546 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fac10102a60 0x7fac1019a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:42.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:42.068+0000 7fac173bb640 1 -- 172.21.15.70:0/3986124546 >> 172.21.15.70:0/3986124546 conn(0x7fac10079730 msgr2=0x7fac1006b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:42.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:42.068+0000 7fac173bb640 1 -- 172.21.15.70:0/3986124546 shutdown_connections 2024-09-21T05:49:42.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:42.068+0000 7fac173bb640 1 -- 172.21.15.70:0/3986124546 wait complete. 2024-09-21T05:49:42.719 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:49:42.968 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:43.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:42 smithi070 ceph-mon[30981]: pgmap v377: 129 pgs: 129 active+clean; 656 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-21T05:49:43.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:42 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3986124546' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:49:43.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:42 smithi116 ceph-mon[34332]: pgmap v377: 129 pgs: 129 active+clean; 656 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-21T05:49:43.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:42 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3986124546' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:49:43.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:42 smithi160 ceph-mon[33979]: pgmap v377: 129 pgs: 129 active+clean; 656 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-21T05:49:43.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:42 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3986124546' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:49:43.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.521+0000 7fd18872c640 1 -- 172.21.15.70:0/1041613225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd180108d20 msgr2=0x7fd18010f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:43.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.521+0000 7fd18872c640 1 --2- 172.21.15.70:0/1041613225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd180108d20 0x7fd18010f550 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd178009900 tx=0x7fd17802a410 comp rx=0 tx=0).stop 2024-09-21T05:49:43.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.521+0000 7fd18872c640 1 -- 172.21.15.70:0/1041613225 shutdown_connections 2024-09-21T05:49:43.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.521+0000 7fd18872c640 1 --2- 172.21.15.70:0/1041613225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd180108d20 0x7fd18010f550 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:43.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.521+0000 7fd18872c640 1 --2- 172.21.15.70:0/1041613225 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd1801083d0 0x7fd1801087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:43.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.521+0000 7fd18872c640 1 --2- 172.21.15.70:0/1041613225 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd180102ae0 0x7fd180102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:43.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.521+0000 7fd18872c640 1 -- 172.21.15.70:0/1041613225 >> 172.21.15.70:0/1041613225 conn(0x7fd180079760 msgr2=0x7fd180079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:43.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.521+0000 7fd18872c640 1 -- 172.21.15.70:0/1041613225 shutdown_connections 2024-09-21T05:49:43.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.521+0000 7fd18872c640 1 -- 172.21.15.70:0/1041613225 wait complete. 2024-09-21T05:49:43.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.522+0000 7fd18872c640 1 Processor -- start 2024-09-21T05:49:43.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.522+0000 7fd18872c640 1 -- start start 2024-09-21T05:49:43.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.522+0000 7fd18872c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd180102ae0 0x7fd18019a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:43.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.522+0000 7fd18872c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd1801083d0 0x7fd18019a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:43.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.522+0000 7fd18872c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd180108d20 0x7fd18019fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:43.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.522+0000 7fd18872c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd180112980 con 0x7fd180102ae0 2024-09-21T05:49:43.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.522+0000 7fd18872c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd180112800 con 0x7fd1801083d0 2024-09-21T05:49:43.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.522+0000 7fd18872c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd180112b00 con 0x7fd180108d20 2024-09-21T05:49:43.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.522+0000 7fd1864c8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd180102ae0 0x7fd18019a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:43.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.522+0000 7fd1864c8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd180102ae0 0x7fd18019a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55276/0 (socket says 172.21.15.70:55276) 2024-09-21T05:49:43.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.522+0000 7fd1864c8640 1 -- 172.21.15.70:0/2029588312 learned_addr learned my addr 172.21.15.70:0/2029588312 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:43.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.522+0000 7fd185cc7640 1 --2- 172.21.15.70:0/2029588312 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd1801083d0 0x7fd18019a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:43.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.522+0000 7fd186cc9640 1 --2- 172.21.15.70:0/2029588312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd180108d20 0x7fd18019fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:43.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.522+0000 7fd1864c8640 1 -- 172.21.15.70:0/2029588312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd180108d20 msgr2=0x7fd18019fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:43.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.522+0000 7fd1864c8640 1 --2- 172.21.15.70:0/2029588312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd180108d20 0x7fd18019fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:43.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.522+0000 7fd1864c8640 1 -- 172.21.15.70:0/2029588312 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd1801083d0 msgr2=0x7fd18019a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:43.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.522+0000 7fd1864c8640 1 --2- 172.21.15.70:0/2029588312 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd1801083d0 0x7fd18019a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:43.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.522+0000 7fd1864c8640 1 -- 172.21.15.70:0/2029588312 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1801a02b0 con 0x7fd180102ae0 2024-09-21T05:49:43.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.522+0000 7fd186cc9640 1 --2- 172.21.15.70:0/2029588312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd180108d20 0x7fd18019fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:49:43.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.522+0000 7fd185cc7640 1 --2- 172.21.15.70:0/2029588312 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd1801083d0 0x7fd18019a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:43.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.522+0000 7fd1864c8640 1 --2- 172.21.15.70:0/2029588312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd180102ae0 0x7fd18019a400 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd17000ea80 tx=0x7fd17000ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:43.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.523+0000 7fd17f7fe640 1 -- 172.21.15.70:0/2029588312 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd17000ce40 con 0x7fd180102ae0 2024-09-21T05:49:43.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.523+0000 7fd18872c640 1 -- 172.21.15.70:0/2029588312 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1801a05a0 con 0x7fd180102ae0 2024-09-21T05:49:43.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.523+0000 7fd17f7fe640 1 -- 172.21.15.70:0/2029588312 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fd170005020 con 0x7fd180102ae0 2024-09-21T05:49:43.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.523+0000 7fd17f7fe640 1 -- 172.21.15.70:0/2029588312 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1700116d0 con 0x7fd180102ae0 2024-09-21T05:49:43.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.523+0000 7fd18872c640 1 -- 172.21.15.70:0/2029588312 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1801a6dc0 con 0x7fd180102ae0 2024-09-21T05:49:43.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.524+0000 7fd18872c640 1 -- 172.21.15.70:0/2029588312 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd180102ef0 con 0x7fd180102ae0 2024-09-21T05:49:43.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.525+0000 7fd17f7fe640 1 -- 172.21.15.70:0/2029588312 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) ==== 154563+0+0 (secure 0 0 0) 0x7fd170005560 con 0x7fd180102ae0 2024-09-21T05:49:43.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.526+0000 7fd17f7fe640 1 --2- 172.21.15.70:0/2029588312 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd1680b65d0 0x7fd1680b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:43.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.526+0000 7fd185cc7640 1 --2- 172.21.15.70:0/2029588312 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd1680b65d0 0x7fd1680b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:43.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.526+0000 7fd17f7fe640 1 -- 172.21.15.70:0/2029588312 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fd1700e7b70 con 0x7fd180102ae0 2024-09-21T05:49:43.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.527+0000 7fd185cc7640 1 --2- 172.21.15.70:0/2029588312 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd1680b65d0 0x7fd1680b8ae0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd18007a200 tx=0x7fd17400a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:43.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.531+0000 7fd17f7fe640 1 -- 172.21.15.70:0/2029588312 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd170016030 con 0x7fd180102ae0 2024-09-21T05:49:43.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.747+0000 7fd18872c640 1 -- 172.21.15.70:0/2029588312 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd18019b530 con 0x7fd180102ae0 2024-09-21T05:49:43.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.748+0000 7fd17f7fe640 1 -- 172.21.15.70:0/2029588312 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11986 (secure 0 0 0) 0x7fd1700adeb0 con 0x7fd180102ae0 2024-09-21T05:49:43.750 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:49:43.750 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"btime":"2024-09-21T05:49:35:887363+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3519318330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3519318330},{"type":"v1","addr":"172.21.15.70:6835","nonce":3519318330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2706663460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2706663460},{"type":"v1","addr":"172.21.15.70:6837","nonce":2706663460}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:47:06.246985+0000","modified":"2024-09-21T05:49:35.712686+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24628,"mds_2":24611,"mds_3":24610,"mds_4":24598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/1914209867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1914209867},{"type":"v1","addr":"172.21.15.70:6839","nonce":1914209867}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3392175775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3392175775},{"type":"v1","addr":"172.21.15.70:6841","nonce":3392175775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/3543945704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3543945704},{"type":"v1","addr":"172.21.15.160:6833","nonce":3543945704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6833/283778129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":283778129},{"type":"v1","addr":"172.21.15.116:6833","nonce":283778129}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/3787256790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3787256790},{"type":"v1","addr":"172.21.15.116:6835","nonce":3787256790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.160:6835/2001692372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2001692372},{"type":"v1","addr":"172.21.15.160:6835","nonce":2001692372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.160:6837/2558120045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2558120045},{"type":"v1","addr":"172.21.15.160:6837","nonce":2558120045}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24611":{"gid":24611,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/444312934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":444312934},{"type":"v1","addr":"172.21.15.116:6837","nonce":444312934}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.160:6839/1339744282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1339744282},{"type":"v1","addr":"172.21.15.160:6839","nonce":1339744282}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/3952175670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3952175670},{"type":"v1","addr":"172.21.15.116:6839","nonce":3952175670}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24641,"qdb_cluster":[24598,24611,24610,24628,24641]},"id":1}]} 2024-09-21T05:49:43.751 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-09-21T05:49:43.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.750+0000 7fd18872c640 1 -- 172.21.15.70:0/2029588312 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd1680b65d0 msgr2=0x7fd1680b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:43.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.750+0000 7fd18872c640 1 --2- 172.21.15.70:0/2029588312 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd1680b65d0 0x7fd1680b8ae0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd18007a200 tx=0x7fd17400a5c0 comp rx=0 tx=0).stop 2024-09-21T05:49:43.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.750+0000 7fd18872c640 1 -- 172.21.15.70:0/2029588312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd180102ae0 msgr2=0x7fd18019a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:43.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.750+0000 7fd18872c640 1 --2- 172.21.15.70:0/2029588312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd180102ae0 0x7fd18019a400 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd17000ea80 tx=0x7fd17000ef40 comp rx=0 tx=0).stop 2024-09-21T05:49:43.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.750+0000 7fd18872c640 1 -- 172.21.15.70:0/2029588312 shutdown_connections 2024-09-21T05:49:43.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.750+0000 7fd18872c640 1 --2- 172.21.15.70:0/2029588312 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd1680b65d0 0x7fd1680b8ae0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:43.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.750+0000 7fd18872c640 1 --2- 172.21.15.70:0/2029588312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd180108d20 0x7fd18019fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:43.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.750+0000 7fd18872c640 1 --2- 172.21.15.70:0/2029588312 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd1801083d0 0x7fd18019a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:43.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.750+0000 7fd18872c640 1 --2- 172.21.15.70:0/2029588312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd180102ae0 0x7fd18019a400 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:43.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.750+0000 7fd18872c640 1 -- 172.21.15.70:0/2029588312 >> 172.21.15.70:0/2029588312 conn(0x7fd180079760 msgr2=0x7fd180101aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:43.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.750+0000 7fd18872c640 1 -- 172.21.15.70:0/2029588312 shutdown_connections 2024-09-21T05:49:43.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:43.750+0000 7fd18872c640 1 -- 172.21.15.70:0/2029588312 wait complete. 2024-09-21T05:49:44.053 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:43 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2029588312' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:49:44.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:43 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2029588312' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:49:44.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:43 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2029588312' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:49:44.399 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:49:44.645 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:45.041 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:44 smithi070 ceph-mon[30981]: pgmap v378: 129 pgs: 129 active+clean; 658 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-09-21T05:49:45.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.128+0000 7f33a6bc4640 1 -- 172.21.15.70:0/2624963877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33a0102ae0 msgr2=0x7f33a0102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:45.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.128+0000 7f33a6bc4640 1 --2- 172.21.15.70:0/2624963877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33a0102ae0 0x7f33a0102ef0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f3394009900 tx=0x7f339402a410 comp rx=0 tx=0).stop 2024-09-21T05:49:45.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.128+0000 7f33a6bc4640 1 -- 172.21.15.70:0/2624963877 shutdown_connections 2024-09-21T05:49:45.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.128+0000 7f33a6bc4640 1 --2- 172.21.15.70:0/2624963877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33a0108420 0x7f33a0108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:45.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.128+0000 7f33a6bc4640 1 --2- 172.21.15.70:0/2624963877 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f33a0108d70 0x7f33a010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:45.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.128+0000 7f33a6bc4640 1 --2- 172.21.15.70:0/2624963877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33a0102ae0 0x7f33a0102ef0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:45.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.128+0000 7f33a6bc4640 1 -- 172.21.15.70:0/2624963877 >> 172.21.15.70:0/2624963877 conn(0x7f33a0079770 msgr2=0x7f33a0079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:45.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.128+0000 7f33a6bc4640 1 -- 172.21.15.70:0/2624963877 shutdown_connections 2024-09-21T05:49:45.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.128+0000 7f33a6bc4640 1 -- 172.21.15.70:0/2624963877 wait complete. 2024-09-21T05:49:45.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.129+0000 7f33a6bc4640 1 Processor -- start 2024-09-21T05:49:45.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.129+0000 7f33a6bc4640 1 -- start start 2024-09-21T05:49:45.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.130+0000 7f33a6bc4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33a0102ae0 0x7f33a01991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:45.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.130+0000 7f33a6bc4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33a0108420 0x7f33a0199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:45.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.130+0000 7f33a6bc4640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f33a0108d70 0x7f33a0199c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:45.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.130+0000 7f33a6bc4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f33a0112a20 con 0x7f33a0108420 2024-09-21T05:49:45.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.130+0000 7f33a6bc4640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f33a01128a0 con 0x7f33a0108d70 2024-09-21T05:49:45.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.130+0000 7f33a6bc4640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f33a0112ba0 con 0x7f33a0102ae0 2024-09-21T05:49:45.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.130+0000 7f339ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33a0108420 0x7f33a0199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:45.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.130+0000 7f339ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33a0108420 0x7f33a0199720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55292/0 (socket says 172.21.15.70:55292) 2024-09-21T05:49:45.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.130+0000 7f339ffff640 1 -- 172.21.15.70:0/18226299 learned_addr learned my addr 172.21.15.70:0/18226299 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:45.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.130+0000 7f33a4960640 1 --2- 172.21.15.70:0/18226299 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33a0102ae0 0x7f33a01991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:45.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.130+0000 7f33a5161640 1 --2- 172.21.15.70:0/18226299 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f33a0108d70 0x7f33a0199c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:45.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.130+0000 7f339ffff640 1 -- 172.21.15.70:0/18226299 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33a0102ae0 msgr2=0x7f33a01991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:45.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.130+0000 7f339ffff640 1 --2- 172.21.15.70:0/18226299 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33a0102ae0 0x7f33a01991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:45.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.130+0000 7f339ffff640 1 -- 172.21.15.70:0/18226299 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f33a0108d70 msgr2=0x7f33a0199c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:45.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.130+0000 7f339ffff640 1 --2- 172.21.15.70:0/18226299 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f33a0108d70 0x7f33a0199c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:45.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.130+0000 7f339ffff640 1 -- 172.21.15.70:0/18226299 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a01a8890 con 0x7f33a0108420 2024-09-21T05:49:45.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.130+0000 7f33a5161640 1 --2- 172.21.15.70:0/18226299 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f33a0108d70 0x7f33a0199c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:49:45.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.130+0000 7f339ffff640 1 --2- 172.21.15.70:0/18226299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33a0108420 0x7f33a0199720 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f338c00d750 tx=0x7f338c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:45.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.130+0000 7f339dffb640 1 -- 172.21.15.70:0/18226299 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338c017070 con 0x7f33a0108420 2024-09-21T05:49:45.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.130+0000 7f339dffb640 1 -- 172.21.15.70:0/18226299 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f338c0054d0 con 0x7f33a0108420 2024-09-21T05:49:45.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.130+0000 7f339dffb640 1 -- 172.21.15.70:0/18226299 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338c004c80 con 0x7f33a0108420 2024-09-21T05:49:45.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.130+0000 7f33a6bc4640 1 -- 172.21.15.70:0/18226299 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33a01a8b80 con 0x7f33a0108420 2024-09-21T05:49:45.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.131+0000 7f33a6bc4640 1 -- 172.21.15.70:0/18226299 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33a01a9070 con 0x7f33a0108420 2024-09-21T05:49:45.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.132+0000 7f33a6bc4640 1 -- 172.21.15.70:0/18226299 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33a0103d60 con 0x7f33a0108420 2024-09-21T05:49:45.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.133+0000 7f339dffb640 1 -- 172.21.15.70:0/18226299 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) ==== 154563+0+0 (secure 0 0 0) 0x7f338c004e20 con 0x7f33a0108420 2024-09-21T05:49:45.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.134+0000 7f339dffb640 1 --2- 172.21.15.70:0/18226299 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f33900b65a0 0x7f33900b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:45.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.134+0000 7f33a4960640 1 --2- 172.21.15.70:0/18226299 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f33900b65a0 0x7f33900b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:45.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.134+0000 7f339dffb640 1 -- 172.21.15.70:0/18226299 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f338c0e7320 con 0x7f33a0108420 2024-09-21T05:49:45.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.134+0000 7f33a4960640 1 --2- 172.21.15.70:0/18226299 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f33900b65a0 0x7f33900b8ab0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3394000c00 tx=0x7f3394005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:45.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.138+0000 7f339dffb640 1 -- 172.21.15.70:0/18226299 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f338c0ad660 con 0x7f33a0108420 2024-09-21T05:49:45.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:44 smithi116 ceph-mon[34332]: pgmap v378: 129 pgs: 129 active+clean; 658 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-09-21T05:49:45.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.319+0000 7f33a6bc4640 1 -- 172.21.15.70:0/18226299 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f33a010ab40 con 0x7f33a0108420 2024-09-21T05:49:45.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.321+0000 7f339dffb640 1 -- 172.21.15.70:0/18226299 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24983 (secure 0 0 0) 0x7f338c0b1a40 con 0x7f33a0108420 2024-09-21T05:49:45.323 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:49:45.324 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":85,"fsid":"96c6636e-77db-11ef-baf5-efdc52797490","created":"2024-09-21T05:38:42.297307+0000","modified":"2024-09-21T05:48:38.706309+0000","last_up_change":"2024-09-21T05:46:15.910344+0000","last_in_change":"2024-09-21T05:45:53.382766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:42:25.611590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:47:01.987981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:47:04.388107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T05:47:10.651871+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00be8b82-7cb1-443f-ad18-02916f734df7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6803","nonce":1667051447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6805","nonce":1667051447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6809","nonce":1667051447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6807","nonce":1667051447}]},"public_addr":"172.21.15.70:6803/1667051447","cluster_addr":"172.21.15.70:6805/1667051447","heartbeat_back_addr":"172.21.15.70:6809/1667051447","heartbeat_front_addr":"172.21.15.70:6807/1667051447","state":["exists","up"]},{"osd":1,"uuid":"28ca8c5c-5e81-4e64-ac0e-3c8c3c2d3930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6801","nonce":1037621846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6803","nonce":1037621846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6807","nonce":1037621846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6805","nonce":1037621846}]},"public_addr":"172.21.15.116:6801/1037621846","cluster_addr":"172.21.15.116:6803/1037621846","heartbeat_back_addr":"172.21.15.116:6807/1037621846","heartbeat_front_addr":"172.21.15.116:6805/1037621846","state":["exists","up"]},{"osd":2,"uuid":"e9b42bf2-a38b-4cf9-8774-4950de12d0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6801","nonce":69260815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6803","nonce":69260815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6807","nonce":69260815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6805","nonce":69260815}]},"public_addr":"172.21.15.160:6801/69260815","cluster_addr":"172.21.15.160:6803/69260815","heartbeat_back_addr":"172.21.15.160:6807/69260815","heartbeat_front_addr":"172.21.15.160:6805/69260815","state":["exists","up"]},{"osd":3,"uuid":"25d8e9a8-3c14-43d6-9bb1-b44cd377133f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6811","nonce":3849416072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6813","nonce":3849416072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6817","nonce":3849416072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6815","nonce":3849416072}]},"public_addr":"172.21.15.70:6811/3849416072","cluster_addr":"172.21.15.70:6813/3849416072","heartbeat_back_addr":"172.21.15.70:6817/3849416072","heartbeat_front_addr":"172.21.15.70:6815/3849416072","state":["exists","up"]},{"osd":4,"uuid":"bdb84cbd-d718-4f69-90d0-2e732e580df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6809","nonce":3444857438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6811","nonce":3444857438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6815","nonce":3444857438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6813","nonce":3444857438}]},"public_addr":"172.21.15.116:6809/3444857438","cluster_addr":"172.21.15.116:6811/3444857438","heartbeat_back_addr":"172.21.15.116:6815/3444857438","heartbeat_front_addr":"172.21.15.116:6813/3444857438","state":["exists","up"]},{"osd":5,"uuid":"a490eeba-549f-4caa-8cd5-4168a23dafa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6809","nonce":3063220427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6811","nonce":3063220427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6815","nonce":3063220427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6813","nonce":3063220427}]},"public_addr":"172.21.15.160:6809/3063220427","cluster_addr":"172.21.15.160:6811/3063220427","heartbeat_back_addr":"172.21.15.160:6815/3063220427","heartbeat_front_addr":"172.21.15.160:6813/3063220427","state":["exists","up"]},{"osd":6,"uuid":"1bf22f48-c02f-4f09-b0fe-2597a55fd795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6819","nonce":3650315688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6821","nonce":3650315688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6825","nonce":3650315688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6823","nonce":3650315688}]},"public_addr":"172.21.15.70:6819/3650315688","cluster_addr":"172.21.15.70:6821/3650315688","heartbeat_back_addr":"172.21.15.70:6825/3650315688","heartbeat_front_addr":"172.21.15.70:6823/3650315688","state":["exists","up"]},{"osd":7,"uuid":"40d59744-4860-4a92-aa21-3f33e575e5b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6817","nonce":2034132009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6819","nonce":2034132009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6823","nonce":2034132009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6821","nonce":2034132009}]},"public_addr":"172.21.15.116:6817/2034132009","cluster_addr":"172.21.15.116:6819/2034132009","heartbeat_back_addr":"172.21.15.116:6823/2034132009","heartbeat_front_addr":"172.21.15.116:6821/2034132009","state":["exists","up"]},{"osd":8,"uuid":"65dc02e7-0dcd-4fa7-955a-4d5c00fbe4cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6817","nonce":3381625184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6819","nonce":3381625184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6823","nonce":3381625184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6821","nonce":3381625184}]},"public_addr":"172.21.15.160:6817/3381625184","cluster_addr":"172.21.15.160:6819/3381625184","heartbeat_back_addr":"172.21.15.160:6823/3381625184","heartbeat_front_addr":"172.21.15.160:6821/3381625184","state":["exists","up"]},{"osd":9,"uuid":"d8438a9c-012f-4082-be3f-9653cdfaac78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6827","nonce":3555256209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6829","nonce":3555256209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6833","nonce":3555256209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6831","nonce":3555256209}]},"public_addr":"172.21.15.70:6827/3555256209","cluster_addr":"172.21.15.70:6829/3555256209","heartbeat_back_addr":"172.21.15.70:6833/3555256209","heartbeat_front_addr":"172.21.15.70:6831/3555256209","state":["exists","up"]},{"osd":10,"uuid":"871619b0-181e-4020-9511-2cec296bfe70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6825","nonce":541280433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6827","nonce":541280433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6831","nonce":541280433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6829","nonce":541280433}]},"public_addr":"172.21.15.116:6825/541280433","cluster_addr":"172.21.15.116:6827/541280433","heartbeat_back_addr":"172.21.15.116:6831/541280433","heartbeat_front_addr":"172.21.15.116:6829/541280433","state":["exists","up"]},{"osd":11,"uuid":"302da945-7929-4b0c-a20b-099175752c41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6825","nonce":2632369083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6827","nonce":2632369083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6831","nonce":2632369083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6829","nonce":2632369083}]},"public_addr":"172.21.15.160:6825/2632369083","cluster_addr":"172.21.15.160:6827/2632369083","heartbeat_back_addr":"172.21.15.160:6831/2632369083","heartbeat_front_addr":"172.21.15.160:6829/2632369083","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:41:34.446744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:41:59.336955+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:42:23.958219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:42:49.396007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:43:15.325344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:43:41.923141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:07.873970+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:33.897951+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:58.397680+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:24.568406+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:49.504565+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:14.698577+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.e","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6800/605055695":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/897886925":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/1968357524":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/693721445":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/2810307308":"2024-09-22T05:39:12.492271+0000","172.21.15.70:6801/605055695":"2024-09-22T05:39:37.296630+0000","172.21.15.70:6801/1668927582":"2024-09-22T05:39:12.492271+0000","172.21.15.70:6800/1668927582":"2024-09-22T05:39:12.492271+0000","172.21.15.70:0/1979536420":"2024-09-22T05:39:12.492271+0000","172.21.15.70:0/2674019604":"2024-09-22T05:39:12.492271+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:49:45.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.323+0000 7f33a6bc4640 1 -- 172.21.15.70:0/18226299 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f33900b65a0 msgr2=0x7f33900b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:45.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.323+0000 7f33a6bc4640 1 --2- 172.21.15.70:0/18226299 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f33900b65a0 0x7f33900b8ab0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3394000c00 tx=0x7f3394005d50 comp rx=0 tx=0).stop 2024-09-21T05:49:45.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.323+0000 7f33a6bc4640 1 -- 172.21.15.70:0/18226299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33a0108420 msgr2=0x7f33a0199720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:45.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.323+0000 7f33a6bc4640 1 --2- 172.21.15.70:0/18226299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33a0108420 0x7f33a0199720 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f338c00d750 tx=0x7f338c00dc10 comp rx=0 tx=0).stop 2024-09-21T05:49:45.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.324+0000 7f33a6bc4640 1 -- 172.21.15.70:0/18226299 shutdown_connections 2024-09-21T05:49:45.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.324+0000 7f33a6bc4640 1 --2- 172.21.15.70:0/18226299 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f33900b65a0 0x7f33900b8ab0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:45.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.324+0000 7f33a6bc4640 1 --2- 172.21.15.70:0/18226299 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f33a0108d70 0x7f33a0199c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:45.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.324+0000 7f33a6bc4640 1 --2- 172.21.15.70:0/18226299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33a0108420 0x7f33a0199720 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:45.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.324+0000 7f33a6bc4640 1 --2- 172.21.15.70:0/18226299 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33a0102ae0 0x7f33a01991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:45.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.324+0000 7f33a6bc4640 1 -- 172.21.15.70:0/18226299 >> 172.21.15.70:0/18226299 conn(0x7f33a0079770 msgr2=0x7f33a0106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:45.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.324+0000 7f33a6bc4640 1 -- 172.21.15.70:0/18226299 shutdown_connections 2024-09-21T05:49:45.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:45.324+0000 7f33a6bc4640 1 -- 172.21.15.70:0/18226299 wait complete. 2024-09-21T05:49:45.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:44 smithi160 ceph-mon[33979]: pgmap v378: 129 pgs: 129 active+clean; 658 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-09-21T05:49:45.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:45 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/18226299' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:49:46.061 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph daemon mon.a --format=json config get run_dir 2024-09-21T05:49:46.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:45 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/18226299' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:49:46.305 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:46.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:45 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/18226299' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:49:47.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:46 smithi070 ceph-mon[30981]: pgmap v379: 129 pgs: 129 active+clean; 658 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-09-21T05:49:47.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:46 smithi116 ceph-mon[34332]: pgmap v379: 129 pgs: 129 active+clean; 658 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-09-21T05:49:47.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:46 smithi160 ceph-mon[33979]: pgmap v379: 129 pgs: 129 active+clean; 658 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-09-21T05:49:47.481 INFO:teuthology.orchestra.run.smithi070.stdout:{"run_dir":"/var/run/ceph"} 2024-09-21T05:49:47.481 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-21T05:49:47.481 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 7864 2024-09-21T05:49:47.481 DEBUG:tasks.quiescer:Yielding 2024-09-21T05:49:47.481 INFO:teuthology.run_tasks:Running task workunit... 2024-09-21T05:49:47.495 INFO:tasks.workunit:Pulling workunits from ref 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:49:47.495 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T05:49:47.496 INFO:tasks.workunit:timeout=3h 2024-09-21T05:49:47.496 INFO:tasks.workunit:cleanup=True 2024-09-21T05:49:47.496 DEBUG:teuthology.orchestra.run.smithi070:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T05:49:47.496 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:49:47.512 INFO:teuthology.orchestra.run.smithi070.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-21T05:49:47.513 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-21T05:49:47.513 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 78h/120d Inode: 1 Links: 2 2024-09-21T05:49:47.513 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:49:47.513 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-21T05:49:47.513 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-21 05:47:54.020887361 +0000 2024-09-21T05:49:47.513 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-21 05:47:54.020887361 +0000 2024-09-21T05:49:47.513 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-21 05:49:35.332520113 +0000 2024-09-21T05:49:47.513 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2024-09-21T05:49:47.513 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-21T05:49:47.513 DEBUG:teuthology.orchestra.run.smithi070:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-21T05:49:47.582 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:49:47.638 INFO:tasks.workunit.client.0.smithi070.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T05:49:47.756 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:48.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.272+0000 7f6812e20640 1 -- 172.21.15.70:0/2215171658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f680c103bc0 msgr2=0x7f680c103fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:48.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.272+0000 7f6812e20640 1 --2- 172.21.15.70:0/2215171658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f680c103bc0 0x7f680c103fd0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6800009900 tx=0x7f680002a410 comp rx=0 tx=0).stop 2024-09-21T05:49:48.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.272+0000 7f6812e20640 1 -- 172.21.15.70:0/2215171658 shutdown_connections 2024-09-21T05:49:48.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.272+0000 7f6812e20640 1 --2- 172.21.15.70:0/2215171658 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f680c1094b0 0x7f680c1098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:48.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.272+0000 7f6812e20640 1 --2- 172.21.15.70:0/2215171658 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f680c109e00 0x7f680c110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:48.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.272+0000 7f6812e20640 1 --2- 172.21.15.70:0/2215171658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f680c103bc0 0x7f680c103fd0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:48.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.272+0000 7f6812e20640 1 -- 172.21.15.70:0/2215171658 >> 172.21.15.70:0/2215171658 conn(0x7f680c07b910 msgr2=0x7f680c07bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:48.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.272+0000 7f6812e20640 1 -- 172.21.15.70:0/2215171658 shutdown_connections 2024-09-21T05:49:48.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.272+0000 7f6812e20640 1 -- 172.21.15.70:0/2215171658 wait complete. 2024-09-21T05:49:48.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.273+0000 7f6812e20640 1 Processor -- start 2024-09-21T05:49:48.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.273+0000 7f6812e20640 1 -- start start 2024-09-21T05:49:48.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.273+0000 7f6812e20640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f680c103bc0 0x7f680c19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:48.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.273+0000 7f6812e20640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f680c1094b0 0x7f680c19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:48.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.273+0000 7f6812e20640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f680c109e00 0x7f680c19fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:48.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.273+0000 7f6812e20640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f680c113a90 con 0x7f680c109e00 2024-09-21T05:49:48.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.273+0000 7f6812e20640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f680c113910 con 0x7f680c1094b0 2024-09-21T05:49:48.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.273+0000 7f6812e20640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f680c113c10 con 0x7f680c103bc0 2024-09-21T05:49:48.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.273+0000 7f68113bd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f680c109e00 0x7f680c19fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:48.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.273+0000 7f68113bd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f680c109e00 0x7f680c19fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55320/0 (socket says 172.21.15.70:55320) 2024-09-21T05:49:48.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.273+0000 7f68113bd640 1 -- 172.21.15.70:0/2348445145 learned_addr learned my addr 172.21.15.70:0/2348445145 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:48.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.273+0000 7f680bfff640 1 --2- 172.21.15.70:0/2348445145 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f680c1094b0 0x7f680c19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:48.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.274+0000 7f6810bbc640 1 --2- 172.21.15.70:0/2348445145 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f680c103bc0 0x7f680c19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:48.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.274+0000 7f68113bd640 1 -- 172.21.15.70:0/2348445145 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f680c103bc0 msgr2=0x7f680c19a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:48.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.274+0000 7f68113bd640 1 --2- 172.21.15.70:0/2348445145 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f680c103bc0 0x7f680c19a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:48.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.274+0000 7f68113bd640 1 -- 172.21.15.70:0/2348445145 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f680c1094b0 msgr2=0x7f680c19aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:48.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.274+0000 7f68113bd640 1 --2- 172.21.15.70:0/2348445145 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f680c1094b0 0x7f680c19aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:48.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.274+0000 7f68113bd640 1 -- 172.21.15.70:0/2348445145 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f680c1a0410 con 0x7f680c109e00 2024-09-21T05:49:48.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.274+0000 7f680bfff640 1 --2- 172.21.15.70:0/2348445145 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f680c1094b0 0x7f680c19aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:49:48.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.274+0000 7f68113bd640 1 --2- 172.21.15.70:0/2348445145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f680c109e00 0x7f680c19fce0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f680400eb10 tx=0x7f680400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:48.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.274+0000 7f6809ffb640 1 -- 172.21.15.70:0/2348445145 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6804004b20 con 0x7f680c109e00 2024-09-21T05:49:48.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.274+0000 7f6809ffb640 1 -- 172.21.15.70:0/2348445145 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f6804004cc0 con 0x7f680c109e00 2024-09-21T05:49:48.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.274+0000 7f6812e20640 1 -- 172.21.15.70:0/2348445145 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f680c1a0700 con 0x7f680c109e00 2024-09-21T05:49:48.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.274+0000 7f6809ffb640 1 -- 172.21.15.70:0/2348445145 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6804010690 con 0x7f680c109e00 2024-09-21T05:49:48.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.274+0000 7f6812e20640 1 -- 172.21.15.70:0/2348445145 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f680c1a6e60 con 0x7f680c109e00 2024-09-21T05:49:48.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.276+0000 7f6812e20640 1 -- 172.21.15.70:0/2348445145 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f680c103fd0 con 0x7f680c109e00 2024-09-21T05:49:48.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.277+0000 7f6809ffb640 1 -- 172.21.15.70:0/2348445145 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) ==== 154563+0+0 (secure 0 0 0) 0x7f6804005020 con 0x7f680c109e00 2024-09-21T05:49:48.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.278+0000 7f6809ffb640 1 --2- 172.21.15.70:0/2348445145 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f67fc0b65a0 0x7f67fc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:48.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.278+0000 7f6810bbc640 1 --2- 172.21.15.70:0/2348445145 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f67fc0b65a0 0x7f67fc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:48.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.278+0000 7f6809ffb640 1 -- 172.21.15.70:0/2348445145 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f68040e7e90 con 0x7f680c109e00 2024-09-21T05:49:48.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.278+0000 7f6810bbc640 1 --2- 172.21.15.70:0/2348445145 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f67fc0b65a0 0x7f67fc0b8ab0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6800005d90 tx=0x7f6800005df0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:48.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.282+0000 7f6809ffb640 1 -- 172.21.15.70:0/2348445145 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f68040ae1d0 con 0x7f680c109e00 2024-09-21T05:49:48.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.504+0000 7f6812e20640 1 -- 172.21.15.70:0/2348445145 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f680c02e640 con 0x7f680c109e00 2024-09-21T05:49:48.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.505+0000 7f6809ffb640 1 -- 172.21.15.70:0/2348445145 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11986 (secure 0 0 0) 0x7f68040b25b0 con 0x7f680c109e00 2024-09-21T05:49:48.507 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:49:48.507 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"btime":"2024-09-21T05:49:35:887363+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3519318330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3519318330},{"type":"v1","addr":"172.21.15.70:6835","nonce":3519318330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2706663460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2706663460},{"type":"v1","addr":"172.21.15.70:6837","nonce":2706663460}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:47:06.246985+0000","modified":"2024-09-21T05:49:35.712686+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24628,"mds_2":24611,"mds_3":24610,"mds_4":24598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/1914209867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1914209867},{"type":"v1","addr":"172.21.15.70:6839","nonce":1914209867}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3392175775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3392175775},{"type":"v1","addr":"172.21.15.70:6841","nonce":3392175775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/3543945704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3543945704},{"type":"v1","addr":"172.21.15.160:6833","nonce":3543945704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6833/283778129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":283778129},{"type":"v1","addr":"172.21.15.116:6833","nonce":283778129}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/3787256790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3787256790},{"type":"v1","addr":"172.21.15.116:6835","nonce":3787256790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.160:6835/2001692372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2001692372},{"type":"v1","addr":"172.21.15.160:6835","nonce":2001692372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.160:6837/2558120045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2558120045},{"type":"v1","addr":"172.21.15.160:6837","nonce":2558120045}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24611":{"gid":24611,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/444312934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":444312934},{"type":"v1","addr":"172.21.15.116:6837","nonce":444312934}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.160:6839/1339744282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1339744282},{"type":"v1","addr":"172.21.15.160:6839","nonce":1339744282}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/3952175670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3952175670},{"type":"v1","addr":"172.21.15.116:6839","nonce":3952175670}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24641,"qdb_cluster":[24598,24611,24610,24628,24641]},"id":1}]} 2024-09-21T05:49:48.507 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-09-21T05:49:48.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.507+0000 7f6812e20640 1 -- 172.21.15.70:0/2348445145 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f67fc0b65a0 msgr2=0x7f67fc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:48.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.507+0000 7f6812e20640 1 --2- 172.21.15.70:0/2348445145 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f67fc0b65a0 0x7f67fc0b8ab0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6800005d90 tx=0x7f6800005df0 comp rx=0 tx=0).stop 2024-09-21T05:49:48.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.507+0000 7f6812e20640 1 -- 172.21.15.70:0/2348445145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f680c109e00 msgr2=0x7f680c19fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:48.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.507+0000 7f6812e20640 1 --2- 172.21.15.70:0/2348445145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f680c109e00 0x7f680c19fce0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f680400eb10 tx=0x7f680400c2d0 comp rx=0 tx=0).stop 2024-09-21T05:49:48.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.507+0000 7f6812e20640 1 -- 172.21.15.70:0/2348445145 shutdown_connections 2024-09-21T05:49:48.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.507+0000 7f6812e20640 1 --2- 172.21.15.70:0/2348445145 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f67fc0b65a0 0x7f67fc0b8ab0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:48.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.507+0000 7f6812e20640 1 --2- 172.21.15.70:0/2348445145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f680c109e00 0x7f680c19fce0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:48.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.507+0000 7f6812e20640 1 --2- 172.21.15.70:0/2348445145 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f680c1094b0 0x7f680c19aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:48.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.507+0000 7f6812e20640 1 --2- 172.21.15.70:0/2348445145 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f680c103bc0 0x7f680c19a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:48.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.507+0000 7f6812e20640 1 -- 172.21.15.70:0/2348445145 >> 172.21.15.70:0/2348445145 conn(0x7f680c07b910 msgr2=0x7f680c107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:48.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.507+0000 7f6812e20640 1 -- 172.21.15.70:0/2348445145 shutdown_connections 2024-09-21T05:49:48.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:48.507+0000 7f6812e20640 1 -- 172.21.15.70:0/2348445145 wait complete. 2024-09-21T05:49:49.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:48 smithi070 ceph-mon[30981]: pgmap v380: 129 pgs: 129 active+clean; 659 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-09-21T05:49:49.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:48 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2348445145' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:49:49.149 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T05:47:06.246985+0000', 'modified': '2024-09-21T05:49:35.712686+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24641, 'mds_1': 24628, 'mds_2': 24611, 'mds_3': 24610, 'mds_4': 24598}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14787': {'gid': 14787, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.70:6839/1914209867', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6838', 'nonce': 1914209867}, {'type': 'v1', 'addr': '172.21.15.70:6839', 'nonce': 1914209867}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14793': {'gid': 14793, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.70:6841/3392175775', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6840', 'nonce': 3392175775}, {'type': 'v1', 'addr': '172.21.15.70:6841', 'nonce': 3392175775}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24568': {'gid': 24568, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.160:6833/3543945704', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6832', 'nonce': 3543945704}, {'type': 'v1', 'addr': '172.21.15.160:6833', 'nonce': 3543945704}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24575': {'gid': 24575, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.116:6833/283778129', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6832', 'nonce': 283778129}, {'type': 'v1', 'addr': '172.21.15.116:6833', 'nonce': 283778129}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24590': {'gid': 24590, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.116:6835/3787256790', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6834', 'nonce': 3787256790}, {'type': 'v1', 'addr': '172.21.15.116:6835', 'nonce': 3787256790}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24598': {'gid': 24598, 'name': 'f', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.160:6835/2001692372', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6834', 'nonce': 2001692372}, {'type': 'v1', 'addr': '172.21.15.160:6835', 'nonce': 2001692372}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24610': {'gid': 24610, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.160:6837/2558120045', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6836', 'nonce': 2558120045}, {'type': 'v1', 'addr': '172.21.15.160:6837', 'nonce': 2558120045}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24611': {'gid': 24611, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.116:6837/444312934', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6836', 'nonce': 444312934}, {'type': 'v1', 'addr': '172.21.15.116:6837', 'nonce': 444312934}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24628': {'gid': 24628, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.160:6839/1339744282', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6838', 'nonce': 1339744282}, {'type': 'v1', 'addr': '172.21.15.160:6839', 'nonce': 1339744282}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24641': {'gid': 24641, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.116:6839/3952175670', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6838', 'nonce': 3952175670}, {'type': 'v1', 'addr': '172.21.15.116:6839', 'nonce': 3952175670}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24641, 'qdb_cluster': [24598, 24611, 24610, 24628, 24641]} 2024-09-21T05:49:49.149 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-21T05:49:49.149 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph tell mds.f status 2024-09-21T05:49:49.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:48 smithi116 ceph-mon[34332]: pgmap v380: 129 pgs: 129 active+clean; 659 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-09-21T05:49:49.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:48 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2348445145' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:49:49.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:48 smithi160 ceph-mon[33979]: pgmap v380: 129 pgs: 129 active+clean; 659 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-09-21T05:49:49.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:48 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2348445145' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:49:49.452 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:49.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.933+0000 7f463b73e640 1 -- 172.21.15.70:0/70208890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4634109eb0 msgr2=0x7f46341106e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:49.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.933+0000 7f463b73e640 1 --2- 172.21.15.70:0/70208890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4634109eb0 0x7f46341106e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f462c009ca0 tx=0x7f462c02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.933+0000 7f463b73e640 1 -- 172.21.15.70:0/70208890 shutdown_connections 2024-09-21T05:49:49.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.933+0000 7f463b73e640 1 --2- 172.21.15.70:0/70208890 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4634109560 0x7f4634109970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.933+0000 7f463b73e640 1 --2- 172.21.15.70:0/70208890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4634109eb0 0x7f46341106e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.933+0000 7f463b73e640 1 --2- 172.21.15.70:0/70208890 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4634102080 0x7f4634102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.933+0000 7f463b73e640 1 -- 172.21.15.70:0/70208890 >> 172.21.15.70:0/70208890 conn(0x7f4634079ec0 msgr2=0x7f463407a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:49.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.933+0000 7f463b73e640 1 -- 172.21.15.70:0/70208890 shutdown_connections 2024-09-21T05:49:49.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.933+0000 7f463b73e640 1 -- 172.21.15.70:0/70208890 wait complete. 2024-09-21T05:49:49.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.933+0000 7f463b73e640 1 Processor -- start 2024-09-21T05:49:49.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.933+0000 7f463b73e640 1 -- start start 2024-09-21T05:49:49.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.934+0000 7f463b73e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4634102080 0x7f463419a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:49.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.934+0000 7f463b73e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4634109560 0x7f463419aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:49.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.934+0000 7f463b73e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4634109eb0 0x7f463419fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:49.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.934+0000 7f463b73e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4634113b40 con 0x7f4634109eb0 2024-09-21T05:49:49.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.934+0000 7f463b73e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f46341139c0 con 0x7f4634109560 2024-09-21T05:49:49.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.934+0000 7f463b73e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4634113cc0 con 0x7f4634102080 2024-09-21T05:49:49.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.934+0000 7f4639cdb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4634109eb0 0x7f463419fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:49.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.934+0000 7f4639cdb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4634109eb0 0x7f463419fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55338/0 (socket says 172.21.15.70:55338) 2024-09-21T05:49:49.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.934+0000 7f4639cdb640 1 -- 172.21.15.70:0/416183028 learned_addr learned my addr 172.21.15.70:0/416183028 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:49.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.934+0000 7f46394da640 1 --2- 172.21.15.70:0/416183028 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4634102080 0x7f463419a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:49.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.934+0000 7f4638cd9640 1 --2- 172.21.15.70:0/416183028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4634109560 0x7f463419aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:49.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.934+0000 7f4639cdb640 1 -- 172.21.15.70:0/416183028 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4634102080 msgr2=0x7f463419a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:49.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.934+0000 7f4639cdb640 1 --2- 172.21.15.70:0/416183028 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4634102080 0x7f463419a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.934+0000 7f4639cdb640 1 -- 172.21.15.70:0/416183028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4634109560 msgr2=0x7f463419aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:49.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.934+0000 7f4639cdb640 1 --2- 172.21.15.70:0/416183028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4634109560 0x7f463419aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.934+0000 7f4639cdb640 1 -- 172.21.15.70:0/416183028 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46341a0480 con 0x7f4634109eb0 2024-09-21T05:49:49.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.934+0000 7f4638cd9640 1 --2- 172.21.15.70:0/416183028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4634109560 0x7f463419aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:49.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.934+0000 7f4639cdb640 1 --2- 172.21.15.70:0/416183028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4634109eb0 0x7f463419fd50 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f462c0097b0 tx=0x7f462c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:49.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.934+0000 7f462a7fc640 1 -- 172.21.15.70:0/416183028 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f462c004040 con 0x7f4634109eb0 2024-09-21T05:49:49.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.934+0000 7f463b73e640 1 -- 172.21.15.70:0/416183028 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46341a0710 con 0x7f4634109eb0 2024-09-21T05:49:49.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.935+0000 7f462a7fc640 1 -- 172.21.15.70:0/416183028 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f462c004690 con 0x7f4634109eb0 2024-09-21T05:49:49.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.935+0000 7f463b73e640 1 -- 172.21.15.70:0/416183028 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46341a6ed0 con 0x7f4634109eb0 2024-09-21T05:49:49.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.935+0000 7f462a7fc640 1 -- 172.21.15.70:0/416183028 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f462c030d80 con 0x7f4634109eb0 2024-09-21T05:49:49.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.937+0000 7f4641cb2740 1 Processor -- start 2024-09-21T05:49:49.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.937+0000 7f462a7fc640 1 -- 172.21.15.70:0/416183028 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) ==== 154563+0+0 (secure 0 0 0) 0x7f462c0305c0 con 0x7f4634109eb0 2024-09-21T05:49:49.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.938+0000 7f4641cb2740 1 -- start start 2024-09-21T05:49:49.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.938+0000 7f4641cb2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639770e8f60 0x56397748ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:49.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.938+0000 7f4641cb2740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5639770c00a0 0x56397748f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:49.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.938+0000 7f4641cb2740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5639770c8280 0x56397748f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:49.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.938+0000 7f4641cb2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563977406c10 con 0x5639770e8f60 2024-09-21T05:49:49.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.938+0000 7f4641cb2740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5639773f6040 con 0x5639770c00a0 2024-09-21T05:49:49.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.938+0000 7f4641cb2740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5639773f9e50 con 0x5639770c8280 2024-09-21T05:49:49.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.938+0000 7f4638cd9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639770e8f60 0x56397748ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:49.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.938+0000 7f4638cd9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639770e8f60 0x56397748ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55350/0 (socket says 172.21.15.70:55350) 2024-09-21T05:49:49.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.938+0000 7f4638cd9640 1 -- 172.21.15.70:0/61321059 learned_addr learned my addr 172.21.15.70:0/61321059 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:49.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.938+0000 7f46394da640 1 --2- 172.21.15.70:0/61321059 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5639770c00a0 0x56397748f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:49.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.938+0000 7f4638cd9640 1 -- 172.21.15.70:0/61321059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5639770c8280 msgr2=0x56397748f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:49.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.938+0000 7f4638cd9640 1 --2- 172.21.15.70:0/61321059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5639770c8280 0x56397748f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.938+0000 7f4638cd9640 1 -- 172.21.15.70:0/61321059 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5639770c00a0 msgr2=0x56397748f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:49.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.938+0000 7f4638cd9640 1 --2- 172.21.15.70:0/61321059 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5639770c00a0 0x56397748f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.938+0000 7f4638cd9640 1 -- 172.21.15.70:0/61321059 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563977154540 con 0x5639770e8f60 2024-09-21T05:49:49.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.938+0000 7f4638cd9640 1 --2- 172.21.15.70:0/61321059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639770e8f60 0x56397748ef00 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f462400cc30 tx=0x7f4624010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca6e0768d19d462 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:49.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.938+0000 7f462a7fc640 1 --2- 172.21.15.70:0/416183028 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f46200b65a0 0x7f46200b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:49.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.939+0000 7f46394da640 1 --2- 172.21.15.70:0/416183028 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f46200b65a0 0x7f46200b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:49.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.939+0000 7f462a7fc640 1 -- 172.21.15.70:0/416183028 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f462c109090 con 0x7f4634109eb0 2024-09-21T05:49:49.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.939+0000 7f461f7fe640 1 -- 172.21.15.70:0/61321059 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4624016030 con 0x5639770e8f60 2024-09-21T05:49:49.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.939+0000 7f461f7fe640 1 -- 172.21.15.70:0/61321059 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f46240054d0 con 0x5639770e8f60 2024-09-21T05:49:49.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.939+0000 7f461f7fe640 1 -- 172.21.15.70:0/61321059 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4624012480 con 0x5639770e8f60 2024-09-21T05:49:49.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.940+0000 7f4641cb2740 1 -- 172.21.15.70:0/61321059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639770e8f60 msgr2=0x56397748ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:49.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.940+0000 7f46394da640 1 --2- 172.21.15.70:0/416183028 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f46200b65a0 0x7f46200b8ab0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4630005fd0 tx=0x7f4630005e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:49.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.940+0000 7f4641cb2740 1 --2- 172.21.15.70:0/61321059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639770e8f60 0x56397748ef00 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f462400cc30 tx=0x7f4624010740 comp rx=0 tx=0).stop 2024-09-21T05:49:49.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.940+0000 7f4641cb2740 1 -- 172.21.15.70:0/61321059 shutdown_connections 2024-09-21T05:49:49.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.940+0000 7f4641cb2740 1 --2- 172.21.15.70:0/61321059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5639770c8280 0x56397748f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.940+0000 7f4641cb2740 1 --2- 172.21.15.70:0/61321059 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5639770c00a0 0x56397748f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.940+0000 7f4641cb2740 1 --2- 172.21.15.70:0/61321059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639770e8f60 0x56397748ef00 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.940+0000 7f4641cb2740 1 -- 172.21.15.70:0/61321059 >> 172.21.15.70:0/61321059 conn(0x5639770dd350 msgr2=0x56397748cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:49.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.940+0000 7f4641cb2740 1 -- 172.21.15.70:0/61321059 shutdown_connections 2024-09-21T05:49:49.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.940+0000 7f4641cb2740 1 -- 172.21.15.70:0/61321059 wait complete. 2024-09-21T05:49:49.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.940+0000 7f4641cb2740 1 -- start start 2024-09-21T05:49:49.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.940+0000 7f4641cb2740 1 Processor -- start 2024-09-21T05:49:49.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.941+0000 7f4641cb2740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5639770c00a0 0x56397749aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:49.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.941+0000 7f4641cb2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639770c8280 0x56397749afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:49.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.941+0000 7f4641cb2740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5639770e8f60 0x5639774a6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:49.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.941+0000 7f4641cb2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5639772575f0 con 0x5639770c8280 2024-09-21T05:49:49.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.941+0000 7f4641cb2740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x563977391010 con 0x5639770c00a0 2024-09-21T05:49:49.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.941+0000 7f4641cb2740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x56397749d6e0 con 0x5639770e8f60 2024-09-21T05:49:49.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.941+0000 7f4641cb2740 10 client.0 _ll_register_callbacks cb 0x5639773f0340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:49:49.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.941+0000 7f4638cd9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639770c8280 0x56397749afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:49.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.941+0000 7f4638cd9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639770c8280 0x56397749afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55356/0 (socket says 172.21.15.70:55356) 2024-09-21T05:49:49.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.941+0000 7f4638cd9640 1 -- 172.21.15.70:0/3694029343 learned_addr learned my addr 172.21.15.70:0/3694029343 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:49.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.941+0000 7f46394da640 1 --2- 172.21.15.70:0/3694029343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5639770c00a0 0x56397749aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:49.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.941+0000 7f4639cdb640 1 --2- 172.21.15.70:0/3694029343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5639770e8f60 0x5639774a6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:49.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.941+0000 7f4638cd9640 1 -- 172.21.15.70:0/3694029343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5639770e8f60 msgr2=0x5639774a6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:49.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.941+0000 7f4638cd9640 1 --2- 172.21.15.70:0/3694029343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5639770e8f60 0x5639774a6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.941+0000 7f4638cd9640 1 -- 172.21.15.70:0/3694029343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5639770c00a0 msgr2=0x56397749aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:49.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.941+0000 7f4638cd9640 1 --2- 172.21.15.70:0/3694029343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5639770c00a0 0x56397749aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.941+0000 7f4638cd9640 1 -- 172.21.15.70:0/3694029343 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639773bea00 con 0x5639770c8280 2024-09-21T05:49:49.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.942+0000 7f4638cd9640 1 --2- 172.21.15.70:0/3694029343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639770c8280 0x56397749afc0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4624006010 tx=0x7f4624005250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4713e18238260515 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:49.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.942+0000 7f461cff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:49:49.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.943+0000 7f461cff9640 1 -- 172.21.15.70:0/3694029343 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4624016070 con 0x5639770c8280 2024-09-21T05:49:49.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.943+0000 7f461cff9640 1 -- 172.21.15.70:0/3694029343 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f4624004020 con 0x5639770c8280 2024-09-21T05:49:49.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.943+0000 7f4641cb2740 1 -- 172.21.15.70:0/3694029343 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46240054d0 con 0x5639770c8280 2024-09-21T05:49:49.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.943+0000 7f461cff9640 1 -- 172.21.15.70:0/3694029343 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f462402f050 con 0x5639770c8280 2024-09-21T05:49:49.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.943+0000 7f4641cb2740 10 client.15561 fetch_fsmap learned FSMap version 28 2024-09-21T05:49:49.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.943+0000 7f4641cb2740 1 -- 172.21.15.70:0/3694029343 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5639774a96d0 con 0x5639770c8280 2024-09-21T05:49:49.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.943+0000 7f461cff9640 1 -- 172.21.15.70:0/3694029343 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f46240054d0 con 0x5639770c8280 2024-09-21T05:49:49.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.943+0000 7f461cff9640 1 -- 172.21.15.70:0/3694029343 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4624023030 con 0x5639770c8280 2024-09-21T05:49:49.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.944+0000 7f4641cb2740 10 client.15561 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T05:49:49.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.944+0000 7f4641cb2740 10 client.15561 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T05:49:49.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.944+0000 7f4641cb2740 20 client.15561 populate_metadata read hostname 'smithi070' 2024-09-21T05:49:49.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.944+0000 7f4641cb2740 1 --2- 172.21.15.70:0/3694029343 >> [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] conn(0x5639770a78e0 0x5639774ace80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:49.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.944+0000 7f4641cb2740 4 client.15561 mds_command: new command op to 24598 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:49:49.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.944+0000 7f4641cb2740 1 -- 172.21.15.70:0/3694029343 --> [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563977408b60 con 0x5639770a78e0 2024-09-21T05:49:49.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.944+0000 7f46394da640 1 --2- 172.21.15.70:0/3694029343 >> [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] conn(0x5639770a78e0 0x5639774ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:49.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.944+0000 7f461cff9640 10 client.15561 ms_handle_connect on v2:172.21.15.160:6834/2001692372 2024-09-21T05:49:49.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.944+0000 7f46394da640 1 --2- 172.21.15.70:0/3694029343 >> [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] conn(0x5639770a78e0 0x5639774ace80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4eec64ddc7f419ba server_cookie=23eccab80e2f6956 in_seq=0 out_seq=0 2024-09-21T05:49:49.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.945+0000 7f461cff9640 1 -- 172.21.15.70:0/3694029343 <== mds.4 v2:172.21.15.160:6834/2001692372 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563977408b60 con 0x5639770a78e0 2024-09-21T05:49:49.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.945+0000 7f461cff9640 10 client.15561 handle_command_reply: tid=0 2024-09-21T05:49:49.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.945+0000 7f4641cb2740 1 client.15561 shutdown 2024-09-21T05:49:49.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.945+0000 7f4641cb2740 1 -- 172.21.15.70:0/3694029343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639770c8280 msgr2=0x56397749afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:49.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.945+0000 7f4641cb2740 1 --2- 172.21.15.70:0/3694029343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639770c8280 0x56397749afc0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4624006010 tx=0x7f4624005250 comp rx=0 tx=0).stop 2024-09-21T05:49:49.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.945+0000 7f4641cb2740 1 -- 172.21.15.70:0/3694029343 shutdown_connections 2024-09-21T05:49:49.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.945+0000 7f4641cb2740 1 --2- 172.21.15.70:0/3694029343 >> [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] conn(0x5639770a78e0 0x5639774ace80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.945+0000 7f4641cb2740 1 --2- 172.21.15.70:0/3694029343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5639770e8f60 0x5639774a6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.945+0000 7f4641cb2740 1 --2- 172.21.15.70:0/3694029343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639770c8280 0x56397749afc0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.945+0000 7f4641cb2740 1 --2- 172.21.15.70:0/3694029343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5639770c00a0 0x56397749aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.945+0000 7f4641cb2740 1 -- 172.21.15.70:0/3694029343 >> 172.21.15.70:0/3694029343 conn(0x5639770dd350 msgr2=0x5639774920e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:49.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.945+0000 7f461cff9640 0 client.15561 ms_handle_reset on v2:172.21.15.160:6834/2001692372 2024-09-21T05:49:49.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.946+0000 7f4641cb2740 1 -- 172.21.15.70:0/3694029343 shutdown_connections 2024-09-21T05:49:49.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.946+0000 7f4641cb2740 1 -- 172.21.15.70:0/3694029343 wait complete. 2024-09-21T05:49:49.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.946+0000 7f4641cb2740 20 client.15561 trim_cache size 0 max 16384 2024-09-21T05:49:49.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.963+0000 7f4641cb2740 1 Processor -- start 2024-09-21T05:49:49.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.963+0000 7f4641cb2740 1 -- start start 2024-09-21T05:49:49.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.964+0000 7f4641cb2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639770c00a0 0x563977495a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:49.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.964+0000 7f4641cb2740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5639770c8280 0x563977495f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:49.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.964+0000 7f4641cb2740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5639770e8f60 0x56397749aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:49.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.964+0000 7f4641cb2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5639774ab1c0 con 0x5639770c00a0 2024-09-21T05:49:49.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.964+0000 7f4641cb2740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5639774ab890 con 0x5639770e8f60 2024-09-21T05:49:49.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.964+0000 7f4641cb2740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5639774abf60 con 0x5639770c8280 2024-09-21T05:49:49.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.964+0000 7f46394da640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639770c00a0 0x563977495a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:49.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.964+0000 7f46394da640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639770c00a0 0x563977495a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55364/0 (socket says 172.21.15.70:55364) 2024-09-21T05:49:49.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.964+0000 7f46394da640 1 -- 172.21.15.70:0/2871072692 learned_addr learned my addr 172.21.15.70:0/2871072692 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:49.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.964+0000 7f4639cdb640 1 --2- 172.21.15.70:0/2871072692 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5639770e8f60 0x56397749aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:49.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.964+0000 7f4638cd9640 1 --2- 172.21.15.70:0/2871072692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5639770c8280 0x563977495f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:49.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.964+0000 7f46394da640 1 -- 172.21.15.70:0/2871072692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5639770c8280 msgr2=0x563977495f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:49.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.964+0000 7f46394da640 1 --2- 172.21.15.70:0/2871072692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5639770c8280 0x563977495f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.964+0000 7f46394da640 1 -- 172.21.15.70:0/2871072692 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5639770e8f60 msgr2=0x56397749aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:49.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.964+0000 7f46394da640 1 --2- 172.21.15.70:0/2871072692 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5639770e8f60 0x56397749aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.964+0000 7f46394da640 1 -- 172.21.15.70:0/2871072692 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563977487080 con 0x5639770c00a0 2024-09-21T05:49:49.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.964+0000 7f4638cd9640 1 --2- 172.21.15.70:0/2871072692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5639770c8280 0x563977495f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:49:49.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.964+0000 7f46394da640 1 --2- 172.21.15.70:0/2871072692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639770c00a0 0x563977495a30 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f46300058c0 tx=0x7f4630015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f2beaf63bfa9eb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:49.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.965+0000 7f461effd640 1 -- 172.21.15.70:0/2871072692 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463001f630 con 0x5639770c00a0 2024-09-21T05:49:49.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.965+0000 7f461effd640 1 -- 172.21.15.70:0/2871072692 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f463002b070 con 0x5639770c00a0 2024-09-21T05:49:49.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.965+0000 7f461effd640 1 -- 172.21.15.70:0/2871072692 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4630028ae0 con 0x5639770c00a0 2024-09-21T05:49:49.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.966+0000 7f4641cb2740 1 -- 172.21.15.70:0/2871072692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639770c00a0 msgr2=0x563977495a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:49.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.966+0000 7f4641cb2740 1 --2- 172.21.15.70:0/2871072692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639770c00a0 0x563977495a30 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f46300058c0 tx=0x7f4630015000 comp rx=0 tx=0).stop 2024-09-21T05:49:49.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.966+0000 7f4641cb2740 1 -- 172.21.15.70:0/2871072692 shutdown_connections 2024-09-21T05:49:49.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.966+0000 7f4641cb2740 1 --2- 172.21.15.70:0/2871072692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5639770c8280 0x563977495f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.966+0000 7f4641cb2740 1 --2- 172.21.15.70:0/2871072692 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5639770e8f60 0x56397749aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.966+0000 7f4641cb2740 1 --2- 172.21.15.70:0/2871072692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639770c00a0 0x563977495a30 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.966+0000 7f4641cb2740 1 -- 172.21.15.70:0/2871072692 >> 172.21.15.70:0/2871072692 conn(0x5639770dd350 msgr2=0x5639774a6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:49.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.966+0000 7f4641cb2740 1 -- 172.21.15.70:0/2871072692 shutdown_connections 2024-09-21T05:49:49.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.966+0000 7f4641cb2740 1 -- 172.21.15.70:0/2871072692 wait complete. 2024-09-21T05:49:49.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.966+0000 7f4641cb2740 1 -- start start 2024-09-21T05:49:49.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.966+0000 7f4641cb2740 1 Processor -- start 2024-09-21T05:49:49.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.967+0000 7f4641cb2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639770c00a0 0x5639774b5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:49.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.967+0000 7f4641cb2740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5639770c8280 0x5639774aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:49.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.967+0000 7f4641cb2740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5639770e8f60 0x5639774af210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:49.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.967+0000 7f4641cb2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5639774acd00 con 0x5639770c00a0 2024-09-21T05:49:49.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.967+0000 7f4641cb2740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5639774ac630 con 0x5639770e8f60 2024-09-21T05:49:49.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.967+0000 7f4641cb2740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5639774ad3d0 con 0x5639770c8280 2024-09-21T05:49:49.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.967+0000 7f4641cb2740 10 client.0 _ll_register_callbacks cb 0x7f462400cb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:49:49.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.967+0000 7f46394da640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639770c00a0 0x5639774b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:49.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.967+0000 7f46394da640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639770c00a0 0x5639774b5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55374/0 (socket says 172.21.15.70:55374) 2024-09-21T05:49:49.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.967+0000 7f46394da640 1 -- 172.21.15.70:0/3296067943 learned_addr learned my addr 172.21.15.70:0/3296067943 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:49.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.967+0000 7f4639cdb640 1 --2- 172.21.15.70:0/3296067943 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5639770e8f60 0x5639774af210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:49.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.967+0000 7f4638cd9640 1 --2- 172.21.15.70:0/3296067943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5639770c8280 0x5639774aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:49.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.967+0000 7f46394da640 1 -- 172.21.15.70:0/3296067943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5639770c8280 msgr2=0x5639774aecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:49.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.967+0000 7f46394da640 1 --2- 172.21.15.70:0/3296067943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5639770c8280 0x5639774aecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.967+0000 7f46394da640 1 -- 172.21.15.70:0/3296067943 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5639770e8f60 msgr2=0x5639774af210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:49.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.967+0000 7f46394da640 1 --2- 172.21.15.70:0/3296067943 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5639770e8f60 0x5639774af210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.967+0000 7f46394da640 1 -- 172.21.15.70:0/3296067943 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639774af8b0 con 0x5639770c00a0 2024-09-21T05:49:49.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.968+0000 7f4638cd9640 1 --2- 172.21.15.70:0/3296067943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5639770c8280 0x5639774aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:49.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.968+0000 7f46394da640 1 --2- 172.21.15.70:0/3296067943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639770c00a0 0x5639774b5820 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f46300289c0 tx=0x7f46300289f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6a5f94f9acb72c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:49.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.968+0000 7f461cff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:49:49.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.968+0000 7f461cff9640 1 -- 172.21.15.70:0/3296067943 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463003e060 con 0x5639770c00a0 2024-09-21T05:49:49.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.968+0000 7f461cff9640 1 -- 172.21.15.70:0/3296067943 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f463001f430 con 0x5639770c00a0 2024-09-21T05:49:49.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.968+0000 7f4641cb2740 1 -- 172.21.15.70:0/3296067943 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f463002b070 con 0x5639770c00a0 2024-09-21T05:49:49.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.968+0000 7f461cff9640 1 -- 172.21.15.70:0/3296067943 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4630045050 con 0x5639770c00a0 2024-09-21T05:49:49.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.968+0000 7f4641cb2740 10 client.15567 fetch_fsmap learned FSMap version 28 2024-09-21T05:49:49.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.968+0000 7f4641cb2740 1 -- 172.21.15.70:0/3296067943 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5639774b5220 con 0x5639770c00a0 2024-09-21T05:49:49.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.968+0000 7f461cff9640 1 -- 172.21.15.70:0/3296067943 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f463002b070 con 0x5639770c00a0 2024-09-21T05:49:49.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.969+0000 7f461cff9640 1 -- 172.21.15.70:0/3296067943 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f46300304f0 con 0x5639770c00a0 2024-09-21T05:49:49.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.969+0000 7f4641cb2740 10 client.15567 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T05:49:49.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.969+0000 7f4641cb2740 10 client.15567 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T05:49:49.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.969+0000 7f4641cb2740 20 client.15567 populate_metadata read hostname 'smithi070' 2024-09-21T05:49:49.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.969+0000 7f4641cb2740 1 --2- 172.21.15.70:0/3296067943 >> [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] conn(0x56397707cc90 0x56397751b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:49.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.969+0000 7f4641cb2740 4 client.15567 mds_command: new command op to 24598 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T05:49:49.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.969+0000 7f4641cb2740 1 -- 172.21.15.70:0/3296067943 --> [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] -- command(tid 0: {"prefix": "status"}) -- 0x563977404610 con 0x56397707cc90 2024-09-21T05:49:49.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.969+0000 7f4638cd9640 1 --2- 172.21.15.70:0/3296067943 >> [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] conn(0x56397707cc90 0x56397751b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:49.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.969+0000 7f461cff9640 10 client.15567 ms_handle_connect on v2:172.21.15.160:6834/2001692372 2024-09-21T05:49:49.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.969+0000 7f4638cd9640 1 --2- 172.21.15.70:0/3296067943 >> [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] conn(0x56397707cc90 0x56397751b650 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6e700c5642b54c62 server_cookie=315047e75600f54d in_seq=0 out_seq=0 2024-09-21T05:49:49.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.970+0000 7f461cff9640 1 -- 172.21.15.70:0/3296067943 <== mds.4 v2:172.21.15.160:6834/2001692372 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x563977404610 con 0x56397707cc90 2024-09-21T05:49:49.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.970+0000 7f461cff9640 10 client.15567 handle_command_reply: tid=0 2024-09-21T05:49:49.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.970+0000 7f4641cb2740 1 client.15567 shutdown 2024-09-21T05:49:49.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.970+0000 7f4641cb2740 1 -- 172.21.15.70:0/3296067943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639770c00a0 msgr2=0x5639774b5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:49.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.970+0000 7f4641cb2740 1 --2- 172.21.15.70:0/3296067943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639770c00a0 0x5639774b5820 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f46300289c0 tx=0x7f46300289f0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.970+0000 7f4641cb2740 1 -- 172.21.15.70:0/3296067943 shutdown_connections 2024-09-21T05:49:49.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.970+0000 7f4641cb2740 1 --2- 172.21.15.70:0/3296067943 >> [v2:172.21.15.160:6834/2001692372,v1:172.21.15.160:6835/2001692372] conn(0x56397707cc90 0x56397751b650 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.970+0000 7f4641cb2740 1 --2- 172.21.15.70:0/3296067943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5639770c8280 0x5639774aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.970+0000 7f4641cb2740 1 --2- 172.21.15.70:0/3296067943 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5639770e8f60 0x5639774af210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.970+0000 7f4641cb2740 1 --2- 172.21.15.70:0/3296067943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639770c00a0 0x5639774b5820 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.970+0000 7f4641cb2740 1 -- 172.21.15.70:0/3296067943 >> 172.21.15.70:0/3296067943 conn(0x5639770dd350 msgr2=0x5639774a6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:49.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.970+0000 7f461cff9640 0 client.15567 ms_handle_reset on v2:172.21.15.160:6834/2001692372 2024-09-21T05:49:49.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.970+0000 7f4641cb2740 1 -- 172.21.15.70:0/3296067943 shutdown_connections 2024-09-21T05:49:49.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.970+0000 7f4641cb2740 1 -- 172.21.15.70:0/3296067943 wait complete. 2024-09-21T05:49:49.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.970+0000 7f4641cb2740 20 client.15567 trim_cache size 0 max 16384 2024-09-21T05:49:49.978 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:49:49.978 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "96c6636e-77db-11ef-baf5-efdc52797490", 2024-09-21T05:49:49.979 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 4, 2024-09-21T05:49:49.979 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24598, 2024-09-21T05:49:49.979 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-21T05:49:49.979 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-21T05:49:49.979 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-21T05:49:49.979 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 120.436107987, 2024-09-21T05:49:49.979 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 28, 2024-09-21T05:49:49.979 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 85, 2024-09-21T05:49:49.979 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 85, 2024-09-21T05:49:49.979 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 190.09723686300001 2024-09-21T05:49:49.979 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:49:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.971+0000 7f463b73e640 1 -- 172.21.15.70:0/416183028 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f46200b65a0 msgr2=0x7f46200b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.971+0000 7f463b73e640 1 --2- 172.21.15.70:0/416183028 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f46200b65a0 0x7f46200b8ab0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4630005fd0 tx=0x7f4630005e40 comp rx=0 tx=0).stop 2024-09-21T05:49:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.971+0000 7f463b73e640 1 -- 172.21.15.70:0/416183028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4634109eb0 msgr2=0x7f463419fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.971+0000 7f463b73e640 1 --2- 172.21.15.70:0/416183028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4634109eb0 0x7f463419fd50 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f462c0097b0 tx=0x7f462c003ba0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.971+0000 7f463b73e640 1 -- 172.21.15.70:0/416183028 shutdown_connections 2024-09-21T05:49:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.971+0000 7f463b73e640 1 --2- 172.21.15.70:0/416183028 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f46200b65a0 0x7f46200b8ab0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.971+0000 7f463b73e640 1 --2- 172.21.15.70:0/416183028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4634109eb0 0x7f463419fd50 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.971+0000 7f463b73e640 1 --2- 172.21.15.70:0/416183028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4634109560 0x7f463419aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.971+0000 7f463b73e640 1 --2- 172.21.15.70:0/416183028 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4634102080 0x7f463419a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:49.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.971+0000 7f463b73e640 1 -- 172.21.15.70:0/416183028 >> 172.21.15.70:0/416183028 conn(0x7f4634079ec0 msgr2=0x7f46341075b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:49.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.971+0000 7f463b73e640 1 -- 172.21.15.70:0/416183028 shutdown_connections 2024-09-21T05:49:49.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:49.971+0000 7f463b73e640 1 -- 172.21.15.70:0/416183028 wait complete. 2024-09-21T05:49:50.797 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T05:49:51.046 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:51.167 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:50 smithi070 ceph-mon[30981]: pgmap v381: 129 pgs: 129 active+clean; 659 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-21T05:49:51.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:50 smithi116 ceph-mon[34332]: pgmap v381: 129 pgs: 129 active+clean; 659 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-21T05:49:51.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:50 smithi160 ceph-mon[33979]: pgmap v381: 129 pgs: 129 active+clean; 659 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-21T05:49:51.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.555+0000 7f95e3b73640 1 -- 172.21.15.70:0/3538752269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95dc1049e0 msgr2=0x7f95dc104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:51.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.555+0000 7f95e3b73640 1 --2- 172.21.15.70:0/3538752269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95dc1049e0 0x7f95dc104df0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009900 tx=0x7f95d802a410 comp rx=0 tx=0).stop 2024-09-21T05:49:51.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.555+0000 7f95e3b73640 1 -- 172.21.15.70:0/3538752269 shutdown_connections 2024-09-21T05:49:51.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.555+0000 7f95e3b73640 1 --2- 172.21.15.70:0/3538752269 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95dc10de40 0x7f95dc110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.555+0000 7f95e3b73640 1 --2- 172.21.15.70:0/3538752269 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95dc105330 0x7f95dc10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.555+0000 7f95e3b73640 1 --2- 172.21.15.70:0/3538752269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95dc1049e0 0x7f95dc104df0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.555+0000 7f95e3b73640 1 -- 172.21.15.70:0/3538752269 >> 172.21.15.70:0/3538752269 conn(0x7f95dc079750 msgr2=0x7f95dc079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:51.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.556+0000 7f95e3b73640 1 -- 172.21.15.70:0/3538752269 shutdown_connections 2024-09-21T05:49:51.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.556+0000 7f95e3b73640 1 -- 172.21.15.70:0/3538752269 wait complete. 2024-09-21T05:49:51.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.556+0000 7f95e3b73640 1 Processor -- start 2024-09-21T05:49:51.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.556+0000 7f95e3b73640 1 -- start start 2024-09-21T05:49:51.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.556+0000 7f95e3b73640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95dc1049e0 0x7f95dc19a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:51.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.556+0000 7f95e3b73640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95dc105330 0x7f95dc19aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:51.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.557+0000 7f95e3b73640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95dc10de40 0x7f95dc19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:51.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.557+0000 7f95e3b73640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc113a90 con 0x7f95dc105330 2024-09-21T05:49:51.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.557+0000 7f95e3b73640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc113910 con 0x7f95dc1049e0 2024-09-21T05:49:51.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.557+0000 7f95e3b73640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc113c10 con 0x7f95dc10de40 2024-09-21T05:49:51.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.557+0000 7f95e110e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95dc105330 0x7f95dc19aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:51.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.557+0000 7f95e110e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95dc105330 0x7f95dc19aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35564/0 (socket says 172.21.15.70:35564) 2024-09-21T05:49:51.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.557+0000 7f95e110e640 1 -- 172.21.15.70:0/2307452615 learned_addr learned my addr 172.21.15.70:0/2307452615 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:51.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.557+0000 7f95e190f640 1 --2- 172.21.15.70:0/2307452615 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95dc1049e0 0x7f95dc19a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:51.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.557+0000 7f95e2110640 1 --2- 172.21.15.70:0/2307452615 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95dc10de40 0x7f95dc19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:51.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.557+0000 7f95e110e640 1 -- 172.21.15.70:0/2307452615 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95dc10de40 msgr2=0x7f95dc19fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:51.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.557+0000 7f95e110e640 1 --2- 172.21.15.70:0/2307452615 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95dc10de40 0x7f95dc19fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.557+0000 7f95e110e640 1 -- 172.21.15.70:0/2307452615 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95dc1049e0 msgr2=0x7f95dc19a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:51.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.557+0000 7f95e110e640 1 --2- 172.21.15.70:0/2307452615 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95dc1049e0 0x7f95dc19a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.557+0000 7f95e110e640 1 -- 172.21.15.70:0/2307452615 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95dc1a0470 con 0x7f95dc105330 2024-09-21T05:49:51.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.557+0000 7f95e110e640 1 --2- 172.21.15.70:0/2307452615 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95dc105330 0x7f95dc19aaa0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f95cc00c970 tx=0x7f95cc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:51.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.557+0000 7f95d2ffd640 1 -- 172.21.15.70:0/2307452615 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95cc007bb0 con 0x7f95dc105330 2024-09-21T05:49:51.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.557+0000 7f95d2ffd640 1 -- 172.21.15.70:0/2307452615 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f95cc007d50 con 0x7f95dc105330 2024-09-21T05:49:51.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.557+0000 7f95e3b73640 1 -- 172.21.15.70:0/2307452615 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95dc1a0760 con 0x7f95dc105330 2024-09-21T05:49:51.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.557+0000 7f95d2ffd640 1 -- 172.21.15.70:0/2307452615 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95cc004e40 con 0x7f95dc105330 2024-09-21T05:49:51.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.558+0000 7f95e3b73640 1 -- 172.21.15.70:0/2307452615 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95dc1a6ec0 con 0x7f95dc105330 2024-09-21T05:49:51.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.560+0000 7f95ea0e7740 1 Processor -- start 2024-09-21T05:49:51.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.560+0000 7f95ea0e7740 1 -- start start 2024-09-21T05:49:51.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.560+0000 7f95d2ffd640 1 -- 172.21.15.70:0/2307452615 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) ==== 154563+0+0 (secure 0 0 0) 0x7f95cc005000 con 0x7f95dc105330 2024-09-21T05:49:51.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.561+0000 7f95ea0e7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e38a2d4f60 0x55e38a67af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:51.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.561+0000 7f95ea0e7740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e38a2ac0a0 0x55e38a67b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:51.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.561+0000 7f95ea0e7740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e38a2b4280 0x55e38a67b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:51.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.561+0000 7f95ea0e7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e38a5f2c10 con 0x55e38a2d4f60 2024-09-21T05:49:51.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.561+0000 7f95ea0e7740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e38a5e2040 con 0x55e38a2b4280 2024-09-21T05:49:51.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.561+0000 7f95ea0e7740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55e38a5e5e50 con 0x55e38a2ac0a0 2024-09-21T05:49:51.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.561+0000 7f95e2110640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e38a2d4f60 0x55e38a67af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:51.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.561+0000 7f95e2110640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e38a2d4f60 0x55e38a67af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35572/0 (socket says 172.21.15.70:35572) 2024-09-21T05:49:51.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.561+0000 7f95e2110640 1 -- 172.21.15.70:0/2315122803 learned_addr learned my addr 172.21.15.70:0/2315122803 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:51.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.561+0000 7f95e190f640 1 --2- 172.21.15.70:0/2315122803 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e38a2ac0a0 0x55e38a67b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:51.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.561+0000 7f95e110e640 1 --2- 172.21.15.70:0/2315122803 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e38a2b4280 0x55e38a67b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.561+0000 7f95e2110640 1 -- 172.21.15.70:0/2315122803 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e38a2ac0a0 msgr2=0x55e38a67b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.561+0000 7f95e2110640 1 --2- 172.21.15.70:0/2315122803 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e38a2ac0a0 0x55e38a67b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.561+0000 7f95e2110640 1 -- 172.21.15.70:0/2315122803 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e38a2b4280 msgr2=0x55e38a67b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.561+0000 7f95e2110640 1 --2- 172.21.15.70:0/2315122803 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e38a2b4280 0x55e38a67b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.561+0000 7f95e2110640 1 -- 172.21.15.70:0/2315122803 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e38a340540 con 0x55e38a2d4f60 2024-09-21T05:49:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.561+0000 7f95e110e640 1 --2- 172.21.15.70:0/2315122803 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e38a2b4280 0x55e38a67b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:49:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.561+0000 7f95e2110640 1 --2- 172.21.15.70:0/2315122803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e38a2d4f60 0x55e38a67af00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f95d400ae90 tx=0x7f95d400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8007992ae59554a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.561+0000 7f95d2ffd640 1 --2- 172.21.15.70:0/2307452615 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f95c80b65a0 0x7f95c80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.562+0000 7f95c7fff640 1 -- 172.21.15.70:0/2315122803 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d4003b70 con 0x55e38a2d4f60 2024-09-21T05:49:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.562+0000 7f95c7fff640 1 -- 172.21.15.70:0/2315122803 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f95d4003d10 con 0x55e38a2d4f60 2024-09-21T05:49:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.562+0000 7f95c7fff640 1 -- 172.21.15.70:0/2315122803 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d4010b00 con 0x55e38a2d4f60 2024-09-21T05:49:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.562+0000 7f95e190f640 1 --2- 172.21.15.70:0/2307452615 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f95c80b65a0 0x7f95c80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.562+0000 7f95d2ffd640 1 -- 172.21.15.70:0/2307452615 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f95cc0e74e0 con 0x7f95dc105330 2024-09-21T05:49:51.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.563+0000 7f95ea0e7740 1 -- 172.21.15.70:0/2315122803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e38a2d4f60 msgr2=0x55e38a67af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:51.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.563+0000 7f95e190f640 1 --2- 172.21.15.70:0/2307452615 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f95c80b65a0 0x7f95c80b8ab0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f95d8000c00 tx=0x7f95d8005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:51.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.563+0000 7f95ea0e7740 1 --2- 172.21.15.70:0/2315122803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e38a2d4f60 0x55e38a67af00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f95d400ae90 tx=0x7f95d400f790 comp rx=0 tx=0).stop 2024-09-21T05:49:51.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.563+0000 7f95ea0e7740 1 -- 172.21.15.70:0/2315122803 shutdown_connections 2024-09-21T05:49:51.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.563+0000 7f95ea0e7740 1 --2- 172.21.15.70:0/2315122803 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e38a2ac0a0 0x55e38a67b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.563+0000 7f95ea0e7740 1 --2- 172.21.15.70:0/2315122803 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e38a2b4280 0x55e38a67b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.563+0000 7f95ea0e7740 1 --2- 172.21.15.70:0/2315122803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e38a2d4f60 0x55e38a67af00 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.563+0000 7f95ea0e7740 1 -- 172.21.15.70:0/2315122803 >> 172.21.15.70:0/2315122803 conn(0x55e38a2c9350 msgr2=0x55e38a678df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:51.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.563+0000 7f95ea0e7740 1 -- 172.21.15.70:0/2315122803 shutdown_connections 2024-09-21T05:49:51.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.563+0000 7f95ea0e7740 1 -- 172.21.15.70:0/2315122803 wait complete. 2024-09-21T05:49:51.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.563+0000 7f95ea0e7740 1 -- start start 2024-09-21T05:49:51.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.563+0000 7f95ea0e7740 1 Processor -- start 2024-09-21T05:49:51.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.564+0000 7f95ea0e7740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e38a2ac0a0 0x55e38a6869f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:51.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.564+0000 7f95ea0e7740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e38a2b4280 0x55e38a686f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:51.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.564+0000 7f95ea0e7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e38a2d4f60 0x55e38a6929d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:51.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.564+0000 7f95ea0e7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e38a4435f0 con 0x55e38a2d4f60 2024-09-21T05:49:51.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.564+0000 7f95ea0e7740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e38a57d010 con 0x55e38a2ac0a0 2024-09-21T05:49:51.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.564+0000 7f95ea0e7740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55e38a6896e0 con 0x55e38a2b4280 2024-09-21T05:49:51.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.564+0000 7f95ea0e7740 10 client.0 _ll_register_callbacks cb 0x55e38a5dc340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:49:51.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.564+0000 7f95e2110640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e38a2d4f60 0x55e38a6929d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:51.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.564+0000 7f95e2110640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e38a2d4f60 0x55e38a6929d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35584/0 (socket says 172.21.15.70:35584) 2024-09-21T05:49:51.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.564+0000 7f95e2110640 1 -- 172.21.15.70:0/2609337539 learned_addr learned my addr 172.21.15.70:0/2609337539 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:51.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.564+0000 7f95e110e640 1 --2- 172.21.15.70:0/2609337539 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e38a2b4280 0x55e38a686f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:51.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.564+0000 7f95e190f640 1 --2- 172.21.15.70:0/2609337539 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e38a2ac0a0 0x55e38a6869f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.564+0000 7f95e2110640 1 -- 172.21.15.70:0/2609337539 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e38a2b4280 msgr2=0x55e38a686f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.564+0000 7f95e2110640 1 --2- 172.21.15.70:0/2609337539 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e38a2b4280 0x55e38a686f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.564+0000 7f95e2110640 1 -- 172.21.15.70:0/2609337539 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e38a2ac0a0 msgr2=0x55e38a6869f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.564+0000 7f95e2110640 1 --2- 172.21.15.70:0/2609337539 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e38a2ac0a0 0x55e38a6869f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.564+0000 7f95e2110640 1 -- 172.21.15.70:0/2609337539 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e38a5aaa00 con 0x55e38a2d4f60 2024-09-21T05:49:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.564+0000 7f95e110e640 1 --2- 172.21.15.70:0/2609337539 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e38a2b4280 0x55e38a686f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.564+0000 7f95e2110640 1 --2- 172.21.15.70:0/2609337539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e38a2d4f60 0x55e38a6929d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f95d4005b40 tx=0x7f95d4010ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cfccc233d8a92be server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.564+0000 7f95c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:49:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.565+0000 7f95c57fa640 1 -- 172.21.15.70:0/2609337539 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d401d040 con 0x55e38a2d4f60 2024-09-21T05:49:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.565+0000 7f95c57fa640 1 -- 172.21.15.70:0/2609337539 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f95d4010cd0 con 0x55e38a2d4f60 2024-09-21T05:49:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.565+0000 7f95ea0e7740 1 -- 172.21.15.70:0/2609337539 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95d4003d10 con 0x55e38a2d4f60 2024-09-21T05:49:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.565+0000 7f95c57fa640 1 -- 172.21.15.70:0/2609337539 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f95d402f050 con 0x55e38a2d4f60 2024-09-21T05:49:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.565+0000 7f95ea0e7740 10 client.15579 fetch_fsmap learned FSMap version 28 2024-09-21T05:49:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.565+0000 7f95ea0e7740 1 -- 172.21.15.70:0/2609337539 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e38a695590 con 0x55e38a2d4f60 2024-09-21T05:49:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.565+0000 7f95c57fa640 1 -- 172.21.15.70:0/2609337539 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f95d4003d10 con 0x55e38a2d4f60 2024-09-21T05:49:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.565+0000 7f95c57fa640 1 -- 172.21.15.70:0/2609337539 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f95d4018670 con 0x55e38a2d4f60 2024-09-21T05:49:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.565+0000 7f95ea0e7740 10 client.15579 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T05:49:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.565+0000 7f95ea0e7740 10 client.15579 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T05:49:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.565+0000 7f95ea0e7740 20 client.15579 populate_metadata read hostname 'smithi070' 2024-09-21T05:49:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.565+0000 7f95ea0e7740 1 --2- 172.21.15.70:0/2609337539 >> [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] conn(0x55e38a2938e0 0x55e38a698c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.565+0000 7f95ea0e7740 4 client.15579 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:49:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.565+0000 7f95ea0e7740 1 -- 172.21.15.70:0/2609337539 --> [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e38a5f4b60 con 0x55e38a2938e0 2024-09-21T05:49:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.566+0000 7f95e190f640 1 --2- 172.21.15.70:0/2609337539 >> [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] conn(0x55e38a2938e0 0x55e38a698c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.566+0000 7f95c57fa640 10 client.15579 ms_handle_connect on v2:172.21.15.160:6836/2558120045 2024-09-21T05:49:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.566+0000 7f95e190f640 1 --2- 172.21.15.70:0/2609337539 >> [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] conn(0x55e38a2938e0 0x55e38a698c60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a091a47df14876ab server_cookie=e85dd1e6ad8b609d in_seq=0 out_seq=0 2024-09-21T05:49:51.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.567+0000 7f95c57fa640 1 -- 172.21.15.70:0/2609337539 <== mds.3 v2:172.21.15.160:6836/2558120045 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e38a5f4b60 con 0x55e38a2938e0 2024-09-21T05:49:51.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.567+0000 7f95c57fa640 10 client.15579 handle_command_reply: tid=0 2024-09-21T05:49:51.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.567+0000 7f95ea0e7740 1 client.15579 shutdown 2024-09-21T05:49:51.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.567+0000 7f95ea0e7740 1 -- 172.21.15.70:0/2609337539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e38a2d4f60 msgr2=0x55e38a6929d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:51.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.567+0000 7f95ea0e7740 1 --2- 172.21.15.70:0/2609337539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e38a2d4f60 0x55e38a6929d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f95d4005b40 tx=0x7f95d4010ab0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.567+0000 7f95ea0e7740 1 -- 172.21.15.70:0/2609337539 shutdown_connections 2024-09-21T05:49:51.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.567+0000 7f95ea0e7740 1 --2- 172.21.15.70:0/2609337539 >> [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] conn(0x55e38a2938e0 0x55e38a698c60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.567+0000 7f95ea0e7740 1 --2- 172.21.15.70:0/2609337539 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e38a2b4280 0x55e38a686f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.567+0000 7f95ea0e7740 1 --2- 172.21.15.70:0/2609337539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e38a2d4f60 0x55e38a6929d0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.567+0000 7f95ea0e7740 1 --2- 172.21.15.70:0/2609337539 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e38a2ac0a0 0x55e38a6869f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.567+0000 7f95c57fa640 0 client.15579 ms_handle_reset on v2:172.21.15.160:6836/2558120045 2024-09-21T05:49:51.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.567+0000 7f95ea0e7740 1 -- 172.21.15.70:0/2609337539 >> 172.21.15.70:0/2609337539 conn(0x55e38a2c9350 msgr2=0x55e38a67e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:51.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.567+0000 7f95ea0e7740 1 -- 172.21.15.70:0/2609337539 shutdown_connections 2024-09-21T05:49:51.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.567+0000 7f95ea0e7740 1 -- 172.21.15.70:0/2609337539 wait complete. 2024-09-21T05:49:51.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.567+0000 7f95ea0e7740 20 client.15579 trim_cache size 0 max 16384 2024-09-21T05:49:51.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.585+0000 7f95ea0e7740 1 Processor -- start 2024-09-21T05:49:51.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.585+0000 7f95ea0e7740 1 -- start start 2024-09-21T05:49:51.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.585+0000 7f95ea0e7740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e38a2ac0a0 0x55e38a685ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:51.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.585+0000 7f95ea0e7740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e38a2b4280 0x55e38a692940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:51.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.585+0000 7f95ea0e7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e38a2d4f60 0x55e38a692e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:51.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.585+0000 7f95ea0e7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e38a696fa0 con 0x55e38a2d4f60 2024-09-21T05:49:51.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.585+0000 7f95ea0e7740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e38a697670 con 0x55e38a2b4280 2024-09-21T05:49:51.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.586+0000 7f95ea0e7740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55e38a697d40 con 0x55e38a2ac0a0 2024-09-21T05:49:51.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.586+0000 7f95e2110640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e38a2d4f60 0x55e38a692e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:51.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.586+0000 7f95e2110640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e38a2d4f60 0x55e38a692e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35586/0 (socket says 172.21.15.70:35586) 2024-09-21T05:49:51.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.586+0000 7f95e2110640 1 -- 172.21.15.70:0/2986371256 learned_addr learned my addr 172.21.15.70:0/2986371256 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:51.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.586+0000 7f95e190f640 1 --2- 172.21.15.70:0/2986371256 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e38a2ac0a0 0x55e38a685ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:51.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.586+0000 7f95e110e640 1 --2- 172.21.15.70:0/2986371256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e38a2b4280 0x55e38a692940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:51.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.586+0000 7f95e2110640 1 -- 172.21.15.70:0/2986371256 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e38a2ac0a0 msgr2=0x55e38a685ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:51.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.586+0000 7f95e2110640 1 --2- 172.21.15.70:0/2986371256 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e38a2ac0a0 0x55e38a685ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.586+0000 7f95e2110640 1 -- 172.21.15.70:0/2986371256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e38a2b4280 msgr2=0x55e38a692940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:51.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.586+0000 7f95e2110640 1 --2- 172.21.15.70:0/2986371256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e38a2b4280 0x55e38a692940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.586+0000 7f95e2110640 1 -- 172.21.15.70:0/2986371256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e38a682080 con 0x55e38a2d4f60 2024-09-21T05:49:51.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.586+0000 7f95e2110640 1 --2- 172.21.15.70:0/2986371256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e38a2d4f60 0x55e38a692e80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f95d4018b10 tx=0x7f95d400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e294b3b696f610ce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:51.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.586+0000 7f95c77fe640 1 -- 172.21.15.70:0/2986371256 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d40106c0 con 0x55e38a2d4f60 2024-09-21T05:49:51.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.586+0000 7f95c77fe640 1 -- 172.21.15.70:0/2986371256 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f95d4004a00 con 0x55e38a2d4f60 2024-09-21T05:49:51.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.586+0000 7f95c77fe640 1 -- 172.21.15.70:0/2986371256 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d4005040 con 0x55e38a2d4f60 2024-09-21T05:49:51.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.587+0000 7f95ea0e7740 1 -- 172.21.15.70:0/2986371256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e38a2d4f60 msgr2=0x55e38a692e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:51.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.587+0000 7f95ea0e7740 1 --2- 172.21.15.70:0/2986371256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e38a2d4f60 0x55e38a692e80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f95d4018b10 tx=0x7f95d400a710 comp rx=0 tx=0).stop 2024-09-21T05:49:51.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.587+0000 7f95ea0e7740 1 -- 172.21.15.70:0/2986371256 shutdown_connections 2024-09-21T05:49:51.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.587+0000 7f95ea0e7740 1 --2- 172.21.15.70:0/2986371256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e38a2d4f60 0x55e38a692e80 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.587+0000 7f95ea0e7740 1 --2- 172.21.15.70:0/2986371256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e38a2b4280 0x55e38a692940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.587+0000 7f95ea0e7740 1 --2- 172.21.15.70:0/2986371256 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e38a2ac0a0 0x55e38a685ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.587+0000 7f95ea0e7740 1 -- 172.21.15.70:0/2986371256 >> 172.21.15.70:0/2986371256 conn(0x55e38a2c9350 msgr2=0x55e38a685070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:51.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.587+0000 7f95ea0e7740 1 -- 172.21.15.70:0/2986371256 shutdown_connections 2024-09-21T05:49:51.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.587+0000 7f95ea0e7740 1 -- 172.21.15.70:0/2986371256 wait complete. 2024-09-21T05:49:51.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.588+0000 7f95ea0e7740 1 -- start start 2024-09-21T05:49:51.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.588+0000 7f95ea0e7740 1 Processor -- start 2024-09-21T05:49:51.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.588+0000 7f95ea0e7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e38a2ac0a0 0x55e38a69b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:51.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.588+0000 7f95ea0e7740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e38a2b4280 0x55e38a69b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:51.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.588+0000 7f95ea0e7740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e38a2d4f60 0x55e38a69baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:51.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.588+0000 7f95ea0e7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e38a698ae0 con 0x55e38a2ac0a0 2024-09-21T05:49:51.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.588+0000 7f95ea0e7740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e38a698410 con 0x55e38a2b4280 2024-09-21T05:49:51.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.588+0000 7f95ea0e7740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55e38a6991b0 con 0x55e38a2d4f60 2024-09-21T05:49:51.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.588+0000 7f95ea0e7740 10 client.0 _ll_register_callbacks cb 0x7f95d400ace0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:49:51.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.588+0000 7f95e190f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e38a2ac0a0 0x55e38a69b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:51.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.588+0000 7f95e190f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e38a2ac0a0 0x55e38a69b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35600/0 (socket says 172.21.15.70:35600) 2024-09-21T05:49:51.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.588+0000 7f95e190f640 1 -- 172.21.15.70:0/1706452360 learned_addr learned my addr 172.21.15.70:0/1706452360 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:51.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.589+0000 7f95e110e640 1 --2- 172.21.15.70:0/1706452360 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e38a2b4280 0x55e38a69b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:51.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.589+0000 7f95e2110640 1 --2- 172.21.15.70:0/1706452360 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e38a2d4f60 0x55e38a69baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:51.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.589+0000 7f95e190f640 1 -- 172.21.15.70:0/1706452360 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e38a2d4f60 msgr2=0x55e38a69baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:51.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.589+0000 7f95e190f640 1 --2- 172.21.15.70:0/1706452360 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e38a2d4f60 0x55e38a69baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.589+0000 7f95e190f640 1 -- 172.21.15.70:0/1706452360 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e38a2b4280 msgr2=0x55e38a69b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:51.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.589+0000 7f95e190f640 1 --2- 172.21.15.70:0/1706452360 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e38a2b4280 0x55e38a69b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.589+0000 7f95e190f640 1 -- 172.21.15.70:0/1706452360 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e38a6a0910 con 0x55e38a2ac0a0 2024-09-21T05:49:51.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.589+0000 7f95e110e640 1 --2- 172.21.15.70:0/1706452360 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e38a2b4280 0x55e38a69b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:51.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.589+0000 7f95e190f640 1 --2- 172.21.15.70:0/1706452360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e38a2ac0a0 0x55e38a69b020 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f95d80096c0 tx=0x7f95d8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18513eb39a9254fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:51.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.589+0000 7f95c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:49:51.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.589+0000 7f95c57fa640 1 -- 172.21.15.70:0/1706452360 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d8042070 con 0x55e38a2ac0a0 2024-09-21T05:49:51.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.589+0000 7f95c57fa640 1 -- 172.21.15.70:0/1706452360 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f95d8005020 con 0x55e38a2ac0a0 2024-09-21T05:49:51.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.589+0000 7f95ea0e7740 1 -- 172.21.15.70:0/1706452360 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95d4004a00 con 0x55e38a2ac0a0 2024-09-21T05:49:51.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.589+0000 7f95c57fa640 1 -- 172.21.15.70:0/1706452360 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f95d8064050 con 0x55e38a2ac0a0 2024-09-21T05:49:51.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.589+0000 7f95ea0e7740 10 client.15585 fetch_fsmap learned FSMap version 28 2024-09-21T05:49:51.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.589+0000 7f95ea0e7740 1 -- 172.21.15.70:0/1706452360 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e38a704510 con 0x55e38a2ac0a0 2024-09-21T05:49:51.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.590+0000 7f95c57fa640 1 -- 172.21.15.70:0/1706452360 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f95d4004a00 con 0x55e38a2ac0a0 2024-09-21T05:49:51.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.590+0000 7f95c57fa640 1 -- 172.21.15.70:0/1706452360 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f95d8058070 con 0x55e38a2ac0a0 2024-09-21T05:49:51.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.590+0000 7f95ea0e7740 10 client.15585 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T05:49:51.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.590+0000 7f95ea0e7740 10 client.15585 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T05:49:51.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.590+0000 7f95ea0e7740 20 client.15585 populate_metadata read hostname 'smithi070' 2024-09-21T05:49:51.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.590+0000 7f95ea0e7740 1 --2- 172.21.15.70:0/1706452360 >> [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] conn(0x55e38a268c90 0x55e38a707e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:51.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.590+0000 7f95ea0e7740 4 client.15585 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T05:49:51.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.590+0000 7f95ea0e7740 1 -- 172.21.15.70:0/1706452360 --> [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] -- command(tid 0: {"prefix": "status"}) -- 0x55e38a5f0610 con 0x55e38a268c90 2024-09-21T05:49:51.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.590+0000 7f95e110e640 1 --2- 172.21.15.70:0/1706452360 >> [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] conn(0x55e38a268c90 0x55e38a707e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:51.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.591+0000 7f95e110e640 1 --2- 172.21.15.70:0/1706452360 >> [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] conn(0x55e38a268c90 0x55e38a707e50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2f84763d04cc18ac server_cookie=bfd94e62a7f02399 in_seq=0 out_seq=0 2024-09-21T05:49:51.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.591+0000 7f95c57fa640 10 client.15585 ms_handle_connect on v2:172.21.15.160:6836/2558120045 2024-09-21T05:49:51.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.591+0000 7f95c57fa640 1 -- 172.21.15.70:0/1706452360 <== mds.3 v2:172.21.15.160:6836/2558120045 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55e38a5f0610 con 0x55e38a268c90 2024-09-21T05:49:51.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.591+0000 7f95c57fa640 10 client.15585 handle_command_reply: tid=0 2024-09-21T05:49:51.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.591+0000 7f95ea0e7740 1 client.15585 shutdown 2024-09-21T05:49:51.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.591+0000 7f95ea0e7740 1 -- 172.21.15.70:0/1706452360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e38a2ac0a0 msgr2=0x55e38a69b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:51.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.591+0000 7f95ea0e7740 1 --2- 172.21.15.70:0/1706452360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e38a2ac0a0 0x55e38a69b020 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f95d80096c0 tx=0x7f95d8009260 comp rx=0 tx=0).stop 2024-09-21T05:49:51.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.591+0000 7f95ea0e7740 1 -- 172.21.15.70:0/1706452360 shutdown_connections 2024-09-21T05:49:51.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.591+0000 7f95ea0e7740 1 --2- 172.21.15.70:0/1706452360 >> [v2:172.21.15.160:6836/2558120045,v1:172.21.15.160:6837/2558120045] conn(0x55e38a268c90 0x55e38a707e50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.591+0000 7f95ea0e7740 1 --2- 172.21.15.70:0/1706452360 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e38a2d4f60 0x55e38a69baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.591+0000 7f95ea0e7740 1 --2- 172.21.15.70:0/1706452360 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e38a2b4280 0x55e38a69b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.591+0000 7f95ea0e7740 1 --2- 172.21.15.70:0/1706452360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e38a2ac0a0 0x55e38a69b020 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.591+0000 7f95c57fa640 0 client.15585 ms_handle_reset on v2:172.21.15.160:6836/2558120045 2024-09-21T05:49:51.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.591+0000 7f95ea0e7740 1 -- 172.21.15.70:0/1706452360 >> 172.21.15.70:0/1706452360 conn(0x55e38a2c9350 msgr2=0x55e38a6869d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:51.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.591+0000 7f95ea0e7740 1 -- 172.21.15.70:0/1706452360 shutdown_connections 2024-09-21T05:49:51.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.592+0000 7f95ea0e7740 1 -- 172.21.15.70:0/1706452360 wait complete. 2024-09-21T05:49:51.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.592+0000 7f95ea0e7740 20 client.15585 trim_cache size 0 max 16384 2024-09-21T05:49:51.599 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:49:51.599 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "96c6636e-77db-11ef-baf5-efdc52797490", 2024-09-21T05:49:51.600 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 3, 2024-09-21T05:49:51.600 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24610, 2024-09-21T05:49:51.600 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-21T05:49:51.600 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-21T05:49:51.600 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-21T05:49:51.600 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 123.065707202, 2024-09-21T05:49:51.600 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 28, 2024-09-21T05:49:51.600 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 85, 2024-09-21T05:49:51.600 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 85, 2024-09-21T05:49:51.600 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 189.11286323300001 2024-09-21T05:49:51.600 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:49:51.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.592+0000 7f95e3b73640 1 -- 172.21.15.70:0/2307452615 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f95c80b65a0 msgr2=0x7f95c80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:51.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.592+0000 7f95e3b73640 1 --2- 172.21.15.70:0/2307452615 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f95c80b65a0 0x7f95c80b8ab0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f95d8000c00 tx=0x7f95d8005d50 comp rx=0 tx=0).stop 2024-09-21T05:49:51.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.592+0000 7f95e3b73640 1 -- 172.21.15.70:0/2307452615 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95dc105330 msgr2=0x7f95dc19aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:51.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.592+0000 7f95e3b73640 1 --2- 172.21.15.70:0/2307452615 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95dc105330 0x7f95dc19aaa0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f95cc00c970 tx=0x7f95cc00ce30 comp rx=0 tx=0).stop 2024-09-21T05:49:51.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.592+0000 7f95e3b73640 1 -- 172.21.15.70:0/2307452615 shutdown_connections 2024-09-21T05:49:51.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.592+0000 7f95e3b73640 1 --2- 172.21.15.70:0/2307452615 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f95c80b65a0 0x7f95c80b8ab0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.592+0000 7f95e3b73640 1 --2- 172.21.15.70:0/2307452615 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95dc10de40 0x7f95dc19fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.592+0000 7f95e3b73640 1 --2- 172.21.15.70:0/2307452615 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95dc105330 0x7f95dc19aaa0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.592+0000 7f95e3b73640 1 --2- 172.21.15.70:0/2307452615 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95dc1049e0 0x7f95dc19a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.592+0000 7f95e3b73640 1 -- 172.21.15.70:0/2307452615 >> 172.21.15.70:0/2307452615 conn(0x7f95dc079750 msgr2=0x7f95dc1008b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:51.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.592+0000 7f95e3b73640 1 -- 172.21.15.70:0/2307452615 shutdown_connections 2024-09-21T05:49:51.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:51.592+0000 7f95e3b73640 1 -- 172.21.15.70:0/2307452615 wait complete. 2024-09-21T05:49:52.409 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph tell mds.h status 2024-09-21T05:49:52.656 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:53.043 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:52 smithi070 ceph-mon[30981]: pgmap v382: 129 pgs: 129 active+clean; 659 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-21T05:49:53.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.130+0000 7f128b863640 1 -- 172.21.15.70:0/1606400663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1284102a80 msgr2=0x7f1284102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:53.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.130+0000 7f128b863640 1 --2- 172.21.15.70:0/1606400663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1284102a80 0x7f1284102e90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f1280009900 tx=0x7f128002a410 comp rx=0 tx=0).stop 2024-09-21T05:49:53.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.130+0000 7f128b863640 1 -- 172.21.15.70:0/1606400663 shutdown_connections 2024-09-21T05:49:53.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.130+0000 7f128b863640 1 --2- 172.21.15.70:0/1606400663 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12841083c0 0x7f12841087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.130+0000 7f128b863640 1 --2- 172.21.15.70:0/1606400663 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1284108d10 0x7f128410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.130+0000 7f128b863640 1 --2- 172.21.15.70:0/1606400663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1284102a80 0x7f1284102e90 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.130+0000 7f128b863640 1 -- 172.21.15.70:0/1606400663 >> 172.21.15.70:0/1606400663 conn(0x7f1284079740 msgr2=0x7f1284079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:53.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.131+0000 7f128b863640 1 -- 172.21.15.70:0/1606400663 shutdown_connections 2024-09-21T05:49:53.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.131+0000 7f128b863640 1 -- 172.21.15.70:0/1606400663 wait complete. 2024-09-21T05:49:53.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.131+0000 7f128b863640 1 Processor -- start 2024-09-21T05:49:53.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.131+0000 7f128b863640 1 -- start start 2024-09-21T05:49:53.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.132+0000 7f128b863640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1284102a80 0x7f1284199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:53.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.132+0000 7f128b863640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12841083c0 0x7f12841998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:53.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.132+0000 7f128b863640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1284108d10 0x7f128419eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:53.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.132+0000 7f128b863640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1284112950 con 0x7f12841083c0 2024-09-21T05:49:53.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.132+0000 7f128b863640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f12841127d0 con 0x7f1284108d10 2024-09-21T05:49:53.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.132+0000 7f128b863640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1284112ad0 con 0x7f1284102a80 2024-09-21T05:49:53.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.132+0000 7f1288dfe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12841083c0 0x7f12841998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:53.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.132+0000 7f1288dfe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12841083c0 0x7f12841998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35608/0 (socket says 172.21.15.70:35608) 2024-09-21T05:49:53.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.132+0000 7f1288dfe640 1 -- 172.21.15.70:0/587581654 learned_addr learned my addr 172.21.15.70:0/587581654 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:53.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.132+0000 7f12895ff640 1 --2- 172.21.15.70:0/587581654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1284102a80 0x7f1284199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:53.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.132+0000 7f1289e00640 1 --2- 172.21.15.70:0/587581654 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1284108d10 0x7f128419eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:53.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.132+0000 7f1288dfe640 1 -- 172.21.15.70:0/587581654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1284102a80 msgr2=0x7f1284199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:53.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.132+0000 7f1288dfe640 1 --2- 172.21.15.70:0/587581654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1284102a80 0x7f1284199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.132+0000 7f1288dfe640 1 -- 172.21.15.70:0/587581654 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1284108d10 msgr2=0x7f128419eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:53.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.132+0000 7f1288dfe640 1 --2- 172.21.15.70:0/587581654 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1284108d10 0x7f128419eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.132+0000 7f1288dfe640 1 -- 172.21.15.70:0/587581654 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f128419f1b0 con 0x7f12841083c0 2024-09-21T05:49:53.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.132+0000 7f1288dfe640 1 --2- 172.21.15.70:0/587581654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12841083c0 0x7f12841998a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f127400c970 tx=0x7f127400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:53.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.132+0000 7f127a7fc640 1 -- 172.21.15.70:0/587581654 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1274014070 con 0x7f12841083c0 2024-09-21T05:49:53.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.132+0000 7f127a7fc640 1 -- 172.21.15.70:0/587581654 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f1274004440 con 0x7f12841083c0 2024-09-21T05:49:53.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.133+0000 7f128b863640 1 -- 172.21.15.70:0/587581654 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f128419f4a0 con 0x7f12841083c0 2024-09-21T05:49:53.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.133+0000 7f127a7fc640 1 -- 172.21.15.70:0/587581654 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1274003d80 con 0x7f12841083c0 2024-09-21T05:49:53.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.133+0000 7f128b863640 1 -- 172.21.15.70:0/587581654 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f128406bb40 con 0x7f12841083c0 2024-09-21T05:49:53.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.135+0000 7f1291dd7740 1 Processor -- start 2024-09-21T05:49:53.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.135+0000 7f127a7fc640 1 -- 172.21.15.70:0/587581654 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) ==== 154563+0+0 (secure 0 0 0) 0x7f1274017070 con 0x7f12841083c0 2024-09-21T05:49:53.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.135+0000 7f1291dd7740 1 -- start start 2024-09-21T05:49:53.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.136+0000 7f1291dd7740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55906b3e5f60 0x55906b78bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:53.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.136+0000 7f1291dd7740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55906b3bd0a0 0x55906b78c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:53.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.136+0000 7f1291dd7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55906b3c5280 0x55906b78c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:53.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.136+0000 7f1291dd7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55906b703c10 con 0x55906b3c5280 2024-09-21T05:49:53.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.136+0000 7f1291dd7740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55906b6f3040 con 0x55906b3e5f60 2024-09-21T05:49:53.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.136+0000 7f1291dd7740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55906b6f6e50 con 0x55906b3bd0a0 2024-09-21T05:49:53.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.136+0000 7f1288dfe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55906b3c5280 0x55906b78c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:53.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.136+0000 7f1288dfe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55906b3c5280 0x55906b78c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35624/0 (socket says 172.21.15.70:35624) 2024-09-21T05:49:53.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.136+0000 7f1288dfe640 1 -- 172.21.15.70:0/2669999281 learned_addr learned my addr 172.21.15.70:0/2669999281 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:53.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.136+0000 7f12895ff640 1 --2- 172.21.15.70:0/2669999281 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55906b3bd0a0 0x55906b78c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:53.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.136+0000 7f1289e00640 1 --2- 172.21.15.70:0/2669999281 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55906b3e5f60 0x55906b78bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:53.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.136+0000 7f1288dfe640 1 -- 172.21.15.70:0/2669999281 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55906b3bd0a0 msgr2=0x55906b78c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:53.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.136+0000 7f1288dfe640 1 --2- 172.21.15.70:0/2669999281 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55906b3bd0a0 0x55906b78c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.136+0000 7f1288dfe640 1 -- 172.21.15.70:0/2669999281 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55906b3e5f60 msgr2=0x55906b78bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:53.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.136+0000 7f1288dfe640 1 --2- 172.21.15.70:0/2669999281 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55906b3e5f60 0x55906b78bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.136+0000 7f127a7fc640 1 --2- 172.21.15.70:0/587581654 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f12700b6650 0x7f12700b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:53.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.136+0000 7f1288dfe640 1 -- 172.21.15.70:0/2669999281 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55906b451540 con 0x55906b3c5280 2024-09-21T05:49:53.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.136+0000 7f1289e00640 1 --2- 172.21.15.70:0/2669999281 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55906b3e5f60 0x55906b78bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:53.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.137+0000 7f12895ff640 1 --2- 172.21.15.70:0/587581654 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f12700b6650 0x7f12700b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:53.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.137+0000 7f127a7fc640 1 -- 172.21.15.70:0/587581654 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f12740e7220 con 0x7f12841083c0 2024-09-21T05:49:53.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.137+0000 7f1288dfe640 1 --2- 172.21.15.70:0/2669999281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55906b3c5280 0x55906b78c980 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f12740e4720 tx=0x7f12740a94b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d85d46d9c63b7771 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:53.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.137+0000 7f126f7fe640 1 -- 172.21.15.70:0/2669999281 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12740acc30 con 0x55906b3c5280 2024-09-21T05:49:53.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.137+0000 7f126f7fe640 1 -- 172.21.15.70:0/2669999281 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f12740ad560 con 0x55906b3c5280 2024-09-21T05:49:53.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.137+0000 7f126f7fe640 1 -- 172.21.15.70:0/2669999281 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12740ac5d0 con 0x55906b3c5280 2024-09-21T05:49:53.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.138+0000 7f1291dd7740 1 -- 172.21.15.70:0/2669999281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55906b3c5280 msgr2=0x55906b78c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:53.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.138+0000 7f12895ff640 1 --2- 172.21.15.70:0/587581654 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f12700b6650 0x7f12700b8b60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1280005d90 tx=0x7f1280032ad0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:53.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.138+0000 7f1291dd7740 1 --2- 172.21.15.70:0/2669999281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55906b3c5280 0x55906b78c980 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f12740e4720 tx=0x7f12740a94b0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.138+0000 7f1291dd7740 1 -- 172.21.15.70:0/2669999281 shutdown_connections 2024-09-21T05:49:53.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.138+0000 7f1291dd7740 1 --2- 172.21.15.70:0/2669999281 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55906b3bd0a0 0x55906b78c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.138+0000 7f1291dd7740 1 --2- 172.21.15.70:0/2669999281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55906b3c5280 0x55906b78c980 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.138+0000 7f1291dd7740 1 --2- 172.21.15.70:0/2669999281 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55906b3e5f60 0x55906b78bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.138+0000 7f1291dd7740 1 -- 172.21.15.70:0/2669999281 >> 172.21.15.70:0/2669999281 conn(0x55906b3da350 msgr2=0x55906b789df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:53.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.138+0000 7f1291dd7740 1 -- 172.21.15.70:0/2669999281 shutdown_connections 2024-09-21T05:49:53.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.138+0000 7f1291dd7740 1 -- 172.21.15.70:0/2669999281 wait complete. 2024-09-21T05:49:53.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.138+0000 7f1291dd7740 1 -- start start 2024-09-21T05:49:53.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.138+0000 7f1291dd7740 1 Processor -- start 2024-09-21T05:49:53.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.139+0000 7f1291dd7740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55906b3bd0a0 0x55906b7979b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:53.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.139+0000 7f1291dd7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55906b3c5280 0x55906b797ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:53.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.139+0000 7f1291dd7740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55906b3e5f60 0x55906b7a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:53.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.139+0000 7f1291dd7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55906b5545f0 con 0x55906b3c5280 2024-09-21T05:49:53.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.139+0000 7f1291dd7740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55906b68e010 con 0x55906b3bd0a0 2024-09-21T05:49:53.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.139+0000 7f1291dd7740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55906b79a6e0 con 0x55906b3e5f60 2024-09-21T05:49:53.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.139+0000 7f1288dfe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55906b3c5280 0x55906b797ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:53.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.139+0000 7f1291dd7740 10 client.0 _ll_register_callbacks cb 0x55906b6ed340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:49:53.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.139+0000 7f1288dfe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55906b3c5280 0x55906b797ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35626/0 (socket says 172.21.15.70:35626) 2024-09-21T05:49:53.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.139+0000 7f1288dfe640 1 -- 172.21.15.70:0/3680134336 learned_addr learned my addr 172.21.15.70:0/3680134336 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:53.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.139+0000 7f1289e00640 1 --2- 172.21.15.70:0/3680134336 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55906b3e5f60 0x55906b7a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:53.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.139+0000 7f12895ff640 1 --2- 172.21.15.70:0/3680134336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55906b3bd0a0 0x55906b7979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:53.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.140+0000 7f1288dfe640 1 -- 172.21.15.70:0/3680134336 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55906b3e5f60 msgr2=0x55906b7a39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:53.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.140+0000 7f1288dfe640 1 --2- 172.21.15.70:0/3680134336 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55906b3e5f60 0x55906b7a39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.140+0000 7f1288dfe640 1 -- 172.21.15.70:0/3680134336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55906b3bd0a0 msgr2=0x55906b7979b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:53.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.140+0000 7f1288dfe640 1 --2- 172.21.15.70:0/3680134336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55906b3bd0a0 0x55906b7979b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.140+0000 7f1288dfe640 1 -- 172.21.15.70:0/3680134336 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55906b6bba00 con 0x55906b3c5280 2024-09-21T05:49:53.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.140+0000 7f1289e00640 1 --2- 172.21.15.70:0/3680134336 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55906b3e5f60 0x55906b7a39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:53.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.140+0000 7f1288dfe640 1 --2- 172.21.15.70:0/3680134336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55906b3c5280 0x55906b797ef0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f12740a9430 tx=0x7f127400af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d341e615cb7d89 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:53.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.140+0000 7f126cff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:49:53.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.140+0000 7f126cff9640 1 -- 172.21.15.70:0/3680134336 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12740ac7b0 con 0x55906b3c5280 2024-09-21T05:49:53.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.140+0000 7f1291dd7740 1 -- 172.21.15.70:0/3680134336 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12740ad560 con 0x55906b3c5280 2024-09-21T05:49:53.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.140+0000 7f126cff9640 1 -- 172.21.15.70:0/3680134336 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f1274094110 con 0x55906b3c5280 2024-09-21T05:49:53.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.140+0000 7f126cff9640 1 -- 172.21.15.70:0/3680134336 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f12740ac9a0 con 0x55906b3c5280 2024-09-21T05:49:53.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.140+0000 7f1291dd7740 10 client.15597 fetch_fsmap learned FSMap version 28 2024-09-21T05:49:53.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.140+0000 7f1291dd7740 1 -- 172.21.15.70:0/3680134336 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55906b7a65e0 con 0x55906b3c5280 2024-09-21T05:49:53.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.140+0000 7f126cff9640 1 -- 172.21.15.70:0/3680134336 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f12740ad560 con 0x55906b3c5280 2024-09-21T05:49:53.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.140+0000 7f126cff9640 1 -- 172.21.15.70:0/3680134336 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f1274098020 con 0x55906b3c5280 2024-09-21T05:49:53.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.141+0000 7f1291dd7740 10 client.15597 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T05:49:53.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.141+0000 7f1291dd7740 10 client.15597 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T05:49:53.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.141+0000 7f1291dd7740 20 client.15597 populate_metadata read hostname 'smithi070' 2024-09-21T05:49:53.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.141+0000 7f1291dd7740 1 --2- 172.21.15.70:0/3680134336 >> [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] conn(0x55906b3a48e0 0x55906b7a9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:53.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.141+0000 7f1291dd7740 4 client.15597 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:49:53.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.141+0000 7f1291dd7740 1 -- 172.21.15.70:0/3680134336 --> [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55906b705b60 con 0x55906b3a48e0 2024-09-21T05:49:53.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.141+0000 7f12895ff640 1 --2- 172.21.15.70:0/3680134336 >> [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] conn(0x55906b3a48e0 0x55906b7a9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:53.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.141+0000 7f12895ff640 1 --2- 172.21.15.70:0/3680134336 >> [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] conn(0x55906b3a48e0 0x55906b7a9a80 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=81eda07927d09ecb server_cookie=af1948c78d8fe0f7 in_seq=0 out_seq=0 2024-09-21T05:49:53.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.141+0000 7f126cff9640 10 client.15597 ms_handle_connect on v2:172.21.15.116:6836/444312934 2024-09-21T05:49:53.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.142+0000 7f126cff9640 1 -- 172.21.15.70:0/3680134336 <== mds.2 v2:172.21.15.116:6836/444312934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55906b705b60 con 0x55906b3a48e0 2024-09-21T05:49:53.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.142+0000 7f126cff9640 10 client.15597 handle_command_reply: tid=0 2024-09-21T05:49:53.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.142+0000 7f1291dd7740 1 client.15597 shutdown 2024-09-21T05:49:53.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.142+0000 7f1291dd7740 1 -- 172.21.15.70:0/3680134336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55906b3c5280 msgr2=0x55906b797ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:53.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.142+0000 7f1291dd7740 1 --2- 172.21.15.70:0/3680134336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55906b3c5280 0x55906b797ef0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f12740a9430 tx=0x7f127400af70 comp rx=0 tx=0).stop 2024-09-21T05:49:53.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.142+0000 7f1291dd7740 1 -- 172.21.15.70:0/3680134336 shutdown_connections 2024-09-21T05:49:53.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.142+0000 7f1291dd7740 1 --2- 172.21.15.70:0/3680134336 >> [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] conn(0x55906b3a48e0 0x55906b7a9a80 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.142+0000 7f1291dd7740 1 --2- 172.21.15.70:0/3680134336 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55906b3e5f60 0x55906b7a39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.142+0000 7f1291dd7740 1 --2- 172.21.15.70:0/3680134336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55906b3c5280 0x55906b797ef0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.142+0000 7f1291dd7740 1 --2- 172.21.15.70:0/3680134336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55906b3bd0a0 0x55906b7979b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.142+0000 7f1291dd7740 1 -- 172.21.15.70:0/3680134336 >> 172.21.15.70:0/3680134336 conn(0x55906b3da350 msgr2=0x55906b78f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:53.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.142+0000 7f126cff9640 0 client.15597 ms_handle_reset on v2:172.21.15.116:6836/444312934 2024-09-21T05:49:53.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.143+0000 7f1291dd7740 1 -- 172.21.15.70:0/3680134336 shutdown_connections 2024-09-21T05:49:53.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.143+0000 7f1291dd7740 1 -- 172.21.15.70:0/3680134336 wait complete. 2024-09-21T05:49:53.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.143+0000 7f1291dd7740 20 client.15597 trim_cache size 0 max 16384 2024-09-21T05:49:53.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.160+0000 7f1291dd7740 1 Processor -- start 2024-09-21T05:49:53.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.160+0000 7f1291dd7740 1 -- start start 2024-09-21T05:49:53.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.161+0000 7f1291dd7740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55906b3bd0a0 0x55906b7a3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:53.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.161+0000 7f1291dd7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55906b3c5280 0x55906b7a3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:53.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.161+0000 7f1291dd7740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55906b3e5f60 0x55906b789600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:53.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.161+0000 7f1291dd7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55906b7a7dc0 con 0x55906b3c5280 2024-09-21T05:49:53.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.161+0000 7f1291dd7740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55906b7a8490 con 0x55906b3e5f60 2024-09-21T05:49:53.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.161+0000 7f1291dd7740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55906b7a8b60 con 0x55906b3bd0a0 2024-09-21T05:49:53.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.161+0000 7f1288dfe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55906b3c5280 0x55906b7a3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:53.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.161+0000 7f1288dfe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55906b3c5280 0x55906b7a3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35636/0 (socket says 172.21.15.70:35636) 2024-09-21T05:49:53.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.161+0000 7f1288dfe640 1 -- 172.21.15.70:0/1928625053 learned_addr learned my addr 172.21.15.70:0/1928625053 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:53.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.161+0000 7f12895ff640 1 --2- 172.21.15.70:0/1928625053 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55906b3bd0a0 0x55906b7a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:53.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.161+0000 7f1289e00640 1 --2- 172.21.15.70:0/1928625053 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55906b3e5f60 0x55906b789600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:53.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.161+0000 7f1288dfe640 1 -- 172.21.15.70:0/1928625053 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55906b3bd0a0 msgr2=0x55906b7a3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:53.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.161+0000 7f1288dfe640 1 --2- 172.21.15.70:0/1928625053 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55906b3bd0a0 0x55906b7a3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.161+0000 7f1288dfe640 1 -- 172.21.15.70:0/1928625053 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55906b3e5f60 msgr2=0x55906b789600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:53.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.161+0000 7f1288dfe640 1 --2- 172.21.15.70:0/1928625053 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55906b3e5f60 0x55906b789600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.161+0000 7f1288dfe640 1 -- 172.21.15.70:0/1928625053 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55906b7a4900 con 0x55906b3c5280 2024-09-21T05:49:53.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.161+0000 7f1288dfe640 1 --2- 172.21.15.70:0/1928625053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55906b3c5280 0x55906b7a3e80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f12740acdf0 tx=0x7f12740e71b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5fae4e77dac6fde server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:53.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.162+0000 7f126effd640 1 -- 172.21.15.70:0/1928625053 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12740ee070 con 0x55906b3c5280 2024-09-21T05:49:53.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.162+0000 7f126effd640 1 -- 172.21.15.70:0/1928625053 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f12740ad560 con 0x55906b3c5280 2024-09-21T05:49:53.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.162+0000 7f126effd640 1 -- 172.21.15.70:0/1928625053 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12740eae60 con 0x55906b3c5280 2024-09-21T05:49:53.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.162+0000 7f1291dd7740 1 -- 172.21.15.70:0/1928625053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55906b3c5280 msgr2=0x55906b7a3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:53.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.162+0000 7f1291dd7740 1 --2- 172.21.15.70:0/1928625053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55906b3c5280 0x55906b7a3e80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f12740acdf0 tx=0x7f12740e71b0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.162+0000 7f1291dd7740 1 -- 172.21.15.70:0/1928625053 shutdown_connections 2024-09-21T05:49:53.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.163+0000 7f1291dd7740 1 --2- 172.21.15.70:0/1928625053 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55906b3e5f60 0x55906b789600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.163+0000 7f1291dd7740 1 --2- 172.21.15.70:0/1928625053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55906b3c5280 0x55906b7a3e80 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.163+0000 7f1291dd7740 1 --2- 172.21.15.70:0/1928625053 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55906b3bd0a0 0x55906b7a3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.163+0000 7f1291dd7740 1 -- 172.21.15.70:0/1928625053 >> 172.21.15.70:0/1928625053 conn(0x55906b3da350 msgr2=0x55906b797990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:53.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.163+0000 7f1291dd7740 1 -- 172.21.15.70:0/1928625053 shutdown_connections 2024-09-21T05:49:53.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.163+0000 7f1291dd7740 1 -- 172.21.15.70:0/1928625053 wait complete. 2024-09-21T05:49:53.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.163+0000 7f1291dd7740 1 -- start start 2024-09-21T05:49:53.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.163+0000 7f1291dd7740 1 Processor -- start 2024-09-21T05:49:53.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.163+0000 7f1291dd7740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55906b3bd0a0 0x55906b7b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:53.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.163+0000 7f1291dd7740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55906b3c5280 0x55906b7b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:53.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.163+0000 7f1291dd7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55906b3e5f60 0x55906b7ab470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:53.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.163+0000 7f1291dd7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55906b7a9900 con 0x55906b3e5f60 2024-09-21T05:49:53.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.163+0000 7f1291dd7740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55906b7a9230 con 0x55906b3c5280 2024-09-21T05:49:53.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.163+0000 7f1291dd7740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55906b7a9fd0 con 0x55906b3bd0a0 2024-09-21T05:49:53.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.163+0000 7f1291dd7740 10 client.0 _ll_register_callbacks cb 0x7f1280009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:49:53.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.164+0000 7f1289e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55906b3e5f60 0x55906b7ab470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:53.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.164+0000 7f1289e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55906b3e5f60 0x55906b7ab470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35652/0 (socket says 172.21.15.70:35652) 2024-09-21T05:49:53.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.164+0000 7f1289e00640 1 -- 172.21.15.70:0/2167723284 learned_addr learned my addr 172.21.15.70:0/2167723284 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:53.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.164+0000 7f1288dfe640 1 --2- 172.21.15.70:0/2167723284 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55906b3c5280 0x55906b7b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:53.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.164+0000 7f12895ff640 1 --2- 172.21.15.70:0/2167723284 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55906b3bd0a0 0x55906b7b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:53.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.164+0000 7f1289e00640 1 -- 172.21.15.70:0/2167723284 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55906b3bd0a0 msgr2=0x55906b7b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:53.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.164+0000 7f1289e00640 1 --2- 172.21.15.70:0/2167723284 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55906b3bd0a0 0x55906b7b1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.164+0000 7f1289e00640 1 -- 172.21.15.70:0/2167723284 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55906b3c5280 msgr2=0x55906b7b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:53.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.164+0000 7f1289e00640 1 --2- 172.21.15.70:0/2167723284 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55906b3c5280 0x55906b7b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.164+0000 7f1289e00640 1 -- 172.21.15.70:0/2167723284 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55906b7abc00 con 0x55906b3e5f60 2024-09-21T05:49:53.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.164+0000 7f1288dfe640 1 --2- 172.21.15.70:0/2167723284 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55906b3c5280 0x55906b7b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:49:53.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.164+0000 7f1289e00640 1 --2- 172.21.15.70:0/2167723284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55906b3e5f60 0x55906b7ab470 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f127c010ee0 tx=0x7f127c00f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c15dbd4cdd1f638 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:53.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.164+0000 7f126cff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:49:53.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.164+0000 7f126cff9640 1 -- 172.21.15.70:0/2167723284 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127c020060 con 0x55906b3e5f60 2024-09-21T05:49:53.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.164+0000 7f1291dd7740 1 -- 172.21.15.70:0/2167723284 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12740ad560 con 0x55906b3e5f60 2024-09-21T05:49:53.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.164+0000 7f126cff9640 1 -- 172.21.15.70:0/2167723284 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f127c01b3f0 con 0x55906b3e5f60 2024-09-21T05:49:53.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.164+0000 7f126cff9640 1 -- 172.21.15.70:0/2167723284 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f127c027050 con 0x55906b3e5f60 2024-09-21T05:49:53.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.164+0000 7f1291dd7740 10 client.15603 fetch_fsmap learned FSMap version 28 2024-09-21T05:49:53.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.165+0000 7f1291dd7740 1 -- 172.21.15.70:0/2167723284 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55906b7b1690 con 0x55906b3e5f60 2024-09-21T05:49:53.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.165+0000 7f126cff9640 1 -- 172.21.15.70:0/2167723284 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f12740ad560 con 0x55906b3e5f60 2024-09-21T05:49:53.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.165+0000 7f126cff9640 1 -- 172.21.15.70:0/2167723284 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f127c01a030 con 0x55906b3e5f60 2024-09-21T05:49:53.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.165+0000 7f1291dd7740 10 client.15603 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T05:49:53.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.165+0000 7f1291dd7740 10 client.15603 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T05:49:53.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.165+0000 7f1291dd7740 20 client.15603 populate_metadata read hostname 'smithi070' 2024-09-21T05:49:53.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.165+0000 7f1291dd7740 1 --2- 172.21.15.70:0/2167723284 >> [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] conn(0x55906b379c90 0x55906b818320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:53.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.165+0000 7f1291dd7740 4 client.15603 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T05:49:53.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.165+0000 7f1291dd7740 1 -- 172.21.15.70:0/2167723284 --> [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] -- command(tid 0: {"prefix": "status"}) -- 0x55906b701610 con 0x55906b379c90 2024-09-21T05:49:53.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.165+0000 7f12895ff640 1 --2- 172.21.15.70:0/2167723284 >> [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] conn(0x55906b379c90 0x55906b818320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:53.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.166+0000 7f12895ff640 1 --2- 172.21.15.70:0/2167723284 >> [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] conn(0x55906b379c90 0x55906b818320 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d9ad568f9f6a2566 server_cookie=181d6139013e9fdd in_seq=0 out_seq=0 2024-09-21T05:49:53.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.166+0000 7f126cff9640 10 client.15603 ms_handle_connect on v2:172.21.15.116:6836/444312934 2024-09-21T05:49:53.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.166+0000 7f126cff9640 1 -- 172.21.15.70:0/2167723284 <== mds.2 v2:172.21.15.116:6836/444312934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55906b701610 con 0x55906b379c90 2024-09-21T05:49:53.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.166+0000 7f126cff9640 10 client.15603 handle_command_reply: tid=0 2024-09-21T05:49:53.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.166+0000 7f1291dd7740 1 client.15603 shutdown 2024-09-21T05:49:53.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.166+0000 7f1291dd7740 1 -- 172.21.15.70:0/2167723284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55906b3e5f60 msgr2=0x55906b7ab470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:53.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.166+0000 7f1291dd7740 1 --2- 172.21.15.70:0/2167723284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55906b3e5f60 0x55906b7ab470 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f127c010ee0 tx=0x7f127c00f7f0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.166+0000 7f1291dd7740 1 -- 172.21.15.70:0/2167723284 shutdown_connections 2024-09-21T05:49:53.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.166+0000 7f1291dd7740 1 --2- 172.21.15.70:0/2167723284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55906b3e5f60 0x55906b7ab470 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.166+0000 7f1291dd7740 1 --2- 172.21.15.70:0/2167723284 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55906b3c5280 0x55906b7b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.166+0000 7f1291dd7740 1 --2- 172.21.15.70:0/2167723284 >> [v2:172.21.15.116:6836/444312934,v1:172.21.15.116:6837/444312934] conn(0x55906b379c90 0x55906b818320 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.166+0000 7f1291dd7740 1 --2- 172.21.15.70:0/2167723284 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55906b3bd0a0 0x55906b7b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.166+0000 7f1291dd7740 1 -- 172.21.15.70:0/2167723284 >> 172.21.15.70:0/2167723284 conn(0x55906b3da350 msgr2=0x55906b789600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:53.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.166+0000 7f126cff9640 0 client.15603 ms_handle_reset on v2:172.21.15.116:6836/444312934 2024-09-21T05:49:53.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.166+0000 7f1291dd7740 1 -- 172.21.15.70:0/2167723284 shutdown_connections 2024-09-21T05:49:53.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.166+0000 7f1291dd7740 1 -- 172.21.15.70:0/2167723284 wait complete. 2024-09-21T05:49:53.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.166+0000 7f1291dd7740 20 client.15603 trim_cache size 0 max 16384 2024-09-21T05:49:53.174 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:49:53.174 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "96c6636e-77db-11ef-baf5-efdc52797490", 2024-09-21T05:49:53.175 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 2, 2024-09-21T05:49:53.175 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24611, 2024-09-21T05:49:53.175 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-21T05:49:53.175 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-21T05:49:53.175 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-21T05:49:53.175 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 125.649606289, 2024-09-21T05:49:53.175 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 28, 2024-09-21T05:49:53.175 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 85, 2024-09-21T05:49:53.175 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 85, 2024-09-21T05:49:53.175 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 188.05750995700001 2024-09-21T05:49:53.175 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:49:53.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.167+0000 7f128b863640 1 -- 172.21.15.70:0/587581654 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f12700b6650 msgr2=0x7f12700b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:53.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.167+0000 7f128b863640 1 --2- 172.21.15.70:0/587581654 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f12700b6650 0x7f12700b8b60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1280005d90 tx=0x7f1280032ad0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.167+0000 7f128b863640 1 -- 172.21.15.70:0/587581654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12841083c0 msgr2=0x7f12841998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:53.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.167+0000 7f128b863640 1 --2- 172.21.15.70:0/587581654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12841083c0 0x7f12841998a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f127400c970 tx=0x7f127400ce30 comp rx=0 tx=0).stop 2024-09-21T05:49:53.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.167+0000 7f128b863640 1 -- 172.21.15.70:0/587581654 shutdown_connections 2024-09-21T05:49:53.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.167+0000 7f128b863640 1 --2- 172.21.15.70:0/587581654 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f12700b6650 0x7f12700b8b60 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.167+0000 7f128b863640 1 --2- 172.21.15.70:0/587581654 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1284108d10 0x7f128419eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.167+0000 7f128b863640 1 --2- 172.21.15.70:0/587581654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12841083c0 0x7f12841998a0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.167+0000 7f128b863640 1 --2- 172.21.15.70:0/587581654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1284102a80 0x7f1284199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.167+0000 7f128b863640 1 -- 172.21.15.70:0/587581654 >> 172.21.15.70:0/587581654 conn(0x7f1284079740 msgr2=0x7f1284101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:53.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.167+0000 7f128b863640 1 -- 172.21.15.70:0/587581654 shutdown_connections 2024-09-21T05:49:53.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:53.167+0000 7f128b863640 1 -- 172.21.15.70:0/587581654 wait complete. 2024-09-21T05:49:53.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:52 smithi116 ceph-mon[34332]: pgmap v382: 129 pgs: 129 active+clean; 659 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-21T05:49:53.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:52 smithi160 ceph-mon[33979]: pgmap v382: 129 pgs: 129 active+clean; 659 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-21T05:49:53.850 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T05:49:54.097 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:54.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.599+0000 7f25098e1640 1 -- 172.21.15.70:0/1831086769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2504102ab0 msgr2=0x7f2504102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:54.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.599+0000 7f25098e1640 1 --2- 172.21.15.70:0/1831086769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2504102ab0 0x7f2504102ec0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009900 tx=0x7f24f402a410 comp rx=0 tx=0).stop 2024-09-21T05:49:54.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.599+0000 7f25098e1640 1 -- 172.21.15.70:0/1831086769 shutdown_connections 2024-09-21T05:49:54.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.599+0000 7f25098e1640 1 --2- 172.21.15.70:0/1831086769 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25041083f0 0x7f2504108800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.599+0000 7f25098e1640 1 --2- 172.21.15.70:0/1831086769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2504108d40 0x7f250410f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.599+0000 7f25098e1640 1 --2- 172.21.15.70:0/1831086769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2504102ab0 0x7f2504102ec0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.599+0000 7f25098e1640 1 -- 172.21.15.70:0/1831086769 >> 172.21.15.70:0/1831086769 conn(0x7f25040796b0 msgr2=0x7f2504079ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:54.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.599+0000 7f25098e1640 1 -- 172.21.15.70:0/1831086769 shutdown_connections 2024-09-21T05:49:54.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.599+0000 7f25098e1640 1 -- 172.21.15.70:0/1831086769 wait complete. 2024-09-21T05:49:54.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.600+0000 7f25098e1640 1 Processor -- start 2024-09-21T05:49:54.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.600+0000 7f25098e1640 1 -- start start 2024-09-21T05:49:54.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.600+0000 7f25098e1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2504102ab0 0x7f250419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:54.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.600+0000 7f25098e1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25041083f0 0x7f250419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:54.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.600+0000 7f25098e1640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2504108d40 0x7f250419fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:54.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.600+0000 7f25098e1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2504112980 con 0x7f2504102ab0 2024-09-21T05:49:54.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.600+0000 7f25098e1640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2504112800 con 0x7f25041083f0 2024-09-21T05:49:54.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.600+0000 7f25098e1640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2504112b00 con 0x7f2504108d40 2024-09-21T05:49:54.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.601+0000 7f2502ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2504102ab0 0x7f250419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:54.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.601+0000 7f2502ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2504102ab0 0x7f250419a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35670/0 (socket says 172.21.15.70:35670) 2024-09-21T05:49:54.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.601+0000 7f2502ffd640 1 -- 172.21.15.70:0/3223918764 learned_addr learned my addr 172.21.15.70:0/3223918764 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:54.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.601+0000 7f25027fc640 1 --2- 172.21.15.70:0/3223918764 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25041083f0 0x7f250419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:54.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.601+0000 7f25037fe640 1 --2- 172.21.15.70:0/3223918764 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2504108d40 0x7f250419fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:54.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.601+0000 7f2502ffd640 1 -- 172.21.15.70:0/3223918764 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2504108d40 msgr2=0x7f250419fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:54.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.601+0000 7f2502ffd640 1 --2- 172.21.15.70:0/3223918764 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2504108d40 0x7f250419fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.601+0000 7f2502ffd640 1 -- 172.21.15.70:0/3223918764 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25041083f0 msgr2=0x7f250419aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:54.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.601+0000 7f2502ffd640 1 --2- 172.21.15.70:0/3223918764 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25041083f0 0x7f250419aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.601+0000 7f2502ffd640 1 -- 172.21.15.70:0/3223918764 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25041a0310 con 0x7f2504102ab0 2024-09-21T05:49:54.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.601+0000 7f2502ffd640 1 --2- 172.21.15.70:0/3223918764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2504102ab0 0x7f250419a460 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f24f4005940 tx=0x7f24f40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:54.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.601+0000 7f25088df640 1 -- 172.21.15.70:0/3223918764 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f403f030 con 0x7f2504102ab0 2024-09-21T05:49:54.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.601+0000 7f25098e1640 1 -- 172.21.15.70:0/3223918764 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25041a05a0 con 0x7f2504102ab0 2024-09-21T05:49:54.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.601+0000 7f25088df640 1 -- 172.21.15.70:0/3223918764 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f24f4003cb0 con 0x7f2504102ab0 2024-09-21T05:49:54.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.601+0000 7f25088df640 1 -- 172.21.15.70:0/3223918764 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f4035070 con 0x7f2504102ab0 2024-09-21T05:49:54.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.601+0000 7f25098e1640 1 -- 172.21.15.70:0/3223918764 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25041a0ad0 con 0x7f2504102ab0 2024-09-21T05:49:54.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.604+0000 7f250fe55740 1 Processor -- start 2024-09-21T05:49:54.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.604+0000 7f250fe55740 1 -- start start 2024-09-21T05:49:54.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.604+0000 7f25088df640 1 -- 172.21.15.70:0/3223918764 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) ==== 154563+0+0 (secure 0 0 0) 0x7f24f4042030 con 0x7f2504102ab0 2024-09-21T05:49:54.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.604+0000 7f250fe55740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a858e87f60 0x55a85922df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:54.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.604+0000 7f250fe55740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a858e5f0a0 0x55a85922e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:54.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.604+0000 7f250fe55740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a858e67280 0x55a85922e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:54.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.604+0000 7f250fe55740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a8591a5c10 con 0x55a858e67280 2024-09-21T05:49:54.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.604+0000 7f250fe55740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a859195040 con 0x55a858e87f60 2024-09-21T05:49:54.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.604+0000 7f250fe55740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55a859198e50 con 0x55a858e5f0a0 2024-09-21T05:49:54.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.604+0000 7f25027fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a858e67280 0x55a85922e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:54.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.604+0000 7f25027fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a858e67280 0x55a85922e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35672/0 (socket says 172.21.15.70:35672) 2024-09-21T05:49:54.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.604+0000 7f25027fc640 1 -- 172.21.15.70:0/1970653540 learned_addr learned my addr 172.21.15.70:0/1970653540 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:54.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.604+0000 7f2502ffd640 1 --2- 172.21.15.70:0/1970653540 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a858e5f0a0 0x55a85922e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:54.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.604+0000 7f25037fe640 1 --2- 172.21.15.70:0/1970653540 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a858e87f60 0x55a85922df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:54.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.605+0000 7f25027fc640 1 -- 172.21.15.70:0/1970653540 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a858e5f0a0 msgr2=0x55a85922e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:54.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.605+0000 7f25027fc640 1 --2- 172.21.15.70:0/1970653540 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a858e5f0a0 0x55a85922e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.605+0000 7f25027fc640 1 -- 172.21.15.70:0/1970653540 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a858e87f60 msgr2=0x55a85922df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:54.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.605+0000 7f25027fc640 1 --2- 172.21.15.70:0/1970653540 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a858e87f60 0x55a85922df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.605+0000 7f25027fc640 1 -- 172.21.15.70:0/1970653540 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a858ef3540 con 0x55a858e67280 2024-09-21T05:49:54.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.605+0000 7f25037fe640 1 --2- 172.21.15.70:0/1970653540 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a858e87f60 0x55a85922df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:54.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.605+0000 7f25088df640 1 --2- 172.21.15.70:0/3223918764 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f24ec0b65d0 0x7f24ec0b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:54.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.605+0000 7f25027fc640 1 --2- 172.21.15.70:0/1970653540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a858e67280 0x55a85922e980 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f24f800ac70 tx=0x7f24f800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4349dd843fb5dfc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:54.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.605+0000 7f25037fe640 1 --2- 172.21.15.70:0/3223918764 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f24ec0b65d0 0x7f24ec0b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:54.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.605+0000 7f25088df640 1 -- 172.21.15.70:0/3223918764 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f24f4107e30 con 0x7f2504102ab0 2024-09-21T05:49:54.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.605+0000 7f24e9ffb640 1 -- 172.21.15.70:0/1970653540 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f801d070 con 0x55a858e67280 2024-09-21T05:49:54.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.605+0000 7f24e9ffb640 1 -- 172.21.15.70:0/1970653540 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f24f8018af0 con 0x55a858e67280 2024-09-21T05:49:54.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.605+0000 7f24e9ffb640 1 -- 172.21.15.70:0/1970653540 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f8010b80 con 0x55a858e67280 2024-09-21T05:49:54.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.606+0000 7f250fe55740 1 -- 172.21.15.70:0/1970653540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a858e67280 msgr2=0x55a85922e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:54.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.606+0000 7f250fe55740 1 --2- 172.21.15.70:0/1970653540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a858e67280 0x55a85922e980 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f24f800ac70 tx=0x7f24f800f790 comp rx=0 tx=0).stop 2024-09-21T05:49:54.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.606+0000 7f25037fe640 1 --2- 172.21.15.70:0/3223918764 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f24ec0b65d0 0x7f24ec0b8ae0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f24fc005fd0 tx=0x7f24fc009580 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:54.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.606+0000 7f250fe55740 1 -- 172.21.15.70:0/1970653540 shutdown_connections 2024-09-21T05:49:54.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.606+0000 7f250fe55740 1 --2- 172.21.15.70:0/1970653540 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a858e5f0a0 0x55a85922e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.606+0000 7f250fe55740 1 --2- 172.21.15.70:0/1970653540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a858e67280 0x55a85922e980 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.606+0000 7f250fe55740 1 --2- 172.21.15.70:0/1970653540 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a858e87f60 0x55a85922df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.606+0000 7f250fe55740 1 -- 172.21.15.70:0/1970653540 >> 172.21.15.70:0/1970653540 conn(0x55a858e7c350 msgr2=0x55a85922bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:54.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.606+0000 7f250fe55740 1 -- 172.21.15.70:0/1970653540 shutdown_connections 2024-09-21T05:49:54.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.606+0000 7f250fe55740 1 -- 172.21.15.70:0/1970653540 wait complete. 2024-09-21T05:49:54.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.606+0000 7f250fe55740 1 -- start start 2024-09-21T05:49:54.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.607+0000 7f250fe55740 1 Processor -- start 2024-09-21T05:49:54.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.607+0000 7f250fe55740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a858e5f0a0 0x55a859239a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:54.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.607+0000 7f250fe55740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a858e67280 0x55a859239f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:54.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.607+0000 7f250fe55740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a858e87f60 0x55a8592459d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:54.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.607+0000 7f250fe55740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a858ff65f0 con 0x55a858e67280 2024-09-21T05:49:54.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.607+0000 7f250fe55740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a859130010 con 0x55a858e5f0a0 2024-09-21T05:49:54.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.607+0000 7f250fe55740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55a85923c6e0 con 0x55a858e87f60 2024-09-21T05:49:54.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.607+0000 7f250fe55740 10 client.0 _ll_register_callbacks cb 0x55a85918f340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:49:54.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.607+0000 7f25027fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a858e67280 0x55a859239f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:54.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.607+0000 7f25027fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a858e67280 0x55a859239f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35686/0 (socket says 172.21.15.70:35686) 2024-09-21T05:49:54.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.607+0000 7f25027fc640 1 -- 172.21.15.70:0/3109574136 learned_addr learned my addr 172.21.15.70:0/3109574136 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:54.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.607+0000 7f2502ffd640 1 --2- 172.21.15.70:0/3109574136 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a858e5f0a0 0x55a859239a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:54.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.607+0000 7f25037fe640 1 --2- 172.21.15.70:0/3109574136 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a858e87f60 0x55a8592459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:54.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.607+0000 7f25027fc640 1 -- 172.21.15.70:0/3109574136 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a858e87f60 msgr2=0x55a8592459d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:54.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.607+0000 7f25027fc640 1 --2- 172.21.15.70:0/3109574136 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a858e87f60 0x55a8592459d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.607+0000 7f25027fc640 1 -- 172.21.15.70:0/3109574136 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a858e5f0a0 msgr2=0x55a859239a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:54.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.607+0000 7f25027fc640 1 --2- 172.21.15.70:0/3109574136 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a858e5f0a0 0x55a859239a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.607+0000 7f25027fc640 1 -- 172.21.15.70:0/3109574136 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a85915da00 con 0x55a858e67280 2024-09-21T05:49:54.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.607+0000 7f25037fe640 1 --2- 172.21.15.70:0/3109574136 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a858e87f60 0x55a8592459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:49:54.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.608+0000 7f25027fc640 1 --2- 172.21.15.70:0/3109574136 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a858e67280 0x55a859239f90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f24f800a840 tx=0x7f24f8018a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a038ef99f3138068 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:54.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.608+0000 7f24e2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:49:54.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.608+0000 7f24e2ffd640 1 -- 172.21.15.70:0/3109574136 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f8027020 con 0x55a858e67280 2024-09-21T05:49:54.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.608+0000 7f250fe55740 1 -- 172.21.15.70:0/3109574136 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24f8018af0 con 0x55a858e67280 2024-09-21T05:49:54.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.608+0000 7f24e2ffd640 1 -- 172.21.15.70:0/3109574136 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f24f8010880 con 0x55a858e67280 2024-09-21T05:49:54.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.608+0000 7f24e2ffd640 1 -- 172.21.15.70:0/3109574136 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f24f8032050 con 0x55a858e67280 2024-09-21T05:49:54.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.608+0000 7f250fe55740 10 client.15615 fetch_fsmap learned FSMap version 28 2024-09-21T05:49:54.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.608+0000 7f250fe55740 1 -- 172.21.15.70:0/3109574136 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a8592486a0 con 0x55a858e67280 2024-09-21T05:49:54.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.608+0000 7f24e2ffd640 1 -- 172.21.15.70:0/3109574136 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f24f8018af0 con 0x55a858e67280 2024-09-21T05:49:54.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.608+0000 7f24e2ffd640 1 -- 172.21.15.70:0/3109574136 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f24f80046c0 con 0x55a858e67280 2024-09-21T05:49:54.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.608+0000 7f250fe55740 10 client.15615 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T05:49:54.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.608+0000 7f250fe55740 10 client.15615 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T05:49:54.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.608+0000 7f250fe55740 20 client.15615 populate_metadata read hostname 'smithi070' 2024-09-21T05:49:54.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.608+0000 7f250fe55740 1 --2- 172.21.15.70:0/3109574136 >> [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] conn(0x55a858e468e0 0x55a85924bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:54.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.608+0000 7f250fe55740 4 client.15615 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:49:54.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.608+0000 7f250fe55740 1 -- 172.21.15.70:0/3109574136 --> [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8591a7b60 con 0x55a858e468e0 2024-09-21T05:49:54.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.609+0000 7f2502ffd640 1 --2- 172.21.15.70:0/3109574136 >> [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] conn(0x55a858e468e0 0x55a85924bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:54.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.609+0000 7f24e2ffd640 10 client.15615 ms_handle_connect on v2:172.21.15.160:6838/1339744282 2024-09-21T05:49:54.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.609+0000 7f2502ffd640 1 --2- 172.21.15.70:0/3109574136 >> [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] conn(0x55a858e468e0 0x55a85924bcb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=744d11468e1fd16b server_cookie=616fcd986087e220 in_seq=0 out_seq=0 2024-09-21T05:49:54.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.610+0000 7f24e2ffd640 1 -- 172.21.15.70:0/3109574136 <== mds.1 v2:172.21.15.160:6838/1339744282 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a8591a7b60 con 0x55a858e468e0 2024-09-21T05:49:54.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.610+0000 7f24e2ffd640 10 client.15615 handle_command_reply: tid=0 2024-09-21T05:49:54.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.610+0000 7f250fe55740 1 client.15615 shutdown 2024-09-21T05:49:54.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.610+0000 7f250fe55740 1 -- 172.21.15.70:0/3109574136 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a858e67280 msgr2=0x55a859239f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:54.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.610+0000 7f250fe55740 1 --2- 172.21.15.70:0/3109574136 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a858e67280 0x55a859239f90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f24f800a840 tx=0x7f24f8018a50 comp rx=0 tx=0).stop 2024-09-21T05:49:54.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.610+0000 7f250fe55740 1 -- 172.21.15.70:0/3109574136 shutdown_connections 2024-09-21T05:49:54.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.610+0000 7f250fe55740 1 --2- 172.21.15.70:0/3109574136 >> [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] conn(0x55a858e468e0 0x55a85924bcb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.610+0000 7f250fe55740 1 --2- 172.21.15.70:0/3109574136 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a858e87f60 0x55a8592459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.610+0000 7f24e2ffd640 0 client.15615 ms_handle_reset on v2:172.21.15.160:6838/1339744282 2024-09-21T05:49:54.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.610+0000 7f250fe55740 1 --2- 172.21.15.70:0/3109574136 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a858e67280 0x55a859239f90 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.610+0000 7f250fe55740 1 --2- 172.21.15.70:0/3109574136 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a858e5f0a0 0x55a859239a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.610+0000 7f250fe55740 1 -- 172.21.15.70:0/3109574136 >> 172.21.15.70:0/3109574136 conn(0x55a858e7c350 msgr2=0x55a8592310e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:54.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.610+0000 7f250fe55740 1 -- 172.21.15.70:0/3109574136 shutdown_connections 2024-09-21T05:49:54.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.610+0000 7f250fe55740 1 -- 172.21.15.70:0/3109574136 wait complete. 2024-09-21T05:49:54.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.610+0000 7f250fe55740 20 client.15615 trim_cache size 0 max 16384 2024-09-21T05:49:54.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.628+0000 7f250fe55740 1 Processor -- start 2024-09-21T05:49:54.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.628+0000 7f250fe55740 1 -- start start 2024-09-21T05:49:54.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.628+0000 7f250fe55740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a858e468e0 0x55a859234020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:54.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.628+0000 7f250fe55740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a858e5f0a0 0x55a859234a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:54.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.628+0000 7f250fe55740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a858e67280 0x55a859234f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:54.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.628+0000 7f250fe55740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a859249ff0 con 0x55a858e5f0a0 2024-09-21T05:49:54.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.628+0000 7f250fe55740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a85924a6c0 con 0x55a858e468e0 2024-09-21T05:49:54.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.628+0000 7f250fe55740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55a85924ad90 con 0x55a858e67280 2024-09-21T05:49:54.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.628+0000 7f25027fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a858e5f0a0 0x55a859234a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:54.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.628+0000 7f25027fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a858e5f0a0 0x55a859234a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35702/0 (socket says 172.21.15.70:35702) 2024-09-21T05:49:54.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.628+0000 7f25027fc640 1 -- 172.21.15.70:0/3409221009 learned_addr learned my addr 172.21.15.70:0/3409221009 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:54.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.628+0000 7f2502ffd640 1 --2- 172.21.15.70:0/3409221009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a858e468e0 0x55a859234020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:54.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.628+0000 7f25027fc640 1 -- 172.21.15.70:0/3409221009 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a858e67280 msgr2=0x55a859234f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:54.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.628+0000 7f25027fc640 1 --2- 172.21.15.70:0/3409221009 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a858e67280 0x55a859234f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.628+0000 7f25027fc640 1 -- 172.21.15.70:0/3409221009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a858e468e0 msgr2=0x55a859234020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:54.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.628+0000 7f25027fc640 1 --2- 172.21.15.70:0/3409221009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a858e468e0 0x55a859234020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.628+0000 7f25027fc640 1 -- 172.21.15.70:0/3409221009 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8592301f0 con 0x55a858e5f0a0 2024-09-21T05:49:54.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.629+0000 7f25027fc640 1 --2- 172.21.15.70:0/3409221009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a858e5f0a0 0x55a859234a00 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f24f800a9a0 tx=0x7f24f8005730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e692bb1b3c2ca573 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:54.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.629+0000 7f24e97fa640 1 -- 172.21.15.70:0/3409221009 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f8027070 con 0x55a858e5f0a0 2024-09-21T05:49:54.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.629+0000 7f24e97fa640 1 -- 172.21.15.70:0/3409221009 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f24f803b070 con 0x55a858e5f0a0 2024-09-21T05:49:54.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.629+0000 7f24e97fa640 1 -- 172.21.15.70:0/3409221009 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f801d070 con 0x55a858e5f0a0 2024-09-21T05:49:54.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.630+0000 7f250fe55740 1 -- 172.21.15.70:0/3409221009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a858e5f0a0 msgr2=0x55a859234a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:54.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.630+0000 7f250fe55740 1 --2- 172.21.15.70:0/3409221009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a858e5f0a0 0x55a859234a00 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f24f800a9a0 tx=0x7f24f8005730 comp rx=0 tx=0).stop 2024-09-21T05:49:54.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.630+0000 7f250fe55740 1 -- 172.21.15.70:0/3409221009 shutdown_connections 2024-09-21T05:49:54.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.630+0000 7f250fe55740 1 --2- 172.21.15.70:0/3409221009 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a858e67280 0x55a859234f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.630+0000 7f250fe55740 1 --2- 172.21.15.70:0/3409221009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a858e5f0a0 0x55a859234a00 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.630+0000 7f250fe55740 1 --2- 172.21.15.70:0/3409221009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a858e468e0 0x55a859234020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.630+0000 7f250fe55740 1 -- 172.21.15.70:0/3409221009 >> 172.21.15.70:0/3409221009 conn(0x55a858e7c350 msgr2=0x55a859239a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:54.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.630+0000 7f250fe55740 1 -- 172.21.15.70:0/3409221009 shutdown_connections 2024-09-21T05:49:54.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.630+0000 7f250fe55740 1 -- 172.21.15.70:0/3409221009 wait complete. 2024-09-21T05:49:54.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.630+0000 7f250fe55740 1 -- start start 2024-09-21T05:49:54.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.630+0000 7f250fe55740 1 Processor -- start 2024-09-21T05:49:54.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.631+0000 7f250fe55740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a858e468e0 0x55a85924d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:54.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.631+0000 7f250fe55740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a858e5f0a0 0x55a85924da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:54.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.631+0000 7f250fe55740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a858e67280 0x55a859252a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:54.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.631+0000 7f250fe55740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a85924bb30 con 0x55a858e67280 2024-09-21T05:49:54.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.631+0000 7f250fe55740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a85924b460 con 0x55a858e468e0 2024-09-21T05:49:54.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.631+0000 7f250fe55740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55a85924c200 con 0x55a858e5f0a0 2024-09-21T05:49:54.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.631+0000 7f250fe55740 10 client.0 _ll_register_callbacks cb 0x7f24f801b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:49:54.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.631+0000 7f25037fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a858e67280 0x55a859252a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:54.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.631+0000 7f25037fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a858e67280 0x55a859252a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35704/0 (socket says 172.21.15.70:35704) 2024-09-21T05:49:54.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.631+0000 7f25037fe640 1 -- 172.21.15.70:0/2922825681 learned_addr learned my addr 172.21.15.70:0/2922825681 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:54.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.631+0000 7f25027fc640 1 --2- 172.21.15.70:0/2922825681 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a858e5f0a0 0x55a85924da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:54.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.631+0000 7f2502ffd640 1 --2- 172.21.15.70:0/2922825681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a858e468e0 0x55a85924d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:54.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.631+0000 7f25037fe640 1 -- 172.21.15.70:0/2922825681 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a858e5f0a0 msgr2=0x55a85924da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:54.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.631+0000 7f25037fe640 1 --2- 172.21.15.70:0/2922825681 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a858e5f0a0 0x55a85924da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.631+0000 7f25037fe640 1 -- 172.21.15.70:0/2922825681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a858e468e0 msgr2=0x55a85924d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:54.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.631+0000 7f25037fe640 1 --2- 172.21.15.70:0/2922825681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a858e468e0 0x55a85924d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.631+0000 7f25037fe640 1 -- 172.21.15.70:0/2922825681 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8592530d0 con 0x55a858e67280 2024-09-21T05:49:54.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.631+0000 7f25037fe640 1 --2- 172.21.15.70:0/2922825681 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a858e67280 0x55a859252a60 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f24fc012980 tx=0x7f24fc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d129d2cadcf836b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:54.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.631+0000 7f24e2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:49:54.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.631+0000 7f24e2ffd640 1 -- 172.21.15.70:0/2922825681 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc01ecc0 con 0x55a858e67280 2024-09-21T05:49:54.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.632+0000 7f24e2ffd640 1 -- 172.21.15.70:0/2922825681 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f24fc01f420 con 0x55a858e67280 2024-09-21T05:49:54.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.632+0000 7f250fe55740 1 -- 172.21.15.70:0/2922825681 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24f803b070 con 0x55a858e67280 2024-09-21T05:49:54.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.632+0000 7f24e2ffd640 1 -- 172.21.15.70:0/2922825681 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f24fc032050 con 0x55a858e67280 2024-09-21T05:49:54.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.632+0000 7f250fe55740 10 client.15621 fetch_fsmap learned FSMap version 28 2024-09-21T05:49:54.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.632+0000 7f250fe55740 1 -- 172.21.15.70:0/2922825681 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a8592544f0 con 0x55a858e67280 2024-09-21T05:49:54.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.632+0000 7f24e2ffd640 1 -- 172.21.15.70:0/2922825681 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f24f803b070 con 0x55a858e67280 2024-09-21T05:49:54.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.632+0000 7f24e2ffd640 1 -- 172.21.15.70:0/2922825681 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f24fc00f040 con 0x55a858e67280 2024-09-21T05:49:54.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.632+0000 7f250fe55740 10 client.15621 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T05:49:54.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.632+0000 7f250fe55740 10 client.15621 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T05:49:54.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.632+0000 7f250fe55740 20 client.15621 populate_metadata read hostname 'smithi070' 2024-09-21T05:49:54.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.632+0000 7f250fe55740 1 --2- 172.21.15.70:0/2922825681 >> [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] conn(0x55a858e87f60 0x55a8592ba130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:54.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.632+0000 7f250fe55740 4 client.15621 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T05:49:54.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.632+0000 7f250fe55740 1 -- 172.21.15.70:0/2922825681 --> [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] -- command(tid 0: {"prefix": "status"}) -- 0x55a8591a3610 con 0x55a858e87f60 2024-09-21T05:49:54.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.633+0000 7f2502ffd640 1 --2- 172.21.15.70:0/2922825681 >> [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] conn(0x55a858e87f60 0x55a8592ba130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:54.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.633+0000 7f2502ffd640 1 --2- 172.21.15.70:0/2922825681 >> [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] conn(0x55a858e87f60 0x55a8592ba130 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3000631292cfcf62 server_cookie=a8fa4190e7e6e16f in_seq=0 out_seq=0 2024-09-21T05:49:54.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.633+0000 7f24e2ffd640 10 client.15621 ms_handle_connect on v2:172.21.15.160:6838/1339744282 2024-09-21T05:49:54.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.633+0000 7f24e2ffd640 1 -- 172.21.15.70:0/2922825681 <== mds.1 v2:172.21.15.160:6838/1339744282 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55a8591a3610 con 0x55a858e87f60 2024-09-21T05:49:54.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.633+0000 7f24e2ffd640 10 client.15621 handle_command_reply: tid=0 2024-09-21T05:49:54.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.633+0000 7f250fe55740 1 client.15621 shutdown 2024-09-21T05:49:54.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.633+0000 7f250fe55740 1 -- 172.21.15.70:0/2922825681 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a858e67280 msgr2=0x55a859252a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:54.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.633+0000 7f250fe55740 1 --2- 172.21.15.70:0/2922825681 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a858e67280 0x55a859252a60 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f24fc012980 tx=0x7f24fc004ab0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.633+0000 7f250fe55740 1 -- 172.21.15.70:0/2922825681 shutdown_connections 2024-09-21T05:49:54.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.633+0000 7f250fe55740 1 --2- 172.21.15.70:0/2922825681 >> [v2:172.21.15.160:6838/1339744282,v1:172.21.15.160:6839/1339744282] conn(0x55a858e87f60 0x55a8592ba130 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.633+0000 7f250fe55740 1 --2- 172.21.15.70:0/2922825681 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a858e5f0a0 0x55a85924da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.633+0000 7f250fe55740 1 --2- 172.21.15.70:0/2922825681 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a858e67280 0x55a859252a60 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.633+0000 7f250fe55740 1 --2- 172.21.15.70:0/2922825681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a858e468e0 0x55a85924d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.633+0000 7f250fe55740 1 -- 172.21.15.70:0/2922825681 >> 172.21.15.70:0/2922825681 conn(0x55a858e7c350 msgr2=0x55a859239a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:54.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.633+0000 7f24e2ffd640 0 client.15621 ms_handle_reset on v2:172.21.15.160:6838/1339744282 2024-09-21T05:49:54.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.634+0000 7f250fe55740 1 -- 172.21.15.70:0/2922825681 shutdown_connections 2024-09-21T05:49:54.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.634+0000 7f250fe55740 1 -- 172.21.15.70:0/2922825681 wait complete. 2024-09-21T05:49:54.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.634+0000 7f250fe55740 20 client.15621 trim_cache size 0 max 16384 2024-09-21T05:49:54.640 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:49:54.640 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "96c6636e-77db-11ef-baf5-efdc52797490", 2024-09-21T05:49:54.640 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 1, 2024-09-21T05:49:54.640 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24628, 2024-09-21T05:49:54.640 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-21T05:49:54.640 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-21T05:49:54.641 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-21T05:49:54.641 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 128.125763253, 2024-09-21T05:49:54.641 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 28, 2024-09-21T05:49:54.641 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 85, 2024-09-21T05:49:54.641 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 85, 2024-09-21T05:49:54.641 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 186.97363842600001 2024-09-21T05:49:54.641 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:49:54.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.634+0000 7f25098e1640 1 -- 172.21.15.70:0/3223918764 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f24ec0b65d0 msgr2=0x7f24ec0b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:54.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.634+0000 7f25098e1640 1 --2- 172.21.15.70:0/3223918764 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f24ec0b65d0 0x7f24ec0b8ae0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f24fc005fd0 tx=0x7f24fc009580 comp rx=0 tx=0).stop 2024-09-21T05:49:54.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.634+0000 7f25098e1640 1 -- 172.21.15.70:0/3223918764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2504102ab0 msgr2=0x7f250419a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:54.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.634+0000 7f25098e1640 1 --2- 172.21.15.70:0/3223918764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2504102ab0 0x7f250419a460 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f24f4005940 tx=0x7f24f40042f0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.634+0000 7f25098e1640 1 -- 172.21.15.70:0/3223918764 shutdown_connections 2024-09-21T05:49:54.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.634+0000 7f25098e1640 1 --2- 172.21.15.70:0/3223918764 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f24ec0b65d0 0x7f24ec0b8ae0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.634+0000 7f25098e1640 1 --2- 172.21.15.70:0/3223918764 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2504108d40 0x7f250419fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.634+0000 7f25098e1640 1 --2- 172.21.15.70:0/3223918764 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25041083f0 0x7f250419aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.634+0000 7f25098e1640 1 --2- 172.21.15.70:0/3223918764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2504102ab0 0x7f250419a460 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:54.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.634+0000 7f25098e1640 1 -- 172.21.15.70:0/3223918764 >> 172.21.15.70:0/3223918764 conn(0x7f25040796b0 msgr2=0x7f2504101b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:54.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.634+0000 7f25098e1640 1 -- 172.21.15.70:0/3223918764 shutdown_connections 2024-09-21T05:49:54.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:54.634+0000 7f25098e1640 1 -- 172.21.15.70:0/3223918764 wait complete. 2024-09-21T05:49:55.200 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:54 smithi160 ceph-mon[33979]: pgmap v383: 129 pgs: 129 active+clean; 665 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-21T05:49:55.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:54 smithi070 ceph-mon[30981]: pgmap v383: 129 pgs: 129 active+clean; 665 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-21T05:49:55.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:54 smithi116 ceph-mon[34332]: pgmap v383: 129 pgs: 129 active+clean; 665 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-21T05:49:55.401 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T05:49:55.644 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:56.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.181+0000 7fec78761640 1 -- 172.21.15.70:0/3414125094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec701083c0 msgr2=0x7fec701087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:56.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.181+0000 7fec78761640 1 --2- 172.21.15.70:0/3414125094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec701083c0 0x7fec701087d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fec60009900 tx=0x7fec6002a410 comp rx=0 tx=0).stop 2024-09-21T05:49:56.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.181+0000 7fec78761640 1 -- 172.21.15.70:0/3414125094 shutdown_connections 2024-09-21T05:49:56.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.181+0000 7fec78761640 1 --2- 172.21.15.70:0/3414125094 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec70108d10 0x7fec7010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.181+0000 7fec78761640 1 --2- 172.21.15.70:0/3414125094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec701083c0 0x7fec701087d0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.181+0000 7fec78761640 1 --2- 172.21.15.70:0/3414125094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec70102a80 0x7fec70102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.181+0000 7fec78761640 1 -- 172.21.15.70:0/3414125094 >> 172.21.15.70:0/3414125094 conn(0x7fec70079740 msgr2=0x7fec70079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:56.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.181+0000 7fec78761640 1 -- 172.21.15.70:0/3414125094 shutdown_connections 2024-09-21T05:49:56.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.181+0000 7fec78761640 1 -- 172.21.15.70:0/3414125094 wait complete. 2024-09-21T05:49:56.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.182+0000 7fec78761640 1 Processor -- start 2024-09-21T05:49:56.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.182+0000 7fec78761640 1 -- start start 2024-09-21T05:49:56.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.183+0000 7fec78761640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec70102a80 0x7fec701993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:56.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.183+0000 7fec78761640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec701083c0 0x7fec70199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:56.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.183+0000 7fec78761640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec70108d10 0x7fec7019ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:56.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.183+0000 7fec78761640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fec70112950 con 0x7fec701083c0 2024-09-21T05:49:56.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.183+0000 7fec78761640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fec701127d0 con 0x7fec70108d10 2024-09-21T05:49:56.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.183+0000 7fec78761640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fec70112ad0 con 0x7fec70102a80 2024-09-21T05:49:56.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.183+0000 7fec75cfc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec701083c0 0x7fec70199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:56.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.183+0000 7fec75cfc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec701083c0 0x7fec70199980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35710/0 (socket says 172.21.15.70:35710) 2024-09-21T05:49:56.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.183+0000 7fec75cfc640 1 -- 172.21.15.70:0/3529597285 learned_addr learned my addr 172.21.15.70:0/3529597285 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:56.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.183+0000 7fec76cfe640 1 --2- 172.21.15.70:0/3529597285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec70108d10 0x7fec7019ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:56.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.183+0000 7fec764fd640 1 --2- 172.21.15.70:0/3529597285 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec70102a80 0x7fec701993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:56.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.183+0000 7fec75cfc640 1 -- 172.21.15.70:0/3529597285 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec70102a80 msgr2=0x7fec701993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:56.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.183+0000 7fec75cfc640 1 --2- 172.21.15.70:0/3529597285 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec70102a80 0x7fec701993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.183+0000 7fec75cfc640 1 -- 172.21.15.70:0/3529597285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec70108d10 msgr2=0x7fec7019ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:56.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.183+0000 7fec75cfc640 1 --2- 172.21.15.70:0/3529597285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec70108d10 0x7fec7019ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.183+0000 7fec75cfc640 1 -- 172.21.15.70:0/3529597285 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec7019f350 con 0x7fec701083c0 2024-09-21T05:49:56.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.183+0000 7fec75cfc640 1 --2- 172.21.15.70:0/3529597285 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec701083c0 0x7fec70199980 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fec60004270 tx=0x7fec600042a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:56.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.183+0000 7fec677fe640 1 -- 172.21.15.70:0/3529597285 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec6003f030 con 0x7fec701083c0 2024-09-21T05:49:56.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.184+0000 7fec677fe640 1 -- 172.21.15.70:0/3529597285 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fec600044c0 con 0x7fec701083c0 2024-09-21T05:49:56.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.184+0000 7fec78761640 1 -- 172.21.15.70:0/3529597285 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec7019f5e0 con 0x7fec701083c0 2024-09-21T05:49:56.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.184+0000 7fec677fe640 1 -- 172.21.15.70:0/3529597285 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec60035070 con 0x7fec701083c0 2024-09-21T05:49:56.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.184+0000 7fec78761640 1 -- 172.21.15.70:0/3529597285 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec701a5da0 con 0x7fec701083c0 2024-09-21T05:49:56.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.186+0000 7fec7ecd5740 1 Processor -- start 2024-09-21T05:49:56.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.186+0000 7fec7ecd5740 1 -- start start 2024-09-21T05:49:56.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.186+0000 7fec677fe640 1 -- 172.21.15.70:0/3529597285 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) ==== 154563+0+0 (secure 0 0 0) 0x7fec60042030 con 0x7fec701083c0 2024-09-21T05:49:56.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.187+0000 7fec7ecd5740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5598e4ffbf60 0x5598e53a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:56.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.187+0000 7fec7ecd5740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5598e4fd30a0 0x5598e53a2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:56.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.187+0000 7fec7ecd5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598e4fdb280 0x5598e53a2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:56.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.187+0000 7fec7ecd5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5598e5319c10 con 0x5598e4fdb280 2024-09-21T05:49:56.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.187+0000 7fec7ecd5740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5598e5309040 con 0x5598e4fd30a0 2024-09-21T05:49:56.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.187+0000 7fec7ecd5740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5598e530ce50 con 0x5598e4ffbf60 2024-09-21T05:49:56.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.187+0000 7fec75cfc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598e4fdb280 0x5598e53a2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:56.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.187+0000 7fec75cfc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598e4fdb280 0x5598e53a2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35718/0 (socket says 172.21.15.70:35718) 2024-09-21T05:49:56.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.187+0000 7fec75cfc640 1 -- 172.21.15.70:0/1826808408 learned_addr learned my addr 172.21.15.70:0/1826808408 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:56.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.187+0000 7fec764fd640 1 --2- 172.21.15.70:0/1826808408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5598e4fd30a0 0x5598e53a2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:56.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.187+0000 7fec76cfe640 1 --2- 172.21.15.70:0/1826808408 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5598e4ffbf60 0x5598e53a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:56.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.187+0000 7fec75cfc640 1 -- 172.21.15.70:0/1826808408 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5598e4ffbf60 msgr2=0x5598e53a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:56.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.187+0000 7fec75cfc640 1 --2- 172.21.15.70:0/1826808408 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5598e4ffbf60 0x5598e53a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.187+0000 7fec75cfc640 1 -- 172.21.15.70:0/1826808408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5598e4fd30a0 msgr2=0x5598e53a2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:56.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.187+0000 7fec75cfc640 1 --2- 172.21.15.70:0/1826808408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5598e4fd30a0 0x5598e53a2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.187+0000 7fec75cfc640 1 -- 172.21.15.70:0/1826808408 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598e5067540 con 0x5598e4fdb280 2024-09-21T05:49:56.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.187+0000 7fec764fd640 1 --2- 172.21.15.70:0/1826808408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5598e4fd30a0 0x5598e53a2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:49:56.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.187+0000 7fec76cfe640 1 --2- 172.21.15.70:0/1826808408 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5598e4ffbf60 0x5598e53a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:56.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.187+0000 7fec677fe640 1 --2- 172.21.15.70:0/3529597285 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fec5c0b65a0 0x7fec5c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:56.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.187+0000 7fec75cfc640 1 --2- 172.21.15.70:0/1826808408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598e4fdb280 0x5598e53a2980 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fec6010bf60 tx=0x7fec6010bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9909a09a29f9e4af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:56.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.187+0000 7fec76cfe640 1 --2- 172.21.15.70:0/3529597285 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fec5c0b65a0 0x7fec5c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:56.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.188+0000 7fec64ff9640 1 -- 172.21.15.70:0/1826808408 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec600ca070 con 0x5598e4fdb280 2024-09-21T05:49:56.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.188+0000 7fec677fe640 1 -- 172.21.15.70:0/3529597285 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fec60107de0 con 0x7fec701083c0 2024-09-21T05:49:56.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.188+0000 7fec64ff9640 1 -- 172.21.15.70:0/1826808408 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fec60115070 con 0x5598e4fdb280 2024-09-21T05:49:56.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.188+0000 7fec64ff9640 1 -- 172.21.15.70:0/1826808408 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec60003b90 con 0x5598e4fdb280 2024-09-21T05:49:56.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.189+0000 7fec7ecd5740 1 -- 172.21.15.70:0/1826808408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598e4fdb280 msgr2=0x5598e53a2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:56.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.189+0000 7fec76cfe640 1 --2- 172.21.15.70:0/3529597285 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fec5c0b65a0 0x7fec5c0b8ab0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fec68005fd0 tx=0x7fec68009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:56.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.189+0000 7fec7ecd5740 1 --2- 172.21.15.70:0/1826808408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598e4fdb280 0x5598e53a2980 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fec6010bf60 tx=0x7fec6010bf90 comp rx=0 tx=0).stop 2024-09-21T05:49:56.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.189+0000 7fec7ecd5740 1 -- 172.21.15.70:0/1826808408 shutdown_connections 2024-09-21T05:49:56.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.189+0000 7fec7ecd5740 1 --2- 172.21.15.70:0/1826808408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598e4fdb280 0x5598e53a2980 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.189+0000 7fec7ecd5740 1 --2- 172.21.15.70:0/1826808408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5598e4fd30a0 0x5598e53a2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.189+0000 7fec7ecd5740 1 --2- 172.21.15.70:0/1826808408 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5598e4ffbf60 0x5598e53a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.189+0000 7fec7ecd5740 1 -- 172.21.15.70:0/1826808408 >> 172.21.15.70:0/1826808408 conn(0x5598e4ff0350 msgr2=0x5598e539fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:56.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.189+0000 7fec7ecd5740 1 -- 172.21.15.70:0/1826808408 shutdown_connections 2024-09-21T05:49:56.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.189+0000 7fec7ecd5740 1 -- 172.21.15.70:0/1826808408 wait complete. 2024-09-21T05:49:56.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.189+0000 7fec7ecd5740 1 -- start start 2024-09-21T05:49:56.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.189+0000 7fec7ecd5740 1 Processor -- start 2024-09-21T05:49:56.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.189+0000 7fec7ecd5740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5598e4fd30a0 0x5598e53afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:56.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.189+0000 7fec7ecd5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598e4fdb280 0x5598e53b0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:56.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.190+0000 7fec7ecd5740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5598e4ffbf60 0x5598e53bb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:56.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.190+0000 7fec7ecd5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5598e516a5f0 con 0x5598e4fdb280 2024-09-21T05:49:56.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.190+0000 7fec7ecd5740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5598e52a4010 con 0x5598e4ffbf60 2024-09-21T05:49:56.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.190+0000 7fec7ecd5740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5598e53b25d0 con 0x5598e4fd30a0 2024-09-21T05:49:56.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.190+0000 7fec7ecd5740 10 client.0 _ll_register_callbacks cb 0x5598e5303340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:49:56.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.190+0000 7fec75cfc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598e4fdb280 0x5598e53b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:56.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.190+0000 7fec75cfc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598e4fdb280 0x5598e53b0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35722/0 (socket says 172.21.15.70:35722) 2024-09-21T05:49:56.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.190+0000 7fec75cfc640 1 -- 172.21.15.70:0/3467927256 learned_addr learned my addr 172.21.15.70:0/3467927256 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:56.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.190+0000 7fec76cfe640 1 --2- 172.21.15.70:0/3467927256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5598e4ffbf60 0x5598e53bb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:56.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.190+0000 7fec764fd640 1 --2- 172.21.15.70:0/3467927256 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5598e4fd30a0 0x5598e53afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:56.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.190+0000 7fec75cfc640 1 -- 172.21.15.70:0/3467927256 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5598e4fd30a0 msgr2=0x5598e53afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:56.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.190+0000 7fec75cfc640 1 --2- 172.21.15.70:0/3467927256 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5598e4fd30a0 0x5598e53afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.190+0000 7fec75cfc640 1 -- 172.21.15.70:0/3467927256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5598e4ffbf60 msgr2=0x5598e53bb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:56.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.190+0000 7fec75cfc640 1 --2- 172.21.15.70:0/3467927256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5598e4ffbf60 0x5598e53bb8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.190+0000 7fec75cfc640 1 -- 172.21.15.70:0/3467927256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598e52d1a00 con 0x5598e4fdb280 2024-09-21T05:49:56.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.190+0000 7fec75cfc640 1 --2- 172.21.15.70:0/3467927256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598e4fdb280 0x5598e53b0110 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fec600f1040 tx=0x7fec60105800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576d39d7aa2da0b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:56.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.190+0000 7fec59ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:49:56.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.190+0000 7fec59ffb640 1 -- 172.21.15.70:0/3467927256 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec60049070 con 0x5598e4fdb280 2024-09-21T05:49:56.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.190+0000 7fec59ffb640 1 -- 172.21.15.70:0/3467927256 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fec600d71b0 con 0x5598e4fdb280 2024-09-21T05:49:56.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.190+0000 7fec7ecd5740 1 -- 172.21.15.70:0/3467927256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec60115070 con 0x5598e4fdb280 2024-09-21T05:49:56.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.190+0000 7fec59ffb640 1 -- 172.21.15.70:0/3467927256 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fec60043de0 con 0x5598e4fdb280 2024-09-21T05:49:56.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.190+0000 7fec7ecd5740 10 client.15633 fetch_fsmap learned FSMap version 28 2024-09-21T05:49:56.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.190+0000 7fec7ecd5740 1 -- 172.21.15.70:0/3467927256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5598e53be4f0 con 0x5598e4fdb280 2024-09-21T05:49:56.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.191+0000 7fec59ffb640 1 -- 172.21.15.70:0/3467927256 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fec60115070 con 0x5598e4fdb280 2024-09-21T05:49:56.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.191+0000 7fec59ffb640 1 -- 172.21.15.70:0/3467927256 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fec600d2020 con 0x5598e4fdb280 2024-09-21T05:49:56.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.191+0000 7fec7ecd5740 10 client.15633 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T05:49:56.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.191+0000 7fec7ecd5740 10 client.15633 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T05:49:56.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.191+0000 7fec7ecd5740 20 client.15633 populate_metadata read hostname 'smithi070' 2024-09-21T05:49:56.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.191+0000 7fec7ecd5740 1 --2- 172.21.15.70:0/3467927256 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x5598e4fba8e0 0x5598e53c1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:56.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.191+0000 7fec7ecd5740 4 client.15633 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:49:56.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.191+0000 7fec7ecd5740 1 -- 172.21.15.70:0/3467927256 --> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598e531bb60 con 0x5598e4fba8e0 2024-09-21T05:49:56.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.191+0000 7fec764fd640 1 --2- 172.21.15.70:0/3467927256 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x5598e4fba8e0 0x5598e53c1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:56.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.192+0000 7fec59ffb640 10 client.15633 ms_handle_connect on v2:172.21.15.116:6838/3952175670 2024-09-21T05:49:56.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.192+0000 7fec764fd640 1 --2- 172.21.15.70:0/3467927256 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x5598e4fba8e0 0x5598e53c1df0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c519aa959bb92a61 server_cookie=c8caf0cbe3e55d6c in_seq=0 out_seq=0 2024-09-21T05:49:56.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.192+0000 7fec59ffb640 1 -- 172.21.15.70:0/3467927256 <== mds.0 v2:172.21.15.116:6838/3952175670 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5598e531bb60 con 0x5598e4fba8e0 2024-09-21T05:49:56.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.193+0000 7fec59ffb640 10 client.15633 handle_command_reply: tid=0 2024-09-21T05:49:56.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.193+0000 7fec7ecd5740 1 client.15633 shutdown 2024-09-21T05:49:56.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.193+0000 7fec7ecd5740 1 -- 172.21.15.70:0/3467927256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598e4fdb280 msgr2=0x5598e53b0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:56.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.193+0000 7fec7ecd5740 1 --2- 172.21.15.70:0/3467927256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598e4fdb280 0x5598e53b0110 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fec600f1040 tx=0x7fec60105800 comp rx=0 tx=0).stop 2024-09-21T05:49:56.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.193+0000 7fec7ecd5740 1 -- 172.21.15.70:0/3467927256 shutdown_connections 2024-09-21T05:49:56.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.193+0000 7fec7ecd5740 1 --2- 172.21.15.70:0/3467927256 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x5598e4fba8e0 0x5598e53c1df0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.193+0000 7fec7ecd5740 1 --2- 172.21.15.70:0/3467927256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5598e4ffbf60 0x5598e53bb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.193+0000 7fec7ecd5740 1 --2- 172.21.15.70:0/3467927256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598e4fdb280 0x5598e53b0110 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.193+0000 7fec59ffb640 0 client.15633 ms_handle_reset on v2:172.21.15.116:6838/3952175670 2024-09-21T05:49:56.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.193+0000 7fec7ecd5740 1 --2- 172.21.15.70:0/3467927256 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5598e4fd30a0 0x5598e53afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.193+0000 7fec7ecd5740 1 -- 172.21.15.70:0/3467927256 >> 172.21.15.70:0/3467927256 conn(0x5598e4ff0350 msgr2=0x5598e53a5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:56.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.193+0000 7fec7ecd5740 1 -- 172.21.15.70:0/3467927256 shutdown_connections 2024-09-21T05:49:56.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.193+0000 7fec7ecd5740 1 -- 172.21.15.70:0/3467927256 wait complete. 2024-09-21T05:49:56.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.193+0000 7fec7ecd5740 20 client.15633 trim_cache size 0 max 16384 2024-09-21T05:49:56.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.211+0000 7fec7ecd5740 1 Processor -- start 2024-09-21T05:49:56.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.211+0000 7fec7ecd5740 1 -- start start 2024-09-21T05:49:56.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.211+0000 7fec7ecd5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598e4fd30a0 0x5598e53bb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:56.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.211+0000 7fec7ecd5740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5598e4fdb280 0x5598e53bbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:56.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.211+0000 7fec7ecd5740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5598e4ffbf60 0x5598e53ae250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:56.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.211+0000 7fec7ecd5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5598e53c0130 con 0x5598e4fd30a0 2024-09-21T05:49:56.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.211+0000 7fec7ecd5740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5598e53c0800 con 0x5598e4ffbf60 2024-09-21T05:49:56.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.211+0000 7fec7ecd5740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5598e53c0ed0 con 0x5598e4fdb280 2024-09-21T05:49:56.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.211+0000 7fec764fd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598e4fd30a0 0x5598e53bb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:56.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.211+0000 7fec764fd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598e4fd30a0 0x5598e53bb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35738/0 (socket says 172.21.15.70:35738) 2024-09-21T05:49:56.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.211+0000 7fec764fd640 1 -- 172.21.15.70:0/3423981435 learned_addr learned my addr 172.21.15.70:0/3423981435 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:56.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.211+0000 7fec76cfe640 1 --2- 172.21.15.70:0/3423981435 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5598e4ffbf60 0x5598e53ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:56.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.211+0000 7fec75cfc640 1 --2- 172.21.15.70:0/3423981435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5598e4fdb280 0x5598e53bbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:56.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.211+0000 7fec764fd640 1 -- 172.21.15.70:0/3423981435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5598e4fdb280 msgr2=0x5598e53bbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:56.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.211+0000 7fec764fd640 1 --2- 172.21.15.70:0/3423981435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5598e4fdb280 0x5598e53bbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.211+0000 7fec764fd640 1 -- 172.21.15.70:0/3423981435 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5598e4ffbf60 msgr2=0x5598e53ae250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:56.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.211+0000 7fec764fd640 1 --2- 172.21.15.70:0/3423981435 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5598e4ffbf60 0x5598e53ae250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.211+0000 7fec764fd640 1 -- 172.21.15.70:0/3423981435 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598e53b23a0 con 0x5598e4fd30a0 2024-09-21T05:49:56.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.211+0000 7fec76cfe640 1 --2- 172.21.15.70:0/3423981435 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5598e4ffbf60 0x5598e53ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:49:56.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.211+0000 7fec75cfc640 1 --2- 172.21.15.70:0/3423981435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5598e4fdb280 0x5598e53bbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:49:56.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.211+0000 7fec764fd640 1 --2- 172.21.15.70:0/3423981435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598e4fd30a0 0x5598e53bb830 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x5598e53c2710 tx=0x7fec6c00c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f7921b85545ed3d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:56.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.212+0000 7fec5bfff640 1 -- 172.21.15.70:0/3423981435 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec6c004220 con 0x5598e4fd30a0 2024-09-21T05:49:56.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.212+0000 7fec5bfff640 1 -- 172.21.15.70:0/3423981435 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fec6c010e50 con 0x5598e4fd30a0 2024-09-21T05:49:56.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.212+0000 7fec5bfff640 1 -- 172.21.15.70:0/3423981435 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec6c004e10 con 0x5598e4fd30a0 2024-09-21T05:49:56.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.212+0000 7fec7ecd5740 1 -- 172.21.15.70:0/3423981435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598e4fd30a0 msgr2=0x5598e53bb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:56.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.212+0000 7fec7ecd5740 1 --2- 172.21.15.70:0/3423981435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598e4fd30a0 0x5598e53bb830 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x5598e53c2710 tx=0x7fec6c00c430 comp rx=0 tx=0).stop 2024-09-21T05:49:56.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.212+0000 7fec7ecd5740 1 -- 172.21.15.70:0/3423981435 shutdown_connections 2024-09-21T05:49:56.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.212+0000 7fec7ecd5740 1 --2- 172.21.15.70:0/3423981435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5598e4fdb280 0x5598e53bbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.212+0000 7fec7ecd5740 1 --2- 172.21.15.70:0/3423981435 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5598e4ffbf60 0x5598e53ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.212+0000 7fec7ecd5740 1 --2- 172.21.15.70:0/3423981435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598e4fd30a0 0x5598e53bb830 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.213+0000 7fec7ecd5740 1 -- 172.21.15.70:0/3423981435 >> 172.21.15.70:0/3423981435 conn(0x5598e4ff0350 msgr2=0x5598e53afbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:56.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.213+0000 7fec7ecd5740 1 -- 172.21.15.70:0/3423981435 shutdown_connections 2024-09-21T05:49:56.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.213+0000 7fec7ecd5740 1 -- 172.21.15.70:0/3423981435 wait complete. 2024-09-21T05:49:56.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.213+0000 7fec7ecd5740 1 -- start start 2024-09-21T05:49:56.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.213+0000 7fec7ecd5740 1 Processor -- start 2024-09-21T05:49:56.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.213+0000 7fec7ecd5740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5598e4fd30a0 0x5598e53c3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:56.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.213+0000 7fec7ecd5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598e4fdb280 0x5598e53c4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:56.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.213+0000 7fec7ecd5740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5598e4ffbf60 0x5598e53c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:56.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.213+0000 7fec7ecd5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5598e53c1c70 con 0x5598e4fdb280 2024-09-21T05:49:56.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.213+0000 7fec7ecd5740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5598e53c15a0 con 0x5598e4ffbf60 2024-09-21T05:49:56.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.213+0000 7fec7ecd5740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5598e53c2340 con 0x5598e4fd30a0 2024-09-21T05:49:56.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.213+0000 7fec7ecd5740 10 client.0 _ll_register_callbacks cb 0x7fec6c00c2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:49:56.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.213+0000 7fec75cfc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598e4fdb280 0x5598e53c4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:56.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.213+0000 7fec75cfc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598e4fdb280 0x5598e53c4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35740/0 (socket says 172.21.15.70:35740) 2024-09-21T05:49:56.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.213+0000 7fec75cfc640 1 -- 172.21.15.70:0/105027817 learned_addr learned my addr 172.21.15.70:0/105027817 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:49:56.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.214+0000 7fec764fd640 1 --2- 172.21.15.70:0/105027817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5598e4fd30a0 0x5598e53c3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:56.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.214+0000 7fec76cfe640 1 --2- 172.21.15.70:0/105027817 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5598e4ffbf60 0x5598e53c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:56.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.214+0000 7fec75cfc640 1 -- 172.21.15.70:0/105027817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5598e4fd30a0 msgr2=0x5598e53c3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:56.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.214+0000 7fec75cfc640 1 --2- 172.21.15.70:0/105027817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5598e4fd30a0 0x5598e53c3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.214+0000 7fec75cfc640 1 -- 172.21.15.70:0/105027817 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5598e4ffbf60 msgr2=0x5598e53c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:49:56.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.214+0000 7fec75cfc640 1 --2- 172.21.15.70:0/105027817 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5598e4ffbf60 0x5598e53c4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.214+0000 7fec75cfc640 1 -- 172.21.15.70:0/105027817 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598e53c9780 con 0x5598e4fdb280 2024-09-21T05:49:56.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.214+0000 7fec75cfc640 1 --2- 172.21.15.70:0/105027817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598e4fdb280 0x5598e53c4530 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fec6002a450 tx=0x7fec601080a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d969805bd7a6ec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:56.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.214+0000 7fec59ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:49:56.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.214+0000 7fec59ffb640 1 -- 172.21.15.70:0/105027817 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec60049070 con 0x5598e4fdb280 2024-09-21T05:49:56.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.214+0000 7fec59ffb640 1 -- 172.21.15.70:0/105027817 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fec6003bd80 con 0x5598e4fdb280 2024-09-21T05:49:56.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.214+0000 7fec7ecd5740 1 -- 172.21.15.70:0/105027817 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec6c010e50 con 0x5598e4fdb280 2024-09-21T05:49:56.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.214+0000 7fec59ffb640 1 -- 172.21.15.70:0/105027817 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fec6010ba20 con 0x5598e4fdb280 2024-09-21T05:49:56.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.214+0000 7fec7ecd5740 10 client.15639 fetch_fsmap learned FSMap version 28 2024-09-21T05:49:56.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.214+0000 7fec7ecd5740 1 -- 172.21.15.70:0/105027817 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5598e53c9780 con 0x5598e4fdb280 2024-09-21T05:49:56.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.215+0000 7fec59ffb640 1 -- 172.21.15.70:0/105027817 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fec600a4020 con 0x5598e4fdb280 2024-09-21T05:49:56.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.215+0000 7fec59ffb640 1 -- 172.21.15.70:0/105027817 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fec600c9370 con 0x5598e4fdb280 2024-09-21T05:49:56.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.215+0000 7fec7ecd5740 10 client.15639 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T05:49:56.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.215+0000 7fec7ecd5740 10 client.15639 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T05:49:56.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.215+0000 7fec7ecd5740 20 client.15639 populate_metadata read hostname 'smithi070' 2024-09-21T05:49:56.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.215+0000 7fec7ecd5740 1 --2- 172.21.15.70:0/105027817 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x5598e4f8fc90 0x5598e5430850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:56.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.215+0000 7fec7ecd5740 4 client.15639 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T05:49:56.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.215+0000 7fec7ecd5740 1 -- 172.21.15.70:0/105027817 --> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] -- command(tid 0: {"prefix": "status"}) -- 0x5598e5317610 con 0x5598e4f8fc90 2024-09-21T05:49:56.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.215+0000 7fec764fd640 1 --2- 172.21.15.70:0/105027817 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x5598e4f8fc90 0x5598e5430850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:56.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.215+0000 7fec59ffb640 10 client.15639 ms_handle_connect on v2:172.21.15.116:6838/3952175670 2024-09-21T05:49:56.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.215+0000 7fec764fd640 1 --2- 172.21.15.70:0/105027817 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x5598e4f8fc90 0x5598e5430850 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df99357088a5bb83 server_cookie=d02e7e99783c8ae7 in_seq=0 out_seq=0 2024-09-21T05:49:56.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.216+0000 7fec59ffb640 1 -- 172.21.15.70:0/105027817 <== mds.0 v2:172.21.15.116:6838/3952175670 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5598e5317610 con 0x5598e4f8fc90 2024-09-21T05:49:56.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.216+0000 7fec59ffb640 10 client.15639 handle_command_reply: tid=0 2024-09-21T05:49:56.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.216+0000 7fec7ecd5740 1 client.15639 shutdown 2024-09-21T05:49:56.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.216+0000 7fec7ecd5740 1 -- 172.21.15.70:0/105027817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598e4fdb280 msgr2=0x5598e53c4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:56.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.216+0000 7fec7ecd5740 1 --2- 172.21.15.70:0/105027817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598e4fdb280 0x5598e53c4530 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fec6002a450 tx=0x7fec601080a0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.216+0000 7fec7ecd5740 1 -- 172.21.15.70:0/105027817 shutdown_connections 2024-09-21T05:49:56.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.216+0000 7fec7ecd5740 1 --2- 172.21.15.70:0/105027817 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x5598e4f8fc90 0x5598e5430850 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.216+0000 7fec7ecd5740 1 --2- 172.21.15.70:0/105027817 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5598e4ffbf60 0x5598e53c4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.216+0000 7fec7ecd5740 1 --2- 172.21.15.70:0/105027817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598e4fdb280 0x5598e53c4530 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.216+0000 7fec7ecd5740 1 --2- 172.21.15.70:0/105027817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5598e4fd30a0 0x5598e53c3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.216+0000 7fec7ecd5740 1 -- 172.21.15.70:0/105027817 >> 172.21.15.70:0/105027817 conn(0x5598e4ff0350 msgr2=0x5598e539f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:56.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.216+0000 7fec59ffb640 0 client.15639 ms_handle_reset on v2:172.21.15.116:6838/3952175670 2024-09-21T05:49:56.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.216+0000 7fec7ecd5740 1 -- 172.21.15.70:0/105027817 shutdown_connections 2024-09-21T05:49:56.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.216+0000 7fec7ecd5740 1 -- 172.21.15.70:0/105027817 wait complete. 2024-09-21T05:49:56.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.216+0000 7fec7ecd5740 20 client.15639 trim_cache size 0 max 16384 2024-09-21T05:49:56.224 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:49:56.224 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "96c6636e-77db-11ef-baf5-efdc52797490", 2024-09-21T05:49:56.224 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 0, 2024-09-21T05:49:56.224 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24641, 2024-09-21T05:49:56.224 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-21T05:49:56.224 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-21T05:49:56.224 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-21T05:49:56.224 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 169.599611856, 2024-09-21T05:49:56.224 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 28, 2024-09-21T05:49:56.224 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 85, 2024-09-21T05:49:56.225 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 85, 2024-09-21T05:49:56.225 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 180.09230608199999 2024-09-21T05:49:56.225 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:49:56.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.217+0000 7fec78761640 1 -- 172.21.15.70:0/3529597285 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fec5c0b65a0 msgr2=0x7fec5c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:56.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.217+0000 7fec78761640 1 --2- 172.21.15.70:0/3529597285 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fec5c0b65a0 0x7fec5c0b8ab0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fec68005fd0 tx=0x7fec68009600 comp rx=0 tx=0).stop 2024-09-21T05:49:56.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.217+0000 7fec78761640 1 -- 172.21.15.70:0/3529597285 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec701083c0 msgr2=0x7fec70199980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:56.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.217+0000 7fec78761640 1 --2- 172.21.15.70:0/3529597285 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec701083c0 0x7fec70199980 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fec60004270 tx=0x7fec600042a0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.217+0000 7fec78761640 1 -- 172.21.15.70:0/3529597285 shutdown_connections 2024-09-21T05:49:56.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.217+0000 7fec78761640 1 --2- 172.21.15.70:0/3529597285 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fec5c0b65a0 0x7fec5c0b8ab0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.217+0000 7fec78761640 1 --2- 172.21.15.70:0/3529597285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec70108d10 0x7fec7019ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.217+0000 7fec78761640 1 --2- 172.21.15.70:0/3529597285 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec701083c0 0x7fec70199980 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.217+0000 7fec78761640 1 --2- 172.21.15.70:0/3529597285 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec70102a80 0x7fec701993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.217+0000 7fec78761640 1 -- 172.21.15.70:0/3529597285 >> 172.21.15.70:0/3529597285 conn(0x7fec70079740 msgr2=0x7fec701015b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:56.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.217+0000 7fec78761640 1 -- 172.21.15.70:0/3529597285 shutdown_connections 2024-09-21T05:49:56.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:49:56.217+0000 7fec78761640 1 -- 172.21.15.70:0/3529597285 wait complete. 2024-09-21T05:49:57.082 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:56 smithi070 ceph-mon[30981]: pgmap v384: 129 pgs: 129 active+clean; 665 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-21T05:49:57.111 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-21T05:49:57.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:56 smithi116 ceph-mon[34332]: pgmap v384: 129 pgs: 129 active+clean; 665 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-21T05:49:57.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:56 smithi160 ceph-mon[33979]: pgmap v384: 129 pgs: 129 active+clean; 665 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-21T05:49:59.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:49:58 smithi070 ceph-mon[30981]: pgmap v385: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-09-21T05:49:59.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:49:58 smithi116 ceph-mon[34332]: pgmap v385: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-09-21T05:49:59.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:49:58 smithi160 ceph-mon[33979]: pgmap v385: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-09-21T05:50:01.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:00 smithi070 ceph-mon[30981]: pgmap v386: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-21T05:50:01.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:00 smithi070 ceph-mon[30981]: overall HEALTH_OK 2024-09-21T05:50:01.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:00 smithi116 ceph-mon[34332]: pgmap v386: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-21T05:50:01.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:00 smithi116 ceph-mon[34332]: overall HEALTH_OK 2024-09-21T05:50:01.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:00 smithi160 ceph-mon[33979]: pgmap v386: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-21T05:50:01.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:00 smithi160 ceph-mon[33979]: overall HEALTH_OK 2024-09-21T05:50:03.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:02 smithi070 ceph-mon[30981]: pgmap v387: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-21T05:50:03.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:02 smithi116 ceph-mon[34332]: pgmap v387: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-21T05:50:03.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:02 smithi160 ceph-mon[33979]: pgmap v387: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-21T05:50:05.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:04 smithi070 ceph-mon[30981]: pgmap v388: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T05:50:05.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:04 smithi116 ceph-mon[34332]: pgmap v388: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T05:50:05.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:04 smithi160 ceph-mon[33979]: pgmap v388: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T05:50:07.232 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:06 smithi116 ceph-mon[34332]: pgmap v389: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-21T05:50:07.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:06 smithi070 ceph-mon[30981]: pgmap v389: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-21T05:50:07.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:06 smithi160 ceph-mon[33979]: pgmap v389: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-21T05:50:09.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:08 smithi070 ceph-mon[30981]: pgmap v390: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-21T05:50:09.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:08 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:50:09.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:08 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:50:09.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:08 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:50:09.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:08 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:50:09.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:08 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:50:09.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:08 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:50:09.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:08 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:50:09.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:08 smithi116 ceph-mon[34332]: pgmap v390: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-21T05:50:09.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:08 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:50:09.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:08 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:50:09.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:08 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:50:09.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:08 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:50:09.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:08 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:50:09.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:08 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:50:09.305 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:08 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:50:09.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:08 smithi160 ceph-mon[33979]: pgmap v390: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-21T05:50:09.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:08 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:50:09.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:08 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:50:09.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:08 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:50:09.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:08 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:50:09.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:08 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:50:09.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:08 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:50:09.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:08 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:50:10.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:09 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:10.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:09 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:50:10.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:09 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:50:10.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:09 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:10.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:09 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:50:10.304 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:09 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:50:10.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:09 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:10.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:09 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:50:10.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:09 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:50:11.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:11 smithi160 ceph-mon[33979]: pgmap v391: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-21T05:50:11.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:11 smithi070 ceph-mon[30981]: pgmap v391: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-21T05:50:11.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:11 smithi116 ceph-mon[34332]: pgmap v391: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-21T05:50:12.112 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 14.5 2024-09-21T05:50:12.112 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:50:12.393 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:50:12.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.936+0000 7f14af1dc640 1 -- 172.21.15.70:0/3302207124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14a8108d20 msgr2=0x7f14a810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:12.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.937+0000 7f14af1dc640 1 --2- 172.21.15.70:0/3302207124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14a8108d20 0x7f14a810f550 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f14a0009ca0 tx=0x7f14a002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:50:12.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.937+0000 7f14af1dc640 1 -- 172.21.15.70:0/3302207124 shutdown_connections 2024-09-21T05:50:12.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.937+0000 7f14af1dc640 1 --2- 172.21.15.70:0/3302207124 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14a81083d0 0x7f14a81087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:12.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.937+0000 7f14af1dc640 1 --2- 172.21.15.70:0/3302207124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14a8108d20 0x7f14a810f550 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:12.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.937+0000 7f14af1dc640 1 --2- 172.21.15.70:0/3302207124 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14a8102ae0 0x7f14a8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:12.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.937+0000 7f14af1dc640 1 -- 172.21.15.70:0/3302207124 >> 172.21.15.70:0/3302207124 conn(0x7f14a8079790 msgr2=0x7f14a8079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:12.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.937+0000 7f14af1dc640 1 -- 172.21.15.70:0/3302207124 shutdown_connections 2024-09-21T05:50:12.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.937+0000 7f14af1dc640 1 -- 172.21.15.70:0/3302207124 wait complete. 2024-09-21T05:50:12.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.937+0000 7f14af1dc640 1 Processor -- start 2024-09-21T05:50:12.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.938+0000 7f14af1dc640 1 -- start start 2024-09-21T05:50:12.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.938+0000 7f14af1dc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14a8102ae0 0x7f14a81993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:12.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.938+0000 7f14af1dc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14a81083d0 0x7f14a8199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:12.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.938+0000 7f14af1dc640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14a8108d20 0x7f14a819ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:12.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.938+0000 7f14af1dc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f14a81129b0 con 0x7f14a81083d0 2024-09-21T05:50:12.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.938+0000 7f14af1dc640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f14a8112830 con 0x7f14a8102ae0 2024-09-21T05:50:12.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.938+0000 7f14af1dc640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f14a8112b30 con 0x7f14a8108d20 2024-09-21T05:50:12.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.938+0000 7f14a7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14a81083d0 0x7f14a8199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:12.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.938+0000 7f14a7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14a81083d0 0x7f14a8199940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41858/0 (socket says 172.21.15.70:41858) 2024-09-21T05:50:12.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.938+0000 7f14a7fff640 1 -- 172.21.15.70:0/1278862564 learned_addr learned my addr 172.21.15.70:0/1278862564 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:50:12.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.938+0000 7f14acf78640 1 --2- 172.21.15.70:0/1278862564 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14a8102ae0 0x7f14a81993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:12.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.938+0000 7f14ad779640 1 --2- 172.21.15.70:0/1278862564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14a8108d20 0x7f14a819ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:12.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.938+0000 7f14a7fff640 1 -- 172.21.15.70:0/1278862564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14a8108d20 msgr2=0x7f14a819ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:12.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.938+0000 7f14a7fff640 1 --2- 172.21.15.70:0/1278862564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14a8108d20 0x7f14a819ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:12.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.938+0000 7f14a7fff640 1 -- 172.21.15.70:0/1278862564 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14a8102ae0 msgr2=0x7f14a81993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:12.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.938+0000 7f14a7fff640 1 --2- 172.21.15.70:0/1278862564 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14a8102ae0 0x7f14a81993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:12.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.938+0000 7f14a7fff640 1 -- 172.21.15.70:0/1278862564 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14a819f310 con 0x7f14a81083d0 2024-09-21T05:50:12.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.939+0000 7f14a7fff640 1 --2- 172.21.15.70:0/1278862564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14a81083d0 0x7f14a8199940 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f149400d740 tx=0x7f149400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:12.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.939+0000 7f14a5ffb640 1 -- 172.21.15.70:0/1278862564 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1494017070 con 0x7f14a81083d0 2024-09-21T05:50:12.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.939+0000 7f14a5ffb640 1 -- 172.21.15.70:0/1278862564 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f149400de50 con 0x7f14a81083d0 2024-09-21T05:50:12.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.939+0000 7f14af1dc640 1 -- 172.21.15.70:0/1278862564 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14a819f600 con 0x7f14a81083d0 2024-09-21T05:50:12.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.939+0000 7f14a5ffb640 1 -- 172.21.15.70:0/1278862564 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f149400f620 con 0x7f14a81083d0 2024-09-21T05:50:12.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.939+0000 7f14af1dc640 1 -- 172.21.15.70:0/1278862564 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14a81a5d60 con 0x7f14a81083d0 2024-09-21T05:50:12.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.940+0000 7f14af1dc640 1 -- 172.21.15.70:0/1278862564 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14a8103d10 con 0x7f14a81083d0 2024-09-21T05:50:12.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.942+0000 7f14a5ffb640 1 -- 172.21.15.70:0/1278862564 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) ==== 154563+0+0 (secure 0 0 0) 0x7f149401a070 con 0x7f14a81083d0 2024-09-21T05:50:12.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.943+0000 7f14a5ffb640 1 --2- 172.21.15.70:0/1278862564 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f14980b65a0 0x7f14980b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:12.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.943+0000 7f14acf78640 1 --2- 172.21.15.70:0/1278862564 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f14980b65a0 0x7f14980b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:12.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.943+0000 7f14a5ffb640 1 -- 172.21.15.70:0/1278862564 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f14940e71e0 con 0x7f14a81083d0 2024-09-21T05:50:12.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.943+0000 7f14acf78640 1 --2- 172.21.15.70:0/1278862564 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f14980b65a0 0x7f14980b8ab0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f149c005d00 tx=0x7f149c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:12.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:12.946+0000 7f14a5ffb640 1 -- 172.21.15.70:0/1278862564 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f14940ad520 con 0x7f14a81083d0 2024-09-21T05:50:13.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:13.174+0000 7f14af1dc640 1 -- 172.21.15.70:0/1278862564 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f14a8102ef0 con 0x7f14a81083d0 2024-09-21T05:50:13.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:13.174+0000 7f14a5ffb640 1 -- 172.21.15.70:0/1278862564 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11986 (secure 0 0 0) 0x7f14940b1900 con 0x7f14a81083d0 2024-09-21T05:50:13.177 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:50:13.177 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"btime":"2024-09-21T05:49:35:887363+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3519318330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3519318330},{"type":"v1","addr":"172.21.15.70:6835","nonce":3519318330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2706663460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2706663460},{"type":"v1","addr":"172.21.15.70:6837","nonce":2706663460}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:47:06.246985+0000","modified":"2024-09-21T05:49:35.712686+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24628,"mds_2":24611,"mds_3":24610,"mds_4":24598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/1914209867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1914209867},{"type":"v1","addr":"172.21.15.70:6839","nonce":1914209867}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3392175775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3392175775},{"type":"v1","addr":"172.21.15.70:6841","nonce":3392175775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/3543945704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3543945704},{"type":"v1","addr":"172.21.15.160:6833","nonce":3543945704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6833/283778129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":283778129},{"type":"v1","addr":"172.21.15.116:6833","nonce":283778129}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/3787256790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3787256790},{"type":"v1","addr":"172.21.15.116:6835","nonce":3787256790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.160:6835/2001692372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2001692372},{"type":"v1","addr":"172.21.15.160:6835","nonce":2001692372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.160:6837/2558120045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2558120045},{"type":"v1","addr":"172.21.15.160:6837","nonce":2558120045}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24611":{"gid":24611,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/444312934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":444312934},{"type":"v1","addr":"172.21.15.116:6837","nonce":444312934}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.160:6839/1339744282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1339744282},{"type":"v1","addr":"172.21.15.160:6839","nonce":1339744282}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/3952175670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3952175670},{"type":"v1","addr":"172.21.15.116:6839","nonce":3952175670}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24641,"qdb_cluster":[24598,24611,24610,24628,24641]},"id":1}]} 2024-09-21T05:50:13.177 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-09-21T05:50:13.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:13.177+0000 7f14af1dc640 1 -- 172.21.15.70:0/1278862564 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f14980b65a0 msgr2=0x7f14980b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:13.177+0000 7f14af1dc640 1 --2- 172.21.15.70:0/1278862564 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f14980b65a0 0x7f14980b8ab0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f149c005d00 tx=0x7f149c00b410 comp rx=0 tx=0).stop 2024-09-21T05:50:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:13.177+0000 7f14af1dc640 1 -- 172.21.15.70:0/1278862564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14a81083d0 msgr2=0x7f14a8199940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:13.177+0000 7f14af1dc640 1 --2- 172.21.15.70:0/1278862564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14a81083d0 0x7f14a8199940 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f149400d740 tx=0x7f149400dc00 comp rx=0 tx=0).stop 2024-09-21T05:50:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:13.177+0000 7f14af1dc640 1 -- 172.21.15.70:0/1278862564 shutdown_connections 2024-09-21T05:50:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:13.177+0000 7f14af1dc640 1 --2- 172.21.15.70:0/1278862564 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f14980b65a0 0x7f14980b8ab0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:13.177+0000 7f14af1dc640 1 --2- 172.21.15.70:0/1278862564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14a8108d20 0x7f14a819ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:13.177+0000 7f14af1dc640 1 --2- 172.21.15.70:0/1278862564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14a81083d0 0x7f14a8199940 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:13.177+0000 7f14af1dc640 1 --2- 172.21.15.70:0/1278862564 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14a8102ae0 0x7f14a81993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:13.177+0000 7f14af1dc640 1 -- 172.21.15.70:0/1278862564 >> 172.21.15.70:0/1278862564 conn(0x7f14a8079790 msgr2=0x7f14a8106420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:13.177+0000 7f14af1dc640 1 -- 172.21.15.70:0/1278862564 shutdown_connections 2024-09-21T05:50:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:13.177+0000 7f14af1dc640 1 -- 172.21.15.70:0/1278862564 wait complete. 2024-09-21T05:50:13.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:13 smithi160 ceph-mon[33979]: pgmap v392: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-21T05:50:13.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:13 smithi070 ceph-mon[30981]: pgmap v392: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-21T05:50:13.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:13 smithi116 ceph-mon[34332]: pgmap v392: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-21T05:50:13.910 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24641 quiesce db / --timeout 90 --expiration 134.5 --await-for 45.0' 2024-09-21T05:50:13.910 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24641 quiesce db / --timeout 90 --expiration 134.5 --await-for 45.0 2024-09-21T05:50:14.142 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:14 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1278862564' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:14.176 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:50:14.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:14 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1278862564' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:14.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:14 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1278862564' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:15.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:15 smithi160 ceph-mon[33979]: pgmap v393: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 10 op/s 2024-09-21T05:50:15.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:15 smithi070 ceph-mon[30981]: pgmap v393: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 10 op/s 2024-09-21T05:50:15.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:15 smithi116 ceph-mon[34332]: pgmap v393: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 10 op/s 2024-09-21T05:50:17.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:17 smithi160 ceph-mon[33979]: pgmap v394: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T05:50:17.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:17 smithi070 ceph-mon[30981]: pgmap v394: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T05:50:17.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:17 smithi116 ceph-mon[34332]: pgmap v394: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T05:50:17.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.180+0000 7feca02bd640 1 -- 172.21.15.70:0/518327563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec98105320 msgr2=0x7fec9810d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:17.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.180+0000 7feca02bd640 1 --2- 172.21.15.70:0/518327563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec98105320 0x7fec9810d870 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fec88009900 tx=0x7fec8802a410 comp rx=0 tx=0).stop 2024-09-21T05:50:17.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.181+0000 7feca02bd640 1 -- 172.21.15.70:0/518327563 shutdown_connections 2024-09-21T05:50:17.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.181+0000 7feca02bd640 1 --2- 172.21.15.70:0/518327563 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec9810de30 0x7fec98110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.181+0000 7feca02bd640 1 --2- 172.21.15.70:0/518327563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec98105320 0x7fec9810d870 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.181+0000 7feca02bd640 1 --2- 172.21.15.70:0/518327563 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec981049d0 0x7fec98104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.181+0000 7feca02bd640 1 -- 172.21.15.70:0/518327563 >> 172.21.15.70:0/518327563 conn(0x7fec98079760 msgr2=0x7fec98079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:17.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.181+0000 7feca02bd640 1 -- 172.21.15.70:0/518327563 shutdown_connections 2024-09-21T05:50:17.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.181+0000 7feca02bd640 1 -- 172.21.15.70:0/518327563 wait complete. 2024-09-21T05:50:17.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.182+0000 7feca02bd640 1 Processor -- start 2024-09-21T05:50:17.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.182+0000 7feca02bd640 1 -- start start 2024-09-21T05:50:17.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.182+0000 7feca02bd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec981049d0 0x7fec98102710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:17.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.182+0000 7feca02bd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec98105320 0x7fec98102c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:17.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.182+0000 7feca02bd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec9810de30 0x7fec98103190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:17.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.182+0000 7feca02bd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fec98113a60 con 0x7fec9810de30 2024-09-21T05:50:17.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.182+0000 7feca02bd640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fec981138e0 con 0x7fec98105320 2024-09-21T05:50:17.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.182+0000 7feca02bd640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fec98113be0 con 0x7fec981049d0 2024-09-21T05:50:17.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.182+0000 7fec9e85a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec9810de30 0x7fec98103190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:17.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.182+0000 7fec9e85a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec9810de30 0x7fec98103190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41876/0 (socket says 172.21.15.70:41876) 2024-09-21T05:50:17.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.182+0000 7fec9e85a640 1 -- 172.21.15.70:0/3050097228 learned_addr learned my addr 172.21.15.70:0/3050097228 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:50:17.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.182+0000 7fec9d858640 1 --2- 172.21.15.70:0/3050097228 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec98105320 0x7fec98102c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:17.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.182+0000 7fec9e059640 1 --2- 172.21.15.70:0/3050097228 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec981049d0 0x7fec98102710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:17.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.183+0000 7fec9e85a640 1 -- 172.21.15.70:0/3050097228 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec981049d0 msgr2=0x7fec98102710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:17.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.183+0000 7fec9e85a640 1 --2- 172.21.15.70:0/3050097228 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec981049d0 0x7fec98102710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.183+0000 7fec9e85a640 1 -- 172.21.15.70:0/3050097228 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec98105320 msgr2=0x7fec98102c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:17.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.183+0000 7fec9e85a640 1 --2- 172.21.15.70:0/3050097228 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec98105320 0x7fec98102c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.183+0000 7fec9e85a640 1 -- 172.21.15.70:0/3050097228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec981a8770 con 0x7fec9810de30 2024-09-21T05:50:17.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.183+0000 7fec9e85a640 1 --2- 172.21.15.70:0/3050097228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec9810de30 0x7fec98103190 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fec9000eb10 tx=0x7fec9000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:17.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.183+0000 7fec8f7fe640 1 -- 172.21.15.70:0/3050097228 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec90004b20 con 0x7fec9810de30 2024-09-21T05:50:17.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.183+0000 7feca02bd640 1 -- 172.21.15.70:0/3050097228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec981a8a60 con 0x7fec9810de30 2024-09-21T05:50:17.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.183+0000 7feca02bd640 1 -- 172.21.15.70:0/3050097228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec981a8f70 con 0x7fec9810de30 2024-09-21T05:50:17.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.183+0000 7fec8f7fe640 1 -- 172.21.15.70:0/3050097228 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fec90004cc0 con 0x7fec9810de30 2024-09-21T05:50:17.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.183+0000 7fec8f7fe640 1 -- 172.21.15.70:0/3050097228 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec90010690 con 0x7fec9810de30 2024-09-21T05:50:17.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.187+0000 7feca6831740 1 Processor -- start 2024-09-21T05:50:17.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.187+0000 7fec8f7fe640 1 -- 172.21.15.70:0/3050097228 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) ==== 154563+0+0 (secure 0 0 0) 0x7fec90010830 con 0x7fec9810de30 2024-09-21T05:50:17.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.188+0000 7feca6831740 1 -- start start 2024-09-21T05:50:17.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.188+0000 7feca6831740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc47f0d840 0x55bc482b4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:17.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.188+0000 7feca6831740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc47ee4980 0x55bc482b4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:17.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.188+0000 7feca6831740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc47eecb60 0x55bc482b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:17.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.188+0000 7feca6831740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bc4822ab90 con 0x55bc47f0d840 2024-09-21T05:50:17.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.188+0000 7feca6831740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55bc48219fc0 con 0x55bc47ee4980 2024-09-21T05:50:17.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.188+0000 7feca6831740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55bc4821ddd0 con 0x55bc47eecb60 2024-09-21T05:50:17.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.188+0000 7fec9d858640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc47f0d840 0x55bc482b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:17.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.188+0000 7fec9d858640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc47f0d840 0x55bc482b4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41886/0 (socket says 172.21.15.70:41886) 2024-09-21T05:50:17.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.188+0000 7fec9d858640 1 -- 172.21.15.70:0/3733932987 learned_addr learned my addr 172.21.15.70:0/3733932987 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:50:17.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.188+0000 7fec9d858640 1 --2- 172.21.15.70:0/3733932987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc47eecb60 0x55bc482b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:17.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.189+0000 7fec9e059640 1 --2- 172.21.15.70:0/3733932987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc47ee4980 0x55bc482b4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:17.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.189+0000 7fec9d858640 1 -- 172.21.15.70:0/3733932987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc47eecb60 msgr2=0x55bc482b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:50:17.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.189+0000 7fec9d858640 1 --2- 172.21.15.70:0/3733932987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc47eecb60 0x55bc482b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.189+0000 7fec9d858640 1 -- 172.21.15.70:0/3733932987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc47ee4980 msgr2=0x55bc482b4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:50:17.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.189+0000 7fec9d858640 1 --2- 172.21.15.70:0/3733932987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc47ee4980 0x55bc482b4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.189+0000 7fec9d858640 1 -- 172.21.15.70:0/3733932987 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc481a1060 con 0x55bc47f0d840 2024-09-21T05:50:17.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.189+0000 7fec9e059640 1 --2- 172.21.15.70:0/3733932987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc47ee4980 0x55bc482b4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:50:17.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.189+0000 7fec8f7fe640 1 --2- 172.21.15.70:0/3050097228 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fec840b66a0 0x7fec840b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:17.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.189+0000 7fec9e059640 1 --2- 172.21.15.70:0/3050097228 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fec840b66a0 0x7fec840b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:17.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.189+0000 7fec9d858640 1 --2- 172.21.15.70:0/3733932987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc47f0d840 0x55bc482b4600 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fec88009230 tx=0x7fec88009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4126127d50b07ff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:17.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.189+0000 7fec8f7fe640 1 -- 172.21.15.70:0/3050097228 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fec900e7e80 con 0x7fec9810de30 2024-09-21T05:50:17.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.189+0000 7fec8cd9a640 1 -- 172.21.15.70:0/3733932987 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec88044020 con 0x55bc47f0d840 2024-09-21T05:50:17.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.189+0000 7fec8cd9a640 1 -- 172.21.15.70:0/3733932987 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fec880054f0 con 0x55bc47f0d840 2024-09-21T05:50:17.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.190+0000 7fec8cd9a640 1 -- 172.21.15.70:0/3733932987 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec88035040 con 0x55bc47f0d840 2024-09-21T05:50:17.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.190+0000 7feca6831740 1 -- 172.21.15.70:0/3733932987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc47f0d840 msgr2=0x55bc482b4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:17.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.190+0000 7feca6831740 1 --2- 172.21.15.70:0/3733932987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc47f0d840 0x55bc482b4600 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fec88009230 tx=0x7fec88009560 comp rx=0 tx=0).stop 2024-09-21T05:50:17.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.190+0000 7fec9e059640 1 --2- 172.21.15.70:0/3050097228 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fec840b66a0 0x7fec840b8bb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55bc482b3280 tx=0x7fec94005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:17.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.190+0000 7feca6831740 1 -- 172.21.15.70:0/3733932987 shutdown_connections 2024-09-21T05:50:17.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.190+0000 7feca6831740 1 --2- 172.21.15.70:0/3733932987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc47eecb60 0x55bc482b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.190+0000 7feca6831740 1 --2- 172.21.15.70:0/3733932987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc47ee4980 0x55bc482b4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.190+0000 7feca6831740 1 --2- 172.21.15.70:0/3733932987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc47f0d840 0x55bc482b4600 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.190+0000 7feca6831740 1 -- 172.21.15.70:0/3733932987 >> 172.21.15.70:0/3733932987 conn(0x55bc47f01990 msgr2=0x55bc482b24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:17.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.191+0000 7feca6831740 1 -- 172.21.15.70:0/3733932987 shutdown_connections 2024-09-21T05:50:17.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.191+0000 7feca6831740 1 -- 172.21.15.70:0/3733932987 wait complete. 2024-09-21T05:50:17.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.191+0000 7feca6831740 1 -- start start 2024-09-21T05:50:17.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.191+0000 7feca6831740 1 Processor -- start 2024-09-21T05:50:17.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.192+0000 7feca6831740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc47ee4980 0x55bc482c0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:17.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.192+0000 7feca6831740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc47eecb60 0x55bc482c0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:17.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.192+0000 7feca6831740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc47f0d840 0x55bc482cc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:17.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.192+0000 7feca6831740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bc4807b7a0 con 0x55bc47f0d840 2024-09-21T05:50:17.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.192+0000 7fec9e059640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc47ee4980 0x55bc482c0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:17.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.192+0000 7fec9e059640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc47ee4980 0x55bc482c0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.70:56798/0 (socket says 172.21.15.70:56798) 2024-09-21T05:50:17.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.192+0000 7fec9e059640 1 -- 172.21.15.70:0/1303764519 learned_addr learned my addr 172.21.15.70:0/1303764519 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:50:17.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.192+0000 7fec9e85a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc47f0d840 0x55bc482cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:17.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.192+0000 7feca6831740 1 -- 172.21.15.70:0/1303764519 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55bc481bf0a0 con 0x55bc47eecb60 2024-09-21T05:50:17.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.192+0000 7fec9d858640 1 --2- 172.21.15.70:0/1303764519 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc47eecb60 0x55bc482c0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:17.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.192+0000 7feca6831740 1 -- 172.21.15.70:0/1303764519 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55bc482c2e20 con 0x55bc47ee4980 2024-09-21T05:50:17.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.193+0000 7feca6831740 10 client.0 _ll_register_callbacks cb 0x55bc4819c3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:50:17.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.193+0000 7fec9e85a640 1 -- 172.21.15.70:0/1303764519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc47ee4980 msgr2=0x55bc482c0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:50:17.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.193+0000 7fec9e85a640 1 --2- 172.21.15.70:0/1303764519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc47ee4980 0x55bc482c0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.193+0000 7fec9e85a640 1 -- 172.21.15.70:0/1303764519 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc47eecb60 msgr2=0x55bc482c0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:50:17.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.193+0000 7fec9e85a640 1 --2- 172.21.15.70:0/1303764519 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc47eecb60 0x55bc482c0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.193+0000 7fec9e85a640 1 -- 172.21.15.70:0/1303764519 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc481ad880 con 0x55bc47f0d840 2024-09-21T05:50:17.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.193+0000 7fec9e059640 1 --2- 172.21.15.70:0/1303764519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc47ee4980 0x55bc482c0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:50:17.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.193+0000 7fec9e85a640 1 --2- 172.21.15.70:0/1303764519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc47f0d840 0x55bc482cc110 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fec900e53b0 tx=0x7fec900ad8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=746aa7f4bac8ab7b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:17.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.193+0000 7fec81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:50:17.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.193+0000 7fec81ffb640 1 -- 172.21.15.70:0/1303764519 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec900b2070 con 0x55bc47f0d840 2024-09-21T05:50:17.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.193+0000 7feca6831740 1 -- 172.21.15.70:0/1303764519 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec880054f0 con 0x55bc47f0d840 2024-09-21T05:50:17.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.193+0000 7fec81ffb640 1 -- 172.21.15.70:0/1303764519 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fec900b2210 con 0x55bc47f0d840 2024-09-21T05:50:17.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.194+0000 7fec81ffb640 1 -- 172.21.15.70:0/1303764519 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fec900ae160 con 0x55bc47f0d840 2024-09-21T05:50:17.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.194+0000 7feca6831740 10 client.15657 fetch_fsmap learned FSMap version 28 2024-09-21T05:50:17.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.194+0000 7feca6831740 1 -- 172.21.15.70:0/1303764519 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bc47f87b90 con 0x55bc47f0d840 2024-09-21T05:50:17.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.194+0000 7fec81ffb640 1 -- 172.21.15.70:0/1303764519 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fec880054f0 con 0x55bc47f0d840 2024-09-21T05:50:17.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.194+0000 7fec81ffb640 1 -- 172.21.15.70:0/1303764519 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fec900a93b0 con 0x55bc47f0d840 2024-09-21T05:50:17.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.194+0000 7feca6831740 10 client.15657 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T05:50:17.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.194+0000 7feca6831740 10 client.15657 resolve_mds: validated gid 24641 aka daemon mds.b 2024-09-21T05:50:17.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.194+0000 7feca6831740 20 client.15657 populate_metadata read hostname 'smithi070' 2024-09-21T05:50:17.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.194+0000 7feca6831740 1 --2- 172.21.15.70:0/1303764519 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55bc47ecc1c0 0x55bc482d2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:17.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.194+0000 7feca6831740 4 client.15657 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:50:17.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.194+0000 7feca6831740 1 -- 172.21.15.70:0/1303764519 --> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc4822cae0 con 0x55bc47ecc1c0 2024-09-21T05:50:17.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.195+0000 7fec9e059640 1 --2- 172.21.15.70:0/1303764519 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55bc47ecc1c0 0x55bc482d2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:17.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.195+0000 7fec9e059640 1 --2- 172.21.15.70:0/1303764519 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55bc47ecc1c0 0x55bc482d2600 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc3ef34c20b547e6 server_cookie=8516ece6b3dcc230 in_seq=0 out_seq=0 2024-09-21T05:50:17.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.195+0000 7fec81ffb640 10 client.15657 ms_handle_connect on v2:172.21.15.116:6838/3952175670 2024-09-21T05:50:17.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.196+0000 7fec81ffb640 1 -- 172.21.15.70:0/1303764519 <== mds.0 v2:172.21.15.116:6838/3952175670 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bc4822cae0 con 0x55bc47ecc1c0 2024-09-21T05:50:17.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.196+0000 7fec81ffb640 10 client.15657 handle_command_reply: tid=0 2024-09-21T05:50:17.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.196+0000 7feca6831740 1 client.15657 shutdown 2024-09-21T05:50:17.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.196+0000 7feca6831740 1 -- 172.21.15.70:0/1303764519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc47f0d840 msgr2=0x55bc482cc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:17.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.196+0000 7feca6831740 1 --2- 172.21.15.70:0/1303764519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc47f0d840 0x55bc482cc110 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fec900e53b0 tx=0x7fec900ad8f0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.196+0000 7feca6831740 1 -- 172.21.15.70:0/1303764519 shutdown_connections 2024-09-21T05:50:17.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.196+0000 7feca6831740 1 --2- 172.21.15.70:0/1303764519 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55bc47ecc1c0 0x55bc482d2600 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.196+0000 7feca6831740 1 --2- 172.21.15.70:0/1303764519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc47f0d840 0x55bc482cc110 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.196+0000 7feca6831740 1 --2- 172.21.15.70:0/1303764519 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc47eecb60 0x55bc482c0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.196+0000 7feca6831740 1 --2- 172.21.15.70:0/1303764519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc47ee4980 0x55bc482c0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.196+0000 7feca6831740 1 -- 172.21.15.70:0/1303764519 >> 172.21.15.70:0/1303764519 conn(0x55bc47f01990 msgr2=0x55bc482b5630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:17.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.196+0000 7fec81ffb640 0 client.15657 ms_handle_reset on v2:172.21.15.116:6838/3952175670 2024-09-21T05:50:17.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.196+0000 7feca6831740 1 -- 172.21.15.70:0/1303764519 shutdown_connections 2024-09-21T05:50:17.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.196+0000 7feca6831740 1 -- 172.21.15.70:0/1303764519 wait complete. 2024-09-21T05:50:17.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.196+0000 7feca6831740 20 client.15657 trim_cache size 0 max 16384 2024-09-21T05:50:17.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.213+0000 7feca6831740 1 Processor -- start 2024-09-21T05:50:17.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.213+0000 7feca6831740 1 -- start start 2024-09-21T05:50:17.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.214+0000 7feca6831740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc47ee4980 0x55bc482be880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:17.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.214+0000 7feca6831740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc47eecb60 0x55bc482b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:17.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.214+0000 7feca6831740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc47f0d840 0x55bc482b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:17.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.214+0000 7feca6831740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fec981b2e10 con 0x55bc47f0d840 2024-09-21T05:50:17.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.214+0000 7feca6831740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fec981b4950 con 0x55bc47ee4980 2024-09-21T05:50:17.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.214+0000 7feca6831740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fec981b34e0 con 0x55bc47eecb60 2024-09-21T05:50:17.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.214+0000 7fec9e85a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc47f0d840 0x55bc482b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:17.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.214+0000 7fec9e85a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc47f0d840 0x55bc482b2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41916/0 (socket says 172.21.15.70:41916) 2024-09-21T05:50:17.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.214+0000 7fec9e85a640 1 -- 172.21.15.70:0/287309651 learned_addr learned my addr 172.21.15.70:0/287309651 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:50:17.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.214+0000 7fec9e059640 1 --2- 172.21.15.70:0/287309651 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc47ee4980 0x55bc482be880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:17.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.214+0000 7fec9e85a640 1 -- 172.21.15.70:0/287309651 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc47eecb60 msgr2=0x55bc482b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:50:17.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.214+0000 7fec9d858640 1 --2- 172.21.15.70:0/287309651 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc47eecb60 0x55bc482b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:17.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.214+0000 7fec9e85a640 1 --2- 172.21.15.70:0/287309651 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc47eecb60 0x55bc482b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.214+0000 7fec9e85a640 1 -- 172.21.15.70:0/287309651 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc47ee4980 msgr2=0x55bc482be880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:50:17.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.214+0000 7fec9e85a640 1 --2- 172.21.15.70:0/287309651 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc47ee4980 0x55bc482be880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.214+0000 7fec9e85a640 1 -- 172.21.15.70:0/287309651 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc482bb890 con 0x55bc47f0d840 2024-09-21T05:50:17.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.214+0000 7fec9d858640 1 --2- 172.21.15.70:0/287309651 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc47eecb60 0x55bc482b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:50:17.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.214+0000 7fec9e85a640 1 --2- 172.21.15.70:0/287309651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc47f0d840 0x55bc482b2370 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fec9000cfb0 tx=0x7fec900d5160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c292b824d2a7401f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:17.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.215+0000 7fec83fff640 1 -- 172.21.15.70:0/287309651 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec900b2040 con 0x55bc47f0d840 2024-09-21T05:50:17.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.215+0000 7fec83fff640 1 -- 172.21.15.70:0/287309651 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fec900b2540 con 0x55bc47f0d840 2024-09-21T05:50:17.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.215+0000 7fec83fff640 1 -- 172.21.15.70:0/287309651 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec900ad1d0 con 0x55bc47f0d840 2024-09-21T05:50:17.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.215+0000 7feca6831740 1 -- 172.21.15.70:0/287309651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc47f0d840 msgr2=0x55bc482b2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:17.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.215+0000 7feca6831740 1 --2- 172.21.15.70:0/287309651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc47f0d840 0x55bc482b2370 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fec9000cfb0 tx=0x7fec900d5160 comp rx=0 tx=0).stop 2024-09-21T05:50:17.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.216+0000 7feca6831740 1 -- 172.21.15.70:0/287309651 shutdown_connections 2024-09-21T05:50:17.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.216+0000 7feca6831740 1 --2- 172.21.15.70:0/287309651 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc47eecb60 0x55bc482b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.216+0000 7feca6831740 1 --2- 172.21.15.70:0/287309651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc47f0d840 0x55bc482b2370 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.216+0000 7feca6831740 1 --2- 172.21.15.70:0/287309651 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc47ee4980 0x55bc482be880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.216+0000 7feca6831740 1 -- 172.21.15.70:0/287309651 >> 172.21.15.70:0/287309651 conn(0x55bc47f01990 msgr2=0x55bc482c0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:17.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.216+0000 7feca6831740 1 -- 172.21.15.70:0/287309651 shutdown_connections 2024-09-21T05:50:17.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.216+0000 7feca6831740 1 -- 172.21.15.70:0/287309651 wait complete. 2024-09-21T05:50:17.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.216+0000 7feca6831740 1 -- start start 2024-09-21T05:50:17.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.216+0000 7feca6831740 1 Processor -- start 2024-09-21T05:50:17.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.216+0000 7feca6831740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc47ee4980 0x55bc482c8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:17.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.216+0000 7feca6831740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc47eecb60 0x55bc482c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:17.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.217+0000 7feca6831740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc47f0d840 0x55bc482c3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:17.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.217+0000 7feca6831740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fec981b4280 con 0x55bc47f0d840 2024-09-21T05:50:17.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.217+0000 7feca6831740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fec981b3bb0 con 0x55bc47eecb60 2024-09-21T05:50:17.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.217+0000 7feca6831740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fec981b0df0 con 0x55bc47ee4980 2024-09-21T05:50:17.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.217+0000 7feca6831740 10 client.0 _ll_register_callbacks cb 0x7fec900057a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:50:17.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.217+0000 7fec9e85a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc47f0d840 0x55bc482c3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:17.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.217+0000 7fec9d858640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc47eecb60 0x55bc482c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:17.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.217+0000 7fec9e85a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc47f0d840 0x55bc482c3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41932/0 (socket says 172.21.15.70:41932) 2024-09-21T05:50:17.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.217+0000 7fec9e85a640 1 -- 172.21.15.70:0/1793413078 learned_addr learned my addr 172.21.15.70:0/1793413078 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:50:17.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.217+0000 7fec9e059640 1 --2- 172.21.15.70:0/1793413078 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc47ee4980 0x55bc482c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:17.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.217+0000 7fec9e85a640 1 -- 172.21.15.70:0/1793413078 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc47ee4980 msgr2=0x55bc482c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:50:17.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.217+0000 7fec9e85a640 1 --2- 172.21.15.70:0/1793413078 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc47ee4980 0x55bc482c8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.217+0000 7fec9e85a640 1 -- 172.21.15.70:0/1793413078 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc47eecb60 msgr2=0x55bc482c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:50:17.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.217+0000 7fec9e85a640 1 --2- 172.21.15.70:0/1793413078 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc47eecb60 0x55bc482c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.217+0000 7fec9e85a640 1 -- 172.21.15.70:0/1793413078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc482c36a0 con 0x55bc47f0d840 2024-09-21T05:50:17.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.217+0000 7fec9e059640 1 --2- 172.21.15.70:0/1793413078 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc47ee4980 0x55bc482c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:50:17.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.217+0000 7fec9e85a640 1 --2- 172.21.15.70:0/1793413078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc47f0d840 0x55bc482c3030 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fec900aa220 tx=0x7fec900a9900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b906bb226db78a74 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:17.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.217+0000 7fec81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:50:17.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.218+0000 7fec81ffb640 1 -- 172.21.15.70:0/1793413078 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec900b2040 con 0x55bc47f0d840 2024-09-21T05:50:17.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.218+0000 7fec81ffb640 1 -- 172.21.15.70:0/1793413078 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fec900ac730 con 0x55bc47f0d840 2024-09-21T05:50:17.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.218+0000 7feca6831740 1 -- 172.21.15.70:0/1793413078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec900b2540 con 0x55bc47f0d840 2024-09-21T05:50:17.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.218+0000 7fec81ffb640 1 -- 172.21.15.70:0/1793413078 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fec900ad1d0 con 0x55bc47f0d840 2024-09-21T05:50:17.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.218+0000 7feca6831740 10 client.15663 fetch_fsmap learned FSMap version 28 2024-09-21T05:50:17.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.218+0000 7feca6831740 1 -- 172.21.15.70:0/1793413078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bc48346040 con 0x55bc47f0d840 2024-09-21T05:50:17.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.218+0000 7fec81ffb640 1 -- 172.21.15.70:0/1793413078 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fec900b7480 con 0x55bc47f0d840 2024-09-21T05:50:17.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.218+0000 7fec81ffb640 1 -- 172.21.15.70:0/1793413078 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fec900cfa70 con 0x55bc47f0d840 2024-09-21T05:50:17.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.218+0000 7feca6831740 10 client.15663 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T05:50:17.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.218+0000 7feca6831740 10 client.15663 resolve_mds: validated gid 24641 aka daemon mds.b 2024-09-21T05:50:17.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.218+0000 7feca6831740 20 client.15663 populate_metadata read hostname 'smithi070' 2024-09-21T05:50:17.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.219+0000 7feca6831740 1 --2- 172.21.15.70:0/1793413078 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55bc47ea1570 0x55bc48348590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:17.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.219+0000 7feca6831740 4 client.15663 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 134.5, "await_for": 45.0}] 2024-09-21T05:50:17.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.219+0000 7feca6831740 1 -- 172.21.15.70:0/1793413078 --> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 134.5, "await_for": 45.0}) -- 0x7fec900b2540 con 0x55bc47ea1570 2024-09-21T05:50:17.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.219+0000 7fec9e059640 1 --2- 172.21.15.70:0/1793413078 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55bc47ea1570 0x55bc48348590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:17.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.219+0000 7fec9e059640 1 --2- 172.21.15.70:0/1793413078 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55bc47ea1570 0x55bc48348590 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d36ee6095dc8c49d server_cookie=c0b1743f01cb2d5b in_seq=0 out_seq=0 2024-09-21T05:50:17.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.219+0000 7fec81ffb640 10 client.15663 ms_handle_connect on v2:172.21.15.116:6838/3952175670 2024-09-21T05:50:17.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.229+0000 7fec81ffb640 1 -- 172.21.15.70:0/1793413078 <== mds.0 v2:172.21.15.116:6838/3952175670 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7fec900b2540 con 0x55bc47ea1570 2024-09-21T05:50:17.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.229+0000 7fec81ffb640 10 client.15663 handle_command_reply: tid=0 2024-09-21T05:50:17.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.229+0000 7feca6831740 1 client.15663 shutdown 2024-09-21T05:50:17.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.229+0000 7feca6831740 1 -- 172.21.15.70:0/1793413078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc47f0d840 msgr2=0x55bc482c3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:17.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.229+0000 7feca6831740 1 --2- 172.21.15.70:0/1793413078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc47f0d840 0x55bc482c3030 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fec900aa220 tx=0x7fec900a9900 comp rx=0 tx=0).stop 2024-09-21T05:50:17.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.229+0000 7feca6831740 1 -- 172.21.15.70:0/1793413078 shutdown_connections 2024-09-21T05:50:17.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.229+0000 7feca6831740 1 --2- 172.21.15.70:0/1793413078 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55bc47ea1570 0x55bc48348590 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.229+0000 7feca6831740 1 --2- 172.21.15.70:0/1793413078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc47f0d840 0x55bc482c3030 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.841 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:50:17.841 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 28, 2024-09-21T05:50:17.841 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 24641, 2024-09-21T05:50:17.841 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 2, 2024-09-21T05:50:17.841 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-09-21T05:50:17.841 INFO:teuthology.orchestra.run.smithi070.stdout: "6f095311": { 2024-09-21T05:50:17.841 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 2, 2024-09-21T05:50:17.841 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-09-21T05:50:17.841 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-09-21T05:50:17.841 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-09-21T05:50:17.842 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-09-21T05:50:17.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:50:17.842 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 90.0, 2024-09-21T05:50:17.842 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 134.5, 2024-09-21T05:50:17.842 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-09-21T05:50:17.842 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-09-21T05:50:17.842 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-09-21T05:50:17.842 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-09-21T05:50:17.842 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-09-21T05:50:17.842 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-09-21T05:50:17.842 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:50:17.842 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:50:17.842 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:50:17.842 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:50:17.842 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:50:17.843 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:50:17.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.229+0000 7feca6831740 1 --2- 172.21.15.70:0/1793413078 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc47eecb60 0x55bc482c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.229+0000 7feca6831740 1 --2- 172.21.15.70:0/1793413078 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bc47ee4980 0x55bc482c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.229+0000 7feca6831740 1 -- 172.21.15.70:0/1793413078 >> 172.21.15.70:0/1793413078 conn(0x55bc47f01990 msgr2=0x55bc482b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:17.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.230+0000 7fec81ffb640 0 client.15663 ms_handle_reset on v2:172.21.15.116:6838/3952175670 2024-09-21T05:50:17.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.230+0000 7feca6831740 1 -- 172.21.15.70:0/1793413078 shutdown_connections 2024-09-21T05:50:17.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.230+0000 7feca6831740 1 -- 172.21.15.70:0/1793413078 wait complete. 2024-09-21T05:50:17.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.230+0000 7feca6831740 20 client.15663 trim_cache size 0 max 16384 2024-09-21T05:50:17.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.230+0000 7feca02bd640 1 -- 172.21.15.70:0/3050097228 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fec840b66a0 msgr2=0x7fec840b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:17.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.230+0000 7feca02bd640 1 --2- 172.21.15.70:0/3050097228 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fec840b66a0 0x7fec840b8bb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55bc482b3280 tx=0x7fec94005f90 comp rx=0 tx=0).stop 2024-09-21T05:50:17.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.230+0000 7feca02bd640 1 -- 172.21.15.70:0/3050097228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec9810de30 msgr2=0x7fec98103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:17.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.230+0000 7feca02bd640 1 --2- 172.21.15.70:0/3050097228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec9810de30 0x7fec98103190 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fec9000eb10 tx=0x7fec9000c2d0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.231+0000 7feca02bd640 1 -- 172.21.15.70:0/3050097228 shutdown_connections 2024-09-21T05:50:17.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.231+0000 7feca02bd640 1 --2- 172.21.15.70:0/3050097228 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fec840b66a0 0x7fec840b8bb0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.231+0000 7feca02bd640 1 --2- 172.21.15.70:0/3050097228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec9810de30 0x7fec98103190 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.231+0000 7feca02bd640 1 --2- 172.21.15.70:0/3050097228 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec98105320 0x7fec98102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.231+0000 7feca02bd640 1 --2- 172.21.15.70:0/3050097228 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec981049d0 0x7fec98102710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:17.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.231+0000 7feca02bd640 1 -- 172.21.15.70:0/3050097228 >> 172.21.15.70:0/3050097228 conn(0x7fec98079760 msgr2=0x7fec98100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:17.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.231+0000 7feca02bd640 1 -- 172.21.15.70:0/3050097228 shutdown_connections 2024-09-21T05:50:17.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:17.231+0000 7feca02bd640 1 -- 172.21.15.70:0/3050097228 wait complete. 2024-09-21T05:50:18.762 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6f095311', quiesce took 6.7 seconds. Will release after: 7.8 2024-09-21T05:50:19.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:19 smithi070 ceph-mon[30981]: pgmap v395: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T05:50:19.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:19 smithi116 ceph-mon[34332]: pgmap v395: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T05:50:19.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:19 smithi160 ceph-mon[33979]: pgmap v395: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T05:50:21.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:21 smithi070 ceph-mon[30981]: pgmap v396: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T05:50:21.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:21 smithi116 ceph-mon[34332]: pgmap v396: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T05:50:21.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:21 smithi160 ceph-mon[33979]: pgmap v396: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T05:50:23.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:23 smithi070 ceph-mon[30981]: pgmap v397: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T05:50:23.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:23 smithi116 ceph-mon[34332]: pgmap v397: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T05:50:23.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:23 smithi160 ceph-mon[33979]: pgmap v397: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T05:50:25.450 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:25 smithi160 ceph-mon[33979]: pgmap v398: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-21T05:50:25.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:25 smithi070 ceph-mon[30981]: pgmap v398: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-21T05:50:25.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:25 smithi116 ceph-mon[34332]: pgmap v398: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-21T05:50:26.563 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:50:26.843 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:50:27.245 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:27 smithi070 ceph-mon[30981]: pgmap v399: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:50:27.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.458+0000 7efc05bfe640 1 -- 172.21.15.70:0/309772675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc001094b0 msgr2=0x7efc001098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:27.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.458+0000 7efc05bfe640 1 --2- 172.21.15.70:0/309772675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc001094b0 0x7efc001098c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7efbf4009900 tx=0x7efbf402a410 comp rx=0 tx=0).stop 2024-09-21T05:50:27.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.458+0000 7efc05bfe640 1 -- 172.21.15.70:0/309772675 shutdown_connections 2024-09-21T05:50:27.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.458+0000 7efc05bfe640 1 --2- 172.21.15.70:0/309772675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc00109e00 0x7efc00110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:27.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.458+0000 7efc05bfe640 1 --2- 172.21.15.70:0/309772675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc001094b0 0x7efc001098c0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:27.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.458+0000 7efc05bfe640 1 --2- 172.21.15.70:0/309772675 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc00101f70 0x7efc00102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:27.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.458+0000 7efc05bfe640 1 -- 172.21.15.70:0/309772675 >> 172.21.15.70:0/309772675 conn(0x7efc00077c60 msgr2=0x7efc000780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:27.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.458+0000 7efc05bfe640 1 -- 172.21.15.70:0/309772675 shutdown_connections 2024-09-21T05:50:27.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.458+0000 7efc05bfe640 1 -- 172.21.15.70:0/309772675 wait complete. 2024-09-21T05:50:27.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.459+0000 7efc05bfe640 1 Processor -- start 2024-09-21T05:50:27.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.460+0000 7efc05bfe640 1 -- start start 2024-09-21T05:50:27.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.460+0000 7efc05bfe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc00101f70 0x7efc0019a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:27.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.460+0000 7efc05bfe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc001094b0 0x7efc0019a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:27.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.460+0000 7efbff7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc00101f70 0x7efc0019a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:27.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.460+0000 7efbff7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc00101f70 0x7efc0019a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36458/0 (socket says 172.21.15.70:36458) 2024-09-21T05:50:27.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.460+0000 7efbff7fe640 1 -- 172.21.15.70:0/2839226369 learned_addr learned my addr 172.21.15.70:0/2839226369 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:50:27.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.460+0000 7efc05bfe640 1 --2- 172.21.15.70:0/2839226369 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc00109e00 0x7efc0019fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:27.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.460+0000 7efc05bfe640 1 -- 172.21.15.70:0/2839226369 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efc00113a90 con 0x7efc00101f70 2024-09-21T05:50:27.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.460+0000 7efc05bfe640 1 -- 172.21.15.70:0/2839226369 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7efc00113910 con 0x7efc00109e00 2024-09-21T05:50:27.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.460+0000 7efc05bfe640 1 -- 172.21.15.70:0/2839226369 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7efc00113c10 con 0x7efc001094b0 2024-09-21T05:50:27.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.461+0000 7efbfeffd640 1 --2- 172.21.15.70:0/2839226369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc001094b0 0x7efc0019a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:27.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.461+0000 7efbfffff640 1 --2- 172.21.15.70:0/2839226369 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc00109e00 0x7efc0019fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:27.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.461+0000 7efbff7fe640 1 -- 172.21.15.70:0/2839226369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc001094b0 msgr2=0x7efc0019a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:27.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.461+0000 7efbff7fe640 1 --2- 172.21.15.70:0/2839226369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc001094b0 0x7efc0019a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:27.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.461+0000 7efbff7fe640 1 -- 172.21.15.70:0/2839226369 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc00109e00 msgr2=0x7efc0019fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:27.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.461+0000 7efbff7fe640 1 --2- 172.21.15.70:0/2839226369 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc00109e00 0x7efc0019fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:27.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.461+0000 7efbff7fe640 1 -- 172.21.15.70:0/2839226369 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc001a01c0 con 0x7efc00101f70 2024-09-21T05:50:27.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.461+0000 7efbff7fe640 1 --2- 172.21.15.70:0/2839226369 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc00101f70 0x7efc0019a250 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7efbf000bf40 tx=0x7efbf000dd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:27.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.462+0000 7efbfcff9640 1 -- 172.21.15.70:0/2839226369 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf001c070 con 0x7efc00101f70 2024-09-21T05:50:27.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.462+0000 7efbfcff9640 1 -- 172.21.15.70:0/2839226369 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7efbf001a070 con 0x7efc00101f70 2024-09-21T05:50:27.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.462+0000 7efbfcff9640 1 -- 172.21.15.70:0/2839226369 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf0009a80 con 0x7efc00101f70 2024-09-21T05:50:27.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.462+0000 7efc05bfe640 1 -- 172.21.15.70:0/2839226369 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc001a04b0 con 0x7efc00101f70 2024-09-21T05:50:27.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.462+0000 7efc05bfe640 1 -- 172.21.15.70:0/2839226369 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc00102df0 con 0x7efc00101f70 2024-09-21T05:50:27.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.463+0000 7efc05bfe640 1 -- 172.21.15.70:0/2839226369 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc0006ac50 con 0x7efc00101f70 2024-09-21T05:50:27.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.466+0000 7efbfcff9640 1 -- 172.21.15.70:0/2839226369 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) ==== 154563+0+0 (secure 0 0 0) 0x7efbf0005140 con 0x7efc00101f70 2024-09-21T05:50:27.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.467+0000 7efbfcff9640 1 --2- 172.21.15.70:0/2839226369 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7efbe80b66a0 0x7efbe80b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:27.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.467+0000 7efbfeffd640 1 --2- 172.21.15.70:0/2839226369 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7efbe80b66a0 0x7efbe80b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:27.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.468+0000 7efbfcff9640 1 -- 172.21.15.70:0/2839226369 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7efbf00ef7e0 con 0x7efc00101f70 2024-09-21T05:50:27.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.468+0000 7efbfeffd640 1 --2- 172.21.15.70:0/2839226369 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7efbe80b66a0 0x7efbe80b8bb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7efbf4005ab0 tx=0x7efbf400b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:27.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.473+0000 7efbfcff9640 1 -- 172.21.15.70:0/2839226369 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efbf00b5ac0 con 0x7efc00101f70 2024-09-21T05:50:27.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:27 smithi116 ceph-mon[34332]: pgmap v399: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:50:27.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:27 smithi160 ceph-mon[33979]: pgmap v399: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:50:27.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.920+0000 7efc05bfe640 1 -- 172.21.15.70:0/2839226369 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc0019b380 con 0x7efc00101f70 2024-09-21T05:50:27.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.921+0000 7efbfcff9640 1 -- 172.21.15.70:0/2839226369 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11986 (secure 0 0 0) 0x7efbf00b9ea0 con 0x7efc00101f70 2024-09-21T05:50:27.923 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:50:27.924 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"btime":"2024-09-21T05:49:35:887363+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3519318330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3519318330},{"type":"v1","addr":"172.21.15.70:6835","nonce":3519318330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2706663460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2706663460},{"type":"v1","addr":"172.21.15.70:6837","nonce":2706663460}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:47:06.246985+0000","modified":"2024-09-21T05:49:35.712686+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24628,"mds_2":24611,"mds_3":24610,"mds_4":24598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/1914209867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1914209867},{"type":"v1","addr":"172.21.15.70:6839","nonce":1914209867}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3392175775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3392175775},{"type":"v1","addr":"172.21.15.70:6841","nonce":3392175775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/3543945704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3543945704},{"type":"v1","addr":"172.21.15.160:6833","nonce":3543945704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6833/283778129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":283778129},{"type":"v1","addr":"172.21.15.116:6833","nonce":283778129}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/3787256790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3787256790},{"type":"v1","addr":"172.21.15.116:6835","nonce":3787256790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.160:6835/2001692372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2001692372},{"type":"v1","addr":"172.21.15.160:6835","nonce":2001692372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.160:6837/2558120045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2558120045},{"type":"v1","addr":"172.21.15.160:6837","nonce":2558120045}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24611":{"gid":24611,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/444312934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":444312934},{"type":"v1","addr":"172.21.15.116:6837","nonce":444312934}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.160:6839/1339744282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1339744282},{"type":"v1","addr":"172.21.15.160:6839","nonce":1339744282}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/3952175670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3952175670},{"type":"v1","addr":"172.21.15.116:6839","nonce":3952175670}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24641,"qdb_cluster":[24598,24611,24610,24628,24641]},"id":1}]} 2024-09-21T05:50:27.924 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-09-21T05:50:27.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.924+0000 7efc05bfe640 1 -- 172.21.15.70:0/2839226369 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7efbe80b66a0 msgr2=0x7efbe80b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:27.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.924+0000 7efc05bfe640 1 --2- 172.21.15.70:0/2839226369 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7efbe80b66a0 0x7efbe80b8bb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7efbf4005ab0 tx=0x7efbf400b040 comp rx=0 tx=0).stop 2024-09-21T05:50:27.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.924+0000 7efc05bfe640 1 -- 172.21.15.70:0/2839226369 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc00101f70 msgr2=0x7efc0019a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:27.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.924+0000 7efc05bfe640 1 --2- 172.21.15.70:0/2839226369 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc00101f70 0x7efc0019a250 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7efbf000bf40 tx=0x7efbf000dd60 comp rx=0 tx=0).stop 2024-09-21T05:50:27.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.924+0000 7efc05bfe640 1 -- 172.21.15.70:0/2839226369 shutdown_connections 2024-09-21T05:50:27.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.924+0000 7efc05bfe640 1 --2- 172.21.15.70:0/2839226369 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7efbe80b66a0 0x7efbe80b8bb0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:27.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.925+0000 7efc05bfe640 1 --2- 172.21.15.70:0/2839226369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc001094b0 0x7efc0019a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:27.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.925+0000 7efc05bfe640 1 --2- 172.21.15.70:0/2839226369 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc00109e00 0x7efc0019fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:27.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.925+0000 7efc05bfe640 1 --2- 172.21.15.70:0/2839226369 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc00101f70 0x7efc0019a250 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:27.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.925+0000 7efc05bfe640 1 -- 172.21.15.70:0/2839226369 >> 172.21.15.70:0/2839226369 conn(0x7efc00077c60 msgr2=0x7efc00107360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:27.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.925+0000 7efc05bfe640 1 -- 172.21.15.70:0/2839226369 shutdown_connections 2024-09-21T05:50:27.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:27.925+0000 7efc05bfe640 1 -- 172.21.15.70:0/2839226369 wait complete. 2024-09-21T05:50:28.207 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:28 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2839226369' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:28.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:28 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2839226369' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:28.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:28 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2839226369' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:28.770 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24641 quiesce db --set-id 6f095311 --release --await' 2024-09-21T05:50:28.770 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24641 quiesce db --set-id 6f095311 --release --await 2024-09-21T05:50:29.175 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:50:29.450 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:29 smithi070 ceph-mon[30981]: pgmap v400: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-21T05:50:29.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:29 smithi116 ceph-mon[34332]: pgmap v400: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-21T05:50:29.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:29 smithi160 ceph-mon[33979]: pgmap v400: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-21T05:50:29.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.755+0000 7f90e3f6e640 1 -- 172.21.15.70:0/365591683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90dc103180 msgr2=0x7f90dc103590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:29.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.755+0000 7f90e3f6e640 1 --2- 172.21.15.70:0/365591683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90dc103180 0x7f90dc103590 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f90d8009900 tx=0x7f90d802a410 comp rx=0 tx=0).stop 2024-09-21T05:50:29.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.755+0000 7f90e3f6e640 1 -- 172.21.15.70:0/365591683 shutdown_connections 2024-09-21T05:50:29.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.755+0000 7f90e3f6e640 1 --2- 172.21.15.70:0/365591683 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90dc108d00 0x7f90dc10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.755+0000 7f90e3f6e640 1 --2- 172.21.15.70:0/365591683 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90dc1083b0 0x7f90dc1087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.756+0000 7f90e3f6e640 1 --2- 172.21.15.70:0/365591683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90dc103180 0x7f90dc103590 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.756+0000 7f90e3f6e640 1 -- 172.21.15.70:0/365591683 >> 172.21.15.70:0/365591683 conn(0x7f90dc077c60 msgr2=0x7f90dc0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:29.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.756+0000 7f90e3f6e640 1 -- 172.21.15.70:0/365591683 shutdown_connections 2024-09-21T05:50:29.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.756+0000 7f90e3f6e640 1 -- 172.21.15.70:0/365591683 wait complete. 2024-09-21T05:50:29.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.757+0000 7f90e3f6e640 1 Processor -- start 2024-09-21T05:50:29.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.757+0000 7f90e3f6e640 1 -- start start 2024-09-21T05:50:29.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.758+0000 7f90e3f6e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90dc103180 0x7f90dc19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:29.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.758+0000 7f90e3f6e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90dc1083b0 0x7f90dc19aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:29.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.758+0000 7f90e3f6e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90dc108d00 0x7f90dc19fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:29.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.758+0000 7f90e3f6e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f90dc113ae0 con 0x7f90dc108d00 2024-09-21T05:50:29.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.758+0000 7f90e3f6e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f90dc113960 con 0x7f90dc103180 2024-09-21T05:50:29.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.758+0000 7f90e3f6e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f90dc113c60 con 0x7f90dc1083b0 2024-09-21T05:50:29.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.758+0000 7f90e1509640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90dc1083b0 0x7f90dc19aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:29.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.758+0000 7f90e1d0a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90dc103180 0x7f90dc19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:29.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.758+0000 7f90e1509640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90dc1083b0 0x7f90dc19aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.70:57238/0 (socket says 172.21.15.70:57238) 2024-09-21T05:50:29.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.758+0000 7f90e1509640 1 -- 172.21.15.70:0/3251363666 learned_addr learned my addr 172.21.15.70:0/3251363666 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:50:29.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.759+0000 7f90e250b640 1 --2- 172.21.15.70:0/3251363666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90dc108d00 0x7f90dc19fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:29.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.759+0000 7f90e1509640 1 -- 172.21.15.70:0/3251363666 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90dc103180 msgr2=0x7f90dc19a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:29.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.759+0000 7f90e1509640 1 --2- 172.21.15.70:0/3251363666 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90dc103180 0x7f90dc19a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.759+0000 7f90e1509640 1 -- 172.21.15.70:0/3251363666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90dc108d00 msgr2=0x7f90dc19fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:29.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.759+0000 7f90e1509640 1 --2- 172.21.15.70:0/3251363666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90dc108d00 0x7f90dc19fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.759+0000 7f90e1509640 1 -- 172.21.15.70:0/3251363666 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90dc1a0400 con 0x7f90dc1083b0 2024-09-21T05:50:29.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.759+0000 7f90e250b640 1 --2- 172.21.15.70:0/3251363666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90dc108d00 0x7f90dc19fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:50:29.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.759+0000 7f90e1509640 1 --2- 172.21.15.70:0/3251363666 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90dc1083b0 0x7f90dc19aa30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f90cc00e9f0 tx=0x7f90cc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:29.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.760+0000 7f90d2ffd640 1 -- 172.21.15.70:0/3251363666 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90cc00ccc0 con 0x7f90dc1083b0 2024-09-21T05:50:29.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.760+0000 7f90e3f6e640 1 -- 172.21.15.70:0/3251363666 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90dc1a06f0 con 0x7f90dc1083b0 2024-09-21T05:50:29.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.760+0000 7f90d2ffd640 1 -- 172.21.15.70:0/3251363666 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f90cc0108e0 con 0x7f90dc1083b0 2024-09-21T05:50:29.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.760+0000 7f90d2ffd640 1 -- 172.21.15.70:0/3251363666 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90cc018840 con 0x7f90dc1083b0 2024-09-21T05:50:29.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.760+0000 7f90e3f6e640 1 -- 172.21.15.70:0/3251363666 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90dc10fbf0 con 0x7f90dc1083b0 2024-09-21T05:50:29.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.764+0000 7f90ea4e2740 1 Processor -- start 2024-09-21T05:50:29.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.764+0000 7f90ea4e2740 1 -- start start 2024-09-21T05:50:29.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.764+0000 7f90d2ffd640 1 -- 172.21.15.70:0/3251363666 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 19) ==== 154563+0+0 (secure 0 0 0) 0x7f90cc010a90 con 0x7f90dc1083b0 2024-09-21T05:50:29.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.764+0000 7f90ea4e2740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3b91d4520 0x55c3b957a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:29.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.764+0000 7f90ea4e2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c3b91ab660 0x55c3b957aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:29.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.764+0000 7f90ea4e2740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3b91b3840 0x55c3b957af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:29.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.764+0000 7f90ea4e2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c3b9465dc0 con 0x55c3b91ab660 2024-09-21T05:50:29.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.764+0000 7f90ea4e2740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c3b94f21f0 con 0x55c3b91d4520 2024-09-21T05:50:29.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.764+0000 7f90ea4e2740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55c3b94e1620 con 0x55c3b91b3840 2024-09-21T05:50:29.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.765+0000 7f90e1509640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3b91b3840 0x55c3b957af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:29.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.765+0000 7f90e1d0a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c3b91ab660 0x55c3b957aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:29.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.765+0000 7f90e250b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3b91d4520 0x55c3b957a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:29.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.765+0000 7f90e250b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3b91d4520 0x55c3b957a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.70:50842/0 (socket says 172.21.15.70:50842) 2024-09-21T05:50:29.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.765+0000 7f90e250b640 1 -- 172.21.15.70:0/703680285 learned_addr learned my addr 172.21.15.70:0/703680285 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:50:29.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.766+0000 7f90e250b640 1 -- 172.21.15.70:0/703680285 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3b91b3840 msgr2=0x55c3b957af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:50:29.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.766+0000 7f90e250b640 1 --2- 172.21.15.70:0/703680285 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3b91b3840 0x55c3b957af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.766+0000 7f90e250b640 1 -- 172.21.15.70:0/703680285 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c3b91ab660 msgr2=0x55c3b957aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:50:29.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.766+0000 7f90e250b640 1 --2- 172.21.15.70:0/703680285 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c3b91ab660 0x55c3b957aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.766+0000 7f90e250b640 1 -- 172.21.15.70:0/703680285 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3b94a9fd0 con 0x55c3b91d4520 2024-09-21T05:50:29.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.766+0000 7f90e250b640 1 --2- 172.21.15.70:0/703680285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3b91d4520 0x55c3b957a510 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f90d4010750 tx=0x7f90d4010c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5509681164fa6762 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:29.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.766+0000 7f90d2ffd640 1 --2- 172.21.15.70:0/3251363666 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f90c80baa30 0x7f90c80bcf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:29.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.767+0000 7f90e1d0a640 1 --2- 172.21.15.70:0/3251363666 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f90c80baa30 0x7f90c80bcf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:29.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.767+0000 7f90c7fff640 1 -- 172.21.15.70:0/703680285 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d400ead0 con 0x55c3b91d4520 2024-09-21T05:50:29.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.767+0000 7f90c7fff640 1 -- 172.21.15.70:0/703680285 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f90d4010e60 con 0x55c3b91d4520 2024-09-21T05:50:29.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.767+0000 7f90c7fff640 1 -- 172.21.15.70:0/703680285 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d40113e0 con 0x55c3b91d4520 2024-09-21T05:50:29.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.767+0000 7f90d2ffd640 1 -- 172.21.15.70:0/3251363666 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f90cc0e7bb0 con 0x7f90dc1083b0 2024-09-21T05:50:29.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.768+0000 7f90ea4e2740 1 -- 172.21.15.70:0/703680285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3b91d4520 msgr2=0x55c3b957a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:29.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.768+0000 7f90e1d0a640 1 --2- 172.21.15.70:0/3251363666 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f90c80baa30 0x7f90c80bcf40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f90d8000c00 tx=0x7f90d8005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:29.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.768+0000 7f90ea4e2740 1 --2- 172.21.15.70:0/703680285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3b91d4520 0x55c3b957a510 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f90d4010750 tx=0x7f90d4010c10 comp rx=0 tx=0).stop 2024-09-21T05:50:29.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.768+0000 7f90ea4e2740 1 -- 172.21.15.70:0/703680285 shutdown_connections 2024-09-21T05:50:29.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.768+0000 7f90ea4e2740 1 --2- 172.21.15.70:0/703680285 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3b91b3840 0x55c3b957af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.768+0000 7f90ea4e2740 1 --2- 172.21.15.70:0/703680285 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c3b91ab660 0x55c3b957aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.768+0000 7f90ea4e2740 1 --2- 172.21.15.70:0/703680285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3b91d4520 0x55c3b957a510 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.768+0000 7f90ea4e2740 1 -- 172.21.15.70:0/703680285 >> 172.21.15.70:0/703680285 conn(0x55c3b91c8910 msgr2=0x55c3b9578400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:29.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.768+0000 7f90ea4e2740 1 -- 172.21.15.70:0/703680285 shutdown_connections 2024-09-21T05:50:29.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.768+0000 7f90ea4e2740 1 -- 172.21.15.70:0/703680285 wait complete. 2024-09-21T05:50:29.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.769+0000 7f90ea4e2740 1 -- start start 2024-09-21T05:50:29.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.769+0000 7f90ea4e2740 1 Processor -- start 2024-09-21T05:50:29.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.770+0000 7f90ea4e2740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3b91ab660 0x55c3b9585bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:29.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.770+0000 7f90ea4e2740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3b91b3840 0x55c3b95860f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:29.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.770+0000 7f90ea4e2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c3b91d4520 0x55c3b9586670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:29.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.770+0000 7f90e1d0a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3b91ab660 0x55c3b9585bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:29.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.770+0000 7f90e1d0a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3b91ab660 0x55c3b9585bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.70:57270/0 (socket says 172.21.15.70:57270) 2024-09-21T05:50:29.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.771+0000 7f90e250b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c3b91d4520 0x55c3b9586670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:29.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.771+0000 7f90e250b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c3b91d4520 0x55c3b9586670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36484/0 (socket says 172.21.15.70:36484) 2024-09-21T05:50:29.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.771+0000 7f90e1509640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3b91b3840 0x55c3b95860f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:29.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.771+0000 7f90e1509640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3b91b3840 0x55c3b95860f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.70:50844/0 (socket says 172.21.15.70:50844) 2024-09-21T05:50:29.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.771+0000 7f90e1d0a640 1 -- 172.21.15.70:0/3296137905 learned_addr learned my addr 172.21.15.70:0/3296137905 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:50:29.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.771+0000 7f90ea4e2740 1 -- 172.21.15.70:0/3296137905 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c3b947c300 con 0x55c3b91d4520 2024-09-21T05:50:29.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.771+0000 7f90ea4e2740 1 -- 172.21.15.70:0/3296137905 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c3b94e5430 con 0x55c3b91b3840 2024-09-21T05:50:29.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.771+0000 7f90ea4e2740 1 -- 172.21.15.70:0/3296137905 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55c3b9342bb0 con 0x55c3b91ab660 2024-09-21T05:50:29.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.771+0000 7f90e250b640 1 -- 172.21.15.70:0/3296137905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3b91ab660 msgr2=0x55c3b9585bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:50:29.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.771+0000 7f90e250b640 1 --2- 172.21.15.70:0/3296137905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3b91ab660 0x55c3b9585bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.771+0000 7f90e250b640 1 -- 172.21.15.70:0/3296137905 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3b91b3840 msgr2=0x55c3b95860f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:50:29.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.771+0000 7f90e250b640 1 --2- 172.21.15.70:0/3296137905 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3b91b3840 0x55c3b95860f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.771+0000 7f90e250b640 1 -- 172.21.15.70:0/3296137905 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3b946b780 con 0x55c3b91d4520 2024-09-21T05:50:29.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.771+0000 7f90e1509640 1 --2- 172.21.15.70:0/3296137905 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3b91b3840 0x55c3b95860f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:50:29.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.772+0000 7f90ea4e2740 10 client.0 _ll_register_callbacks cb 0x55c3b9496120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:50:29.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.772+0000 7f90ea4e2740 1 -- 172.21.15.70:0/3296137905 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90d4010e60 con 0x55c3b91d4520 2024-09-21T05:50:29.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.772+0000 7f90e250b640 1 --2- 172.21.15.70:0/3296137905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c3b91d4520 0x55c3b9586670 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f90d4012d30 tx=0x7f90d400e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d70d86c395e26c17 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:29.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.772+0000 7f90c57fa640 10 client.15681 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:50:29.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.772+0000 7f90c57fa640 1 -- 172.21.15.70:0/3296137905 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d402c060 con 0x55c3b91d4520 2024-09-21T05:50:29.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.772+0000 7f90c57fa640 1 -- 172.21.15.70:0/3296137905 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f90d400eac0 con 0x55c3b91d4520 2024-09-21T05:50:29.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.772+0000 7f90c57fa640 1 -- 172.21.15.70:0/3296137905 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f90d400ed20 con 0x55c3b91d4520 2024-09-21T05:50:29.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.772+0000 7f90ea4e2740 10 client.15681 fetch_fsmap learned FSMap version 28 2024-09-21T05:50:29.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.773+0000 7f90ea4e2740 1 -- 172.21.15.70:0/3296137905 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55c3b923fb00 con 0x55c3b91d4520 2024-09-21T05:50:29.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.773+0000 7f90c57fa640 1 -- 172.21.15.70:0/3296137905 <== mon.0 v2:172.21.15.70:3300/0 4 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f90d400f040 con 0x55c3b91d4520 2024-09-21T05:50:29.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.773+0000 7f90ea4e2740 10 client.15681 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T05:50:29.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.773+0000 7f90ea4e2740 10 client.15681 resolve_mds: validated gid 24641 aka daemon mds.b 2024-09-21T05:50:29.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.773+0000 7f90ea4e2740 20 client.15681 populate_metadata read hostname 'smithi070' 2024-09-21T05:50:29.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.773+0000 7f90ea4e2740 1 --2- 172.21.15.70:0/3296137905 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55c3b9192ea0 0x55c3b95980d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:29.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.773+0000 7f90ea4e2740 4 client.15681 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:50:29.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.773+0000 7f90ea4e2740 1 -- 172.21.15.70:0/3296137905 --> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3b94f4140 con 0x55c3b9192ea0 2024-09-21T05:50:29.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.773+0000 7f90e1d0a640 1 --2- 172.21.15.70:0/3296137905 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55c3b9192ea0 0x55c3b95980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:29.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.774+0000 7f90c57fa640 10 client.15681 ms_handle_connect on v2:172.21.15.116:6838/3952175670 2024-09-21T05:50:29.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.774+0000 7f90e1d0a640 1 --2- 172.21.15.70:0/3296137905 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55c3b9192ea0 0x55c3b95980d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be9a67e79bd091c4 server_cookie=bebed6bbcb0f1731 in_seq=0 out_seq=0 2024-09-21T05:50:29.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.775+0000 7f90c57fa640 1 -- 172.21.15.70:0/3296137905 <== mds.0 v2:172.21.15.116:6838/3952175670 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c3b94f4140 con 0x55c3b9192ea0 2024-09-21T05:50:29.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.775+0000 7f90c57fa640 10 client.15681 handle_command_reply: tid=0 2024-09-21T05:50:29.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.775+0000 7f90ea4e2740 1 client.15681 shutdown 2024-09-21T05:50:29.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.775+0000 7f90ea4e2740 1 -- 172.21.15.70:0/3296137905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c3b91d4520 msgr2=0x55c3b9586670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:29.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.775+0000 7f90ea4e2740 1 --2- 172.21.15.70:0/3296137905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c3b91d4520 0x55c3b9586670 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f90d4012d30 tx=0x7f90d400e8d0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.775+0000 7f90ea4e2740 1 -- 172.21.15.70:0/3296137905 shutdown_connections 2024-09-21T05:50:29.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.775+0000 7f90ea4e2740 1 --2- 172.21.15.70:0/3296137905 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55c3b9192ea0 0x55c3b95980d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.775+0000 7f90ea4e2740 1 --2- 172.21.15.70:0/3296137905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c3b91d4520 0x55c3b9586670 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.775+0000 7f90ea4e2740 1 --2- 172.21.15.70:0/3296137905 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3b91b3840 0x55c3b95860f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.775+0000 7f90ea4e2740 1 --2- 172.21.15.70:0/3296137905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3b91ab660 0x55c3b9585bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.775+0000 7f90ea4e2740 1 -- 172.21.15.70:0/3296137905 >> 172.21.15.70:0/3296137905 conn(0x55c3b91c8910 msgr2=0x55c3b957d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:29.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.775+0000 7f90c57fa640 0 client.15681 ms_handle_reset on v2:172.21.15.116:6838/3952175670 2024-09-21T05:50:29.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.775+0000 7f90ea4e2740 1 -- 172.21.15.70:0/3296137905 shutdown_connections 2024-09-21T05:50:29.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.775+0000 7f90ea4e2740 1 -- 172.21.15.70:0/3296137905 wait complete. 2024-09-21T05:50:29.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.776+0000 7f90ea4e2740 20 client.15681 trim_cache size 0 max 16384 2024-09-21T05:50:29.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.809+0000 7f90ea4e2740 1 Processor -- start 2024-09-21T05:50:29.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.809+0000 7f90ea4e2740 1 -- start start 2024-09-21T05:50:29.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.810+0000 7f90ea4e2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c3b91ab660 0x55c3b957c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:29.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.810+0000 7f90ea4e2740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3b91b3840 0x55c3b9585b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:29.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.810+0000 7f90ea4e2740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3b91d4520 0x55c3b9582da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:29.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.810+0000 7f90ea4e2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f90dc1aec50 con 0x55c3b91ab660 2024-09-21T05:50:29.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.810+0000 7f90ea4e2740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f90dc1b0790 con 0x55c3b91d4520 2024-09-21T05:50:29.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.810+0000 7f90e1d0a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c3b91ab660 0x55c3b957c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:29.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.810+0000 7f90ea4e2740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f90dc1af320 con 0x55c3b91b3840 2024-09-21T05:50:29.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.810+0000 7f90e1d0a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c3b91ab660 0x55c3b957c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36492/0 (socket says 172.21.15.70:36492) 2024-09-21T05:50:29.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.810+0000 7f90e1d0a640 1 -- 172.21.15.70:0/3472699395 learned_addr learned my addr 172.21.15.70:0/3472699395 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:50:29.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.810+0000 7f90e1d0a640 1 -- 172.21.15.70:0/3472699395 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3b91b3840 msgr2=0x55c3b9585b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:50:29.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.810+0000 7f90e1d0a640 1 --2- 172.21.15.70:0/3472699395 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3b91b3840 0x55c3b9585b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.810+0000 7f90e1d0a640 1 -- 172.21.15.70:0/3472699395 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3b91d4520 msgr2=0x55c3b9582da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T05:50:29.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.811+0000 7f90e250b640 1 --2- 172.21.15.70:0/3472699395 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3b91d4520 0x55c3b9582da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:29.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.811+0000 7f90e1d0a640 1 --2- 172.21.15.70:0/3472699395 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3b91d4520 0x55c3b9582da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.811+0000 7f90e1d0a640 1 -- 172.21.15.70:0/3472699395 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3b92b6960 con 0x55c3b91ab660 2024-09-21T05:50:29.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.811+0000 7f90e1d0a640 1 --2- 172.21.15.70:0/3472699395 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c3b91ab660 0x55c3b957c020 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f90d802a930 tx=0x7f90d8040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e64241ce76fa4fc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:29.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.811+0000 7f90c77fe640 1 -- 172.21.15.70:0/3472699395 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d805a070 con 0x55c3b91ab660 2024-09-21T05:50:29.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.811+0000 7f90c77fe640 1 -- 172.21.15.70:0/3472699395 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f90d8004c30 con 0x55c3b91ab660 2024-09-21T05:50:29.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.811+0000 7f90c77fe640 1 -- 172.21.15.70:0/3472699395 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d8031a20 con 0x55c3b91ab660 2024-09-21T05:50:29.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.812+0000 7f90ea4e2740 1 -- 172.21.15.70:0/3472699395 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c3b91ab660 msgr2=0x55c3b957c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:29.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.812+0000 7f90ea4e2740 1 --2- 172.21.15.70:0/3472699395 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c3b91ab660 0x55c3b957c020 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f90d802a930 tx=0x7f90d8040000 comp rx=0 tx=0).stop 2024-09-21T05:50:29.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.812+0000 7f90ea4e2740 1 -- 172.21.15.70:0/3472699395 shutdown_connections 2024-09-21T05:50:29.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.812+0000 7f90ea4e2740 1 --2- 172.21.15.70:0/3472699395 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3b91b3840 0x55c3b9585b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.812+0000 7f90ea4e2740 1 --2- 172.21.15.70:0/3472699395 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3b91d4520 0x55c3b9582da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.812+0000 7f90ea4e2740 1 --2- 172.21.15.70:0/3472699395 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c3b91ab660 0x55c3b957c020 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.812+0000 7f90ea4e2740 1 -- 172.21.15.70:0/3472699395 >> 172.21.15.70:0/3472699395 conn(0x55c3b91c8910 msgr2=0x55c3b9591710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:29.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.813+0000 7f90ea4e2740 1 -- 172.21.15.70:0/3472699395 shutdown_connections 2024-09-21T05:50:29.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.813+0000 7f90ea4e2740 1 -- 172.21.15.70:0/3472699395 wait complete. 2024-09-21T05:50:29.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.813+0000 7f90ea4e2740 1 -- start start 2024-09-21T05:50:29.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.813+0000 7f90ea4e2740 1 Processor -- start 2024-09-21T05:50:29.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.814+0000 7f90ea4e2740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3b91b3840 0x55c3b958e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:29.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.814+0000 7f90ea4e2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c3b91d4520 0x55c3b9589c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:29.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.814+0000 7f90ea4e2740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3b9168250 0x55c3b958a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:29.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.814+0000 7f90ea4e2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f90dc1b00c0 con 0x55c3b91d4520 2024-09-21T05:50:29.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.814+0000 7f90ea4e2740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f90dc1af9f0 con 0x55c3b91b3840 2024-09-21T05:50:29.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.814+0000 7f90ea4e2740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f90dc1acc30 con 0x55c3b9168250 2024-09-21T05:50:29.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.814+0000 7f90e1509640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c3b91d4520 0x55c3b9589c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:29.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.814+0000 7f90e1509640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c3b91d4520 0x55c3b9589c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36494/0 (socket says 172.21.15.70:36494) 2024-09-21T05:50:29.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.814+0000 7f90e1509640 1 -- 172.21.15.70:0/430848319 learned_addr learned my addr 172.21.15.70:0/430848319 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:50:29.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.814+0000 7f90e250b640 1 --2- 172.21.15.70:0/430848319 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3b9168250 0x55c3b958a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:29.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.815+0000 7f90e1d0a640 1 --2- 172.21.15.70:0/430848319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3b91b3840 0x55c3b958e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:29.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.815+0000 7f90e1509640 1 -- 172.21.15.70:0/430848319 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3b9168250 msgr2=0x55c3b958a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:50:29.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.815+0000 7f90e1509640 1 --2- 172.21.15.70:0/430848319 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3b9168250 0x55c3b958a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.815+0000 7f90e1509640 1 -- 172.21.15.70:0/430848319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3b91b3840 msgr2=0x55c3b958e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:50:29.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.815+0000 7f90e1509640 1 --2- 172.21.15.70:0/430848319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3b91b3840 0x55c3b958e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.815+0000 7f90e1509640 1 -- 172.21.15.70:0/430848319 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3b9601ad0 con 0x55c3b91d4520 2024-09-21T05:50:29.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.814+0000 7f90ea4e2740 10 client.0 _ll_register_callbacks cb 0x7f90d4016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:50:29.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.815+0000 7f90e1d0a640 1 --2- 172.21.15.70:0/430848319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3b91b3840 0x55c3b958e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:50:29.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.815+0000 7f90ea4e2740 1 -- 172.21.15.70:0/430848319 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90d8004c30 con 0x55c3b91d4520 2024-09-21T05:50:29.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.815+0000 7f90e1509640 1 --2- 172.21.15.70:0/430848319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c3b91d4520 0x55c3b9589c10 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f90cc0ad4f0 tx=0x7f90cc010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e45058e31cb996f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:29.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.815+0000 7f90c57fa640 10 client.15687 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:50:29.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.815+0000 7f90c57fa640 1 -- 172.21.15.70:0/430848319 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90cc0d2020 con 0x55c3b91d4520 2024-09-21T05:50:29.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.815+0000 7f90c57fa640 1 -- 172.21.15.70:0/430848319 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f90cc0aeb20 con 0x55c3b91d4520 2024-09-21T05:50:29.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.816+0000 7f90c57fa640 1 -- 172.21.15.70:0/430848319 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f90cc0ad5c0 con 0x55c3b91d4520 2024-09-21T05:50:29.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.816+0000 7f90ea4e2740 10 client.15687 fetch_fsmap learned FSMap version 28 2024-09-21T05:50:29.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.816+0000 7f90ea4e2740 1 -- 172.21.15.70:0/430848319 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55c3b9602af0 con 0x55c3b91d4520 2024-09-21T05:50:29.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.816+0000 7f90c57fa640 1 -- 172.21.15.70:0/430848319 <== mon.0 v2:172.21.15.70:3300/0 4 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f90cc0ac4c0 con 0x55c3b91d4520 2024-09-21T05:50:29.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.816+0000 7f90ea4e2740 10 client.15687 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T05:50:29.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.816+0000 7f90ea4e2740 10 client.15687 resolve_mds: validated gid 24641 aka daemon mds.b 2024-09-21T05:50:29.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.816+0000 7f90ea4e2740 20 client.15687 populate_metadata read hostname 'smithi070' 2024-09-21T05:50:29.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.816+0000 7f90ea4e2740 1 --2- 172.21.15.70:0/430848319 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55c3b9603100 0x55c3b9605520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:29.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.816+0000 7f90ea4e2740 4 client.15687 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6f095311", "release": true, "await": true}] 2024-09-21T05:50:29.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.816+0000 7f90ea4e2740 1 -- 172.21.15.70:0/430848319 --> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6f095311", "release": true, "await": true}) -- 0x55c3b94efbf0 con 0x55c3b9603100 2024-09-21T05:50:29.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.817+0000 7f90e1d0a640 1 --2- 172.21.15.70:0/430848319 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55c3b9603100 0x55c3b9605520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:29.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.817+0000 7f90c57fa640 10 client.15687 ms_handle_connect on v2:172.21.15.116:6838/3952175670 2024-09-21T05:50:29.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.817+0000 7f90e1d0a640 1 --2- 172.21.15.70:0/430848319 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55c3b9603100 0x55c3b9605520 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29fb641846e3e54c server_cookie=fb6de034678180b7 in_seq=0 out_seq=0 2024-09-21T05:50:29.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.820+0000 7f90c57fa640 1 -- 172.21.15.70:0/430848319 <== mds.0 v2:172.21.15.116:6838/3952175670 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55c3b94efbf0 con 0x55c3b9603100 2024-09-21T05:50:29.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.820+0000 7f90c57fa640 10 client.15687 handle_command_reply: tid=0 2024-09-21T05:50:29.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.820+0000 7f90ea4e2740 1 client.15687 shutdown 2024-09-21T05:50:29.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.820+0000 7f90ea4e2740 1 -- 172.21.15.70:0/430848319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c3b91d4520 msgr2=0x55c3b9589c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:29.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.820+0000 7f90ea4e2740 1 --2- 172.21.15.70:0/430848319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c3b91d4520 0x55c3b9589c10 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f90cc0ad4f0 tx=0x7f90cc010800 comp rx=0 tx=0).stop 2024-09-21T05:50:29.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.820+0000 7f90ea4e2740 1 -- 172.21.15.70:0/430848319 shutdown_connections 2024-09-21T05:50:29.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.820+0000 7f90ea4e2740 1 --2- 172.21.15.70:0/430848319 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55c3b9603100 0x55c3b9605520 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.820+0000 7f90ea4e2740 1 --2- 172.21.15.70:0/430848319 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3b9168250 0x55c3b958a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.820+0000 7f90ea4e2740 1 --2- 172.21.15.70:0/430848319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c3b91d4520 0x55c3b9589c10 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.820+0000 7f90c57fa640 0 client.15687 ms_handle_reset on v2:172.21.15.116:6838/3952175670 2024-09-21T05:50:29.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.820+0000 7f90ea4e2740 1 --2- 172.21.15.70:0/430848319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3b91b3840 0x55c3b958e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.820+0000 7f90ea4e2740 1 -- 172.21.15.70:0/430848319 >> 172.21.15.70:0/430848319 conn(0x55c3b91c8910 msgr2=0x55c3b9590d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:29.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.820+0000 7f90ea4e2740 1 -- 172.21.15.70:0/430848319 shutdown_connections 2024-09-21T05:50:29.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.820+0000 7f90ea4e2740 1 -- 172.21.15.70:0/430848319 wait complete. 2024-09-21T05:50:29.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.821+0000 7f90ea4e2740 20 client.15687 trim_cache size 0 max 16384 2024-09-21T05:50:29.824 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:50:29.824 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 28, 2024-09-21T05:50:29.824 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 24641, 2024-09-21T05:50:29.824 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 4, 2024-09-21T05:50:29.824 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-09-21T05:50:29.824 INFO:teuthology.orchestra.run.smithi070.stdout: "6f095311": { 2024-09-21T05:50:29.824 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 4, 2024-09-21T05:50:29.824 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-09-21T05:50:29.824 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-09-21T05:50:29.824 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-09-21T05:50:29.824 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-09-21T05:50:29.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:50:29.824 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 90.0, 2024-09-21T05:50:29.825 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 134.5, 2024-09-21T05:50:29.825 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-09-21T05:50:29.825 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-09-21T05:50:29.825 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-09-21T05:50:29.825 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-09-21T05:50:29.825 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-09-21T05:50:29.825 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-09-21T05:50:29.825 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:50:29.825 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:50:29.825 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:50:29.825 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:50:29.825 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:50:29.825 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:50:29.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.822+0000 7f90e3f6e640 1 -- 172.21.15.70:0/3251363666 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f90c80baa30 msgr2=0x7f90c80bcf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:29.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.822+0000 7f90e3f6e640 1 --2- 172.21.15.70:0/3251363666 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f90c80baa30 0x7f90c80bcf40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f90d8000c00 tx=0x7f90d8005d50 comp rx=0 tx=0).stop 2024-09-21T05:50:29.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.822+0000 7f90e3f6e640 1 -- 172.21.15.70:0/3251363666 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90dc1083b0 msgr2=0x7f90dc19aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:29.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.822+0000 7f90e3f6e640 1 --2- 172.21.15.70:0/3251363666 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90dc1083b0 0x7f90dc19aa30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f90cc00e9f0 tx=0x7f90cc00eeb0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.822+0000 7f90e3f6e640 1 -- 172.21.15.70:0/3251363666 shutdown_connections 2024-09-21T05:50:29.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.822+0000 7f90e3f6e640 1 --2- 172.21.15.70:0/3251363666 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f90c80baa30 0x7f90c80bcf40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.822+0000 7f90e3f6e640 1 --2- 172.21.15.70:0/3251363666 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90dc1083b0 0x7f90dc19aa30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.822+0000 7f90e3f6e640 1 --2- 172.21.15.70:0/3251363666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90dc108d00 0x7f90dc19fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.822+0000 7f90e3f6e640 1 --2- 172.21.15.70:0/3251363666 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90dc103180 0x7f90dc19a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:29.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.822+0000 7f90e3f6e640 1 -- 172.21.15.70:0/3251363666 >> 172.21.15.70:0/3251363666 conn(0x7f90dc077c60 msgr2=0x7f90dc106400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:29.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.822+0000 7f90e3f6e640 1 -- 172.21.15.70:0/3251363666 shutdown_connections 2024-09-21T05:50:29.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:29.822+0000 7f90e3f6e640 1 -- 172.21.15.70:0/3251363666 wait complete. 2024-09-21T05:50:30.624 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6f095311', total seconds elapsed: 18.5 2024-09-21T05:50:31.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:31 smithi070 ceph-mon[30981]: pgmap v401: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-21T05:50:31.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:31 smithi116 ceph-mon[34332]: pgmap v401: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-21T05:50:31.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:31 smithi160 ceph-mon[33979]: pgmap v401: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-21T05:50:33.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:33 smithi070 ceph-mon[30981]: pgmap v402: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:50:33.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:33 smithi116 ceph-mon[34332]: pgmap v402: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:50:33.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:33 smithi160 ceph-mon[33979]: pgmap v402: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:50:35.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:35 smithi070 ceph-mon[30981]: pgmap v403: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-21T05:50:35.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:35 smithi116 ceph-mon[34332]: pgmap v403: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-21T05:50:35.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:35 smithi160 ceph-mon[33979]: pgmap v403: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-21T05:50:37.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:37 smithi070 ceph-mon[30981]: pgmap v404: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T05:50:37.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:37 smithi116 ceph-mon[34332]: pgmap v404: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T05:50:37.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:37 smithi160 ceph-mon[33979]: pgmap v404: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T05:50:39.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:39 smithi070 ceph-mon[30981]: pgmap v405: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T05:50:39.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:39 smithi116 ceph-mon[34332]: pgmap v405: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T05:50:39.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:39 smithi160 ceph-mon[33979]: pgmap v405: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T05:50:41.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:41 smithi070 ceph-mon[30981]: pgmap v406: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-21T05:50:41.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:41 smithi070 ceph-mon[30981]: mgrmap e20: x(active, since 11m), standbys: z, y 2024-09-21T05:50:41.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:41 smithi116 ceph-mon[34332]: pgmap v406: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-21T05:50:41.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:41 smithi116 ceph-mon[34332]: mgrmap e20: x(active, since 11m), standbys: z, y 2024-09-21T05:50:41.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:41 smithi160 ceph-mon[33979]: pgmap v406: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-21T05:50:41.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:41 smithi160 ceph-mon[33979]: mgrmap e20: x(active, since 11m), standbys: z, y 2024-09-21T05:50:43.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:43 smithi070 ceph-mon[30981]: pgmap v407: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T05:50:43.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:43 smithi116 ceph-mon[34332]: pgmap v407: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T05:50:43.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:43 smithi160 ceph-mon[33979]: pgmap v407: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T05:50:45.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:45 smithi070 ceph-mon[30981]: pgmap v408: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T05:50:45.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:45 smithi116 ceph-mon[34332]: pgmap v408: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T05:50:45.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:45 smithi160 ceph-mon[33979]: pgmap v408: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T05:50:47.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:47 smithi070 ceph-mon[30981]: pgmap v409: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T05:50:47.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:47 smithi116 ceph-mon[34332]: pgmap v409: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T05:50:47.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:47 smithi160 ceph-mon[33979]: pgmap v409: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T05:50:48.335 INFO:tasks.workunit.client.0.smithi070.stderr:Note: switching to '1843221895adccfb3b692060251dd6a0183bc410'. 2024-09-21T05:50:48.336 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-21T05:50:48.336 INFO:tasks.workunit.client.0.smithi070.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T05:50:48.336 INFO:tasks.workunit.client.0.smithi070.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T05:50:48.336 INFO:tasks.workunit.client.0.smithi070.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T05:50:48.336 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-21T05:50:48.336 INFO:tasks.workunit.client.0.smithi070.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T05:50:48.336 INFO:tasks.workunit.client.0.smithi070.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T05:50:48.336 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-21T05:50:48.336 INFO:tasks.workunit.client.0.smithi070.stderr: git switch -c 2024-09-21T05:50:48.336 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-21T05:50:48.336 INFO:tasks.workunit.client.0.smithi070.stderr:Or undo this operation with: 2024-09-21T05:50:48.336 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-21T05:50:48.336 INFO:tasks.workunit.client.0.smithi070.stderr: git switch - 2024-09-21T05:50:48.336 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-21T05:50:48.336 INFO:tasks.workunit.client.0.smithi070.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T05:50:48.337 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-21T05:50:48.337 INFO:tasks.workunit.client.0.smithi070.stderr:HEAD is now at 1843221895a Merge PR #56776 into wip-pdonnell-testing-20240920.212106-debug 2024-09-21T05:50:48.341 DEBUG:teuthology.orchestra.run.smithi070:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T05:50:48.367 INFO:tasks.workunit.client.0.smithi070.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T05:50:48.370 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T05:50:48.370 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T05:50:49.084 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T05:50:49.158 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T05:50:49.200 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T05:50:49.202 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T05:50:49.202 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T05:50:49.240 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T05:50:49.244 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-21T05:50:49.244 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T05:50:49.300 INFO:tasks.workunit:Running workunits matching fs/norstats on client.0... 2024-09-21T05:50:49.301 INFO:tasks.workunit:Running workunit fs/norstats/kernel_untar_tar.sh... 2024-09-21T05:50:49.301 DEBUG:teuthology.orchestra.run.smithi070:workunit test fs/norstats/kernel_untar_tar.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh 2024-09-21T05:50:49.371 INFO:tasks.workunit.client.0.smithi070.stderr:+ KERNEL=linux-4.0.5 2024-09-21T05:50:49.371 INFO:tasks.workunit.client.0.smithi070.stderr:+ wget -q http://download.ceph.com/qa/linux-4.0.5.tar.xz 2024-09-21T05:50:49.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:49 smithi070 ceph-mon[30981]: pgmap v410: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T05:50:49.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:49 smithi116 ceph-mon[34332]: pgmap v410: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T05:50:49.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:49 smithi160 ceph-mon[33979]: pgmap v410: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T05:50:51.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:51 smithi070 ceph-mon[30981]: pgmap v411: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T05:50:51.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:51 smithi116 ceph-mon[34332]: pgmap v411: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T05:50:51.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:51 smithi160 ceph-mon[33979]: pgmap v411: 129 pgs: 129 active+clean; 670 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T05:50:52.285 INFO:tasks.workunit.client.0.smithi070.stderr:+ mkdir untar_tar 2024-09-21T05:50:52.288 INFO:tasks.workunit.client.0.smithi070.stderr:+ cd untar_tar 2024-09-21T05:50:52.291 INFO:tasks.workunit.client.0.smithi070.stderr:+ tar Jxvf ../linux-4.0.5.tar.xz linux-4.0.5/Documentation/ 2024-09-21T05:50:52.327 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ 2024-09-21T05:50:52.330 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/00-INDEX 2024-09-21T05:50:52.333 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/ 2024-09-21T05:50:52.334 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/README 2024-09-21T05:50:52.336 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/obsolete/ 2024-09-21T05:50:52.338 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads 2024-09-21T05:50:52.341 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb 2024-09-21T05:50:52.344 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill 2024-09-21T05:50:52.346 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus 2024-09-21T05:50:52.349 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus 2024-09-21T05:50:52.351 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra 2024-09-21T05:50:52.354 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/removed/ 2024-09-21T05:50:52.356 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/removed/devfs 2024-09-21T05:50:52.358 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/removed/dv1394 2024-09-21T05:50:52.360 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/removed/ip_queue 2024-09-21T05:50:52.363 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/removed/net_dma 2024-09-21T05:50:52.365 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/removed/o2cb 2024-09-21T05:50:52.367 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/removed/raw1394 2024-09-21T05:50:52.369 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/removed/video1394 2024-09-21T05:50:52.372 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/ 2024-09-21T05:50:52.374 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/firewire-cdev 2024-09-21T05:50:52.376 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/o2cb 2024-09-21T05:50:52.378 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/syscalls 2024-09-21T05:50:52.381 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile 2024-09-21T05:50:52.383 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire 2024-09-21T05:50:52.385 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb 2024-09-21T05:50:52.388 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend 2024-09-21T05:50:52.390 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight 2024-09-21T05:50:52.393 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill 2024-09-21T05:50:52.395 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm 2024-09-21T05:50:52.397 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi 2024-09-21T05:50:52.400 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc 2024-09-21T05:50:52.402 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node 2024-09-21T05:50:52.405 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu 2024-09-21T05:50:52.407 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory 2024-09-21T05:50:52.409 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp 2024-09-21T05:50:52.412 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx 2024-09-21T05:50:52.414 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc 2024-09-21T05:50:52.416 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04 2024-09-21T05:50:52.419 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars 2024-09-21T05:50:52.421 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump 2024-09-21T05:50:52.423 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog 2024-09-21T05:50:52.426 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-module 2024-09-21T05:50:52.428 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp 2024-09-21T05:50:52.430 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/thermal-notification 2024-09-21T05:50:52.433 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/vdso 2024-09-21T05:50:52.435 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/ 2024-09-21T05:50:52.437 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget 2024-09-21T05:50:52.439 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget 2024-09-21T05:50:52.442 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm 2024-09-21T05:50:52.444 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm 2024-09-21T05:50:52.446 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem 2024-09-21T05:50:52.450 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs 2024-09-21T05:50:52.450 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid 2024-09-21T05:50:52.452 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback 2024-09-21T05:50:52.455 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage 2024-09-21T05:50:52.457 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi 2024-09-21T05:50:52.459 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm 2024-09-21T05:50:52.461 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex 2024-09-21T05:50:52.464 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet 2024-09-21T05:50:52.466 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis 2024-09-21T05:50:52.468 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial 2024-09-21T05:50:52.470 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink 2024-09-21T05:50:52.472 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset 2024-09-21T05:50:52.474 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1 2024-09-21T05:50:52.477 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2 2024-09-21T05:50:52.479 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc 2024-09-21T05:50:52.481 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe 2024-09-21T05:50:52.484 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ec 2024-09-21T05:50:52.486 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad 2024-09-21T05:50:52.488 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-olpc 2024-09-21T05:50:52.490 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto 2024-09-21T05:50:52.492 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd 2024-09-21T05:50:52.495 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/dev-kmsg 2024-09-21T05:50:52.497 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/evm 2024-09-21T05:50:52.499 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/ima_policy 2024-09-21T05:50:52.501 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/procfs-diskstats 2024-09-21T05:50:52.504 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/pstore 2024-09-21T05:50:52.506 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ata 2024-09-21T05:50:52.508 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block 2024-09-21T05:50:52.510 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache 2024-09-21T05:50:52.513 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm 2024-09-21T05:50:52.515 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd 2024-09-21T05:50:52.517 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram 2024-09-21T05:50:52.520 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi 2024-09-21T05:50:52.522 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba 2024-09-21T05:50:52.524 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma 2024-09-21T05:50:52.527 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10 2024-09-21T05:50:52.529 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x 2024-09-21T05:50:52.531 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel 2024-09-21T05:50:52.534 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc 2024-09-21T05:50:52.536 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css 2024-09-21T05:50:52.538 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events 2024-09-21T05:50:52.541 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format 2024-09-21T05:50:52.543 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7 2024-09-21T05:50:52.546 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci 2024-09-21T05:50:52.548 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe 2024-09-21T05:50:52.550 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi 2024-09-21T05:50:52.553 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480 2024-09-21T05:50:52.555 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352 2024-09-21T05:50:52.557 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533 2024-09-21T05:50:52.560 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio 2024-09-21T05:50:52.564 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150 2024-09-21T05:50:52.567 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523 2024-09-21T05:50:52.569 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350 2024-09-21T05:50:52.572 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160 2024-09-21T05:50:52.574 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als 2024-09-21T05:50:52.576 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050 2024-09-21T05:50:52.579 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935 2024-09-21T05:50:52.581 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs 2024-09-21T05:50:52.583 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio 2024-09-21T05:50:52.585 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media 2024-09-21T05:50:52.588 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei 2024-09-21T05:50:52.590 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci 2024-09-21T05:50:52.593 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss 2024-09-21T05:50:52.595 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd 2024-09-21T05:50:52.597 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform 2024-09-21T05:50:52.599 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd 2024-09-21T05:50:52.601 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg 2024-09-21T05:50:52.603 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc 2024-09-21T05:50:52.606 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb 2024-09-21T05:50:52.608 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg 2024-09-21T05:50:52.610 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest 2024-09-21T05:50:52.612 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-c2port 2024-09-21T05:50:52.615 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency 2024-09-21T05:50:52.617 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class 2024-09-21T05:50:52.619 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870 2024-09-21T05:50:52.622 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533 2024-09-21T05:50:52.624 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi 2024-09-21T05:50:52.626 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl 2024-09-21T05:50:52.629 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq 2024-09-21T05:50:52.631 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon 2024-09-21T05:50:52.633 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu 2024-09-21T05:50:52.635 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu 2024-09-21T05:50:52.637 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu 2024-09-21T05:50:52.640 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd 2024-09-21T05:50:52.643 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led 2024-09-21T05:50:52.645 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533 2024-09-21T05:50:52.647 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r 2024-09-21T05:50:52.649 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei 2024-09-21T05:50:52.651 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt 2024-09-21T05:50:52.654 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd 2024-09-21T05:50:52.656 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net 2024-09-21T05:50:52.658 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv 2024-09-21T05:50:52.661 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm 2024-09-21T05:50:52.663 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan 2024-09-21T05:50:52.665 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh 2024-09-21T05:50:52.667 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues 2024-09-21T05:50:52.670 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics 2024-09-21T05:50:52.672 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd 2024-09-21T05:50:52.674 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-power 2024-09-21T05:50:52.677 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap 2024-09-21T05:50:52.679 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm 2024-09-21T05:50:52.681 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc 2024-09-21T05:50:52.683 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator 2024-09-21T05:50:52.685 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration 2024-09-21T05:50:52.688 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host 2024-09-21T05:50:52.690 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc 2024-09-21T05:50:52.692 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc 2024-09-21T05:50:52.695 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-dev 2024-09-21T05:50:52.697 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices 2024-09-21T05:50:52.699 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac 2024-09-21T05:50:52.702 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node 2024-09-21T05:50:52.704 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr 2024-09-21T05:50:52.706 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory 2024-09-21T05:50:52.709 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc 2024-09-21T05:50:52.711 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online 2024-09-21T05:50:52.713 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget 2024-09-21T05:50:52.715 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3 2024-09-21T05:50:52.717 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb 2024-09-21T05:50:52.720 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power 2024-09-21T05:50:52.722 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0 2024-09-21T05:50:52.726 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1 2024-09-21T05:50:52.728 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2 2024-09-21T05:50:52.730 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot 2024-09-21T05:50:52.733 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup 2024-09-21T05:50:52.735 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state 2024-09-21T05:50:52.737 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state 2024-09-21T05:50:52.739 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use 2024-09-21T05:50:52.742 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc 2024-09-21T05:50:52.744 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun 2024-09-21T05:50:52.746 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu 2024-09-21T05:50:52.748 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl 2024-09-21T05:50:52.750 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu 2024-09-21T05:50:52.753 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe 2024-09-21T05:50:52.756 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid 2024-09-21T05:50:52.758 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo 2024-09-21T05:50:52.760 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff 2024-09-21T05:50:52.762 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch 2024-09-21T05:50:52.765 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd 2024-09-21T05:50:52.767 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys 2024-09-21T05:50:52.769 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo 2024-09-21T05:50:52.772 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku 2024-09-21T05:50:52.774 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone 2024-09-21T05:50:52.777 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus 2024-09-21T05:50:52.779 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure 2024-09-21T05:50:52.781 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus 2024-09-21T05:50:52.784 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua 2024-09-21T05:50:52.786 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra 2024-09-21T05:50:53.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:53 smithi070 ceph-mon[30981]: pgmap v412: 129 pgs: 129 active+clean; 13 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2024-09-21T05:50:53.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:53 smithi116 ceph-mon[34332]: pgmap v412: 129 pgs: 129 active+clean; 13 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2024-09-21T05:50:53.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:53 smithi160 ceph-mon[33979]: pgmap v412: 129 pgs: 129 active+clean; 13 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2024-09-21T05:50:55.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:55 smithi070 ceph-mon[30981]: pgmap v413: 129 pgs: 129 active+clean; 57 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.7 MiB/s wr, 18 op/s 2024-09-21T05:50:55.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:55 smithi116 ceph-mon[34332]: pgmap v413: 129 pgs: 129 active+clean; 57 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.7 MiB/s wr, 18 op/s 2024-09-21T05:50:55.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:55 smithi160 ceph-mon[33979]: pgmap v413: 129 pgs: 129 active+clean; 57 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.7 MiB/s wr, 18 op/s 2024-09-21T05:50:56.237 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos 2024-09-21T05:50:56.240 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu 2024-09-21T05:50:56.243 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1 2024-09-21T05:50:56.245 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote 2024-09-21T05:50:56.248 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek 2024-09-21T05:50:56.252 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start 2024-09-21T05:50:56.254 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback 2024-09-21T05:50:56.258 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi 2024-09-21T05:50:56.260 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop 2024-09-21T05:50:56.263 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid 2024-09-21T05:50:56.266 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse 2024-09-21T05:50:56.268 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi 2024-09-21T05:50:56.271 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom 2024-09-21T05:50:56.273 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback 2024-09-21T05:50:56.275 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront 2024-09-21T05:50:56.278 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi 2024-09-21T05:50:56.281 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi 2024-09-21T05:50:56.284 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi 2024-09-21T05:50:56.286 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map 2024-09-21T05:50:56.289 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi 2024-09-21T05:50:56.292 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log 2024-09-21T05:50:56.294 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap 2024-09-21T05:50:56.297 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw 2024-09-21T05:50:56.299 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi 2024-09-21T05:50:56.302 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv 2024-09-21T05:50:56.304 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4 2024-09-21T05:50:56.307 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs 2024-09-21T05:50:56.310 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2 2024-09-21T05:50:56.312 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs 2024-09-21T05:50:56.314 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-gpio 2024-09-21T05:50:56.317 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085 2024-09-21T05:50:56.319 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ibft 2024-09-21T05:50:56.322 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params 2024-09-21T05:50:56.324 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps 2024-09-21T05:50:56.327 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups 2024-09-21T05:50:56.329 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch 2024-09-21T05:50:56.331 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm 2024-09-21T05:50:56.333 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages 2024-09-21T05:50:56.336 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm 2024-09-21T05:50:56.338 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab 2024-09-21T05:50:56.341 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids 2024-09-21T05:50:56.343 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo 2024-09-21T05:50:56.346 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline 2024-09-21T05:50:56.348 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-module 2024-09-21T05:50:56.351 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2 2024-09-21T05:50:56.354 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop 2024-09-21T05:50:56.356 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi 2024-09-21T05:50:56.358 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91 2024-09-21T05:50:56.361 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb 2024-09-21T05:50:56.363 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg 2024-09-21T05:50:56.366 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop 2024-09-21T05:50:56.368 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop 2024-09-21T05:50:56.370 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim 2024-09-21T05:50:56.373 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop 2024-09-21T05:50:56.375 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb 2024-09-21T05:50:56.377 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500 2024-09-21T05:50:56.380 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-power 2024-09-21T05:50:56.382 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-pps 2024-09-21T05:50:56.385 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-profiling 2024-09-21T05:50:56.387 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ptp 2024-09-21T05:50:56.389 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-tty 2024-09-21T05:50:56.392 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf 2024-09-21T05:50:56.394 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/BUG-HUNTING 2024-09-21T05:50:56.397 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/Changes 2024-09-21T05:50:56.399 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/CodeOfConflict 2024-09-21T05:50:56.401 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/CodingStyle 2024-09-21T05:50:56.404 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DMA-API-HOWTO.txt 2024-09-21T05:50:56.407 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DMA-API.txt 2024-09-21T05:50:56.410 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DMA-ISA-LPC.txt 2024-09-21T05:50:56.413 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DMA-attributes.txt 2024-09-21T05:50:56.415 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/ 2024-09-21T05:50:56.417 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/.gitignore 2024-09-21T05:50:56.418 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/80211.tmpl 2024-09-21T05:50:56.421 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/Makefile 2024-09-21T05:50:56.423 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl 2024-09-21T05:50:56.426 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/crypto-API.tmpl 2024-09-21T05:50:56.429 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/debugobjects.tmpl 2024-09-21T05:50:56.432 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/device-drivers.tmpl 2024-09-21T05:50:56.434 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl 2024-09-21T05:50:56.436 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/drm.tmpl 2024-09-21T05:50:56.443 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/filesystems.tmpl 2024-09-21T05:50:56.446 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/gadget.tmpl 2024-09-21T05:50:56.449 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/genericirq.tmpl 2024-09-21T05:50:56.452 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/kernel-api.tmpl 2024-09-21T05:50:56.455 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl 2024-09-21T05:50:56.458 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl 2024-09-21T05:50:56.461 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/kgdb.tmpl 2024-09-21T05:50:56.465 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/libata.tmpl 2024-09-21T05:50:56.468 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/librs.tmpl 2024-09-21T05:50:56.471 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/lsm.tmpl 2024-09-21T05:50:56.473 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/ 2024-09-21T05:50:56.475 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/Makefile 2024-09-21T05:50:56.478 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/bayer.png.b64 2024-09-21T05:50:56.480 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/constraints.png.b64 2024-09-21T05:50:56.483 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/crop.gif.b64 2024-09-21T05:50:56.485 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ 2024-09-21T05:50:56.487 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore 2024-09-21T05:50:56.489 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml 2024-09-21T05:50:56.492 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml 2024-09-21T05:50:56.495 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml 2024-09-21T05:50:56.498 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml 2024-09-21T05:50:56.500 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml 2024-09-21T05:50:56.504 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf 2024-09-21T05:50:56.506 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml 2024-09-21T05:50:56.509 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml 2024-09-21T05:50:56.512 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml 2024-09-21T05:50:56.515 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml 2024-09-21T05:50:56.519 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/net.xml 2024-09-21T05:50:56.521 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/video.xml 2024-09-21T05:50:56.525 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64 2024-09-21T05:50:56.529 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64 2024-09-21T05:50:56.533 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64 2024-09-21T05:50:56.535 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64 2024-09-21T05:50:56.538 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64 2024-09-21T05:50:56.542 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64 2024-09-21T05:50:56.543 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/selection.png.b64 2024-09-21T05:50:56.546 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/ 2024-09-21T05:50:56.547 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore 2024-09-21T05:50:56.550 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml 2024-09-21T05:50:56.552 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml 2024-09-21T05:50:56.555 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/common.xml 2024-09-21T05:50:56.557 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml 2024-09-21T05:50:56.562 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml 2024-09-21T05:50:56.569 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf 2024-09-21T05:50:56.572 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml 2024-09-21T05:50:56.574 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml 2024-09-21T05:50:56.577 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml 2024-09-21T05:50:56.579 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml 2024-09-21T05:50:56.581 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml 2024-09-21T05:50:56.584 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml 2024-09-21T05:50:56.587 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml 2024-09-21T05:50:56.589 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml 2024-09-21T05:50:56.592 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml 2024-09-21T05:50:56.594 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml 2024-09-21T05:50:56.597 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml 2024-09-21T05:50:56.599 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml 2024-09-21T05:50:56.602 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml 2024-09-21T05:50:56.605 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml 2024-09-21T05:50:56.608 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml 2024-09-21T05:50:56.610 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml 2024-09-21T05:50:56.613 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf 2024-09-21T05:50:56.615 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf 2024-09-21T05:50:56.618 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml 2024-09-21T05:50:56.620 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml 2024-09-21T05:50:56.622 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml 2024-09-21T05:50:56.625 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml 2024-09-21T05:50:56.627 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml 2024-09-21T05:50:56.629 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml 2024-09-21T05:50:56.632 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml 2024-09-21T05:50:56.635 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml 2024-09-21T05:50:56.637 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml 2024-09-21T05:50:56.639 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml 2024-09-21T05:50:56.642 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/io.xml 2024-09-21T05:50:56.645 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml 2024-09-21T05:50:56.647 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml 2024-09-21T05:50:56.650 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml 2024-09-21T05:50:56.653 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml 2024-09-21T05:50:56.656 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml 2024-09-21T05:50:56.658 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml 2024-09-21T05:50:56.661 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml 2024-09-21T05:50:56.664 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml 2024-09-21T05:50:56.666 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml 2024-09-21T05:50:56.669 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml 2024-09-21T05:50:56.672 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml 2024-09-21T05:50:56.675 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf 2024-09-21T05:50:56.678 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml 2024-09-21T05:50:56.681 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml 2024-09-21T05:50:56.685 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml 2024-09-21T05:50:56.687 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml 2024-09-21T05:50:56.690 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml 2024-09-21T05:50:56.692 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml 2024-09-21T05:50:56.694 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml 2024-09-21T05:50:56.697 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml 2024-09-21T05:50:56.699 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml 2024-09-21T05:50:56.702 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml 2024-09-21T05:50:56.705 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml 2024-09-21T05:50:56.707 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml 2024-09-21T05:50:56.710 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml 2024-09-21T05:50:56.712 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml 2024-09-21T05:50:56.715 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml 2024-09-21T05:50:56.717 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml 2024-09-21T05:50:56.719 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml 2024-09-21T05:50:56.722 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml 2024-09-21T05:50:56.724 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml 2024-09-21T05:50:56.731 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml 2024-09-21T05:50:56.733 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml 2024-09-21T05:50:56.735 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml 2024-09-21T05:50:56.737 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml 2024-09-21T05:50:56.740 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml 2024-09-21T05:50:56.742 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml 2024-09-21T05:50:56.745 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml 2024-09-21T05:50:56.747 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml 2024-09-21T05:50:56.749 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml 2024-09-21T05:50:56.752 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml 2024-09-21T05:50:56.754 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml 2024-09-21T05:50:56.756 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml 2024-09-21T05:50:56.758 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml 2024-09-21T05:50:56.761 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml 2024-09-21T05:50:56.763 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml 2024-09-21T05:50:56.765 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml 2024-09-21T05:50:56.768 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml 2024-09-21T05:50:56.770 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml 2024-09-21T05:50:56.773 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml 2024-09-21T05:50:56.775 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml 2024-09-21T05:50:56.778 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml 2024-09-21T05:50:56.780 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml 2024-09-21T05:50:56.782 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml 2024-09-21T05:50:56.787 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml 2024-09-21T05:50:56.789 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml 2024-09-21T05:50:56.792 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml 2024-09-21T05:50:56.795 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml 2024-09-21T05:50:56.797 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml 2024-09-21T05:50:56.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia 2024-09-21T05:50:56.805 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg 2024-09-21T05:50:56.807 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia 2024-09-21T05:50:56.811 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg 2024-09-21T05:50:56.813 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia 2024-09-21T05:50:56.816 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg 2024-09-21T05:50:56.819 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml 2024-09-21T05:50:56.822 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml 2024-09-21T05:50:56.825 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf 2024-09-21T05:50:56.827 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf 2024-09-21T05:50:56.830 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf 2024-09-21T05:50:56.832 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml 2024-09-21T05:50:56.835 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml 2024-09-21T05:50:56.837 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml 2024-09-21T05:50:56.840 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml 2024-09-21T05:50:56.842 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml 2024-09-21T05:50:56.845 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml 2024-09-21T05:50:56.848 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml 2024-09-21T05:50:56.850 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml 2024-09-21T05:50:56.853 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml 2024-09-21T05:50:56.855 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml 2024-09-21T05:50:56.858 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml 2024-09-21T05:50:56.861 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml 2024-09-21T05:50:56.863 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml 2024-09-21T05:50:56.865 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml 2024-09-21T05:50:56.868 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml 2024-09-21T05:50:56.870 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml 2024-09-21T05:50:56.873 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml 2024-09-21T05:50:56.875 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml 2024-09-21T05:50:56.877 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml 2024-09-21T05:50:56.880 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml 2024-09-21T05:50:56.883 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml 2024-09-21T05:50:56.885 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml 2024-09-21T05:50:56.887 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml 2024-09-21T05:50:56.890 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml 2024-09-21T05:50:56.893 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml 2024-09-21T05:50:56.895 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml 2024-09-21T05:50:56.898 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml 2024-09-21T05:50:56.900 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml 2024-09-21T05:50:56.903 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml 2024-09-21T05:50:56.905 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml 2024-09-21T05:50:56.907 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml 2024-09-21T05:50:56.910 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml 2024-09-21T05:50:56.912 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml 2024-09-21T05:50:56.915 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml 2024-09-21T05:50:56.918 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml 2024-09-21T05:50:56.921 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml 2024-09-21T05:50:56.924 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml 2024-09-21T05:50:56.926 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml 2024-09-21T05:50:56.929 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml 2024-09-21T05:50:56.931 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml 2024-09-21T05:50:56.934 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml 2024-09-21T05:50:56.936 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml 2024-09-21T05:50:56.939 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml 2024-09-21T05:50:56.941 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml 2024-09-21T05:50:56.943 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml 2024-09-21T05:50:56.946 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml 2024-09-21T05:50:57.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:57 smithi070 ceph-mon[30981]: pgmap v414: 129 pgs: 129 active+clean; 67 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.6 MiB/s wr, 21 op/s 2024-09-21T05:50:57.553 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 17.0 2024-09-21T05:50:57.553 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:50:57.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:57 smithi116 ceph-mon[34332]: pgmap v414: 129 pgs: 129 active+clean; 67 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.6 MiB/s wr, 21 op/s 2024-09-21T05:50:57.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:57 smithi160 ceph-mon[33979]: pgmap v414: 129 pgs: 129 active+clean; 67 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.6 MiB/s wr, 21 op/s 2024-09-21T05:50:57.815 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:50:58.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.251+0000 7f0d2495b640 1 -- 172.21.15.70:0/1125578215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d201083a0 msgr2=0x7f0d201087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:58.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.251+0000 7f0d2495b640 1 --2- 172.21.15.70:0/1125578215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d201083a0 0x7f0d201087b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0d14009900 tx=0x7f0d1402a410 comp rx=0 tx=0).stop 2024-09-21T05:50:58.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.251+0000 7f0d2495b640 1 -- 172.21.15.70:0/1125578215 shutdown_connections 2024-09-21T05:50:58.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.251+0000 7f0d2495b640 1 --2- 172.21.15.70:0/1125578215 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d20108cf0 0x7f0d2010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:58.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.251+0000 7f0d2495b640 1 --2- 172.21.15.70:0/1125578215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d201083a0 0x7f0d201087b0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:58.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.251+0000 7f0d2495b640 1 --2- 172.21.15.70:0/1125578215 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d20102a60 0x7f0d20102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:58.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.251+0000 7f0d2495b640 1 -- 172.21.15.70:0/1125578215 >> 172.21.15.70:0/1125578215 conn(0x7f0d20079730 msgr2=0x7f0d20079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:58.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.251+0000 7f0d2495b640 1 -- 172.21.15.70:0/1125578215 shutdown_connections 2024-09-21T05:50:58.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.251+0000 7f0d2495b640 1 -- 172.21.15.70:0/1125578215 wait complete. 2024-09-21T05:50:58.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.252+0000 7f0d2495b640 1 Processor -- start 2024-09-21T05:50:58.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.252+0000 7f0d2495b640 1 -- start start 2024-09-21T05:50:58.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.253+0000 7f0d2495b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d20102a60 0x7f0d2019b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:58.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.253+0000 7f0d2495b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d201083a0 0x7f0d2019b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:58.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.253+0000 7f0d2495b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d20108cf0 0x7f0d2019bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:58.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.253+0000 7f0d2495b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0d20112990 con 0x7f0d20108cf0 2024-09-21T05:50:58.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.253+0000 7f0d2495b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0d20112810 con 0x7f0d20102a60 2024-09-21T05:50:58.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.253+0000 7f0d2495b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0d20112b10 con 0x7f0d201083a0 2024-09-21T05:50:58.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.253+0000 7f0d1ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d20108cf0 0x7f0d2019bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:58.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.253+0000 7f0d1ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d20108cf0 0x7f0d2019bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39212/0 (socket says 172.21.15.70:39212) 2024-09-21T05:50:58.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.253+0000 7f0d1ed9d640 1 -- 172.21.15.70:0/2514481238 learned_addr learned my addr 172.21.15.70:0/2514481238 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:50:58.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.253+0000 7f0d1dd9b640 1 --2- 172.21.15.70:0/2514481238 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d201083a0 0x7f0d2019b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:58.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.253+0000 7f0d1e59c640 1 --2- 172.21.15.70:0/2514481238 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d20102a60 0x7f0d2019b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:58.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.253+0000 7f0d1ed9d640 1 -- 172.21.15.70:0/2514481238 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d201083a0 msgr2=0x7f0d2019b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:58.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.253+0000 7f0d1ed9d640 1 --2- 172.21.15.70:0/2514481238 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d201083a0 0x7f0d2019b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:58.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.253+0000 7f0d1ed9d640 1 -- 172.21.15.70:0/2514481238 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d20102a60 msgr2=0x7f0d2019b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:58.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.253+0000 7f0d1ed9d640 1 --2- 172.21.15.70:0/2514481238 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d20102a60 0x7f0d2019b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:58.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.253+0000 7f0d1ed9d640 1 -- 172.21.15.70:0/2514481238 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d201a6620 con 0x7f0d20108cf0 2024-09-21T05:50:58.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.253+0000 7f0d1ed9d640 1 --2- 172.21.15.70:0/2514481238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d20108cf0 0x7f0d2019bde0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0d1800cad0 tx=0x7f0d1800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:58.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.254+0000 7f0d0f7fe640 1 -- 172.21.15.70:0/2514481238 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1800ad60 con 0x7f0d20108cf0 2024-09-21T05:50:58.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.254+0000 7f0d2495b640 1 -- 172.21.15.70:0/2514481238 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d201a6910 con 0x7f0d20108cf0 2024-09-21T05:50:58.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.254+0000 7f0d0f7fe640 1 -- 172.21.15.70:0/2514481238 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f0d18005020 con 0x7f0d20108cf0 2024-09-21T05:50:58.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.254+0000 7f0d0f7fe640 1 -- 172.21.15.70:0/2514481238 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1800f6b0 con 0x7f0d20108cf0 2024-09-21T05:50:58.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.254+0000 7f0d2495b640 1 -- 172.21.15.70:0/2514481238 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d201a6dd0 con 0x7f0d20108cf0 2024-09-21T05:50:58.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.255+0000 7f0d2495b640 1 -- 172.21.15.70:0/2514481238 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d20102e70 con 0x7f0d20108cf0 2024-09-21T05:50:58.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.257+0000 7f0d0f7fe640 1 -- 172.21.15.70:0/2514481238 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f0d18005580 con 0x7f0d20108cf0 2024-09-21T05:50:58.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.258+0000 7f0d0f7fe640 1 --2- 172.21.15.70:0/2514481238 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0d080b6510 0x7f0d080b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:58.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.258+0000 7f0d1e59c640 1 --2- 172.21.15.70:0/2514481238 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0d080b6510 0x7f0d080b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:58.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.258+0000 7f0d0f7fe640 1 -- 172.21.15.70:0/2514481238 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f0d180e7a90 con 0x7f0d20108cf0 2024-09-21T05:50:58.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.259+0000 7f0d1e59c640 1 --2- 172.21.15.70:0/2514481238 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0d080b6510 0x7f0d080b8a20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0d2006b9e0 tx=0x7f0d10009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:58.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.261+0000 7f0d0f7fe640 1 -- 172.21.15.70:0/2514481238 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0d18014030 con 0x7f0d20108cf0 2024-09-21T05:50:58.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.477+0000 7f0d2495b640 1 -- 172.21.15.70:0/2514481238 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d2006b290 con 0x7f0d20108cf0 2024-09-21T05:50:58.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.477+0000 7f0d0f7fe640 1 -- 172.21.15.70:0/2514481238 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11986 (secure 0 0 0) 0x7f0d180adf30 con 0x7f0d20108cf0 2024-09-21T05:50:58.481 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:50:58.481 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"btime":"2024-09-21T05:49:35:887363+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3519318330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3519318330},{"type":"v1","addr":"172.21.15.70:6835","nonce":3519318330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2706663460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2706663460},{"type":"v1","addr":"172.21.15.70:6837","nonce":2706663460}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:47:06.246985+0000","modified":"2024-09-21T05:49:35.712686+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24628,"mds_2":24611,"mds_3":24610,"mds_4":24598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/1914209867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1914209867},{"type":"v1","addr":"172.21.15.70:6839","nonce":1914209867}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3392175775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3392175775},{"type":"v1","addr":"172.21.15.70:6841","nonce":3392175775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/3543945704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3543945704},{"type":"v1","addr":"172.21.15.160:6833","nonce":3543945704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6833/283778129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":283778129},{"type":"v1","addr":"172.21.15.116:6833","nonce":283778129}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/3787256790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3787256790},{"type":"v1","addr":"172.21.15.116:6835","nonce":3787256790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.160:6835/2001692372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2001692372},{"type":"v1","addr":"172.21.15.160:6835","nonce":2001692372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.160:6837/2558120045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2558120045},{"type":"v1","addr":"172.21.15.160:6837","nonce":2558120045}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24611":{"gid":24611,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/444312934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":444312934},{"type":"v1","addr":"172.21.15.116:6837","nonce":444312934}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.160:6839/1339744282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1339744282},{"type":"v1","addr":"172.21.15.160:6839","nonce":1339744282}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/3952175670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3952175670},{"type":"v1","addr":"172.21.15.116:6839","nonce":3952175670}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24641,"qdb_cluster":[24598,24611,24610,24628,24641]},"id":1}]} 2024-09-21T05:50:58.481 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-09-21T05:50:58.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.480+0000 7f0d2495b640 1 -- 172.21.15.70:0/2514481238 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0d080b6510 msgr2=0x7f0d080b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:58.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.480+0000 7f0d2495b640 1 --2- 172.21.15.70:0/2514481238 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0d080b6510 0x7f0d080b8a20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0d2006b9e0 tx=0x7f0d10009110 comp rx=0 tx=0).stop 2024-09-21T05:50:58.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.480+0000 7f0d2495b640 1 -- 172.21.15.70:0/2514481238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d20108cf0 msgr2=0x7f0d2019bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:58.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.480+0000 7f0d2495b640 1 --2- 172.21.15.70:0/2514481238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d20108cf0 0x7f0d2019bde0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0d1800cad0 tx=0x7f0d1800ced0 comp rx=0 tx=0).stop 2024-09-21T05:50:58.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.480+0000 7f0d2495b640 1 -- 172.21.15.70:0/2514481238 shutdown_connections 2024-09-21T05:50:58.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.480+0000 7f0d2495b640 1 --2- 172.21.15.70:0/2514481238 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f0d080b6510 0x7f0d080b8a20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:58.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.480+0000 7f0d2495b640 1 --2- 172.21.15.70:0/2514481238 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d201083a0 0x7f0d2019b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:58.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.480+0000 7f0d2495b640 1 --2- 172.21.15.70:0/2514481238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d20108cf0 0x7f0d2019bde0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:58.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.480+0000 7f0d2495b640 1 --2- 172.21.15.70:0/2514481238 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d20102a60 0x7f0d2019b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:58.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.480+0000 7f0d2495b640 1 -- 172.21.15.70:0/2514481238 >> 172.21.15.70:0/2514481238 conn(0x7f0d20079730 msgr2=0x7f0d201052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:58.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.480+0000 7f0d2495b640 1 -- 172.21.15.70:0/2514481238 shutdown_connections 2024-09-21T05:50:58.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:50:58.480+0000 7f0d2495b640 1 -- 172.21.15.70:0/2514481238 wait complete. 2024-09-21T05:50:59.334 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24641 quiesce db / --timeout 90 --expiration 137.0 --await-for 45.0' 2024-09-21T05:50:59.335 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24641 quiesce db / --timeout 90 --expiration 137.0 --await-for 45.0 2024-09-21T05:50:59.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:59 smithi070 ceph-mon[30981]: pgmap v415: 129 pgs: 129 active+clean; 80 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.6 MiB/s wr, 30 op/s 2024-09-21T05:50:59.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:50:59 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2514481238' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:59.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:59 smithi116 ceph-mon[34332]: pgmap v415: 129 pgs: 129 active+clean; 80 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.6 MiB/s wr, 30 op/s 2024-09-21T05:50:59.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:50:59 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2514481238' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:59.581 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:50:59.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:59 smithi160 ceph-mon[33979]: pgmap v415: 129 pgs: 129 active+clean; 80 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.6 MiB/s wr, 30 op/s 2024-09-21T05:50:59.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:50:59 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2514481238' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:00.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.050+0000 7fc14b6b7640 1 -- 172.21.15.70:0/52961111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1441083c0 msgr2=0x7fc1441087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:00.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.050+0000 7fc14b6b7640 1 --2- 172.21.15.70:0/52961111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1441083c0 0x7fc1441087d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc134009900 tx=0x7fc13402a410 comp rx=0 tx=0).stop 2024-09-21T05:51:00.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.050+0000 7fc14b6b7640 1 -- 172.21.15.70:0/52961111 shutdown_connections 2024-09-21T05:51:00.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.050+0000 7fc14b6b7640 1 --2- 172.21.15.70:0/52961111 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc144108d10 0x7fc14410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:00.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.050+0000 7fc14b6b7640 1 --2- 172.21.15.70:0/52961111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1441083c0 0x7fc1441087d0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:00.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.050+0000 7fc14b6b7640 1 --2- 172.21.15.70:0/52961111 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc144102a80 0x7fc144102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:00.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.050+0000 7fc14b6b7640 1 -- 172.21.15.70:0/52961111 >> 172.21.15.70:0/52961111 conn(0x7fc144079760 msgr2=0x7fc144079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:00.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.050+0000 7fc14b6b7640 1 -- 172.21.15.70:0/52961111 shutdown_connections 2024-09-21T05:51:00.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.050+0000 7fc14b6b7640 1 -- 172.21.15.70:0/52961111 wait complete. 2024-09-21T05:51:00.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.051+0000 7fc14b6b7640 1 Processor -- start 2024-09-21T05:51:00.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.051+0000 7fc14b6b7640 1 -- start start 2024-09-21T05:51:00.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.051+0000 7fc14b6b7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc144102a80 0x7fc144199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:00.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.051+0000 7fc14b6b7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc1441083c0 0x7fc1441998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:00.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.051+0000 7fc14b6b7640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc144108d10 0x7fc14419eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:00.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.051+0000 7fc14b6b7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc144112950 con 0x7fc144102a80 2024-09-21T05:51:00.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.051+0000 7fc14b6b7640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc1441127d0 con 0x7fc1441083c0 2024-09-21T05:51:00.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.051+0000 7fc14b6b7640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc144112ad0 con 0x7fc144108d10 2024-09-21T05:51:00.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.051+0000 7fc149453640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc144102a80 0x7fc144199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:00.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.051+0000 7fc149453640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc144102a80 0x7fc144199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39234/0 (socket says 172.21.15.70:39234) 2024-09-21T05:51:00.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.051+0000 7fc149453640 1 -- 172.21.15.70:0/1637429250 learned_addr learned my addr 172.21.15.70:0/1637429250 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:51:00.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.052+0000 7fc148c52640 1 --2- 172.21.15.70:0/1637429250 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc1441083c0 0x7fc1441998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:00.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.052+0000 7fc149c54640 1 --2- 172.21.15.70:0/1637429250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc144108d10 0x7fc14419eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:00.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.052+0000 7fc149453640 1 -- 172.21.15.70:0/1637429250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc144108d10 msgr2=0x7fc14419eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:00.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.052+0000 7fc149453640 1 --2- 172.21.15.70:0/1637429250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc144108d10 0x7fc14419eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:00.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.052+0000 7fc149453640 1 -- 172.21.15.70:0/1637429250 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc1441083c0 msgr2=0x7fc1441998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:00.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.052+0000 7fc149453640 1 --2- 172.21.15.70:0/1637429250 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc1441083c0 0x7fc1441998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:00.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.052+0000 7fc149453640 1 -- 172.21.15.70:0/1637429250 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc14419f1f0 con 0x7fc144102a80 2024-09-21T05:51:00.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.052+0000 7fc148c52640 1 --2- 172.21.15.70:0/1637429250 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc1441083c0 0x7fc1441998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:51:00.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.052+0000 7fc149453640 1 --2- 172.21.15.70:0/1637429250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc144102a80 0x7fc144199340 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc14000c920 tx=0x7fc14000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:00.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.052+0000 7fc13a7fc640 1 -- 172.21.15.70:0/1637429250 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc140007c70 con 0x7fc144102a80 2024-09-21T05:51:00.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.052+0000 7fc13a7fc640 1 -- 172.21.15.70:0/1637429250 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fc140007e10 con 0x7fc144102a80 2024-09-21T05:51:00.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.052+0000 7fc14b6b7640 1 -- 172.21.15.70:0/1637429250 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc14419f4e0 con 0x7fc144102a80 2024-09-21T05:51:00.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.052+0000 7fc13a7fc640 1 -- 172.21.15.70:0/1637429250 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1400187b0 con 0x7fc144102a80 2024-09-21T05:51:00.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.052+0000 7fc14b6b7640 1 -- 172.21.15.70:0/1637429250 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1441a5d00 con 0x7fc144102a80 2024-09-21T05:51:00.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.055+0000 7fc151c2b740 1 Processor -- start 2024-09-21T05:51:00.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.055+0000 7fc13a7fc640 1 -- 172.21.15.70:0/1637429250 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7fc14000f450 con 0x7fc144102a80 2024-09-21T05:51:00.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.055+0000 7fc151c2b740 1 -- start start 2024-09-21T05:51:00.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.055+0000 7fc151c2b740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2e905a840 0x55c2e9401600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:00.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.055+0000 7fc151c2b740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c2e9031980 0x55c2e9401b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:00.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.055+0000 7fc151c2b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2e9039b60 0x55c2e9402080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:00.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.055+0000 7fc151c2b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c2e9377b90 con 0x55c2e9039b60 2024-09-21T05:51:00.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.055+0000 7fc151c2b740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c2e9366fc0 con 0x55c2e9031980 2024-09-21T05:51:00.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.055+0000 7fc151c2b740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55c2e936add0 con 0x55c2e905a840 2024-09-21T05:51:00.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.055+0000 7fc148c52640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2e9039b60 0x55c2e9402080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:00.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.055+0000 7fc148c52640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2e9039b60 0x55c2e9402080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39238/0 (socket says 172.21.15.70:39238) 2024-09-21T05:51:00.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.055+0000 7fc148c52640 1 -- 172.21.15.70:0/848749027 learned_addr learned my addr 172.21.15.70:0/848749027 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:51:00.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.055+0000 7fc149453640 1 --2- 172.21.15.70:0/848749027 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c2e9031980 0x55c2e9401b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:00.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.056+0000 7fc149c54640 1 --2- 172.21.15.70:0/848749027 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2e905a840 0x55c2e9401600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:00.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.056+0000 7fc148c52640 1 -- 172.21.15.70:0/848749027 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2e905a840 msgr2=0x55c2e9401600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:51:00.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.056+0000 7fc148c52640 1 --2- 172.21.15.70:0/848749027 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2e905a840 0x55c2e9401600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:00.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.056+0000 7fc148c52640 1 -- 172.21.15.70:0/848749027 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c2e9031980 msgr2=0x55c2e9401b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:51:00.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.056+0000 7fc148c52640 1 --2- 172.21.15.70:0/848749027 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c2e9031980 0x55c2e9401b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:00.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.056+0000 7fc148c52640 1 -- 172.21.15.70:0/848749027 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2e92ee060 con 0x55c2e9039b60 2024-09-21T05:51:00.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.056+0000 7fc13a7fc640 1 --2- 172.21.15.70:0/1637429250 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc1300b6540 0x7fc1300b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:00.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.056+0000 7fc149c54640 1 --2- 172.21.15.70:0/1637429250 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc1300b6540 0x7fc1300b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:00.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.056+0000 7fc13a7fc640 1 -- 172.21.15.70:0/1637429250 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fc1400e78a0 con 0x7fc144102a80 2024-09-21T05:51:00.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.056+0000 7fc148c52640 1 --2- 172.21.15.70:0/848749027 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2e9039b60 0x55c2e9402080 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc134000c00 tx=0x7fc134032de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d84e77d32e034c01 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:00.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.056+0000 7fc12f7fe640 1 -- 172.21.15.70:0/848749027 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc13403f070 con 0x55c2e9039b60 2024-09-21T05:51:00.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.056+0000 7fc12f7fe640 1 -- 172.21.15.70:0/848749027 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fc134031600 con 0x55c2e9039b60 2024-09-21T05:51:00.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.056+0000 7fc12f7fe640 1 -- 172.21.15.70:0/848749027 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc134035070 con 0x55c2e9039b60 2024-09-21T05:51:00.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.057+0000 7fc151c2b740 1 -- 172.21.15.70:0/848749027 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2e9039b60 msgr2=0x55c2e9402080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:00.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.057+0000 7fc149c54640 1 --2- 172.21.15.70:0/1637429250 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc1300b6540 0x7fc1300b8a50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc13c005fd0 tx=0x7fc13c009620 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:00.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.057+0000 7fc151c2b740 1 --2- 172.21.15.70:0/848749027 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2e9039b60 0x55c2e9402080 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc134000c00 tx=0x7fc134032de0 comp rx=0 tx=0).stop 2024-09-21T05:51:00.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.057+0000 7fc151c2b740 1 -- 172.21.15.70:0/848749027 shutdown_connections 2024-09-21T05:51:00.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.057+0000 7fc151c2b740 1 --2- 172.21.15.70:0/848749027 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2e9039b60 0x55c2e9402080 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:00.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.057+0000 7fc151c2b740 1 --2- 172.21.15.70:0/848749027 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c2e9031980 0x55c2e9401b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:00.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.057+0000 7fc151c2b740 1 --2- 172.21.15.70:0/848749027 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2e905a840 0x55c2e9401600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:00.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.057+0000 7fc151c2b740 1 -- 172.21.15.70:0/848749027 >> 172.21.15.70:0/848749027 conn(0x55c2e904e990 msgr2=0x55c2e93ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:00.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.057+0000 7fc151c2b740 1 -- 172.21.15.70:0/848749027 shutdown_connections 2024-09-21T05:51:00.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.057+0000 7fc151c2b740 1 -- 172.21.15.70:0/848749027 wait complete. 2024-09-21T05:51:00.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.058+0000 7fc151c2b740 1 -- start start 2024-09-21T05:51:00.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.058+0000 7fc151c2b740 1 Processor -- start 2024-09-21T05:51:00.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.058+0000 7fc151c2b740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c2e9031980 0x55c2e940f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:00.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.058+0000 7fc151c2b740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2e9039b60 0x55c2e940f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:00.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.058+0000 7fc151c2b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2e905a840 0x55c2e941b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:00.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.058+0000 7fc151c2b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c2e91c87a0 con 0x55c2e905a840 2024-09-21T05:51:00.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.058+0000 7fc151c2b740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c2e930c0a0 con 0x55c2e9031980 2024-09-21T05:51:00.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.058+0000 7fc151c2b740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55c2e9411ee0 con 0x55c2e9039b60 2024-09-21T05:51:00.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.059+0000 7fc151c2b740 10 client.0 _ll_register_callbacks cb 0x55c2e92e93c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:51:00.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.059+0000 7fc148c52640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2e9039b60 0x55c2e940f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:00.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.059+0000 7fc149c54640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2e905a840 0x55c2e941b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:00.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.059+0000 7fc148c52640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2e9039b60 0x55c2e940f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.70:60150/0 (socket says 172.21.15.70:60150) 2024-09-21T05:51:00.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.059+0000 7fc148c52640 1 -- 172.21.15.70:0/3896033510 learned_addr learned my addr 172.21.15.70:0/3896033510 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:51:00.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.059+0000 7fc149453640 1 --2- 172.21.15.70:0/3896033510 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c2e9031980 0x55c2e940f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:00.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.059+0000 7fc148c52640 1 -- 172.21.15.70:0/3896033510 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c2e9031980 msgr2=0x55c2e940f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:51:00.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.059+0000 7fc148c52640 1 --2- 172.21.15.70:0/3896033510 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c2e9031980 0x55c2e940f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:00.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.059+0000 7fc148c52640 1 -- 172.21.15.70:0/3896033510 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2e905a840 msgr2=0x55c2e941b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:51:00.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.059+0000 7fc148c52640 1 --2- 172.21.15.70:0/3896033510 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2e905a840 0x55c2e941b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:00.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.059+0000 7fc148c52640 1 -- 172.21.15.70:0/3896033510 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2e92fa880 con 0x55c2e9039b60 2024-09-21T05:51:00.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.059+0000 7fc148c52640 1 --2- 172.21.15.70:0/3896033510 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2e9039b60 0x55c2e940f880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc1340319e0 tx=0x7fc134031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7dd98d55b437a632 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:00.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.059+0000 7fc12cff9640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-09-21T05:51:00.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.060+0000 7fc12cff9640 1 -- 172.21.15.70:0/3896033510 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc13403f030 con 0x55c2e9039b60 2024-09-21T05:51:00.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.060+0000 7fc151c2b740 1 -- 172.21.15.70:0/3896033510 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc134031600 con 0x55c2e9039b60 2024-09-21T05:51:00.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.060+0000 7fc12cff9640 1 -- 172.21.15.70:0/3896033510 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fc134004250 con 0x55c2e9039b60 2024-09-21T05:51:00.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.060+0000 7fc12cff9640 1 -- 172.21.15.70:0/3896033510 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc134054050 con 0x55c2e9039b60 2024-09-21T05:51:00.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.060+0000 7fc151c2b740 10 client.25204 fetch_fsmap learned FSMap version 28 2024-09-21T05:51:00.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.060+0000 7fc151c2b740 1 -- 172.21.15.70:0/3896033510 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c2e90d4b90 con 0x55c2e9039b60 2024-09-21T05:51:00.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.060+0000 7fc12cff9640 1 -- 172.21.15.70:0/3896033510 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fc134031600 con 0x55c2e9039b60 2024-09-21T05:51:00.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.061+0000 7fc12cff9640 1 -- 172.21.15.70:0/3896033510 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fc13403b4f0 con 0x55c2e9039b60 2024-09-21T05:51:00.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.061+0000 7fc151c2b740 10 client.25204 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T05:51:00.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.061+0000 7fc151c2b740 10 client.25204 resolve_mds: validated gid 24641 aka daemon mds.b 2024-09-21T05:51:00.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.061+0000 7fc151c2b740 20 client.25204 populate_metadata read hostname 'smithi070' 2024-09-21T05:51:00.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.061+0000 7fc151c2b740 1 --2- 172.21.15.70:0/3896033510 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55c2e90191c0 0x55c2e9408ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:00.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.061+0000 7fc151c2b740 4 client.25204 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:51:00.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.061+0000 7fc151c2b740 1 -- 172.21.15.70:0/3896033510 --> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2e9379ae0 con 0x55c2e90191c0 2024-09-21T05:51:00.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.061+0000 7fc149453640 1 --2- 172.21.15.70:0/3896033510 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55c2e90191c0 0x55c2e9408ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:00.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.062+0000 7fc149453640 1 --2- 172.21.15.70:0/3896033510 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55c2e90191c0 0x55c2e9408ab0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=244f0adcf168e36d server_cookie=9a84e8a1ad788edf in_seq=0 out_seq=0 2024-09-21T05:51:00.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.062+0000 7fc12cff9640 10 client.25204 ms_handle_connect on v2:172.21.15.116:6838/3952175670 2024-09-21T05:51:00.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.062+0000 7fc12cff9640 1 -- 172.21.15.70:0/3896033510 <== mds.0 v2:172.21.15.116:6838/3952175670 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c2e9379ae0 con 0x55c2e90191c0 2024-09-21T05:51:00.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.062+0000 7fc12cff9640 10 client.25204 handle_command_reply: tid=0 2024-09-21T05:51:00.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.062+0000 7fc151c2b740 1 client.25204 shutdown 2024-09-21T05:51:00.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.062+0000 7fc151c2b740 1 -- 172.21.15.70:0/3896033510 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2e9039b60 msgr2=0x55c2e940f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:00.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.062+0000 7fc151c2b740 1 --2- 172.21.15.70:0/3896033510 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2e9039b60 0x55c2e940f880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc1340319e0 tx=0x7fc134031400 comp rx=0 tx=0).stop 2024-09-21T05:51:00.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.062+0000 7fc151c2b740 1 -- 172.21.15.70:0/3896033510 shutdown_connections 2024-09-21T05:51:00.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.062+0000 7fc151c2b740 1 --2- 172.21.15.70:0/3896033510 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55c2e90191c0 0x55c2e9408ab0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:00.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.062+0000 7fc151c2b740 1 --2- 172.21.15.70:0/3896033510 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2e9039b60 0x55c2e940f880 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:00.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.062+0000 7fc151c2b740 1 --2- 172.21.15.70:0/3896033510 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2e905a840 0x55c2e941b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:00.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.062+0000 7fc12cff9640 0 client.25204 ms_handle_reset on v2:172.21.15.116:6838/3952175670 2024-09-21T05:51:00.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.062+0000 7fc151c2b740 1 --2- 172.21.15.70:0/3896033510 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c2e9031980 0x55c2e940f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:00.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.062+0000 7fc151c2b740 1 -- 172.21.15.70:0/3896033510 >> 172.21.15.70:0/3896033510 conn(0x55c2e904e990 msgr2=0x55c2e9402ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:00.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.063+0000 7fc151c2b740 1 -- 172.21.15.70:0/3896033510 shutdown_connections 2024-09-21T05:51:00.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.063+0000 7fc151c2b740 1 -- 172.21.15.70:0/3896033510 wait complete. 2024-09-21T05:51:00.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.063+0000 7fc151c2b740 20 client.25204 trim_cache size 0 max 16384 2024-09-21T05:51:00.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.080+0000 7fc151c2b740 1 Processor -- start 2024-09-21T05:51:00.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.080+0000 7fc151c2b740 1 -- start start 2024-09-21T05:51:00.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.080+0000 7fc151c2b740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2e90191c0 0x55c2e9402d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:00.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.080+0000 7fc151c2b740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c2e9031980 0x55c2e941b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:00.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.080+0000 7fc151c2b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2e9039b60 0x55c2e941b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:00.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.080+0000 7fc151c2b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc1441ae980 con 0x55c2e9039b60 2024-09-21T05:51:00.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.080+0000 7fc151c2b740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc1441b04c0 con 0x55c2e9031980 2024-09-21T05:51:00.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.080+0000 7fc151c2b740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc1441af050 con 0x55c2e90191c0 2024-09-21T05:51:00.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.080+0000 7fc149c54640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2e9039b60 0x55c2e941b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:00.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.080+0000 7fc149c54640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2e9039b60 0x55c2e941b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39260/0 (socket says 172.21.15.70:39260) 2024-09-21T05:51:00.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.080+0000 7fc149c54640 1 -- 172.21.15.70:0/1205497753 learned_addr learned my addr 172.21.15.70:0/1205497753 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:51:00.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.080+0000 7fc149453640 1 --2- 172.21.15.70:0/1205497753 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2e90191c0 0x55c2e9402d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:00.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.080+0000 7fc148c52640 1 --2- 172.21.15.70:0/1205497753 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c2e9031980 0x55c2e941b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:00.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.080+0000 7fc149c54640 1 -- 172.21.15.70:0/1205497753 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2e90191c0 msgr2=0x55c2e9402d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:51:00.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.080+0000 7fc149c54640 1 --2- 172.21.15.70:0/1205497753 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2e90191c0 0x55c2e9402d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:00.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.080+0000 7fc149c54640 1 -- 172.21.15.70:0/1205497753 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c2e9031980 msgr2=0x55c2e941b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:51:00.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.080+0000 7fc149c54640 1 --2- 172.21.15.70:0/1205497753 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c2e9031980 0x55c2e941b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:00.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.080+0000 7fc149c54640 1 -- 172.21.15.70:0/1205497753 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2e9403d60 con 0x55c2e9039b60 2024-09-21T05:51:00.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.080+0000 7fc148c52640 1 --2- 172.21.15.70:0/1205497753 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c2e9031980 0x55c2e941b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:51:00.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.081+0000 7fc149c54640 1 --2- 172.21.15.70:0/1205497753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2e9039b60 0x55c2e941b6c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc13c01fab0 tx=0x7fc13c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d12f2a571a502935 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:00.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.081+0000 7fc12effd640 1 -- 172.21.15.70:0/1205497753 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc13c004b20 con 0x55c2e9039b60 2024-09-21T05:51:00.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.081+0000 7fc12effd640 1 -- 172.21.15.70:0/1205497753 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fc13c004cc0 con 0x55c2e9039b60 2024-09-21T05:51:00.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.081+0000 7fc12effd640 1 -- 172.21.15.70:0/1205497753 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc13c005020 con 0x55c2e9039b60 2024-09-21T05:51:00.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.081+0000 7fc151c2b740 1 -- 172.21.15.70:0/1205497753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2e9039b60 msgr2=0x55c2e941b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:00.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.081+0000 7fc151c2b740 1 --2- 172.21.15.70:0/1205497753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2e9039b60 0x55c2e941b6c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc13c01fab0 tx=0x7fc13c017000 comp rx=0 tx=0).stop 2024-09-21T05:51:00.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.082+0000 7fc151c2b740 1 -- 172.21.15.70:0/1205497753 shutdown_connections 2024-09-21T05:51:00.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.082+0000 7fc151c2b740 1 --2- 172.21.15.70:0/1205497753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2e9039b60 0x55c2e941b6c0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:00.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.082+0000 7fc151c2b740 1 --2- 172.21.15.70:0/1205497753 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c2e9031980 0x55c2e941b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:00.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.082+0000 7fc151c2b740 1 --2- 172.21.15.70:0/1205497753 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2e90191c0 0x55c2e9402d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:00.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.082+0000 7fc151c2b740 1 -- 172.21.15.70:0/1205497753 >> 172.21.15.70:0/1205497753 conn(0x55c2e904e990 msgr2=0x55c2e9402630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:00.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.082+0000 7fc151c2b740 1 -- 172.21.15.70:0/1205497753 shutdown_connections 2024-09-21T05:51:00.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.082+0000 7fc151c2b740 1 -- 172.21.15.70:0/1205497753 wait complete. 2024-09-21T05:51:00.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.082+0000 7fc151c2b740 1 -- start start 2024-09-21T05:51:00.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.082+0000 7fc151c2b740 1 Processor -- start 2024-09-21T05:51:00.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.082+0000 7fc151c2b740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c2e90191c0 0x55c2e9421050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:00.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.082+0000 7fc151c2b740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2e9031980 0x55c2e9421590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:00.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.083+0000 7fc151c2b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2e9039b60 0x55c2e9421b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:00.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.083+0000 7fc151c2b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc1441afdf0 con 0x55c2e9039b60 2024-09-21T05:51:00.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.083+0000 7fc151c2b740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc1441af720 con 0x55c2e90191c0 2024-09-21T05:51:00.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.083+0000 7fc151c2b740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc1441ac960 con 0x55c2e9031980 2024-09-21T05:51:00.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.083+0000 7fc151c2b740 10 client.0 _ll_register_callbacks cb 0x7fc1400ed500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:51:00.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.083+0000 7fc149c54640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2e9039b60 0x55c2e9421b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:00.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.083+0000 7fc149c54640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2e9039b60 0x55c2e9421b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39266/0 (socket says 172.21.15.70:39266) 2024-09-21T05:51:00.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.083+0000 7fc149c54640 1 -- 172.21.15.70:0/1084265282 learned_addr learned my addr 172.21.15.70:0/1084265282 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:51:00.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.083+0000 7fc149453640 1 --2- 172.21.15.70:0/1084265282 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c2e90191c0 0x55c2e9421050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:00.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.083+0000 7fc148c52640 1 --2- 172.21.15.70:0/1084265282 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2e9031980 0x55c2e9421590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:00.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.083+0000 7fc149c54640 1 -- 172.21.15.70:0/1084265282 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2e9031980 msgr2=0x55c2e9421590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:51:00.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.083+0000 7fc149c54640 1 --2- 172.21.15.70:0/1084265282 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2e9031980 0x55c2e9421590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:00.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.083+0000 7fc149c54640 1 -- 172.21.15.70:0/1084265282 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c2e90191c0 msgr2=0x55c2e9421050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:51:00.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.083+0000 7fc149c54640 1 --2- 172.21.15.70:0/1084265282 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c2e90191c0 0x55c2e9421050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:00.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.083+0000 7fc149c54640 1 -- 172.21.15.70:0/1084265282 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2e9489320 con 0x55c2e9039b60 2024-09-21T05:51:00.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.083+0000 7fc149c54640 1 --2- 172.21.15.70:0/1084265282 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2e9039b60 0x55c2e9421b10 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc13c009d30 tx=0x7fc13c01dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e0f4df12584e42 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:00.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.083+0000 7fc12cff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:51:00.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.083+0000 7fc12cff9640 1 -- 172.21.15.70:0/1084265282 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc13c012ad0 con 0x55c2e9039b60 2024-09-21T05:51:00.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.083+0000 7fc12cff9640 1 -- 172.21.15.70:0/1084265282 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fc13c012c70 con 0x55c2e9039b60 2024-09-21T05:51:00.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.083+0000 7fc151c2b740 1 -- 172.21.15.70:0/1084265282 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc13c004cc0 con 0x55c2e9039b60 2024-09-21T05:51:00.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.084+0000 7fc12cff9640 1 -- 172.21.15.70:0/1084265282 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc13c040050 con 0x55c2e9039b60 2024-09-21T05:51:00.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.084+0000 7fc151c2b740 10 client.15711 fetch_fsmap learned FSMap version 28 2024-09-21T05:51:00.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.084+0000 7fc151c2b740 1 -- 172.21.15.70:0/1084265282 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c2e948a580 con 0x55c2e9039b60 2024-09-21T05:51:00.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.084+0000 7fc12cff9640 1 -- 172.21.15.70:0/1084265282 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fc13c004cc0 con 0x55c2e9039b60 2024-09-21T05:51:00.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.084+0000 7fc12cff9640 1 -- 172.21.15.70:0/1084265282 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fc13c032670 con 0x55c2e9039b60 2024-09-21T05:51:00.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.084+0000 7fc151c2b740 10 client.15711 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T05:51:00.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.084+0000 7fc151c2b740 10 client.15711 resolve_mds: validated gid 24641 aka daemon mds.b 2024-09-21T05:51:00.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.084+0000 7fc151c2b740 20 client.15711 populate_metadata read hostname 'smithi070' 2024-09-21T05:51:00.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.084+0000 7fc151c2b740 1 --2- 172.21.15.70:0/1084265282 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55c2e905a840 0x55c2e948cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:00.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.084+0000 7fc151c2b740 4 client.15711 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.0, "await_for": 45.0}] 2024-09-21T05:51:00.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.084+0000 7fc151c2b740 1 -- 172.21.15.70:0/1084265282 --> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.0, "await_for": 45.0}) -- 0x55c2e9375590 con 0x55c2e905a840 2024-09-21T05:51:00.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.084+0000 7fc149453640 1 --2- 172.21.15.70:0/1084265282 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55c2e905a840 0x55c2e948cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:00.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.085+0000 7fc12cff9640 10 client.15711 ms_handle_connect on v2:172.21.15.116:6838/3952175670 2024-09-21T05:51:00.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:00.085+0000 7fc149453640 1 --2- 172.21.15.70:0/1084265282 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55c2e905a840 0x55c2e948cd40 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c112b0d7dfe8bb53 server_cookie=49cc9289041fc8e6 in_seq=0 out_seq=0 2024-09-21T05:51:01.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:01 smithi070 ceph-mon[30981]: pgmap v416: 129 pgs: 129 active+clean; 82 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.8 MiB/s wr, 46 op/s 2024-09-21T05:51:01.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:01 smithi116 ceph-mon[34332]: pgmap v416: 129 pgs: 129 active+clean; 82 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.8 MiB/s wr, 46 op/s 2024-09-21T05:51:01.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:01 smithi160 ceph-mon[33979]: pgmap v416: 129 pgs: 129 active+clean; 82 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.8 MiB/s wr, 46 op/s 2024-09-21T05:51:01.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:01.851+0000 7fc12cff9640 1 -- 172.21.15.70:0/1084265282 <== mds.0 v2:172.21.15.116:6838/3952175670 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55c2e9375590 con 0x55c2e905a840 2024-09-21T05:51:01.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:01.851+0000 7fc12cff9640 10 client.15711 handle_command_reply: tid=0 2024-09-21T05:51:01.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:01.851+0000 7fc151c2b740 1 client.15711 shutdown 2024-09-21T05:51:01.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:01.851+0000 7fc151c2b740 1 -- 172.21.15.70:0/1084265282 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2e9039b60 msgr2=0x55c2e9421b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:01.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:01.851+0000 7fc151c2b740 1 --2- 172.21.15.70:0/1084265282 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2e9039b60 0x55c2e9421b10 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc13c009d30 tx=0x7fc13c01dae0 comp rx=0 tx=0).stop 2024-09-21T05:51:01.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:01.851+0000 7fc151c2b740 1 -- 172.21.15.70:0/1084265282 shutdown_connections 2024-09-21T05:51:01.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:01.851+0000 7fc151c2b740 1 --2- 172.21.15.70:0/1084265282 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55c2e905a840 0x55c2e948cd40 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:01.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:01.851+0000 7fc151c2b740 1 --2- 172.21.15.70:0/1084265282 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2e9031980 0x55c2e9421590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:01.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:01.851+0000 7fc151c2b740 1 --2- 172.21.15.70:0/1084265282 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2e9039b60 0x55c2e9421b10 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:01.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:01.851+0000 7fc151c2b740 1 --2- 172.21.15.70:0/1084265282 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c2e90191c0 0x55c2e9421050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:01.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:01.851+0000 7fc12cff9640 0 client.15711 ms_handle_reset on v2:172.21.15.116:6838/3952175670 2024-09-21T05:51:01.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:01.851+0000 7fc151c2b740 1 -- 172.21.15.70:0/1084265282 >> 172.21.15.70:0/1084265282 conn(0x55c2e904e990 msgr2=0x55c2e93fda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:01.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:01.851+0000 7fc151c2b740 1 -- 172.21.15.70:0/1084265282 shutdown_connections 2024-09-21T05:51:01.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:01.851+0000 7fc151c2b740 1 -- 172.21.15.70:0/1084265282 wait complete. 2024-09-21T05:51:01.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:01.852+0000 7fc151c2b740 20 client.15711 trim_cache size 0 max 16384 2024-09-21T05:51:01.855 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:51:01.855 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 28, 2024-09-21T05:51:01.855 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 24641, 2024-09-21T05:51:01.855 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 6, 2024-09-21T05:51:01.855 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-09-21T05:51:01.855 INFO:teuthology.orchestra.run.smithi070.stdout: "95917f45": { 2024-09-21T05:51:01.855 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 6, 2024-09-21T05:51:01.855 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-09-21T05:51:01.855 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-09-21T05:51:01.855 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-09-21T05:51:01.855 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-09-21T05:51:01.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:51:01.856 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 90.0, 2024-09-21T05:51:01.856 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 137.0, 2024-09-21T05:51:01.856 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-09-21T05:51:01.856 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-09-21T05:51:01.856 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-09-21T05:51:01.856 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-09-21T05:51:01.856 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-09-21T05:51:01.856 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-09-21T05:51:01.856 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:51:01.856 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:51:01.856 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:51:01.856 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:51:01.856 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:51:01.856 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:51:01.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:01.852+0000 7fc14b6b7640 1 -- 172.21.15.70:0/1637429250 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc1300b6540 msgr2=0x7fc1300b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:01.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:01.852+0000 7fc14b6b7640 1 --2- 172.21.15.70:0/1637429250 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc1300b6540 0x7fc1300b8a50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc13c005fd0 tx=0x7fc13c009620 comp rx=0 tx=0).stop 2024-09-21T05:51:01.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:01.852+0000 7fc14b6b7640 1 -- 172.21.15.70:0/1637429250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc144102a80 msgr2=0x7fc144199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:01.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:01.852+0000 7fc14b6b7640 1 --2- 172.21.15.70:0/1637429250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc144102a80 0x7fc144199340 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc14000c920 tx=0x7fc14000cde0 comp rx=0 tx=0).stop 2024-09-21T05:51:01.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:01.852+0000 7fc14b6b7640 1 -- 172.21.15.70:0/1637429250 shutdown_connections 2024-09-21T05:51:01.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:01.852+0000 7fc14b6b7640 1 --2- 172.21.15.70:0/1637429250 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc1300b6540 0x7fc1300b8a50 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:01.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:01.852+0000 7fc14b6b7640 1 --2- 172.21.15.70:0/1637429250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc144108d10 0x7fc14419eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:01.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:01.852+0000 7fc14b6b7640 1 --2- 172.21.15.70:0/1637429250 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc1441083c0 0x7fc1441998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:01.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:01.852+0000 7fc14b6b7640 1 --2- 172.21.15.70:0/1637429250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc144102a80 0x7fc144199340 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:01.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:01.852+0000 7fc14b6b7640 1 -- 172.21.15.70:0/1637429250 >> 172.21.15.70:0/1637429250 conn(0x7fc144079760 msgr2=0x7fc1441043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:01.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:01.852+0000 7fc14b6b7640 1 -- 172.21.15.70:0/1637429250 shutdown_connections 2024-09-21T05:51:01.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:01.852+0000 7fc14b6b7640 1 -- 172.21.15.70:0/1637429250 wait complete. 2024-09-21T05:51:02.582 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '95917f45', quiesce took 5.0 seconds. Will release after: 12.0 2024-09-21T05:51:03.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:03 smithi070 ceph-mon[30981]: pgmap v417: 129 pgs: 129 active+clean; 83 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.9 MiB/s wr, 52 op/s 2024-09-21T05:51:03.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:03 smithi116 ceph-mon[34332]: pgmap v417: 129 pgs: 129 active+clean; 83 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.9 MiB/s wr, 52 op/s 2024-09-21T05:51:03.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:03 smithi160 ceph-mon[33979]: pgmap v417: 129 pgs: 129 active+clean; 83 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.9 MiB/s wr, 52 op/s 2024-09-21T05:51:05.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:05 smithi070 ceph-mon[30981]: pgmap v418: 129 pgs: 129 active+clean; 84 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.0 MiB/s wr, 72 op/s 2024-09-21T05:51:05.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:05 smithi116 ceph-mon[34332]: pgmap v418: 129 pgs: 129 active+clean; 84 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.0 MiB/s wr, 72 op/s 2024-09-21T05:51:05.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:05 smithi160 ceph-mon[33979]: pgmap v418: 129 pgs: 129 active+clean; 84 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.0 MiB/s wr, 72 op/s 2024-09-21T05:51:07.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:07 smithi070 ceph-mon[30981]: pgmap v419: 129 pgs: 129 active+clean; 84 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 2.3 MiB/s wr, 63 op/s 2024-09-21T05:51:07.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:07 smithi116 ceph-mon[34332]: pgmap v419: 129 pgs: 129 active+clean; 84 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 2.3 MiB/s wr, 63 op/s 2024-09-21T05:51:07.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:07 smithi160 ceph-mon[33979]: pgmap v419: 129 pgs: 129 active+clean; 84 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 2.3 MiB/s wr, 63 op/s 2024-09-21T05:51:09.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:09 smithi070 ceph-mon[30981]: pgmap v420: 129 pgs: 129 active+clean; 84 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 1.4 MiB/s wr, 66 op/s 2024-09-21T05:51:09.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:09 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:51:09.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:09 smithi116 ceph-mon[34332]: pgmap v420: 129 pgs: 129 active+clean; 84 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 1.4 MiB/s wr, 66 op/s 2024-09-21T05:51:09.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:09 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:51:09.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:09 smithi160 ceph-mon[33979]: pgmap v420: 129 pgs: 129 active+clean; 84 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 1.4 MiB/s wr, 66 op/s 2024-09-21T05:51:09.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:09 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:51:10.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:10 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:10.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:10 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:51:10.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:10 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:51:10.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:10 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:10.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:10 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:51:10.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:10 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:51:10.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:10 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:10.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:10 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:51:10.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:10 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:51:11.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:11 smithi070 ceph-mon[30981]: pgmap v421: 129 pgs: 129 active+clean; 84 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 390 KiB/s wr, 58 op/s 2024-09-21T05:51:11.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:11 smithi116 ceph-mon[34332]: pgmap v421: 129 pgs: 129 active+clean; 84 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 390 KiB/s wr, 58 op/s 2024-09-21T05:51:11.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:11 smithi160 ceph-mon[33979]: pgmap v421: 129 pgs: 129 active+clean; 84 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 390 KiB/s wr, 58 op/s 2024-09-21T05:51:13.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:13 smithi070 ceph-mon[30981]: pgmap v422: 129 pgs: 129 active+clean; 84 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 209 KiB/s wr, 40 op/s 2024-09-21T05:51:13.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:13 smithi116 ceph-mon[34332]: pgmap v422: 129 pgs: 129 active+clean; 84 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 209 KiB/s wr, 40 op/s 2024-09-21T05:51:13.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:13 smithi160 ceph-mon[33979]: pgmap v422: 129 pgs: 129 active+clean; 84 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 209 KiB/s wr, 40 op/s 2024-09-21T05:51:14.584 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:51:14.842 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:15.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.253+0000 7efc89f40640 1 -- 172.21.15.70:0/2132158021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc84102ae0 msgr2=0x7efc84102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:15.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.253+0000 7efc89f40640 1 --2- 172.21.15.70:0/2132158021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc84102ae0 0x7efc84102ef0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7efc74009900 tx=0x7efc7402a410 comp rx=0 tx=0).stop 2024-09-21T05:51:15.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.253+0000 7efc89f40640 1 -- 172.21.15.70:0/2132158021 shutdown_connections 2024-09-21T05:51:15.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.253+0000 7efc89f40640 1 --2- 172.21.15.70:0/2132158021 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc84108d20 0x7efc8410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:15.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.253+0000 7efc89f40640 1 --2- 172.21.15.70:0/2132158021 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc841083d0 0x7efc841087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:15.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.253+0000 7efc89f40640 1 --2- 172.21.15.70:0/2132158021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc84102ae0 0x7efc84102ef0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:15.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.253+0000 7efc89f40640 1 -- 172.21.15.70:0/2132158021 >> 172.21.15.70:0/2132158021 conn(0x7efc84079760 msgr2=0x7efc84079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:15.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.253+0000 7efc89f40640 1 -- 172.21.15.70:0/2132158021 shutdown_connections 2024-09-21T05:51:15.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.253+0000 7efc89f40640 1 -- 172.21.15.70:0/2132158021 wait complete. 2024-09-21T05:51:15.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.254+0000 7efc89f40640 1 Processor -- start 2024-09-21T05:51:15.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.254+0000 7efc89f40640 1 -- start start 2024-09-21T05:51:15.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.254+0000 7efc89f40640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc84102ae0 0x7efc8419b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:15.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.254+0000 7efc89f40640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc841083d0 0x7efc8419b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:15.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.254+0000 7efc89f40640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc84108d20 0x7efc8419bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:15.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.254+0000 7efc89f40640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efc84112980 con 0x7efc841083d0 2024-09-21T05:51:15.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.254+0000 7efc89f40640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7efc84112800 con 0x7efc84108d20 2024-09-21T05:51:15.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.254+0000 7efc89f40640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7efc84112b00 con 0x7efc84102ae0 2024-09-21T05:51:15.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.254+0000 7efc7bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc841083d0 0x7efc8419b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:15.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.254+0000 7efc7bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc841083d0 0x7efc8419b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39262/0 (socket says 172.21.15.70:39262) 2024-09-21T05:51:15.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.254+0000 7efc7bfff640 1 -- 172.21.15.70:0/347062262 learned_addr learned my addr 172.21.15.70:0/347062262 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:51:15.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.254+0000 7efc83fff640 1 --2- 172.21.15.70:0/347062262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc84108d20 0x7efc8419bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:15.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.255+0000 7efc837fe640 1 --2- 172.21.15.70:0/347062262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc84102ae0 0x7efc8419b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:15.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.255+0000 7efc7bfff640 1 -- 172.21.15.70:0/347062262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc84102ae0 msgr2=0x7efc8419b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:15.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.255+0000 7efc7bfff640 1 --2- 172.21.15.70:0/347062262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc84102ae0 0x7efc8419b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:15.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.255+0000 7efc7bfff640 1 -- 172.21.15.70:0/347062262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc84108d20 msgr2=0x7efc8419bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:15.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.255+0000 7efc7bfff640 1 --2- 172.21.15.70:0/347062262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc84108d20 0x7efc8419bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:15.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.255+0000 7efc7bfff640 1 -- 172.21.15.70:0/347062262 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc841a6570 con 0x7efc841083d0 2024-09-21T05:51:15.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.255+0000 7efc837fe640 1 --2- 172.21.15.70:0/347062262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc84102ae0 0x7efc8419b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:51:15.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.255+0000 7efc7bfff640 1 --2- 172.21.15.70:0/347062262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc841083d0 0x7efc8419b7f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7efc6c00d770 tx=0x7efc6c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:15.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.255+0000 7efc817fa640 1 -- 172.21.15.70:0/347062262 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6c017070 con 0x7efc841083d0 2024-09-21T05:51:15.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.255+0000 7efc89f40640 1 -- 172.21.15.70:0/347062262 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc841a6860 con 0x7efc841083d0 2024-09-21T05:51:15.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.255+0000 7efc817fa640 1 -- 172.21.15.70:0/347062262 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7efc6c009c30 con 0x7efc841083d0 2024-09-21T05:51:15.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.255+0000 7efc817fa640 1 -- 172.21.15.70:0/347062262 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6c00f620 con 0x7efc841083d0 2024-09-21T05:51:15.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.255+0000 7efc89f40640 1 -- 172.21.15.70:0/347062262 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc841a6da0 con 0x7efc841083d0 2024-09-21T05:51:15.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.256+0000 7efc89f40640 1 -- 172.21.15.70:0/347062262 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc84103d10 con 0x7efc841083d0 2024-09-21T05:51:15.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.258+0000 7efc817fa640 1 -- 172.21.15.70:0/347062262 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7efc6c01a070 con 0x7efc841083d0 2024-09-21T05:51:15.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.259+0000 7efc817fa640 1 --2- 172.21.15.70:0/347062262 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7efc700b6510 0x7efc700b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:15.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.259+0000 7efc837fe640 1 --2- 172.21.15.70:0/347062262 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7efc700b6510 0x7efc700b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:15.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.259+0000 7efc817fa640 1 -- 172.21.15.70:0/347062262 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7efc6c0e7160 con 0x7efc841083d0 2024-09-21T05:51:15.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.259+0000 7efc837fe640 1 --2- 172.21.15.70:0/347062262 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7efc700b6510 0x7efc700b8a20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7efc74000c00 tx=0x7efc74005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:15.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.262+0000 7efc817fa640 1 -- 172.21.15.70:0/347062262 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efc6c009de0 con 0x7efc841083d0 2024-09-21T05:51:15.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.476+0000 7efc89f40640 1 -- 172.21.15.70:0/347062262 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc8406bf70 con 0x7efc841083d0 2024-09-21T05:51:15.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.477+0000 7efc817fa640 1 -- 172.21.15.70:0/347062262 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11986 (secure 0 0 0) 0x7efc6c0ad600 con 0x7efc841083d0 2024-09-21T05:51:15.479 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:51:15.479 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"btime":"2024-09-21T05:49:35:887363+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3519318330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3519318330},{"type":"v1","addr":"172.21.15.70:6835","nonce":3519318330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2706663460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2706663460},{"type":"v1","addr":"172.21.15.70:6837","nonce":2706663460}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:47:06.246985+0000","modified":"2024-09-21T05:49:35.712686+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24628,"mds_2":24611,"mds_3":24610,"mds_4":24598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/1914209867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1914209867},{"type":"v1","addr":"172.21.15.70:6839","nonce":1914209867}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3392175775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3392175775},{"type":"v1","addr":"172.21.15.70:6841","nonce":3392175775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/3543945704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3543945704},{"type":"v1","addr":"172.21.15.160:6833","nonce":3543945704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6833/283778129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":283778129},{"type":"v1","addr":"172.21.15.116:6833","nonce":283778129}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/3787256790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3787256790},{"type":"v1","addr":"172.21.15.116:6835","nonce":3787256790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.160:6835/2001692372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2001692372},{"type":"v1","addr":"172.21.15.160:6835","nonce":2001692372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.160:6837/2558120045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2558120045},{"type":"v1","addr":"172.21.15.160:6837","nonce":2558120045}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24611":{"gid":24611,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/444312934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":444312934},{"type":"v1","addr":"172.21.15.116:6837","nonce":444312934}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.160:6839/1339744282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1339744282},{"type":"v1","addr":"172.21.15.160:6839","nonce":1339744282}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/3952175670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3952175670},{"type":"v1","addr":"172.21.15.116:6839","nonce":3952175670}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24641,"qdb_cluster":[24598,24611,24610,24628,24641]},"id":1}]} 2024-09-21T05:51:15.480 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-09-21T05:51:15.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.479+0000 7efc89f40640 1 -- 172.21.15.70:0/347062262 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7efc700b6510 msgr2=0x7efc700b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:15.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.479+0000 7efc89f40640 1 --2- 172.21.15.70:0/347062262 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7efc700b6510 0x7efc700b8a20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7efc74000c00 tx=0x7efc74005d50 comp rx=0 tx=0).stop 2024-09-21T05:51:15.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.479+0000 7efc89f40640 1 -- 172.21.15.70:0/347062262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc841083d0 msgr2=0x7efc8419b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:15.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.479+0000 7efc89f40640 1 --2- 172.21.15.70:0/347062262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc841083d0 0x7efc8419b7f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7efc6c00d770 tx=0x7efc6c00dc30 comp rx=0 tx=0).stop 2024-09-21T05:51:15.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.479+0000 7efc89f40640 1 -- 172.21.15.70:0/347062262 shutdown_connections 2024-09-21T05:51:15.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.479+0000 7efc89f40640 1 --2- 172.21.15.70:0/347062262 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7efc700b6510 0x7efc700b8a20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:15.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.479+0000 7efc89f40640 1 --2- 172.21.15.70:0/347062262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc84108d20 0x7efc8419bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:15.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.479+0000 7efc89f40640 1 --2- 172.21.15.70:0/347062262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc841083d0 0x7efc8419b7f0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:15.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.479+0000 7efc89f40640 1 --2- 172.21.15.70:0/347062262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc84102ae0 0x7efc8419b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:15.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.479+0000 7efc89f40640 1 -- 172.21.15.70:0/347062262 >> 172.21.15.70:0/347062262 conn(0x7efc84079760 msgr2=0x7efc84101450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:15.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.479+0000 7efc89f40640 1 -- 172.21.15.70:0/347062262 shutdown_connections 2024-09-21T05:51:15.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:15.479+0000 7efc89f40640 1 -- 172.21.15.70:0/347062262 wait complete. 2024-09-21T05:51:15.494 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:15 smithi070 ceph-mon[30981]: pgmap v423: 129 pgs: 129 active+clean; 84 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 129 KiB/s wr, 36 op/s 2024-09-21T05:51:15.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:15 smithi116 ceph-mon[34332]: pgmap v423: 129 pgs: 129 active+clean; 84 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 129 KiB/s wr, 36 op/s 2024-09-21T05:51:15.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:15 smithi160 ceph-mon[33979]: pgmap v423: 129 pgs: 129 active+clean; 84 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 129 KiB/s wr, 36 op/s 2024-09-21T05:51:16.465 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24641 quiesce db --set-id 95917f45 --release --await' 2024-09-21T05:51:16.466 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24641 quiesce db --set-id 95917f45 --release --await 2024-09-21T05:51:16.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:16 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/347062262' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:16.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:16 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/347062262' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:16.712 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:16.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:16 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/347062262' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:17.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.191+0000 7f88e6dc0640 1 -- 172.21.15.70:0/3640132807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88e0108d20 msgr2=0x7f88e010f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:17.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.191+0000 7f88e6dc0640 1 --2- 172.21.15.70:0/3640132807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88e0108d20 0x7f88e010f550 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f88d8009ca0 tx=0x7f88d802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.191+0000 7f88e6dc0640 1 -- 172.21.15.70:0/3640132807 shutdown_connections 2024-09-21T05:51:17.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.191+0000 7f88e6dc0640 1 --2- 172.21.15.70:0/3640132807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88e0108d20 0x7f88e010f550 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.191+0000 7f88e6dc0640 1 --2- 172.21.15.70:0/3640132807 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88e01083d0 0x7f88e01087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.191+0000 7f88e6dc0640 1 --2- 172.21.15.70:0/3640132807 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88e0102a90 0x7f88e0102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.191+0000 7f88e6dc0640 1 -- 172.21.15.70:0/3640132807 >> 172.21.15.70:0/3640132807 conn(0x7f88e0079730 msgr2=0x7f88e0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:17.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.191+0000 7f88e6dc0640 1 -- 172.21.15.70:0/3640132807 shutdown_connections 2024-09-21T05:51:17.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.191+0000 7f88e6dc0640 1 -- 172.21.15.70:0/3640132807 wait complete. 2024-09-21T05:51:17.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.192+0000 7f88e6dc0640 1 Processor -- start 2024-09-21T05:51:17.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.192+0000 7f88e6dc0640 1 -- start start 2024-09-21T05:51:17.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.192+0000 7f88e6dc0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88e0102a90 0x7f88e019b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:17.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.192+0000 7f88e6dc0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88e01083d0 0x7f88e019b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:17.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.192+0000 7f88e6dc0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88e0108d20 0x7f88e019bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:17.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.192+0000 7f88e6dc0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f88e01129d0 con 0x7f88e0108d20 2024-09-21T05:51:17.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.192+0000 7f88e6dc0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f88e0112850 con 0x7f88e01083d0 2024-09-21T05:51:17.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.192+0000 7f88e6dc0640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f88e0112b50 con 0x7f88e0102a90 2024-09-21T05:51:17.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.192+0000 7f88e535d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88e0108d20 0x7f88e019bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:17.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.192+0000 7f88e535d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88e0108d20 0x7f88e019bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39280/0 (socket says 172.21.15.70:39280) 2024-09-21T05:51:17.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.192+0000 7f88e535d640 1 -- 172.21.15.70:0/1953979233 learned_addr learned my addr 172.21.15.70:0/1953979233 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:51:17.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.192+0000 7f88dffff640 1 --2- 172.21.15.70:0/1953979233 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88e01083d0 0x7f88e019b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:17.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.192+0000 7f88e4b5c640 1 --2- 172.21.15.70:0/1953979233 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88e0102a90 0x7f88e019b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:17.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.193+0000 7f88e535d640 1 -- 172.21.15.70:0/1953979233 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88e0102a90 msgr2=0x7f88e019b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:17.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.193+0000 7f88e535d640 1 --2- 172.21.15.70:0/1953979233 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88e0102a90 0x7f88e019b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.193+0000 7f88e535d640 1 -- 172.21.15.70:0/1953979233 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88e01083d0 msgr2=0x7f88e019b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:17.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.193+0000 7f88e535d640 1 --2- 172.21.15.70:0/1953979233 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88e01083d0 0x7f88e019b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.193+0000 7f88e535d640 1 -- 172.21.15.70:0/1953979233 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e01a6510 con 0x7f88e0108d20 2024-09-21T05:51:17.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.193+0000 7f88e535d640 1 --2- 172.21.15.70:0/1953979233 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88e0108d20 0x7f88e019bc80 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f88d80097b0 tx=0x7f88d8032fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:17.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.193+0000 7f88ddffb640 1 -- 172.21.15.70:0/1953979233 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d8003cf0 con 0x7f88e0108d20 2024-09-21T05:51:17.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.193+0000 7f88e6dc0640 1 -- 172.21.15.70:0/1953979233 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88e01a67a0 con 0x7f88e0108d20 2024-09-21T05:51:17.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.193+0000 7f88ddffb640 1 -- 172.21.15.70:0/1953979233 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f88d80044f0 con 0x7f88e0108d20 2024-09-21T05:51:17.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.193+0000 7f88ddffb640 1 -- 172.21.15.70:0/1953979233 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d8030c30 con 0x7f88e0108d20 2024-09-21T05:51:17.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.193+0000 7f88e6dc0640 1 -- 172.21.15.70:0/1953979233 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88e01a6ce0 con 0x7f88e0108d20 2024-09-21T05:51:17.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.196+0000 7f88ed334740 1 Processor -- start 2024-09-21T05:51:17.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.196+0000 7f88ddffb640 1 -- 172.21.15.70:0/1953979233 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f88d80046a0 con 0x7f88e0108d20 2024-09-21T05:51:17.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.196+0000 7f88ed334740 1 -- start start 2024-09-21T05:51:17.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.197+0000 7f88ed334740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55988d520520 0x55988d8c6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:17.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.197+0000 7f88ed334740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55988d4f7660 0x55988d8c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:17.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.197+0000 7f88ed334740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55988d4ff840 0x55988d8c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:17.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.197+0000 7f88ed334740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55988d7b1dc0 con 0x55988d520520 2024-09-21T05:51:17.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.197+0000 7f88ed334740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55988d83e1f0 con 0x55988d4f7660 2024-09-21T05:51:17.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.197+0000 7f88ed334740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55988d82d620 con 0x55988d4ff840 2024-09-21T05:51:17.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.197+0000 7f88dffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55988d520520 0x55988d8c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:17.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.197+0000 7f88dffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55988d520520 0x55988d8c6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39284/0 (socket says 172.21.15.70:39284) 2024-09-21T05:51:17.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.197+0000 7f88dffff640 1 -- 172.21.15.70:0/1211488910 learned_addr learned my addr 172.21.15.70:0/1211488910 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:51:17.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.197+0000 7f88e4b5c640 1 --2- 172.21.15.70:0/1211488910 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55988d4f7660 0x55988d8c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:17.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.197+0000 7f88dffff640 1 --2- 172.21.15.70:0/1211488910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55988d4ff840 0x55988d8c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:17.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.197+0000 7f88ddffb640 1 --2- 172.21.15.70:0/1953979233 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f88d00b6510 0x7f88d00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:17.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.197+0000 7f88dffff640 1 -- 172.21.15.70:0/1211488910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55988d4ff840 msgr2=0x55988d8c6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:51:17.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.197+0000 7f88dffff640 1 --2- 172.21.15.70:0/1211488910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55988d4ff840 0x55988d8c6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.197+0000 7f88dffff640 1 -- 172.21.15.70:0/1211488910 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55988d4f7660 msgr2=0x55988d8c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:51:17.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.197+0000 7f88dffff640 1 --2- 172.21.15.70:0/1211488910 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55988d4f7660 0x55988d8c6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.197+0000 7f88dffff640 1 -- 172.21.15.70:0/1211488910 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55988d7f5fd0 con 0x55988d520520 2024-09-21T05:51:17.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.197+0000 7f88e535d640 1 --2- 172.21.15.70:0/1953979233 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f88d00b6510 0x7f88d00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:17.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.197+0000 7f88dffff640 1 --2- 172.21.15.70:0/1211488910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55988d520520 0x55988d8c6510 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0124c0 tx=0x7f88cc00b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2be5fdb36181e8d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:17.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.198+0000 7f88ddffb640 1 -- 172.21.15.70:0/1953979233 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f88d81089f0 con 0x7f88e0108d20 2024-09-21T05:51:17.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.198+0000 7f88caffd640 1 -- 172.21.15.70:0/1211488910 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc004030 con 0x55988d520520 2024-09-21T05:51:17.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.198+0000 7f88caffd640 1 -- 172.21.15.70:0/1211488910 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f88cc0054d0 con 0x55988d520520 2024-09-21T05:51:17.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.198+0000 7f88caffd640 1 -- 172.21.15.70:0/1211488910 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc004bc0 con 0x55988d520520 2024-09-21T05:51:17.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.199+0000 7f88ed334740 1 -- 172.21.15.70:0/1211488910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55988d520520 msgr2=0x55988d8c6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:17.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.199+0000 7f88e535d640 1 --2- 172.21.15.70:0/1953979233 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f88d00b6510 0x7f88d00b8a20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f88d80ce490 tx=0x7f88d8037e60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:17.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.199+0000 7f88ed334740 1 --2- 172.21.15.70:0/1211488910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55988d520520 0x55988d8c6510 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0124c0 tx=0x7f88cc00b820 comp rx=0 tx=0).stop 2024-09-21T05:51:17.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.199+0000 7f88ed334740 1 -- 172.21.15.70:0/1211488910 shutdown_connections 2024-09-21T05:51:17.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.199+0000 7f88ed334740 1 --2- 172.21.15.70:0/1211488910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55988d4ff840 0x55988d8c6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.199+0000 7f88ed334740 1 --2- 172.21.15.70:0/1211488910 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55988d4f7660 0x55988d8c6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.199+0000 7f88ed334740 1 --2- 172.21.15.70:0/1211488910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55988d520520 0x55988d8c6510 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.199+0000 7f88ed334740 1 -- 172.21.15.70:0/1211488910 >> 172.21.15.70:0/1211488910 conn(0x55988d514910 msgr2=0x55988d8c4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:17.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.199+0000 7f88ed334740 1 -- 172.21.15.70:0/1211488910 shutdown_connections 2024-09-21T05:51:17.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.199+0000 7f88ed334740 1 -- 172.21.15.70:0/1211488910 wait complete. 2024-09-21T05:51:17.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.199+0000 7f88ed334740 1 -- start start 2024-09-21T05:51:17.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.199+0000 7f88ed334740 1 Processor -- start 2024-09-21T05:51:17.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.200+0000 7f88ed334740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55988d4f7660 0x55988d8d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:17.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.200+0000 7f88ed334740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55988d4ff840 0x55988d8d2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:17.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.200+0000 7f88ed334740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55988d520520 0x55988d8dde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:17.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.200+0000 7f88ed334740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55988d7c8300 con 0x55988d520520 2024-09-21T05:51:17.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.200+0000 7f88ed334740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55988d831430 con 0x55988d4ff840 2024-09-21T05:51:17.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.200+0000 7f88ed334740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55988d68ebb0 con 0x55988d4f7660 2024-09-21T05:51:17.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.200+0000 7f88ed334740 10 client.0 _ll_register_callbacks cb 0x55988d7e2120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:51:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.200+0000 7f88dffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55988d520520 0x55988d8dde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.200+0000 7f88dffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55988d520520 0x55988d8dde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39290/0 (socket says 172.21.15.70:39290) 2024-09-21T05:51:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.200+0000 7f88dffff640 1 -- 172.21.15.70:0/3575665432 learned_addr learned my addr 172.21.15.70:0/3575665432 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:51:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.200+0000 7f88dffff640 1 --2- 172.21.15.70:0/3575665432 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55988d4f7660 0x55988d8d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.200+0000 7f88e4b5c640 1 --2- 172.21.15.70:0/3575665432 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55988d4ff840 0x55988d8d2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.200+0000 7f88dffff640 1 -- 172.21.15.70:0/3575665432 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55988d4f7660 msgr2=0x55988d8d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:51:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.200+0000 7f88dffff640 1 --2- 172.21.15.70:0/3575665432 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55988d4f7660 0x55988d8d1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.200+0000 7f88dffff640 1 -- 172.21.15.70:0/3575665432 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55988d4ff840 msgr2=0x55988d8d2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:51:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.200+0000 7f88dffff640 1 --2- 172.21.15.70:0/3575665432 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55988d4ff840 0x55988d8d2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.200+0000 7f88dffff640 1 -- 172.21.15.70:0/3575665432 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55988d7b7780 con 0x55988d520520 2024-09-21T05:51:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.200+0000 7f88dffff640 1 --2- 172.21.15.70:0/3575665432 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55988d520520 0x55988d8dde60 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0047e0 tx=0x7f88cc004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e52e9373164bbd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.200+0000 7f88bffff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:51:17.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.201+0000 7f88bffff640 1 -- 172.21.15.70:0/3575665432 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc027040 con 0x55988d520520 2024-09-21T05:51:17.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.201+0000 7f88bffff640 1 -- 172.21.15.70:0/3575665432 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f88cc004940 con 0x55988d520520 2024-09-21T05:51:17.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.201+0000 7f88ed334740 1 -- 172.21.15.70:0/3575665432 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88cc0054d0 con 0x55988d520520 2024-09-21T05:51:17.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.201+0000 7f88bffff640 1 -- 172.21.15.70:0/3575665432 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f88cc004b40 con 0x55988d520520 2024-09-21T05:51:17.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.201+0000 7f88ed334740 10 client.15729 fetch_fsmap learned FSMap version 28 2024-09-21T05:51:17.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.201+0000 7f88ed334740 1 -- 172.21.15.70:0/3575665432 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55988d58bb00 con 0x55988d520520 2024-09-21T05:51:17.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.201+0000 7f88bffff640 1 -- 172.21.15.70:0/3575665432 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f88cc0054d0 con 0x55988d520520 2024-09-21T05:51:17.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.201+0000 7f88bffff640 1 -- 172.21.15.70:0/3575665432 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f88cc01c020 con 0x55988d520520 2024-09-21T05:51:17.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.201+0000 7f88ed334740 10 client.15729 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T05:51:17.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.201+0000 7f88ed334740 10 client.15729 resolve_mds: validated gid 24641 aka daemon mds.b 2024-09-21T05:51:17.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.201+0000 7f88ed334740 20 client.15729 populate_metadata read hostname 'smithi070' 2024-09-21T05:51:17.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.201+0000 7f88ed334740 1 --2- 172.21.15.70:0/3575665432 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55988d4deea0 0x55988d8e3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:17.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.201+0000 7f88ed334740 4 client.15729 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:51:17.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.201+0000 7f88ed334740 1 -- 172.21.15.70:0/3575665432 --> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55988d840140 con 0x55988d4deea0 2024-09-21T05:51:17.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.202+0000 7f88e4b5c640 1 --2- 172.21.15.70:0/3575665432 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55988d4deea0 0x55988d8e3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:17.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.202+0000 7f88bffff640 10 client.15729 ms_handle_connect on v2:172.21.15.116:6838/3952175670 2024-09-21T05:51:17.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.202+0000 7f88e4b5c640 1 --2- 172.21.15.70:0/3575665432 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55988d4deea0 0x55988d8e3e00 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6059c8e1cc1d73 server_cookie=19fdefdc7525878d in_seq=0 out_seq=0 2024-09-21T05:51:17.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.203+0000 7f88bffff640 1 -- 172.21.15.70:0/3575665432 <== mds.0 v2:172.21.15.116:6838/3952175670 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55988d840140 con 0x55988d4deea0 2024-09-21T05:51:17.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.203+0000 7f88bffff640 10 client.15729 handle_command_reply: tid=0 2024-09-21T05:51:17.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.203+0000 7f88ed334740 1 client.15729 shutdown 2024-09-21T05:51:17.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.203+0000 7f88ed334740 1 -- 172.21.15.70:0/3575665432 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55988d520520 msgr2=0x55988d8dde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:17.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.203+0000 7f88ed334740 1 --2- 172.21.15.70:0/3575665432 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55988d520520 0x55988d8dde60 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0047e0 tx=0x7f88cc004840 comp rx=0 tx=0).stop 2024-09-21T05:51:17.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.203+0000 7f88ed334740 1 -- 172.21.15.70:0/3575665432 shutdown_connections 2024-09-21T05:51:17.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.203+0000 7f88ed334740 1 --2- 172.21.15.70:0/3575665432 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55988d4deea0 0x55988d8e3e00 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.203+0000 7f88ed334740 1 --2- 172.21.15.70:0/3575665432 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55988d520520 0x55988d8dde60 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.203+0000 7f88bffff640 0 client.15729 ms_handle_reset on v2:172.21.15.116:6838/3952175670 2024-09-21T05:51:17.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.203+0000 7f88ed334740 1 --2- 172.21.15.70:0/3575665432 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55988d4ff840 0x55988d8d2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.203+0000 7f88ed334740 1 --2- 172.21.15.70:0/3575665432 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55988d4f7660 0x55988d8d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.203+0000 7f88ed334740 1 -- 172.21.15.70:0/3575665432 >> 172.21.15.70:0/3575665432 conn(0x55988d514910 msgr2=0x55988d8c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:17.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.203+0000 7f88ed334740 1 -- 172.21.15.70:0/3575665432 shutdown_connections 2024-09-21T05:51:17.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.203+0000 7f88ed334740 1 -- 172.21.15.70:0/3575665432 wait complete. 2024-09-21T05:51:17.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.203+0000 7f88ed334740 20 client.15729 trim_cache size 0 max 16384 2024-09-21T05:51:17.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.220+0000 7f88ed334740 1 Processor -- start 2024-09-21T05:51:17.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.220+0000 7f88ed334740 1 -- start start 2024-09-21T05:51:17.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.220+0000 7f88ed334740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55988d514910 0x55988d8cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:17.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.220+0000 7f88ed334740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55988d4deea0 0x55988d8d0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:17.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.220+0000 7f88ed334740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55988d4f7660 0x55988d8e6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:17.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.220+0000 7f88ed334740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f88e01b0c70 con 0x55988d4deea0 2024-09-21T05:51:17.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.220+0000 7f88ed334740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f88e01b27b0 con 0x55988d4f7660 2024-09-21T05:51:17.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.220+0000 7f88ed334740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f88e01b1340 con 0x55988d514910 2024-09-21T05:51:17.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.221+0000 7f88e4b5c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55988d4deea0 0x55988d8d0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:17.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.221+0000 7f88e4b5c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55988d4deea0 0x55988d8d0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39304/0 (socket says 172.21.15.70:39304) 2024-09-21T05:51:17.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.221+0000 7f88e4b5c640 1 -- 172.21.15.70:0/1162189616 learned_addr learned my addr 172.21.15.70:0/1162189616 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:51:17.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.221+0000 7f88e4b5c640 1 -- 172.21.15.70:0/1162189616 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55988d514910 msgr2=0x55988d8cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:51:17.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.221+0000 7f88e4b5c640 1 --2- 172.21.15.70:0/1162189616 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55988d514910 0x55988d8cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.221+0000 7f88e4b5c640 1 -- 172.21.15.70:0/1162189616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55988d4f7660 msgr2=0x55988d8e6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:51:17.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.221+0000 7f88dffff640 1 --2- 172.21.15.70:0/1162189616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55988d4f7660 0x55988d8e6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:17.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.221+0000 7f88e4b5c640 1 --2- 172.21.15.70:0/1162189616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55988d4f7660 0x55988d8e6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.221+0000 7f88e4b5c640 1 -- 172.21.15.70:0/1162189616 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55988d602960 con 0x55988d4deea0 2024-09-21T05:51:17.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.221+0000 7f88dffff640 1 --2- 172.21.15.70:0/1162189616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55988d4f7660 0x55988d8e6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:51:17.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.221+0000 7f88e4b5c640 1 --2- 172.21.15.70:0/1162189616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55988d4deea0 0x55988d8d0bd0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f88d400af70 tx=0x7f88d400a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f2a79b6be9242b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:17.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.221+0000 7f88ca7fc640 1 -- 172.21.15.70:0/1162189616 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d4028070 con 0x55988d4deea0 2024-09-21T05:51:17.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.221+0000 7f88ca7fc640 1 -- 172.21.15.70:0/1162189616 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f88d4004220 con 0x55988d4deea0 2024-09-21T05:51:17.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.221+0000 7f88ca7fc640 1 -- 172.21.15.70:0/1162189616 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d40247d0 con 0x55988d4deea0 2024-09-21T05:51:17.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.222+0000 7f88ed334740 1 -- 172.21.15.70:0/1162189616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55988d4deea0 msgr2=0x55988d8d0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:17.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.222+0000 7f88ed334740 1 --2- 172.21.15.70:0/1162189616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55988d4deea0 0x55988d8d0bd0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f88d400af70 tx=0x7f88d400a250 comp rx=0 tx=0).stop 2024-09-21T05:51:17.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.222+0000 7f88ed334740 1 -- 172.21.15.70:0/1162189616 shutdown_connections 2024-09-21T05:51:17.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.222+0000 7f88ed334740 1 --2- 172.21.15.70:0/1162189616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55988d4f7660 0x55988d8e6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.222+0000 7f88ed334740 1 --2- 172.21.15.70:0/1162189616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55988d4deea0 0x55988d8d0bd0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.222+0000 7f88ed334740 1 --2- 172.21.15.70:0/1162189616 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55988d514910 0x55988d8cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.222+0000 7f88ed334740 1 -- 172.21.15.70:0/1162189616 >> 172.21.15.70:0/1162189616 conn(0x55988d8d2300 msgr2=0x55988d8d04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:17.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.222+0000 7f88ed334740 1 -- 172.21.15.70:0/1162189616 shutdown_connections 2024-09-21T05:51:17.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.222+0000 7f88ed334740 1 -- 172.21.15.70:0/1162189616 wait complete. 2024-09-21T05:51:17.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.222+0000 7f88ed334740 1 -- start start 2024-09-21T05:51:17.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.223+0000 7f88ed334740 1 Processor -- start 2024-09-21T05:51:17.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.223+0000 7f88ed334740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55988d4deea0 0x55988d946500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:17.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.223+0000 7f88ed334740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55988d4f7660 0x55988d946ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:17.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.223+0000 7f88ed334740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55988d514910 0x55988d94bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:17.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.223+0000 7f88ed334740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f88e01b20e0 con 0x55988d4deea0 2024-09-21T05:51:17.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.223+0000 7f88ed334740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f88e01b1a10 con 0x55988d4f7660 2024-09-21T05:51:17.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.223+0000 7f88ed334740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f88e01aec50 con 0x55988d514910 2024-09-21T05:51:17.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.223+0000 7f88ed334740 10 client.0 _ll_register_callbacks cb 0x7f88d400a5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:51:17.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.223+0000 7f88dffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55988d4deea0 0x55988d946500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:17.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.223+0000 7f88dffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55988d4deea0 0x55988d946500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39306/0 (socket says 172.21.15.70:39306) 2024-09-21T05:51:17.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.223+0000 7f88dffff640 1 -- 172.21.15.70:0/1965639279 learned_addr learned my addr 172.21.15.70:0/1965639279 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:51:17.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.223+0000 7f88dffff640 1 -- 172.21.15.70:0/1965639279 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55988d514910 msgr2=0x55988d94bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:51:17.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.223+0000 7f88dffff640 1 --2- 172.21.15.70:0/1965639279 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55988d514910 0x55988d94bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.223+0000 7f88e4b5c640 1 --2- 172.21.15.70:0/1965639279 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55988d4f7660 0x55988d946ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:17.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.223+0000 7f88dffff640 1 -- 172.21.15.70:0/1965639279 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55988d4f7660 msgr2=0x55988d946ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:51:17.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.223+0000 7f88dffff640 1 --2- 172.21.15.70:0/1965639279 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55988d4f7660 0x55988d946ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.223+0000 7f88dffff640 1 -- 172.21.15.70:0/1965639279 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55988d94c170 con 0x55988d4deea0 2024-09-21T05:51:17.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.224+0000 7f88dffff640 1 --2- 172.21.15.70:0/1965639279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55988d4deea0 0x55988d946500 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f88cc000c00 tx=0x7f88cc00b400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5b7f84a4b76e61 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:17.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.224+0000 7f88bffff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:51:17.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.224+0000 7f88bffff640 1 -- 172.21.15.70:0/1965639279 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc004840 con 0x55988d4deea0 2024-09-21T05:51:17.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.224+0000 7f88bffff640 1 -- 172.21.15.70:0/1965639279 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f88cc0120d0 con 0x55988d4deea0 2024-09-21T05:51:17.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.224+0000 7f88ed334740 1 -- 172.21.15.70:0/1965639279 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88d4004220 con 0x55988d4deea0 2024-09-21T05:51:17.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.224+0000 7f88bffff640 1 -- 172.21.15.70:0/1965639279 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f88cc040050 con 0x55988d4deea0 2024-09-21T05:51:17.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.224+0000 7f88ed334740 10 client.15735 fetch_fsmap learned FSMap version 28 2024-09-21T05:51:17.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.224+0000 7f88ed334740 1 -- 172.21.15.70:0/1965639279 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55988d953510 con 0x55988d4deea0 2024-09-21T05:51:17.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.224+0000 7f88bffff640 1 -- 172.21.15.70:0/1965639279 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f88d4004220 con 0x55988d4deea0 2024-09-21T05:51:17.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.224+0000 7f88bffff640 1 -- 172.21.15.70:0/1965639279 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f88cc01c070 con 0x55988d4deea0 2024-09-21T05:51:17.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.224+0000 7f88ed334740 10 client.15735 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T05:51:17.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.224+0000 7f88ed334740 10 client.15735 resolve_mds: validated gid 24641 aka daemon mds.b 2024-09-21T05:51:17.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.224+0000 7f88ed334740 20 client.15735 populate_metadata read hostname 'smithi070' 2024-09-21T05:51:17.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.224+0000 7f88ed334740 1 --2- 172.21.15.70:0/1965639279 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55988d4ff840 0x55988d955bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:17.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.225+0000 7f88ed334740 4 client.15735 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "95917f45", "release": true, "await": true}] 2024-09-21T05:51:17.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.225+0000 7f88ed334740 1 -- 172.21.15.70:0/1965639279 --> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] -- command(tid 0: {"prefix": "quiesce db", "set_id": "95917f45", "release": true, "await": true}) -- 0x55988d83bbf0 con 0x55988d4ff840 2024-09-21T05:51:17.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.225+0000 7f88e4b5c640 1 --2- 172.21.15.70:0/1965639279 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55988d4ff840 0x55988d955bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:17.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.225+0000 7f88e4b5c640 1 --2- 172.21.15.70:0/1965639279 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55988d4ff840 0x55988d955bf0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e27d8f5238a61e29 server_cookie=50078e5e800adb81 in_seq=0 out_seq=0 2024-09-21T05:51:17.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.225+0000 7f88bffff640 10 client.15735 ms_handle_connect on v2:172.21.15.116:6838/3952175670 2024-09-21T05:51:17.250 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml 2024-09-21T05:51:17.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.260+0000 7f88bffff640 1 -- 172.21.15.70:0/1965639279 <== mds.0 v2:172.21.15.116:6838/3952175670 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55988d83bbf0 con 0x55988d4ff840 2024-09-21T05:51:17.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.260+0000 7f88bffff640 10 client.15735 handle_command_reply: tid=0 2024-09-21T05:51:17.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.260+0000 7f88ed334740 1 client.15735 shutdown 2024-09-21T05:51:17.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.260+0000 7f88ed334740 1 -- 172.21.15.70:0/1965639279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55988d4deea0 msgr2=0x55988d946500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:17.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.260+0000 7f88ed334740 1 --2- 172.21.15.70:0/1965639279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55988d4deea0 0x55988d946500 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f88cc000c00 tx=0x7f88cc00b400 comp rx=0 tx=0).stop 2024-09-21T05:51:17.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.260+0000 7f88ed334740 1 -- 172.21.15.70:0/1965639279 shutdown_connections 2024-09-21T05:51:17.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.260+0000 7f88ed334740 1 --2- 172.21.15.70:0/1965639279 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55988d4ff840 0x55988d955bf0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.260+0000 7f88ed334740 1 --2- 172.21.15.70:0/1965639279 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55988d514910 0x55988d94bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.260+0000 7f88ed334740 1 --2- 172.21.15.70:0/1965639279 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55988d4f7660 0x55988d946ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.260+0000 7f88ed334740 1 --2- 172.21.15.70:0/1965639279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55988d4deea0 0x55988d946500 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.260+0000 7f88bffff640 0 client.15735 ms_handle_reset on v2:172.21.15.116:6838/3952175670 2024-09-21T05:51:17.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.260+0000 7f88ed334740 1 -- 172.21.15.70:0/1965639279 >> 172.21.15.70:0/1965639279 conn(0x55988d8d2300 msgr2=0x55988d8d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:17.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.260+0000 7f88ed334740 1 -- 172.21.15.70:0/1965639279 shutdown_connections 2024-09-21T05:51:17.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.260+0000 7f88ed334740 1 -- 172.21.15.70:0/1965639279 wait complete. 2024-09-21T05:51:17.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.260+0000 7f88ed334740 20 client.15735 trim_cache size 0 max 16384 2024-09-21T05:51:17.264 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:51:17.264 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 28, 2024-09-21T05:51:17.264 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 24641, 2024-09-21T05:51:17.264 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 8, 2024-09-21T05:51:17.264 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-09-21T05:51:17.264 INFO:teuthology.orchestra.run.smithi070.stdout: "95917f45": { 2024-09-21T05:51:17.264 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 8, 2024-09-21T05:51:17.264 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-09-21T05:51:17.264 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-09-21T05:51:17.264 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-09-21T05:51:17.264 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-09-21T05:51:17.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:51:17.264 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 90.0, 2024-09-21T05:51:17.264 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 137.0, 2024-09-21T05:51:17.264 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-09-21T05:51:17.265 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-09-21T05:51:17.265 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-09-21T05:51:17.265 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-09-21T05:51:17.265 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-09-21T05:51:17.265 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-09-21T05:51:17.265 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:51:17.265 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:51:17.265 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:51:17.265 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:51:17.265 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:51:17.265 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:51:17.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.261+0000 7f88e6dc0640 1 -- 172.21.15.70:0/1953979233 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f88d00b6510 msgr2=0x7f88d00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:17.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.261+0000 7f88e6dc0640 1 --2- 172.21.15.70:0/1953979233 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f88d00b6510 0x7f88d00b8a20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f88d80ce490 tx=0x7f88d8037e60 comp rx=0 tx=0).stop 2024-09-21T05:51:17.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.261+0000 7f88e6dc0640 1 -- 172.21.15.70:0/1953979233 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88e0108d20 msgr2=0x7f88e019bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:17.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.261+0000 7f88e6dc0640 1 --2- 172.21.15.70:0/1953979233 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88e0108d20 0x7f88e019bc80 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f88d80097b0 tx=0x7f88d8032fe0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.261+0000 7f88e6dc0640 1 -- 172.21.15.70:0/1953979233 shutdown_connections 2024-09-21T05:51:17.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.261+0000 7f88e6dc0640 1 --2- 172.21.15.70:0/1953979233 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f88d00b6510 0x7f88d00b8a20 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.261+0000 7f88e6dc0640 1 --2- 172.21.15.70:0/1953979233 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88e0108d20 0x7f88e019bc80 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.261+0000 7f88e6dc0640 1 --2- 172.21.15.70:0/1953979233 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88e01083d0 0x7f88e019b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.261+0000 7f88e6dc0640 1 --2- 172.21.15.70:0/1953979233 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88e0102a90 0x7f88e019b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.261+0000 7f88e6dc0640 1 -- 172.21.15.70:0/1953979233 >> 172.21.15.70:0/1953979233 conn(0x7f88e0079730 msgr2=0x7f88e01063c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:17.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.261+0000 7f88e6dc0640 1 -- 172.21.15.70:0/1953979233 shutdown_connections 2024-09-21T05:51:17.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:17.261+0000 7f88e6dc0640 1 -- 172.21.15.70:0/1953979233 wait complete. 2024-09-21T05:51:17.284 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml 2024-09-21T05:51:17.288 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml 2024-09-21T05:51:17.292 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml 2024-09-21T05:51:17.296 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml 2024-09-21T05:51:17.300 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml 2024-09-21T05:51:17.303 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml 2024-09-21T05:51:17.307 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml 2024-09-21T05:51:17.310 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml 2024-09-21T05:51:17.314 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml 2024-09-21T05:51:17.317 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml 2024-09-21T05:51:17.320 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml 2024-09-21T05:51:17.324 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml 2024-09-21T05:51:17.327 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml 2024-09-21T05:51:17.331 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64 2024-09-21T05:51:17.335 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64 2024-09-21T05:51:17.348 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64 2024-09-21T05:51:17.355 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media_api.tmpl 2024-09-21T05:51:17.362 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/mtdnand.tmpl 2024-09-21T05:51:17.366 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/networking.tmpl 2024-09-21T05:51:17.369 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/rapidio.tmpl 2024-09-21T05:51:17.372 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/regulator.tmpl 2024-09-21T05:51:17.376 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl 2024-09-21T05:51:17.380 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/scsi.tmpl 2024-09-21T05:51:17.383 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/sh.tmpl 2024-09-21T05:51:17.386 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/stylesheet.xsl 2024-09-21T05:51:17.389 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/tracepoint.tmpl 2024-09-21T05:51:17.392 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/uio-howto.tmpl 2024-09-21T05:51:17.396 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/usb.tmpl 2024-09-21T05:51:17.399 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/w1.tmpl 2024-09-21T05:51:17.403 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl 2024-09-21T05:51:17.410 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl 2024-09-21T05:51:17.414 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl 2024-09-21T05:51:17.417 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/z8530book.tmpl 2024-09-21T05:51:17.420 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/ 2024-09-21T05:51:17.423 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/1024x768.S 2024-09-21T05:51:17.425 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/1280x1024.S 2024-09-21T05:51:17.427 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/1600x1200.S 2024-09-21T05:51:17.430 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/1680x1050.S 2024-09-21T05:51:17.431 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/1920x1080.S 2024-09-21T05:51:17.434 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/800x600.S 2024-09-21T05:51:17.436 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/HOWTO.txt 2024-09-21T05:51:17.438 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/Makefile 2024-09-21T05:51:17.441 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/edid.S 2024-09-21T05:51:17.443 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/hex 2024-09-21T05:51:17.445 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/HOWTO 2024-09-21T05:51:17.449 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/IPMI.txt 2024-09-21T05:51:17.453 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/IRQ-affinity.txt 2024-09-21T05:51:17.456 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/IRQ-domain.txt 2024-09-21T05:51:17.459 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/IRQ.txt 2024-09-21T05:51:17.462 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/Intel-IOMMU.txt 2024-09-21T05:51:17.466 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/Makefile 2024-09-21T05:51:17.469 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ManagementStyle 2024-09-21T05:51:17.472 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/PCI/ 2024-09-21T05:51:17.475 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/PCI/00-INDEX 2024-09-21T05:51:17.477 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt 2024-09-21T05:51:17.480 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt 2024-09-21T05:51:17.483 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/PCI/pci-error-recovery.txt 2024-09-21T05:51:17.486 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/PCI/pci-iov-howto.txt 2024-09-21T05:51:17.489 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/PCI/pci.txt 2024-09-21T05:51:17.491 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/PCI/pcieaer-howto.txt 2024-09-21T05:51:17.494 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/ 2024-09-21T05:51:17.494 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:17 smithi070 ceph-mon[30981]: pgmap v424: 129 pgs: 129 active+clean; 84 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 16 KiB/s wr, 16 op/s 2024-09-21T05:51:17.497 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/00-INDEX 2024-09-21T05:51:17.500 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/NMI-RCU.txt 2024-09-21T05:51:17.502 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/RTFP.txt 2024-09-21T05:51:17.506 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/UP.txt 2024-09-21T05:51:17.509 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/arrayRCU.txt 2024-09-21T05:51:17.511 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/checklist.txt 2024-09-21T05:51:17.514 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/listRCU.txt 2024-09-21T05:51:17.516 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/lockdep-splat.txt 2024-09-21T05:51:17.518 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/lockdep.txt 2024-09-21T05:51:17.521 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/rcu.txt 2024-09-21T05:51:17.523 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/rcu_dereference.txt 2024-09-21T05:51:17.526 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/rcubarrier.txt 2024-09-21T05:51:17.528 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/rculist_nulls.txt 2024-09-21T05:51:17.531 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/rcuref.txt 2024-09-21T05:51:17.533 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/stallwarn.txt 2024-09-21T05:51:17.535 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/torture.txt 2024-09-21T05:51:17.538 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/trace.txt 2024-09-21T05:51:17.541 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/whatisRCU.txt 2024-09-21T05:51:17.544 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/SAK.txt 2024-09-21T05:51:17.547 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/SM501.txt 2024-09-21T05:51:17.550 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/SecurityBugs 2024-09-21T05:51:17.553 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/SubmitChecklist 2024-09-21T05:51:17.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:17 smithi116 ceph-mon[34332]: pgmap v424: 129 pgs: 129 active+clean; 84 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 16 KiB/s wr, 16 op/s 2024-09-21T05:51:17.556 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/SubmittingDrivers 2024-09-21T05:51:17.559 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/SubmittingPatches 2024-09-21T05:51:17.563 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/VGA-softcursor.txt 2024-09-21T05:51:17.566 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/accounting/ 2024-09-21T05:51:17.568 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/accounting/.gitignore 2024-09-21T05:51:17.570 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/accounting/Makefile 2024-09-21T05:51:17.572 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/accounting/cgroupstats.txt 2024-09-21T05:51:17.574 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/accounting/delay-accounting.txt 2024-09-21T05:51:17.577 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/accounting/getdelays.c 2024-09-21T05:51:17.579 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/accounting/taskstats-struct.txt 2024-09-21T05:51:17.582 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/accounting/taskstats.txt 2024-09-21T05:51:17.585 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/ 2024-09-21T05:51:17.587 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/apei/ 2024-09-21T05:51:17.589 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/apei/einj.txt 2024-09-21T05:51:17.591 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/apei/output_format.txt 2024-09-21T05:51:17.593 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/debug.txt 2024-09-21T05:51:17.596 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/dsdt-override.txt 2024-09-21T05:51:17.598 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/enumeration.txt 2024-09-21T05:51:17.601 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/gpio-properties.txt 2024-09-21T05:51:17.603 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/initrd_table_override.txt 2024-09-21T05:51:17.606 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/method-customizing.txt 2024-09-21T05:51:17.608 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/method-tracing.txt 2024-09-21T05:51:17.611 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/namespace.txt 2024-09-21T05:51:17.613 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/scan_handlers.txt 2024-09-21T05:51:17.616 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/video_extension.txt 2024-09-21T05:51:17.618 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/aoe/ 2024-09-21T05:51:17.621 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/aoe/aoe.txt 2024-09-21T05:51:17.624 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/aoe/autoload.sh 2024-09-21T05:51:17.626 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/aoe/status.sh 2024-09-21T05:51:17.628 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/aoe/todo.txt 2024-09-21T05:51:17.630 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/aoe/udev-install.sh 2024-09-21T05:51:17.633 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/aoe/udev.txt 2024-09-21T05:51:17.635 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/applying-patches.txt 2024-09-21T05:51:17.638 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/ 2024-09-21T05:51:17.641 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/00-INDEX 2024-09-21T05:51:17.643 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Atmel/ 2024-09-21T05:51:17.645 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Atmel/README 2024-09-21T05:51:17.647 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Booting 2024-09-21T05:51:17.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:17 smithi160 ceph-mon[33979]: pgmap v424: 129 pgs: 129 active+clean; 84 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 16 KiB/s wr, 16 op/s 2024-09-21T05:51:17.649 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/CCN.txt 2024-09-21T05:51:17.652 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/IXP4xx 2024-09-21T05:51:17.654 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Interrupts 2024-09-21T05:51:17.657 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Makefile 2024-09-21T05:51:17.659 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Marvell/ 2024-09-21T05:51:17.661 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Marvell/README 2024-09-21T05:51:17.663 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Netwinder 2024-09-21T05:51:17.666 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/OMAP/ 2024-09-21T05:51:17.668 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/OMAP/DSS 2024-09-21T05:51:17.671 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/OMAP/omap_pm 2024-09-21T05:51:17.673 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Porting 2024-09-21T05:51:17.676 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/README 2024-09-21T05:51:17.678 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/ 2024-09-21T05:51:17.680 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/ADSBitsy 2024-09-21T05:51:17.683 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/Assabet 2024-09-21T05:51:17.685 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/Brutus 2024-09-21T05:51:17.688 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/CERF 2024-09-21T05:51:17.690 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/FreeBird 2024-09-21T05:51:17.692 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsClient 2024-09-21T05:51:17.694 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster 2024-09-21T05:51:17.696 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL 2024-09-21T05:51:17.699 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/Itsy 2024-09-21T05:51:17.701 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/LART 2024-09-21T05:51:17.703 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/PLEB 2024-09-21T05:51:17.705 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/Pangolin 2024-09-21T05:51:17.708 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/Tifon 2024-09-21T05:51:17.710 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/Victor 2024-09-21T05:51:17.713 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/Yopy 2024-09-21T05:51:17.715 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/empeg 2024-09-21T05:51:17.717 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/nanoEngine 2024-09-21T05:51:17.720 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/serial_UART 2024-09-21T05:51:17.722 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/ 2024-09-21T05:51:17.724 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore 2024-09-21T05:51:17.726 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/Makefile 2024-09-21T05:51:17.728 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c 2024-09-21T05:51:17.731 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt 2024-09-21T05:51:17.733 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt 2024-09-21T05:51:17.735 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SPEAr/ 2024-09-21T05:51:17.737 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SPEAr/overview.txt 2024-09-21T05:51:17.740 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/ 2024-09-21T05:51:17.742 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt 2024-09-21T05:51:17.745 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt 2024-09-21T05:51:17.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt 2024-09-21T05:51:17.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt 2024-09-21T05:51:17.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt 2024-09-21T05:51:17.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt 2024-09-21T05:51:17.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt 2024-09-21T05:51:17.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt 2024-09-21T05:51:17.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt 2024-09-21T05:51:17.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt 2024-09-21T05:51:17.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt 2024-09-21T05:51:17.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung/ 2024-09-21T05:51:17.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung/GPIO.txt 2024-09-21T05:51:17.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung/Overview.txt 2024-09-21T05:51:17.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk 2024-09-21T05:51:17.803 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Setup 2024-09-21T05:51:17.803 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/VFP/ 2024-09-21T05:51:17.803 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/VFP/release-notes.txt 2024-09-21T05:51:17.803 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt 2024-09-21T05:51:17.803 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/firmware.txt 2024-09-21T05:51:17.803 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/kernel_mode_neon.txt 2024-09-21T05:51:17.803 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/kernel_user_helpers.txt 2024-09-21T05:51:17.803 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/mem_alignment 2024-09-21T05:51:17.803 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/memory.txt 2024-09-21T05:51:17.803 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/msm/ 2024-09-21T05:51:17.803 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/msm/gpiomux.txt 2024-09-21T05:51:17.804 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/nwfpe/ 2024-09-21T05:51:17.806 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/nwfpe/NOTES 2024-09-21T05:51:17.807 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/nwfpe/README 2024-09-21T05:51:17.810 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/nwfpe/README.FPE 2024-09-21T05:51:17.812 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/nwfpe/TODO 2024-09-21T05:51:17.814 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/pxa/ 2024-09-21T05:51:17.816 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/pxa/mfp.txt 2024-09-21T05:51:17.819 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sti/ 2024-09-21T05:51:17.821 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sti/overview.txt 2024-09-21T05:51:17.824 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sti/stih407-overview.txt 2024-09-21T05:51:17.827 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sti/stih415-overview.txt 2024-09-21T05:51:17.829 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sti/stih416-overview.txt 2024-09-21T05:51:17.831 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sti/stih418-overview.txt 2024-09-21T05:51:17.834 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sunxi/ 2024-09-21T05:51:17.836 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sunxi/README 2024-09-21T05:51:17.838 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sunxi/clocks.txt 2024-09-21T05:51:17.841 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/swp_emulation 2024-09-21T05:51:17.843 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/tcm.txt 2024-09-21T05:51:17.846 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/uefi.txt 2024-09-21T05:51:17.848 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/vlocks.txt 2024-09-21T05:51:17.850 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm64/ 2024-09-21T05:51:17.853 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm64/booting.txt 2024-09-21T05:51:17.855 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm64/legacy_instructions.txt 2024-09-21T05:51:17.857 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm64/memory.txt 2024-09-21T05:51:17.859 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm64/tagged-pointers.txt 2024-09-21T05:51:17.862 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/assoc_array.txt 2024-09-21T05:51:17.866 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/atomic_ops.txt 2024-09-21T05:51:17.869 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/auxdisplay/ 2024-09-21T05:51:17.871 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/auxdisplay/.gitignore 2024-09-21T05:51:17.874 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/auxdisplay/Makefile 2024-09-21T05:51:17.876 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b 2024-09-21T05:51:17.878 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b-example.c 2024-09-21T05:51:17.880 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/auxdisplay/ks0108 2024-09-21T05:51:17.883 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/backlight/ 2024-09-21T05:51:17.885 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/backlight/lp855x-driver.txt 2024-09-21T05:51:17.887 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/bad_memory.txt 2024-09-21T05:51:17.890 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/basic_profiling.txt 2024-09-21T05:51:17.894 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/bcache.txt 2024-09-21T05:51:17.897 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/binfmt_misc.txt 2024-09-21T05:51:17.900 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blackfin/ 2024-09-21T05:51:17.902 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blackfin/00-INDEX 2024-09-21T05:51:17.905 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blackfin/Makefile 2024-09-21T05:51:17.907 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blackfin/bfin-gpio-notes.txt 2024-09-21T05:51:17.909 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blackfin/bfin-spi-notes.txt 2024-09-21T05:51:17.911 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blackfin/gptimers-example.c 2024-09-21T05:51:17.913 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/ 2024-09-21T05:51:17.916 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/00-INDEX 2024-09-21T05:51:17.918 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/biodoc.txt 2024-09-21T05:51:17.921 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/biovecs.txt 2024-09-21T05:51:17.924 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/capability.txt 2024-09-21T05:51:17.926 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/cfq-iosched.txt 2024-09-21T05:51:17.928 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/cmdline-partition.txt 2024-09-21T05:51:17.930 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/data-integrity.txt 2024-09-21T05:51:17.933 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/deadline-iosched.txt 2024-09-21T05:51:17.935 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/ioprio.txt 2024-09-21T05:51:17.937 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/null_blk.txt 2024-09-21T05:51:17.940 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/queue-sysfs.txt 2024-09-21T05:51:17.942 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/request.txt 2024-09-21T05:51:17.944 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/stat.txt 2024-09-21T05:51:17.946 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/switching-sched.txt 2024-09-21T05:51:17.949 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/writeback_cache_control.txt 2024-09-21T05:51:17.951 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/ 2024-09-21T05:51:17.953 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/00-INDEX 2024-09-21T05:51:17.955 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/README.DAC960 2024-09-21T05:51:17.958 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/cciss.txt 2024-09-21T05:51:17.960 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/cpqarray.txt 2024-09-21T05:51:17.963 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/ 2024-09-21T05:51:17.965 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-8.3-data-packets.svg 2024-09-21T05:51:17.967 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-data-packets.svg 2024-09-21T05:51:17.970 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/README.txt 2024-09-21T05:51:17.973 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/conn-states-8.dot 2024-09-21T05:51:17.975 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/data-structure-v9.txt 2024-09-21T05:51:17.977 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/disk-states-8.dot 2024-09-21T05:51:17.979 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/drbd-connection-state-overview.dot 2024-09-21T05:51:17.983 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/node-states-8.dot 2024-09-21T05:51:17.986 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/floppy.txt 2024-09-21T05:51:17.989 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/mflash.txt 2024-09-21T05:51:17.991 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/nbd.txt 2024-09-21T05:51:17.993 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/paride.txt 2024-09-21T05:51:17.997 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/ramdisk.txt 2024-09-21T05:51:17.999 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/zram.txt 2024-09-21T05:51:18.001 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/braille-console.txt 2024-09-21T05:51:18.005 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/bt8xxgpio.txt 2024-09-21T05:51:18.008 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/btmrvl.txt 2024-09-21T05:51:18.011 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/bus-devices/ 2024-09-21T05:51:18.013 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/bus-devices/ti-gpmc.txt 2024-09-21T05:51:18.014 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '95917f45', total seconds elapsed: 20.5 2024-09-21T05:51:18.016 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/bus-virt-phys-mapping.txt 2024-09-21T05:51:18.019 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cachetlb.txt 2024-09-21T05:51:18.022 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cdrom/ 2024-09-21T05:51:18.025 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cdrom/00-INDEX 2024-09-21T05:51:18.026 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cdrom/Makefile 2024-09-21T05:51:18.028 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cdrom/cdrom-standard.tex 2024-09-21T05:51:18.032 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cdrom/ide-cd 2024-09-21T05:51:18.034 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cdrom/packet-writing.txt 2024-09-21T05:51:18.036 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/ 2024-09-21T05:51:18.039 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/00-INDEX 2024-09-21T05:51:18.041 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/blkio-controller.txt 2024-09-21T05:51:18.044 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/cgroups.txt 2024-09-21T05:51:18.047 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/cpuacct.txt 2024-09-21T05:51:18.049 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/cpusets.txt 2024-09-21T05:51:18.053 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/devices.txt 2024-09-21T05:51:18.055 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/freezer-subsystem.txt 2024-09-21T05:51:18.057 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/hugetlb.txt 2024-09-21T05:51:18.059 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/memcg_test.txt 2024-09-21T05:51:18.061 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/memory.txt 2024-09-21T05:51:18.064 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/net_cls.txt 2024-09-21T05:51:18.067 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/net_prio.txt 2024-09-21T05:51:18.069 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/unified-hierarchy.txt 2024-09-21T05:51:18.072 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/circular-buffers.txt 2024-09-21T05:51:18.075 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/clk.txt 2024-09-21T05:51:18.078 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/coccinelle.txt 2024-09-21T05:51:18.081 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/connector/ 2024-09-21T05:51:18.084 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/connector/.gitignore 2024-09-21T05:51:18.086 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/connector/Makefile 2024-09-21T05:51:18.089 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/connector/cn_test.c 2024-09-21T05:51:18.091 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/connector/connector.txt 2024-09-21T05:51:18.094 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/connector/ucon.c 2024-09-21T05:51:18.096 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/console/ 2024-09-21T05:51:18.099 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/console/console.txt 2024-09-21T05:51:18.100 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/ 2024-09-21T05:51:18.103 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/amd-powernow.txt 2024-09-21T05:51:18.105 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/boost.txt 2024-09-21T05:51:18.107 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/core.txt 2024-09-21T05:51:18.110 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/cpu-drivers.txt 2024-09-21T05:51:18.112 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-nforce2.txt 2024-09-21T05:51:18.114 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-stats.txt 2024-09-21T05:51:18.117 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/governors.txt 2024-09-21T05:51:18.119 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/index.txt 2024-09-21T05:51:18.121 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/intel-pstate.txt 2024-09-21T05:51:18.124 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/pcc-cpufreq.txt 2024-09-21T05:51:18.126 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/user-guide.txt 2024-09-21T05:51:18.129 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-hotplug.txt 2024-09-21T05:51:18.132 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-load.txt 2024-09-21T05:51:18.136 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpuidle/ 2024-09-21T05:51:18.138 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpuidle/core.txt 2024-09-21T05:51:18.140 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpuidle/driver.txt 2024-09-21T05:51:18.142 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpuidle/governor.txt 2024-09-21T05:51:18.144 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpuidle/sysfs.txt 2024-09-21T05:51:18.146 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cputopology.txt 2024-09-21T05:51:18.149 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/crc32.txt 2024-09-21T05:51:18.153 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cris/ 2024-09-21T05:51:18.155 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cris/README 2024-09-21T05:51:18.157 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/crypto/ 2024-09-21T05:51:18.159 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/crypto/api-intro.txt 2024-09-21T05:51:18.161 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/crypto/asymmetric-keys.txt 2024-09-21T05:51:18.164 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/crypto/async-tx-api.txt 2024-09-21T05:51:18.166 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/crypto/crypto-API-userspace.txt 2024-09-21T05:51:18.169 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/crypto/descore-readme.txt 2024-09-21T05:51:18.171 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dcdbas.txt 2024-09-21T05:51:18.175 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/debugging-modules.txt 2024-09-21T05:51:18.178 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/debugging-via-ohci1394.txt 2024-09-21T05:51:18.181 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dell_rbu.txt 2024-09-21T05:51:18.184 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/ 2024-09-21T05:51:18.186 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/1.Intro 2024-09-21T05:51:18.188 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/2.Process 2024-09-21T05:51:18.191 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/3.Early-stage 2024-09-21T05:51:18.194 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/4.Coding 2024-09-21T05:51:18.196 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/5.Posting 2024-09-21T05:51:18.198 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/6.Followthrough 2024-09-21T05:51:18.201 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/7.AdvancedTopics 2024-09-21T05:51:18.203 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/8.Conclusion 2024-09-21T05:51:18.205 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/ 2024-09-21T05:51:18.207 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/cache-policies.txt 2024-09-21T05:51:18.210 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/cache.txt 2024-09-21T05:51:18.212 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/delay.txt 2024-09-21T05:51:18.214 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/dm-crypt.txt 2024-09-21T05:51:18.216 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/dm-flakey.txt 2024-09-21T05:51:18.219 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/dm-io.txt 2024-09-21T05:51:18.221 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/dm-log.txt 2024-09-21T05:51:18.223 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/dm-queue-length.txt 2024-09-21T05:51:18.226 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/dm-raid.txt 2024-09-21T05:51:18.228 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/dm-service-time.txt 2024-09-21T05:51:18.231 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/dm-uevent.txt 2024-09-21T05:51:18.233 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/era.txt 2024-09-21T05:51:18.235 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/kcopyd.txt 2024-09-21T05:51:18.237 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/linear.txt 2024-09-21T05:51:18.239 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/persistent-data.txt 2024-09-21T05:51:18.242 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/snapshot.txt 2024-09-21T05:51:18.244 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/statistics.txt 2024-09-21T05:51:18.247 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/striped.txt 2024-09-21T05:51:18.249 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/switch.txt 2024-09-21T05:51:18.251 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/thin-provisioning.txt 2024-09-21T05:51:18.254 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/verity.txt 2024-09-21T05:51:18.256 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/zero.txt 2024-09-21T05:51:18.258 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devices.txt 2024-09-21T05:51:18.265 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/ 2024-09-21T05:51:18.267 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/00-INDEX 2024-09-21T05:51:18.269 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ 2024-09-21T05:51:18.271 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ABI.txt 2024-09-21T05:51:18.274 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/ 2024-09-21T05:51:18.276 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/interrupts.txt 2024-09-21T05:51:18.279 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/pmu.txt 2024-09-21T05:51:18.281 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ 2024-09-21T05:51:18.283 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/adapteva.txt 2024-09-21T05:51:18.286 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/ 2024-09-21T05:51:18.288 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-clk-manager.txt 2024-09-21T05:51:18.290 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-sdram-edac.txt 2024-09-21T05:51:18.292 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-system.txt 2024-09-21T05:51:18.295 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/amlogic.txt 2024-09-21T05:51:18.298 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arch_timer.txt 2024-09-21T05:51:18.300 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arm-boards 2024-09-21T05:51:18.303 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp-pmsu.txt 2024-09-21T05:51:18.305 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp.txt 2024-09-21T05:51:18.307 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-375.txt 2024-09-21T05:51:18.310 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-380-mpcore-soc-ctrl.txt 2024-09-21T05:51:18.313 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-38x.txt 2024-09-21T05:51:18.315 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-cpu-reset.txt 2024-09-21T05:51:18.318 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armadeus.txt 2024-09-21T05:51:18.320 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-at91.txt 2024-09-21T05:51:18.322 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-pmc.txt 2024-09-21T05:51:18.324 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/axxia.txt 2024-09-21T05:51:18.327 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/ 2024-09-21T05:51:18.329 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm11351.txt 2024-09-21T05:51:18.331 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm21664.txt 2024-09-21T05:51:18.334 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm63138.txt 2024-09-21T05:51:18.336 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/brcm,bcm11351-cpu-method 2024-09-21T05:51:18.338 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/cygnus.txt 2024-09-21T05:51:18.341 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-resetmgr.txt 2024-09-21T05:51:18.343 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-timer.txt 2024-09-21T05:51:18.346 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-wdt.txt 2024-09-21T05:51:18.348 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm2835.txt 2024-09-21T05:51:18.351 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm4708.txt 2024-09-21T05:51:18.354 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/brcm-brcmstb.txt 2024-09-21T05:51:18.357 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda.txt 2024-09-21T05:51:18.359 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/ 2024-09-21T05:51:18.361 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/combophy.txt 2024-09-21T05:51:18.363 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/l2ecc.txt 2024-09-21T05:51:18.365 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/mem-ctrlr.txt 2024-09-21T05:51:18.368 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cavium-thunder.txt 2024-09-21T05:51:18.371 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cci.txt 2024-09-21T05:51:18.373 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ccn.txt 2024-09-21T05:51:18.376 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coherency-fabric.txt 2024-09-21T05:51:18.378 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coresight.txt 2024-09-21T05:51:18.380 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/ 2024-09-21T05:51:18.382 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/marvell,berlin-smp 2024-09-21T05:51:18.385 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpus.txt 2024-09-21T05:51:18.388 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci.txt 2024-09-21T05:51:18.390 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/ 2024-09-21T05:51:18.392 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/cp-intc.txt 2024-09-21T05:51:18.394 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/digicolor.txt 2024-09-21T05:51:18.398 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/ 2024-09-21T05:51:18.400 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/power_domain.txt 2024-09-21T05:51:18.402 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/smp-sysram.txt 2024-09-21T05:51:18.405 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/ 2024-09-21T05:51:18.408 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/tlm,trusted-foundations.txt 2024-09-21T05:51:18.410 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fsl.txt 2024-09-21T05:51:18.413 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fw-cfg.txt 2024-09-21T05:51:18.416 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/geniatech.txt 2024-09-21T05:51:18.418 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic-v3.txt 2024-09-21T05:51:18.420 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic.txt 2024-09-21T05:51:18.423 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/global_timer.txt 2024-09-21T05:51:18.425 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/ 2024-09-21T05:51:18.427 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/hisilicon.txt 2024-09-21T05:51:18.429 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/idle-states.txt 2024-09-21T05:51:18.432 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/insignal-boards.txt 2024-09-21T05:51:18.435 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/ 2024-09-21T05:51:18.436 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/keystone.txt 2024-09-21T05:51:18.439 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/kirkwood.txt 2024-09-21T05:51:18.442 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/l2cc.txt 2024-09-21T05:51:18.444 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx-mic.txt 2024-09-21T05:51:18.446 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx.txt 2024-09-21T05:51:18.449 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,berlin.txt 2024-09-21T05:51:18.451 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,dove.txt 2024-09-21T05:51:18.453 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,kirkwood.txt 2024-09-21T05:51:18.456 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek.txt 2024-09-21T05:51:18.458 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/ 2024-09-21T05:51:18.460 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/mediatek,sysirq.txt 2024-09-21T05:51:18.462 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/moxart.txt 2024-09-21T05:51:18.465 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/ 2024-09-21T05:51:18.467 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/feroceon.txt 2024-09-21T05:51:18.469 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/intc.txt 2024-09-21T05:51:18.472 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/mrvl.txt 2024-09-21T05:51:18.474 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/tauros2.txt 2024-09-21T05:51:18.477 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/timer.txt 2024-09-21T05:51:18.479 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ 2024-09-21T05:51:18.482 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,kpss-acc.txt 2024-09-21T05:51:18.484 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,saw2.txt 2024-09-21T05:51:18.487 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ssbi.txt 2024-09-21T05:51:18.489 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/timer.txt 2024-09-21T05:51:18.492 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mvebu-system-controller.txt 2024-09-21T05:51:18.495 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/nspire.txt 2024-09-21T05:51:18.497 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/olimex.txt 2024-09-21T05:51:18.500 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/ 2024-09-21T05:51:18.501 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/counter.txt 2024-09-21T05:51:18.504 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/crossbar.txt 2024-09-21T05:51:18.506 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dmm.txt 2024-09-21T05:51:18.508 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dsp.txt 2024-09-21T05:51:18.511 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/intc.txt 2024-09-21T05:51:18.513 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/iva.txt 2024-09-21T05:51:18.516 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/l3-noc.txt 2024-09-21T05:51:18.518 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/mpu.txt 2024-09-21T05:51:18.521 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/omap.txt 2024-09-21T05:51:18.524 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/prcm.txt 2024-09-21T05:51:18.526 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/timer.txt 2024-09-21T05:51:18.529 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/picoxcell.txt 2024-09-21T05:51:18.532 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/pmu.txt 2024-09-21T05:51:18.534 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/primecell.txt 2024-09-21T05:51:18.537 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/psci.txt 2024-09-21T05:51:18.539 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip.txt 2024-09-21T05:51:18.542 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/ 2024-09-21T05:51:18.543 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu-sram.txt 2024-09-21T05:51:18.546 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu.txt 2024-09-21T05:51:18.548 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/smp-sram.txt 2024-09-21T05:51:18.550 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rtsm-dcscb.txt 2024-09-21T05:51:18.554 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung-boards.txt 2024-09-21T05:51:18.556 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/ 2024-09-21T05:51:18.558 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-adc.txt 2024-09-21T05:51:18.560 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-chipid.txt 2024-09-21T05:51:18.563 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/interrupt-combiner.txt 2024-09-21T05:51:18.565 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/pmu.txt 2024-09-21T05:51:18.567 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/sysreg.txt 2024-09-21T05:51:18.570 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/shmobile.txt 2024-09-21T05:51:18.573 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sirf.txt 2024-09-21T05:51:18.575 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-misc.txt 2024-09-21T05:51:18.577 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-timer.txt 2024-09-21T05:51:18.580 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear.txt 2024-09-21T05:51:18.582 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/ 2024-09-21T05:51:18.584 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/shirq.txt 2024-09-21T05:51:18.586 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sprd.txt 2024-09-21T05:51:18.589 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-nomadik.txt 2024-09-21T05:51:18.592 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-u300.txt 2024-09-21T05:51:18.594 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sti.txt 2024-09-21T05:51:18.597 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sunxi.txt 2024-09-21T05:51:18.599 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra.txt 2024-09-21T05:51:18.601 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/ 2024-09-21T05:51:18.604 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt 2024-09-21T05:51:18.606 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt 2024-09-21T05:51:18.609 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt 2024-09-21T05:51:18.611 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt 2024-09-21T05:51:18.614 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt 2024-09-21T05:51:18.616 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt 2024-09-21T05:51:18.619 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/topology.txt 2024-09-21T05:51:18.623 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/twd.txt 2024-09-21T05:51:18.625 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/ 2024-09-21T05:51:18.627 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt 2024-09-21T05:51:18.630 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-fpga-irq.txt 2024-09-21T05:51:18.635 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-sysreg.txt 2024-09-21T05:51:18.637 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-scc.txt 2024-09-21T05:51:18.639 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-sysreg.txt 2024-09-21T05:51:18.642 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress.txt 2024-09-21T05:51:18.644 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vic.txt 2024-09-21T05:51:18.647 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500.txt 2024-09-21T05:51:18.649 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/ 2024-09-21T05:51:18.651 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-intc.txt 2024-09-21T05:51:18.877 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-pmc.txt 2024-09-21T05:51:18.879 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-timer.txt 2024-09-21T05:51:18.881 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xen.txt 2024-09-21T05:51:18.884 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xilinx.txt 2024-09-21T05:51:18.887 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ 2024-09-21T05:51:18.889 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-platform.txt 2024-09-21T05:51:18.891 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-st.txt 2024-09-21T05:51:18.894 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/apm-xgene.txt 2024-09-21T05:51:18.896 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/atmel-at91_cf.txt 2024-09-21T05:51:18.899 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/cavium-compact-flash.txt 2024-09-21T05:51:18.901 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/exynos-sata.txt 2024-09-21T05:51:18.903 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/fsl-sata.txt 2024-09-21T05:51:18.906 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-pata.txt 2024-09-21T05:51:18.908 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-sata.txt 2024-09-21T05:51:18.910 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/marvell.txt 2024-09-21T05:51:18.913 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/pata-arasan.txt 2024-09-21T05:51:18.915 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/qcom-sata.txt 2024-09-21T05:51:18.918 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_highbank.txt 2024-09-21T05:51:18.920 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_rcar.txt 2024-09-21T05:51:18.923 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/tegra-sata.txt 2024-09-21T05:51:18.925 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/btmrvl.txt 2024-09-21T05:51:18.928 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ 2024-09-21T05:51:18.930 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/bcma.txt 2024-09-21T05:51:18.932 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/brcm,gisb-arb.txt 2024-09-21T05:51:18.934 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/imx-weim.txt 2024-09-21T05:51:18.937 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/mvebu-mbus.txt 2024-09-21T05:51:18.940 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/omap-ocp2scp.txt 2024-09-21T05:51:18.942 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ti-gpmc.txt 2024-09-21T05:51:18.945 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/ 2024-09-21T05:51:18.947 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/clocks.txt 2024-09-21T05:51:18.949 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/dscr.txt 2024-09-21T05:51:18.952 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/emifa.txt 2024-09-21T05:51:18.954 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/interrupt.txt 2024-09-21T05:51:18.957 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/soc.txt 2024-09-21T05:51:18.959 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/timer64.txt 2024-09-21T05:51:18.962 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/chosen.txt 2024-09-21T05:51:18.964 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ 2024-09-21T05:51:18.966 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/alphascale,acc.txt 2024-09-21T05:51:18.969 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/altr_socfpga.txt 2024-09-21T05:51:18.971 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/arm-integrator.txt 2024-09-21T05:51:18.973 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/at91-clock.txt 2024-09-21T05:51:18.976 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/axi-clkgen.txt 2024-09-21T05:51:18.978 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-cygnus-clock.txt 2024-09-21T05:51:18.981 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-kona-clock.txt 2024-09-21T05:51:18.983 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/calxeda.txt 2024-09-21T05:51:18.985 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-exynos-audss.txt 2024-09-21T05:51:18.988 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-palmas-clk32kg-clocks.txt 2024-09-21T05:51:18.990 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-s5pv210-audss.txt 2024-09-21T05:51:18.992 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clock-bindings.txt 2024-09-21T05:51:18.995 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clps711x-clock.txt 2024-09-21T05:51:18.998 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/efm32-clock.txt 2024-09-21T05:51:19.000 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/emev2-clock.txt 2024-09-21T05:51:19.002 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos3250-clock.txt 2024-09-21T05:51:19.005 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4-clock.txt 2024-09-21T05:51:19.008 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4415-clock.txt 2024-09-21T05:51:19.010 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5250-clock.txt 2024-09-21T05:51:19.012 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5260-clock.txt 2024-09-21T05:51:19.014 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5410-clock.txt 2024-09-21T05:51:19.017 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5420-clock.txt 2024-09-21T05:51:19.019 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5440-clock.txt 2024-09-21T05:51:19.022 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos7-clock.txt 2024-09-21T05:51:19.024 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-clock.txt 2024-09-21T05:51:19.027 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-factor-clock.txt 2024-09-21T05:51:19.029 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/gpio-gate-clock.txt 2024-09-21T05:51:19.032 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hi3620-clock.txt 2024-09-21T05:51:19.034 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hix5hd2-clock.txt 2024-09-21T05:51:19.036 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx1-clock.txt 2024-09-21T05:51:19.039 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx21-clock.txt 2024-09-21T05:51:19.042 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx23-clock.txt 2024-09-21T05:51:19.043 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx25-clock.txt 2024-09-21T05:51:19.046 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx27-clock.txt 2024-09-21T05:51:19.048 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx28-clock.txt 2024-09-21T05:51:19.050 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx31-clock.txt 2024-09-21T05:51:19.053 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx35-clock.txt 2024-09-21T05:51:19.055 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx5-clock.txt 2024-09-21T05:51:19.057 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6q-clock.txt 2024-09-21T05:51:19.060 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sl-clock.txt 2024-09-21T05:51:19.063 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sx-clock.txt 2024-09-21T05:51:19.065 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-gate.txt 2024-09-21T05:51:19.068 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-pll.txt 2024-09-21T05:51:19.070 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/lsi,axm5516-clks.txt 2024-09-21T05:51:19.073 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,mmp2.txt 2024-09-21T05:51:19.075 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa168.txt 2024-09-21T05:51:19.077 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa910.txt 2024-09-21T05:51:19.080 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77686.txt 2024-09-21T05:51:19.082 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77802.txt 2024-09-21T05:51:19.085 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/moxa,moxart-clock.txt 2024-09-21T05:51:19.088 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-core-clock.txt 2024-09-21T05:51:19.090 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-corediv-clock.txt 2024-09-21T05:51:19.093 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-cpu-clock.txt 2024-09-21T05:51:19.096 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-gated-clock.txt 2024-09-21T05:51:19.098 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nspire-clock.txt 2024-09-21T05:51:19.101 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra114-car.txt 2024-09-21T05:51:19.103 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra124-car.txt 2024-09-21T05:51:19.105 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra20-car.txt 2024-09-21T05:51:19.108 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra30-car.txt 2024-09-21T05:51:19.110 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/prima2-clock.txt 2024-09-21T05:51:19.113 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/pxa-clock.txt 2024-09-21T05:51:19.115 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,gcc.txt 2024-09-21T05:51:19.118 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,lcc.txt 2024-09-21T05:51:19.120 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,mmcc.txt 2024-09-21T05:51:19.123 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qoriq-clock.txt 2024-09-21T05:51:19.125 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-div6-clocks.txt 2024-09-21T05:51:19.127 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-mstp-clocks.txt 2024-09-21T05:51:19.130 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a73a4-cpg-clocks.txt 2024-09-21T05:51:19.132 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7740-cpg-clocks.txt 2024-09-21T05:51:19.134 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7779-cpg-clocks.txt 2024-09-21T05:51:19.137 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rcar-gen2-cpg-clocks.txt 2024-09-21T05:51:19.139 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rz-cpg-clocks.txt 2024-09-21T05:51:19.142 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,sh73a0-cpg-clocks.txt 2024-09-21T05:51:19.144 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3188-cru.txt 2024-09-21T05:51:19.146 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3288-cru.txt 2024-09-21T05:51:19.149 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip.txt 2024-09-21T05:51:19.152 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2410-clock.txt 2024-09-21T05:51:19.154 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2412-clock.txt 2024-09-21T05:51:19.157 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2443-clock.txt 2024-09-21T05:51:19.159 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c64xx-clock.txt 2024-09-21T05:51:19.162 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s5pv210-clock.txt 2024-09-21T05:51:19.164 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si5351.txt 2024-09-21T05:51:19.167 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si570.txt 2024-09-21T05:51:19.169 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st,nomadik.txt 2024-09-21T05:51:19.172 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/ 2024-09-21T05:51:19.174 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-divmux.txt 2024-09-21T05:51:19.176 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-mux.txt 2024-09-21T05:51:19.179 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-pll.txt 2024-09-21T05:51:19.181 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-prediv.txt 2024-09-21T05:51:19.184 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-vcc.txt 2024-09-21T05:51:19.186 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen.txt 2024-09-21T05:51:19.188 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,flexgen.txt 2024-09-21T05:51:19.191 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,quadfs.txt 2024-09-21T05:51:19.193 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ste-u300-syscon-clock.txt 2024-09-21T05:51:19.196 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/sunxi.txt 2024-09-21T05:51:19.198 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti,cdce706.txt 2024-09-21T05:51:19.201 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti-keystone-pllctrl.txt 2024-09-21T05:51:19.203 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/ 2024-09-21T05:51:19.205 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/apll.txt 2024-09-21T05:51:19.207 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/autoidle.txt 2024-09-21T05:51:19.210 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/clockdomain.txt 2024-09-21T05:51:19.212 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/composite.txt 2024-09-21T05:51:19.214 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/divider.txt 2024-09-21T05:51:19.217 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dpll.txt 2024-09-21T05:51:19.219 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dra7-atl.txt 2024-09-21T05:51:19.222 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fapll.txt 2024-09-21T05:51:19.224 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fixed-factor-clock.txt 2024-09-21T05:51:19.226 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/gate.txt 2024-09-21T05:51:19.229 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/interface.txt 2024-09-21T05:51:19.232 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/mux.txt 2024-09-21T05:51:19.234 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vf610-clock.txt 2024-09-21T05:51:19.237 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vt8500.txt 2024-09-21T05:51:19.239 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/xgene.txt 2024-09-21T05:51:19.241 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/zynq-7000.txt 2024-09-21T05:51:19.244 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/ 2024-09-21T05:51:19.246 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/arm_big_little_dt.txt 2024-09-21T05:51:19.250 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-dt.txt 2024-09-21T05:51:19.250 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-exynos5440.txt 2024-09-21T05:51:19.253 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-spear.txt 2024-09-21T05:51:19.255 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/ 2024-09-21T05:51:19.258 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/amd-ccp.txt 2024-09-21T05:51:19.260 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/atmel-crypto.txt 2024-09-21T05:51:19.262 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-dcp.txt 2024-09-21T05:51:19.265 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-imx-sahara.txt 2024-09-21T05:51:19.268 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec2.txt 2024-09-21T05:51:19.270 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec4.txt 2024-09-21T05:51:19.273 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec6.txt 2024-09-21T05:51:19.275 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/mv_cesa.txt 2024-09-21T05:51:19.277 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-aes.txt 2024-09-21T05:51:19.280 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-des.txt 2024-09-21T05:51:19.282 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-sham.txt 2024-09-21T05:51:19.285 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/picochip-spacc.txt 2024-09-21T05:51:19.287 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/qcom-qce.txt 2024-09-21T05:51:19.290 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/samsung-sss.txt 2024-09-21T05:51:19.292 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/ 2024-09-21T05:51:19.296 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/ 2024-09-21T05:51:19.297 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt 2024-09-21T05:51:19.300 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ 2024-09-21T05:51:19.303 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/arm-pl330.txt 2024-09-21T05:51:19.305 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-dma.txt 2024-09-21T05:51:19.308 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-xdma.txt 2024-09-21T05:51:19.310 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/bcm2835-dma.txt 2024-09-21T05:51:19.312 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/dma.txt 2024-09-21T05:51:19.315 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-edma.txt 2024-09-21T05:51:19.318 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-dma.txt 2024-09-21T05:51:19.320 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-sdma.txt 2024-09-21T05:51:19.322 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-mxs-dma.txt 2024-09-21T05:51:19.325 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/img-mdc-dma.txt 2024-09-21T05:51:19.327 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/k3dma.txt 2024-09-21T05:51:19.329 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mmp-dma.txt 2024-09-21T05:51:19.332 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/moxa,moxart-dma.txt 2024-09-21T05:51:19.334 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mpc512x-dma.txt 2024-09-21T05:51:19.337 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mv-xor.txt 2024-09-21T05:51:19.340 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/nbpfaxi.txt 2024-09-21T05:51:19.342 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_adm.txt 2024-09-21T05:51:19.345 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_bam_dma.txt 2024-09-21T05:51:19.347 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/rcar-audmapp.txt 2024-09-21T05:51:19.350 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/renesas,rcar-dmac.txt 2024-09-21T05:51:19.353 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/shdma.txt 2024-09-21T05:51:19.355 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sirfsoc-dma.txt 2024-09-21T05:51:19.357 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/snps-dma.txt 2024-09-21T05:51:19.360 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-coh901318.txt 2024-09-21T05:51:19.362 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-dma40.txt 2024-09-21T05:51:19.365 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sun6i-dma.txt 2024-09-21T05:51:19.367 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/tegra20-apbdma.txt 2024-09-21T05:51:19.369 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ti-edma.txt 2024-09-21T05:51:19.371 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/ 2024-09-21T05:51:19.374 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_dma.txt 2024-09-21T05:51:19.376 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_vdma.txt 2024-09-21T05:51:19.378 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/ 2024-09-21T05:51:19.382 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/ 2024-09-21T05:51:19.384 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/marvell,dove-lcd.txt 2024-09-21T05:51:19.386 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/ 2024-09-21T05:51:19.388 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/hlcdc-dc.txt 2024-09-21T05:51:19.391 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/ 2024-09-21T05:51:19.393 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/dw_hdmi.txt 2024-09-21T05:51:19.395 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/ 2024-09-21T05:51:19.398 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/tda998x.txt 2024-09-21T05:51:19.400 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ 2024-09-21T05:51:19.403 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/fsl-imx-drm.txt 2024-09-21T05:51:19.405 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/hdmi.txt 2024-09-21T05:51:19.408 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ldb.txt 2024-09-21T05:51:19.410 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/ 2024-09-21T05:51:19.412 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/gpu.txt 2024-09-21T05:51:19.415 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/hdmi.txt 2024-09-21T05:51:19.417 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/mdp.txt 2024-09-21T05:51:19.420 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/ 2024-09-21T05:51:19.422 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/panel.txt 2024-09-21T05:51:19.424 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/slave.txt 2024-09-21T05:51:19.427 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tfp410.txt 2024-09-21T05:51:19.430 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tilcdc.txt 2024-09-21T05:51:19.432 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/eeprom.txt 2024-09-21T05:51:19.436 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/ 2024-09-21T05:51:19.438 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-palmas.txt 2024-09-21T05:51:19.440 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-rt8973a.txt 2024-09-21T05:51:19.443 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-sm5502.txt 2024-09-21T05:51:19.446 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/ 2024-09-21T05:51:19.448 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/mxsfb.txt 2024-09-21T05:51:19.450 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/sm501fb.txt 2024-09-21T05:51:19.454 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/ 2024-09-21T05:51:19.455 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/altera-socfpga-fpga-mgr.txt 2024-09-21T05:51:19.457 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/ 2024-09-21T05:51:19.459 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/nvidia,tegra20-fuse.txt 2024-09-21T05:51:19.462 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/ 2024-09-21T05:51:19.464 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt 2024-09-21T05:51:19.466 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt 2024-09-21T05:51:19.469 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt 2024-09-21T05:51:19.471 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt 2024-09-21T05:51:19.474 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt 2024-09-21T05:51:19.476 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt 2024-09-21T05:51:19.479 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt 2024-09-21T05:51:19.482 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt 2024-09-21T05:51:19.484 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt 2024-09-21T05:51:19.486 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt 2024-09-21T05:51:19.489 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt 2024-09-21T05:51:19.491 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt 2024-09-21T05:51:19.493 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt 2024-09-21T05:51:19.496 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt 2024-09-21T05:51:19.498 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt 2024-09-21T05:51:19.500 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt 2024-09-21T05:51:19.503 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt 2024-09-21T05:51:19.506 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt 2024-09-21T05:51:19.508 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt 2024-09-21T05:51:19.510 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt 2024-09-21T05:51:19.513 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt 2024-09-21T05:51:19.515 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt 2024-09-21T05:51:19.518 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt 2024-09-21T05:51:19.520 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt 2024-09-21T05:51:19.523 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt 2024-09-21T05:51:19.525 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt 2024-09-21T05:51:19.527 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt 2024-09-21T05:51:19.530 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt 2024-09-21T05:51:19.532 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt 2024-09-21T05:51:19.534 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt 2024-09-21T05:51:19.537 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt 2024-09-21T05:51:19.539 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt 2024-09-21T05:51:19.542 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt 2024-09-21T05:51:19.544 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt 2024-09-21T05:51:19.547 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt 2024-09-21T05:51:19.549 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt 2024-09-21T05:51:19.551 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt 2024-09-21T05:51:19.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:19 smithi116 ceph-mon[34332]: pgmap v425: 129 pgs: 129 active+clean; 84 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 16 KiB/s wr, 17 op/s 2024-09-21T05:51:19.554 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt 2024-09-21T05:51:19.557 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt 2024-09-21T05:51:19.559 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt 2024-09-21T05:51:19.562 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt 2024-09-21T05:51:19.564 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt 2024-09-21T05:51:19.567 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt 2024-09-21T05:51:19.570 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt 2024-09-21T05:51:19.572 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt 2024-09-21T05:51:19.574 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt 2024-09-21T05:51:19.577 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt 2024-09-21T05:51:19.579 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt 2024-09-21T05:51:19.582 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt 2024-09-21T05:51:19.585 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt 2024-09-21T05:51:19.587 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt 2024-09-21T05:51:19.589 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt 2024-09-21T05:51:19.592 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt 2024-09-21T05:51:19.594 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt 2024-09-21T05:51:19.597 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/ 2024-09-21T05:51:19.599 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,gk20a.txt 2024-09-21T05:51:19.601 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,tegra20-host1x.txt 2024-09-21T05:51:19.604 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-g2d.txt 2024-09-21T05:51:19.607 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-rotator.txt 2024-09-21T05:51:19.609 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/st,stih4xx.txt 2024-09-21T05:51:19.612 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/graph.txt 2024-09-21T05:51:19.615 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/ 2024-09-21T05:51:19.617 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/hid-over-i2c.txt 2024-09-21T05:51:19.619 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/ 2024-09-21T05:51:19.622 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/client-devices.txt 2024-09-21T05:51:19.624 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/nokia-modem.txt 2024-09-21T05:51:19.627 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/omap-ssi.txt 2024-09-21T05:51:19.629 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ 2024-09-21T05:51:19.632 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ads1015.txt 2024-09-21T05:51:19.634 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/g762.txt 2024-09-21T05:51:19.636 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ibmpowernv.txt 2024-09-21T05:51:19.639 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/lm90.txt 2024-09-21T05:51:19.641 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ltc2978.txt 2024-09-21T05:51:19.643 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ntc_thermistor.txt 2024-09-21T05:51:19.646 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/pwm-fan.txt 2024-09-21T05:51:19.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:19 smithi160 ceph-mon[33979]: pgmap v425: 129 pgs: 129 active+clean; 84 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 16 KiB/s wr, 17 op/s 2024-09-21T05:51:19.648 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/vexpress.txt 2024-09-21T05:51:19.651 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/ 2024-09-21T05:51:19.653 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/atmel-trng.txt 2024-09-21T05:51:19.655 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/omap_rng.txt 2024-09-21T05:51:19.657 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/timeriomem_rng.txt 2024-09-21T05:51:19.662 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ 2024-09-21T05:51:19.662 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,bcm2835-i2c.txt 2024-09-21T05:51:19.664 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,iproc-i2c.txt 2024-09-21T05:51:19.667 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-arb-gpio-challenge.txt 2024-09-21T05:51:19.670 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-at91.txt 2024-09-21T05:51:19.673 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-axxia.txt 2024-09-21T05:51:19.676 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-bcm-kona.txt 2024-09-21T05:51:19.678 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cadence.txt 2024-09-21T05:51:19.681 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cbus-gpio.txt 2024-09-21T05:51:19.683 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cros-ec-tunnel.txt 2024-09-21T05:51:19.685 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-davinci.txt 2024-09-21T05:51:19.687 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-designware.txt 2024-09-21T05:51:19.690 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-efm32.txt 2024-09-21T05:51:19.693 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-exynos5.txt 2024-09-21T05:51:19.695 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-gpio.txt 2024-09-21T05:51:19.697 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-hix5hd2.txt 2024-09-21T05:51:19.699 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-img-scb.txt 2024-09-21T05:51:19.702 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-imx.txt 2024-09-21T05:51:19.705 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-meson.txt 2024-09-21T05:51:19.707 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mpc.txt 2024-09-21T05:51:19.709 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-gpio.txt 2024-09-21T05:51:19.711 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pca954x.txt 2024-09-21T05:51:19.714 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pinctrl.txt 2024-09-21T05:51:19.717 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux.txt 2024-09-21T05:51:19.719 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mv64xxx.txt 2024-09-21T05:51:19.721 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mxs.txt 2024-09-21T05:51:19.724 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-nomadik.txt 2024-09-21T05:51:19.726 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-ocores.txt 2024-09-21T05:51:19.729 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-octeon.txt 2024-09-21T05:51:19.731 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-omap.txt 2024-09-21T05:51:19.734 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-opal.txt 2024-09-21T05:51:19.736 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pnx.txt 2024-09-21T05:51:19.739 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa-pci-ce4100.txt 2024-09-21T05:51:19.741 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa.txt 2024-09-21T05:51:19.743 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rcar.txt 2024-09-21T05:51:19.744 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:19 smithi070 ceph-mon[30981]: pgmap v425: 129 pgs: 129 active+clean; 84 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 16 KiB/s wr, 17 op/s 2024-09-21T05:51:19.746 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-riic.txt 2024-09-21T05:51:19.748 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rk3x.txt 2024-09-21T05:51:19.750 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-s3c2410.txt 2024-09-21T05:51:19.753 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sh_mobile.txt 2024-09-21T05:51:19.759 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sirf.txt 2024-09-21T05:51:19.761 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st-ddci2c.txt 2024-09-21T05:51:19.763 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st.txt 2024-09-21T05:51:19.765 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sunxi-p2wi.txt 2024-09-21T05:51:19.768 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-versatile.txt 2024-09-21T05:51:19.771 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-vt8500.txt 2024-09-21T05:51:19.773 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-xiic.txt 2024-09-21T05:51:19.775 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina209.txt 2024-09-21T05:51:19.778 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina2xx.txt 2024-09-21T05:51:19.780 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/max6697.txt 2024-09-21T05:51:19.783 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/nvidia,tegra20-i2c.txt 2024-09-21T05:51:19.785 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/qcom,i2c-qup.txt 2024-09-21T05:51:19.788 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ti,bq32k.txt 2024-09-21T05:51:19.791 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/trivial-devices.txt 2024-09-21T05:51:19.793 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/ 2024-09-21T05:51:19.795 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/ 2024-09-21T05:51:19.797 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/bma180.txt 2024-09-21T05:51:19.799 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/ 2024-09-21T05:51:19.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/at91_adc.txt 2024-09-21T05:51:19.804 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/cc10001_adc.txt 2024-09-21T05:51:19.807 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/max1027-adc.txt 2024-09-21T05:51:19.810 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/nuvoton-nau7802.txt 2024-09-21T05:51:19.812 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-iadc.txt 2024-09-21T05:51:19.814 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-vadc.txt 2024-09-21T05:51:19.817 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/rockchip-saradc.txt 2024-09-21T05:51:19.819 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/twl4030-madc.txt 2024-09-21T05:51:19.821 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/vf610-adc.txt 2024-09-21T05:51:19.824 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/xilinx-xadc.txt 2024-09-21T05:51:19.826 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ 2024-09-21T05:51:19.829 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ad7303.txt 2024-09-21T05:51:19.831 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/max5821.txt 2024-09-21T05:51:19.834 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/ 2024-09-21T05:51:19.837 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/adf4350.txt 2024-09-21T05:51:19.839 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/ 2024-09-21T05:51:19.841 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/dht11.txt 2024-09-21T05:51:19.844 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/iio-bindings.txt 2024-09-21T05:51:19.847 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/ 2024-09-21T05:51:19.849 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/apds9300.txt 2024-09-21T05:51:19.851 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/cm36651.txt 2024-09-21T05:51:19.853 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/gp2ap020a00f.txt 2024-09-21T05:51:19.856 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/tsl2563.txt 2024-09-21T05:51:19.858 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ 2024-09-21T05:51:19.861 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ak8975.txt 2024-09-21T05:51:19.863 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/hmc5843.txt 2024-09-21T05:51:19.865 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/ 2024-09-21T05:51:19.868 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/as3935.txt 2024-09-21T05:51:19.870 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/sensorhub.txt 2024-09-21T05:51:19.873 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/st-sensors.txt 2024-09-21T05:51:19.876 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ 2024-09-21T05:51:19.878 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt 2024-09-21T05:51:19.880 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt 2024-09-21T05:51:19.883 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt 2024-09-21T05:51:19.885 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt 2024-09-21T05:51:19.887 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt 2024-09-21T05:51:19.890 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt 2024-09-21T05:51:19.892 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt 2024-09-21T05:51:19.894 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt 2024-09-21T05:51:19.897 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt 2024-09-21T05:51:19.899 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt 2024-09-21T05:51:19.901 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt 2024-09-21T05:51:19.904 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt 2024-09-21T05:51:19.906 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt 2024-09-21T05:51:19.908 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt 2024-09-21T05:51:19.910 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt 2024-09-21T05:51:19.913 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt 2024-09-21T05:51:19.916 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt 2024-09-21T05:51:19.918 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt 2024-09-21T05:51:19.920 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt 2024-09-21T05:51:19.922 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt 2024-09-21T05:51:19.925 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt 2024-09-21T05:51:19.927 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt 2024-09-21T05:51:19.929 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt 2024-09-21T05:51:19.932 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt 2024-09-21T05:51:19.935 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt 2024-09-21T05:51:19.938 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt 2024-09-21T05:51:19.940 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt 2024-09-21T05:51:19.942 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt 2024-09-21T05:51:19.945 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt 2024-09-21T05:51:19.948 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt 2024-09-21T05:51:19.950 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt 2024-09-21T05:51:19.952 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt 2024-09-21T05:51:19.954 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt 2024-09-21T05:51:19.957 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt 2024-09-21T05:51:19.960 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt 2024-09-21T05:51:19.962 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt 2024-09-21T05:51:19.964 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt 2024-09-21T05:51:19.967 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ 2024-09-21T05:51:19.969 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt 2024-09-21T05:51:19.971 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt 2024-09-21T05:51:19.974 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt 2024-09-21T05:51:19.976 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt 2024-09-21T05:51:19.979 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt 2024-09-21T05:51:19.981 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt 2024-09-21T05:51:19.984 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt 2024-09-21T05:51:19.986 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt 2024-09-21T05:51:19.989 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt 2024-09-21T05:51:19.991 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt 2024-09-21T05:51:19.994 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt 2024-09-21T05:51:19.996 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt 2024-09-21T05:51:19.999 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt 2024-09-21T05:51:20.001 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt 2024-09-21T05:51:20.004 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt 2024-09-21T05:51:20.006 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt 2024-09-21T05:51:20.009 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt 2024-09-21T05:51:20.011 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt 2024-09-21T05:51:20.014 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ 2024-09-21T05:51:20.017 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/abilis,tb10x-ictl.txt 2024-09-21T05:51:20.019 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun4i-ic.txt 2024-09-21T05:51:20.022 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun67i-sc-nmi.txt 2024-09-21T05:51:20.024 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/atmel,aic.txt 2024-09-21T05:51:20.026 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm2835-armctrl-ic.txt 2024-09-21T05:51:20.029 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm7120-l2-intc.txt 2024-09-21T05:51:20.031 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,l2-intc.txt 2024-09-21T05:51:20.034 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/cirrus,clps711x-intc.txt 2024-09-21T05:51:20.036 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/digicolor-ic.txt 2024-09-21T05:51:20.039 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/interrupts.txt 2024-09-21T05:51:20.041 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/lsi,zevio-intc.txt 2024-09-21T05:51:20.044 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,armada-370-xp-mpic.txt 2024-09-21T05:51:20.046 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,orion-intc.txt 2024-09-21T05:51:20.048 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/mips-gic.txt 2024-09-21T05:51:20.051 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/opencores,or1k-pic.txt 2024-09-21T05:51:20.053 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,intc-irqpin.txt 2024-09-21T05:51:20.055 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,irqc.txt 2024-09-21T05:51:20.058 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/samsung,s3c24xx-irq.txt 2024-09-21T05:51:20.060 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/snps,dw-apb-ictl.txt 2024-09-21T05:51:20.062 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,keystone-irq.txt 2024-09-21T05:51:20.065 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,omap-intc-irq.txt 2024-09-21T05:51:20.067 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ 2024-09-21T05:51:20.069 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/arm,smmu.txt 2024-09-21T05:51:20.074 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/iommu.txt 2024-09-21T05:51:20.074 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra20-gart.txt 2024-09-21T05:51:20.077 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra30-smmu.txt 2024-09-21T05:51:20.079 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/renesas,ipmmu-vmsa.txt 2024-09-21T05:51:20.082 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/rockchip,iommu.txt 2024-09-21T05:51:20.084 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/samsung,sysmmu.txt 2024-09-21T05:51:20.087 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ti,omap-iommu.txt 2024-09-21T05:51:20.089 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/ 2024-09-21T05:51:20.092 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/common.txt 2024-09-21T05:51:20.094 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-gpio.txt 2024-09-21T05:51:20.096 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp55xx.txt 2024-09-21T05:51:20.099 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp8860.txt 2024-09-21T05:51:20.101 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-ns2.txt 2024-09-21T05:51:20.305 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-pwm.txt 2024-09-21T05:51:20.308 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/pca963x.txt 2024-09-21T05:51:20.310 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/register-bit-led.txt 2024-09-21T05:51:20.312 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/tca6507.txt 2024-09-21T05:51:20.315 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/ 2024-09-21T05:51:20.318 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2-timings.txt 2024-09-21T05:51:20.321 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2.txt 2024-09-21T05:51:20.323 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/ 2024-09-21T05:51:20.326 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/altera-mailbox.txt 2024-09-21T05:51:20.328 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/mailbox.txt 2024-09-21T05:51:20.330 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/omap-mailbox.txt 2024-09-21T05:51:20.333 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/marvell.txt 2024-09-21T05:51:20.336 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ 2024-09-21T05:51:20.338 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/atmel-isi.txt 2024-09-21T05:51:20.340 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/coda.txt 2024-09-21T05:51:20.342 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-fimc-lite.txt 2024-09-21T05:51:20.345 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-jpeg-codec.txt 2024-09-21T05:51:20.347 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos4-fimc-is.txt 2024-09-21T05:51:20.349 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos5-gsc.txt 2024-09-21T05:51:20.351 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/gpio-ir-receiver.txt 2024-09-21T05:51:20.354 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/hix5hd2-ir.txt 2024-09-21T05:51:20.356 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ 2024-09-21T05:51:20.358 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt 2024-09-21T05:51:20.360 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt 2024-09-21T05:51:20.363 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt 2024-09-21T05:51:20.366 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt 2024-09-21T05:51:20.368 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt 2024-09-21T05:51:20.370 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt 2024-09-21T05:51:20.373 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt 2024-09-21T05:51:20.376 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt 2024-09-21T05:51:20.378 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/img-ir-rev1.txt 2024-09-21T05:51:20.381 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/meson-ir.txt 2024-09-21T05:51:20.384 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/pxa-camera.txt 2024-09-21T05:51:20.386 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/rcar_vin.txt 2024-09-21T05:51:20.388 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/renesas,vsp1.txt 2024-09-21T05:51:20.391 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/s5p-mfc.txt 2024-09-21T05:51:20.393 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-fimc.txt 2024-09-21T05:51:20.396 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-mipi-csis.txt 2024-09-21T05:51:20.398 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5c73m3.txt 2024-09-21T05:51:20.400 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k5baf.txt 2024-09-21T05:51:20.403 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k6a3.txt 2024-09-21T05:51:20.405 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sh_mobile_ceu.txt 2024-09-21T05:51:20.407 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/si4713.txt 2024-09-21T05:51:20.410 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/st-rc.txt 2024-09-21T05:51:20.412 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sunxi-ir.txt 2024-09-21T05:51:20.414 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ti-am437x-vpfe.txt 2024-09-21T05:51:20.416 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/video-interfaces.txt 2024-09-21T05:51:20.419 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ 2024-09-21T05:51:20.421 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ 2024-09-21T05:51:20.423 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ifc.txt 2024-09-21T05:51:20.425 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-devbus.txt 2024-09-21T05:51:20.429 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-sdram-controller.txt 2024-09-21T05:51:20.431 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra-mc.txt 2024-09-21T05:51:20.433 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/renesas-memory-controllers.txt 2024-09-21T05:51:20.436 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/synopsys.txt 2024-09-21T05:51:20.438 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti-aemif.txt 2024-09-21T05:51:20.440 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/ 2024-09-21T05:51:20.442 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/emif.txt 2024-09-21T05:51:20.445 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/ 2024-09-21T05:51:20.447 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta-intc.txt 2024-09-21T05:51:20.449 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta.txt 2024-09-21T05:51:20.451 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/pdc-intc.txt 2024-09-21T05:51:20.454 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ 2024-09-21T05:51:20.457 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/88pm860x.txt 2024-09-21T05:51:20.459 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ab8500.txt 2024-09-21T05:51:20.462 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/arizona.txt 2024-09-21T05:51:20.465 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3711.txt 2024-09-21T05:51:20.468 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3722.txt 2024-09-21T05:51:20.470 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-gpbr.txt 2024-09-21T05:51:20.473 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-hlcdc.txt 2024-09-21T05:51:20.478 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-matrix.txt 2024-09-21T05:51:20.479 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-smc.txt 2024-09-21T05:51:20.481 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bcm590xx.txt 2024-09-21T05:51:20.483 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bfticu.txt 2024-09-21T05:51:20.486 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/cros-ec.txt 2024-09-21T05:51:20.488 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9052-i2c.txt 2024-09-21T05:51:20.491 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9055.txt 2024-09-21T05:51:20.494 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9063.txt 2024-09-21T05:51:20.496 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/hi6421.txt 2024-09-21T05:51:20.498 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/lp3943.txt 2024-09-21T05:51:20.501 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max14577.txt 2024-09-21T05:51:20.503 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77686.txt 2024-09-21T05:51:20.505 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77693.txt 2024-09-21T05:51:20.508 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8925.txt 2024-09-21T05:51:20.510 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8998.txt 2024-09-21T05:51:20.513 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/mc13xxx.txt 2024-09-21T05:51:20.515 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-host.txt 2024-09-21T05:51:20.518 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-tll.txt 2024-09-21T05:51:20.521 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/palmas.txt 2024-09-21T05:51:20.523 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom,spmi-pmic.txt 2024-09-21T05:51:20.526 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-pm8xxx.txt 2024-09-21T05:51:20.528 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-rpm.txt 2024-09-21T05:51:20.531 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qriox.txt 2024-09-21T05:51:20.533 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rk808.txt 2024-09-21T05:51:20.535 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rn5t618.txt 2024-09-21T05:51:20.537 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mpa01.txt 2024-09-21T05:51:20.540 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mps11.txt 2024-09-21T05:51:20.542 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/stmpe.txt 2024-09-21T05:51:20.544 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/sun6i-prcm.txt 2024-09-21T05:51:20.547 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/syscon.txt 2024-09-21T05:51:20.549 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tc3589x.txt 2024-09-21T05:51:20.552 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ti-keystone-devctrl.txt 2024-09-21T05:51:20.555 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps6507x.txt 2024-09-21T05:51:20.557 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps65910.txt 2024-09-21T05:51:20.560 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl-familly.txt 2024-09-21T05:51:20.562 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-audio.txt 2024-09-21T05:51:20.565 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-power.txt 2024-09-21T05:51:20.567 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl6040.txt 2024-09-21T05:51:20.570 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/ 2024-09-21T05:51:20.573 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/ 2024-09-21T05:51:20.576 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt 2024-09-21T05:51:20.579 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt 2024-09-21T05:51:20.581 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ 2024-09-21T05:51:20.584 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/ 2024-09-21T05:51:20.586 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt 2024-09-21T05:51:20.588 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt 2024-09-21T05:51:20.590 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt 2024-09-21T05:51:20.592 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt 2024-09-21T05:51:20.595 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ 2024-09-21T05:51:20.598 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/bootbus.txt 2024-09-21T05:51:20.600 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/cib.txt 2024-09-21T05:51:20.602 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu.txt 2024-09-21T05:51:20.604 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu2.txt 2024-09-21T05:51:20.606 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/dma-engine.txt 2024-09-21T05:51:20.609 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/uctl.txt 2024-09-21T05:51:20.611 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cpu_irq.txt 2024-09-21T05:51:20.614 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ralink.txt 2024-09-21T05:51:20.616 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ 2024-09-21T05:51:20.619 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/allwinner,sunxi-sid.txt 2024-09-21T05:51:20.621 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/arm-charlcd.txt 2024-09-21T05:51:20.623 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/at25.txt 2024-09-21T05:51:20.625 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/atmel-ssc.txt 2024-09-21T05:51:20.628 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/bmp085.txt 2024-09-21T05:51:20.630 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/fsl,qoriq-mc.txt 2024-09-21T05:51:20.633 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ifm-csi.txt 2024-09-21T05:51:20.635 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/lis302.txt 2024-09-21T05:51:20.638 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/nvidia,tegra20-apbmisc.txt 2024-09-21T05:51:20.640 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/smc.txt 2024-09-21T05:51:20.642 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/sram.txt 2024-09-21T05:51:20.645 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ti,dac7512.txt 2024-09-21T05:51:20.647 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ 2024-09-21T05:51:20.649 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt 2024-09-21T05:51:20.652 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt 2024-09-21T05:51:20.654 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt 2024-09-21T05:51:20.656 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt 2024-09-21T05:51:20.659 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt 2024-09-21T05:51:20.661 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt 2024-09-21T05:51:20.664 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt 2024-09-21T05:51:20.666 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt 2024-09-21T05:51:20.668 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt 2024-09-21T05:51:20.671 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt 2024-09-21T05:51:20.674 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt 2024-09-21T05:51:20.676 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt 2024-09-21T05:51:20.679 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt 2024-09-21T05:51:20.682 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt 2024-09-21T05:51:20.685 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt 2024-09-21T05:51:20.687 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt 2024-09-21T05:51:20.690 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt 2024-09-21T05:51:20.692 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt 2024-09-21T05:51:20.695 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt 2024-09-21T05:51:20.697 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt 2024-09-21T05:51:20.699 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt 2024-09-21T05:51:20.702 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt 2024-09-21T05:51:20.704 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt 2024-09-21T05:51:20.707 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt 2024-09-21T05:51:20.709 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt 2024-09-21T05:51:20.711 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt 2024-09-21T05:51:20.714 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt 2024-09-21T05:51:20.716 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt 2024-09-21T05:51:20.719 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt 2024-09-21T05:51:20.721 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt 2024-09-21T05:51:20.723 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt 2024-09-21T05:51:20.726 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt 2024-09-21T05:51:20.728 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt 2024-09-21T05:51:20.730 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt 2024-09-21T05:51:20.733 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt 2024-09-21T05:51:20.735 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt 2024-09-21T05:51:20.738 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt 2024-09-21T05:51:20.740 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt 2024-09-21T05:51:20.742 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt 2024-09-21T05:51:20.744 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/ 2024-09-21T05:51:20.747 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/arm-versatile.txt 2024-09-21T05:51:20.749 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-dataflash.txt 2024-09-21T05:51:20.751 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-nand.txt 2024-09-21T05:51:20.753 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/davinci-nand.txt 2024-09-21T05:51:20.756 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/denali-nand.txt 2024-09-21T05:51:20.765 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/diskonchip.txt 2024-09-21T05:51:20.767 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/elm.txt 2024-09-21T05:51:20.770 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/flctl-nand.txt 2024-09-21T05:51:20.772 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-quadspi.txt 2024-09-21T05:51:20.775 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-upm-nand.txt 2024-09-21T05:51:20.777 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsmc-nand.txt 2024-09-21T05:51:20.779 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpio-control-nand.txt 2024-09-21T05:51:20.781 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nand.txt 2024-09-21T05:51:20.784 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nor.txt 2024-09-21T05:51:20.786 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-onenand.txt 2024-09-21T05:51:20.789 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmi-nand.txt 2024-09-21T05:51:20.791 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/hisi504-nand.txt 2024-09-21T05:51:20.793 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-mlc.txt 2024-09-21T05:51:20.796 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-slc.txt 2024-09-21T05:51:20.798 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/m25p80.txt 2024-09-21T05:51:20.800 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mtd-physmap.txt 2024-09-21T05:51:20.803 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mxc-nand.txt 2024-09-21T05:51:20.805 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/nand.txt 2024-09-21T05:51:20.807 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/orion-nand.txt 2024-09-21T05:51:20.810 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/partition.txt 2024-09-21T05:51:20.812 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/pxa3xx-nand.txt 2024-09-21T05:51:20.814 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/spear_smi.txt 2024-09-21T05:51:20.817 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/st-fsm.txt 2024-09-21T05:51:20.819 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/sunxi-nand.txt 2024-09-21T05:51:20.822 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ 2024-09-21T05:51:20.824 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt 2024-09-21T05:51:20.826 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt 2024-09-21T05:51:20.828 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt 2024-09-21T05:51:20.831 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt 2024-09-21T05:51:20.833 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt 2024-09-21T05:51:20.836 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt 2024-09-21T05:51:20.838 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt 2024-09-21T05:51:20.840 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt 2024-09-21T05:51:20.843 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt 2024-09-21T05:51:20.845 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt 2024-09-21T05:51:20.848 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt 2024-09-21T05:51:20.850 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt 2024-09-21T05:51:20.852 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt 2024-09-21T05:51:20.855 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt 2024-09-21T05:51:20.857 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/ 2024-09-21T05:51:20.859 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt 2024-09-21T05:51:20.861 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt 2024-09-21T05:51:20.864 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt 2024-09-21T05:51:20.866 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt 2024-09-21T05:51:20.868 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt 2024-09-21T05:51:20.871 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt 2024-09-21T05:51:20.873 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt 2024-09-21T05:51:20.875 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt 2024-09-21T05:51:20.877 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt 2024-09-21T05:51:20.880 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt 2024-09-21T05:51:20.882 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt 2024-09-21T05:51:20.886 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt 2024-09-21T05:51:20.888 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt 2024-09-21T05:51:20.890 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt 2024-09-21T05:51:20.893 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt 2024-09-21T05:51:20.895 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt 2024-09-21T05:51:20.897 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt 2024-09-21T05:51:20.900 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt 2024-09-21T05:51:20.902 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt 2024-09-21T05:51:20.904 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt 2024-09-21T05:51:20.906 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/ 2024-09-21T05:51:20.908 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt 2024-09-21T05:51:20.911 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt 2024-09-21T05:51:20.914 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt 2024-09-21T05:51:20.916 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt 2024-09-21T05:51:20.919 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt 2024-09-21T05:51:20.921 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt 2024-09-21T05:51:20.923 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt 2024-09-21T05:51:20.926 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt 2024-09-21T05:51:20.928 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt 2024-09-21T05:51:20.930 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/ 2024-09-21T05:51:20.932 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt 2024-09-21T05:51:20.935 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt 2024-09-21T05:51:20.937 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt 2024-09-21T05:51:20.940 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt 2024-09-21T05:51:20.942 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt 2024-09-21T05:51:20.944 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt 2024-09-21T05:51:20.946 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt 2024-09-21T05:51:20.949 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt 2024-09-21T05:51:20.951 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt 2024-09-21T05:51:20.954 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt 2024-09-21T05:51:20.956 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt 2024-09-21T05:51:20.958 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt 2024-09-21T05:51:20.961 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt 2024-09-21T05:51:20.963 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt 2024-09-21T05:51:20.966 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt 2024-09-21T05:51:20.968 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt 2024-09-21T05:51:20.971 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt 2024-09-21T05:51:20.973 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt 2024-09-21T05:51:20.976 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt 2024-09-21T05:51:20.978 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/ 2024-09-21T05:51:20.980 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt 2024-09-21T05:51:20.982 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt 2024-09-21T05:51:20.985 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt 2024-09-21T05:51:20.987 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt 2024-09-21T05:51:20.989 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt 2024-09-21T05:51:20.992 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt 2024-09-21T05:51:20.995 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt 2024-09-21T05:51:20.997 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt 2024-09-21T05:51:21.000 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt 2024-09-21T05:51:21.002 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt 2024-09-21T05:51:21.004 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt 2024-09-21T05:51:21.007 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt 2024-09-21T05:51:21.009 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt 2024-09-21T05:51:21.011 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt 2024-09-21T05:51:21.013 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt 2024-09-21T05:51:21.016 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt 2024-09-21T05:51:21.018 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt 2024-09-21T05:51:21.020 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ 2024-09-21T05:51:21.022 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt 2024-09-21T05:51:21.025 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt 2024-09-21T05:51:21.027 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt 2024-09-21T05:51:21.029 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/ 2024-09-21T05:51:21.033 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/nios2.txt 2024-09-21T05:51:21.034 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/timer.txt 2024-09-21T05:51:21.037 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/ 2024-09-21T05:51:21.039 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/nvidia,nvec.txt 2024-09-21T05:51:21.041 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/open-pic.txt 2024-09-21T05:51:21.044 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/ 2024-09-21T05:51:21.046 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101aw03.txt 2024-09-21T05:51:21.048 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101xtn01.txt 2024-09-21T05:51:21.051 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b116xw03.txt 2024-09-21T05:51:21.053 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133htn01.txt 2024-09-21T05:51:21.055 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133xtn01.txt 2024-09-21T05:51:21.058 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/avic,tm070ddh03.txt 2024-09-21T05:51:21.061 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wa01a.txt 2024-09-21T05:51:21.063 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wb03.txt 2024-09-21T05:51:21.066 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et057090dhu.txt 2024-09-21T05:51:21.068 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et070080dh6.txt 2024-09-21T05:51:21.071 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,etm0700g0dh6.txt 2024-09-21T05:51:21.073 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/foxlink,fl500wvr00-a0t.txt 2024-09-21T05:51:21.076 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/giantplus,gpg482739qs5.txt 2024-09-21T05:51:21.079 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hannstar,hsd070pww1.txt 2024-09-21T05:51:21.081 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hit,tx23d38vm0caa.txt 2024-09-21T05:51:21.083 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,g121i1-l01.txt 2024-09-21T05:51:21.085 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n116bge.txt 2024-09-21T05:51:21.090 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n156bge-l21.txt 2024-09-21T05:51:21.090 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,ld070wx3-sl01.txt 2024-09-21T05:51:21.092 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lh500wx1-sd03.txt 2024-09-21T05:51:21.095 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lp129qe.txt 2024-09-21T05:51:21.097 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/panasonic,vvx10f004b00.txt 2024-09-21T05:51:21.100 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ld9040.txt 2024-09-21T05:51:21.102 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ltn101nt05.txt 2024-09-21T05:51:21.104 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,s6e8aa0.txt 2024-09-21T05:51:21.107 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/sharp,lq101r1sx01.txt 2024-09-21T05:51:21.109 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/simple-panel.txt 2024-09-21T05:51:21.112 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ 2024-09-21T05:51:21.115 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/83xx-512x-pci.txt 2024-09-21T05:51:21.117 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/designware-pcie.txt 2024-09-21T05:51:21.119 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,imx6q-pcie.txt 2024-09-21T05:51:21.122 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,pci.txt 2024-09-21T05:51:21.124 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/host-generic-pci.txt 2024-09-21T05:51:21.127 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/layerscape-pci.txt 2024-09-21T05:51:21.129 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/mvebu-pci.txt 2024-09-21T05:51:21.132 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/nvidia,tegra20-pcie.txt 2024-09-21T05:51:21.136 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-keystone.txt 2024-09-21T05:51:21.139 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-rcar-gen2.txt 2024-09-21T05:51:21.142 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci.txt 2024-09-21T05:51:21.145 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ralink,rt3883-pci.txt 2024-09-21T05:51:21.148 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/rcar-pci.txt 2024-09-21T05:51:21.151 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/samsung,exynos5440-pcie.txt 2024-09-21T05:51:21.154 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/spear13xx-pcie.txt 2024-09-21T05:51:21.157 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ti-pci.txt 2024-09-21T05:51:21.160 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/v3-v360epc-pci.txt 2024-09-21T05:51:21.163 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/versatile.txt 2024-09-21T05:51:21.166 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xgene-pci.txt 2024-09-21T05:51:21.169 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xilinx-pcie.txt 2024-09-21T05:51:21.172 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ 2024-09-21T05:51:21.175 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/apm-xgene-phy.txt 2024-09-21T05:51:21.178 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/bcm-phy.txt 2024-09-21T05:51:21.181 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-sata-phy.txt 2024-09-21T05:51:21.184 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-usb-phy.txt 2024-09-21T05:51:21.186 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/hix5hd2-phy.txt 2024-09-21T05:51:21.189 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-bindings.txt 2024-09-21T05:51:21.191 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy28lp.txt 2024-09-21T05:51:21.194 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy365x.txt 2024-09-21T05:51:21.197 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-mvebu.txt 2024-09-21T05:51:21.200 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih407-usb.txt 2024-09-21T05:51:21.202 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih41x-usb.txt 2024-09-21T05:51:21.205 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-apq8064-sata-phy.txt 2024-09-21T05:51:21.208 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-dwc3-usb-phy.txt 2024-09-21T05:51:21.211 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-ipq806x-sata-phy.txt 2024-09-21T05:51:21.214 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rcar-gen2-phy.txt 2024-09-21T05:51:21.216 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rockchip-usb-phy.txt 2024-09-21T05:51:21.220 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/samsung-phy.txt 2024-09-21T05:51:21.222 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/st-spear-miphy.txt 2024-09-21T05:51:21.225 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/sun4i-usb-phy.txt 2024-09-21T05:51:21.228 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ti-phy.txt 2024-09-21T05:51:21.231 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ 2024-09-21T05:51:21.233 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/abilis,tb10x-iomux.txt 2024-09-21T05:51:21.236 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/allwinner,sunxi-pinctrl.txt 2024-09-21T05:51:21.239 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/atmel,at91-pinctrl.txt 2024-09-21T05:51:21.242 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm11351-pinctrl.txt 2024-09-21T05:51:21.244 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm2835-gpio.txt 2024-09-21T05:51:21.248 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx-pinctrl.txt 2024-09-21T05:51:21.250 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx25-pinctrl.txt 2024-09-21T05:51:21.253 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx27-pinctrl.txt 2024-09-21T05:51:21.256 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx35-pinctrl.txt 2024-09-21T05:51:21.259 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx51-pinctrl.txt 2024-09-21T05:51:21.262 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx53-pinctrl.txt 2024-09-21T05:51:21.266 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6dl-pinctrl.txt 2024-09-21T05:51:21.271 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6q-pinctrl.txt 2024-09-21T05:51:21.303 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sl-pinctrl.txt 2024-09-21T05:51:21.314 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sx-pinctrl.txt 2024-09-21T05:51:21.317 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,mxs-pinctrl.txt 2024-09-21T05:51:21.321 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,vf610-pinctrl.txt 2024-09-21T05:51:21.323 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pdc-pinctrl.txt 2024-09-21T05:51:21.326 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pinctrl.txt 2024-09-21T05:51:21.329 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,falcon-pinumx.txt 2024-09-21T05:51:21.332 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,xway-pinumx.txt 2024-09-21T05:51:21.334 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-370-pinctrl.txt 2024-09-21T05:51:21.337 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-375-pinctrl.txt 2024-09-21T05:51:21.340 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-38x-pinctrl.txt 2024-09-21T05:51:21.344 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-xp-pinctrl.txt 2024-09-21T05:51:21.347 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,dove-pinctrl.txt 2024-09-21T05:51:21.350 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,kirkwood-pinctrl.txt 2024-09-21T05:51:21.353 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,mvebu-pinctrl.txt 2024-09-21T05:51:21.356 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,orion-pinctrl.txt 2024-09-21T05:51:21.359 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/meson,pinctrl.txt 2024-09-21T05:51:21.362 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra114-pinmux.txt 2024-09-21T05:51:21.365 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-pinmux.txt 2024-09-21T05:51:21.368 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-xusb-padctl.txt 2024-09-21T05:51:21.370 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra20-pinmux.txt 2024-09-21T05:51:21.373 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra30-pinmux.txt 2024-09-21T05:51:21.377 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-bindings.txt 2024-09-21T05:51:21.380 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-palmas.txt 2024-09-21T05:51:21.382 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-single.txt 2024-09-21T05:51:21.385 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-sirf.txt 2024-09-21T05:51:21.387 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-st.txt 2024-09-21T05:51:21.390 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-vt8500.txt 2024-09-21T05:51:21.392 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl_spear.txt 2024-09-21T05:51:21.395 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8064-pinctrl.txt 2024-09-21T05:51:21.398 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8084-pinctrl.txt 2024-09-21T05:51:21.401 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,ipq8064-pinctrl.txt 2024-09-21T05:51:21.403 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8916-pinctrl.txt 2024-09-21T05:51:21.407 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8960-pinctrl.txt 2024-09-21T05:51:21.409 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8974-pinctrl.txt 2024-09-21T05:51:21.414 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-gpio.txt 2024-09-21T05:51:21.417 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-mpp.txt 2024-09-21T05:51:21.420 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/renesas,pfc-pinctrl.txt 2024-09-21T05:51:21.423 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/rockchip,pinctrl.txt 2024-09-21T05:51:21.425 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/samsung-pinctrl.txt 2024-09-21T05:51:21.428 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,abx500.txt 2024-09-21T05:51:21.431 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,nomadik.txt 2024-09-21T05:51:21.434 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ti,omap-pinctrl.txt 2024-09-21T05:51:21.437 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/xlnx,zynq-pinctrl.txt 2024-09-21T05:51:21.440 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ 2024-09-21T05:51:21.443 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/bq2415x.txt 2024-09-21T05:51:21.447 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/isp1704.txt 2024-09-21T05:51:21.451 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ltc2941.txt 2024-09-21T05:51:21.453 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/opp.txt 2024-09-21T05:51:21.456 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power-controller.txt 2024-09-21T05:51:21.459 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power_domain.txt 2024-09-21T05:51:21.462 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/renesas,sysc-rmobile.txt 2024-09-21T05:51:21.466 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ 2024-09-21T05:51:21.468 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/keystone-reset.txt 2024-09-21T05:51:21.471 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ltc2952-poweroff.txt 2024-09-21T05:51:21.474 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/st-reset.txt 2024-09-21T05:51:21.477 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/syscon-reboot.txt 2024-09-21T05:51:21.480 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rockchip-io-domain.txt 2024-09-21T05:51:21.483 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rx51-battery.txt 2024-09-21T05:51:21.486 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/twl-charger.txt 2024-09-21T05:51:21.489 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ 2024-09-21T05:51:21.491 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/ 2024-09-21T05:51:21.494 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/btemp.txt 2024-09-21T05:51:21.498 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/chargalg.txt 2024-09-21T05:51:21.501 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/charger.txt 2024-09-21T05:51:21.503 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/fg.txt 2024-09-21T05:51:21.505 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/axxia-reset.txt 2024-09-21T05:51:21.509 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/charger-manager.txt 2024-09-21T05:51:21.511 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/gpio-charger.txt 2024-09-21T05:51:21.513 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/imx-snvs-poweroff.txt 2024-09-21T05:51:21.515 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/lp8727_charger.txt 2024-09-21T05:51:21.517 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max17042_battery.txt 2024-09-21T05:51:21.520 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max8925_batter.txt 2024-09-21T05:51:21.522 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/msm-poweroff.txt 2024-09-21T05:51:21.525 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/olpc_battery.txt 2024-09-21T05:51:21.527 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/power_supply.txt 2024-09-21T05:51:21.530 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/qnap-poweroff.txt 2024-09-21T05:51:21.532 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/restart-poweroff.txt 2024-09-21T05:51:21.535 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/sbs_sbs-battery.txt 2024-09-21T05:51:21.537 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ti,bq24735.txt 2024-09-21T05:51:21.540 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/tps65090.txt 2024-09-21T05:51:21.542 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/ 2024-09-21T05:51:21.545 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ 2024-09-21T05:51:21.547 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/akebono.txt 2024-09-21T05:51:21.549 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/cpm.txt 2024-09-21T05:51:21.552 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/emac.txt 2024-09-21T05:51:21.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:21 smithi116 ceph-mon[34332]: pgmap v426: 129 pgs: 129 active+clean; 86 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 100 KiB/s wr, 26 op/s 2024-09-21T05:51:21.555 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/hsta.txt 2024-09-21T05:51:21.557 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ndfc.txt 2024-09-21T05:51:21.560 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ppc440spe-adma.txt 2024-09-21T05:51:21.563 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/reboot.txt 2024-09-21T05:51:21.565 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ 2024-09-21T05:51:21.567 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/board.txt 2024-09-21T05:51:21.570 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cache_sram.txt 2024-09-21T05:51:21.572 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ccf.txt 2024-09-21T05:51:21.575 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/ 2024-09-21T05:51:21.577 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm.txt 2024-09-21T05:51:21.579 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/ 2024-09-21T05:51:21.581 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/brg.txt 2024-09-21T05:51:21.583 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/i2c.txt 2024-09-21T05:51:21.586 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/pic.txt 2024-09-21T05:51:21.588 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/usb.txt 2024-09-21T05:51:21.591 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/gpio.txt 2024-09-21T05:51:21.594 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/network.txt 2024-09-21T05:51:21.596 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe.txt 2024-09-21T05:51:21.599 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ 2024-09-21T05:51:21.601 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/firmware.txt 2024-09-21T05:51:21.604 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/par_io.txt 2024-09-21T05:51:21.607 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/pincfg.txt 2024-09-21T05:51:21.610 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ucc.txt 2024-09-21T05:51:21.613 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/usb.txt 2024-09-21T05:51:21.616 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/serial.txt 2024-09-21T05:51:21.619 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpus.txt 2024-09-21T05:51:21.622 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dcsr.txt 2024-09-21T05:51:21.624 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/diu.txt 2024-09-21T05:51:21.627 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dma.txt 2024-09-21T05:51:21.630 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ecm.txt 2024-09-21T05:51:21.632 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/fman.txt 2024-09-21T05:51:21.636 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/gtm.txt 2024-09-21T05:51:21.639 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/guts.txt 2024-09-21T05:51:21.642 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/interlaken-lac.txt 2024-09-21T05:51:21.645 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/l2cache.txt 2024-09-21T05:51:21.648 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/lbc.txt 2024-09-21T05:51:21.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:21 smithi160 ceph-mon[33979]: pgmap v426: 129 pgs: 129 active+clean; 86 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 100 KiB/s wr, 26 op/s 2024-09-21T05:51:21.650 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcm.txt 2024-09-21T05:51:21.653 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcu-mpc8349emitx.txt 2024-09-21T05:51:21.656 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mem-ctrlr.txt 2024-09-21T05:51:21.658 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5121-psc.txt 2024-09-21T05:51:21.660 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5200.txt 2024-09-21T05:51:21.663 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-msgr.txt 2024-09-21T05:51:21.665 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-timer.txt 2024-09-21T05:51:21.668 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic.txt 2024-09-21T05:51:21.670 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/msi-pic.txt 2024-09-21T05:51:21.673 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pamu.txt 2024-09-21T05:51:21.676 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pmc.txt 2024-09-21T05:51:21.679 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/raideng.txt 2024-09-21T05:51:21.681 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio-rmu.txt 2024-09-21T05:51:21.683 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio.txt 2024-09-21T05:51:21.686 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/ 2024-09-21T05:51:21.688 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/gamecube.txt 2024-09-21T05:51:21.691 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/wii.txt 2024-09-21T05:51:21.693 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/ 2024-09-21T05:51:21.696 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/pps-gpio.txt 2024-09-21T05:51:21.699 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ 2024-09-21T05:51:21.702 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-hlcdc-pwm.txt 2024-09-21T05:51:21.705 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-pwm.txt 2024-09-21T05:51:21.707 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-tcb-pwm.txt 2024-09-21T05:51:21.709 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/bcm-kona-pwm.txt 2024-09-21T05:51:21.712 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/cirrus,clps711x-pwm.txt 2024-09-21T05:51:21.714 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/img-pwm.txt 2024-09-21T05:51:21.716 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/imx-pwm.txt 2024-09-21T05:51:21.719 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/lpc32xx-pwm.txt 2024-09-21T05:51:21.721 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/mxs-pwm.txt 2024-09-21T05:51:21.724 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nvidia,tegra20-pwm.txt 2024-09-21T05:51:21.726 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nxp,pca9685-pwm.txt 2024-09-21T05:51:21.729 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-bcm2835.txt 2024-09-21T05:51:21.731 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-fsl-ftm.txt 2024-09-21T05:51:21.734 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-lp3943.txt 2024-09-21T05:51:21.737 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-rockchip.txt 2024-09-21T05:51:21.739 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-samsung.txt 2024-09-21T05:51:21.742 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-st.txt 2024-09-21T05:51:21.745 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-sun4i.txt 2024-09-21T05:51:21.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:21 smithi070 ceph-mon[30981]: pgmap v426: 129 pgs: 129 active+clean; 86 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 100 KiB/s wr, 26 op/s 2024-09-21T05:51:21.747 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiecap.txt 2024-09-21T05:51:21.749 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiehrpwm.txt 2024-09-21T05:51:21.751 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tipwmss.txt 2024-09-21T05:51:21.754 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm.txt 2024-09-21T05:51:21.757 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pxa-pwm.txt 2024-09-21T05:51:21.759 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/renesas,tpu-pwm.txt 2024-09-21T05:51:21.761 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/spear-pwm.txt 2024-09-21T05:51:21.764 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwm.txt 2024-09-21T05:51:21.769 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwmled.txt 2024-09-21T05:51:21.771 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/vt8500-pwm.txt 2024-09-21T05:51:21.773 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/ 2024-09-21T05:51:21.775 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/regmap.txt 2024-09-21T05:51:21.778 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ 2024-09-21T05:51:21.780 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt 2024-09-21T05:51:21.782 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt 2024-09-21T05:51:21.785 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt 2024-09-21T05:51:21.787 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt 2024-09-21T05:51:21.789 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt 2024-09-21T05:51:21.791 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt 2024-09-21T05:51:21.794 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt 2024-09-21T05:51:21.796 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt 2024-09-21T05:51:21.799 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt 2024-09-21T05:51:21.801 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt 2024-09-21T05:51:21.803 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt 2024-09-21T05:51:21.806 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt 2024-09-21T05:51:21.808 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt 2024-09-21T05:51:21.811 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt 2024-09-21T05:51:21.813 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt 2024-09-21T05:51:21.815 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt 2024-09-21T05:51:21.818 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt 2024-09-21T05:51:21.820 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt 2024-09-21T05:51:21.823 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt 2024-09-21T05:51:21.825 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt 2024-09-21T05:51:21.827 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt 2024-09-21T05:51:21.830 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt 2024-09-21T05:51:21.832 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt 2024-09-21T05:51:21.835 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt 2024-09-21T05:51:21.838 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt 2024-09-21T05:51:21.840 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt 2024-09-21T05:51:21.842 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt 2024-09-21T05:51:21.844 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt 2024-09-21T05:51:21.847 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt 2024-09-21T05:51:21.850 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt 2024-09-21T05:51:21.852 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt 2024-09-21T05:51:21.854 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt 2024-09-21T05:51:21.857 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt 2024-09-21T05:51:21.859 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt 2024-09-21T05:51:21.861 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt 2024-09-21T05:51:21.863 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt 2024-09-21T05:51:21.866 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt 2024-09-21T05:51:21.868 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt 2024-09-21T05:51:21.870 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/ 2024-09-21T05:51:21.873 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/reserved-memory.txt 2024-09-21T05:51:21.875 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/ 2024-09-21T05:51:21.877 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/allwinner,sunxi-clock-reset.txt 2024-09-21T05:51:21.879 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/fsl,imx-src.txt 2024-09-21T05:51:21.882 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/reset.txt 2024-09-21T05:51:21.884 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/sirf,rstc.txt 2024-09-21T05:51:21.886 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/socfpga-reset.txt 2024-09-21T05:51:21.889 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-picophyreset.txt 2024-09-21T05:51:21.891 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-powerdown.txt 2024-09-21T05:51:21.894 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-softreset.txt 2024-09-21T05:51:21.897 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/resource-names.txt 2024-09-21T05:51:21.900 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/ 2024-09-21T05:51:21.902 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/apm,rng.txt 2024-09-21T05:51:21.904 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/brcm,bcm2835.txt 2024-09-21T05:51:21.906 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/qcom,prng.txt 2024-09-21T05:51:21.909 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/ 2024-09-21T05:51:21.911 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/armada-380-rtc.txt 2024-09-21T05:51:21.913 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91rm9200-rtc.txt 2024-09-21T05:51:21.916 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91sam9-rtc.txt 2024-09-21T05:51:21.918 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dallas,ds1339.txt 2024-09-21T05:51:21.920 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dw-apb.txt 2024-09-21T05:51:21.922 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/haoyu,hym8563.txt 2024-09-21T05:51:21.925 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/imxdi-rtc.txt 2024-09-21T05:51:21.927 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/isil,isl12057.txt 2024-09-21T05:51:21.929 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/lpc32xx-rtc.txt 2024-09-21T05:51:21.932 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/maxim,ds1742.txt 2024-09-21T05:51:21.934 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/moxa,moxart-rtc.txt 2024-09-21T05:51:21.936 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nvidia,tegra20-rtc.txt 2024-09-21T05:51:21.938 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nxp,rtc-2123.txt 2024-09-21T05:51:21.940 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/olpc-xo1-rtc.txt 2024-09-21T05:51:21.943 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/orion-rtc.txt 2024-09-21T05:51:21.945 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/pxa-rtc.txt 2024-09-21T05:51:21.948 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-cmos.txt 2024-09-21T05:51:21.950 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-omap.txt 2024-09-21T05:51:21.952 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-opal.txt 2024-09-21T05:51:21.955 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-palmas.txt 2024-09-21T05:51:21.957 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/s3c-rtc.txt 2024-09-21T05:51:21.959 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sa1100-rtc.txt 2024-09-21T05:51:21.962 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/snvs-rtc.txt 2024-09-21T05:51:21.965 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/spear-rtc.txt 2024-09-21T05:51:21.967 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/stmp3xxx-rtc.txt 2024-09-21T05:51:21.969 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sun6i-rtc.txt 2024-09-21T05:51:21.972 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sunxi-rtc.txt 2024-09-21T05:51:21.974 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/twl-rtc.txt 2024-09-21T05:51:21.976 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/via,vt8500-rtc.txt 2024-09-21T05:51:21.979 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/xgene-rtc.txt 2024-09-21T05:51:21.981 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/ 2024-09-21T05:51:21.984 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/ 2024-09-21T05:51:21.985 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/st33zp24-i2c.txt 2024-09-21T05:51:21.987 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/ 2024-09-21T05:51:21.990 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/8250.txt 2024-09-21T05:51:21.993 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_jtaguart.txt 2024-09-21T05:51:21.995 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_uart.txt 2024-09-21T05:51:21.998 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/arc-uart.txt 2024-09-21T05:51:22.000 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/atmel-usart.txt 2024-09-21T05:51:22.003 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/axis,etraxfs-uart.txt 2024-09-21T05:51:22.005 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/bcm63xx-uart.txt 2024-09-21T05:51:22.008 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cavium-uart.txt 2024-09-21T05:51:22.010 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cdns,uart.txt 2024-09-21T05:51:22.012 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cirrus,clps711x-uart.txt 2024-09-21T05:51:22.014 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/digicolor-usart.txt 2024-09-21T05:51:22.017 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/efm32-uart.txt 2024-09-21T05:51:22.019 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-imx-uart.txt 2024-09-21T05:51:22.021 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-lpuart.txt 2024-09-21T05:51:22.023 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-mxs-auart.txt 2024-09-21T05:51:22.025 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/lantiq_asc.txt 2024-09-21T05:51:22.028 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/maxim,max310x.txt 2024-09-21T05:51:22.030 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl,pxa-ssp.txt 2024-09-21T05:51:22.032 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl-serial.txt 2024-09-21T05:51:22.034 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mtk-uart.txt 2024-09-21T05:51:22.037 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nvidia,tegra20-hsuart.txt 2024-09-21T05:51:22.039 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp,sc16is7xx.txt 2024-09-21T05:51:22.042 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp-lpc32xx-hsuart.txt 2024-09-21T05:51:22.044 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/omap_serial.txt 2024-09-21T05:51:22.046 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/pl011.txt 2024-09-21T05:51:22.049 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qca,ar9330-uart.txt 2024-09-21T05:51:22.051 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uart.txt 2024-09-21T05:51:22.053 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uartdm.txt 2024-09-21T05:51:22.056 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/renesas,sci-serial.txt 2024-09-21T05:51:22.059 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/rs485.txt 2024-09-21T05:51:22.061 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/samsung_uart.txt 2024-09-21T05:51:22.063 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sirf-uart.txt 2024-09-21T05:51:22.066 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/snps-dw-apb-uart.txt 2024-09-21T05:51:22.068 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sprd-uart.txt 2024-09-21T05:51:22.070 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/st-asc.txt 2024-09-21T05:51:22.072 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/vt8500-uart.txt 2024-09-21T05:51:22.075 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/ 2024-09-21T05:51:22.077 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/allwinner,sun4i-ps2.txt 2024-09-21T05:51:22.079 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/altera_ps2.txt 2024-09-21T05:51:22.081 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/olpc,ap-sp.txt 2024-09-21T05:51:22.084 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/snps-arc_ps2.txt 2024-09-21T05:51:22.086 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ 2024-09-21T05:51:22.089 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/ 2024-09-21T05:51:22.090 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman-portals.txt 2024-09-21T05:51:22.093 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman.txt 2024-09-21T05:51:22.095 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman-portals.txt 2024-09-21T05:51:22.098 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman.txt 2024-09-21T05:51:22.100 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/ 2024-09-21T05:51:22.103 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/qcom,gsbi.txt 2024-09-21T05:51:22.105 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/ 2024-09-21T05:51:22.107 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-dma.txt 2024-09-21T05:51:22.109 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-qmss.txt 2024-09-21T05:51:22.112 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ 2024-09-21T05:51:22.115 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,adau1701.txt 2024-09-21T05:51:22.117 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-i2s.txt 2024-09-21T05:51:22.120 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-spdif-tx.txt 2024-09-21T05:51:22.122 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,ssm2602.txt 2024-09-21T05:51:22.125 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4104.txt 2024-09-21T05:51:22.127 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4554.c 2024-09-21T05:51:22.129 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4642.txt 2024-09-21T05:51:22.131 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak5386.txt 2024-09-21T05:51:22.134 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5623.txt 2024-09-21T05:51:22.136 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5632.txt 2024-09-21T05:51:22.138 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/armada-370db-audio.txt 2024-09-21T05:51:22.141 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/arndale.txt 2024-09-21T05:51:22.143 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-at91sam9g20ek-wm8731-audio.txt 2024-09-21T05:51:22.146 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-sam9x5-wm8731-audio.txt 2024-09-21T05:51:22.148 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-wm8904.txt 2024-09-21T05:51:22.150 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel_ac97c.txt 2024-09-21T05:51:22.152 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/bcm2835-i2s.txt 2024-09-21T05:51:22.155 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cdns,xtfpga-i2s.txt 2024-09-21T05:51:22.157 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs35l32.txt 2024-09-21T05:51:22.160 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4265.txt 2024-09-21T05:51:22.162 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4270.txt 2024-09-21T05:51:22.165 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4271.txt 2024-09-21T05:51:22.167 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l52.txt 2024-09-21T05:51:22.170 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l56.txt 2024-09-21T05:51:22.173 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l73.txt 2024-09-21T05:51:22.175 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42xx8.txt 2024-09-21T05:51:22.177 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/da9055.txt 2024-09-21T05:51:22.179 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-evm-audio.txt 2024-09-21T05:51:22.182 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-mcasp-audio.txt 2024-09-21T05:51:22.184 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/designware-i2s.txt 2024-09-21T05:51:22.187 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/es8328.txt 2024-09-21T05:51:22.190 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/eukrea-tlv320.txt 2024-09-21T05:51:22.192 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,asrc.txt 2024-09-21T05:51:22.194 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,esai.txt 2024-09-21T05:51:22.197 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,spdif.txt 2024-09-21T05:51:22.200 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,ssi.txt 2024-09-21T05:51:22.203 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-asoc-card.txt 2024-09-21T05:51:22.205 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-sai.txt 2024-09-21T05:51:22.208 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/hdmi.txt 2024-09-21T05:51:22.210 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-es8328.txt 2024-09-21T05:51:22.213 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-sgtl5000.txt 2024-09-21T05:51:22.216 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-spdif.txt 2024-09-21T05:51:22.218 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-wm8962.txt 2024-09-21T05:51:22.221 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audmux.txt 2024-09-21T05:51:22.223 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ingenic,jz4740-i2s.txt 2024-09-21T05:51:22.225 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98090.txt 2024-09-21T05:51:22.228 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98095.txt 2024-09-21T05:51:22.231 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98357a.txt 2024-09-21T05:51:22.233 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa-ssp.txt 2024-09-21T05:51:22.236 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa2xx-pcm.txt 2024-09-21T05:51:22.238 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mvebu-audio.txt 2024-09-21T05:51:22.241 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-audio-sgtl5000.txt 2024-09-21T05:51:22.243 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-saif.txt 2024-09-21T05:51:22.245 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nokia,rx51.txt 2024-09-21T05:51:22.247 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-alc5632.txt 2024-09-21T05:51:22.250 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-max98090.txt 2024-09-21T05:51:22.253 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5640.txt 2024-09-21T05:51:22.255 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5677.txt 2024-09-21T05:51:22.257 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-trimslice.txt 2024-09-21T05:51:22.259 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8753.txt 2024-09-21T05:51:22.262 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8903.txt 2024-09-21T05:51:22.264 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm9712.txt 2024-09-21T05:51:22.267 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-ac97.txt 2024-09-21T05:51:22.269 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-das.txt 2024-09-21T05:51:22.272 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-i2s.txt 2024-09-21T05:51:22.274 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-ahub.txt 2024-09-21T05:51:22.277 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-hda.txt 2024-09-21T05:51:22.280 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-i2s.txt 2024-09-21T05:51:22.282 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-abe-twl6040.txt 2024-09-21T05:51:22.285 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-dmic.txt 2024-09-21T05:51:22.287 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcbsp.txt 2024-09-21T05:51:22.290 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcpdm.txt 2024-09-21T05:51:22.292 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-twl4030.txt 2024-09-21T05:51:22.294 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm1792a.txt 2024-09-21T05:51:22.297 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm512x.txt 2024-09-21T05:51:22.299 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,fsi.txt 2024-09-21T05:51:22.301 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,rsnd.txt 2024-09-21T05:51:22.304 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rockchip-i2s.txt 2024-09-21T05:51:22.306 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5631.txt 2024-09-21T05:51:22.309 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5640.txt 2024-09-21T05:51:22.311 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5677.txt 2024-09-21T05:51:22.313 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,odroidx2-max98090.txt 2024-09-21T05:51:22.316 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,smdk-wm8994.txt 2024-09-21T05:51:22.318 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung-i2s.txt 2024-09-21T05:51:22.321 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sgtl5000.txt 2024-09-21T05:51:22.323 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/simple-card.txt 2024-09-21T05:51:22.326 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-codec.txt 2024-09-21T05:51:22.328 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-port.txt 2024-09-21T05:51:22.330 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio.txt 2024-09-21T05:51:22.332 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-usp.txt 2024-09-21T05:51:22.334 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/snow.txt 2024-09-21T05:51:22.337 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/soc-ac97link.txt 2024-09-21T05:51:22.339 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-receiver.txt 2024-09-21T05:51:22.341 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-transmitter.txt 2024-09-21T05:51:22.344 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm2518.txt 2024-09-21T05:51:22.346 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm4567.txt 2024-09-21T05:51:22.348 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta32x.txt 2024-09-21T05:51:22.350 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta350.txt 2024-09-21T05:51:22.353 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tas2552.txt 2024-09-21T05:51:22.355 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tdm-slot.txt 2024-09-21T05:51:22.358 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,pcm1681.txt 2024-09-21T05:51:22.360 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,tas5086.txt 2024-09-21T05:51:22.362 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic31xx.txt 2024-09-21T05:51:22.365 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic32x4.txt 2024-09-21T05:51:22.367 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic3x.txt 2024-09-21T05:51:22.369 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tpa6130a2.txt 2024-09-21T05:51:22.372 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ts3a227e.txt 2024-09-21T05:51:22.374 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-mop500.txt 2024-09-21T05:51:22.376 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-msp.txt 2024-09-21T05:51:22.379 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/widgets.txt 2024-09-21T05:51:22.381 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8510.txt 2024-09-21T05:51:22.383 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8523.txt 2024-09-21T05:51:22.386 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8580.txt 2024-09-21T05:51:22.388 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8711.txt 2024-09-21T05:51:22.390 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8728.txt 2024-09-21T05:51:22.393 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8731.txt 2024-09-21T05:51:22.395 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8737.txt 2024-09-21T05:51:22.397 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8741.txt 2024-09-21T05:51:22.400 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8750.txt 2024-09-21T05:51:22.402 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8753.txt 2024-09-21T05:51:22.404 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8770.txt 2024-09-21T05:51:22.407 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8776.txt 2024-09-21T05:51:22.409 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8804.txt 2024-09-21T05:51:22.412 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8903.txt 2024-09-21T05:51:22.414 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8904.txt 2024-09-21T05:51:22.417 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8960.txt 2024-09-21T05:51:22.419 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8962.txt 2024-09-21T05:51:22.421 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8994.txt 2024-09-21T05:51:22.424 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ 2024-09-21T05:51:22.426 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/brcm,bcm2835-spi.txt 2024-09-21T05:51:22.428 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/efm32-spi.txt 2024-09-21T05:51:22.431 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-imx-cspi.txt 2024-09-21T05:51:22.433 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-spi.txt 2024-09-21T05:51:22.436 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/mxs-spi.txt 2024-09-21T05:51:22.438 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra114-spi.txt 2024-09-21T05:51:22.440 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-sflash.txt 2024-09-21T05:51:22.443 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-slink.txt 2024-09-21T05:51:22.446 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/omap-spi.txt 2024-09-21T05:51:22.448 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/qcom,spi-qup.txt 2024-09-21T05:51:22.450 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-hspi.txt 2024-09-21T05:51:22.452 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-msiof.txt 2024-09-21T05:51:22.455 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/snps,dw-apb-ssi.txt 2024-09-21T05:51:22.457 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-bus.txt 2024-09-21T05:51:22.460 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-cadence.txt 2024-09-21T05:51:22.462 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-davinci.txt 2024-09-21T05:51:22.464 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-dw.txt 2024-09-21T05:51:22.466 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-fsl-dspi.txt 2024-09-21T05:51:22.469 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-gpio.txt 2024-09-21T05:51:22.471 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-img-spfi.txt 2024-09-21T05:51:22.474 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-meson.txt 2024-09-21T05:51:22.477 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-octeon.txt 2024-09-21T05:51:22.479 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-orion.txt 2024-09-21T05:51:22.482 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rockchip.txt 2024-09-21T05:51:22.484 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rspi.txt 2024-09-21T05:51:22.487 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-samsung.txt 2024-09-21T05:51:22.489 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sc18is602.txt 2024-09-21T05:51:22.492 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sirf.txt 2024-09-21T05:51:22.494 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-st-ssc.txt 2024-09-21T05:51:22.497 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun4i.txt 2024-09-21T05:51:22.499 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun6i.txt 2024-09-21T05:51:22.502 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-xtensa-xtfpga.txt 2024-09-21T05:51:22.505 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_altera.txt 2024-09-21T05:51:22.507 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_atmel.txt 2024-09-21T05:51:22.510 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_oc_tiny.txt 2024-09-21T05:51:22.512 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_pl022.txt 2024-09-21T05:51:22.514 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ti_qspi.txt 2024-09-21T05:51:22.517 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/ 2024-09-21T05:51:22.522 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/qcom,spmi-pmic-arb.txt 2024-09-21T05:51:22.525 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/spmi.txt 2024-09-21T05:51:22.527 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/ 2024-09-21T05:51:22.530 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/ 2024-09-21T05:51:22.531 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/ 2024-09-21T05:51:22.533 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/lpc32xx-adc.txt 2024-09-21T05:51:22.536 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/mxs-lradc.txt 2024-09-21T05:51:22.538 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/spear-adc.txt 2024-09-21T05:51:22.541 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/submitting-patches.txt 2024-09-21T05:51:22.546 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ 2024-09-21T05:51:22.548 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/armada-thermal.txt 2024-09-21T05:51:22.551 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/db8500-thermal.txt 2024-09-21T05:51:22.553 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/dove-thermal.txt 2024-09-21T05:51:22.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:22 smithi116 ceph-mon[34332]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:51:22.556 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/exynos-thermal.txt 2024-09-21T05:51:22.558 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/imx-thermal.txt 2024-09-21T05:51:22.561 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/kirkwood-thermal.txt 2024-09-21T05:51:22.564 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rcar-thermal.txt 2024-09-21T05:51:22.567 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rockchip-thermal.txt 2024-09-21T05:51:22.569 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/spear-thermal.txt 2024-09-21T05:51:22.571 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/st-thermal.txt 2024-09-21T05:51:22.574 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/tegra-soctherm.txt 2024-09-21T05:51:22.577 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/thermal.txt 2024-09-21T05:51:22.580 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ti_soc_thermal.txt 2024-09-21T05:51:22.583 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ 2024-09-21T05:51:22.586 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun4i-timer.txt 2024-09-21T05:51:22.589 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun5i-a13-hstimer.txt 2024-09-21T05:51:22.591 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/amlogic,meson6-timer.txt 2024-09-21T05:51:22.594 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/arm,sp804.txt 2024-09-21T05:51:22.597 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/brcm,bcm2835-system-timer.txt 2024-09-21T05:51:22.599 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cadence,ttc-timer.txt 2024-09-21T05:51:22.602 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cirrus,clps711x-timer.txt 2024-09-21T05:51:22.604 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/digicolor-timer.txt 2024-09-21T05:51:22.606 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/energymicro,efm32-timer.txt 2024-09-21T05:51:22.608 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,ftm-timer.txt 2024-09-21T05:51:22.611 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,imxgpt.txt 2024-09-21T05:51:22.613 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/lsi,zevio-timer.txt 2024-09-21T05:51:22.616 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,armada-370-xp-timer.txt 2024-09-21T05:51:22.618 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,orion-timer.txt 2024-09-21T05:51:22.621 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/mediatek,mtk-timer.txt 2024-09-21T05:51:22.623 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/moxa,moxart-timer.txt 2024-09-21T05:51:22.625 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra20-timer.txt 2024-09-21T05:51:22.628 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra30-timer.txt 2024-09-21T05:51:22.630 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,cmt.txt 2024-09-21T05:51:22.632 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,mtu2.txt 2024-09-21T05:51:22.635 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,tmu.txt 2024-09-21T05:51:22.637 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/rockchip,rk3288-timer.txt 2024-09-21T05:51:22.639 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/samsung,exynos4210-mct.txt 2024-09-21T05:51:22.642 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/stericsson-u300-apptimer.txt 2024-09-21T05:51:22.644 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ti,keystone-timer.txt 2024-09-21T05:51:22.646 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ 2024-09-21T05:51:22.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:22 smithi160 ceph-mon[33979]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:51:22.648 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ufshcd-pltfrm.txt 2024-09-21T05:51:22.651 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/unittest.txt 2024-09-21T05:51:22.654 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ 2024-09-21T05:51:22.655 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/am33xx-usb.txt 2024-09-21T05:51:22.658 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/atmel-usb.txt 2024-09-21T05:51:22.660 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-imx.txt 2024-09-21T05:51:22.662 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-qcom.txt 2024-09-21T05:51:22.665 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-usb2.txt 2024-09-21T05:51:22.667 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-zevio.txt 2024-09-21T05:51:22.670 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc2.txt 2024-09-21T05:51:22.673 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3-st.txt 2024-09-21T05:51:22.675 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3.txt 2024-09-21T05:51:22.678 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-omap.txt 2024-09-21T05:51:22.681 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-orion.txt 2024-09-21T05:51:22.683 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-st.txt 2024-09-21T05:51:22.686 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/exynos-usb.txt 2024-09-21T05:51:22.689 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/fsl-usb.txt 2024-09-21T05:51:22.691 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/generic.txt 2024-09-21T05:51:22.694 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/gr-udc.txt 2024-09-21T05:51:22.696 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/isp1301.txt 2024-09-21T05:51:22.699 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-phy.txt 2024-09-21T05:51:22.701 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-usb.txt 2024-09-21T05:51:22.703 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/lpc32xx-udc.txt 2024-09-21T05:51:22.705 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/msm-hsusb.txt 2024-09-21T05:51:22.708 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/mxs-phy.txt 2024-09-21T05:51:22.710 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-ehci.txt 2024-09-21T05:51:22.713 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-usb-phy.txt 2024-09-21T05:51:22.715 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-nxp.txt 2024-09-21T05:51:22.718 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-omap3.txt 2024-09-21T05:51:22.720 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-st.txt 2024-09-21T05:51:22.722 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/omap-usb.txt 2024-09-21T05:51:22.725 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/pxa-usb.txt 2024-09-21T05:51:22.727 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/qcom,dwc3.txt 2024-09-21T05:51:22.730 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/renesas_usbhs.txt 2024-09-21T05:51:22.732 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-hsotg.txt 2024-09-21T05:51:22.735 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-usbphy.txt 2024-09-21T05:51:22.737 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/spear-usb.txt 2024-09-21T05:51:22.740 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/twlxxxx-usb.txt 2024-09-21T05:51:22.742 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/udc-xilinx.txt 2024-09-21T05:51:22.744 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:22 smithi070 ceph-mon[30981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:51:22.745 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ehci.txt 2024-09-21T05:51:22.747 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-nop-xceiv.txt 2024-09-21T05:51:22.749 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ohci.txt 2024-09-21T05:51:22.751 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-uhci.txt 2024-09-21T05:51:22.754 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-xhci.txt 2024-09-21T05:51:22.756 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb3503.txt 2024-09-21T05:51:22.759 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usbmisc-imx.txt 2024-09-21T05:51:22.762 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ux500-usb.txt 2024-09-21T05:51:22.764 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/vendor-prefixes.txt 2024-09-21T05:51:22.767 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ 2024-09-21T05:51:22.776 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7123.txt 2024-09-21T05:51:22.839 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7511.txt 2024-09-21T05:51:22.842 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/analog-tv-connector.txt 2024-09-21T05:51:22.844 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/arm,pl11x.txt 2024-09-21T05:51:22.847 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/atmel,lcdc.txt 2024-09-21T05:51:22.850 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/ 2024-09-21T05:51:22.852 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/88pm860x.txt 2024-09-21T05:51:22.854 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/gpio-backlight.txt 2024-09-21T05:51:22.856 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/lp855x.txt 2024-09-21T05:51:22.859 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/max8925-backlight.txt 2024-09-21T05:51:22.861 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/pwm-backlight.txt 2024-09-21T05:51:22.863 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/tps65217-backlight.txt 2024-09-21T05:51:22.866 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ 2024-09-21T05:51:22.869 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ps8622.txt 2024-09-21T05:51:22.871 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ptn3460.txt 2024-09-21T05:51:22.873 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/cirrus,clps711x-fb.txt 2024-09-21T05:51:22.877 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/display-timing.txt 2024-09-21T05:51:22.880 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dvi-connector.txt 2024-09-21T05:51:22.882 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dw_hdmi-rockchip.txt 2024-09-21T05:51:22.885 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos7-decon.txt 2024-09-21T05:51:22.888 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dp.txt 2024-09-21T05:51:22.890 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dsim.txt 2024-09-21T05:51:22.893 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmi.txt 2024-09-21T05:51:22.896 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiddc.txt 2024-09-21T05:51:22.898 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiphy.txt 2024-09-21T05:51:22.901 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_mixer.txt 2024-09-21T05:51:22.903 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/fsl,imx-fb.txt 2024-09-21T05:51:22.905 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/hdmi-connector.txt 2024-09-21T05:51:22.907 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/lgphilips,lb035q02.txt 2024-09-21T05:51:22.910 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dpi.txt 2024-09-21T05:51:22.912 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dsi-cm.txt 2024-09-21T05:51:22.915 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/renesas,du.txt 2024-09-21T05:51:22.917 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-drm.txt 2024-09-21T05:51:22.919 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-vop.txt 2024-09-21T05:51:23.193 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/samsung-fimd.txt 2024-09-21T05:51:23.196 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sharp,ls037v7dw01.txt 2024-09-21T05:51:23.199 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer-sunxi.txt 2024-09-21T05:51:23.201 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer.txt 2024-09-21T05:51:23.204 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sony,acx565akm.txt 2024-09-21T05:51:23.206 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1289fb.txt 2024-09-21T05:51:23.208 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1307fb.txt 2024-09-21T05:51:23.211 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/thine,thc63lvdm83d 2024-09-21T05:51:23.214 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,dra7-dss.txt 2024-09-21T05:51:23.216 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap-dss.txt 2024-09-21T05:51:23.218 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap2-dss.txt 2024-09-21T05:51:23.221 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap3-dss.txt 2024-09-21T05:51:23.223 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap4-dss.txt 2024-09-21T05:51:23.226 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap5-dss.txt 2024-09-21T05:51:23.229 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,opa362.txt 2024-09-21T05:51:23.232 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tfp410.txt 2024-09-21T05:51:23.234 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tpd12s015.txt 2024-09-21T05:51:23.237 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/toppoly,td028ttec1.txt 2024-09-21T05:51:23.240 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/tpo,td043mtea1.txt 2024-09-21T05:51:23.243 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/vga-connector.txt 2024-09-21T05:51:23.246 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/via,vt8500-fb.txt 2024-09-21T05:51:23.248 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,prizm-ge-rops.txt 2024-09-21T05:51:23.251 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,wm8505-fb.txt 2024-09-21T05:51:23.254 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/ 2024-09-21T05:51:23.256 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/mmio.txt 2024-09-21T05:51:23.258 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/ 2024-09-21T05:51:23.261 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/fsl-imx-owire.txt 2024-09-21T05:51:23.264 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/omap-hdq.txt 2024-09-21T05:51:23.267 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/w1-gpio.txt 2024-09-21T05:51:23.270 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ 2024-09-21T05:51:23.272 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-at91rm9200-wdt.txt 2024-09-21T05:51:23.275 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-wdt.txt 2024-09-21T05:51:23.277 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/brcm,bcm2835-pm-wdog.txt 2024-09-21T05:51:23.280 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/cadence-wdt.txt 2024-09-21T05:51:23.282 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/davinci-wdt.txt 2024-09-21T05:51:23.285 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/dw_wdt.txt 2024-09-21T05:51:23.287 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/fsl-imx-wdt.txt 2024-09-21T05:51:23.290 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/gpio-wdt.txt 2024-09-21T05:51:23.292 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/imgpdc-wdt.txt 2024-09-21T05:51:23.294 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ingenic,jz4740-wdt.txt 2024-09-21T05:51:23.296 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/marvel.txt 2024-09-21T05:51:23.299 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/men-a021-wdt.txt 2024-09-21T05:51:23.302 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/meson6-wdt.txt 2024-09-21T05:51:23.304 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/moxa,moxart-watchdog.txt 2024-09-21T05:51:23.307 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/mtk-wdt.txt 2024-09-21T05:51:23.308 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/of-xilinx-wdt.txt 2024-09-21T05:51:23.311 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/omap-wdt.txt 2024-09-21T05:51:23.313 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/pnx4008-wdt.txt 2024-09-21T05:51:23.315 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qca-ar7130-wdt.txt 2024-09-21T05:51:23.318 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qcom-wdt.txt 2024-09-21T05:51:23.321 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/rt2880-wdt.txt 2024-09-21T05:51:23.323 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/samsung-wdt.txt 2024-09-21T05:51:23.325 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sirfsoc_wdt.txt 2024-09-21T05:51:23.328 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/stericsson-coh901327.txt 2024-09-21T05:51:23.330 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sunxi-wdt.txt 2024-09-21T05:51:23.333 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/twl4030-wdt.txt 2024-09-21T05:51:23.335 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ 2024-09-21T05:51:23.337 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ce4100.txt 2024-09-21T05:51:23.339 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/interrupt.txt 2024-09-21T05:51:23.342 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/timer.txt 2024-09-21T05:51:23.344 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/xilinx.txt 2024-09-21T05:51:23.347 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/ 2024-09-21T05:51:23.349 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/xillybus.txt 2024-09-21T05:51:23.351 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/booting-without-of.txt 2024-09-21T05:51:23.356 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/changesets.txt 2024-09-21T05:51:23.358 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/dynamic-resolution-notes.txt 2024-09-21T05:51:23.361 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/of_selftest.txt 2024-09-21T05:51:23.363 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/overlay-notes.txt 2024-09-21T05:51:23.366 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/todo.txt 2024-09-21T05:51:23.368 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/usage-model.txt 2024-09-21T05:51:23.371 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/digsig.txt 2024-09-21T05:51:23.374 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dma-buf-sharing.txt 2024-09-21T05:51:23.378 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dmaengine/ 2024-09-21T05:51:23.379 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dmaengine/00-INDEX 2024-09-21T05:51:23.381 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dmaengine/client.txt 2024-09-21T05:51:23.384 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dmaengine/dmatest.txt 2024-09-21T05:51:23.386 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dmaengine/provider.txt 2024-09-21T05:51:23.389 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dontdiff 2024-09-21T05:51:23.392 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/ 2024-09-21T05:51:23.394 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/binding.txt 2024-09-21T05:51:23.396 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/bus.txt 2024-09-21T05:51:23.399 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/class.txt 2024-09-21T05:51:23.401 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/design-patterns.txt 2024-09-21T05:51:23.403 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/device.txt 2024-09-21T05:51:23.405 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/devres.txt 2024-09-21T05:51:23.408 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/driver.txt 2024-09-21T05:51:23.410 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/overview.txt 2024-09-21T05:51:23.412 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/platform.txt 2024-09-21T05:51:23.415 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/porting.txt 2024-09-21T05:51:23.417 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/ 2024-09-21T05:51:23.420 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/README.dvb-usb 2024-09-21T05:51:23.423 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/avermedia.txt 2024-09-21T05:51:23.425 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/bt8xx.txt 2024-09-21T05:51:23.428 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/cards.txt 2024-09-21T05:51:23.430 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/ci.txt 2024-09-21T05:51:23.432 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/contributors.txt 2024-09-21T05:51:23.434 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/faq.txt 2024-09-21T05:51:23.436 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/get_dvb_firmware 2024-09-21T05:51:23.440 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/lmedm04.txt 2024-09-21T05:51:23.442 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/opera-firmware.txt 2024-09-21T05:51:23.444 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/readme.txt 2024-09-21T05:51:23.446 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/technisat.txt 2024-09-21T05:51:23.449 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/ttusb-dec.txt 2024-09-21T05:51:23.451 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/udev.txt 2024-09-21T05:51:23.453 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dynamic-debug-howto.txt 2024-09-21T05:51:23.457 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/early-userspace/ 2024-09-21T05:51:23.459 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/early-userspace/README 2024-09-21T05:51:23.462 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/early-userspace/buffer-format.txt 2024-09-21T05:51:23.464 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/edac.txt 2024-09-21T05:51:23.468 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/efi-stub.txt 2024-09-21T05:51:23.471 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/eisa.txt 2024-09-21T05:51:23.474 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/email-clients.txt 2024-09-21T05:51:23.477 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/extcon/ 2024-09-21T05:51:23.480 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/extcon/porting-android-switch-class 2024-09-21T05:51:23.481 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fault-injection/ 2024-09-21T05:51:23.484 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fault-injection/fault-injection.txt 2024-09-21T05:51:23.486 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fault-injection/notifier-error-inject.txt 2024-09-21T05:51:23.488 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fault-injection/provoke-crashes.txt 2024-09-21T05:51:23.490 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/ 2024-09-21T05:51:23.493 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/00-INDEX 2024-09-21T05:51:23.495 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/api.txt 2024-09-21T05:51:23.497 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/arkfb.txt 2024-09-21T05:51:23.500 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/aty128fb.txt 2024-09-21T05:51:23.502 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/cirrusfb.txt 2024-09-21T05:51:23.504 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/cmap_xfbdev.txt 2024-09-21T05:51:23.506 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/deferred_io.txt 2024-09-21T05:51:23.509 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/efifb.txt 2024-09-21T05:51:23.511 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/ep93xx-fb.txt 2024-09-21T05:51:23.513 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/fbcon.txt 2024-09-21T05:51:23.516 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/framebuffer.txt 2024-09-21T05:51:23.518 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/gxfb.txt 2024-09-21T05:51:23.521 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/intel810.txt 2024-09-21T05:51:23.523 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/intelfb.txt 2024-09-21T05:51:23.525 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/internals.txt 2024-09-21T05:51:23.528 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/lxfb.txt 2024-09-21T05:51:23.531 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/matroxfb.txt 2024-09-21T05:51:23.533 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/metronomefb.txt 2024-09-21T05:51:23.535 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/modedb.txt 2024-09-21T05:51:23.538 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/pvr2fb.txt 2024-09-21T05:51:23.540 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/pxafb.txt 2024-09-21T05:51:23.542 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/s3fb.txt 2024-09-21T05:51:23.544 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/sa1100fb.txt 2024-09-21T05:51:23.547 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/sh7760fb.txt 2024-09-21T05:51:23.549 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/sisfb.txt 2024-09-21T05:51:23.552 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/sm501.txt 2024-09-21T05:51:23.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:23 smithi116 ceph-mon[34332]: pgmap v427: 129 pgs: 129 active+clean; 87 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 228 KiB/s wr, 54 op/s 2024-09-21T05:51:23.555 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/sstfb.txt 2024-09-21T05:51:23.557 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/tgafb.txt 2024-09-21T05:51:23.560 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/tridentfb.txt 2024-09-21T05:51:23.562 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/udlfb.txt 2024-09-21T05:51:23.564 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/uvesafb.txt 2024-09-21T05:51:23.567 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/vesafb.txt 2024-09-21T05:51:23.569 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/viafb.modes 2024-09-21T05:51:23.572 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/viafb.txt 2024-09-21T05:51:23.575 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/vt8623fb.txt 2024-09-21T05:51:23.577 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ 2024-09-21T05:51:23.581 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/.gitignore 2024-09-21T05:51:23.583 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/00-INDEX 2024-09-21T05:51:23.585 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/9p.txt 2024-09-21T05:51:23.587 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/Locking 2024-09-21T05:51:23.589 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/Makefile 2024-09-21T05:51:23.591 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/adfs.txt 2024-09-21T05:51:23.594 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/affs.txt 2024-09-21T05:51:23.596 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/afs.txt 2024-09-21T05:51:23.598 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/autofs4-mount-control.txt 2024-09-21T05:51:23.601 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/autofs4.txt 2024-09-21T05:51:23.604 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/automount-support.txt 2024-09-21T05:51:23.606 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/befs.txt 2024-09-21T05:51:23.608 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/bfs.txt 2024-09-21T05:51:23.610 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/btrfs.txt 2024-09-21T05:51:23.613 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/caching/ 2024-09-21T05:51:23.614 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/caching/backend-api.txt 2024-09-21T05:51:23.617 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/caching/cachefiles.txt 2024-09-21T05:51:23.620 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/caching/fscache.txt 2024-09-21T05:51:23.622 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/caching/netfs-api.txt 2024-09-21T05:51:23.626 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/caching/object.txt 2024-09-21T05:51:23.629 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/caching/operations.txt 2024-09-21T05:51:23.631 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ceph.txt 2024-09-21T05:51:23.635 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/cifs/ 2024-09-21T05:51:23.636 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/cifs/AUTHORS 2024-09-21T05:51:23.638 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/cifs/CHANGES 2024-09-21T05:51:23.641 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/cifs/README 2024-09-21T05:51:23.645 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/cifs/TODO 2024-09-21T05:51:23.647 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/cifs/cifs.txt 2024-09-21T05:51:23.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:23 smithi160 ceph-mon[33979]: pgmap v427: 129 pgs: 129 active+clean; 87 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 228 KiB/s wr, 54 op/s 2024-09-21T05:51:23.650 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/cifs/winucase_convert.pl 2024-09-21T05:51:23.652 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/coda.txt 2024-09-21T05:51:23.656 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/configfs/ 2024-09-21T05:51:23.658 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/configfs/Makefile 2024-09-21T05:51:23.660 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs.txt 2024-09-21T05:51:23.663 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_explicit.c 2024-09-21T05:51:23.666 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_macros.c 2024-09-21T05:51:23.669 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/cramfs.txt 2024-09-21T05:51:23.671 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/dax.txt 2024-09-21T05:51:23.674 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/debugfs.txt 2024-09-21T05:51:23.677 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/devpts.txt 2024-09-21T05:51:23.679 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/directory-locking 2024-09-21T05:51:23.682 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/dlmfs.txt 2024-09-21T05:51:23.684 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/dnotify.txt 2024-09-21T05:51:23.686 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/dnotify_test.c 2024-09-21T05:51:23.689 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ecryptfs.txt 2024-09-21T05:51:23.691 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/efivarfs.txt 2024-09-21T05:51:23.693 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/exofs.txt 2024-09-21T05:51:23.696 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ext2.txt 2024-09-21T05:51:23.698 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ext3.txt 2024-09-21T05:51:23.701 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ext4.txt 2024-09-21T05:51:23.703 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/f2fs.txt 2024-09-21T05:51:23.706 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/fiemap.txt 2024-09-21T05:51:23.709 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/files.txt 2024-09-21T05:51:23.711 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/fuse.txt 2024-09-21T05:51:23.714 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/gfs2-glocks.txt 2024-09-21T05:51:23.716 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/gfs2-uevents.txt 2024-09-21T05:51:23.719 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/gfs2.txt 2024-09-21T05:51:23.721 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/hfs.txt 2024-09-21T05:51:23.723 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/hfsplus.txt 2024-09-21T05:51:23.726 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/hpfs.txt 2024-09-21T05:51:23.728 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/inotify.txt 2024-09-21T05:51:23.731 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/isofs.txt 2024-09-21T05:51:23.733 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/jfs.txt 2024-09-21T05:51:23.736 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/locks.txt 2024-09-21T05:51:23.738 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/logfs.txt 2024-09-21T05:51:23.741 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/mandatory-locking.txt 2024-09-21T05:51:23.743 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ncpfs.txt 2024-09-21T05:51:23.744 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:23 smithi070 ceph-mon[30981]: pgmap v427: 129 pgs: 129 active+clean; 87 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 228 KiB/s wr, 54 op/s 2024-09-21T05:51:23.745 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/ 2024-09-21T05:51:23.747 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/00-INDEX 2024-09-21T05:51:23.749 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/Exporting 2024-09-21T05:51:23.752 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/fault_injection.txt 2024-09-21T05:51:23.754 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/idmapper.txt 2024-09-21T05:51:23.757 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/knfsd-stats.txt 2024-09-21T05:51:23.759 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs-rdma.txt 2024-09-21T05:51:23.761 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs.txt 2024-09-21T05:51:23.764 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs41-server.txt 2024-09-21T05:51:23.766 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsd-admin-interfaces.txt 2024-09-21T05:51:23.769 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsroot.txt 2024-09-21T05:51:23.771 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs-block-server.txt 2024-09-21T05:51:23.774 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs.txt 2024-09-21T05:51:23.795 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-cache.txt 2024-09-21T05:51:23.914 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-server-gss.txt 2024-09-21T05:51:23.916 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nilfs2.txt 2024-09-21T05:51:23.919 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ntfs.txt 2024-09-21T05:51:23.922 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ocfs2.txt 2024-09-21T05:51:23.924 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/omfs.txt 2024-09-21T05:51:23.926 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/overlayfs.txt 2024-09-21T05:51:23.929 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/path-lookup.txt 2024-09-21T05:51:23.932 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/ 2024-09-21T05:51:23.934 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/design_notes.txt 2024-09-21T05:51:23.936 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/info.txt 2024-09-21T05:51:23.938 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/network_protocol.txt 2024-09-21T05:51:23.941 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/porting 2024-09-21T05:51:23.944 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/proc.txt 2024-09-21T05:51:23.948 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/qnx6.txt 2024-09-21T05:51:23.951 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/quota.txt 2024-09-21T05:51:23.954 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ramfs-rootfs-initramfs.txt 2024-09-21T05:51:23.956 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/relay.txt 2024-09-21T05:51:23.959 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/romfs.txt 2024-09-21T05:51:23.962 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/seq_file.txt 2024-09-21T05:51:23.964 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/sharedsubtree.txt 2024-09-21T05:51:23.967 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/spufs.txt 2024-09-21T05:51:23.970 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/squashfs.txt 2024-09-21T05:51:23.972 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/sysfs-pci.txt 2024-09-21T05:51:23.975 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/sysfs-tagging.txt 2024-09-21T05:51:23.977 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/sysfs.txt 2024-09-21T05:51:23.980 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/sysv-fs.txt 2024-09-21T05:51:23.982 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/tmpfs.txt 2024-09-21T05:51:23.985 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ubifs.txt 2024-09-21T05:51:23.987 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/udf.txt 2024-09-21T05:51:23.989 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ufs.txt 2024-09-21T05:51:23.991 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/vfat.txt 2024-09-21T05:51:23.993 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/vfs.txt 2024-09-21T05:51:23.997 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/xfs-delayed-logging-design.txt 2024-09-21T05:51:24.000 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/xfs-self-describing-metadata.txt 2024-09-21T05:51:24.003 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/xfs.txt 2024-09-21T05:51:24.006 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/firmware_class/ 2024-09-21T05:51:24.008 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/firmware_class/README 2024-09-21T05:51:24.010 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/firmware_class/hotplug-script 2024-09-21T05:51:24.012 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/flexible-arrays.txt 2024-09-21T05:51:24.016 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/ 2024-09-21T05:51:24.019 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/00-INDEX 2024-09-21T05:51:24.022 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/API.txt 2024-09-21T05:51:24.024 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/FMC-and-SDB.txt 2024-09-21T05:51:24.027 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/carrier.txt 2024-09-21T05:51:24.030 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/fmc-chardev.txt 2024-09-21T05:51:24.032 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/fmc-fakedev.txt 2024-09-21T05:51:24.034 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/fmc-trivial.txt 2024-09-21T05:51:24.037 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/fmc-write-eeprom.txt 2024-09-21T05:51:24.039 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/identifiers.txt 2024-09-21T05:51:24.042 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/mezzanine.txt 2024-09-21T05:51:24.044 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/parameters.txt 2024-09-21T05:51:24.046 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/ 2024-09-21T05:51:24.049 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/README.txt 2024-09-21T05:51:24.052 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/atomic-ops.txt 2024-09-21T05:51:24.054 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/booting.txt 2024-09-21T05:51:24.057 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/clock.txt 2024-09-21T05:51:24.059 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/configuring.txt 2024-09-21T05:51:24.061 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/features.txt 2024-09-21T05:51:24.064 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/gdbinit 2024-09-21T05:51:24.066 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/gdbstub.txt 2024-09-21T05:51:24.069 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/kernel-ABI.txt 2024-09-21T05:51:24.071 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/mmu-layout.txt 2024-09-21T05:51:24.073 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/futex-requeue-pi.txt 2024-09-21T05:51:24.077 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gcov.txt 2024-09-21T05:51:24.080 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gdb-kernel-debugging.txt 2024-09-21T05:51:24.083 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gpio/ 2024-09-21T05:51:24.085 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gpio/00-INDEX 2024-09-21T05:51:24.088 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gpio/board.txt 2024-09-21T05:51:24.091 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gpio/consumer.txt 2024-09-21T05:51:24.093 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gpio/driver.txt 2024-09-21T05:51:24.096 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gpio/gpio-legacy.txt 2024-09-21T05:51:24.099 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gpio/gpio.txt 2024-09-21T05:51:24.101 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gpio/sysfs.txt 2024-09-21T05:51:24.103 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hid/ 2024-09-21T05:51:24.106 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hid/hid-sensor.txt 2024-09-21T05:51:24.108 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hid/hid-transport.txt 2024-09-21T05:51:24.111 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hid/hiddev.txt 2024-09-21T05:51:24.113 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hid/hidraw.txt 2024-09-21T05:51:24.116 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hid/uhid.txt 2024-09-21T05:51:24.119 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/highuid.txt 2024-09-21T05:51:24.122 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hsi.txt 2024-09-21T05:51:24.125 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hw_random.txt 2024-09-21T05:51:24.128 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ 2024-09-21T05:51:24.130 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ab8500 2024-09-21T05:51:24.133 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/abituguru 2024-09-21T05:51:24.136 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/abituguru-datasheet 2024-09-21T05:51:24.138 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/abituguru3 2024-09-21T05:51:24.141 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/abx500 2024-09-21T05:51:24.143 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/acpi_power_meter 2024-09-21T05:51:24.145 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ad7314 2024-09-21T05:51:24.148 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adc128d818 2024-09-21T05:51:24.150 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adm1021 2024-09-21T05:51:24.152 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adm1025 2024-09-21T05:51:24.155 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adm1026 2024-09-21T05:51:24.157 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adm1031 2024-09-21T05:51:24.159 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adm1275 2024-09-21T05:51:24.162 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adm9240 2024-09-21T05:51:24.164 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ads1015 2024-09-21T05:51:24.166 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ads7828 2024-09-21T05:51:24.168 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adt7410 2024-09-21T05:51:24.170 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adt7411 2024-09-21T05:51:24.172 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adt7462 2024-09-21T05:51:24.174 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adt7470 2024-09-21T05:51:24.177 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adt7475 2024-09-21T05:51:24.179 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/amc6821 2024-09-21T05:51:24.182 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/asb100 2024-09-21T05:51:24.184 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/asc7621 2024-09-21T05:51:24.186 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/coretemp 2024-09-21T05:51:24.188 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/da9052 2024-09-21T05:51:24.191 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/da9055 2024-09-21T05:51:24.193 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/dme1737 2024-09-21T05:51:24.196 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ds1621 2024-09-21T05:51:24.198 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ds620 2024-09-21T05:51:24.200 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/emc1403 2024-09-21T05:51:24.203 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/emc2103 2024-09-21T05:51:24.205 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/emc6w201 2024-09-21T05:51:24.207 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/f71805f 2024-09-21T05:51:24.209 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/f71882fg 2024-09-21T05:51:24.212 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/fam15h_power 2024-09-21T05:51:24.214 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/g760a 2024-09-21T05:51:24.216 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/g762 2024-09-21T05:51:24.219 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/gl518sm 2024-09-21T05:51:24.221 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/hih6130 2024-09-21T05:51:24.223 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/htu21 2024-09-21T05:51:24.225 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/hwmon-kernel-api.txt 2024-09-21T05:51:24.227 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ibmaem 2024-09-21T05:51:24.230 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ibmpowernv 2024-09-21T05:51:24.232 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ina209 2024-09-21T05:51:24.234 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ina2xx 2024-09-21T05:51:24.237 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/it87 2024-09-21T05:51:24.239 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/jc42 2024-09-21T05:51:24.241 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/k10temp 2024-09-21T05:51:24.243 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/k8temp 2024-09-21T05:51:24.245 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lineage-pem 2024-09-21T05:51:24.248 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm25066 2024-09-21T05:51:24.250 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm63 2024-09-21T05:51:24.252 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm70 2024-09-21T05:51:24.254 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm73 2024-09-21T05:51:24.256 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm75 2024-09-21T05:51:24.259 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm77 2024-09-21T05:51:24.261 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm78 2024-09-21T05:51:24.263 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm80 2024-09-21T05:51:24.266 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm83 2024-09-21T05:51:24.268 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm85 2024-09-21T05:51:24.271 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm87 2024-09-21T05:51:24.273 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm90 2024-09-21T05:51:24.276 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm92 2024-09-21T05:51:24.278 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm93 2024-09-21T05:51:24.281 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm95234 2024-09-21T05:51:24.283 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm95245 2024-09-21T05:51:24.285 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ltc2945 2024-09-21T05:51:24.288 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ltc2978 2024-09-21T05:51:24.290 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ltc4151 2024-09-21T05:51:24.292 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ltc4215 2024-09-21T05:51:24.294 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ltc4245 2024-09-21T05:51:24.296 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ltc4260 2024-09-21T05:51:24.299 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ltc4261 2024-09-21T05:51:24.301 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max16064 2024-09-21T05:51:24.303 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max16065 2024-09-21T05:51:24.306 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max1619 2024-09-21T05:51:24.308 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max1668 2024-09-21T05:51:24.311 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max197 2024-09-21T05:51:24.313 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max34440 2024-09-21T05:51:24.315 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max6639 2024-09-21T05:51:24.317 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max6642 2024-09-21T05:51:24.320 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max6650 2024-09-21T05:51:24.322 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max6697 2024-09-21T05:51:24.325 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max8688 2024-09-21T05:51:24.327 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/mc13783-adc 2024-09-21T05:51:24.329 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/mcp3021 2024-09-21T05:51:24.331 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/menf21bmc 2024-09-21T05:51:24.334 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/nct6683 2024-09-21T05:51:24.336 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/nct6775 2024-09-21T05:51:24.338 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/nct7802 2024-09-21T05:51:24.341 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ntc_thermistor 2024-09-21T05:51:24.343 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/pc87360 2024-09-21T05:51:24.345 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/pc87427 2024-09-21T05:51:24.348 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/pcf8591 2024-09-21T05:51:24.350 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/pmbus 2024-09-21T05:51:24.352 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/pmbus-core 2024-09-21T05:51:24.355 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/powr1220 2024-09-21T05:51:24.357 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/pwm-fan 2024-09-21T05:51:24.362 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/sch5627 2024-09-21T05:51:24.362 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/sch5636 2024-09-21T05:51:24.364 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/sht15 2024-09-21T05:51:24.366 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/sht21 2024-09-21T05:51:24.368 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/shtc1 2024-09-21T05:51:24.371 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/sis5595 2024-09-21T05:51:24.373 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/smm665 2024-09-21T05:51:24.376 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/smsc47b397 2024-09-21T05:51:24.378 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/smsc47m1 2024-09-21T05:51:24.380 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/smsc47m192 2024-09-21T05:51:24.383 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/submitting-patches 2024-09-21T05:51:24.385 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/sysfs-interface 2024-09-21T05:51:24.388 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/thmc50 2024-09-21T05:51:24.390 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/tmp102 2024-09-21T05:51:24.393 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/tmp103 2024-09-21T05:51:24.395 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/tmp401 2024-09-21T05:51:24.397 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/tmp421 2024-09-21T05:51:24.399 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/tps40422 2024-09-21T05:51:24.402 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/twl4030-madc-hwmon 2024-09-21T05:51:24.404 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ucd9000 2024-09-21T05:51:24.407 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ucd9200 2024-09-21T05:51:24.409 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/userspace-tools 2024-09-21T05:51:24.411 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/vexpress 2024-09-21T05:51:24.413 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/via686a 2024-09-21T05:51:24.415 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/vt1211 2024-09-21T05:51:24.418 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83627ehf 2024-09-21T05:51:24.420 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83627hf 2024-09-21T05:51:24.423 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83781d 2024-09-21T05:51:24.425 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83791d 2024-09-21T05:51:24.428 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83792d 2024-09-21T05:51:24.430 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83793 2024-09-21T05:51:24.433 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83795 2024-09-21T05:51:24.435 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83l785ts 2024-09-21T05:51:24.437 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83l786ng 2024-09-21T05:51:24.439 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/wm831x 2024-09-21T05:51:24.441 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/wm8350 2024-09-21T05:51:24.444 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/zl6100 2024-09-21T05:51:24.446 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwspinlock.txt 2024-09-21T05:51:24.451 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/ 2024-09-21T05:51:24.453 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/ 2024-09-21T05:51:24.455 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1535 2024-09-21T05:51:24.457 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1563 2024-09-21T05:51:24.459 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali15x3 2024-09-21T05:51:24.461 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd756 2024-09-21T05:51:24.463 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd8111 2024-09-21T05:51:24.466 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-diolan-u2c 2024-09-21T05:51:24.468 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-i801 2024-09-21T05:51:24.470 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ismt 2024-09-21T05:51:24.473 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-nforce2 2024-09-21T05:51:24.475 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ocores 2024-09-21T05:51:24.477 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport 2024-09-21T05:51:24.480 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport-light 2024-09-21T05:51:24.482 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-pca-isa 2024-09-21T05:51:24.485 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-piix4 2024-09-21T05:51:24.487 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis5595 2024-09-21T05:51:24.489 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis630 2024-09-21T05:51:24.491 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis96x 2024-09-21T05:51:24.494 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-taos-evm 2024-09-21T05:51:24.496 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-via 2024-09-21T05:51:24.498 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-viapro 2024-09-21T05:51:24.500 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/scx200_acb 2024-09-21T05:51:24.502 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/dev-interface 2024-09-21T05:51:24.505 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/fault-codes 2024-09-21T05:51:24.507 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/functionality 2024-09-21T05:51:24.509 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/i2c-protocol 2024-09-21T05:51:24.512 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/i2c-stub 2024-09-21T05:51:24.514 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/instantiating-devices 2024-09-21T05:51:24.516 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/muxes/ 2024-09-21T05:51:24.518 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/muxes/i2c-mux-gpio 2024-09-21T05:51:24.520 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/old-module-parameters 2024-09-21T05:51:24.523 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/smbus-protocol 2024-09-21T05:51:24.525 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/summary 2024-09-21T05:51:24.527 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/ten-bit-addresses 2024-09-21T05:51:24.530 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/upgrading-clients 2024-09-21T05:51:24.532 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/writing-clients 2024-09-21T05:51:24.535 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2o/ 2024-09-21T05:51:24.538 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2o/README 2024-09-21T05:51:24.540 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2o/ioctl 2024-09-21T05:51:24.543 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/ 2024-09-21T05:51:24.545 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/.gitignore 2024-09-21T05:51:24.547 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/IRQ-redir.txt 2024-09-21T05:51:24.550 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/Makefile 2024-09-21T05:51:24.552 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/README 2024-09-21T05:51:24.555 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/aliasing-test.c 2024-09-21T05:51:24.557 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/aliasing.txt 2024-09-21T05:51:24.880 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/efirtc.txt 2024-09-21T05:51:24.996 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/err_inject.txt 2024-09-21T05:51:24.999 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/fsys.txt 2024-09-21T05:51:25.001 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/mca.txt 2024-09-21T05:51:25.004 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/serial.txt 2024-09-21T05:51:25.006 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/xen.txt 2024-09-21T05:51:25.008 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ide/ 2024-09-21T05:51:25.012 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ide/00-INDEX 2024-09-21T05:51:25.014 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-cd.1994-2004 2024-09-21T05:51:25.017 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-floppy.1996-2002 2024-09-21T05:51:25.019 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-tape.1995-2002 2024-09-21T05:51:25.022 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ide/ide-tape.txt 2024-09-21T05:51:25.024 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ide/ide.txt 2024-09-21T05:51:25.027 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ide/warm-plug-howto.txt 2024-09-21T05:51:25.029 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/infiniband/ 2024-09-21T05:51:25.031 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/infiniband/core_locking.txt 2024-09-21T05:51:25.033 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/infiniband/ipoib.txt 2024-09-21T05:51:25.036 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/infiniband/sysfs.txt 2024-09-21T05:51:25.038 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/infiniband/user_mad.txt 2024-09-21T05:51:25.040 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/infiniband/user_verbs.txt 2024-09-21T05:51:25.042 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/init.txt 2024-09-21T05:51:25.046 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/initrd.txt 2024-09-21T05:51:25.049 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/ 2024-09-21T05:51:25.051 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/alps.txt 2024-09-21T05:51:25.053 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/amijoy.txt 2024-09-21T05:51:25.056 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/appletouch.txt 2024-09-21T05:51:25.058 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/atarikbd.txt 2024-09-21T05:51:25.061 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/bcm5974.txt 2024-09-21T05:51:25.063 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/cd32.txt 2024-09-21T05:51:25.065 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/cma3000_d0x.txt 2024-09-21T05:51:25.068 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/cs461x.txt 2024-09-21T05:51:25.070 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/edt-ft5x06.txt 2024-09-21T05:51:25.072 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/elantech.txt 2024-09-21T05:51:25.075 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/event-codes.txt 2024-09-21T05:51:25.077 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/ff.txt 2024-09-21T05:51:25.079 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/gamepad.txt 2024-09-21T05:51:25.082 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/gameport-programming.txt 2024-09-21T05:51:25.085 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/gpio-tilt.txt 2024-09-21T05:51:25.087 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/iforce-protocol.txt 2024-09-21T05:51:25.090 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/input-programming.txt 2024-09-21T05:51:25.092 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/input.txt 2024-09-21T05:51:25.095 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/interactive.fig 2024-09-21T05:51:25.097 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/joystick-api.txt 2024-09-21T05:51:25.100 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/joystick-parport.txt 2024-09-21T05:51:25.103 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/joystick.txt 2024-09-21T05:51:25.105 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/multi-touch-protocol.txt 2024-09-21T05:51:25.108 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/notifier.txt 2024-09-21T05:51:25.110 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/ntrig.txt 2024-09-21T05:51:25.113 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/rotary-encoder.txt 2024-09-21T05:51:25.115 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/sentelic.txt 2024-09-21T05:51:25.118 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/shape.fig 2024-09-21T05:51:25.121 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/walkera0701.txt 2024-09-21T05:51:25.124 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/xpad.txt 2024-09-21T05:51:25.126 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/yealink.txt 2024-09-21T05:51:25.129 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/intel_txt.txt 2024-09-21T05:51:25.133 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/io-mapping.txt 2024-09-21T05:51:25.136 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/io_ordering.txt 2024-09-21T05:51:25.139 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ioctl/ 2024-09-21T05:51:25.141 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ioctl/00-INDEX 2024-09-21T05:51:25.143 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ioctl/botching-up-ioctls.txt 2024-09-21T05:51:25.146 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ioctl/cdrom.txt 2024-09-21T05:51:25.148 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ioctl/hdio.txt 2024-09-21T05:51:25.151 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ioctl/ioctl-decoding.txt 2024-09-21T05:51:25.154 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ioctl/ioctl-number.txt 2024-09-21T05:51:25.157 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/iostats.txt 2024-09-21T05:51:25.161 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/irqflags-tracing.txt 2024-09-21T05:51:25.164 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isapnp.txt 2024-09-21T05:51:25.168 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/ 2024-09-21T05:51:25.170 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/00-INDEX 2024-09-21T05:51:25.173 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/CREDITS 2024-09-21T05:51:25.175 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/HiSax.cert 2024-09-21T05:51:25.177 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/INTERFACE 2024-09-21T05:51:25.180 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.CAPI 2024-09-21T05:51:25.183 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.fax 2024-09-21T05:51:25.185 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README 2024-09-21T05:51:25.189 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.FAQ 2024-09-21T05:51:25.191 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.HiSax 2024-09-21T05:51:25.194 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.act2000 2024-09-21T05:51:25.197 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.audio 2024-09-21T05:51:25.199 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.avmb1 2024-09-21T05:51:25.201 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.concap 2024-09-21T05:51:25.203 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.diversion 2024-09-21T05:51:25.206 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.fax 2024-09-21T05:51:25.208 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.gigaset 2024-09-21T05:51:25.211 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.hfc-pci 2024-09-21T05:51:25.213 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.hysdn 2024-09-21T05:51:25.216 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.icn 2024-09-21T05:51:25.218 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.mISDN 2024-09-21T05:51:25.220 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.pcbit 2024-09-21T05:51:25.223 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.sc 2024-09-21T05:51:25.225 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.syncppp 2024-09-21T05:51:25.227 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.x25 2024-09-21T05:51:25.230 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/syncPPP.FAQ 2024-09-21T05:51:25.232 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ja_JP/ 2024-09-21T05:51:25.235 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ja_JP/HOWTO 2024-09-21T05:51:25.237 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ja_JP/SubmitChecklist 2024-09-21T05:51:25.240 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ja_JP/SubmittingPatches 2024-09-21T05:51:25.243 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ja_JP/stable_api_nonsense.txt 2024-09-21T05:51:25.246 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ja_JP/stable_kernel_rules.txt 2024-09-21T05:51:25.248 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/java.txt 2024-09-21T05:51:25.251 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kasan.txt 2024-09-21T05:51:25.255 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kbuild/ 2024-09-21T05:51:25.257 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kbuild/00-INDEX 2024-09-21T05:51:25.259 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kbuild/headers_install.txt 2024-09-21T05:51:25.261 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kbuild/kbuild.txt 2024-09-21T05:51:25.263 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kbuild/kconfig-language.txt 2024-09-21T05:51:25.266 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kbuild/kconfig.txt 2024-09-21T05:51:25.268 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kbuild/makefiles.txt 2024-09-21T05:51:25.272 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kbuild/modules.txt 2024-09-21T05:51:25.275 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kdump/ 2024-09-21T05:51:25.277 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kdump/gdbmacros.txt 2024-09-21T05:51:25.279 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kdump/kdump.txt 2024-09-21T05:51:25.282 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kernel-doc-nano-HOWTO.txt 2024-09-21T05:51:25.286 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kernel-docs.txt 2024-09-21T05:51:25.289 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kernel-parameters.txt 2024-09-21T05:51:25.296 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kernel-per-CPU-kthreads.txt 2024-09-21T05:51:25.300 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kmemcheck.txt 2024-09-21T05:51:25.303 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kmemleak.txt 2024-09-21T05:51:25.307 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ko_KR/ 2024-09-21T05:51:25.310 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ko_KR/HOWTO 2024-09-21T05:51:25.313 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ko_KR/stable_api_nonsense.txt 2024-09-21T05:51:25.316 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kobject.txt 2024-09-21T05:51:25.321 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kprobes.txt 2024-09-21T05:51:25.325 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kref.txt 2024-09-21T05:51:25.329 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kselftest.txt 2024-09-21T05:51:25.333 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/ 2024-09-21T05:51:25.336 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/.gitignore 2024-09-21T05:51:25.339 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/00-INDEX 2024-09-21T05:51:25.342 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/Makefile 2024-09-21T05:51:25.344 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/asus-laptop.txt 2024-09-21T05:51:25.347 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/disk-shock-protection.txt 2024-09-21T05:51:25.349 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/dslm.c 2024-09-21T05:51:25.352 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/freefall.c 2024-09-21T05:51:25.354 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/laptop-mode.txt 2024-09-21T05:51:25.357 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/sony-laptop.txt 2024-09-21T05:51:25.360 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/sonypi.txt 2024-09-21T05:51:25.363 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/thinkpad-acpi.txt 2024-09-21T05:51:25.367 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/toshiba_haps.txt 2024-09-21T05:51:25.369 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ldm.txt 2024-09-21T05:51:25.374 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/ 2024-09-21T05:51:25.377 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/00-INDEX 2024-09-21T05:51:25.379 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/leds-blinkm.txt 2024-09-21T05:51:25.381 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/leds-class.txt 2024-09-21T05:51:25.383 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/leds-lm3556.txt 2024-09-21T05:51:25.385 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/leds-lp3944.txt 2024-09-21T05:51:25.387 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/leds-lp5521.txt 2024-09-21T05:51:25.389 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/leds-lp5523.txt 2024-09-21T05:51:25.392 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/leds-lp5562.txt 2024-09-21T05:51:25.394 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/leds-lp55xx.txt 2024-09-21T05:51:25.397 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/ledtrig-oneshot.txt 2024-09-21T05:51:25.398 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/ledtrig-transient.txt 2024-09-21T05:51:25.401 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/local_ops.txt 2024-09-21T05:51:25.405 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/ 2024-09-21T05:51:25.407 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/00-INDEX 2024-09-21T05:51:25.409 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/lglock.txt 2024-09-21T05:51:25.411 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/lockdep-design.txt 2024-09-21T05:51:25.413 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/lockstat.txt 2024-09-21T05:51:25.416 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/locktorture.txt 2024-09-21T05:51:25.418 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/mutex-design.txt 2024-09-21T05:51:25.421 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/rt-mutex-design.txt 2024-09-21T05:51:25.424 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/rt-mutex.txt 2024-09-21T05:51:25.426 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/spinlocks.txt 2024-09-21T05:51:25.429 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/ww-mutex-design.txt 2024-09-21T05:51:25.431 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/lockup-watchdogs.txt 2024-09-21T05:51:25.434 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/logo.gif 2024-09-21T05:51:25.438 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/logo.txt 2024-09-21T05:51:25.441 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/lzo.txt 2024-09-21T05:51:25.444 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/m68k/ 2024-09-21T05:51:25.446 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/m68k/00-INDEX 2024-09-21T05:51:25.448 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/m68k/README.buddha 2024-09-21T05:51:25.451 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/m68k/kernel-options.txt 2024-09-21T05:51:25.454 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/magic-number.txt 2024-09-21T05:51:25.457 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mailbox.txt 2024-09-21T05:51:25.460 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/md.txt 2024-09-21T05:51:25.464 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/media-framework.txt 2024-09-21T05:51:25.467 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/memory-barriers.txt 2024-09-21T05:51:25.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:25 smithi116 ceph-mon[34332]: pgmap v428: 129 pgs: 129 active+clean; 91 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 600 KiB/s wr, 123 op/s 2024-09-21T05:51:25.615 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/memory-devices/ 2024-09-21T05:51:25.617 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/memory-devices/ti-emif.txt 2024-09-21T05:51:25.619 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/memory-hotplug.txt 2024-09-21T05:51:25.623 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/metag/ 2024-09-21T05:51:25.625 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/metag/00-INDEX 2024-09-21T05:51:25.628 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/metag/kernel-ABI.txt 2024-09-21T05:51:25.630 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/ 2024-09-21T05:51:25.633 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/Makefile 2024-09-21T05:51:25.635 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mic_overview.txt 2024-09-21T05:51:25.637 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mpssd/ 2024-09-21T05:51:25.640 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mpssd/.gitignore 2024-09-21T05:51:25.641 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mpssd/Makefile 2024-09-21T05:51:25.644 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mpssd/micctrl 2024-09-21T05:51:25.646 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mpssd/mpss 2024-09-21T05:51:25.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:25 smithi160 ceph-mon[33979]: pgmap v428: 129 pgs: 129 active+clean; 91 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 600 KiB/s wr, 123 op/s 2024-09-21T05:51:25.648 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.c 2024-09-21T05:51:25.651 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.h 2024-09-21T05:51:25.654 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mpssd/sysfs.c 2024-09-21T05:51:25.656 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mips/ 2024-09-21T05:51:25.659 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mips/00-INDEX 2024-09-21T05:51:25.661 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mips/AU1xxx_IDE.README 2024-09-21T05:51:25.663 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/ 2024-09-21T05:51:25.666 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/Makefile 2024-09-21T05:51:25.667 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/ad525x_dpot.txt 2024-09-21T05:51:25.670 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/apds990x.txt 2024-09-21T05:51:25.672 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/bh1770glc.txt 2024-09-21T05:51:25.674 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/c2port.txt 2024-09-21T05:51:25.677 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/eeprom 2024-09-21T05:51:25.680 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/ics932s401 2024-09-21T05:51:25.682 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/isl29003 2024-09-21T05:51:25.685 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/lis3lv02d 2024-09-21T05:51:25.687 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/max6875 2024-09-21T05:51:25.689 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/mei/ 2024-09-21T05:51:25.691 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/mei/.gitignore 2024-09-21T05:51:25.693 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/mei/Makefile 2024-09-21T05:51:25.695 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/mei/TODO 2024-09-21T05:51:25.698 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-amt-version.c 2024-09-21T05:51:25.700 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-client-bus.txt 2024-09-21T05:51:25.702 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei.txt 2024-09-21T05:51:25.705 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/spear-pcie-gadget.txt 2024-09-21T05:51:25.708 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mmc/ 2024-09-21T05:51:25.710 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mmc/00-INDEX 2024-09-21T05:51:25.712 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mmc/mmc-async-req.txt 2024-09-21T05:51:25.714 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-attrs.txt 2024-09-21T05:51:25.717 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-parts.txt 2024-09-21T05:51:25.719 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mn10300/ 2024-09-21T05:51:25.721 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mn10300/ABI.txt 2024-09-21T05:51:25.723 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mn10300/compartmentalisation.txt 2024-09-21T05:51:25.725 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/module-signing.txt 2024-09-21T05:51:25.729 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mono.txt 2024-09-21T05:51:25.732 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mtd/ 2024-09-21T05:51:25.734 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mtd/nand/ 2024-09-21T05:51:25.736 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mtd/nand/pxa3xx-nand.txt 2024-09-21T05:51:25.738 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mtd/nand_ecc.txt 2024-09-21T05:51:25.741 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mtd/spi-nor.txt 2024-09-21T05:51:25.743 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/namespaces/ 2024-09-21T05:51:25.744 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:25 smithi070 ceph-mon[30981]: pgmap v428: 129 pgs: 129 active+clean; 91 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 600 KiB/s wr, 123 op/s 2024-09-21T05:51:25.745 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/namespaces/compatibility-list.txt 2024-09-21T05:51:25.747 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/namespaces/resource-control.txt 2024-09-21T05:51:25.749 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/netlabel/ 2024-09-21T05:51:25.752 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/netlabel/00-INDEX 2024-09-21T05:51:25.755 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/netlabel/cipso_ipv4.txt 2024-09-21T05:51:25.757 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/netlabel/draft-ietf-cipso-ipsecurity-01.txt 2024-09-21T05:51:25.760 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/netlabel/introduction.txt 2024-09-21T05:51:25.762 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/netlabel/lsm_interface.txt 2024-09-21T05:51:25.764 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ 2024-09-21T05:51:25.767 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/00-INDEX 2024-09-21T05:51:25.769 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/3c509.txt 2024-09-21T05:51:25.771 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/6pack.txt 2024-09-21T05:51:25.774 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/LICENSE.qla3xxx 2024-09-21T05:51:25.776 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlcnic 2024-09-21T05:51:25.779 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlge 2024-09-21T05:51:25.781 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/Makefile 2024-09-21T05:51:25.783 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/PLIP.txt 2024-09-21T05:51:25.786 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/README.ipw2100 2024-09-21T05:51:25.788 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/README.ipw2200 2024-09-21T05:51:25.791 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/README.sb1000 2024-09-21T05:51:25.793 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/alias.txt 2024-09-21T05:51:25.795 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/altera_tse.txt 2024-09-21T05:51:25.798 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/arcnet-hardware.txt 2024-09-21T05:51:25.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/arcnet.txt 2024-09-21T05:51:25.805 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/atm.txt 2024-09-21T05:51:25.807 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ax25.txt 2024-09-21T05:51:25.809 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/batman-adv.txt 2024-09-21T05:51:25.811 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/baycom.txt 2024-09-21T05:51:25.814 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/bonding.txt 2024-09-21T05:51:25.819 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/bridge.txt 2024-09-21T05:51:25.821 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/caif/ 2024-09-21T05:51:25.823 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/caif/Linux-CAIF.txt 2024-09-21T05:51:25.957 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/caif/README 2024-09-21T05:51:25.959 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/caif/spi_porting.txt 2024-09-21T05:51:25.962 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/can.txt 2024-09-21T05:51:25.966 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/cdc_mbim.txt 2024-09-21T05:51:25.969 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/cops.txt 2024-09-21T05:51:25.971 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/cs89x0.txt 2024-09-21T05:51:25.973 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/cxacru-cf.py 2024-09-21T05:51:25.975 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/cxacru.txt 2024-09-21T05:51:25.978 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/cxgb.txt 2024-09-21T05:51:25.981 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/dccp.txt 2024-09-21T05:51:25.983 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/dctcp.txt 2024-09-21T05:51:25.986 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/de4x5.txt 2024-09-21T05:51:25.988 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/decnet.txt 2024-09-21T05:51:25.991 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/dl2k.txt 2024-09-21T05:51:25.993 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/dm9000.txt 2024-09-21T05:51:25.996 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/dmfe.txt 2024-09-21T05:51:25.998 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/dns_resolver.txt 2024-09-21T05:51:26.001 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/driver.txt 2024-09-21T05:51:26.003 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/e100.txt 2024-09-21T05:51:26.006 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/e1000.txt 2024-09-21T05:51:26.009 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/e1000e.txt 2024-09-21T05:51:26.011 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/eql.txt 2024-09-21T05:51:26.014 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/fib_trie.txt 2024-09-21T05:51:26.016 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/filter.txt 2024-09-21T05:51:26.019 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/fore200e.txt 2024-09-21T05:51:26.021 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/framerelay.txt 2024-09-21T05:51:26.024 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/gen_stats.txt 2024-09-21T05:51:26.026 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/generic-hdlc.txt 2024-09-21T05:51:26.028 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/generic_netlink.txt 2024-09-21T05:51:26.031 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/gianfar.txt 2024-09-21T05:51:26.033 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/i40e.txt 2024-09-21T05:51:26.035 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/i40evf.txt 2024-09-21T05:51:26.038 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ieee802154.txt 2024-09-21T05:51:26.040 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/igb.txt 2024-09-21T05:51:26.043 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/igbvf.txt 2024-09-21T05:51:26.045 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ip-sysctl.txt 2024-09-21T05:51:26.049 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ip_dynaddr.txt 2024-09-21T05:51:26.052 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ipddp.txt 2024-09-21T05:51:26.055 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/iphase.txt 2024-09-21T05:51:26.057 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ipsec.txt 2024-09-21T05:51:26.060 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ipv6.txt 2024-09-21T05:51:26.062 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ipvlan.txt 2024-09-21T05:51:26.065 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ipvs-sysctl.txt 2024-09-21T05:51:26.067 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/irda.txt 2024-09-21T05:51:26.069 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ixgb.txt 2024-09-21T05:51:26.072 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ixgbe.txt 2024-09-21T05:51:26.074 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ixgbevf.txt 2024-09-21T05:51:26.076 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/l2tp.txt 2024-09-21T05:51:26.079 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/lapb-module.txt 2024-09-21T05:51:26.082 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ltpc.txt 2024-09-21T05:51:26.084 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/mac80211-auth-assoc-deauth.txt 2024-09-21T05:51:26.086 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/mac80211-injection.txt 2024-09-21T05:51:26.088 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/ 2024-09-21T05:51:26.090 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/README 2024-09-21T05:51:26.092 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/hostapd.conf 2024-09-21T05:51:26.094 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/wpa_supplicant.conf 2024-09-21T05:51:26.097 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/multiqueue.txt 2024-09-21T05:51:26.099 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/netconsole.txt 2024-09-21T05:51:26.102 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/netdev-FAQ.txt 2024-09-21T05:51:26.104 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/netdev-features.txt 2024-09-21T05:51:26.107 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/netdevices.txt 2024-09-21T05:51:26.109 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/netif-msg.txt 2024-09-21T05:51:26.111 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/netlink_mmap.txt 2024-09-21T05:51:26.114 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/nf_conntrack-sysctl.txt 2024-09-21T05:51:26.116 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/nfc.txt 2024-09-21T05:51:26.118 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/openvswitch.txt 2024-09-21T05:51:26.121 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/operstates.txt 2024-09-21T05:51:26.123 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/packet_mmap.txt 2024-09-21T05:51:26.126 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/phonet.txt 2024-09-21T05:51:26.129 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/phy.txt 2024-09-21T05:51:26.132 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/pktgen.txt 2024-09-21T05:51:26.134 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/policy-routing.txt 2024-09-21T05:51:26.140 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ppp_generic.txt 2024-09-21T05:51:26.149 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/proc_net_tcp.txt 2024-09-21T05:51:26.154 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/radiotap-headers.txt 2024-09-21T05:51:26.159 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ray_cs.txt 2024-09-21T05:51:26.163 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/rds.txt 2024-09-21T05:51:26.166 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/regulatory.txt 2024-09-21T05:51:26.169 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/rxrpc.txt 2024-09-21T05:51:26.173 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/s2io.txt 2024-09-21T05:51:26.175 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/scaling.txt 2024-09-21T05:51:26.178 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/sctp.txt 2024-09-21T05:51:26.181 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/secid.txt 2024-09-21T05:51:26.183 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/skfp.txt 2024-09-21T05:51:26.186 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/smc9.txt 2024-09-21T05:51:26.188 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/spider_net.txt 2024-09-21T05:51:26.191 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/stmmac.txt 2024-09-21T05:51:26.194 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/switchdev.txt 2024-09-21T05:51:26.196 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/tc-actions-env-rules.txt 2024-09-21T05:51:26.198 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/tcp-thin.txt 2024-09-21T05:51:26.201 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/tcp.txt 2024-09-21T05:51:26.204 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/team.txt 2024-09-21T05:51:26.207 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/timestamping.txt 2024-09-21T05:51:26.211 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/timestamping/ 2024-09-21T05:51:26.213 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/timestamping/.gitignore 2024-09-21T05:51:26.216 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/timestamping/Makefile 2024-09-21T05:51:26.219 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/timestamping/hwtstamp_config.c 2024-09-21T05:51:26.222 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/timestamping/timestamping.c 2024-09-21T05:51:26.224 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/timestamping/txtimestamp.c 2024-09-21T05:51:26.227 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/tlan.txt 2024-09-21T05:51:26.230 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/tproxy.txt 2024-09-21T05:51:26.233 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/tuntap.txt 2024-09-21T05:51:26.236 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/udplite.txt 2024-09-21T05:51:26.239 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/vortex.txt 2024-09-21T05:51:26.242 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/vxge.txt 2024-09-21T05:51:26.244 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/vxlan.txt 2024-09-21T05:51:26.247 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/x25-iface.txt 2024-09-21T05:51:26.250 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/x25.txt 2024-09-21T05:51:26.252 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/xfrm_proc.txt 2024-09-21T05:51:26.255 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/xfrm_sync.txt 2024-09-21T05:51:26.258 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/xfrm_sysctl.txt 2024-09-21T05:51:26.261 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/z8530drv.txt 2024-09-21T05:51:26.264 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/nfc/ 2024-09-21T05:51:26.329 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/nfc/nfc-hci.txt 2024-09-21T05:51:26.332 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/nfc/nfc-pn544.txt 2024-09-21T05:51:26.335 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/nios2/ 2024-09-21T05:51:26.337 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/nios2/README 2024-09-21T05:51:26.340 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/nommu-mmap.txt 2024-09-21T05:51:26.344 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/numastat.txt 2024-09-21T05:51:26.348 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/oops-tracing.txt 2024-09-21T05:51:26.352 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/padata.txt 2024-09-21T05:51:26.356 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/parisc/ 2024-09-21T05:51:26.358 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/parisc/00-INDEX 2024-09-21T05:51:26.361 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/parisc/debugging 2024-09-21T05:51:26.363 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/parisc/registers 2024-09-21T05:51:26.366 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/parport-lowlevel.txt 2024-09-21T05:51:26.372 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/parport.txt 2024-09-21T05:51:26.376 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pcmcia/ 2024-09-21T05:51:26.378 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pcmcia/.gitignore 2024-09-21T05:51:26.380 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pcmcia/Makefile 2024-09-21T05:51:26.382 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pcmcia/crc32hash.c 2024-09-21T05:51:26.385 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pcmcia/devicetable.txt 2024-09-21T05:51:26.387 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pcmcia/driver-changes.txt 2024-09-21T05:51:26.389 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pcmcia/driver.txt 2024-09-21T05:51:26.392 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pcmcia/locking.txt 2024-09-21T05:51:26.395 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/percpu-rw-semaphore.txt 2024-09-21T05:51:26.399 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/phy.txt 2024-09-21T05:51:26.403 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/phy/ 2024-09-21T05:51:26.405 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/phy/samsung-usb2.txt 2024-09-21T05:51:26.407 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pi-futex.txt 2024-09-21T05:51:26.412 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pinctrl.txt 2024-09-21T05:51:26.416 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/platform/ 2024-09-21T05:51:26.419 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/platform/x86-laptop-drivers.txt 2024-09-21T05:51:26.422 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pnp.txt 2024-09-21T05:51:26.426 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/ 2024-09-21T05:51:26.429 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/00-INDEX 2024-09-21T05:51:26.431 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/apm-acpi.txt 2024-09-21T05:51:26.434 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/basic-pm-debugging.txt 2024-09-21T05:51:26.437 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/charger-manager.txt 2024-09-21T05:51:26.440 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/devices.txt 2024-09-21T05:51:26.442 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/drivers-testing.txt 2024-09-21T05:51:26.445 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/freezing-of-tasks.txt 2024-09-21T05:51:26.447 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/interface.txt 2024-09-21T05:51:26.450 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/notifiers.txt 2024-09-21T05:51:26.452 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/opp.txt 2024-09-21T05:51:26.455 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/pci.txt 2024-09-21T05:51:26.458 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/pm_qos_interface.txt 2024-09-21T05:51:26.461 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/power_supply_class.txt 2024-09-21T05:51:26.464 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/powercap/ 2024-09-21T05:51:26.465 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/powercap/powercap.txt 2024-09-21T05:51:26.468 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/regulator/ 2024-09-21T05:51:26.471 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/regulator/consumer.txt 2024-09-21T05:51:26.473 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/regulator/design.txt 2024-09-21T05:51:26.476 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/regulator/machine.txt 2024-09-21T05:51:26.478 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/regulator/overview.txt 2024-09-21T05:51:26.481 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/regulator/regulator.txt 2024-09-21T05:51:26.483 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/runtime_pm.txt 2024-09-21T05:51:26.487 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/s2ram.txt 2024-09-21T05:51:26.489 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/states.txt 2024-09-21T05:51:26.491 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/suspend-and-cpuhotplug.txt 2024-09-21T05:51:26.494 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/suspend-and-interrupts.txt 2024-09-21T05:51:26.496 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/swsusp-and-swap-files.txt 2024-09-21T05:51:26.498 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/swsusp-dmcrypt.txt 2024-09-21T05:51:26.500 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/swsusp.txt 2024-09-21T05:51:26.503 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/tricks.txt 2024-09-21T05:51:26.505 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/userland-swsusp.txt 2024-09-21T05:51:26.508 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/video.txt 2024-09-21T05:51:26.510 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/ 2024-09-21T05:51:26.513 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/00-INDEX 2024-09-21T05:51:26.515 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/bootwrapper.txt 2024-09-21T05:51:26.517 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/cpu_families.txt 2024-09-21T05:51:26.520 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/cpu_features.txt 2024-09-21T05:51:26.522 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/cxl.txt 2024-09-21T05:51:26.525 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/eeh-pci-error-recovery.txt 2024-09-21T05:51:26.528 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/firmware-assisted-dump.txt 2024-09-21T05:51:26.530 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/hvcs.txt 2024-09-21T05:51:26.533 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/mpc52xx.txt 2024-09-21T05:51:26.535 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/pmu-ebb.txt 2024-09-21T05:51:26.538 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/ptrace.txt 2024-09-21T05:51:26.540 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/qe_firmware.txt 2024-09-21T05:51:26.543 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/transactional_memory.txt 2024-09-21T05:51:26.545 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pps/ 2024-09-21T05:51:26.548 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pps/pps.txt 2024-09-21T05:51:26.550 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/prctl/ 2024-09-21T05:51:26.552 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/prctl/.gitignore 2024-09-21T05:51:26.554 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/prctl/Makefile 2024-09-21T05:51:26.556 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-ctxt-sw-stress-test.c 2024-09-21T05:51:26.559 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-on-off-stress-test.c 2024-09-21T05:51:26.561 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-test.c 2024-09-21T05:51:26.563 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/prctl/no_new_privs.txt 2024-09-21T05:51:26.566 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/prctl/seccomp_filter.txt 2024-09-21T05:51:26.568 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/preempt-locking.txt 2024-09-21T05:51:26.572 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/printk-formats.txt 2024-09-21T05:51:26.575 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pti/ 2024-09-21T05:51:26.577 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pti/pti_intel_mid.txt 2024-09-21T05:51:26.579 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ptp/ 2024-09-21T05:51:26.581 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ptp/.gitignore 2024-09-21T05:51:26.583 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ptp/Makefile 2024-09-21T05:51:26.585 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ptp/ptp.txt 2024-09-21T05:51:26.587 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ptp/testptp.c 2024-09-21T05:51:26.590 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ptp/testptp.mk 2024-09-21T05:51:26.592 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pwm.txt 2024-09-21T05:51:26.595 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ramoops.txt 2024-09-21T05:51:26.598 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/rapidio/ 2024-09-21T05:51:26.600 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/rapidio/rapidio.txt 2024-09-21T05:51:26.603 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/rapidio/sysfs.txt 2024-09-21T05:51:26.606 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/rapidio/tsi721.txt 2024-09-21T05:51:26.608 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/rbtree.txt 2024-09-21T05:51:26.612 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/remoteproc.txt 2024-09-21T05:51:26.615 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/rfkill.txt 2024-09-21T05:51:26.618 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/robust-futex-ABI.txt 2024-09-21T05:51:26.621 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/robust-futexes.txt 2024-09-21T05:51:26.625 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/rpmsg.txt 2024-09-21T05:51:26.628 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/rtc.txt 2024-09-21T05:51:26.631 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/ 2024-09-21T05:51:26.633 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/00-INDEX 2024-09-21T05:51:26.635 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/3270.ChangeLog 2024-09-21T05:51:26.637 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/3270.txt 2024-09-21T05:51:26.640 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/CommonIO 2024-09-21T05:51:26.642 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/DASD 2024-09-21T05:51:26.645 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/Debugging390.txt 2024-09-21T05:51:26.648 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/cds.txt 2024-09-21T05:51:26.651 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/config3270.sh 2024-09-21T05:51:26.653 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/driver-model.txt 2024-09-21T05:51:26.656 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/kvm.txt 2024-09-21T05:51:26.658 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/monreader.txt 2024-09-21T05:51:26.661 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/qeth.txt 2024-09-21T05:51:26.663 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/s390dbf.txt 2024-09-21T05:51:26.666 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/zfcpdump.txt 2024-09-21T05:51:26.667 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/ 2024-09-21T05:51:26.670 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/00-INDEX 2024-09-21T05:51:26.672 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/completion.txt 2024-09-21T05:51:26.674 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/sched-arch.txt 2024-09-21T05:51:26.677 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/sched-bwc.txt 2024-09-21T05:51:26.679 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/sched-deadline.txt 2024-09-21T05:51:26.682 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/sched-design-CFS.txt 2024-09-21T05:51:26.685 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/sched-domains.txt 2024-09-21T05:51:26.687 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/sched-nice-design.txt 2024-09-21T05:51:26.689 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/sched-rt-group.txt 2024-09-21T05:51:26.692 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/sched-stats.txt 2024-09-21T05:51:26.694 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ 2024-09-21T05:51:26.696 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/00-INDEX 2024-09-21T05:51:26.699 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/53c700.txt 2024-09-21T05:51:26.701 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/BusLogic.txt 2024-09-21T05:51:26.704 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.1992-1997 2024-09-21T05:51:26.707 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.arcmsr 2024-09-21T05:51:26.709 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ips 2024-09-21T05:51:26.712 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.lpfc 2024-09-21T05:51:26.716 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid 2024-09-21T05:51:26.719 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid_sas 2024-09-21T05:51:26.722 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ncr53c8xx 2024-09-21T05:51:26.725 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx 2024-09-21T05:51:26.728 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx_2 2024-09-21T05:51:26.730 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/FlashPoint.txt 2024-09-21T05:51:26.732 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/LICENSE.FlashPoint 2024-09-21T05:51:26.734 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla2xxx 2024-09-21T05:51:26.737 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla4xxx 2024-09-21T05:51:26.739 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/Mylex.txt 2024-09-21T05:51:26.741 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/NinjaSCSI.txt 2024-09-21T05:51:26.744 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/aacraid.txt 2024-09-21T05:51:26.746 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/advansys.txt 2024-09-21T05:51:26.749 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/aha152x.txt 2024-09-21T05:51:26.751 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/aic79xx.txt 2024-09-21T05:51:26.753 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/aic7xxx.txt 2024-09-21T05:51:26.756 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/arcmsr_spec.txt 2024-09-21T05:51:26.758 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/bfa.txt 2024-09-21T05:51:26.760 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/bnx2fc.txt 2024-09-21T05:51:26.763 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/cxgb3i.txt 2024-09-21T05:51:26.765 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/dc395x.txt 2024-09-21T05:51:26.767 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/dpti.txt 2024-09-21T05:51:26.769 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/dtc3x80.txt 2024-09-21T05:51:26.772 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/g_NCR5380.txt 2024-09-21T05:51:26.774 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/hpsa.txt 2024-09-21T05:51:26.777 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/hptiop.txt 2024-09-21T05:51:26.779 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/in2000.txt 2024-09-21T05:51:26.781 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/libsas.txt 2024-09-21T05:51:26.784 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/link_power_management_policy.txt 2024-09-21T05:51:26.787 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/lpfc.txt 2024-09-21T05:51:26.789 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/megaraid.txt 2024-09-21T05:51:26.791 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ncr53c8xx.txt 2024-09-21T05:51:26.795 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/osd.txt 2024-09-21T05:51:26.797 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/osst.txt 2024-09-21T05:51:26.800 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ppa.txt 2024-09-21T05:51:26.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/qlogicfas.txt 2024-09-21T05:51:26.805 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi-changer.txt 2024-09-21T05:51:26.809 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi-generic.txt 2024-09-21T05:51:26.810 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi-parameters.txt 2024-09-21T05:51:26.811 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi.txt 2024-09-21T05:51:26.814 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi_eh.txt 2024-09-21T05:51:26.816 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi_fc_transport.txt 2024-09-21T05:51:26.819 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi_mid_low_api.txt 2024-09-21T05:51:26.822 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/ 2024-09-21T05:51:26.824 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/Makefile 2024-09-21T05:51:26.826 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/rport_state_diagram.dot 2024-09-21T05:51:26.828 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/st.txt 2024-09-21T05:51:26.832 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/sym53c500_cs.txt 2024-09-21T05:51:26.834 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/sym53c8xx_2.txt 2024-09-21T05:51:26.837 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/tmscsim.txt 2024-09-21T05:51:26.990 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ufs.txt 2024-09-21T05:51:26.992 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/wd719x.txt 2024-09-21T05:51:26.994 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/ 2024-09-21T05:51:26.997 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/00-INDEX 2024-09-21T05:51:26.999 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/IMA-templates.txt 2024-09-21T05:51:27.002 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/LSM.txt 2024-09-21T05:51:27.004 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/SELinux.txt 2024-09-21T05:51:27.007 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/Smack.txt 2024-09-21T05:51:27.010 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/Yama.txt 2024-09-21T05:51:27.013 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/apparmor.txt 2024-09-21T05:51:27.017 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/credentials.txt 2024-09-21T05:51:27.018 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/keys-ecryptfs.txt 2024-09-21T05:51:27.021 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/keys-request-key.txt 2024-09-21T05:51:27.023 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/keys-trusted-encrypted.txt 2024-09-21T05:51:27.026 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/keys.txt 2024-09-21T05:51:27.030 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/tomoyo.txt 2024-09-21T05:51:27.032 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial-console.txt 2024-09-21T05:51:27.035 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/ 2024-09-21T05:51:27.038 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/00-INDEX 2024-09-21T05:51:27.040 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/README.cycladesZ 2024-09-21T05:51:27.042 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/driver 2024-09-21T05:51:27.044 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/moxa-smartio 2024-09-21T05:51:27.047 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/n_gsm.txt 2024-09-21T05:51:27.050 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/rocket.txt 2024-09-21T05:51:27.053 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/serial-rs485.txt 2024-09-21T05:51:27.055 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/tty.txt 2024-09-21T05:51:27.058 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sgi-ioc4.txt 2024-09-21T05:51:27.060 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sh/ 2024-09-21T05:51:27.063 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sh/new-machine.txt 2024-09-21T05:51:27.065 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sh/register-banks.txt 2024-09-21T05:51:27.067 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/smsc_ece1099.txt 2024-09-21T05:51:27.070 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/ 2024-09-21T05:51:27.072 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/ 2024-09-21T05:51:27.074 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/ALSA-Configuration.txt 2024-09-21T05:51:27.078 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/Audigy-mixer.txt 2024-09-21T05:51:27.081 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/Audiophile-Usb.txt 2024-09-21T05:51:27.083 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/Bt87x.txt 2024-09-21T05:51:27.086 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/CMIPCI.txt 2024-09-21T05:51:27.088 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/Channel-Mapping-API.txt 2024-09-21T05:51:27.091 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/ControlNames.txt 2024-09-21T05:51:27.093 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Controls.txt 2024-09-21T05:51:27.096 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Models.txt 2024-09-21T05:51:27.098 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio.txt 2024-09-21T05:51:27.101 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/Joystick.txt 2024-09-21T05:51:27.103 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/MIXART.txt 2024-09-21T05:51:27.106 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/OSS-Emulation.txt 2024-09-21T05:51:27.109 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/Procfile.txt 2024-09-21T05:51:27.111 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/README.maya44 2024-09-21T05:51:27.114 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/SB-Live-mixer.txt 2024-09-21T05:51:27.116 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/VIA82xx-mixer.txt 2024-09-21T05:51:27.119 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/alsa-parameters.txt 2024-09-21T05:51:27.121 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/compress_offload.txt 2024-09-21T05:51:27.124 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/emu10k1-jack.txt 2024-09-21T05:51:27.126 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/hda_codec.txt 2024-09-21T05:51:27.129 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/hdspm.txt 2024-09-21T05:51:27.132 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/powersave.txt 2024-09-21T05:51:27.135 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/seq_oss.html 2024-09-21T05:51:27.137 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/serial-u16550.txt 2024-09-21T05:51:27.139 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/ 2024-09-21T05:51:27.141 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DAI.txt 2024-09-21T05:51:27.143 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DPCM.txt 2024-09-21T05:51:27.146 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/clocking.txt 2024-09-21T05:51:27.148 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/codec.txt 2024-09-21T05:51:27.150 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/dapm.txt 2024-09-21T05:51:27.153 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/jack.txt 2024-09-21T05:51:27.156 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/machine.txt 2024-09-21T05:51:27.158 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/overview.txt 2024-09-21T05:51:27.161 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/platform.txt 2024-09-21T05:51:27.163 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/pops_clicks.txt 2024-09-21T05:51:27.165 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/ 2024-09-21T05:51:27.168 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/ALS 2024-09-21T05:51:27.170 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/AudioExcelDSP16 2024-09-21T05:51:27.173 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/CMI8330 2024-09-21T05:51:27.175 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/ESS 2024-09-21T05:51:27.177 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/ESS1868 2024-09-21T05:51:27.180 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/Introduction 2024-09-21T05:51:27.182 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/MultiSound 2024-09-21T05:51:27.185 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/OPL3 2024-09-21T05:51:27.187 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/Opti 2024-09-21T05:51:27.190 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/PAS16 2024-09-21T05:51:27.192 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/PSS 2024-09-21T05:51:27.195 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/PSS-updates 2024-09-21T05:51:27.197 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/README.OSS 2024-09-21T05:51:27.201 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/README.modules 2024-09-21T05:51:27.203 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/README.ymfsb 2024-09-21T05:51:27.206 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/SoundPro 2024-09-21T05:51:27.208 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/Soundblaster 2024-09-21T05:51:27.210 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/Tropez+ 2024-09-21T05:51:27.213 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/VIBRA16 2024-09-21T05:51:27.215 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/WaveArtist 2024-09-21T05:51:27.217 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/btaudio 2024-09-21T05:51:27.221 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/mwave 2024-09-21T05:51:27.222 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/oss-parameters.txt 2024-09-21T05:51:27.224 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/ultrasound 2024-09-21T05:51:27.227 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sparse.txt 2024-09-21T05:51:27.232 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/ 2024-09-21T05:51:27.234 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/.gitignore 2024-09-21T05:51:27.236 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/00-INDEX 2024-09-21T05:51:27.238 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/Makefile 2024-09-21T05:51:27.240 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/butterfly 2024-09-21T05:51:27.243 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/ep93xx_spi 2024-09-21T05:51:27.245 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/pxa2xx 2024-09-21T05:51:27.248 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/spi-lm70llp 2024-09-21T05:51:27.250 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/spi-sc18is602 2024-09-21T05:51:27.252 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/spi-summary 2024-09-21T05:51:27.256 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/spidev 2024-09-21T05:51:27.258 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/spidev_fdx.c 2024-09-21T05:51:27.260 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/spidev_test.c 2024-09-21T05:51:27.262 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/stable_api_nonsense.txt 2024-09-21T05:51:27.266 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/stable_kernel_rules.txt 2024-09-21T05:51:27.269 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/static-keys.txt 2024-09-21T05:51:27.272 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/svga.txt 2024-09-21T05:51:27.276 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/ 2024-09-21T05:51:27.279 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/00-INDEX 2024-09-21T05:51:27.281 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/README 2024-09-21T05:51:27.283 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/abi.txt 2024-09-21T05:51:27.286 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/fs.txt 2024-09-21T05:51:27.289 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/kernel.txt 2024-09-21T05:51:27.291 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/net.txt 2024-09-21T05:51:27.294 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/sunrpc.txt 2024-09-21T05:51:27.296 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/vm.txt 2024-09-21T05:51:27.299 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysfs-rules.txt 2024-09-21T05:51:27.303 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysrq.txt 2024-09-21T05:51:27.306 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/target/ 2024-09-21T05:51:27.308 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.py 2024-09-21T05:51:27.311 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.txt 2024-09-21T05:51:27.313 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/target/tcmu-design.txt 2024-09-21T05:51:27.316 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/thermal/ 2024-09-21T05:51:27.319 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/thermal/cpu-cooling-api.txt 2024-09-21T05:51:27.321 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal 2024-09-21T05:51:27.323 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal_emulation 2024-09-21T05:51:27.325 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/thermal/intel_powerclamp.txt 2024-09-21T05:51:27.328 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/thermal/nouveau_thermal 2024-09-21T05:51:27.330 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/thermal/sysfs-api.txt 2024-09-21T05:51:27.333 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/thermal/x86_pkg_temperature_thermal 2024-09-21T05:51:27.336 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/this_cpu_ops.txt 2024-09-21T05:51:27.340 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/ 2024-09-21T05:51:27.342 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/.gitignore 2024-09-21T05:51:27.344 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/00-INDEX 2024-09-21T05:51:27.346 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/Makefile 2024-09-21T05:51:27.348 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/NO_HZ.txt 2024-09-21T05:51:27.351 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/highres.txt 2024-09-21T05:51:27.354 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/hpet.txt 2024-09-21T05:51:27.356 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/hpet_example.c 2024-09-21T05:51:27.359 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/hrtimers.txt 2024-09-21T05:51:27.361 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/timekeeping.txt 2024-09-21T05:51:27.364 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/timer_stats.txt 2024-09-21T05:51:27.367 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/timers-howto.txt 2024-09-21T05:51:27.369 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/tpm/ 2024-09-21T05:51:27.373 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/tpm/xen-tpmfront.txt 2024-09-21T05:51:27.375 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/ 2024-09-21T05:51:27.378 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/coresight.txt 2024-09-21T05:51:27.381 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/events-kmem.txt 2024-09-21T05:51:27.383 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/events-nmi.txt 2024-09-21T05:51:27.386 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/events-power.txt 2024-09-21T05:51:27.389 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/events.txt 2024-09-21T05:51:27.391 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/ftrace-design.txt 2024-09-21T05:51:27.394 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/ftrace.txt 2024-09-21T05:51:27.399 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/function-graph-fold.vim 2024-09-21T05:51:27.402 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/kprobetrace.txt 2024-09-21T05:51:27.405 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/mmiotrace.txt 2024-09-21T05:51:27.408 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/postprocess/ 2024-09-21T05:51:27.409 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-pagealloc-postprocess.pl 2024-09-21T05:51:27.412 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-vmscan-postprocess.pl 2024-09-21T05:51:27.415 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/ring-buffer-design.txt 2024-09-21T05:51:27.419 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/tracepoint-analysis.txt 2024-09-21T05:51:27.422 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/tracepoints.txt 2024-09-21T05:51:27.425 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/uprobetracer.txt 2024-09-21T05:51:27.427 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/unaligned-memory-access.txt 2024-09-21T05:51:27.432 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/unicode.txt 2024-09-21T05:51:27.436 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/unshare.txt 2024-09-21T05:51:27.440 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/ 2024-09-21T05:51:27.443 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/CREDITS 2024-09-21T05:51:27.446 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/URB.txt 2024-09-21T05:51:27.449 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/WUSB-Design-overview.txt 2024-09-21T05:51:27.452 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/acm.txt 2024-09-21T05:51:27.454 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/anchors.txt 2024-09-21T05:51:27.457 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/authorization.txt 2024-09-21T05:51:27.460 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/bulk-streams.txt 2024-09-21T05:51:27.463 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/callbacks.txt 2024-09-21T05:51:27.465 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/chipidea.txt 2024-09-21T05:51:27.468 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/dma.txt 2024-09-21T05:51:27.471 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/dwc3.txt 2024-09-21T05:51:27.474 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/ehci.txt 2024-09-21T05:51:27.476 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/error-codes.txt 2024-09-21T05:51:27.479 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/functionfs.txt 2024-09-21T05:51:27.482 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/gadget-testing.txt 2024-09-21T05:51:27.485 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/gadget_configfs.txt 2024-09-21T05:51:27.488 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/gadget_hid.txt 2024-09-21T05:51:27.492 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/gadget_multi.txt 2024-09-21T05:51:27.495 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/gadget_printer.txt 2024-09-21T05:51:27.498 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/gadget_serial.txt 2024-09-21T05:51:27.501 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/hotplug.txt 2024-09-21T05:51:27.503 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/iuu_phoenix.txt 2024-09-21T05:51:27.506 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/linux-cdc-acm.inf 2024-09-21T05:51:27.509 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/linux.inf 2024-09-21T05:51:27.511 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/mass-storage.txt 2024-09-21T05:51:27.514 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/misc_usbsevseg.txt 2024-09-21T05:51:27.516 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/mtouchusb.txt 2024-09-21T05:51:27.520 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/ohci.txt 2024-09-21T05:51:27.522 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/persist.txt 2024-09-21T05:51:27.525 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/power-management.txt 2024-09-21T05:51:27.529 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/proc_usb_info.txt 2024-09-21T05:51:27.532 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/rio.txt 2024-09-21T05:51:27.535 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/usb-help.txt 2024-09-21T05:51:27.538 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/usb-serial.txt 2024-09-21T05:51:27.541 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/usbmon.txt 2024-09-21T05:51:27.543 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/wusb-cbaf 2024-09-21T05:51:27.547 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:27 smithi070 ceph-mon[30981]: pgmap v429: 129 pgs: 129 active+clean; 94 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 950 KiB/s wr, 166 op/s 2024-09-21T05:51:27.547 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vDSO/ 2024-09-21T05:51:27.550 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vDSO/.gitignore 2024-09-21T05:51:27.552 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vDSO/Makefile 2024-09-21T05:51:27.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:27 smithi116 ceph-mon[34332]: pgmap v429: 129 pgs: 129 active+clean; 94 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 950 KiB/s wr, 166 op/s 2024-09-21T05:51:27.555 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vDSO/parse_vdso.c 2024-09-21T05:51:27.558 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vDSO/vdso_standalone_test_x86.c 2024-09-21T05:51:27.560 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vDSO/vdso_test.c 2024-09-21T05:51:27.562 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vfio.txt 2024-09-21T05:51:27.567 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vgaarbiter.txt 2024-09-21T05:51:27.570 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video-output.txt 2024-09-21T05:51:27.573 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/ 2024-09-21T05:51:27.576 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/4CCs.txt 2024-09-21T05:51:27.579 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/API.html 2024-09-21T05:51:27.581 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.au0828 2024-09-21T05:51:27.583 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.bttv 2024-09-21T05:51:27.586 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx23885 2024-09-21T05:51:27.588 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx88 2024-09-21T05:51:27.591 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.em28xx 2024-09-21T05:51:27.594 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.ivtv 2024-09-21T05:51:27.596 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7134 2024-09-21T05:51:27.599 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7164 2024-09-21T05:51:27.601 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tm6000 2024-09-21T05:51:27.604 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tuner 2024-09-21T05:51:27.606 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.usbvision 2024-09-21T05:51:27.609 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/Makefile 2024-09-21T05:51:27.611 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/README.cpia2 2024-09-21T05:51:27.614 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/README.cx88 2024-09-21T05:51:27.617 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/README.davinci-vpbe 2024-09-21T05:51:27.620 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/README.ir 2024-09-21T05:51:27.622 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/README.ivtv 2024-09-21T05:51:27.625 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/README.pvrusb2 2024-09-21T05:51:27.629 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/README.saa7134 2024-09-21T05:51:27.631 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/Zoran 2024-09-21T05:51:27.634 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/ 2024-09-21T05:51:27.636 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/CONTRIBUTORS 2024-09-21T05:51:27.639 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/Cards 2024-09-21T05:51:27.642 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/ICs 2024-09-21T05:51:27.645 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/Insmod-options 2024-09-21T05:51:27.647 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/MAKEDEV 2024-09-21T05:51:27.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:27 smithi160 ceph-mon[33979]: pgmap v429: 129 pgs: 129 active+clean; 94 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 950 KiB/s wr, 166 op/s 2024-09-21T05:51:27.650 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modprobe.conf 2024-09-21T05:51:27.653 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modules.conf 2024-09-21T05:51:27.655 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/PROBLEMS 2024-09-21T05:51:27.658 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/README 2024-09-21T05:51:27.661 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.WINVIEW 2024-09-21T05:51:27.663 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.freeze 2024-09-21T05:51:27.666 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.quirks 2024-09-21T05:51:27.668 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/Sound-FAQ 2024-09-21T05:51:27.672 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/Specs 2024-09-21T05:51:27.674 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/THANKS 2024-09-21T05:51:27.676 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/Tuners 2024-09-21T05:51:27.679 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cafe_ccic 2024-09-21T05:51:27.683 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cpia2_overview.txt 2024-09-21T05:51:27.686 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx18.txt 2024-09-21T05:51:27.688 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/ 2024-09-21T05:51:27.690 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.hm12 2024-09-21T05:51:27.693 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.vbi 2024-09-21T05:51:27.696 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-calling.txt 2024-09-21T05:51:27.699 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-api.txt 2024-09-21T05:51:27.702 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-regs.txt 2024-09-21T05:51:27.705 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-dma.txt 2024-09-21T05:51:27.708 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-encoder-api.txt 2024-09-21T05:51:27.712 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-memory.txt 2024-09-21T05:51:27.715 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-osd-api.txt 2024-09-21T05:51:27.718 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-upload.txt 2024-09-21T05:51:27.720 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx88/ 2024-09-21T05:51:27.723 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx88/hauppauge-wintv-cx88-ir.txt 2024-09-21T05:51:27.726 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/extract_xc3028.pl 2024-09-21T05:51:27.730 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/fimc.txt 2024-09-21T05:51:27.733 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/gspca.txt 2024-09-21T05:51:27.736 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/hauppauge-wintv-cx88-ir.txt 2024-09-21T05:51:27.738 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/lifeview.txt 2024-09-21T05:51:27.741 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/meye.txt 2024-09-21T05:51:27.745 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/not-in-cx2388x-datasheet.txt 2024-09-21T05:51:27.748 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/omap3isp.txt 2024-09-21T05:51:27.750 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/omap4_camera.txt 2024-09-21T05:51:27.753 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/pxa_camera.txt 2024-09-21T05:51:27.755 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/radiotrack.txt 2024-09-21T05:51:27.757 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/sh_mobile_ceu_camera.txt 2024-09-21T05:51:27.760 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/si470x.txt 2024-09-21T05:51:27.762 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/si4713.txt 2024-09-21T05:51:27.765 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/si476x.txt 2024-09-21T05:51:27.767 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/soc-camera.txt 2024-09-21T05:51:27.769 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/uvcvideo.txt 2024-09-21T05:51:27.772 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/v4l2-controls.txt 2024-09-21T05:51:27.775 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/v4l2-framework.txt 2024-09-21T05:51:27.778 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/v4l2-pci-skeleton.c 2024-09-21T05:51:27.781 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/videobuf 2024-09-21T05:51:27.784 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/vivid.txt 2024-09-21T05:51:27.787 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/zr364xx.txt 2024-09-21T05:51:27.790 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/ 2024-09-21T05:51:27.792 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/00-INDEX 2024-09-21T05:51:27.794 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/ 2024-09-21T05:51:27.796 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/00-INDEX 2024-09-21T05:51:27.798 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/api.txt 2024-09-21T05:51:27.803 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/cpuid.txt 2024-09-21T05:51:27.806 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/ 2024-09-21T05:51:27.808 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/README 2024-09-21T05:51:27.810 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/arm-vgic.txt 2024-09-21T05:51:27.812 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/mpic.txt 2024-09-21T05:51:27.815 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/s390_flic.txt 2024-09-21T05:51:27.817 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vfio.txt 2024-09-21T05:51:27.820 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vm.txt 2024-09-21T05:51:27.822 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/xics.txt 2024-09-21T05:51:27.824 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/hypercalls.txt 2024-09-21T05:51:27.827 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/locking.txt 2024-09-21T05:51:27.829 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/mmu.txt 2024-09-21T05:51:27.833 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/msr.txt 2024-09-21T05:51:27.835 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/nested-vmx.txt 2024-09-21T05:51:27.837 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/ppc-pv.txt 2024-09-21T05:51:27.839 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/review-checklist.txt 2024-09-21T05:51:27.841 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/s390-diag.txt 2024-09-21T05:51:27.843 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/timekeeping.txt 2024-09-21T05:51:27.846 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/paravirt_ops.txt 2024-09-21T05:51:27.849 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/uml/ 2024-09-21T05:51:27.851 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/uml/UserModeLinux-HOWTO.txt 2024-09-21T05:51:28.182 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/ 2024-09-21T05:51:28.185 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/.gitignore 2024-09-21T05:51:28.187 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/00-INDEX 2024-09-21T05:51:28.190 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/active_mm.txt 2024-09-21T05:51:28.193 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/balance 2024-09-21T05:51:28.196 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/cleancache.txt 2024-09-21T05:51:28.199 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/frontswap.txt 2024-09-21T05:51:28.201 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/highmem.txt 2024-09-21T05:51:28.204 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/hugetlbpage.txt 2024-09-21T05:51:28.207 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/hwpoison.txt 2024-09-21T05:51:28.210 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/ksm.txt 2024-09-21T05:51:28.213 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/numa 2024-09-21T05:51:28.215 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/numa_memory_policy.txt 2024-09-21T05:51:28.218 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/overcommit-accounting 2024-09-21T05:51:28.221 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/page_migration 2024-09-21T05:51:28.223 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/page_owner.txt 2024-09-21T05:51:28.225 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/pagemap.txt 2024-09-21T05:51:28.228 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/remap_file_pages.txt 2024-09-21T05:51:28.230 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/slub.txt 2024-09-21T05:51:28.232 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/soft-dirty.txt 2024-09-21T05:51:28.234 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/split_page_table_lock 2024-09-21T05:51:28.237 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/transhuge.txt 2024-09-21T05:51:28.240 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/unevictable-lru.txt 2024-09-21T05:51:28.243 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/zswap.txt 2024-09-21T05:51:28.245 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vme_api.txt 2024-09-21T05:51:28.249 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/volatile-considered-harmful.txt 2024-09-21T05:51:28.252 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/ 2024-09-21T05:51:28.254 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/00-INDEX 2024-09-21T05:51:28.256 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/masters/ 2024-09-21T05:51:28.258 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/masters/00-INDEX 2024-09-21T05:51:28.260 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/masters/ds2482 2024-09-21T05:51:28.263 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/masters/ds2490 2024-09-21T05:51:28.265 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/masters/mxc-w1 2024-09-21T05:51:28.267 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/masters/omap-hdq 2024-09-21T05:51:28.270 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/masters/w1-gpio 2024-09-21T05:51:28.272 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/slaves/ 2024-09-21T05:51:28.275 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/slaves/00-INDEX 2024-09-21T05:51:28.277 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2406 2024-09-21T05:51:28.279 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2423 2024-09-21T05:51:28.282 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds28e04 2024-09-21T05:51:28.284 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/slaves/w1_therm 2024-09-21T05:51:28.287 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/w1.generic 2024-09-21T05:51:28.290 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/w1.netlink 2024-09-21T05:51:28.292 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/ 2024-09-21T05:51:28.295 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/Makefile 2024-09-21T05:51:28.297 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/convert_drivers_to_kernel_api.txt 2024-09-21T05:51:28.299 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/hpwdt.txt 2024-09-21T05:51:28.302 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/pcwd-watchdog.txt 2024-09-21T05:51:28.305 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/src/ 2024-09-21T05:51:28.307 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/src/.gitignore 2024-09-21T05:51:28.310 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/src/Makefile 2024-09-21T05:51:28.312 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-simple.c 2024-09-21T05:51:28.315 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-test.c 2024-09-21T05:51:28.317 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/watchdog-api.txt 2024-09-21T05:51:28.319 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/watchdog-kernel-api.txt 2024-09-21T05:51:28.322 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/watchdog-parameters.txt 2024-09-21T05:51:28.325 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/wdt.txt 2024-09-21T05:51:28.327 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/wimax/ 2024-09-21T05:51:28.330 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/wimax/README.i2400m 2024-09-21T05:51:28.332 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/wimax/README.wimax 2024-09-21T05:51:28.334 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/workqueue.txt 2024-09-21T05:51:28.337 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/ 2024-09-21T05:51:28.340 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/00-INDEX 2024-09-21T05:51:28.341 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/boot.txt 2024-09-21T05:51:28.345 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/early-microcode.txt 2024-09-21T05:51:28.347 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/earlyprintk.txt 2024-09-21T05:51:28.350 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/entry_64.txt 2024-09-21T05:51:28.352 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/exception-tables.txt 2024-09-21T05:51:28.355 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/i386/ 2024-09-21T05:51:28.356 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/i386/IO-APIC.txt 2024-09-21T05:51:28.359 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/intel_mpx.txt 2024-09-21T05:51:28.361 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/mtrr.txt 2024-09-21T05:51:28.364 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/pat.txt 2024-09-21T05:51:28.366 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/tlb.txt 2024-09-21T05:51:28.368 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/usb-legacy-support.txt 2024-09-21T05:51:28.370 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/ 2024-09-21T05:51:28.372 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/00-INDEX 2024-09-21T05:51:28.375 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/boot-options.txt 2024-09-21T05:51:28.377 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec 2024-09-21T05:51:28.379 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets 2024-09-21T05:51:28.381 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/kernel-stacks 2024-09-21T05:51:28.384 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/machinecheck 2024-09-21T05:51:28.386 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/mm.txt 2024-09-21T05:51:28.389 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/uefi.txt 2024-09-21T05:51:28.391 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/zero-page.txt 2024-09-21T05:51:28.394 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/xillybus.txt 2024-09-21T05:51:28.398 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/xtensa/ 2024-09-21T05:51:28.400 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/xtensa/atomctl.txt 2024-09-21T05:51:28.402 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/xtensa/mmu.txt 2024-09-21T05:51:28.405 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/xz.txt 2024-09-21T05:51:28.408 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/ 2024-09-21T05:51:28.410 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/CodingStyle 2024-09-21T05:51:28.413 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/HOWTO 2024-09-21T05:51:28.417 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/IRQ.txt 2024-09-21T05:51:28.419 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/SecurityBugs 2024-09-21T05:51:28.422 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingDrivers 2024-09-21T05:51:28.424 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingPatches 2024-09-21T05:51:28.427 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/arm/ 2024-09-21T05:51:28.428 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/arm/Booting 2024-09-21T05:51:28.431 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/arm/kernel_user_helpers.txt 2024-09-21T05:51:28.434 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/arm64/ 2024-09-21T05:51:28.436 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/arm64/booting.txt 2024-09-21T05:51:28.438 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/arm64/memory.txt 2024-09-21T05:51:28.440 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/arm64/tagged-pointers.txt 2024-09-21T05:51:28.443 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/basic_profiling.txt 2024-09-21T05:51:28.446 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/email-clients.txt 2024-09-21T05:51:28.448 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/ 2024-09-21T05:51:28.450 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/sysfs.txt 2024-09-21T05:51:28.452 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/gpio.txt 2024-09-21T05:51:28.455 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/io_ordering.txt 2024-09-21T05:51:28.458 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/magic-number.txt 2024-09-21T05:51:28.460 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/oops-tracing.txt 2024-09-21T05:51:28.463 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/sparse.txt 2024-09-21T05:51:28.465 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/stable_api_nonsense.txt 2024-09-21T05:51:28.468 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/stable_kernel_rules.txt 2024-09-21T05:51:28.470 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/ 2024-09-21T05:51:28.472 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/omap3isp.txt 2024-09-21T05:51:28.474 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/v4l2-framework.txt 2024-09-21T05:51:28.478 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/volatile-considered-harmful.txt 2024-09-21T05:51:28.480 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zorro.txt 2024-09-21T05:51:29.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:29 smithi116 ceph-mon[34332]: pgmap v430: 129 pgs: 129 active+clean; 99 MiB data, 646 MiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 1.3 MiB/s wr, 206 op/s 2024-09-21T05:51:29.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:29 smithi160 ceph-mon[33979]: pgmap v430: 129 pgs: 129 active+clean; 99 MiB data, 646 MiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 1.3 MiB/s wr, 206 op/s 2024-09-21T05:51:29.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:29 smithi070 ceph-mon[30981]: pgmap v430: 129 pgs: 129 active+clean; 99 MiB data, 646 MiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 1.3 MiB/s wr, 206 op/s 2024-09-21T05:51:31.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:31 smithi116 ceph-mon[34332]: pgmap v431: 129 pgs: 129 active+clean; 106 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 1.9 MiB/s wr, 269 op/s 2024-09-21T05:51:31.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:31 smithi160 ceph-mon[33979]: pgmap v431: 129 pgs: 129 active+clean; 106 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 1.9 MiB/s wr, 269 op/s 2024-09-21T05:51:31.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:31 smithi070 ceph-mon[30981]: pgmap v431: 129 pgs: 129 active+clean; 106 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 1.9 MiB/s wr, 269 op/s 2024-09-21T05:51:33.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:33 smithi116 ceph-mon[34332]: pgmap v432: 129 pgs: 129 active+clean; 110 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 2.2 MiB/s wr, 275 op/s 2024-09-21T05:51:33.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:33 smithi160 ceph-mon[33979]: pgmap v432: 129 pgs: 129 active+clean; 110 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 2.2 MiB/s wr, 275 op/s 2024-09-21T05:51:33.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:33 smithi070 ceph-mon[30981]: pgmap v432: 129 pgs: 129 active+clean; 110 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 2.2 MiB/s wr, 275 op/s 2024-09-21T05:51:34.280 INFO:tasks.workunit.client.0.smithi070.stderr:+ tar cf doc.tar linux-4.0.5 2024-09-21T05:51:35.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:35 smithi116 ceph-mon[34332]: pgmap v433: 129 pgs: 129 active+clean; 113 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.4 MiB/s wr, 264 op/s 2024-09-21T05:51:35.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:35 smithi160 ceph-mon[33979]: pgmap v433: 129 pgs: 129 active+clean; 113 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.4 MiB/s wr, 264 op/s 2024-09-21T05:51:35.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:35 smithi070 ceph-mon[30981]: pgmap v433: 129 pgs: 129 active+clean; 113 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.4 MiB/s wr, 264 op/s 2024-09-21T05:51:37.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:37 smithi116 ceph-mon[34332]: pgmap v434: 129 pgs: 129 active+clean; 114 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 2.1 MiB/s wr, 197 op/s 2024-09-21T05:51:37.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:37 smithi160 ceph-mon[33979]: pgmap v434: 129 pgs: 129 active+clean; 114 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 2.1 MiB/s wr, 197 op/s 2024-09-21T05:51:37.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:37 smithi070 ceph-mon[30981]: pgmap v434: 129 pgs: 129 active+clean; 114 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 2.1 MiB/s wr, 197 op/s 2024-09-21T05:51:38.005 INFO:tasks.workunit.client.0.smithi070.stderr:+ tar xf doc.tar 2024-09-21T05:51:39.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:39 smithi116 ceph-mon[34332]: pgmap v435: 129 pgs: 129 active+clean; 115 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 1.9 MiB/s wr, 157 op/s 2024-09-21T05:51:39.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:39 smithi160 ceph-mon[33979]: pgmap v435: 129 pgs: 129 active+clean; 115 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 1.9 MiB/s wr, 157 op/s 2024-09-21T05:51:39.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:39 smithi070 ceph-mon[30981]: pgmap v435: 129 pgs: 129 active+clean; 115 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 1.9 MiB/s wr, 157 op/s 2024-09-21T05:51:41.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:41 smithi116 ceph-mon[34332]: pgmap v436: 129 pgs: 129 active+clean; 125 MiB data, 698 MiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 2.3 MiB/s wr, 125 op/s 2024-09-21T05:51:41.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:41 smithi160 ceph-mon[33979]: pgmap v436: 129 pgs: 129 active+clean; 125 MiB data, 698 MiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 2.3 MiB/s wr, 125 op/s 2024-09-21T05:51:41.744 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:41 smithi070 ceph-mon[30981]: pgmap v436: 129 pgs: 129 active+clean; 125 MiB data, 698 MiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 2.3 MiB/s wr, 125 op/s 2024-09-21T05:51:43.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:43 smithi116 ceph-mon[34332]: pgmap v437: 129 pgs: 129 active+clean; 135 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 2.5 MiB/s wr, 76 op/s 2024-09-21T05:51:43.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:43 smithi160 ceph-mon[33979]: pgmap v437: 129 pgs: 129 active+clean; 135 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 2.5 MiB/s wr, 76 op/s 2024-09-21T05:51:43.744 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:43 smithi070 ceph-mon[30981]: pgmap v437: 129 pgs: 129 active+clean; 135 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 2.5 MiB/s wr, 76 op/s 2024-09-21T05:51:45.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:45 smithi116 ceph-mon[34332]: pgmap v438: 129 pgs: 129 active+clean; 144 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 2.9 MiB/s wr, 101 op/s 2024-09-21T05:51:45.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:45 smithi160 ceph-mon[33979]: pgmap v438: 129 pgs: 129 active+clean; 144 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 2.9 MiB/s wr, 101 op/s 2024-09-21T05:51:45.744 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:45 smithi070 ceph-mon[30981]: pgmap v438: 129 pgs: 129 active+clean; 144 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 2.9 MiB/s wr, 101 op/s 2024-09-21T05:51:47.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:47 smithi116 ceph-mon[34332]: pgmap v439: 129 pgs: 129 active+clean; 144 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 2.6 MiB/s wr, 125 op/s 2024-09-21T05:51:47.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:47 smithi160 ceph-mon[33979]: pgmap v439: 129 pgs: 129 active+clean; 144 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 2.6 MiB/s wr, 125 op/s 2024-09-21T05:51:47.744 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:47 smithi070 ceph-mon[30981]: pgmap v439: 129 pgs: 129 active+clean; 144 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 2.6 MiB/s wr, 125 op/s 2024-09-21T05:51:49.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:49 smithi116 ceph-mon[34332]: pgmap v440: 129 pgs: 129 active+clean; 149 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 3.1 MiB/s wr, 164 op/s 2024-09-21T05:51:49.587 INFO:tasks.quiescer.fs.[cephfs]:Total duration (55.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T05:51:49.587 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.8 2024-09-21T05:51:49.587 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:51:49.610 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:49 smithi070 ceph-mon[30981]: pgmap v440: 129 pgs: 129 active+clean; 149 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 3.1 MiB/s wr, 164 op/s 2024-09-21T05:51:49.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:49 smithi160 ceph-mon[33979]: pgmap v440: 129 pgs: 129 active+clean; 149 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 3.1 MiB/s wr, 164 op/s 2024-09-21T05:51:49.906 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:50.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.488+0000 7f8e6be18640 1 -- 172.21.15.70:0/2048861363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e64104a30 msgr2=0x7f8e64104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:50.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.488+0000 7f8e6be18640 1 --2- 172.21.15.70:0/2048861363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e64104a30 0x7f8e64104e40 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009900 tx=0x7f8e6002a410 comp rx=0 tx=0).stop 2024-09-21T05:51:50.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.488+0000 7f8e6be18640 1 -- 172.21.15.70:0/2048861363 shutdown_connections 2024-09-21T05:51:50.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.488+0000 7f8e6be18640 1 --2- 172.21.15.70:0/2048861363 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e64105380 0x7f8e6410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:50.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.488+0000 7f8e6be18640 1 --2- 172.21.15.70:0/2048861363 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e6410de60 0x7f8e64110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:50.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.488+0000 7f8e6be18640 1 --2- 172.21.15.70:0/2048861363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e64104a30 0x7f8e64104e40 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:50.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.488+0000 7f8e6be18640 1 -- 172.21.15.70:0/2048861363 >> 172.21.15.70:0/2048861363 conn(0x7f8e64079760 msgr2=0x7f8e64079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:50.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.488+0000 7f8e6be18640 1 -- 172.21.15.70:0/2048861363 shutdown_connections 2024-09-21T05:51:50.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.488+0000 7f8e6be18640 1 -- 172.21.15.70:0/2048861363 wait complete. 2024-09-21T05:51:50.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.489+0000 7f8e6be18640 1 Processor -- start 2024-09-21T05:51:50.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.489+0000 7f8e6be18640 1 -- start start 2024-09-21T05:51:50.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.490+0000 7f8e6be18640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e64104a30 0x7f8e64102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:50.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.490+0000 7f8e6be18640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e64105380 0x7f8e64102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:50.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.490+0000 7f8e6be18640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e6410de60 0x7f8e641031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:50.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.490+0000 7f8e6be18640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8e64113b00 con 0x7f8e6410de60 2024-09-21T05:51:50.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.490+0000 7f8e6be18640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8e64113980 con 0x7f8e64105380 2024-09-21T05:51:50.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.490+0000 7f8e6be18640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8e64113c80 con 0x7f8e64104a30 2024-09-21T05:51:50.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.490+0000 7f8e69bb4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e64104a30 0x7f8e64102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:50.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.490+0000 7f8e6a3b5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e6410de60 0x7f8e641031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:50.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.490+0000 7f8e6a3b5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e6410de60 0x7f8e641031f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52928/0 (socket says 172.21.15.70:52928) 2024-09-21T05:51:50.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.490+0000 7f8e6a3b5640 1 -- 172.21.15.70:0/3889864451 learned_addr learned my addr 172.21.15.70:0/3889864451 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:51:50.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.490+0000 7f8e69bb4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e64104a30 0x7f8e64102770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.70:51706/0 (socket says 172.21.15.70:51706) 2024-09-21T05:51:50.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.490+0000 7f8e693b3640 1 --2- 172.21.15.70:0/3889864451 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e64105380 0x7f8e64102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:50.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.490+0000 7f8e693b3640 1 -- 172.21.15.70:0/3889864451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e64104a30 msgr2=0x7f8e64102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:50.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.490+0000 7f8e693b3640 1 --2- 172.21.15.70:0/3889864451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e64104a30 0x7f8e64102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:50.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.490+0000 7f8e693b3640 1 -- 172.21.15.70:0/3889864451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e6410de60 msgr2=0x7f8e641031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:50.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.490+0000 7f8e693b3640 1 --2- 172.21.15.70:0/3889864451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e6410de60 0x7f8e641031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:50.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.490+0000 7f8e693b3640 1 -- 172.21.15.70:0/3889864451 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e641a87f0 con 0x7f8e64105380 2024-09-21T05:51:50.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.490+0000 7f8e6a3b5640 1 --2- 172.21.15.70:0/3889864451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e6410de60 0x7f8e641031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:51:50.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.491+0000 7f8e693b3640 1 --2- 172.21.15.70:0/3889864451 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e64105380 0x7f8e64102cb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8e6406b7a0 tx=0x7f8e5400ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:50.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.491+0000 7f8e5affd640 1 -- 172.21.15.70:0/3889864451 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5400cc40 con 0x7f8e64105380 2024-09-21T05:51:50.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.491+0000 7f8e6be18640 1 -- 172.21.15.70:0/3889864451 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e641a8ae0 con 0x7f8e64105380 2024-09-21T05:51:50.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.491+0000 7f8e5affd640 1 -- 172.21.15.70:0/3889864451 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f8e5400cde0 con 0x7f8e64105380 2024-09-21T05:51:50.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.491+0000 7f8e5affd640 1 -- 172.21.15.70:0/3889864451 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e54004a00 con 0x7f8e64105380 2024-09-21T05:51:50.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.491+0000 7f8e6be18640 1 -- 172.21.15.70:0/3889864451 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e641a8ff0 con 0x7f8e64105380 2024-09-21T05:51:50.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.492+0000 7f8e6be18640 1 -- 172.21.15.70:0/3889864451 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e64104e40 con 0x7f8e64105380 2024-09-21T05:51:50.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.494+0000 7f8e5affd640 1 -- 172.21.15.70:0/3889864451 <== mon.2 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f8e54005140 con 0x7f8e64105380 2024-09-21T05:51:50.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.494+0000 7f8e5affd640 1 --2- 172.21.15.70:0/3889864451 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f8e500b6510 0x7f8e500b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:50.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.495+0000 7f8e69bb4640 1 --2- 172.21.15.70:0/3889864451 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f8e500b6510 0x7f8e500b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:50.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.495+0000 7f8e5affd640 1 -- 172.21.15.70:0/3889864451 <== mon.2 v2:172.21.15.116:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f8e540e7800 con 0x7f8e64105380 2024-09-21T05:51:50.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.495+0000 7f8e69bb4640 1 --2- 172.21.15.70:0/3889864451 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f8e500b6510 0x7f8e500b8a20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8e60005d90 tx=0x7f8e60005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:50.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.498+0000 7f8e5affd640 1 -- 172.21.15.70:0/3889864451 <== mon.2 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8e54055710 con 0x7f8e64105380 2024-09-21T05:51:50.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.757+0000 7f8e6be18640 1 -- 172.21.15.70:0/3889864451 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e64103a70 con 0x7f8e64105380 2024-09-21T05:51:50.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.757+0000 7f8e5affd640 1 -- 172.21.15.70:0/3889864451 <== mon.2 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7f8e540adca0 con 0x7f8e64105380 2024-09-21T05:51:50.760 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:51:50.760 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":29,"btime":"2024-09-21T05:51:21:253819+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3519318330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3519318330},{"type":"v1","addr":"172.21.15.70:6835","nonce":3519318330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2706663460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2706663460},{"type":"v1","addr":"172.21.15.70:6837","nonce":2706663460}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:47:06.246985+0000","modified":"2024-09-21T05:51:21.134554+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24628,"mds_2":24611,"mds_3":24610,"mds_4":24598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/1914209867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1914209867},{"type":"v1","addr":"172.21.15.70:6839","nonce":1914209867}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3392175775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3392175775},{"type":"v1","addr":"172.21.15.70:6841","nonce":3392175775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/3543945704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3543945704},{"type":"v1","addr":"172.21.15.160:6833","nonce":3543945704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6833/283778129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":283778129},{"type":"v1","addr":"172.21.15.116:6833","nonce":283778129}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/3787256790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3787256790},{"type":"v1","addr":"172.21.15.116:6835","nonce":3787256790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.160:6835/2001692372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2001692372},{"type":"v1","addr":"172.21.15.160:6835","nonce":2001692372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.160:6837/2558120045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2558120045},{"type":"v1","addr":"172.21.15.160:6837","nonce":2558120045}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24611":{"gid":24611,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/444312934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":444312934},{"type":"v1","addr":"172.21.15.116:6837","nonce":444312934}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.160:6839/1339744282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1339744282},{"type":"v1","addr":"172.21.15.160:6839","nonce":1339744282}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/3952175670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3952175670},{"type":"v1","addr":"172.21.15.116:6839","nonce":3952175670}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24641,"qdb_cluster":[24641,24628,24610,24611,24598]},"id":1}]} 2024-09-21T05:51:50.760 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 29 2024-09-21T05:51:50.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.760+0000 7f8e6be18640 1 -- 172.21.15.70:0/3889864451 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f8e500b6510 msgr2=0x7f8e500b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:50.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.760+0000 7f8e6be18640 1 --2- 172.21.15.70:0/3889864451 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f8e500b6510 0x7f8e500b8a20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8e60005d90 tx=0x7f8e60005a20 comp rx=0 tx=0).stop 2024-09-21T05:51:50.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.760+0000 7f8e6be18640 1 -- 172.21.15.70:0/3889864451 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e64105380 msgr2=0x7f8e64102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:50.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.760+0000 7f8e6be18640 1 --2- 172.21.15.70:0/3889864451 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e64105380 0x7f8e64102cb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8e6406b7a0 tx=0x7f8e5400ee50 comp rx=0 tx=0).stop 2024-09-21T05:51:50.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.760+0000 7f8e6be18640 1 -- 172.21.15.70:0/3889864451 shutdown_connections 2024-09-21T05:51:50.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.760+0000 7f8e6be18640 1 --2- 172.21.15.70:0/3889864451 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f8e500b6510 0x7f8e500b8a20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:50.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.760+0000 7f8e6be18640 1 --2- 172.21.15.70:0/3889864451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e6410de60 0x7f8e641031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:50.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.760+0000 7f8e6be18640 1 --2- 172.21.15.70:0/3889864451 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e64105380 0x7f8e64102cb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:50.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.760+0000 7f8e6be18640 1 --2- 172.21.15.70:0/3889864451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e64104a30 0x7f8e64102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:50.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.760+0000 7f8e6be18640 1 -- 172.21.15.70:0/3889864451 >> 172.21.15.70:0/3889864451 conn(0x7f8e64079760 msgr2=0x7f8e64100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:50.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.760+0000 7f8e6be18640 1 -- 172.21.15.70:0/3889864451 shutdown_connections 2024-09-21T05:51:50.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:50.760+0000 7f8e6be18640 1 -- 172.21.15.70:0/3889864451 wait complete. 2024-09-21T05:51:51.484 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:51 smithi070 ceph-mon[30981]: pgmap v441: 129 pgs: 129 active+clean; 149 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 3.1 MiB/s wr, 233 op/s 2024-09-21T05:51:51.484 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:51 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3889864451' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:51.518 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24641 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0' 2024-09-21T05:51:51.518 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24641 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0 2024-09-21T05:51:51.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:51 smithi116 ceph-mon[34332]: pgmap v441: 129 pgs: 129 active+clean; 149 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 3.1 MiB/s wr, 233 op/s 2024-09-21T05:51:51.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:51 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3889864451' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:51.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:51 smithi160 ceph-mon[33979]: pgmap v441: 129 pgs: 129 active+clean; 149 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 3.1 MiB/s wr, 233 op/s 2024-09-21T05:51:51.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:51 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3889864451' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:51.859 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:52.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.410+0000 7fbb66de9640 1 -- 172.21.15.70:0/1251656912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb601083c0 msgr2=0x7fbb601087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:52.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.410+0000 7fbb66de9640 1 --2- 172.21.15.70:0/1251656912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb601083c0 0x7fbb601087d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c009900 tx=0x7fbb4c02a410 comp rx=0 tx=0).stop 2024-09-21T05:51:52.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.410+0000 7fbb66de9640 1 -- 172.21.15.70:0/1251656912 shutdown_connections 2024-09-21T05:51:52.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.410+0000 7fbb66de9640 1 --2- 172.21.15.70:0/1251656912 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb60108d10 0x7fbb6010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.410+0000 7fbb66de9640 1 --2- 172.21.15.70:0/1251656912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb601083c0 0x7fbb601087d0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.410+0000 7fbb66de9640 1 --2- 172.21.15.70:0/1251656912 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbb60102a80 0x7fbb60102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.410+0000 7fbb66de9640 1 -- 172.21.15.70:0/1251656912 >> 172.21.15.70:0/1251656912 conn(0x7fbb60079760 msgr2=0x7fbb60079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:52.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.410+0000 7fbb66de9640 1 -- 172.21.15.70:0/1251656912 shutdown_connections 2024-09-21T05:51:52.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.410+0000 7fbb66de9640 1 -- 172.21.15.70:0/1251656912 wait complete. 2024-09-21T05:51:52.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.411+0000 7fbb66de9640 1 Processor -- start 2024-09-21T05:51:52.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.411+0000 7fbb66de9640 1 -- start start 2024-09-21T05:51:52.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.411+0000 7fbb66de9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb60102a80 0x7fbb60199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:52.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.411+0000 7fbb66de9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb601083c0 0x7fbb601996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:52.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.411+0000 7fbb66de9640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbb60108d10 0x7fbb60199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:52.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.411+0000 7fbb66de9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb601129a0 con 0x7fbb601083c0 2024-09-21T05:51:52.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.411+0000 7fbb66de9640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fbb60112820 con 0x7fbb60102a80 2024-09-21T05:51:52.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.411+0000 7fbb66de9640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbb60112b20 con 0x7fbb60108d10 2024-09-21T05:51:52.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.411+0000 7fbb64b85640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb60102a80 0x7fbb60199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:52.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.411+0000 7fbb5ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb601083c0 0x7fbb601996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:52.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.411+0000 7fbb64b85640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb60102a80 0x7fbb60199160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.70:35222/0 (socket says 172.21.15.70:35222) 2024-09-21T05:51:52.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.411+0000 7fbb64b85640 1 -- 172.21.15.70:0/575767237 learned_addr learned my addr 172.21.15.70:0/575767237 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:51:52.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.412+0000 7fbb65386640 1 --2- 172.21.15.70:0/575767237 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbb60108d10 0x7fbb60199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:52.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.412+0000 7fbb5ffff640 1 -- 172.21.15.70:0/575767237 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbb60108d10 msgr2=0x7fbb60199be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:52.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.412+0000 7fbb5ffff640 1 --2- 172.21.15.70:0/575767237 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbb60108d10 0x7fbb60199be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.412+0000 7fbb5ffff640 1 -- 172.21.15.70:0/575767237 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb60102a80 msgr2=0x7fbb60199160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:52.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.412+0000 7fbb5ffff640 1 --2- 172.21.15.70:0/575767237 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb60102a80 0x7fbb60199160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.412+0000 7fbb5ffff640 1 -- 172.21.15.70:0/575767237 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb601a8810 con 0x7fbb601083c0 2024-09-21T05:51:52.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.412+0000 7fbb65386640 1 --2- 172.21.15.70:0/575767237 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbb60108d10 0x7fbb60199be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:51:52.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.412+0000 7fbb5ffff640 1 --2- 172.21.15.70:0/575767237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb601083c0 0x7fbb601996a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c02a930 tx=0x7fbb4c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:52.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.412+0000 7fbb5dffb640 1 -- 172.21.15.70:0/575767237 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c03f070 con 0x7fbb601083c0 2024-09-21T05:51:52.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.412+0000 7fbb5dffb640 1 -- 172.21.15.70:0/575767237 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fbb4c03bb20 con 0x7fbb601083c0 2024-09-21T05:51:52.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.412+0000 7fbb66de9640 1 -- 172.21.15.70:0/575767237 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb601a8aa0 con 0x7fbb601083c0 2024-09-21T05:51:52.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.412+0000 7fbb5dffb640 1 -- 172.21.15.70:0/575767237 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c035030 con 0x7fbb601083c0 2024-09-21T05:51:52.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.413+0000 7fbb66de9640 1 -- 172.21.15.70:0/575767237 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb601a8f50 con 0x7fbb601083c0 2024-09-21T05:51:52.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.416+0000 7fbb6d35d740 1 Processor -- start 2024-09-21T05:51:52.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.416+0000 7fbb6d35d740 1 -- start start 2024-09-21T05:51:52.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.416+0000 7fbb5dffb640 1 -- 172.21.15.70:0/575767237 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7fbb4c042070 con 0x7fbb601083c0 2024-09-21T05:51:52.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.417+0000 7fbb6d35d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558ae8b43840 0x558ae8eea600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:52.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.417+0000 7fbb6d35d740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ae8b1a980 0x558ae8eeab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:52.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.417+0000 7fbb6d35d740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ae8b22b60 0x558ae8eeb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:52.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.417+0000 7fbb6d35d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558ae8e60b90 con 0x558ae8b43840 2024-09-21T05:51:52.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.417+0000 7fbb6d35d740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558ae8e4ffc0 con 0x558ae8b22b60 2024-09-21T05:51:52.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.417+0000 7fbb6d35d740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x558ae8e53dd0 con 0x558ae8b1a980 2024-09-21T05:51:52.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.417+0000 7fbb65386640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558ae8b43840 0x558ae8eea600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:52.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.417+0000 7fbb5ffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ae8b22b60 0x558ae8eeb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:52.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.417+0000 7fbb65386640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558ae8b43840 0x558ae8eea600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52944/0 (socket says 172.21.15.70:52944) 2024-09-21T05:51:52.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.417+0000 7fbb5ffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ae8b22b60 0x558ae8eeb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.70:35230/0 (socket says 172.21.15.70:35230) 2024-09-21T05:51:52.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.417+0000 7fbb65386640 1 -- 172.21.15.70:0/1564171109 learned_addr learned my addr 172.21.15.70:0/1564171109 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:51:52.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.417+0000 7fbb65386640 1 -- 172.21.15.70:0/1564171109 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ae8b1a980 msgr2=0x558ae8eeab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:51:52.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.417+0000 7fbb65386640 1 --2- 172.21.15.70:0/1564171109 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ae8b1a980 0x558ae8eeab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.417+0000 7fbb65386640 1 -- 172.21.15.70:0/1564171109 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ae8b22b60 msgr2=0x558ae8eeb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:51:52.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.417+0000 7fbb65386640 1 --2- 172.21.15.70:0/1564171109 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ae8b22b60 0x558ae8eeb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.417+0000 7fbb65386640 1 -- 172.21.15.70:0/1564171109 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ae8dd7060 con 0x558ae8b43840 2024-09-21T05:51:52.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.417+0000 7fbb5ffff640 1 --2- 172.21.15.70:0/1564171109 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ae8b22b60 0x558ae8eeb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:51:52.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.417+0000 7fbb65386640 1 --2- 172.21.15.70:0/1564171109 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558ae8b43840 0x558ae8eea600 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fbb58011790 tx=0x7fbb58011c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2f29f4921a7cef8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:52.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.418+0000 7fbb5dffb640 1 --2- 172.21.15.70:0/575767237 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fbb500b6510 0x7fbb500b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:52.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.418+0000 7fbb4affd640 1 -- 172.21.15.70:0/1564171109 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58003c30 con 0x558ae8b43840 2024-09-21T05:51:52.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.418+0000 7fbb4affd640 1 -- 172.21.15.70:0/1564171109 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fbb5800fe50 con 0x558ae8b43840 2024-09-21T05:51:52.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.418+0000 7fbb4affd640 1 -- 172.21.15.70:0/1564171109 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb580193e0 con 0x558ae8b43840 2024-09-21T05:51:52.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.418+0000 7fbb64b85640 1 --2- 172.21.15.70:0/575767237 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fbb500b6510 0x7fbb500b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:52.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.418+0000 7fbb5dffb640 1 -- 172.21.15.70:0/575767237 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fbb4c107be0 con 0x7fbb601083c0 2024-09-21T05:51:52.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.419+0000 7fbb6d35d740 1 -- 172.21.15.70:0/1564171109 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558ae8b43840 msgr2=0x558ae8eea600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:52.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.419+0000 7fbb6d35d740 1 --2- 172.21.15.70:0/1564171109 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558ae8b43840 0x558ae8eea600 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fbb58011790 tx=0x7fbb58011c50 comp rx=0 tx=0).stop 2024-09-21T05:51:52.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.419+0000 7fbb64b85640 1 --2- 172.21.15.70:0/575767237 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fbb500b6510 0x7fbb500b8a20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbb54009810 tx=0x7fbb540097a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:52.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.419+0000 7fbb6d35d740 1 -- 172.21.15.70:0/1564171109 shutdown_connections 2024-09-21T05:51:52.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.419+0000 7fbb6d35d740 1 --2- 172.21.15.70:0/1564171109 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ae8b1a980 0x558ae8eeab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.419+0000 7fbb6d35d740 1 --2- 172.21.15.70:0/1564171109 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ae8b22b60 0x558ae8eeb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.419+0000 7fbb6d35d740 1 --2- 172.21.15.70:0/1564171109 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558ae8b43840 0x558ae8eea600 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.419+0000 7fbb6d35d740 1 -- 172.21.15.70:0/1564171109 >> 172.21.15.70:0/1564171109 conn(0x558ae8b37990 msgr2=0x558ae8ee84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:52.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.419+0000 7fbb6d35d740 1 -- 172.21.15.70:0/1564171109 shutdown_connections 2024-09-21T05:51:52.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.419+0000 7fbb6d35d740 1 -- 172.21.15.70:0/1564171109 wait complete. 2024-09-21T05:51:52.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.419+0000 7fbb6d35d740 1 -- start start 2024-09-21T05:51:52.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.420+0000 7fbb6d35d740 1 Processor -- start 2024-09-21T05:51:52.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.420+0000 7fbb6d35d740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ae8b1a980 0x558ae8ef6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:52.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.420+0000 7fbb6d35d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558ae8b22b60 0x558ae8ef67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:52.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.420+0000 7fbb6d35d740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ae8b43840 0x558ae8f02100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:52.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.420+0000 7fbb6d35d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558ae8cb17a0 con 0x558ae8b22b60 2024-09-21T05:51:52.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.420+0000 7fbb6d35d740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558ae8df50a0 con 0x558ae8b1a980 2024-09-21T05:51:52.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.420+0000 7fbb6d35d740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x558ae8ef8de0 con 0x558ae8b43840 2024-09-21T05:51:52.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.420+0000 7fbb64b85640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ae8b1a980 0x558ae8ef6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:52.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.420+0000 7fbb5ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558ae8b22b60 0x558ae8ef67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:52.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.420+0000 7fbb64b85640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ae8b1a980 0x558ae8ef6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.70:35244/0 (socket says 172.21.15.70:35244) 2024-09-21T05:51:52.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.420+0000 7fbb6d35d740 10 client.0 _ll_register_callbacks cb 0x558ae8dd23c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:51:52.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.420+0000 7fbb64b85640 1 -- 172.21.15.70:0/2637226351 learned_addr learned my addr 172.21.15.70:0/2637226351 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:51:52.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.420+0000 7fbb65386640 1 --2- 172.21.15.70:0/2637226351 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ae8b43840 0x558ae8f02100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:52.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.421+0000 7fbb64b85640 1 -- 172.21.15.70:0/2637226351 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ae8b43840 msgr2=0x558ae8f02100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:51:52.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.421+0000 7fbb64b85640 1 --2- 172.21.15.70:0/2637226351 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ae8b43840 0x558ae8f02100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.421+0000 7fbb64b85640 1 -- 172.21.15.70:0/2637226351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558ae8b22b60 msgr2=0x558ae8ef67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:51:52.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.421+0000 7fbb64b85640 1 --2- 172.21.15.70:0/2637226351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558ae8b22b60 0x558ae8ef67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.421+0000 7fbb64b85640 1 -- 172.21.15.70:0/2637226351 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ae8de3880 con 0x558ae8b1a980 2024-09-21T05:51:52.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.421+0000 7fbb64b85640 1 --2- 172.21.15.70:0/2637226351 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ae8b1a980 0x558ae8ef6240 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbb54012fd0 tx=0x7fbb54005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73f207ddddfe9f59 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:52.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.421+0000 7fbb3ffff640 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2024-09-21T05:51:52.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.421+0000 7fbb3ffff640 1 -- 172.21.15.70:0/2637226351 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5402b060 con 0x558ae8b1a980 2024-09-21T05:51:52.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.421+0000 7fbb3ffff640 1 -- 172.21.15.70:0/2637226351 <== mon.2 v2:172.21.15.116:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fbb5401a860 con 0x558ae8b1a980 2024-09-21T05:51:52.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.421+0000 7fbb6d35d740 1 -- 172.21.15.70:0/2637226351 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb5800fe50 con 0x558ae8b1a980 2024-09-21T05:51:52.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.421+0000 7fbb3ffff640 1 -- 172.21.15.70:0/2637226351 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbb54032050 con 0x558ae8b1a980 2024-09-21T05:51:52.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.422+0000 7fbb6d35d740 10 client.25295 fetch_fsmap learned FSMap version 29 2024-09-21T05:51:52.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.422+0000 7fbb6d35d740 1 -- 172.21.15.70:0/2637226351 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558ae8bbdb90 con 0x558ae8b1a980 2024-09-21T05:51:52.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.422+0000 7fbb3ffff640 1 -- 172.21.15.70:0/2637226351 <== mon.2 v2:172.21.15.116:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fbb5800fe50 con 0x558ae8b1a980 2024-09-21T05:51:52.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.422+0000 7fbb3ffff640 1 -- 172.21.15.70:0/2637226351 <== mon.2 v2:172.21.15.116:3300/0 5 ==== fsmap(e 29) ==== 8386+0+0 (secure 0 0 0) 0x7fbb5400fb50 con 0x558ae8b1a980 2024-09-21T05:51:52.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.422+0000 7fbb6d35d740 10 client.25295 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T05:51:52.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.422+0000 7fbb6d35d740 10 client.25295 resolve_mds: validated gid 24641 aka daemon mds.b 2024-09-21T05:51:52.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.422+0000 7fbb6d35d740 20 client.25295 populate_metadata read hostname 'smithi070' 2024-09-21T05:51:52.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.422+0000 7fbb6d35d740 1 --2- 172.21.15.70:0/2637226351 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x558ae8b021c0 0x558ae8f083d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:52.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.422+0000 7fbb6d35d740 4 client.25295 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:51:52.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.422+0000 7fbb6d35d740 1 -- 172.21.15.70:0/2637226351 --> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ae8e62ae0 con 0x558ae8b021c0 2024-09-21T05:51:52.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.422+0000 7fbb5ffff640 1 --2- 172.21.15.70:0/2637226351 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x558ae8b021c0 0x558ae8f083d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:52.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.423+0000 7fbb3ffff640 10 client.25295 ms_handle_connect on v2:172.21.15.116:6838/3952175670 2024-09-21T05:51:52.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.424+0000 7fbb5ffff640 1 --2- 172.21.15.70:0/2637226351 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x558ae8b021c0 0x558ae8f083d0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64acfce99f6e4782 server_cookie=9d84876fd99fe37e in_seq=0 out_seq=0 2024-09-21T05:51:52.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.424+0000 7fbb3ffff640 1 -- 172.21.15.70:0/2637226351 <== mds.0 v2:172.21.15.116:6838/3952175670 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558ae8e62ae0 con 0x558ae8b021c0 2024-09-21T05:51:52.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.424+0000 7fbb3ffff640 10 client.25295 handle_command_reply: tid=0 2024-09-21T05:51:52.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.424+0000 7fbb6d35d740 1 client.25295 shutdown 2024-09-21T05:51:52.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.424+0000 7fbb6d35d740 1 -- 172.21.15.70:0/2637226351 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ae8b1a980 msgr2=0x558ae8ef6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:52.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.424+0000 7fbb6d35d740 1 --2- 172.21.15.70:0/2637226351 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ae8b1a980 0x558ae8ef6240 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbb54012fd0 tx=0x7fbb54005f90 comp rx=0 tx=0).stop 2024-09-21T05:51:52.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.425+0000 7fbb6d35d740 1 -- 172.21.15.70:0/2637226351 shutdown_connections 2024-09-21T05:51:52.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.425+0000 7fbb6d35d740 1 --2- 172.21.15.70:0/2637226351 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x558ae8b021c0 0x558ae8f083d0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.425+0000 7fbb6d35d740 1 --2- 172.21.15.70:0/2637226351 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ae8b43840 0x558ae8f02100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.425+0000 7fbb3ffff640 0 client.25295 ms_handle_reset on v2:172.21.15.116:6838/3952175670 2024-09-21T05:51:52.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.425+0000 7fbb6d35d740 1 --2- 172.21.15.70:0/2637226351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558ae8b22b60 0x558ae8ef67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.425+0000 7fbb6d35d740 1 --2- 172.21.15.70:0/2637226351 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ae8b1a980 0x558ae8ef6240 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.425+0000 7fbb6d35d740 1 -- 172.21.15.70:0/2637226351 >> 172.21.15.70:0/2637226351 conn(0x558ae8b37990 msgr2=0x558ae8eed7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:52.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.425+0000 7fbb6d35d740 1 -- 172.21.15.70:0/2637226351 shutdown_connections 2024-09-21T05:51:52.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.425+0000 7fbb6d35d740 1 -- 172.21.15.70:0/2637226351 wait complete. 2024-09-21T05:51:52.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.425+0000 7fbb6d35d740 20 client.25295 trim_cache size 0 max 16384 2024-09-21T05:51:52.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.445+0000 7fbb6d35d740 1 Processor -- start 2024-09-21T05:51:52.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.445+0000 7fbb6d35d740 1 -- start start 2024-09-21T05:51:52.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.445+0000 7fbb6d35d740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ae8b021c0 0x558ae8eebd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:52.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.445+0000 7fbb6d35d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558ae8b1a980 0x558ae8eef880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:52.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.445+0000 7fbb6d35d740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ae8b22b60 0x558ae8eefdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:52.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.445+0000 7fbb6d35d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb601b2e40 con 0x558ae8b1a980 2024-09-21T05:51:52.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.445+0000 7fbb6d35d740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fbb601b4a40 con 0x558ae8b021c0 2024-09-21T05:51:52.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.445+0000 7fbb6d35d740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbb601b3510 con 0x558ae8b22b60 2024-09-21T05:51:52.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.445+0000 7fbb5ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558ae8b1a980 0x558ae8eef880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:52.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.445+0000 7fbb5ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558ae8b1a980 0x558ae8eef880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52962/0 (socket says 172.21.15.70:52962) 2024-09-21T05:51:52.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.445+0000 7fbb5ffff640 1 -- 172.21.15.70:0/2394347324 learned_addr learned my addr 172.21.15.70:0/2394347324 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:51:52.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.445+0000 7fbb65386640 1 --2- 172.21.15.70:0/2394347324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ae8b22b60 0x558ae8eefdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:52.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.445+0000 7fbb64b85640 1 --2- 172.21.15.70:0/2394347324 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ae8b021c0 0x558ae8eebd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:52.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.445+0000 7fbb5ffff640 1 -- 172.21.15.70:0/2394347324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ae8b22b60 msgr2=0x558ae8eefdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:51:52.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.445+0000 7fbb5ffff640 1 --2- 172.21.15.70:0/2394347324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ae8b22b60 0x558ae8eefdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.445+0000 7fbb5ffff640 1 -- 172.21.15.70:0/2394347324 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ae8b021c0 msgr2=0x558ae8eebd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:51:52.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.445+0000 7fbb5ffff640 1 --2- 172.21.15.70:0/2394347324 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ae8b021c0 0x558ae8eebd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.445+0000 7fbb5ffff640 1 -- 172.21.15.70:0/2394347324 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ae8eed460 con 0x558ae8b1a980 2024-09-21T05:51:52.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.446+0000 7fbb5ffff640 1 --2- 172.21.15.70:0/2394347324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558ae8b1a980 0x558ae8eef880 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c0cd9c0 tx=0x7fbb4c10b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a19cbe11eca64a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:52.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.446+0000 7fbb4a7fc640 1 -- 172.21.15.70:0/2394347324 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c049040 con 0x558ae8b1a980 2024-09-21T05:51:52.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.446+0000 7fbb4a7fc640 1 -- 172.21.15.70:0/2394347324 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fbb4c0cd540 con 0x558ae8b1a980 2024-09-21T05:51:52.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.446+0000 7fbb4a7fc640 1 -- 172.21.15.70:0/2394347324 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c0c91a0 con 0x558ae8b1a980 2024-09-21T05:51:52.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.447+0000 7fbb6d35d740 1 -- 172.21.15.70:0/2394347324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558ae8b1a980 msgr2=0x558ae8eef880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:52.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.447+0000 7fbb6d35d740 1 --2- 172.21.15.70:0/2394347324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558ae8b1a980 0x558ae8eef880 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c0cd9c0 tx=0x7fbb4c10b6c0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.447+0000 7fbb6d35d740 1 -- 172.21.15.70:0/2394347324 shutdown_connections 2024-09-21T05:51:52.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.447+0000 7fbb6d35d740 1 --2- 172.21.15.70:0/2394347324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ae8b22b60 0x558ae8eefdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.447+0000 7fbb6d35d740 1 --2- 172.21.15.70:0/2394347324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558ae8b1a980 0x558ae8eef880 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.447+0000 7fbb6d35d740 1 --2- 172.21.15.70:0/2394347324 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ae8b021c0 0x558ae8eebd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.447+0000 7fbb6d35d740 1 -- 172.21.15.70:0/2394347324 >> 172.21.15.70:0/2394347324 conn(0x558ae8b37990 msgr2=0x558ae8eeb630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:52.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.447+0000 7fbb6d35d740 1 -- 172.21.15.70:0/2394347324 shutdown_connections 2024-09-21T05:51:52.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.447+0000 7fbb6d35d740 1 -- 172.21.15.70:0/2394347324 wait complete. 2024-09-21T05:51:52.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.447+0000 7fbb6d35d740 1 -- start start 2024-09-21T05:51:52.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.447+0000 7fbb6d35d740 1 Processor -- start 2024-09-21T05:51:52.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.448+0000 7fbb6d35d740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ae8b021c0 0x558ae8ef9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:52.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.448+0000 7fbb6d35d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558ae8b1a980 0x558ae8ef9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:52.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.448+0000 7fbb6d35d740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ae8b22b60 0x558ae8f72d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:52.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.448+0000 7fbb6d35d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb601b42b0 con 0x558ae8b1a980 2024-09-21T05:51:52.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.448+0000 7fbb6d35d740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fbb601b3be0 con 0x558ae8b22b60 2024-09-21T05:51:52.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.448+0000 7fbb6d35d740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbb601b0e20 con 0x558ae8b021c0 2024-09-21T05:51:52.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.448+0000 7fbb6d35d740 10 client.0 _ll_register_callbacks cb 0x7fbb54009b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:51:52.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.448+0000 7fbb64b85640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ae8b021c0 0x558ae8ef9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:52.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.448+0000 7fbb5ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558ae8b1a980 0x558ae8ef9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:52.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.448+0000 7fbb5ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558ae8b1a980 0x558ae8ef9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52976/0 (socket says 172.21.15.70:52976) 2024-09-21T05:51:52.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.448+0000 7fbb5ffff640 1 -- 172.21.15.70:0/3573850200 learned_addr learned my addr 172.21.15.70:0/3573850200 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:51:52.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.448+0000 7fbb65386640 1 --2- 172.21.15.70:0/3573850200 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ae8b22b60 0x558ae8f72d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:52.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.448+0000 7fbb5ffff640 1 -- 172.21.15.70:0/3573850200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ae8b021c0 msgr2=0x558ae8ef9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:51:52.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.449+0000 7fbb5ffff640 1 --2- 172.21.15.70:0/3573850200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ae8b021c0 0x558ae8ef9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.449+0000 7fbb5ffff640 1 -- 172.21.15.70:0/3573850200 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ae8b22b60 msgr2=0x558ae8f72d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:51:52.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.449+0000 7fbb5ffff640 1 --2- 172.21.15.70:0/3573850200 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ae8b22b60 0x558ae8f72d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.449+0000 7fbb5ffff640 1 -- 172.21.15.70:0/3573850200 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ae8efa280 con 0x558ae8b1a980 2024-09-21T05:51:52.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.449+0000 7fbb65386640 1 --2- 172.21.15.70:0/3573850200 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ae8b22b60 0x558ae8f72d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:51:52.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.449+0000 7fbb64b85640 1 --2- 172.21.15.70:0/3573850200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ae8b021c0 0x558ae8ef9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:51:52.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.449+0000 7fbb5ffff640 1 --2- 172.21.15.70:0/3573850200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558ae8b1a980 0x558ae8ef9990 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c0f0000 tx=0x7fbb4c0f1100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75233ceae45ee5a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:52.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.449+0000 7fbb3ffff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:51:52.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.449+0000 7fbb3ffff640 1 -- 172.21.15.70:0/3573850200 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c049040 con 0x558ae8b1a980 2024-09-21T05:51:52.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.449+0000 7fbb6d35d740 1 -- 172.21.15.70:0/3573850200 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb4c0cd540 con 0x558ae8b1a980 2024-09-21T05:51:52.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.449+0000 7fbb3ffff640 1 -- 172.21.15.70:0/3573850200 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fbb4c0c9ca0 con 0x558ae8b1a980 2024-09-21T05:51:52.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.449+0000 7fbb3ffff640 1 -- 172.21.15.70:0/3573850200 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbb4c0c91a0 con 0x558ae8b1a980 2024-09-21T05:51:52.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.449+0000 7fbb6d35d740 10 client.15759 fetch_fsmap learned FSMap version 29 2024-09-21T05:51:52.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.449+0000 7fbb6d35d740 1 -- 172.21.15.70:0/3573850200 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558ae8f74300 con 0x558ae8b1a980 2024-09-21T05:51:52.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.449+0000 7fbb3ffff640 1 -- 172.21.15.70:0/3573850200 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fbb4c0cd540 con 0x558ae8b1a980 2024-09-21T05:51:52.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.449+0000 7fbb3ffff640 1 -- 172.21.15.70:0/3573850200 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8386+0+0 (secure 0 0 0) 0x7fbb4c0d6f10 con 0x558ae8b1a980 2024-09-21T05:51:52.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.450+0000 7fbb6d35d740 10 client.15759 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T05:51:52.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.450+0000 7fbb6d35d740 10 client.15759 resolve_mds: validated gid 24641 aka daemon mds.b 2024-09-21T05:51:52.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.450+0000 7fbb6d35d740 20 client.15759 populate_metadata read hostname 'smithi070' 2024-09-21T05:51:52.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.450+0000 7fbb6d35d740 1 --2- 172.21.15.70:0/3573850200 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x558ae8b43840 0x558ae8f76af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:52.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.450+0000 7fbb6d35d740 4 client.15759 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}] 2024-09-21T05:51:52.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.450+0000 7fbb6d35d740 1 -- 172.21.15.70:0/3573850200 --> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}) -- 0x558ae8e5e590 con 0x558ae8b43840 2024-09-21T05:51:52.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.450+0000 7fbb64b85640 1 --2- 172.21.15.70:0/3573850200 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x558ae8b43840 0x558ae8f76af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:52.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.450+0000 7fbb3ffff640 10 client.15759 ms_handle_connect on v2:172.21.15.116:6838/3952175670 2024-09-21T05:51:52.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:52.450+0000 7fbb64b85640 1 --2- 172.21.15.70:0/3573850200 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x558ae8b43840 0x558ae8f76af0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6717ba26f122cbc server_cookie=6aee58aa604696b7 in_seq=0 out_seq=0 2024-09-21T05:51:53.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:53 smithi116 ceph-mon[34332]: pgmap v442: 129 pgs: 129 active+clean; 154 MiB data, 704 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 269 op/s 2024-09-21T05:51:53.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:53 smithi160 ceph-mon[33979]: pgmap v442: 129 pgs: 129 active+clean; 154 MiB data, 704 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 269 op/s 2024-09-21T05:51:53.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:53 smithi070 ceph-mon[30981]: pgmap v442: 129 pgs: 129 active+clean; 154 MiB data, 704 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 269 op/s 2024-09-21T05:51:55.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:55.211+0000 7fbb3ffff640 1 -- 172.21.15.70:0/3573850200 <== mds.0 v2:172.21.15.116:6838/3952175670 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x558ae8e5e590 con 0x558ae8b43840 2024-09-21T05:51:55.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:55.211+0000 7fbb3ffff640 10 client.15759 handle_command_reply: tid=0 2024-09-21T05:51:55.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:55.212+0000 7fbb6d35d740 1 client.15759 shutdown 2024-09-21T05:51:55.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:55.212+0000 7fbb6d35d740 1 -- 172.21.15.70:0/3573850200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558ae8b1a980 msgr2=0x558ae8ef9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:55.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:55.212+0000 7fbb6d35d740 1 --2- 172.21.15.70:0/3573850200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558ae8b1a980 0x558ae8ef9990 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c0f0000 tx=0x7fbb4c0f1100 comp rx=0 tx=0).stop 2024-09-21T05:51:55.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:55.212+0000 7fbb6d35d740 1 -- 172.21.15.70:0/3573850200 shutdown_connections 2024-09-21T05:51:55.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:55.212+0000 7fbb6d35d740 1 --2- 172.21.15.70:0/3573850200 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x558ae8b43840 0x558ae8f76af0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:55.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:55.212+0000 7fbb3ffff640 0 client.15759 ms_handle_reset on v2:172.21.15.116:6838/3952175670 2024-09-21T05:51:55.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:55.212+0000 7fbb6d35d740 1 --2- 172.21.15.70:0/3573850200 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ae8b22b60 0x558ae8f72d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:55.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:55.212+0000 7fbb6d35d740 1 --2- 172.21.15.70:0/3573850200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558ae8b1a980 0x558ae8ef9990 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:55.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:55.212+0000 7fbb6d35d740 1 --2- 172.21.15.70:0/3573850200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ae8b021c0 0x558ae8ef9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:55.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:55.212+0000 7fbb6d35d740 1 -- 172.21.15.70:0/3573850200 >> 172.21.15.70:0/3573850200 conn(0x558ae8b37990 msgr2=0x558ae8eed700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:55.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:55.212+0000 7fbb6d35d740 1 -- 172.21.15.70:0/3573850200 shutdown_connections 2024-09-21T05:51:55.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:55.212+0000 7fbb6d35d740 1 -- 172.21.15.70:0/3573850200 wait complete. 2024-09-21T05:51:55.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:55.212+0000 7fbb6d35d740 20 client.15759 trim_cache size 0 max 16384 2024-09-21T05:51:55.216 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:51:55.216 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 29, 2024-09-21T05:51:55.216 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 24641, 2024-09-21T05:51:55.216 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 10, 2024-09-21T05:51:55.216 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-09-21T05:51:55.216 INFO:teuthology.orchestra.run.smithi070.stdout: "b9a6d9bb": { 2024-09-21T05:51:55.216 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 10, 2024-09-21T05:51:55.216 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-09-21T05:51:55.216 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-09-21T05:51:55.216 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-09-21T05:51:55.217 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-09-21T05:51:55.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:51:55.217 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 90.0, 2024-09-21T05:51:55.217 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 147.8, 2024-09-21T05:51:55.217 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-09-21T05:51:55.217 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-09-21T05:51:55.217 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-09-21T05:51:55.217 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-09-21T05:51:55.217 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-09-21T05:51:55.217 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-09-21T05:51:55.217 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:51:55.217 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:51:55.217 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:51:55.217 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:51:55.217 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:51:55.218 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:51:55.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:55.213+0000 7fbb66de9640 1 -- 172.21.15.70:0/575767237 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fbb500b6510 msgr2=0x7fbb500b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:55.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:55.213+0000 7fbb66de9640 1 --2- 172.21.15.70:0/575767237 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fbb500b6510 0x7fbb500b8a20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbb54009810 tx=0x7fbb540097a0 comp rx=0 tx=0).stop 2024-09-21T05:51:55.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:55.213+0000 7fbb66de9640 1 -- 172.21.15.70:0/575767237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb601083c0 msgr2=0x7fbb601996a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:55.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:55.213+0000 7fbb66de9640 1 --2- 172.21.15.70:0/575767237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb601083c0 0x7fbb601996a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c02a930 tx=0x7fbb4c003c10 comp rx=0 tx=0).stop 2024-09-21T05:51:55.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:55.213+0000 7fbb66de9640 1 -- 172.21.15.70:0/575767237 shutdown_connections 2024-09-21T05:51:55.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:55.213+0000 7fbb66de9640 1 --2- 172.21.15.70:0/575767237 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fbb500b6510 0x7fbb500b8a20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:55.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:55.213+0000 7fbb66de9640 1 --2- 172.21.15.70:0/575767237 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbb60108d10 0x7fbb60199be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:55.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:55.213+0000 7fbb66de9640 1 --2- 172.21.15.70:0/575767237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb601083c0 0x7fbb601996a0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:55.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:55.213+0000 7fbb66de9640 1 --2- 172.21.15.70:0/575767237 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb60102a80 0x7fbb60199160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:55.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:55.213+0000 7fbb66de9640 1 -- 172.21.15.70:0/575767237 >> 172.21.15.70:0/575767237 conn(0x7fbb60079760 msgr2=0x7fbb601044e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:55.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:55.213+0000 7fbb66de9640 1 -- 172.21.15.70:0/575767237 shutdown_connections 2024-09-21T05:51:55.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:51:55.213+0000 7fbb66de9640 1 -- 172.21.15.70:0/575767237 wait complete. 2024-09-21T05:51:55.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:55 smithi070 ceph-mon[30981]: pgmap v443: 129 pgs: 129 active+clean; 154 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 310 op/s 2024-09-21T05:51:55.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:55 smithi160 ceph-mon[33979]: pgmap v443: 129 pgs: 129 active+clean; 154 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 310 op/s 2024-09-21T05:51:55.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:55 smithi116 ceph-mon[34332]: pgmap v443: 129 pgs: 129 active+clean; 154 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 310 op/s 2024-09-21T05:51:55.976 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b9a6d9bb', quiesce took 6.4 seconds. Will release after: 21.4 2024-09-21T05:51:57.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:57 smithi160 ceph-mon[33979]: pgmap v444: 129 pgs: 129 active+clean; 155 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 989 KiB/s rd, 1.3 MiB/s wr, 301 op/s 2024-09-21T05:51:57.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:57 smithi070 ceph-mon[30981]: pgmap v444: 129 pgs: 129 active+clean; 155 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 989 KiB/s rd, 1.3 MiB/s wr, 301 op/s 2024-09-21T05:51:57.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:57 smithi116 ceph-mon[34332]: pgmap v444: 129 pgs: 129 active+clean; 155 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 989 KiB/s rd, 1.3 MiB/s wr, 301 op/s 2024-09-21T05:51:59.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:51:59 smithi160 ceph-mon[33979]: pgmap v445: 129 pgs: 129 active+clean; 156 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 335 op/s 2024-09-21T05:51:59.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:51:59 smithi070 ceph-mon[30981]: pgmap v445: 129 pgs: 129 active+clean; 156 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 335 op/s 2024-09-21T05:51:59.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:51:59 smithi116 ceph-mon[34332]: pgmap v445: 129 pgs: 129 active+clean; 156 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 335 op/s 2024-09-21T05:52:01.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:01 smithi160 ceph-mon[33979]: pgmap v446: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 947 KiB/s wr, 305 op/s 2024-09-21T05:52:01.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:01 smithi070 ceph-mon[30981]: pgmap v446: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 947 KiB/s wr, 305 op/s 2024-09-21T05:52:01.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:01 smithi116 ceph-mon[34332]: pgmap v446: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 947 KiB/s wr, 305 op/s 2024-09-21T05:52:03.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:03 smithi160 ceph-mon[33979]: pgmap v447: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 863 KiB/s wr, 235 op/s 2024-09-21T05:52:03.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:03 smithi070 ceph-mon[30981]: pgmap v447: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 863 KiB/s wr, 235 op/s 2024-09-21T05:52:03.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:03 smithi116 ceph-mon[34332]: pgmap v447: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 863 KiB/s wr, 235 op/s 2024-09-21T05:52:05.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:05 smithi160 ceph-mon[33979]: pgmap v448: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 415 KiB/s wr, 191 op/s 2024-09-21T05:52:05.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:05 smithi070 ceph-mon[30981]: pgmap v448: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 415 KiB/s wr, 191 op/s 2024-09-21T05:52:05.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:05 smithi116 ceph-mon[34332]: pgmap v448: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 415 KiB/s wr, 191 op/s 2024-09-21T05:52:07.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:07 smithi160 ceph-mon[33979]: pgmap v449: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 315 KiB/s wr, 136 op/s 2024-09-21T05:52:07.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:07 smithi070 ceph-mon[30981]: pgmap v449: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 315 KiB/s wr, 136 op/s 2024-09-21T05:52:07.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:07 smithi116 ceph-mon[34332]: pgmap v449: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 315 KiB/s wr, 136 op/s 2024-09-21T05:52:09.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:09 smithi160 ceph-mon[33979]: pgmap v450: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 224 KiB/s wr, 100 op/s 2024-09-21T05:52:09.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:09 smithi070 ceph-mon[30981]: pgmap v450: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 224 KiB/s wr, 100 op/s 2024-09-21T05:52:09.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:09 smithi116 ceph-mon[34332]: pgmap v450: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 224 KiB/s wr, 100 op/s 2024-09-21T05:52:10.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:10 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:52:10.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:10 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:52:10.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:10 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:52:10.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:10 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:52:10.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:10 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:52:10.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:10 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:52:10.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:10 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:52:10.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:10 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:52:10.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:10 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:52:10.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:10 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:52:10.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:10 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:52:10.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:10 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:52:11.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:11 smithi160 ceph-mon[33979]: pgmap v451: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 24 op/s 2024-09-21T05:52:11.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:11 smithi070 ceph-mon[30981]: pgmap v451: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 24 op/s 2024-09-21T05:52:11.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:11 smithi116 ceph-mon[34332]: pgmap v451: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 24 op/s 2024-09-21T05:52:13.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:13 smithi160 ceph-mon[33979]: pgmap v452: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-21T05:52:13.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:13 smithi070 ceph-mon[30981]: pgmap v452: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-21T05:52:13.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:13 smithi116 ceph-mon[34332]: pgmap v452: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-21T05:52:15.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:15 smithi160 ceph-mon[33979]: pgmap v453: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 3.9 KiB/s wr, 11 op/s 2024-09-21T05:52:15.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:15 smithi070 ceph-mon[30981]: pgmap v453: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 3.9 KiB/s wr, 11 op/s 2024-09-21T05:52:15.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:15 smithi116 ceph-mon[34332]: pgmap v453: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 3.9 KiB/s wr, 11 op/s 2024-09-21T05:52:17.377 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:52:17.637 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:17.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:17 smithi160 ceph-mon[33979]: pgmap v454: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 3.8 KiB/s wr, 10 op/s 2024-09-21T05:52:17.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:17 smithi070 ceph-mon[30981]: pgmap v454: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 3.8 KiB/s wr, 10 op/s 2024-09-21T05:52:17.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:17 smithi116 ceph-mon[34332]: pgmap v454: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 3.8 KiB/s wr, 10 op/s 2024-09-21T05:52:18.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.131+0000 7f79d94fe640 1 -- 172.21.15.70:0/1448778421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79d4108cf0 msgr2=0x7f79d410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:18.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.131+0000 7f79d94fe640 1 --2- 172.21.15.70:0/1448778421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79d4108cf0 0x7f79d410f520 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f79cc009ca0 tx=0x7f79cc02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:52:18.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.131+0000 7f79d94fe640 1 -- 172.21.15.70:0/1448778421 shutdown_connections 2024-09-21T05:52:18.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.131+0000 7f79d94fe640 1 --2- 172.21.15.70:0/1448778421 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79d41083a0 0x7f79d41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:18.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.131+0000 7f79d94fe640 1 --2- 172.21.15.70:0/1448778421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79d4108cf0 0x7f79d410f520 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:18.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.131+0000 7f79d94fe640 1 --2- 172.21.15.70:0/1448778421 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79d4102a60 0x7f79d4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:18.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.131+0000 7f79d94fe640 1 -- 172.21.15.70:0/1448778421 >> 172.21.15.70:0/1448778421 conn(0x7f79d4079730 msgr2=0x7f79d4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:18.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.131+0000 7f79d94fe640 1 -- 172.21.15.70:0/1448778421 shutdown_connections 2024-09-21T05:52:18.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.131+0000 7f79d94fe640 1 -- 172.21.15.70:0/1448778421 wait complete. 2024-09-21T05:52:18.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.132+0000 7f79d94fe640 1 Processor -- start 2024-09-21T05:52:18.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.132+0000 7f79d94fe640 1 -- start start 2024-09-21T05:52:18.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.133+0000 7f79d94fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79d4102a60 0x7f79d419a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:18.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.133+0000 7f79d94fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79d41083a0 0x7f79d419a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:18.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.133+0000 7f79d94fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79d4108cf0 0x7f79d419fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:18.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.133+0000 7f79d94fe640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f79d4113a50 con 0x7f79d4102a60 2024-09-21T05:52:18.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.133+0000 7f79d94fe640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f79d41138d0 con 0x7f79d4108cf0 2024-09-21T05:52:18.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.133+0000 7f79d94fe640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f79d4113bd0 con 0x7f79d41083a0 2024-09-21T05:52:18.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.133+0000 7f79d2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79d4102a60 0x7f79d419a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:18.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.133+0000 7f79d2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79d4102a60 0x7f79d419a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59754/0 (socket says 172.21.15.70:59754) 2024-09-21T05:52:18.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.133+0000 7f79d2ffd640 1 -- 172.21.15.70:0/22423992 learned_addr learned my addr 172.21.15.70:0/22423992 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:52:18.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.133+0000 7f79ca7fc640 1 --2- 172.21.15.70:0/22423992 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79d41083a0 0x7f79d419a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:18.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.133+0000 7f79d37fe640 1 --2- 172.21.15.70:0/22423992 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79d4108cf0 0x7f79d419fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:18.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.133+0000 7f79d2ffd640 1 -- 172.21.15.70:0/22423992 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79d41083a0 msgr2=0x7f79d419a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:18.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.133+0000 7f79d2ffd640 1 --2- 172.21.15.70:0/22423992 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79d41083a0 0x7f79d419a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:18.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.133+0000 7f79d2ffd640 1 -- 172.21.15.70:0/22423992 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79d4108cf0 msgr2=0x7f79d419fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:18.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.133+0000 7f79d2ffd640 1 --2- 172.21.15.70:0/22423992 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79d4108cf0 0x7f79d419fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:18.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.133+0000 7f79d2ffd640 1 -- 172.21.15.70:0/22423992 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d41a03b0 con 0x7f79d4102a60 2024-09-21T05:52:18.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.133+0000 7f79d2ffd640 1 --2- 172.21.15.70:0/22423992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79d4102a60 0x7f79d419a440 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f79c400d950 tx=0x7f79c400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:18.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.134+0000 7f79d0ff9640 1 -- 172.21.15.70:0/22423992 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c4017030 con 0x7f79d4102a60 2024-09-21T05:52:18.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.134+0000 7f79d0ff9640 1 -- 172.21.15.70:0/22423992 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f79c4004020 con 0x7f79d4102a60 2024-09-21T05:52:18.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.134+0000 7f79d94fe640 1 -- 172.21.15.70:0/22423992 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79d41a06a0 con 0x7f79d4102a60 2024-09-21T05:52:18.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.134+0000 7f79d0ff9640 1 -- 172.21.15.70:0/22423992 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c40047a0 con 0x7f79d4102a60 2024-09-21T05:52:18.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.134+0000 7f79d94fe640 1 -- 172.21.15.70:0/22423992 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79d41a6e00 con 0x7f79d4102a60 2024-09-21T05:52:18.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.135+0000 7f79d94fe640 1 -- 172.21.15.70:0/22423992 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79d4102e70 con 0x7f79d4102a60 2024-09-21T05:52:18.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.137+0000 7f79d0ff9640 1 -- 172.21.15.70:0/22423992 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f79c40041d0 con 0x7f79d4102a60 2024-09-21T05:52:18.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.138+0000 7f79d0ff9640 1 --2- 172.21.15.70:0/22423992 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f79c00b6510 0x7f79c00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:18.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.138+0000 7f79ca7fc640 1 --2- 172.21.15.70:0/22423992 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f79c00b6510 0x7f79c00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:18.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.138+0000 7f79d0ff9640 1 -- 172.21.15.70:0/22423992 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f79c40e77e0 con 0x7f79d4102a60 2024-09-21T05:52:18.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.139+0000 7f79ca7fc640 1 --2- 172.21.15.70:0/22423992 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f79c00b6510 0x7f79c00b8a20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f79d4105f20 tx=0x7f79bc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:18.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.141+0000 7f79d0ff9640 1 -- 172.21.15.70:0/22423992 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f79c40adc80 con 0x7f79d4102a60 2024-09-21T05:52:18.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.356+0000 7f79d94fe640 1 -- 172.21.15.70:0/22423992 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79d419b570 con 0x7f79d4102a60 2024-09-21T05:52:18.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.357+0000 7f79d0ff9640 1 -- 172.21.15.70:0/22423992 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7f79c40b2060 con 0x7f79d4102a60 2024-09-21T05:52:18.359 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:52:18.360 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":29,"btime":"2024-09-21T05:51:21:253819+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3519318330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3519318330},{"type":"v1","addr":"172.21.15.70:6835","nonce":3519318330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2706663460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2706663460},{"type":"v1","addr":"172.21.15.70:6837","nonce":2706663460}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:47:06.246985+0000","modified":"2024-09-21T05:51:21.134554+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24628,"mds_2":24611,"mds_3":24610,"mds_4":24598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/1914209867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1914209867},{"type":"v1","addr":"172.21.15.70:6839","nonce":1914209867}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3392175775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3392175775},{"type":"v1","addr":"172.21.15.70:6841","nonce":3392175775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/3543945704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3543945704},{"type":"v1","addr":"172.21.15.160:6833","nonce":3543945704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6833/283778129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":283778129},{"type":"v1","addr":"172.21.15.116:6833","nonce":283778129}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/3787256790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3787256790},{"type":"v1","addr":"172.21.15.116:6835","nonce":3787256790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.160:6835/2001692372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2001692372},{"type":"v1","addr":"172.21.15.160:6835","nonce":2001692372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.160:6837/2558120045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2558120045},{"type":"v1","addr":"172.21.15.160:6837","nonce":2558120045}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24611":{"gid":24611,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/444312934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":444312934},{"type":"v1","addr":"172.21.15.116:6837","nonce":444312934}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.160:6839/1339744282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1339744282},{"type":"v1","addr":"172.21.15.160:6839","nonce":1339744282}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/3952175670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3952175670},{"type":"v1","addr":"172.21.15.116:6839","nonce":3952175670}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24641,"qdb_cluster":[24641,24628,24610,24611,24598]},"id":1}]} 2024-09-21T05:52:18.360 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 29 2024-09-21T05:52:18.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.359+0000 7f79d94fe640 1 -- 172.21.15.70:0/22423992 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f79c00b6510 msgr2=0x7f79c00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:18.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.359+0000 7f79d94fe640 1 --2- 172.21.15.70:0/22423992 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f79c00b6510 0x7f79c00b8a20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f79d4105f20 tx=0x7f79bc00b390 comp rx=0 tx=0).stop 2024-09-21T05:52:18.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.359+0000 7f79d94fe640 1 -- 172.21.15.70:0/22423992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79d4102a60 msgr2=0x7f79d419a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:18.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.359+0000 7f79d94fe640 1 --2- 172.21.15.70:0/22423992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79d4102a60 0x7f79d419a440 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f79c400d950 tx=0x7f79c400de10 comp rx=0 tx=0).stop 2024-09-21T05:52:18.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.360+0000 7f79d94fe640 1 -- 172.21.15.70:0/22423992 shutdown_connections 2024-09-21T05:52:18.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.360+0000 7f79d94fe640 1 --2- 172.21.15.70:0/22423992 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f79c00b6510 0x7f79c00b8a20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:18.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.360+0000 7f79d94fe640 1 --2- 172.21.15.70:0/22423992 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79d41083a0 0x7f79d419a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:18.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.360+0000 7f79d94fe640 1 --2- 172.21.15.70:0/22423992 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79d4108cf0 0x7f79d419fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:18.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.360+0000 7f79d94fe640 1 --2- 172.21.15.70:0/22423992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79d4102a60 0x7f79d419a440 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:18.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.360+0000 7f79d94fe640 1 -- 172.21.15.70:0/22423992 >> 172.21.15.70:0/22423992 conn(0x7f79d4079730 msgr2=0x7f79d41043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:18.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.360+0000 7f79d94fe640 1 -- 172.21.15.70:0/22423992 shutdown_connections 2024-09-21T05:52:18.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:18.360+0000 7f79d94fe640 1 -- 172.21.15.70:0/22423992 wait complete. 2024-09-21T05:52:19.208 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24641 quiesce db --set-id b9a6d9bb --release --await' 2024-09-21T05:52:19.208 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24641 quiesce db --set-id b9a6d9bb --release --await 2024-09-21T05:52:19.461 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:19.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:19 smithi070 ceph-mon[30981]: pgmap v455: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.0 KiB/s wr, 12 op/s 2024-09-21T05:52:19.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:19 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/22423992' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:52:19.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:19 smithi160 ceph-mon[33979]: pgmap v455: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.0 KiB/s wr, 12 op/s 2024-09-21T05:52:19.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:19 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/22423992' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:52:19.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:19 smithi116 ceph-mon[34332]: pgmap v455: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.0 KiB/s wr, 12 op/s 2024-09-21T05:52:19.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:19 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/22423992' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:52:19.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.927+0000 7efd75ba2640 1 -- 172.21.15.70:0/1511083189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd70104920 msgr2=0x7efd70104d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:19.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.927+0000 7efd75ba2640 1 --2- 172.21.15.70:0/1511083189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd70104920 0x7efd70104d30 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7efd60009900 tx=0x7efd6002a410 comp rx=0 tx=0).stop 2024-09-21T05:52:19.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.928+0000 7efd75ba2640 1 -- 172.21.15.70:0/1511083189 shutdown_connections 2024-09-21T05:52:19.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.928+0000 7efd75ba2640 1 --2- 172.21.15.70:0/1511083189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd7010ded0 0x7efd701103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.928+0000 7efd75ba2640 1 --2- 172.21.15.70:0/1511083189 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd70105350 0x7efd7010d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.928+0000 7efd75ba2640 1 --2- 172.21.15.70:0/1511083189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd70104920 0x7efd70104d30 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.928+0000 7efd75ba2640 1 -- 172.21.15.70:0/1511083189 >> 172.21.15.70:0/1511083189 conn(0x7efd70079750 msgr2=0x7efd70079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:19.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.928+0000 7efd75ba2640 1 -- 172.21.15.70:0/1511083189 shutdown_connections 2024-09-21T05:52:19.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.928+0000 7efd75ba2640 1 -- 172.21.15.70:0/1511083189 wait complete. 2024-09-21T05:52:19.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.928+0000 7efd75ba2640 1 Processor -- start 2024-09-21T05:52:19.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.928+0000 7efd75ba2640 1 -- start start 2024-09-21T05:52:19.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.929+0000 7efd75ba2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd70104920 0x7efd7019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:19.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.929+0000 7efd75ba2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd70105350 0x7efd7019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:19.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.929+0000 7efd75ba2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd7010ded0 0x7efd7019fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:19.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.929+0000 7efd75ba2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efd70113aa0 con 0x7efd70104920 2024-09-21T05:52:19.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.929+0000 7efd75ba2640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7efd70113920 con 0x7efd7010ded0 2024-09-21T05:52:19.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.929+0000 7efd75ba2640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7efd70113c20 con 0x7efd70105350 2024-09-21T05:52:19.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.929+0000 7efd6f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd70104920 0x7efd7019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:19.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.929+0000 7efd6f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd70104920 0x7efd7019a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59786/0 (socket says 172.21.15.70:59786) 2024-09-21T05:52:19.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.929+0000 7efd6f7fe640 1 -- 172.21.15.70:0/2811848045 learned_addr learned my addr 172.21.15.70:0/2811848045 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:52:19.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.929+0000 7efd6effd640 1 --2- 172.21.15.70:0/2811848045 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd70105350 0x7efd7019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:19.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.929+0000 7efd6ffff640 1 --2- 172.21.15.70:0/2811848045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd7010ded0 0x7efd7019fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:19.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.929+0000 7efd6f7fe640 1 -- 172.21.15.70:0/2811848045 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd70105350 msgr2=0x7efd7019ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:19.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.929+0000 7efd6f7fe640 1 --2- 172.21.15.70:0/2811848045 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd70105350 0x7efd7019ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.929+0000 7efd6f7fe640 1 -- 172.21.15.70:0/2811848045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd7010ded0 msgr2=0x7efd7019fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:19.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.929+0000 7efd6f7fe640 1 --2- 172.21.15.70:0/2811848045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd7010ded0 0x7efd7019fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.929+0000 7efd6f7fe640 1 -- 172.21.15.70:0/2811848045 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd701a0500 con 0x7efd70104920 2024-09-21T05:52:19.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.929+0000 7efd6effd640 1 --2- 172.21.15.70:0/2811848045 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd70105350 0x7efd7019ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:52:19.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.929+0000 7efd6ffff640 1 --2- 172.21.15.70:0/2811848045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd7010ded0 0x7efd7019fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:52:19.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.929+0000 7efd6f7fe640 1 --2- 172.21.15.70:0/2811848045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd70104920 0x7efd7019a590 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7efd60004270 tx=0x7efd600042a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:19.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.929+0000 7efd6cff9640 1 -- 172.21.15.70:0/2811848045 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6003f030 con 0x7efd70104920 2024-09-21T05:52:19.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.930+0000 7efd75ba2640 1 -- 172.21.15.70:0/2811848045 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd701a0790 con 0x7efd70104920 2024-09-21T05:52:19.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.930+0000 7efd6cff9640 1 -- 172.21.15.70:0/2811848045 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7efd60003800 con 0x7efd70104920 2024-09-21T05:52:19.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.930+0000 7efd6cff9640 1 -- 172.21.15.70:0/2811848045 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd60035070 con 0x7efd70104920 2024-09-21T05:52:19.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.930+0000 7efd75ba2640 1 -- 172.21.15.70:0/2811848045 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd701a6f50 con 0x7efd70104920 2024-09-21T05:52:19.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.933+0000 7efd7c116740 1 Processor -- start 2024-09-21T05:52:19.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.933+0000 7efd7c116740 1 -- start start 2024-09-21T05:52:19.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.933+0000 7efd7c116740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5618543b9520 0x56185475f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:19.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.933+0000 7efd7c116740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561854390660 0x56185475fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:19.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.933+0000 7efd7c116740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561854398840 0x56185475ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:19.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.933+0000 7efd7c116740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56185464adc0 con 0x561854398840 2024-09-21T05:52:19.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.933+0000 7efd7c116740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5618546d71f0 con 0x561854390660 2024-09-21T05:52:19.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.933+0000 7efd7c116740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5618546c6620 con 0x5618543b9520 2024-09-21T05:52:19.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.933+0000 7efd6cff9640 1 -- 172.21.15.70:0/2811848045 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7efd600039b0 con 0x7efd70104920 2024-09-21T05:52:19.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.933+0000 7efd6effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561854398840 0x56185475ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:19.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.933+0000 7efd6effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561854398840 0x56185475ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59788/0 (socket says 172.21.15.70:59788) 2024-09-21T05:52:19.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.933+0000 7efd6effd640 1 -- 172.21.15.70:0/3615482459 learned_addr learned my addr 172.21.15.70:0/3615482459 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:52:19.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.934+0000 7efd6ffff640 1 --2- 172.21.15.70:0/3615482459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5618543b9520 0x56185475f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:19.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.934+0000 7efd6f7fe640 1 --2- 172.21.15.70:0/3615482459 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561854390660 0x56185475fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:19.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.934+0000 7efd6effd640 1 -- 172.21.15.70:0/3615482459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5618543b9520 msgr2=0x56185475f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:52:19.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.934+0000 7efd6effd640 1 --2- 172.21.15.70:0/3615482459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5618543b9520 0x56185475f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.934+0000 7efd6effd640 1 -- 172.21.15.70:0/3615482459 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561854390660 msgr2=0x56185475fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:52:19.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.934+0000 7efd6effd640 1 --2- 172.21.15.70:0/3615482459 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561854390660 0x56185475fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.934+0000 7efd6effd640 1 -- 172.21.15.70:0/3615482459 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56185468efd0 con 0x561854398840 2024-09-21T05:52:19.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.934+0000 7efd6effd640 1 --2- 172.21.15.70:0/3615482459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561854398840 0x56185475ff90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7efd6400cc00 tx=0x7efd6400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4093c03e4647d15 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:19.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.934+0000 7efd55ffb640 1 -- 172.21.15.70:0/3615482459 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd64005220 con 0x561854398840 2024-09-21T05:52:19.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.934+0000 7efd55ffb640 1 -- 172.21.15.70:0/3615482459 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7efd64004c50 con 0x561854398840 2024-09-21T05:52:19.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.934+0000 7efd55ffb640 1 -- 172.21.15.70:0/3615482459 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd64010720 con 0x561854398840 2024-09-21T05:52:19.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.934+0000 7efd6cff9640 1 --2- 172.21.15.70:0/2811848045 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7efd580b6510 0x7efd580b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:19.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.935+0000 7efd6ffff640 1 --2- 172.21.15.70:0/2811848045 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7efd580b6510 0x7efd580b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:19.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.935+0000 7efd6cff9640 1 -- 172.21.15.70:0/2811848045 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7efd60108110 con 0x7efd70104920 2024-09-21T05:52:19.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.935+0000 7efd7c116740 1 -- 172.21.15.70:0/3615482459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561854398840 msgr2=0x56185475ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:19.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.935+0000 7efd6ffff640 1 --2- 172.21.15.70:0/2811848045 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7efd580b6510 0x7efd580b8a20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efd68005fd0 tx=0x7efd68008370 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:19.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.935+0000 7efd7c116740 1 --2- 172.21.15.70:0/3615482459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561854398840 0x56185475ff90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7efd6400cc00 tx=0x7efd6400e720 comp rx=0 tx=0).stop 2024-09-21T05:52:19.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.935+0000 7efd7c116740 1 -- 172.21.15.70:0/3615482459 shutdown_connections 2024-09-21T05:52:19.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.935+0000 7efd7c116740 1 --2- 172.21.15.70:0/3615482459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561854398840 0x56185475ff90 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.935+0000 7efd7c116740 1 --2- 172.21.15.70:0/3615482459 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561854390660 0x56185475fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.935+0000 7efd7c116740 1 --2- 172.21.15.70:0/3615482459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5618543b9520 0x56185475f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.935+0000 7efd7c116740 1 -- 172.21.15.70:0/3615482459 >> 172.21.15.70:0/3615482459 conn(0x5618543ad910 msgr2=0x56185475d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:19.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.935+0000 7efd7c116740 1 -- 172.21.15.70:0/3615482459 shutdown_connections 2024-09-21T05:52:19.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.935+0000 7efd7c116740 1 -- 172.21.15.70:0/3615482459 wait complete. 2024-09-21T05:52:19.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.936+0000 7efd7c116740 1 -- start start 2024-09-21T05:52:19.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.936+0000 7efd7c116740 1 Processor -- start 2024-09-21T05:52:19.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.936+0000 7efd7c116740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561854390660 0x56185476aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:19.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.936+0000 7efd7c116740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561854398840 0x56185476b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:19.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.936+0000 7efd7c116740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5618543b9520 0x56185476b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:19.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.936+0000 7efd7c116740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561854661300 con 0x561854398840 2024-09-21T05:52:19.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.936+0000 7efd7c116740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5618546ca430 con 0x561854390660 2024-09-21T05:52:19.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.936+0000 7efd6effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561854398840 0x56185476b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:19.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.936+0000 7efd7c116740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x561854527bb0 con 0x5618543b9520 2024-09-21T05:52:19.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.936+0000 7efd6effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561854398840 0x56185476b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59792/0 (socket says 172.21.15.70:59792) 2024-09-21T05:52:19.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.936+0000 7efd6effd640 1 -- 172.21.15.70:0/2124089343 learned_addr learned my addr 172.21.15.70:0/2124089343 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:52:19.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.936+0000 7efd7c116740 10 client.0 _ll_register_callbacks cb 0x56185467b120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:52:19.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.937+0000 7efd6ffff640 1 --2- 172.21.15.70:0/2124089343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5618543b9520 0x56185476b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:19.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.937+0000 7efd6f7fe640 1 --2- 172.21.15.70:0/2124089343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561854390660 0x56185476aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:19.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.937+0000 7efd6effd640 1 -- 172.21.15.70:0/2124089343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5618543b9520 msgr2=0x56185476b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:52:19.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.937+0000 7efd6effd640 1 --2- 172.21.15.70:0/2124089343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5618543b9520 0x56185476b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.937+0000 7efd6effd640 1 -- 172.21.15.70:0/2124089343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561854390660 msgr2=0x56185476aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:52:19.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.937+0000 7efd6effd640 1 --2- 172.21.15.70:0/2124089343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561854390660 0x56185476aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.937+0000 7efd6effd640 1 -- 172.21.15.70:0/2124089343 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561854650780 con 0x561854398840 2024-09-21T05:52:19.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.937+0000 7efd6effd640 1 --2- 172.21.15.70:0/2124089343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561854398840 0x56185476b020 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7efd64000c00 tx=0x7efd6400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f55911998373a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:19.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.937+0000 7efd4effd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:52:19.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.937+0000 7efd4effd640 1 -- 172.21.15.70:0/2124089343 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6402a060 con 0x561854398840 2024-09-21T05:52:19.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.937+0000 7efd4effd640 1 -- 172.21.15.70:0/2124089343 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7efd64005110 con 0x561854398840 2024-09-21T05:52:19.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.937+0000 7efd7c116740 1 -- 172.21.15.70:0/2124089343 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd64004c50 con 0x561854398840 2024-09-21T05:52:19.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.937+0000 7efd4effd640 1 -- 172.21.15.70:0/2124089343 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efd64031050 con 0x561854398840 2024-09-21T05:52:19.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.937+0000 7efd7c116740 10 client.15777 fetch_fsmap learned FSMap version 29 2024-09-21T05:52:19.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.937+0000 7efd7c116740 1 -- 172.21.15.70:0/2124089343 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561854424b00 con 0x561854398840 2024-09-21T05:52:19.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.938+0000 7efd4effd640 1 -- 172.21.15.70:0/2124089343 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7efd64004c50 con 0x561854398840 2024-09-21T05:52:19.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.938+0000 7efd4effd640 1 -- 172.21.15.70:0/2124089343 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8386+0+0 (secure 0 0 0) 0x7efd6401a460 con 0x561854398840 2024-09-21T05:52:19.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.938+0000 7efd7c116740 10 client.15777 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T05:52:19.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.938+0000 7efd7c116740 10 client.15777 resolve_mds: validated gid 24641 aka daemon mds.b 2024-09-21T05:52:19.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.938+0000 7efd7c116740 20 client.15777 populate_metadata read hostname 'smithi070' 2024-09-21T05:52:19.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.938+0000 7efd7c116740 1 --2- 172.21.15.70:0/2124089343 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x561854377ea0 0x56185477ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:19.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.938+0000 7efd7c116740 4 client.15777 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:52:19.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.938+0000 7efd7c116740 1 -- 172.21.15.70:0/2124089343 --> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618546d9140 con 0x561854377ea0 2024-09-21T05:52:19.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.938+0000 7efd6f7fe640 1 --2- 172.21.15.70:0/2124089343 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x561854377ea0 0x56185477ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:19.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.939+0000 7efd4effd640 10 client.15777 ms_handle_connect on v2:172.21.15.116:6838/3952175670 2024-09-21T05:52:19.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.939+0000 7efd6f7fe640 1 --2- 172.21.15.70:0/2124089343 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x561854377ea0 0x56185477ccd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afd133f3e011a211 server_cookie=dc149a48a8eb6657 in_seq=0 out_seq=0 2024-09-21T05:52:19.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.939+0000 7efd4effd640 1 -- 172.21.15.70:0/2124089343 <== mds.0 v2:172.21.15.116:6838/3952175670 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5618546d9140 con 0x561854377ea0 2024-09-21T05:52:19.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.939+0000 7efd4effd640 10 client.15777 handle_command_reply: tid=0 2024-09-21T05:52:19.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.939+0000 7efd7c116740 1 client.15777 shutdown 2024-09-21T05:52:19.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.940+0000 7efd7c116740 1 -- 172.21.15.70:0/2124089343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561854398840 msgr2=0x56185476b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:19.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.940+0000 7efd7c116740 1 --2- 172.21.15.70:0/2124089343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561854398840 0x56185476b020 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7efd64000c00 tx=0x7efd6400c940 comp rx=0 tx=0).stop 2024-09-21T05:52:19.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.940+0000 7efd7c116740 1 -- 172.21.15.70:0/2124089343 shutdown_connections 2024-09-21T05:52:19.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.940+0000 7efd7c116740 1 --2- 172.21.15.70:0/2124089343 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x561854377ea0 0x56185477ccd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.940+0000 7efd7c116740 1 --2- 172.21.15.70:0/2124089343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5618543b9520 0x56185476b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.940+0000 7efd7c116740 1 --2- 172.21.15.70:0/2124089343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561854398840 0x56185476b020 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.940+0000 7efd7c116740 1 --2- 172.21.15.70:0/2124089343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561854390660 0x56185476aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.940+0000 7efd4effd640 0 client.15777 ms_handle_reset on v2:172.21.15.116:6838/3952175670 2024-09-21T05:52:19.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.940+0000 7efd7c116740 1 -- 172.21.15.70:0/2124089343 >> 172.21.15.70:0/2124089343 conn(0x5618543ad910 msgr2=0x5618547626a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:19.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.940+0000 7efd7c116740 1 -- 172.21.15.70:0/2124089343 shutdown_connections 2024-09-21T05:52:19.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.940+0000 7efd7c116740 1 -- 172.21.15.70:0/2124089343 wait complete. 2024-09-21T05:52:19.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.940+0000 7efd7c116740 20 client.15777 trim_cache size 0 max 16384 2024-09-21T05:52:19.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.956+0000 7efd7c116740 1 Processor -- start 2024-09-21T05:52:19.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.957+0000 7efd7c116740 1 -- start start 2024-09-21T05:52:19.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.957+0000 7efd7c116740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618543ad910 0x561854776490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:19.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.957+0000 7efd7c116740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561854390660 0x5618547769d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:19.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.957+0000 7efd7c116740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561854398840 0x5618547822a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:19.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.957+0000 7efd7c116740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efd701b0d50 con 0x5618543ad910 2024-09-21T05:52:19.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.957+0000 7efd7c116740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7efd701b2950 con 0x561854390660 2024-09-21T05:52:19.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.957+0000 7efd7c116740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7efd701b1420 con 0x561854398840 2024-09-21T05:52:19.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.957+0000 7efd6f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618543ad910 0x561854776490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:19.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.957+0000 7efd6f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618543ad910 0x561854776490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59808/0 (socket says 172.21.15.70:59808) 2024-09-21T05:52:19.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.957+0000 7efd6f7fe640 1 -- 172.21.15.70:0/2873036144 learned_addr learned my addr 172.21.15.70:0/2873036144 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:52:19.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.957+0000 7efd6ffff640 1 --2- 172.21.15.70:0/2873036144 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561854398840 0x5618547822a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:19.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.957+0000 7efd6f7fe640 1 -- 172.21.15.70:0/2873036144 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561854398840 msgr2=0x5618547822a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:52:19.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.957+0000 7efd6f7fe640 1 --2- 172.21.15.70:0/2873036144 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561854398840 0x5618547822a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.957+0000 7efd6f7fe640 1 -- 172.21.15.70:0/2873036144 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561854390660 msgr2=0x5618547769d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:52:19.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.957+0000 7efd6effd640 1 --2- 172.21.15.70:0/2873036144 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561854390660 0x5618547769d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:19.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.957+0000 7efd6f7fe640 1 --2- 172.21.15.70:0/2873036144 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561854390660 0x5618547769d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.957+0000 7efd6f7fe640 1 -- 172.21.15.70:0/2873036144 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56185449b960 con 0x5618543ad910 2024-09-21T05:52:19.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.957+0000 7efd6f7fe640 1 --2- 172.21.15.70:0/2873036144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618543ad910 0x561854776490 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7efd600cde40 tx=0x7efd601056f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f76ffee5d662 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:19.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.958+0000 7efd557fa640 1 -- 172.21.15.70:0/2873036144 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd60049040 con 0x5618543ad910 2024-09-21T05:52:19.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.958+0000 7efd557fa640 1 -- 172.21.15.70:0/2873036144 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7efd600cd9c0 con 0x5618543ad910 2024-09-21T05:52:19.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.958+0000 7efd557fa640 1 -- 172.21.15.70:0/2873036144 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd600d7440 con 0x5618543ad910 2024-09-21T05:52:19.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.958+0000 7efd7c116740 1 -- 172.21.15.70:0/2873036144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618543ad910 msgr2=0x561854776490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:19.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.958+0000 7efd7c116740 1 --2- 172.21.15.70:0/2873036144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618543ad910 0x561854776490 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7efd600cde40 tx=0x7efd601056f0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.958+0000 7efd7c116740 1 -- 172.21.15.70:0/2873036144 shutdown_connections 2024-09-21T05:52:19.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.958+0000 7efd7c116740 1 --2- 172.21.15.70:0/2873036144 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561854398840 0x5618547822a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.958+0000 7efd7c116740 1 --2- 172.21.15.70:0/2873036144 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561854390660 0x5618547769d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.958+0000 7efd7c116740 1 --2- 172.21.15.70:0/2873036144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618543ad910 0x561854776490 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.958+0000 7efd7c116740 1 -- 172.21.15.70:0/2873036144 >> 172.21.15.70:0/2873036144 conn(0x561854761180 msgr2=0x561854775d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:19.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.958+0000 7efd7c116740 1 -- 172.21.15.70:0/2873036144 shutdown_connections 2024-09-21T05:52:19.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.959+0000 7efd7c116740 1 -- 172.21.15.70:0/2873036144 wait complete. 2024-09-21T05:52:19.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.959+0000 7efd7c116740 1 -- start start 2024-09-21T05:52:19.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.959+0000 7efd7c116740 1 Processor -- start 2024-09-21T05:52:19.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.959+0000 7efd7c116740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561854390660 0x561854771de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:19.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.959+0000 7efd7c116740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561854398840 0x561854772320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:19.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.959+0000 7efd7c116740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5618543ad910 0x561854772860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:19.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.959+0000 7efd7c116740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efd701b21c0 con 0x561854390660 2024-09-21T05:52:19.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.959+0000 7efd7c116740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7efd701b1af0 con 0x5618543ad910 2024-09-21T05:52:19.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.959+0000 7efd7c116740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7efd701aed30 con 0x561854398840 2024-09-21T05:52:19.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.959+0000 7efd7c116740 10 client.0 _ll_register_callbacks cb 0x7efd64014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:52:19.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.960+0000 7efd6f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561854390660 0x561854771de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:19.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.960+0000 7efd6f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561854390660 0x561854771de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59812/0 (socket says 172.21.15.70:59812) 2024-09-21T05:52:19.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.960+0000 7efd6f7fe640 1 -- 172.21.15.70:0/1999341748 learned_addr learned my addr 172.21.15.70:0/1999341748 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:52:19.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.960+0000 7efd6effd640 1 --2- 172.21.15.70:0/1999341748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561854398840 0x561854772320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:19.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.960+0000 7efd6ffff640 1 --2- 172.21.15.70:0/1999341748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5618543ad910 0x561854772860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:19.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.960+0000 7efd6f7fe640 1 -- 172.21.15.70:0/1999341748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561854398840 msgr2=0x561854772320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:52:19.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.960+0000 7efd6f7fe640 1 --2- 172.21.15.70:0/1999341748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561854398840 0x561854772320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.960+0000 7efd6f7fe640 1 -- 172.21.15.70:0/1999341748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5618543ad910 msgr2=0x561854772860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:52:19.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.960+0000 7efd6f7fe640 1 --2- 172.21.15.70:0/1999341748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5618543ad910 0x561854772860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.960+0000 7efd6f7fe640 1 -- 172.21.15.70:0/1999341748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618547eb8d0 con 0x561854390660 2024-09-21T05:52:19.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.960+0000 7efd6f7fe640 1 --2- 172.21.15.70:0/1999341748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561854390660 0x561854771de0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7efd60105b90 tx=0x7efd60003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6016e5aafe264d97 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:19.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.960+0000 7efd4effd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:52:19.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.960+0000 7efd4effd640 1 -- 172.21.15.70:0/1999341748 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd60049070 con 0x561854390660 2024-09-21T05:52:19.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.960+0000 7efd4effd640 1 -- 172.21.15.70:0/1999341748 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7efd600ca120 con 0x561854390660 2024-09-21T05:52:19.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.960+0000 7efd7c116740 1 -- 172.21.15.70:0/1999341748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd600cd9c0 con 0x561854390660 2024-09-21T05:52:19.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.960+0000 7efd4effd640 1 -- 172.21.15.70:0/1999341748 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efd600b90d0 con 0x561854390660 2024-09-21T05:52:19.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.960+0000 7efd7c116740 10 client.15783 fetch_fsmap learned FSMap version 29 2024-09-21T05:52:19.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.960+0000 7efd7c116740 1 -- 172.21.15.70:0/1999341748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5618547ecb20 con 0x561854390660 2024-09-21T05:52:19.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.961+0000 7efd4effd640 1 -- 172.21.15.70:0/1999341748 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7efd600cd9c0 con 0x561854390660 2024-09-21T05:52:19.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.961+0000 7efd4effd640 1 -- 172.21.15.70:0/1999341748 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8386+0+0 (secure 0 0 0) 0x7efd60105ce0 con 0x561854390660 2024-09-21T05:52:19.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.961+0000 7efd7c116740 10 client.15783 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T05:52:19.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.961+0000 7efd7c116740 10 client.15783 resolve_mds: validated gid 24641 aka daemon mds.b 2024-09-21T05:52:19.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.961+0000 7efd7c116740 20 client.15783 populate_metadata read hostname 'smithi070' 2024-09-21T05:52:19.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.961+0000 7efd7c116740 1 --2- 172.21.15.70:0/1999341748 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x5618543b9520 0x5618547ef340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:19.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.961+0000 7efd7c116740 4 client.15783 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "b9a6d9bb", "release": true, "await": true}] 2024-09-21T05:52:19.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.961+0000 7efd7c116740 1 -- 172.21.15.70:0/1999341748 --> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] -- command(tid 0: {"prefix": "quiesce db", "set_id": "b9a6d9bb", "release": true, "await": true}) -- 0x5618546d4bf0 con 0x5618543b9520 2024-09-21T05:52:19.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.961+0000 7efd6effd640 1 --2- 172.21.15.70:0/1999341748 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x5618543b9520 0x5618547ef340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:19.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.962+0000 7efd4effd640 10 client.15783 ms_handle_connect on v2:172.21.15.116:6838/3952175670 2024-09-21T05:52:19.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:19.962+0000 7efd6effd640 1 --2- 172.21.15.70:0/1999341748 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x5618543b9520 0x5618547ef340 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e9b1ab71783bbb8 server_cookie=5930767c94a55792 in_seq=0 out_seq=0 2024-09-21T05:52:20.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:20.215+0000 7efd4effd640 1 -- 172.21.15.70:0/1999341748 <== mds.0 v2:172.21.15.116:6838/3952175670 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5618546d4bf0 con 0x5618543b9520 2024-09-21T05:52:20.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:20.215+0000 7efd4effd640 10 client.15783 handle_command_reply: tid=0 2024-09-21T05:52:20.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:20.215+0000 7efd7c116740 1 client.15783 shutdown 2024-09-21T05:52:20.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:20.215+0000 7efd7c116740 1 -- 172.21.15.70:0/1999341748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561854390660 msgr2=0x561854771de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:20.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:20.215+0000 7efd7c116740 1 --2- 172.21.15.70:0/1999341748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561854390660 0x561854771de0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7efd60105b90 tx=0x7efd60003cd0 comp rx=0 tx=0).stop 2024-09-21T05:52:20.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:20.216+0000 7efd7c116740 1 -- 172.21.15.70:0/1999341748 shutdown_connections 2024-09-21T05:52:20.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:20.216+0000 7efd7c116740 1 --2- 172.21.15.70:0/1999341748 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x5618543b9520 0x5618547ef340 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:20.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:20.216+0000 7efd4effd640 0 client.15783 ms_handle_reset on v2:172.21.15.116:6838/3952175670 2024-09-21T05:52:20.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:20.216+0000 7efd7c116740 1 --2- 172.21.15.70:0/1999341748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561854398840 0x561854772320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:20.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:20.216+0000 7efd7c116740 1 --2- 172.21.15.70:0/1999341748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5618543ad910 0x561854772860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:20.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:20.216+0000 7efd7c116740 1 --2- 172.21.15.70:0/1999341748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561854390660 0x561854771de0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:20.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:20.216+0000 7efd7c116740 1 -- 172.21.15.70:0/1999341748 >> 172.21.15.70:0/1999341748 conn(0x561854761180 msgr2=0x561854776740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:20.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:20.216+0000 7efd7c116740 1 -- 172.21.15.70:0/1999341748 shutdown_connections 2024-09-21T05:52:20.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:20.216+0000 7efd7c116740 1 -- 172.21.15.70:0/1999341748 wait complete. 2024-09-21T05:52:20.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:20.216+0000 7efd7c116740 20 client.15783 trim_cache size 0 max 16384 2024-09-21T05:52:20.219 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:52:20.220 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 29, 2024-09-21T05:52:20.220 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 24641, 2024-09-21T05:52:20.220 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 12, 2024-09-21T05:52:20.220 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-09-21T05:52:20.220 INFO:teuthology.orchestra.run.smithi070.stdout: "b9a6d9bb": { 2024-09-21T05:52:20.220 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 12, 2024-09-21T05:52:20.220 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-09-21T05:52:20.220 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-09-21T05:52:20.220 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-09-21T05:52:20.220 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-09-21T05:52:20.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:52:20.220 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 90.0, 2024-09-21T05:52:20.220 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 147.8, 2024-09-21T05:52:20.220 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-09-21T05:52:20.220 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-09-21T05:52:20.221 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-09-21T05:52:20.221 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-09-21T05:52:20.221 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-09-21T05:52:20.221 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-09-21T05:52:20.221 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:52:20.221 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:52:20.221 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:52:20.221 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:52:20.221 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:52:20.221 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:52:20.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:20.216+0000 7efd75ba2640 1 -- 172.21.15.70:0/2811848045 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7efd580b6510 msgr2=0x7efd580b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:20.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:20.216+0000 7efd75ba2640 1 --2- 172.21.15.70:0/2811848045 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7efd580b6510 0x7efd580b8a20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efd68005fd0 tx=0x7efd68008370 comp rx=0 tx=0).stop 2024-09-21T05:52:20.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:20.216+0000 7efd75ba2640 1 -- 172.21.15.70:0/2811848045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd70104920 msgr2=0x7efd7019a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:20.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:20.216+0000 7efd75ba2640 1 --2- 172.21.15.70:0/2811848045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd70104920 0x7efd7019a590 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7efd60004270 tx=0x7efd600042a0 comp rx=0 tx=0).stop 2024-09-21T05:52:20.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:20.217+0000 7efd75ba2640 1 -- 172.21.15.70:0/2811848045 shutdown_connections 2024-09-21T05:52:20.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:20.217+0000 7efd75ba2640 1 --2- 172.21.15.70:0/2811848045 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7efd580b6510 0x7efd580b8a20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:20.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:20.217+0000 7efd75ba2640 1 --2- 172.21.15.70:0/2811848045 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd70105350 0x7efd7019ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:20.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:20.217+0000 7efd75ba2640 1 --2- 172.21.15.70:0/2811848045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd7010ded0 0x7efd7019fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:20.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:20.217+0000 7efd75ba2640 1 --2- 172.21.15.70:0/2811848045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd70104920 0x7efd7019a590 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:20.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:20.217+0000 7efd75ba2640 1 -- 172.21.15.70:0/2811848045 >> 172.21.15.70:0/2811848045 conn(0x7efd70079750 msgr2=0x7efd70107a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:20.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:20.217+0000 7efd75ba2640 1 -- 172.21.15.70:0/2811848045 shutdown_connections 2024-09-21T05:52:20.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:20.217+0000 7efd75ba2640 1 -- 172.21.15.70:0/2811848045 wait complete. 2024-09-21T05:52:21.038 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'b9a6d9bb', total seconds elapsed: 31.5 2024-09-21T05:52:21.038 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.8 2024-09-21T05:52:21.038 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:52:21.323 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:21.601 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:21 smithi070 ceph-mon[30981]: pgmap v456: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-09-21T05:52:21.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:21 smithi160 ceph-mon[33979]: pgmap v456: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-09-21T05:52:21.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:21 smithi116 ceph-mon[34332]: pgmap v456: 129 pgs: 129 active+clean; 156 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-09-21T05:52:21.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.811+0000 7f32790c6640 1 -- 172.21.15.70:0/3495397482 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3274102a60 msgr2=0x7f3274102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:21.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.811+0000 7f32790c6640 1 --2- 172.21.15.70:0/3495397482 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3274102a60 0x7f3274102e70 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f3264009900 tx=0x7f326402a410 comp rx=0 tx=0).stop 2024-09-21T05:52:21.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.811+0000 7f32790c6640 1 -- 172.21.15.70:0/3495397482 shutdown_connections 2024-09-21T05:52:21.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.811+0000 7f32790c6640 1 --2- 172.21.15.70:0/3495397482 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3274108cf0 0x7f327410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:21.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.811+0000 7f32790c6640 1 --2- 172.21.15.70:0/3495397482 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32741083a0 0x7f32741087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:21.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.811+0000 7f32790c6640 1 --2- 172.21.15.70:0/3495397482 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3274102a60 0x7f3274102e70 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:21.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.811+0000 7f32790c6640 1 -- 172.21.15.70:0/3495397482 >> 172.21.15.70:0/3495397482 conn(0x7f3274079730 msgr2=0x7f3274079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:21.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.811+0000 7f32790c6640 1 -- 172.21.15.70:0/3495397482 shutdown_connections 2024-09-21T05:52:21.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.811+0000 7f32790c6640 1 -- 172.21.15.70:0/3495397482 wait complete. 2024-09-21T05:52:21.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.812+0000 7f32790c6640 1 Processor -- start 2024-09-21T05:52:21.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.812+0000 7f32790c6640 1 -- start start 2024-09-21T05:52:21.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.812+0000 7f32790c6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3274102a60 0x7f327419a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:21.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.812+0000 7f32790c6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32741083a0 0x7f327419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:21.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.812+0000 7f32790c6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3274108cf0 0x7f327419fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:21.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.812+0000 7f32790c6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3274112950 con 0x7f3274108cf0 2024-09-21T05:52:21.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.812+0000 7f32790c6640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f32741127d0 con 0x7f3274102a60 2024-09-21T05:52:21.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.812+0000 7f32790c6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3274112ad0 con 0x7f32741083a0 2024-09-21T05:52:21.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.812+0000 7f3272d9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3274102a60 0x7f327419a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:21.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.812+0000 7f327359e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3274108cf0 0x7f327419fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:21.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.813+0000 7f3272d9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3274102a60 0x7f327419a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.70:40706/0 (socket says 172.21.15.70:40706) 2024-09-21T05:52:21.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.813+0000 7f3272d9d640 1 -- 172.21.15.70:0/3358442309 learned_addr learned my addr 172.21.15.70:0/3358442309 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:52:21.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.813+0000 7f327259c640 1 --2- 172.21.15.70:0/3358442309 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32741083a0 0x7f327419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:21.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.813+0000 7f3272d9d640 1 -- 172.21.15.70:0/3358442309 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32741083a0 msgr2=0x7f327419a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:21.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.813+0000 7f3272d9d640 1 --2- 172.21.15.70:0/3358442309 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32741083a0 0x7f327419a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:21.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.813+0000 7f3272d9d640 1 -- 172.21.15.70:0/3358442309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3274108cf0 msgr2=0x7f327419fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:21.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.813+0000 7f3272d9d640 1 --2- 172.21.15.70:0/3358442309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3274108cf0 0x7f327419fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:21.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.813+0000 7f3272d9d640 1 -- 172.21.15.70:0/3358442309 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32741a03a0 con 0x7f3274102a60 2024-09-21T05:52:21.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.813+0000 7f327259c640 1 --2- 172.21.15.70:0/3358442309 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32741083a0 0x7f327419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:52:21.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.814+0000 7f3272d9d640 1 --2- 172.21.15.70:0/3358442309 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3274102a60 0x7f327419a430 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3264005940 tx=0x7f32640040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:21.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.814+0000 7f325bfff640 1 -- 172.21.15.70:0/3358442309 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326403f030 con 0x7f3274102a60 2024-09-21T05:52:21.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.814+0000 7f325bfff640 1 -- 172.21.15.70:0/3358442309 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f32640044c0 con 0x7f3274102a60 2024-09-21T05:52:21.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.814+0000 7f325bfff640 1 -- 172.21.15.70:0/3358442309 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3264035070 con 0x7f3274102a60 2024-09-21T05:52:21.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.814+0000 7f32790c6640 1 -- 172.21.15.70:0/3358442309 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32741a0630 con 0x7f3274102a60 2024-09-21T05:52:21.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.814+0000 7f32790c6640 1 -- 172.21.15.70:0/3358442309 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32741a6df0 con 0x7f3274102a60 2024-09-21T05:52:21.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.815+0000 7f32790c6640 1 -- 172.21.15.70:0/3358442309 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3274102e70 con 0x7f3274102a60 2024-09-21T05:52:21.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.817+0000 7f325bfff640 1 -- 172.21.15.70:0/3358442309 <== mon.2 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f3264042030 con 0x7f3274102a60 2024-09-21T05:52:21.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.818+0000 7f325bfff640 1 --2- 172.21.15.70:0/3358442309 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f325c0b6510 0x7f325c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:21.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.818+0000 7f327259c640 1 --2- 172.21.15.70:0/3358442309 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f325c0b6510 0x7f325c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:21.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.818+0000 7f325bfff640 1 -- 172.21.15.70:0/3358442309 <== mon.2 v2:172.21.15.116:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f3264107cb0 con 0x7f3274102a60 2024-09-21T05:52:21.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.819+0000 7f327259c640 1 --2- 172.21.15.70:0/3358442309 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f325c0b6510 0x7f325c0b8a20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3274100b70 tx=0x7f3268005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:21.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:21.822+0000 7f325bfff640 1 -- 172.21.15.70:0/3358442309 <== mon.2 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f32640d2530 con 0x7f3274102a60 2024-09-21T05:52:22.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:22.071+0000 7f32790c6640 1 -- 172.21.15.70:0/3358442309 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32741a70f0 con 0x7f3274102a60 2024-09-21T05:52:22.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:22.072+0000 7f325bfff640 1 -- 172.21.15.70:0/3358442309 <== mon.2 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7f32640d7470 con 0x7f3274102a60 2024-09-21T05:52:22.074 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:52:22.075 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":29,"btime":"2024-09-21T05:51:21:253819+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3519318330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3519318330},{"type":"v1","addr":"172.21.15.70:6835","nonce":3519318330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2706663460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2706663460},{"type":"v1","addr":"172.21.15.70:6837","nonce":2706663460}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:47:06.246985+0000","modified":"2024-09-21T05:51:21.134554+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24628,"mds_2":24611,"mds_3":24610,"mds_4":24598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/1914209867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1914209867},{"type":"v1","addr":"172.21.15.70:6839","nonce":1914209867}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3392175775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3392175775},{"type":"v1","addr":"172.21.15.70:6841","nonce":3392175775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/3543945704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3543945704},{"type":"v1","addr":"172.21.15.160:6833","nonce":3543945704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6833/283778129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":283778129},{"type":"v1","addr":"172.21.15.116:6833","nonce":283778129}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/3787256790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3787256790},{"type":"v1","addr":"172.21.15.116:6835","nonce":3787256790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.160:6835/2001692372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2001692372},{"type":"v1","addr":"172.21.15.160:6835","nonce":2001692372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.160:6837/2558120045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2558120045},{"type":"v1","addr":"172.21.15.160:6837","nonce":2558120045}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24611":{"gid":24611,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/444312934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":444312934},{"type":"v1","addr":"172.21.15.116:6837","nonce":444312934}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.160:6839/1339744282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1339744282},{"type":"v1","addr":"172.21.15.160:6839","nonce":1339744282}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/3952175670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3952175670},{"type":"v1","addr":"172.21.15.116:6839","nonce":3952175670}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24641,"qdb_cluster":[24641,24628,24610,24611,24598]},"id":1}]} 2024-09-21T05:52:22.075 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 29 2024-09-21T05:52:22.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:22.075+0000 7f32790c6640 1 -- 172.21.15.70:0/3358442309 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f325c0b6510 msgr2=0x7f325c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:22.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:22.075+0000 7f32790c6640 1 --2- 172.21.15.70:0/3358442309 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f325c0b6510 0x7f325c0b8a20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3274100b70 tx=0x7f3268005f90 comp rx=0 tx=0).stop 2024-09-21T05:52:22.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:22.075+0000 7f32790c6640 1 -- 172.21.15.70:0/3358442309 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3274102a60 msgr2=0x7f327419a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:22.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:22.075+0000 7f32790c6640 1 --2- 172.21.15.70:0/3358442309 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3274102a60 0x7f327419a430 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3264005940 tx=0x7f32640040c0 comp rx=0 tx=0).stop 2024-09-21T05:52:22.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:22.075+0000 7f32790c6640 1 -- 172.21.15.70:0/3358442309 shutdown_connections 2024-09-21T05:52:22.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:22.075+0000 7f32790c6640 1 --2- 172.21.15.70:0/3358442309 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f325c0b6510 0x7f325c0b8a20 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:22.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:22.075+0000 7f32790c6640 1 --2- 172.21.15.70:0/3358442309 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32741083a0 0x7f327419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:22.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:22.075+0000 7f32790c6640 1 --2- 172.21.15.70:0/3358442309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3274108cf0 0x7f327419fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:22.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:22.075+0000 7f32790c6640 1 --2- 172.21.15.70:0/3358442309 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3274102a60 0x7f327419a430 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:22.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:22.075+0000 7f32790c6640 1 -- 172.21.15.70:0/3358442309 >> 172.21.15.70:0/3358442309 conn(0x7f3274079730 msgr2=0x7f3274101ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:22.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:22.075+0000 7f32790c6640 1 -- 172.21.15.70:0/3358442309 shutdown_connections 2024-09-21T05:52:22.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:22.075+0000 7f32790c6640 1 -- 172.21.15.70:0/3358442309 wait complete. 2024-09-21T05:52:22.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:22 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3358442309' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:52:22.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:22 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3358442309' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:52:22.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:22 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3358442309' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:52:22.916 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24641 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0' 2024-09-21T05:52:22.917 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24641 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0 2024-09-21T05:52:23.219 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:23.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:23 smithi070 ceph-mon[30981]: pgmap v457: 129 pgs: 129 active+clean; 156 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-21T05:52:23.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:23 smithi160 ceph-mon[33979]: pgmap v457: 129 pgs: 129 active+clean; 156 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-21T05:52:23.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.746+0000 7f3bd48cd640 1 -- 172.21.15.70:0/1612498634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bd0107c00 msgr2=0x7f3bd01080e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:23.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.746+0000 7f3bd48cd640 1 --2- 172.21.15.70:0/1612498634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bd0107c00 0x7f3bd01080e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8009cd0 tx=0x7f3bc802a8e0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.746+0000 7f3bd48cd640 1 -- 172.21.15.70:0/1612498634 shutdown_connections 2024-09-21T05:52:23.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.746+0000 7f3bd48cd640 1 --2- 172.21.15.70:0/1612498634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bd0107c00 0x7f3bd01080e0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.746+0000 7f3bd48cd640 1 --2- 172.21.15.70:0/1612498634 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bd0103110 0x7f3bd0107640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.746+0000 7f3bd48cd640 1 --2- 172.21.15.70:0/1612498634 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3bd01027c0 0x7f3bd0102bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.746+0000 7f3bd48cd640 1 -- 172.21.15.70:0/1612498634 >> 172.21.15.70:0/1612498634 conn(0x7f3bd0079760 msgr2=0x7f3bd0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:23.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.746+0000 7f3bd48cd640 1 -- 172.21.15.70:0/1612498634 shutdown_connections 2024-09-21T05:52:23.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.746+0000 7f3bd48cd640 1 -- 172.21.15.70:0/1612498634 wait complete. 2024-09-21T05:52:23.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.747+0000 7f3bd48cd640 1 Processor -- start 2024-09-21T05:52:23.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.747+0000 7f3bd48cd640 1 -- start start 2024-09-21T05:52:23.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.748+0000 7f3bd48cd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bd01027c0 0x7f3bd01a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:23.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.748+0000 7f3bd48cd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bd0103110 0x7f3bd01a0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:23.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.748+0000 7f3bd48cd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3bd0107c00 0x7f3bd01a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:23.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.748+0000 7f3bd48cd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd011a090 con 0x7f3bd01027c0 2024-09-21T05:52:23.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.748+0000 7f3bd48cd640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd0119f10 con 0x7f3bd0103110 2024-09-21T05:52:23.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.748+0000 7f3bd48cd640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd011a210 con 0x7f3bd0107c00 2024-09-21T05:52:23.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.748+0000 7f3bce59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bd01027c0 0x7f3bd01a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:23.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.748+0000 7f3bce59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bd01027c0 0x7f3bd01a0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37926/0 (socket says 172.21.15.70:37926) 2024-09-21T05:52:23.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.748+0000 7f3bce59c640 1 -- 172.21.15.70:0/1274281806 learned_addr learned my addr 172.21.15.70:0/1274281806 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:52:23.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.748+0000 7f3bc7fff640 1 --2- 172.21.15.70:0/1274281806 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bd0103110 0x7f3bd01a0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:23.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.748+0000 7f3bced9d640 1 --2- 172.21.15.70:0/1274281806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3bd0107c00 0x7f3bd01a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:23.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.748+0000 7f3bce59c640 1 -- 172.21.15.70:0/1274281806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3bd0107c00 msgr2=0x7f3bd01a6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:23.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.748+0000 7f3bce59c640 1 --2- 172.21.15.70:0/1274281806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3bd0107c00 0x7f3bd01a6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.748+0000 7f3bce59c640 1 -- 172.21.15.70:0/1274281806 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bd0103110 msgr2=0x7f3bd01a0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:23.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.748+0000 7f3bce59c640 1 --2- 172.21.15.70:0/1274281806 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bd0103110 0x7f3bd01a0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.748+0000 7f3bce59c640 1 -- 172.21.15.70:0/1274281806 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd01a69b0 con 0x7f3bd01027c0 2024-09-21T05:52:23.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.748+0000 7f3bc7fff640 1 --2- 172.21.15.70:0/1274281806 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bd0103110 0x7f3bd01a0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:52:23.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.748+0000 7f3bced9d640 1 --2- 172.21.15.70:0/1274281806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3bd0107c00 0x7f3bd01a6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:52:23.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.748+0000 7f3bce59c640 1 --2- 172.21.15.70:0/1274281806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bd01027c0 0x7f3bd01a0a40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000e9c0 tx=0x7f3bc000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:23.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.749+0000 7f3bc77fe640 1 -- 172.21.15.70:0/1274281806 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc000cde0 con 0x7f3bd01027c0 2024-09-21T05:52:23.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.749+0000 7f3bd48cd640 1 -- 172.21.15.70:0/1274281806 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd01a6ca0 con 0x7f3bd01027c0 2024-09-21T05:52:23.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.749+0000 7f3bc77fe640 1 -- 172.21.15.70:0/1274281806 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f3bc00108e0 con 0x7f3bd01027c0 2024-09-21T05:52:23.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.749+0000 7f3bc77fe640 1 -- 172.21.15.70:0/1274281806 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0018950 con 0x7f3bd01027c0 2024-09-21T05:52:23.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.749+0000 7f3bd48cd640 1 -- 172.21.15.70:0/1274281806 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd01ad400 con 0x7f3bd01027c0 2024-09-21T05:52:23.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.752+0000 7f3bdae41740 1 Processor -- start 2024-09-21T05:52:23.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.752+0000 7f3bdae41740 1 -- start start 2024-09-21T05:52:23.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.752+0000 7f3bdae41740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6bc7b4840 0x55e6bcb5b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:23.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.752+0000 7f3bdae41740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e6bc78b980 0x55e6bcb5bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:23.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.752+0000 7f3bdae41740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6bc793b60 0x55e6bcb5c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:23.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.752+0000 7f3bdae41740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e6bcad1b90 con 0x55e6bc7b4840 2024-09-21T05:52:23.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.752+0000 7f3bdae41740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e6bcac0fc0 con 0x55e6bc78b980 2024-09-21T05:52:23.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.752+0000 7f3bdae41740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55e6bcac4dd0 con 0x55e6bc793b60 2024-09-21T05:52:23.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.752+0000 7f3bc77fe640 1 -- 172.21.15.70:0/1274281806 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f3bc001f020 con 0x7f3bd01027c0 2024-09-21T05:52:23.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.752+0000 7f3bced9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6bc7b4840 0x55e6bcb5b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:23.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.752+0000 7f3bced9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6bc7b4840 0x55e6bcb5b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37936/0 (socket says 172.21.15.70:37936) 2024-09-21T05:52:23.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.752+0000 7f3bced9d640 1 -- 172.21.15.70:0/2131500731 learned_addr learned my addr 172.21.15.70:0/2131500731 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:52:23.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.753+0000 7f3bc7fff640 1 --2- 172.21.15.70:0/2131500731 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6bc793b60 0x55e6bcb5c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:23.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.753+0000 7f3bce59c640 1 --2- 172.21.15.70:0/2131500731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e6bc78b980 0x55e6bcb5bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:23.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.753+0000 7f3bced9d640 1 -- 172.21.15.70:0/2131500731 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6bc793b60 msgr2=0x55e6bcb5c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:52:23.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.753+0000 7f3bced9d640 1 --2- 172.21.15.70:0/2131500731 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6bc793b60 0x55e6bcb5c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.753+0000 7f3bced9d640 1 -- 172.21.15.70:0/2131500731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e6bc78b980 msgr2=0x55e6bcb5bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:52:23.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.753+0000 7f3bced9d640 1 --2- 172.21.15.70:0/2131500731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e6bc78b980 0x55e6bcb5bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.753+0000 7f3bced9d640 1 -- 172.21.15.70:0/2131500731 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6bca48060 con 0x55e6bc7b4840 2024-09-21T05:52:23.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.753+0000 7f3bced9d640 1 --2- 172.21.15.70:0/2131500731 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6bc7b4840 0x55e6bcb5b600 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80317e0 tx=0x7f3bc8009890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b26a13ebdae4720 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:23.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.753+0000 7f3bc4ff9640 1 -- 172.21.15.70:0/2131500731 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc8049070 con 0x55e6bc7b4840 2024-09-21T05:52:23.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.753+0000 7f3bc4ff9640 1 -- 172.21.15.70:0/2131500731 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f3bc8036040 con 0x55e6bc7b4840 2024-09-21T05:52:23.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.753+0000 7f3bc4ff9640 1 -- 172.21.15.70:0/2131500731 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc8004430 con 0x55e6bc7b4840 2024-09-21T05:52:23.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.753+0000 7f3bc77fe640 1 --2- 172.21.15.70:0/1274281806 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f3bbc0b6510 0x7f3bbc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:23.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.754+0000 7f3bce59c640 1 --2- 172.21.15.70:0/1274281806 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f3bbc0b6510 0x7f3bbc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:23.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.754+0000 7f3bc77fe640 1 -- 172.21.15.70:0/1274281806 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f3bc00e7950 con 0x7f3bd01027c0 2024-09-21T05:52:23.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.754+0000 7f3bce59c640 1 --2- 172.21.15.70:0/1274281806 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f3bbc0b6510 0x7f3bbc0b8a20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0000c00 tx=0x7f3bc00e9040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:23.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.754+0000 7f3bdae41740 1 -- 172.21.15.70:0/2131500731 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6bc7b4840 msgr2=0x55e6bcb5b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:23.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.754+0000 7f3bdae41740 1 --2- 172.21.15.70:0/2131500731 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6bc7b4840 0x55e6bcb5b600 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80317e0 tx=0x7f3bc8009890 comp rx=0 tx=0).stop 2024-09-21T05:52:23.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.754+0000 7f3bdae41740 1 -- 172.21.15.70:0/2131500731 shutdown_connections 2024-09-21T05:52:23.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.754+0000 7f3bdae41740 1 --2- 172.21.15.70:0/2131500731 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6bc793b60 0x55e6bcb5c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.754+0000 7f3bdae41740 1 --2- 172.21.15.70:0/2131500731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e6bc78b980 0x55e6bcb5bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.754+0000 7f3bdae41740 1 --2- 172.21.15.70:0/2131500731 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6bc7b4840 0x55e6bcb5b600 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.754+0000 7f3bdae41740 1 -- 172.21.15.70:0/2131500731 >> 172.21.15.70:0/2131500731 conn(0x55e6bc7a8990 msgr2=0x55e6bcb594f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:23.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.755+0000 7f3bdae41740 1 -- 172.21.15.70:0/2131500731 shutdown_connections 2024-09-21T05:52:23.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.755+0000 7f3bdae41740 1 -- 172.21.15.70:0/2131500731 wait complete. 2024-09-21T05:52:23.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.755+0000 7f3bdae41740 1 -- start start 2024-09-21T05:52:23.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.755+0000 7f3bdae41740 1 Processor -- start 2024-09-21T05:52:23.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.755+0000 7f3bdae41740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6bc78b980 0x55e6bcb67200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:23.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.755+0000 7f3bdae41740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6bc793b60 0x55e6bcb67740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:23.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.755+0000 7f3bdae41740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e6bc7b4840 0x55e6bcb73070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:23.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.755+0000 7f3bdae41740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e6bc9227a0 con 0x55e6bc793b60 2024-09-21T05:52:23.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.755+0000 7f3bdae41740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e6bca660a0 con 0x55e6bc7b4840 2024-09-21T05:52:23.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.755+0000 7f3bdae41740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55e6bcb69d80 con 0x55e6bc78b980 2024-09-21T05:52:23.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.755+0000 7f3bdae41740 10 client.0 _ll_register_callbacks cb 0x55e6bca433c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:52:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.756+0000 7f3bc7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6bc793b60 0x55e6bcb67740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.756+0000 7f3bced9d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6bc78b980 0x55e6bcb67200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.756+0000 7f3bced9d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6bc78b980 0x55e6bcb67200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.70:44920/0 (socket says 172.21.15.70:44920) 2024-09-21T05:52:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.756+0000 7f3bc7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6bc793b60 0x55e6bcb67740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37950/0 (socket says 172.21.15.70:37950) 2024-09-21T05:52:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.756+0000 7f3bc7fff640 1 -- 172.21.15.70:0/203996361 learned_addr learned my addr 172.21.15.70:0/203996361 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:52:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.756+0000 7f3bced9d640 1 --2- 172.21.15.70:0/203996361 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e6bc7b4840 0x55e6bcb73070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.756+0000 7f3bc7fff640 1 -- 172.21.15.70:0/203996361 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6bc78b980 msgr2=0x55e6bcb67200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:52:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.756+0000 7f3bc7fff640 1 --2- 172.21.15.70:0/203996361 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6bc78b980 0x55e6bcb67200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.756+0000 7f3bc7fff640 1 -- 172.21.15.70:0/203996361 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e6bc7b4840 msgr2=0x55e6bcb73070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:52:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.756+0000 7f3bc7fff640 1 --2- 172.21.15.70:0/203996361 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e6bc7b4840 0x55e6bcb73070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.756+0000 7f3bc7fff640 1 -- 172.21.15.70:0/203996361 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6bca54880 con 0x55e6bc793b60 2024-09-21T05:52:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.756+0000 7f3bc7fff640 1 --2- 172.21.15.70:0/203996361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6bc793b60 0x55e6bcb67740 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8012d20 tx=0x7f3bb800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb25114ff0c9394 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.756+0000 7f3bb5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:52:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.756+0000 7f3bb5ffb640 1 -- 172.21.15.70:0/203996361 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8012110 con 0x55e6bc793b60 2024-09-21T05:52:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.756+0000 7f3bb5ffb640 1 -- 172.21.15.70:0/203996361 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f3bb8004050 con 0x55e6bc793b60 2024-09-21T05:52:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.756+0000 7f3bdae41740 1 -- 172.21.15.70:0/203996361 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bc8036040 con 0x55e6bc793b60 2024-09-21T05:52:23.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.756+0000 7f3bb5ffb640 1 -- 172.21.15.70:0/203996361 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3bb8025050 con 0x55e6bc793b60 2024-09-21T05:52:23.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.756+0000 7f3bdae41740 10 client.15801 fetch_fsmap learned FSMap version 29 2024-09-21T05:52:23.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.757+0000 7f3bdae41740 1 -- 172.21.15.70:0/203996361 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e6bc82eb90 con 0x55e6bc793b60 2024-09-21T05:52:23.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.757+0000 7f3bb5ffb640 1 -- 172.21.15.70:0/203996361 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f3bc8036040 con 0x55e6bc793b60 2024-09-21T05:52:23.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.757+0000 7f3bb5ffb640 1 -- 172.21.15.70:0/203996361 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8386+0+0 (secure 0 0 0) 0x7f3bb8010430 con 0x55e6bc793b60 2024-09-21T05:52:23.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.757+0000 7f3bdae41740 10 client.15801 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T05:52:23.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.757+0000 7f3bdae41740 10 client.15801 resolve_mds: validated gid 24641 aka daemon mds.b 2024-09-21T05:52:23.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.757+0000 7f3bdae41740 20 client.15801 populate_metadata read hostname 'smithi070' 2024-09-21T05:52:23.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.757+0000 7f3bdae41740 1 --2- 172.21.15.70:0/203996361 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55e6bc7731c0 0x55e6bcb79200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:23.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.757+0000 7f3bdae41740 4 client.15801 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:52:23.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.757+0000 7f3bdae41740 1 -- 172.21.15.70:0/203996361 --> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6bcad3ae0 con 0x55e6bc7731c0 2024-09-21T05:52:23.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.757+0000 7f3bced9d640 1 --2- 172.21.15.70:0/203996361 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55e6bc7731c0 0x55e6bcb79200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:23.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.758+0000 7f3bb5ffb640 10 client.15801 ms_handle_connect on v2:172.21.15.116:6838/3952175670 2024-09-21T05:52:23.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.758+0000 7f3bced9d640 1 --2- 172.21.15.70:0/203996361 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55e6bc7731c0 0x55e6bcb79200 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a44d4bb50c18370b server_cookie=d18343ccbba6e7a8 in_seq=0 out_seq=0 2024-09-21T05:52:23.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.759+0000 7f3bb5ffb640 1 -- 172.21.15.70:0/203996361 <== mds.0 v2:172.21.15.116:6838/3952175670 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e6bcad3ae0 con 0x55e6bc7731c0 2024-09-21T05:52:23.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.759+0000 7f3bb5ffb640 10 client.15801 handle_command_reply: tid=0 2024-09-21T05:52:23.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.759+0000 7f3bdae41740 1 client.15801 shutdown 2024-09-21T05:52:23.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.759+0000 7f3bdae41740 1 -- 172.21.15.70:0/203996361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6bc793b60 msgr2=0x55e6bcb67740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:23.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.759+0000 7f3bdae41740 1 --2- 172.21.15.70:0/203996361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6bc793b60 0x55e6bcb67740 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8012d20 tx=0x7f3bb800f790 comp rx=0 tx=0).stop 2024-09-21T05:52:23.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.759+0000 7f3bdae41740 1 -- 172.21.15.70:0/203996361 shutdown_connections 2024-09-21T05:52:23.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.759+0000 7f3bdae41740 1 --2- 172.21.15.70:0/203996361 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55e6bc7731c0 0x55e6bcb79200 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.759+0000 7f3bdae41740 1 --2- 172.21.15.70:0/203996361 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e6bc7b4840 0x55e6bcb73070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.759+0000 7f3bdae41740 1 --2- 172.21.15.70:0/203996361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6bc793b60 0x55e6bcb67740 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.759+0000 7f3bb5ffb640 0 client.15801 ms_handle_reset on v2:172.21.15.116:6838/3952175670 2024-09-21T05:52:23.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.759+0000 7f3bdae41740 1 --2- 172.21.15.70:0/203996361 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6bc78b980 0x55e6bcb67200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.759+0000 7f3bdae41740 1 -- 172.21.15.70:0/203996361 >> 172.21.15.70:0/203996361 conn(0x55e6bc7a8990 msgr2=0x55e6bcb5e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:23.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.759+0000 7f3bdae41740 1 -- 172.21.15.70:0/203996361 shutdown_connections 2024-09-21T05:52:23.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.759+0000 7f3bdae41740 1 -- 172.21.15.70:0/203996361 wait complete. 2024-09-21T05:52:23.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.759+0000 7f3bdae41740 20 client.15801 trim_cache size 0 max 16384 2024-09-21T05:52:23.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.780+0000 7f3bdae41740 1 Processor -- start 2024-09-21T05:52:23.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.780+0000 7f3bdae41740 1 -- start start 2024-09-21T05:52:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.780+0000 7f3bdae41740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6bc78b980 0x55e6bcb72f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.780+0000 7f3bdae41740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6bc793b60 0x55e6bcb734b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.780+0000 7f3bdae41740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e6bc7b4840 0x55e6bcb60710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.780+0000 7f3bdae41740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd01b7280 con 0x55e6bc793b60 2024-09-21T05:52:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.780+0000 7f3bdae41740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd01b8e80 con 0x55e6bc7b4840 2024-09-21T05:52:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.780+0000 7f3bdae41740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd01b7950 con 0x55e6bc78b980 2024-09-21T05:52:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.781+0000 7f3bc7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6bc793b60 0x55e6bcb734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.781+0000 7f3bc7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6bc793b60 0x55e6bcb734b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37960/0 (socket says 172.21.15.70:37960) 2024-09-21T05:52:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.781+0000 7f3bc7fff640 1 -- 172.21.15.70:0/600375034 learned_addr learned my addr 172.21.15.70:0/600375034 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:52:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.781+0000 7f3bced9d640 1 --2- 172.21.15.70:0/600375034 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6bc78b980 0x55e6bcb72f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.781+0000 7f3bced9d640 1 --2- 172.21.15.70:0/600375034 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e6bc7b4840 0x55e6bcb60710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.781+0000 7f3bc7fff640 1 -- 172.21.15.70:0/600375034 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6bc78b980 msgr2=0x55e6bcb72f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:52:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.781+0000 7f3bc7fff640 1 --2- 172.21.15.70:0/600375034 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6bc78b980 0x55e6bcb72f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.781+0000 7f3bc7fff640 1 -- 172.21.15.70:0/600375034 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e6bc7b4840 msgr2=0x55e6bcb60710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:52:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.781+0000 7f3bc7fff640 1 --2- 172.21.15.70:0/600375034 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e6bc7b4840 0x55e6bcb60710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.781+0000 7f3bc7fff640 1 -- 172.21.15.70:0/600375034 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6bcb62820 con 0x55e6bc793b60 2024-09-21T05:52:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.781+0000 7f3bced9d640 1 --2- 172.21.15.70:0/600375034 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e6bc7b4840 0x55e6bcb60710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:52:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.781+0000 7f3bc7fff640 1 --2- 172.21.15.70:0/600375034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6bc793b60 0x55e6bcb734b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8009730 tx=0x7f3bb8012320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d93b414620fee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.781+0000 7f3bb7fff640 1 -- 172.21.15.70:0/600375034 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8010430 con 0x55e6bc793b60 2024-09-21T05:52:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.782+0000 7f3bb7fff640 1 -- 172.21.15.70:0/600375034 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f3bb80105d0 con 0x55e6bc793b60 2024-09-21T05:52:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.782+0000 7f3bb7fff640 1 -- 172.21.15.70:0/600375034 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8003970 con 0x55e6bc793b60 2024-09-21T05:52:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.783+0000 7f3bdae41740 1 -- 172.21.15.70:0/600375034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6bc793b60 msgr2=0x55e6bcb734b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.783+0000 7f3bdae41740 1 --2- 172.21.15.70:0/600375034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6bc793b60 0x55e6bcb734b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8009730 tx=0x7f3bb8012320 comp rx=0 tx=0).stop 2024-09-21T05:52:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.783+0000 7f3bdae41740 1 -- 172.21.15.70:0/600375034 shutdown_connections 2024-09-21T05:52:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.783+0000 7f3bdae41740 1 --2- 172.21.15.70:0/600375034 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e6bc7b4840 0x55e6bcb60710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.783+0000 7f3bdae41740 1 --2- 172.21.15.70:0/600375034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6bc793b60 0x55e6bcb734b0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.783+0000 7f3bdae41740 1 --2- 172.21.15.70:0/600375034 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6bc78b980 0x55e6bcb72f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.783+0000 7f3bdae41740 1 -- 172.21.15.70:0/600375034 >> 172.21.15.70:0/600375034 conn(0x55e6bc7a8990 msgr2=0x55e6bcb65880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.783+0000 7f3bdae41740 1 -- 172.21.15.70:0/600375034 shutdown_connections 2024-09-21T05:52:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.783+0000 7f3bdae41740 1 -- 172.21.15.70:0/600375034 wait complete. 2024-09-21T05:52:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.783+0000 7f3bdae41740 1 -- start start 2024-09-21T05:52:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.783+0000 7f3bdae41740 1 Processor -- start 2024-09-21T05:52:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.784+0000 7f3bdae41740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e6bc78b980 0x55e6bcb6f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.784+0000 7f3bdae41740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6bc793b60 0x55e6bcb6bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.784+0000 7f3bdae41740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6bc7b4840 0x55e6bcb6c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.784+0000 7f3bdae41740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd01b86f0 con 0x55e6bc793b60 2024-09-21T05:52:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.784+0000 7f3bdae41740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd01b8020 con 0x55e6bc78b980 2024-09-21T05:52:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.784+0000 7f3bdae41740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd01b5260 con 0x55e6bc7b4840 2024-09-21T05:52:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.784+0000 7f3bdae41740 10 client.0 _ll_register_callbacks cb 0x7f3bb8009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:52:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.784+0000 7f3bc7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6bc793b60 0x55e6bcb6bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.784+0000 7f3bced9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e6bc78b980 0x55e6bcb6f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.784+0000 7f3bc7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6bc793b60 0x55e6bcb6bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37968/0 (socket says 172.21.15.70:37968) 2024-09-21T05:52:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.784+0000 7f3bced9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e6bc78b980 0x55e6bcb6f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.70:40754/0 (socket says 172.21.15.70:40754) 2024-09-21T05:52:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.784+0000 7f3bc7fff640 1 -- 172.21.15.70:0/532186630 learned_addr learned my addr 172.21.15.70:0/532186630 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:52:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.784+0000 7f3bced9d640 1 --2- 172.21.15.70:0/532186630 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6bc7b4840 0x55e6bcb6c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.784+0000 7f3bc7fff640 1 -- 172.21.15.70:0/532186630 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6bc7b4840 msgr2=0x55e6bcb6c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:52:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.784+0000 7f3bc7fff640 1 --2- 172.21.15.70:0/532186630 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6bc7b4840 0x55e6bcb6c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.784+0000 7f3bc7fff640 1 -- 172.21.15.70:0/532186630 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e6bc78b980 msgr2=0x55e6bcb6f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:52:23.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.784+0000 7f3bc7fff640 1 --2- 172.21.15.70:0/532186630 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e6bc78b980 0x55e6bcb6f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.784+0000 7f3bc7fff640 1 -- 172.21.15.70:0/532186630 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6bcbe3bd0 con 0x55e6bc793b60 2024-09-21T05:52:23.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.784+0000 7f3bced9d640 1 --2- 172.21.15.70:0/532186630 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e6bc78b980 0x55e6bcb6f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:52:23.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.784+0000 7f3bc7fff640 1 --2- 172.21.15.70:0/532186630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6bc793b60 0x55e6bcb6bec0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3bb800f7d0 tx=0x7f3bb8010bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=942b959b2229f355 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:23.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.784+0000 7f3bb5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:52:23.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.785+0000 7f3bb5ffb640 1 -- 172.21.15.70:0/532186630 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8010430 con 0x55e6bc793b60 2024-09-21T05:52:23.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.785+0000 7f3bb5ffb640 1 -- 172.21.15.70:0/532186630 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f3bb80052e0 con 0x55e6bc793b60 2024-09-21T05:52:23.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.785+0000 7f3bdae41740 1 -- 172.21.15.70:0/532186630 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bb80105d0 con 0x55e6bc793b60 2024-09-21T05:52:23.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.785+0000 7f3bb5ffb640 1 -- 172.21.15.70:0/532186630 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3bb803c050 con 0x55e6bc793b60 2024-09-21T05:52:23.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.785+0000 7f3bdae41740 10 client.15807 fetch_fsmap learned FSMap version 29 2024-09-21T05:52:23.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.785+0000 7f3bdae41740 1 -- 172.21.15.70:0/532186630 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e6bcbe4d00 con 0x55e6bc793b60 2024-09-21T05:52:23.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.785+0000 7f3bb5ffb640 1 -- 172.21.15.70:0/532186630 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f3bb80105d0 con 0x55e6bc793b60 2024-09-21T05:52:23.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.785+0000 7f3bb5ffb640 1 -- 172.21.15.70:0/532186630 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8386+0+0 (secure 0 0 0) 0x7f3bb801c420 con 0x55e6bc793b60 2024-09-21T05:52:23.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.785+0000 7f3bdae41740 10 client.15807 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T05:52:23.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.785+0000 7f3bdae41740 10 client.15807 resolve_mds: validated gid 24641 aka daemon mds.b 2024-09-21T05:52:23.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.785+0000 7f3bdae41740 20 client.15807 populate_metadata read hostname 'smithi070' 2024-09-21T05:52:23.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.785+0000 7f3bdae41740 1 --2- 172.21.15.70:0/532186630 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55e6bc748570 0x55e6bcbe7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:23.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.785+0000 7f3bdae41740 4 client.15807 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}] 2024-09-21T05:52:23.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.785+0000 7f3bdae41740 1 -- 172.21.15.70:0/532186630 --> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}) -- 0x55e6bcacf590 con 0x55e6bc748570 2024-09-21T05:52:23.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.786+0000 7f3bced9d640 1 --2- 172.21.15.70:0/532186630 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55e6bc748570 0x55e6bcbe7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:23.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.786+0000 7f3bb5ffb640 10 client.15807 ms_handle_connect on v2:172.21.15.116:6838/3952175670 2024-09-21T05:52:23.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:23.786+0000 7f3bced9d640 1 --2- 172.21.15.70:0/532186630 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55e6bc748570 0x55e6bcbe7500 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a05cd3c6db367c8f server_cookie=e342ac704f86e39f in_seq=0 out_seq=0 2024-09-21T05:52:23.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:23 smithi116 ceph-mon[34332]: pgmap v457: 129 pgs: 129 active+clean; 156 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-21T05:52:25.607 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:25 smithi116 ceph-mon[34332]: pgmap v458: 129 pgs: 129 active+clean; 157 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 127 KiB/s wr, 30 op/s 2024-09-21T05:52:25.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:25 smithi160 ceph-mon[33979]: pgmap v458: 129 pgs: 129 active+clean; 157 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 127 KiB/s wr, 30 op/s 2024-09-21T05:52:25.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:25 smithi070 ceph-mon[30981]: pgmap v458: 129 pgs: 129 active+clean; 157 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 127 KiB/s wr, 30 op/s 2024-09-21T05:52:27.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:27 smithi160 ceph-mon[33979]: pgmap v459: 129 pgs: 129 active+clean; 158 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 239 KiB/s wr, 58 op/s 2024-09-21T05:52:27.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:27 smithi070 ceph-mon[30981]: pgmap v459: 129 pgs: 129 active+clean; 158 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 239 KiB/s wr, 58 op/s 2024-09-21T05:52:27.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:27 smithi116 ceph-mon[34332]: pgmap v459: 129 pgs: 129 active+clean; 158 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 239 KiB/s wr, 58 op/s 2024-09-21T05:52:28.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:28.173+0000 7f3bb5ffb640 1 -- 172.21.15.70:0/532186630 <== mds.0 v2:172.21.15.116:6838/3952175670 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55e6bcacf590 con 0x55e6bc748570 2024-09-21T05:52:28.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:28.173+0000 7f3bb5ffb640 10 client.15807 handle_command_reply: tid=0 2024-09-21T05:52:28.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:28.173+0000 7f3bdae41740 1 client.15807 shutdown 2024-09-21T05:52:28.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:28.173+0000 7f3bdae41740 1 -- 172.21.15.70:0/532186630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6bc793b60 msgr2=0x55e6bcb6bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:28.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:28.173+0000 7f3bdae41740 1 --2- 172.21.15.70:0/532186630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6bc793b60 0x55e6bcb6bec0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3bb800f7d0 tx=0x7f3bb8010bf0 comp rx=0 tx=0).stop 2024-09-21T05:52:28.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:28.173+0000 7f3bdae41740 1 -- 172.21.15.70:0/532186630 shutdown_connections 2024-09-21T05:52:28.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:28.173+0000 7f3bdae41740 1 --2- 172.21.15.70:0/532186630 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55e6bc748570 0x55e6bcbe7500 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:28.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:28.173+0000 7f3bdae41740 1 --2- 172.21.15.70:0/532186630 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e6bc7b4840 0x55e6bcb6c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:28.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:28.173+0000 7f3bdae41740 1 --2- 172.21.15.70:0/532186630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6bc793b60 0x55e6bcb6bec0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:28.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:28.173+0000 7f3bb5ffb640 0 client.15807 ms_handle_reset on v2:172.21.15.116:6838/3952175670 2024-09-21T05:52:28.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:28.173+0000 7f3bdae41740 1 --2- 172.21.15.70:0/532186630 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e6bc78b980 0x55e6bcb6f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:28.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:28.173+0000 7f3bdae41740 1 -- 172.21.15.70:0/532186630 >> 172.21.15.70:0/532186630 conn(0x55e6bc7a8990 msgr2=0x55e6bcb60710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:28.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:28.173+0000 7f3bdae41740 1 -- 172.21.15.70:0/532186630 shutdown_connections 2024-09-21T05:52:28.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:28.173+0000 7f3bdae41740 1 -- 172.21.15.70:0/532186630 wait complete. 2024-09-21T05:52:28.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:28.173+0000 7f3bdae41740 20 client.15807 trim_cache size 0 max 16384 2024-09-21T05:52:28.177 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:52:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 29, 2024-09-21T05:52:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 24641, 2024-09-21T05:52:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 14, 2024-09-21T05:52:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-09-21T05:52:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: "4e5fcff8": { 2024-09-21T05:52:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 14, 2024-09-21T05:52:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-09-21T05:52:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-09-21T05:52:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-09-21T05:52:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-09-21T05:52:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:52:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 90.0, 2024-09-21T05:52:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 147.8, 2024-09-21T05:52:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-09-21T05:52:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-09-21T05:52:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-09-21T05:52:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-09-21T05:52:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-09-21T05:52:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-09-21T05:52:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:52:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:52:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:52:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:52:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:52:28.178 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:52:28.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:28.174+0000 7f3bd48cd640 1 -- 172.21.15.70:0/1274281806 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f3bbc0b6510 msgr2=0x7f3bbc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:28.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:28.174+0000 7f3bd48cd640 1 --2- 172.21.15.70:0/1274281806 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f3bbc0b6510 0x7f3bbc0b8a20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0000c00 tx=0x7f3bc00e9040 comp rx=0 tx=0).stop 2024-09-21T05:52:28.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:28.174+0000 7f3bd48cd640 1 -- 172.21.15.70:0/1274281806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bd01027c0 msgr2=0x7f3bd01a0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:28.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:28.174+0000 7f3bd48cd640 1 --2- 172.21.15.70:0/1274281806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bd01027c0 0x7f3bd01a0a40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000e9c0 tx=0x7f3bc000ee80 comp rx=0 tx=0).stop 2024-09-21T05:52:28.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:28.174+0000 7f3bd48cd640 1 -- 172.21.15.70:0/1274281806 shutdown_connections 2024-09-21T05:52:28.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:28.174+0000 7f3bd48cd640 1 --2- 172.21.15.70:0/1274281806 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f3bbc0b6510 0x7f3bbc0b8a20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:28.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:28.174+0000 7f3bd48cd640 1 --2- 172.21.15.70:0/1274281806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3bd0107c00 0x7f3bd01a6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:28.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:28.174+0000 7f3bd48cd640 1 --2- 172.21.15.70:0/1274281806 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bd0103110 0x7f3bd01a0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:28.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:28.174+0000 7f3bd48cd640 1 --2- 172.21.15.70:0/1274281806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bd01027c0 0x7f3bd01a0a40 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:28.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:28.174+0000 7f3bd48cd640 1 -- 172.21.15.70:0/1274281806 >> 172.21.15.70:0/1274281806 conn(0x7f3bd0079760 msgr2=0x7f3bd0105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:28.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:28.174+0000 7f3bd48cd640 1 -- 172.21.15.70:0/1274281806 shutdown_connections 2024-09-21T05:52:28.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:28.174+0000 7f3bd48cd640 1 -- 172.21.15.70:0/1274281806 wait complete. 2024-09-21T05:52:28.978 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '4e5fcff8', quiesce took 7.9 seconds. Will release after: 19.9 2024-09-21T05:52:29.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:29 smithi160 ceph-mon[33979]: pgmap v460: 129 pgs: 129 active+clean; 160 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 482 KiB/s wr, 85 op/s 2024-09-21T05:52:29.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:29 smithi070 ceph-mon[30981]: pgmap v460: 129 pgs: 129 active+clean; 160 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 482 KiB/s wr, 85 op/s 2024-09-21T05:52:29.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:29 smithi116 ceph-mon[34332]: pgmap v460: 129 pgs: 129 active+clean; 160 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 482 KiB/s wr, 85 op/s 2024-09-21T05:52:31.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:31 smithi160 ceph-mon[33979]: pgmap v461: 129 pgs: 129 active+clean; 159 MiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 548 KiB/s wr, 105 op/s 2024-09-21T05:52:31.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:31 smithi070 ceph-mon[30981]: pgmap v461: 129 pgs: 129 active+clean; 159 MiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 548 KiB/s wr, 105 op/s 2024-09-21T05:52:31.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:31 smithi116 ceph-mon[34332]: pgmap v461: 129 pgs: 129 active+clean; 159 MiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 548 KiB/s wr, 105 op/s 2024-09-21T05:52:33.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:33 smithi160 ceph-mon[33979]: pgmap v462: 129 pgs: 129 active+clean; 160 MiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 708 KiB/s wr, 146 op/s 2024-09-21T05:52:33.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:33 smithi070 ceph-mon[30981]: pgmap v462: 129 pgs: 129 active+clean; 160 MiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 708 KiB/s wr, 146 op/s 2024-09-21T05:52:33.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:33 smithi116 ceph-mon[34332]: pgmap v462: 129 pgs: 129 active+clean; 160 MiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 708 KiB/s wr, 146 op/s 2024-09-21T05:52:35.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:35 smithi160 ceph-mon[33979]: pgmap v463: 129 pgs: 129 active+clean; 160 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 672 KiB/s wr, 147 op/s 2024-09-21T05:52:35.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:35 smithi070 ceph-mon[30981]: pgmap v463: 129 pgs: 129 active+clean; 160 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 672 KiB/s wr, 147 op/s 2024-09-21T05:52:35.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:35 smithi116 ceph-mon[34332]: pgmap v463: 129 pgs: 129 active+clean; 160 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 672 KiB/s wr, 147 op/s 2024-09-21T05:52:37.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:37 smithi070 ceph-mon[30981]: pgmap v464: 129 pgs: 129 active+clean; 160 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 591 KiB/s wr, 134 op/s 2024-09-21T05:52:37.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:37 smithi160 ceph-mon[33979]: pgmap v464: 129 pgs: 129 active+clean; 160 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 591 KiB/s wr, 134 op/s 2024-09-21T05:52:37.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:37 smithi116 ceph-mon[34332]: pgmap v464: 129 pgs: 129 active+clean; 160 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 591 KiB/s wr, 134 op/s 2024-09-21T05:52:39.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:39 smithi160 ceph-mon[33979]: pgmap v465: 129 pgs: 129 active+clean; 160 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 480 KiB/s wr, 105 op/s 2024-09-21T05:52:39.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:39 smithi070 ceph-mon[30981]: pgmap v465: 129 pgs: 129 active+clean; 160 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 480 KiB/s wr, 105 op/s 2024-09-21T05:52:39.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:39 smithi116 ceph-mon[34332]: pgmap v465: 129 pgs: 129 active+clean; 160 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 480 KiB/s wr, 105 op/s 2024-09-21T05:52:41.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:41 smithi160 ceph-mon[33979]: pgmap v466: 129 pgs: 129 active+clean; 160 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 236 KiB/s wr, 79 op/s 2024-09-21T05:52:41.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:41 smithi070 ceph-mon[30981]: pgmap v466: 129 pgs: 129 active+clean; 160 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 236 KiB/s wr, 79 op/s 2024-09-21T05:52:41.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:41 smithi116 ceph-mon[34332]: pgmap v466: 129 pgs: 129 active+clean; 160 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 236 KiB/s wr, 79 op/s 2024-09-21T05:52:43.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:43 smithi160 ceph-mon[33979]: pgmap v467: 129 pgs: 129 active+clean; 160 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 172 KiB/s wr, 58 op/s 2024-09-21T05:52:43.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:43 smithi070 ceph-mon[30981]: pgmap v467: 129 pgs: 129 active+clean; 160 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 172 KiB/s wr, 58 op/s 2024-09-21T05:52:43.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:43 smithi116 ceph-mon[34332]: pgmap v467: 129 pgs: 129 active+clean; 160 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 172 KiB/s wr, 58 op/s 2024-09-21T05:52:45.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:45 smithi160 ceph-mon[33979]: pgmap v468: 129 pgs: 129 active+clean; 160 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 KiB/s wr, 18 op/s 2024-09-21T05:52:45.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:45 smithi070 ceph-mon[30981]: pgmap v468: 129 pgs: 129 active+clean; 160 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 KiB/s wr, 18 op/s 2024-09-21T05:52:45.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:45 smithi116 ceph-mon[34332]: pgmap v468: 129 pgs: 129 active+clean; 160 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 KiB/s wr, 18 op/s 2024-09-21T05:52:47.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:47 smithi160 ceph-mon[33979]: pgmap v469: 129 pgs: 129 active+clean; 160 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 11 op/s 2024-09-21T05:52:47.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:47 smithi070 ceph-mon[30981]: pgmap v469: 129 pgs: 129 active+clean; 160 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 11 op/s 2024-09-21T05:52:47.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:47 smithi116 ceph-mon[34332]: pgmap v469: 129 pgs: 129 active+clean; 160 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 11 op/s 2024-09-21T05:52:48.878 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:52:49.137 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:49.526 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:49 smithi070 ceph-mon[30981]: pgmap v470: 129 pgs: 129 active+clean; 160 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.3 KiB/s wr, 10 op/s 2024-09-21T05:52:49.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.614+0000 7fca47899640 1 -- 172.21.15.70:0/4260395912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca4010de10 msgr2=0x7fca40110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:49.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.614+0000 7fca47899640 1 --2- 172.21.15.70:0/4260395912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca4010de10 0x7fca40110300 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fca38009900 tx=0x7fca3802a410 comp rx=0 tx=0).stop 2024-09-21T05:52:49.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.614+0000 7fca47899640 1 -- 172.21.15.70:0/4260395912 shutdown_connections 2024-09-21T05:52:49.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.614+0000 7fca47899640 1 --2- 172.21.15.70:0/4260395912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca4010de10 0x7fca40110300 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:49.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.614+0000 7fca47899640 1 --2- 172.21.15.70:0/4260395912 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca40105300 0x7fca4010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:49.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.614+0000 7fca47899640 1 --2- 172.21.15.70:0/4260395912 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca401049b0 0x7fca40104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:49.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.614+0000 7fca47899640 1 -- 172.21.15.70:0/4260395912 >> 172.21.15.70:0/4260395912 conn(0x7fca40079730 msgr2=0x7fca40079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:49.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.614+0000 7fca47899640 1 -- 172.21.15.70:0/4260395912 shutdown_connections 2024-09-21T05:52:49.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.614+0000 7fca47899640 1 -- 172.21.15.70:0/4260395912 wait complete. 2024-09-21T05:52:49.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.615+0000 7fca47899640 1 Processor -- start 2024-09-21T05:52:49.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.615+0000 7fca47899640 1 -- start start 2024-09-21T05:52:49.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.615+0000 7fca47899640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca401049b0 0x7fca4019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:49.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.615+0000 7fca47899640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca40105300 0x7fca4019aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:49.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.615+0000 7fca47899640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca4010de10 0x7fca4019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:49.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.615+0000 7fca47899640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fca40113ac0 con 0x7fca4010de10 2024-09-21T05:52:49.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.615+0000 7fca47899640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fca40113940 con 0x7fca40105300 2024-09-21T05:52:49.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.615+0000 7fca47899640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fca40113c40 con 0x7fca401049b0 2024-09-21T05:52:49.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.616+0000 7fca45e36640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca4010de10 0x7fca4019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:49.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.616+0000 7fca45e36640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca4010de10 0x7fca4019fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43748/0 (socket says 172.21.15.70:43748) 2024-09-21T05:52:49.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.616+0000 7fca45e36640 1 -- 172.21.15.70:0/3412283967 learned_addr learned my addr 172.21.15.70:0/3412283967 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:52:49.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.616+0000 7fca45635640 1 --2- 172.21.15.70:0/3412283967 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca401049b0 0x7fca4019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:49.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.616+0000 7fca44e34640 1 --2- 172.21.15.70:0/3412283967 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca40105300 0x7fca4019aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:49.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.616+0000 7fca45e36640 1 -- 172.21.15.70:0/3412283967 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca401049b0 msgr2=0x7fca4019a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:49.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.616+0000 7fca45e36640 1 --2- 172.21.15.70:0/3412283967 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca401049b0 0x7fca4019a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:49.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.616+0000 7fca45e36640 1 -- 172.21.15.70:0/3412283967 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca40105300 msgr2=0x7fca4019aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:49.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.616+0000 7fca45e36640 1 --2- 172.21.15.70:0/3412283967 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca40105300 0x7fca4019aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:49.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.616+0000 7fca45e36640 1 -- 172.21.15.70:0/3412283967 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca401a0400 con 0x7fca4010de10 2024-09-21T05:52:49.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.616+0000 7fca45e36640 1 --2- 172.21.15.70:0/3412283967 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca4010de10 0x7fca4019fcd0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fca38009230 tx=0x7fca38004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:49.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.616+0000 7fca3e7fc640 1 -- 172.21.15.70:0/3412283967 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3803f030 con 0x7fca4010de10 2024-09-21T05:52:49.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.616+0000 7fca3e7fc640 1 -- 172.21.15.70:0/3412283967 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fca38003aa0 con 0x7fca4010de10 2024-09-21T05:52:49.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.616+0000 7fca3e7fc640 1 -- 172.21.15.70:0/3412283967 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca38035070 con 0x7fca4010de10 2024-09-21T05:52:49.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.616+0000 7fca47899640 1 -- 172.21.15.70:0/3412283967 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca401a0690 con 0x7fca4010de10 2024-09-21T05:52:49.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.616+0000 7fca47899640 1 -- 172.21.15.70:0/3412283967 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca401a6e50 con 0x7fca4010de10 2024-09-21T05:52:49.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.617+0000 7fca47899640 1 -- 172.21.15.70:0/3412283967 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca40104dc0 con 0x7fca4010de10 2024-09-21T05:52:49.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.620+0000 7fca3e7fc640 1 -- 172.21.15.70:0/3412283967 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7fca38042030 con 0x7fca4010de10 2024-09-21T05:52:49.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.620+0000 7fca3e7fc640 1 --2- 172.21.15.70:0/3412283967 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fca280b6590 0x7fca280b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:49.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.621+0000 7fca45635640 1 --2- 172.21.15.70:0/3412283967 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fca280b6590 0x7fca280b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:49.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.621+0000 7fca3e7fc640 1 -- 172.21.15.70:0/3412283967 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fca381081b0 con 0x7fca4010de10 2024-09-21T05:52:49.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.621+0000 7fca45635640 1 --2- 172.21.15.70:0/3412283967 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fca280b6590 0x7fca280b8aa0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fca4006bc60 tx=0x7fca30009670 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:49.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.624+0000 7fca3e7fc640 1 -- 172.21.15.70:0/3412283967 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fca380ce650 con 0x7fca4010de10 2024-09-21T05:52:49.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:49 smithi160 ceph-mon[33979]: pgmap v470: 129 pgs: 129 active+clean; 160 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.3 KiB/s wr, 10 op/s 2024-09-21T05:52:49.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:49 smithi116 ceph-mon[34332]: pgmap v470: 129 pgs: 129 active+clean; 160 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.3 KiB/s wr, 10 op/s 2024-09-21T05:52:49.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.841+0000 7fca47899640 1 -- 172.21.15.70:0/3412283967 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca4019b5c0 con 0x7fca4010de10 2024-09-21T05:52:49.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.842+0000 7fca3e7fc640 1 -- 172.21.15.70:0/3412283967 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7fca4019b5c0 con 0x7fca4010de10 2024-09-21T05:52:49.845 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:52:49.845 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":29,"btime":"2024-09-21T05:51:21:253819+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3519318330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3519318330},{"type":"v1","addr":"172.21.15.70:6835","nonce":3519318330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2706663460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2706663460},{"type":"v1","addr":"172.21.15.70:6837","nonce":2706663460}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:47:06.246985+0000","modified":"2024-09-21T05:51:21.134554+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24628,"mds_2":24611,"mds_3":24610,"mds_4":24598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/1914209867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1914209867},{"type":"v1","addr":"172.21.15.70:6839","nonce":1914209867}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3392175775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3392175775},{"type":"v1","addr":"172.21.15.70:6841","nonce":3392175775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/3543945704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3543945704},{"type":"v1","addr":"172.21.15.160:6833","nonce":3543945704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6833/283778129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":283778129},{"type":"v1","addr":"172.21.15.116:6833","nonce":283778129}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/3787256790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3787256790},{"type":"v1","addr":"172.21.15.116:6835","nonce":3787256790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.160:6835/2001692372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2001692372},{"type":"v1","addr":"172.21.15.160:6835","nonce":2001692372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.160:6837/2558120045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2558120045},{"type":"v1","addr":"172.21.15.160:6837","nonce":2558120045}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24611":{"gid":24611,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/444312934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":444312934},{"type":"v1","addr":"172.21.15.116:6837","nonce":444312934}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.160:6839/1339744282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1339744282},{"type":"v1","addr":"172.21.15.160:6839","nonce":1339744282}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/3952175670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3952175670},{"type":"v1","addr":"172.21.15.116:6839","nonce":3952175670}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24641,"qdb_cluster":[24641,24628,24610,24611,24598]},"id":1}]} 2024-09-21T05:52:49.845 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 29 2024-09-21T05:52:49.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.844+0000 7fca47899640 1 -- 172.21.15.70:0/3412283967 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fca280b6590 msgr2=0x7fca280b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:49.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.844+0000 7fca47899640 1 --2- 172.21.15.70:0/3412283967 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fca280b6590 0x7fca280b8aa0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fca4006bc60 tx=0x7fca30009670 comp rx=0 tx=0).stop 2024-09-21T05:52:49.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.844+0000 7fca47899640 1 -- 172.21.15.70:0/3412283967 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca4010de10 msgr2=0x7fca4019fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:49.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.844+0000 7fca47899640 1 --2- 172.21.15.70:0/3412283967 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca4010de10 0x7fca4019fcd0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fca38009230 tx=0x7fca38004270 comp rx=0 tx=0).stop 2024-09-21T05:52:49.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.844+0000 7fca47899640 1 -- 172.21.15.70:0/3412283967 shutdown_connections 2024-09-21T05:52:49.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.844+0000 7fca47899640 1 --2- 172.21.15.70:0/3412283967 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fca280b6590 0x7fca280b8aa0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:49.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.844+0000 7fca47899640 1 --2- 172.21.15.70:0/3412283967 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca4010de10 0x7fca4019fcd0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:49.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.844+0000 7fca47899640 1 --2- 172.21.15.70:0/3412283967 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca40105300 0x7fca4019aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:49.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.844+0000 7fca47899640 1 --2- 172.21.15.70:0/3412283967 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca401049b0 0x7fca4019a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:49.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.845+0000 7fca47899640 1 -- 172.21.15.70:0/3412283967 >> 172.21.15.70:0/3412283967 conn(0x7fca40079730 msgr2=0x7fca400ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:49.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.845+0000 7fca47899640 1 -- 172.21.15.70:0/3412283967 shutdown_connections 2024-09-21T05:52:49.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:49.845+0000 7fca47899640 1 -- 172.21.15.70:0/3412283967 wait complete. 2024-09-21T05:52:50.641 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:50 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3412283967' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:52:50.668 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24641 quiesce db --set-id 4e5fcff8 --release --await' 2024-09-21T05:52:50.669 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24641 quiesce db --set-id 4e5fcff8 --release --await 2024-09-21T05:52:50.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:50 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3412283967' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:52:50.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:50 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3412283967' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:52:50.914 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:51.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.371+0000 7f1d48c70640 1 -- 172.21.15.70:0/4189581011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d44102a80 msgr2=0x7f1d44102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:51.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.371+0000 7f1d48c70640 1 --2- 172.21.15.70:0/4189581011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d44102a80 0x7f1d44102e90 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f1d34009900 tx=0x7f1d3402a410 comp rx=0 tx=0).stop 2024-09-21T05:52:51.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.372+0000 7f1d48c70640 1 -- 172.21.15.70:0/4189581011 shutdown_connections 2024-09-21T05:52:51.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.372+0000 7f1d48c70640 1 --2- 172.21.15.70:0/4189581011 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d441083c0 0x7f1d441087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.372+0000 7f1d48c70640 1 --2- 172.21.15.70:0/4189581011 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d44108d10 0x7f1d4410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.372+0000 7f1d48c70640 1 --2- 172.21.15.70:0/4189581011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d44102a80 0x7f1d44102e90 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.372+0000 7f1d48c70640 1 -- 172.21.15.70:0/4189581011 >> 172.21.15.70:0/4189581011 conn(0x7f1d44079740 msgr2=0x7f1d44079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:51.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.372+0000 7f1d48c70640 1 -- 172.21.15.70:0/4189581011 shutdown_connections 2024-09-21T05:52:51.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.372+0000 7f1d48c70640 1 -- 172.21.15.70:0/4189581011 wait complete. 2024-09-21T05:52:51.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.373+0000 7f1d48c70640 1 Processor -- start 2024-09-21T05:52:51.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.373+0000 7f1d48c70640 1 -- start start 2024-09-21T05:52:51.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.373+0000 7f1d48c70640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d44102a80 0x7f1d44199070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:51.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.373+0000 7f1d48c70640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d441083c0 0x7f1d441995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:51.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.373+0000 7f1d48c70640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d44108d10 0x7f1d44199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:51.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.373+0000 7f1d48c70640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1d44112970 con 0x7f1d441083c0 2024-09-21T05:52:51.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.373+0000 7f1d48c70640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1d441127f0 con 0x7f1d44108d10 2024-09-21T05:52:51.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.373+0000 7f1d48c70640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1d44112af0 con 0x7f1d44102a80 2024-09-21T05:52:51.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.373+0000 7f1d41d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d441083c0 0x7f1d441995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:51.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.373+0000 7f1d41d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d441083c0 0x7f1d441995b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37588/0 (socket says 172.21.15.70:37588) 2024-09-21T05:52:51.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.373+0000 7f1d41d9b640 1 -- 172.21.15.70:0/2984166462 learned_addr learned my addr 172.21.15.70:0/2984166462 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:52:51.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.373+0000 7f1d42d9d640 1 --2- 172.21.15.70:0/2984166462 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d44108d10 0x7f1d44199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:51.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.374+0000 7f1d4259c640 1 --2- 172.21.15.70:0/2984166462 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d44102a80 0x7f1d44199070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:51.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.374+0000 7f1d41d9b640 1 -- 172.21.15.70:0/2984166462 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d44102a80 msgr2=0x7f1d44199070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:51.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.374+0000 7f1d41d9b640 1 --2- 172.21.15.70:0/2984166462 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d44102a80 0x7f1d44199070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.374+0000 7f1d41d9b640 1 -- 172.21.15.70:0/2984166462 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d44108d10 msgr2=0x7f1d44199af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:51.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.374+0000 7f1d41d9b640 1 --2- 172.21.15.70:0/2984166462 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d44108d10 0x7f1d44199af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.374+0000 7f1d41d9b640 1 -- 172.21.15.70:0/2984166462 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d441a8720 con 0x7f1d441083c0 2024-09-21T05:52:51.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.374+0000 7f1d4259c640 1 --2- 172.21.15.70:0/2984166462 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d44102a80 0x7f1d44199070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:52:51.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.374+0000 7f1d41d9b640 1 --2- 172.21.15.70:0/2984166462 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d441083c0 0x7f1d441995b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f1d3800d740 tx=0x7f1d3800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:51.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.374+0000 7f1d337fe640 1 -- 172.21.15.70:0/2984166462 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d38017070 con 0x7f1d441083c0 2024-09-21T05:52:51.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.374+0000 7f1d48c70640 1 -- 172.21.15.70:0/2984166462 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d441a8a10 con 0x7f1d441083c0 2024-09-21T05:52:51.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.374+0000 7f1d337fe640 1 -- 172.21.15.70:0/2984166462 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f1d3800de50 con 0x7f1d441083c0 2024-09-21T05:52:51.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.374+0000 7f1d337fe640 1 -- 172.21.15.70:0/2984166462 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d38004cd0 con 0x7f1d441083c0 2024-09-21T05:52:51.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.374+0000 7f1d48c70640 1 -- 172.21.15.70:0/2984166462 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d441a8f00 con 0x7f1d441083c0 2024-09-21T05:52:51.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.377+0000 7f1d337fe640 1 -- 172.21.15.70:0/2984166462 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f1d38009c30 con 0x7f1d441083c0 2024-09-21T05:52:51.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.377+0000 7f1d4f1e4740 1 Processor -- start 2024-09-21T05:52:51.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.378+0000 7f1d4f1e4740 1 -- start start 2024-09-21T05:52:51.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.378+0000 7f1d337fe640 1 --2- 172.21.15.70:0/2984166462 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1d2c0b6510 0x7f1d2c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:51.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.378+0000 7f1d4f1e4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569ec71e520 0x5569ecac4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:51.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.378+0000 7f1d4f1e4740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5569ec6f5660 0x5569ecac4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:51.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.378+0000 7f1d4f1e4740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569ec6fd840 0x5569ecac4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:51.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.378+0000 7f1d4f1e4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5569ec9afdc0 con 0x5569ec71e520 2024-09-21T05:52:51.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.378+0000 7f1d4f1e4740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5569eca3c1f0 con 0x5569ec6fd840 2024-09-21T05:52:51.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.378+0000 7f1d4f1e4740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5569eca2b620 con 0x5569ec6f5660 2024-09-21T05:52:51.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.378+0000 7f1d42d9d640 1 --2- 172.21.15.70:0/2984166462 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1d2c0b6510 0x7f1d2c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:51.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.378+0000 7f1d337fe640 1 -- 172.21.15.70:0/2984166462 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f1d380e70b0 con 0x7f1d441083c0 2024-09-21T05:52:51.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.378+0000 7f1d4259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569ec71e520 0x5569ecac4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:51.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.378+0000 7f1d4259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569ec71e520 0x5569ecac4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37592/0 (socket says 172.21.15.70:37592) 2024-09-21T05:52:51.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.378+0000 7f1d4259c640 1 -- 172.21.15.70:0/1522035507 learned_addr learned my addr 172.21.15.70:0/1522035507 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:52:51.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.378+0000 7f1d41d9b640 1 --2- 172.21.15.70:0/1522035507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5569ec6f5660 0x5569ecac4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:51.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.379+0000 7f1d42d9d640 1 --2- 172.21.15.70:0/1522035507 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569ec6fd840 0x5569ecac4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:51.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.379+0000 7f1d4259c640 1 -- 172.21.15.70:0/1522035507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5569ec6f5660 msgr2=0x5569ecac4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:52:51.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.379+0000 7f1d4259c640 1 --2- 172.21.15.70:0/1522035507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5569ec6f5660 0x5569ecac4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.379+0000 7f1d4259c640 1 -- 172.21.15.70:0/1522035507 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569ec6fd840 msgr2=0x5569ecac4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:52:51.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.379+0000 7f1d4259c640 1 --2- 172.21.15.70:0/1522035507 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569ec6fd840 0x5569ecac4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.379+0000 7f1d4259c640 1 -- 172.21.15.70:0/1522035507 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569ec9f3fd0 con 0x5569ec71e520 2024-09-21T05:52:51.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.379+0000 7f1d41d9b640 1 --2- 172.21.15.70:0/1522035507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5569ec6f5660 0x5569ecac4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:52:51.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.379+0000 7f1d42d9d640 1 --2- 172.21.15.70:0/1522035507 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569ec6fd840 0x5569ecac4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:52:51.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.379+0000 7f1d42d9d640 1 --2- 172.21.15.70:0/2984166462 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1d2c0b6510 0x7f1d2c0b8a20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c005fd0 tx=0x7f1d3c009ae0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:51.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.379+0000 7f1d4259c640 1 --2- 172.21.15.70:0/1522035507 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569ec71e520 0x5569ecac4510 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f1d34005d90 tx=0x7f1d34032e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3afc89364763aa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:51.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.379+0000 7f1d30ff9640 1 -- 172.21.15.70:0/1522035507 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3403f070 con 0x5569ec71e520 2024-09-21T05:52:51.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.379+0000 7f1d30ff9640 1 -- 172.21.15.70:0/1522035507 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f1d340316c0 con 0x5569ec71e520 2024-09-21T05:52:51.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.379+0000 7f1d30ff9640 1 -- 172.21.15.70:0/1522035507 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d34035070 con 0x5569ec71e520 2024-09-21T05:52:51.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.380+0000 7f1d4f1e4740 1 -- 172.21.15.70:0/1522035507 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569ec71e520 msgr2=0x5569ecac4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:51.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.380+0000 7f1d4f1e4740 1 --2- 172.21.15.70:0/1522035507 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569ec71e520 0x5569ecac4510 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f1d34005d90 tx=0x7f1d34032e00 comp rx=0 tx=0).stop 2024-09-21T05:52:51.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.380+0000 7f1d4f1e4740 1 -- 172.21.15.70:0/1522035507 shutdown_connections 2024-09-21T05:52:51.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.380+0000 7f1d4f1e4740 1 --2- 172.21.15.70:0/1522035507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5569ec6f5660 0x5569ecac4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.380+0000 7f1d4f1e4740 1 --2- 172.21.15.70:0/1522035507 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569ec6fd840 0x5569ecac4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.380+0000 7f1d4f1e4740 1 --2- 172.21.15.70:0/1522035507 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569ec71e520 0x5569ecac4510 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.380+0000 7f1d4f1e4740 1 -- 172.21.15.70:0/1522035507 >> 172.21.15.70:0/1522035507 conn(0x5569ec712910 msgr2=0x5569ecac2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:51.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.380+0000 7f1d4f1e4740 1 -- 172.21.15.70:0/1522035507 shutdown_connections 2024-09-21T05:52:51.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.380+0000 7f1d4f1e4740 1 -- 172.21.15.70:0/1522035507 wait complete. 2024-09-21T05:52:51.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.380+0000 7f1d4f1e4740 1 -- start start 2024-09-21T05:52:51.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.381+0000 7f1d4f1e4740 1 Processor -- start 2024-09-21T05:52:51.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.381+0000 7f1d4f1e4740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569ec6f5660 0x5569ecacfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:51.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.381+0000 7f1d4f1e4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569ec6fd840 0x5569ecad0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:51.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.381+0000 7f1d4f1e4740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5569ec71e520 0x5569ecadbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:51.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.381+0000 7f1d4f1e4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5569ec9c6300 con 0x5569ec6fd840 2024-09-21T05:52:51.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.381+0000 7f1d4f1e4740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5569eca2f430 con 0x5569ec6f5660 2024-09-21T05:52:51.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.381+0000 7f1d4f1e4740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5569ec88cbb0 con 0x5569ec71e520 2024-09-21T05:52:51.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.381+0000 7f1d4f1e4740 10 client.0 _ll_register_callbacks cb 0x5569ec9e0120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:52:51.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.381+0000 7f1d41d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569ec6fd840 0x5569ecad0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:51.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.381+0000 7f1d41d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569ec6fd840 0x5569ecad0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37602/0 (socket says 172.21.15.70:37602) 2024-09-21T05:52:51.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.381+0000 7f1d41d9b640 1 -- 172.21.15.70:0/2845278219 learned_addr learned my addr 172.21.15.70:0/2845278219 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:52:51.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.381+0000 7f1d4259c640 1 --2- 172.21.15.70:0/2845278219 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569ec6f5660 0x5569ecacfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:51.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.381+0000 7f1d41d9b640 1 -- 172.21.15.70:0/2845278219 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5569ec71e520 msgr2=0x5569ecadbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:52:51.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.381+0000 7f1d41d9b640 1 --2- 172.21.15.70:0/2845278219 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5569ec71e520 0x5569ecadbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.381+0000 7f1d41d9b640 1 -- 172.21.15.70:0/2845278219 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569ec6f5660 msgr2=0x5569ecacfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:52:51.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.381+0000 7f1d41d9b640 1 --2- 172.21.15.70:0/2845278219 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569ec6f5660 0x5569ecacfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.381+0000 7f1d41d9b640 1 -- 172.21.15.70:0/2845278219 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569ec9b5780 con 0x5569ec6fd840 2024-09-21T05:52:51.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.382+0000 7f1d41d9b640 1 --2- 172.21.15.70:0/2845278219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569ec6fd840 0x5569ecad0150 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f1d380aa0c0 tx=0x7f1d380aca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f36c81e8e4024d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:51.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.382+0000 7f1d29ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:52:51.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.382+0000 7f1d29ffb640 1 -- 172.21.15.70:0/2845278219 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d38020070 con 0x5569ec6fd840 2024-09-21T05:52:51.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.382+0000 7f1d29ffb640 1 -- 172.21.15.70:0/2845278219 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f1d380a87a0 con 0x5569ec6fd840 2024-09-21T05:52:51.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.382+0000 7f1d4f1e4740 1 -- 172.21.15.70:0/2845278219 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d340316c0 con 0x5569ec6fd840 2024-09-21T05:52:51.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.382+0000 7f1d29ffb640 1 -- 172.21.15.70:0/2845278219 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1d380cee60 con 0x5569ec6fd840 2024-09-21T05:52:51.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.382+0000 7f1d4f1e4740 10 client.15825 fetch_fsmap learned FSMap version 29 2024-09-21T05:52:51.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.382+0000 7f1d4f1e4740 1 -- 172.21.15.70:0/2845278219 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5569ec789b00 con 0x5569ec6fd840 2024-09-21T05:52:51.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.382+0000 7f1d29ffb640 1 -- 172.21.15.70:0/2845278219 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f1d340316c0 con 0x5569ec6fd840 2024-09-21T05:52:51.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.382+0000 7f1d29ffb640 1 -- 172.21.15.70:0/2845278219 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8386+0+0 (secure 0 0 0) 0x7f1d380d4190 con 0x5569ec6fd840 2024-09-21T05:52:51.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.382+0000 7f1d4f1e4740 10 client.15825 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T05:52:51.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.382+0000 7f1d4f1e4740 10 client.15825 resolve_mds: validated gid 24641 aka daemon mds.b 2024-09-21T05:52:51.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.382+0000 7f1d4f1e4740 20 client.15825 populate_metadata read hostname 'smithi070' 2024-09-21T05:52:51.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.382+0000 7f1d4f1e4740 1 --2- 172.21.15.70:0/2845278219 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x5569ec6dcea0 0x5569ecae1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:51.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.382+0000 7f1d4f1e4740 4 client.15825 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:52:51.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.382+0000 7f1d4f1e4740 1 -- 172.21.15.70:0/2845278219 --> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569eca3e140 con 0x5569ec6dcea0 2024-09-21T05:52:51.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.383+0000 7f1d4259c640 1 --2- 172.21.15.70:0/2845278219 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x5569ec6dcea0 0x5569ecae1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:51.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.383+0000 7f1d29ffb640 10 client.15825 ms_handle_connect on v2:172.21.15.116:6838/3952175670 2024-09-21T05:52:51.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.383+0000 7f1d4259c640 1 --2- 172.21.15.70:0/2845278219 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x5569ec6dcea0 0x5569ecae1f10 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea62d6dfd48a3da9 server_cookie=f319bf20f242ee09 in_seq=0 out_seq=0 2024-09-21T05:52:51.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.384+0000 7f1d29ffb640 1 -- 172.21.15.70:0/2845278219 <== mds.0 v2:172.21.15.116:6838/3952175670 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5569eca3e140 con 0x5569ec6dcea0 2024-09-21T05:52:51.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.384+0000 7f1d29ffb640 10 client.15825 handle_command_reply: tid=0 2024-09-21T05:52:51.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.384+0000 7f1d4f1e4740 1 client.15825 shutdown 2024-09-21T05:52:51.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.384+0000 7f1d4f1e4740 1 -- 172.21.15.70:0/2845278219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569ec6fd840 msgr2=0x5569ecad0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:51.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.384+0000 7f1d4f1e4740 1 --2- 172.21.15.70:0/2845278219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569ec6fd840 0x5569ecad0150 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f1d380aa0c0 tx=0x7f1d380aca90 comp rx=0 tx=0).stop 2024-09-21T05:52:51.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.384+0000 7f1d4f1e4740 1 -- 172.21.15.70:0/2845278219 shutdown_connections 2024-09-21T05:52:51.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.384+0000 7f1d4f1e4740 1 --2- 172.21.15.70:0/2845278219 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x5569ec6dcea0 0x5569ecae1f10 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.384+0000 7f1d4f1e4740 1 --2- 172.21.15.70:0/2845278219 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5569ec71e520 0x5569ecadbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.384+0000 7f1d4f1e4740 1 --2- 172.21.15.70:0/2845278219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569ec6fd840 0x5569ecad0150 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.384+0000 7f1d4f1e4740 1 --2- 172.21.15.70:0/2845278219 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569ec6f5660 0x5569ecacfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.384+0000 7f1d29ffb640 0 client.15825 ms_handle_reset on v2:172.21.15.116:6838/3952175670 2024-09-21T05:52:51.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.384+0000 7f1d4f1e4740 1 -- 172.21.15.70:0/2845278219 >> 172.21.15.70:0/2845278219 conn(0x5569ec712910 msgr2=0x5569ecac76f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:51.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.384+0000 7f1d4f1e4740 1 -- 172.21.15.70:0/2845278219 shutdown_connections 2024-09-21T05:52:51.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.384+0000 7f1d4f1e4740 1 -- 172.21.15.70:0/2845278219 wait complete. 2024-09-21T05:52:51.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.384+0000 7f1d4f1e4740 20 client.15825 trim_cache size 0 max 16384 2024-09-21T05:52:51.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.402+0000 7f1d4f1e4740 1 Processor -- start 2024-09-21T05:52:51.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.402+0000 7f1d4f1e4740 1 -- start start 2024-09-21T05:52:51.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.402+0000 7f1d4f1e4740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569ec6f5660 0x5569ecac1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:51.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.402+0000 7f1d4f1e4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569ec6fd840 0x5569ecac1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:51.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.402+0000 7f1d4f1e4740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5569ec71e520 0x5569ecacce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:51.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.402+0000 7f1d4f1e4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1d441b2e00 con 0x5569ec6fd840 2024-09-21T05:52:51.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.402+0000 7f1d4f1e4740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1d441b4a00 con 0x5569ec6f5660 2024-09-21T05:52:51.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.402+0000 7f1d4f1e4740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1d441b34d0 con 0x5569ec71e520 2024-09-21T05:52:51.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.402+0000 7f1d41d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569ec6fd840 0x5569ecac1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:51.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.402+0000 7f1d41d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569ec6fd840 0x5569ecac1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37610/0 (socket says 172.21.15.70:37610) 2024-09-21T05:52:51.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.402+0000 7f1d41d9b640 1 -- 172.21.15.70:0/4060450631 learned_addr learned my addr 172.21.15.70:0/4060450631 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:52:51.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.402+0000 7f1d4259c640 1 --2- 172.21.15.70:0/4060450631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569ec6f5660 0x5569ecac1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:51.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.402+0000 7f1d42d9d640 1 --2- 172.21.15.70:0/4060450631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5569ec71e520 0x5569ecacce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:51.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.402+0000 7f1d41d9b640 1 -- 172.21.15.70:0/4060450631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5569ec71e520 msgr2=0x5569ecacce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:52:51.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.402+0000 7f1d41d9b640 1 --2- 172.21.15.70:0/4060450631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5569ec71e520 0x5569ecacce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.402+0000 7f1d41d9b640 1 -- 172.21.15.70:0/4060450631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569ec6f5660 msgr2=0x5569ecac1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:52:51.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.402+0000 7f1d41d9b640 1 --2- 172.21.15.70:0/4060450631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569ec6f5660 0x5569ecac1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.402+0000 7f1d41d9b640 1 -- 172.21.15.70:0/4060450631 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569ec800960 con 0x5569ec6fd840 2024-09-21T05:52:51.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.403+0000 7f1d41d9b640 1 --2- 172.21.15.70:0/4060450631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569ec6fd840 0x5569ecac1e80 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f1d380a9420 tx=0x7f1d380ac960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e53e6c6536fce7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:51.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.403+0000 7f1d2bfff640 1 -- 172.21.15.70:0/4060450631 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d38020030 con 0x5569ec6fd840 2024-09-21T05:52:51.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.403+0000 7f1d2bfff640 1 -- 172.21.15.70:0/4060450631 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f1d380af070 con 0x5569ec6fd840 2024-09-21T05:52:51.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.403+0000 7f1d2bfff640 1 -- 172.21.15.70:0/4060450631 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d380abb20 con 0x5569ec6fd840 2024-09-21T05:52:51.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.404+0000 7f1d4f1e4740 1 -- 172.21.15.70:0/4060450631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569ec6fd840 msgr2=0x5569ecac1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:51.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.404+0000 7f1d4f1e4740 1 --2- 172.21.15.70:0/4060450631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569ec6fd840 0x5569ecac1e80 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f1d380a9420 tx=0x7f1d380ac960 comp rx=0 tx=0).stop 2024-09-21T05:52:51.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.404+0000 7f1d4f1e4740 1 -- 172.21.15.70:0/4060450631 shutdown_connections 2024-09-21T05:52:51.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.404+0000 7f1d4f1e4740 1 --2- 172.21.15.70:0/4060450631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5569ec71e520 0x5569ecacce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.404+0000 7f1d4f1e4740 1 --2- 172.21.15.70:0/4060450631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569ec6fd840 0x5569ecac1e80 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.404+0000 7f1d4f1e4740 1 --2- 172.21.15.70:0/4060450631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569ec6f5660 0x5569ecac1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.404+0000 7f1d4f1e4740 1 -- 172.21.15.70:0/4060450631 >> 172.21.15.70:0/4060450631 conn(0x5569ec712910 msgr2=0x5569ecac5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:51.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.404+0000 7f1d4f1e4740 1 -- 172.21.15.70:0/4060450631 shutdown_connections 2024-09-21T05:52:51.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.404+0000 7f1d4f1e4740 1 -- 172.21.15.70:0/4060450631 wait complete. 2024-09-21T05:52:51.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.404+0000 7f1d4f1e4740 1 -- start start 2024-09-21T05:52:51.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.404+0000 7f1d4f1e4740 1 Processor -- start 2024-09-21T05:52:51.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.405+0000 7f1d4f1e4740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5569ec6f5660 0x5569ecad8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:51.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.405+0000 7f1d4f1e4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569ec6fd840 0x5569ecad4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:51.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.405+0000 7f1d4f1e4740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569ec71e520 0x5569ecad5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:51.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.405+0000 7f1d4f1e4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1d441b4270 con 0x5569ec6fd840 2024-09-21T05:52:51.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.405+0000 7f1d4f1e4740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1d441b3ba0 con 0x5569ec71e520 2024-09-21T05:52:51.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.405+0000 7f1d41d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569ec6fd840 0x5569ecad4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:51.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.405+0000 7f1d4f1e4740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1d441b0de0 con 0x5569ec6f5660 2024-09-21T05:52:51.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.405+0000 7f1d41d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569ec6fd840 0x5569ecad4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37620/0 (socket says 172.21.15.70:37620) 2024-09-21T05:52:51.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.405+0000 7f1d41d9b640 1 -- 172.21.15.70:0/2730224133 learned_addr learned my addr 172.21.15.70:0/2730224133 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:52:51.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.405+0000 7f1d4f1e4740 10 client.0 _ll_register_callbacks cb 0x7f1d380a94a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:52:51.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.405+0000 7f1d4259c640 1 --2- 172.21.15.70:0/2730224133 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5569ec6f5660 0x5569ecad8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:51.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.405+0000 7f1d41d9b640 1 -- 172.21.15.70:0/2730224133 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5569ec6f5660 msgr2=0x5569ecad8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:52:51.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.405+0000 7f1d41d9b640 1 --2- 172.21.15.70:0/2730224133 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5569ec6f5660 0x5569ecad8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.405+0000 7f1d41d9b640 1 -- 172.21.15.70:0/2730224133 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569ec71e520 msgr2=0x5569ecad5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:52:51.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.405+0000 7f1d42d9d640 1 --2- 172.21.15.70:0/2730224133 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569ec71e520 0x5569ecad5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:51.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.405+0000 7f1d41d9b640 1 --2- 172.21.15.70:0/2730224133 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569ec71e520 0x5569ecad5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.405+0000 7f1d41d9b640 1 -- 172.21.15.70:0/2730224133 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569ecb4c920 con 0x5569ec6fd840 2024-09-21T05:52:51.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.405+0000 7f1d42d9d640 1 --2- 172.21.15.70:0/2730224133 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569ec71e520 0x5569ecad5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:52:51.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.405+0000 7f1d41d9b640 1 --2- 172.21.15.70:0/2730224133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569ec6fd840 0x5569ecad4c70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f1d380acb50 tx=0x7f1d38005b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c8150bf69b5c1ef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:51.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.405+0000 7f1d29ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:52:51.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.405+0000 7f1d29ffb640 1 -- 172.21.15.70:0/2730224133 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d380b6870 con 0x5569ec6fd840 2024-09-21T05:52:51.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.405+0000 7f1d29ffb640 1 -- 172.21.15.70:0/2730224133 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f1d380a89b0 con 0x5569ec6fd840 2024-09-21T05:52:51.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.405+0000 7f1d4f1e4740 1 -- 172.21.15.70:0/2730224133 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d380af070 con 0x5569ec6fd840 2024-09-21T05:52:51.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.406+0000 7f1d29ffb640 1 -- 172.21.15.70:0/2730224133 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1d3805c080 con 0x5569ec6fd840 2024-09-21T05:52:51.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.406+0000 7f1d4f1e4740 10 client.15831 fetch_fsmap learned FSMap version 29 2024-09-21T05:52:51.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.406+0000 7f1d4f1e4740 1 -- 172.21.15.70:0/2730224133 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5569ecb4dab0 con 0x5569ec6fd840 2024-09-21T05:52:51.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.406+0000 7f1d29ffb640 1 -- 172.21.15.70:0/2730224133 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f1d380af070 con 0x5569ec6fd840 2024-09-21T05:52:51.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.406+0000 7f1d29ffb640 1 -- 172.21.15.70:0/2730224133 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8386+0+0 (secure 0 0 0) 0x7f1d380d0110 con 0x5569ec6fd840 2024-09-21T05:52:51.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.406+0000 7f1d4f1e4740 10 client.15831 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T05:52:51.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.406+0000 7f1d4f1e4740 10 client.15831 resolve_mds: validated gid 24641 aka daemon mds.b 2024-09-21T05:52:51.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.406+0000 7f1d4f1e4740 20 client.15831 populate_metadata read hostname 'smithi070' 2024-09-21T05:52:51.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.406+0000 7f1d4f1e4740 1 --2- 172.21.15.70:0/2730224133 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x5569ec6b2250 0x5569ecb50020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:51.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.406+0000 7f1d4f1e4740 4 client.15831 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "4e5fcff8", "release": true, "await": true}] 2024-09-21T05:52:51.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.406+0000 7f1d4f1e4740 1 -- 172.21.15.70:0/2730224133 --> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] -- command(tid 0: {"prefix": "quiesce db", "set_id": "4e5fcff8", "release": true, "await": true}) -- 0x5569eca39bf0 con 0x5569ec6b2250 2024-09-21T05:52:51.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.406+0000 7f1d4259c640 1 --2- 172.21.15.70:0/2730224133 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x5569ec6b2250 0x5569ecb50020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:51.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.407+0000 7f1d4259c640 1 --2- 172.21.15.70:0/2730224133 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x5569ec6b2250 0x5569ecb50020 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90e71126a09408ce server_cookie=29768c15a5f42c8b in_seq=0 out_seq=0 2024-09-21T05:52:51.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.407+0000 7f1d29ffb640 10 client.15831 ms_handle_connect on v2:172.21.15.116:6838/3952175670 2024-09-21T05:52:51.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.679+0000 7f1d29ffb640 1 -- 172.21.15.70:0/2730224133 <== mds.0 v2:172.21.15.116:6838/3952175670 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5569eca39bf0 con 0x5569ec6b2250 2024-09-21T05:52:51.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.679+0000 7f1d29ffb640 10 client.15831 handle_command_reply: tid=0 2024-09-21T05:52:51.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.679+0000 7f1d4f1e4740 1 client.15831 shutdown 2024-09-21T05:52:51.682 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:51 smithi070 ceph-mon[30981]: pgmap v471: 129 pgs: 129 active+clean; 160 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 4.3 KiB/s wr, 10 op/s 2024-09-21T05:52:51.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.679+0000 7f1d4f1e4740 1 -- 172.21.15.70:0/2730224133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569ec6fd840 msgr2=0x5569ecad4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:51.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.679+0000 7f1d4f1e4740 1 --2- 172.21.15.70:0/2730224133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569ec6fd840 0x5569ecad4c70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f1d380acb50 tx=0x7f1d38005b20 comp rx=0 tx=0).stop 2024-09-21T05:52:51.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.679+0000 7f1d4f1e4740 1 -- 172.21.15.70:0/2730224133 shutdown_connections 2024-09-21T05:52:51.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.679+0000 7f1d4f1e4740 1 --2- 172.21.15.70:0/2730224133 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x5569ec6b2250 0x5569ecb50020 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.679+0000 7f1d29ffb640 0 client.15831 ms_handle_reset on v2:172.21.15.116:6838/3952175670 2024-09-21T05:52:51.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.679+0000 7f1d4f1e4740 1 --2- 172.21.15.70:0/2730224133 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569ec71e520 0x5569ecad5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.679+0000 7f1d4f1e4740 1 --2- 172.21.15.70:0/2730224133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569ec6fd840 0x5569ecad4c70 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.679+0000 7f1d4f1e4740 1 --2- 172.21.15.70:0/2730224133 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5569ec6f5660 0x5569ecad8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.679+0000 7f1d4f1e4740 1 -- 172.21.15.70:0/2730224133 >> 172.21.15.70:0/2730224133 conn(0x5569ec712910 msgr2=0x5569ecace490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:51.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.680+0000 7f1d4f1e4740 1 -- 172.21.15.70:0/2730224133 shutdown_connections 2024-09-21T05:52:51.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.680+0000 7f1d4f1e4740 1 -- 172.21.15.70:0/2730224133 wait complete. 2024-09-21T05:52:51.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.680+0000 7f1d4f1e4740 20 client.15831 trim_cache size 0 max 16384 2024-09-21T05:52:51.684 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:52:51.684 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 29, 2024-09-21T05:52:51.684 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 24641, 2024-09-21T05:52:51.684 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 16, 2024-09-21T05:52:51.684 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-09-21T05:52:51.684 INFO:teuthology.orchestra.run.smithi070.stdout: "4e5fcff8": { 2024-09-21T05:52:51.684 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 16, 2024-09-21T05:52:51.684 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-09-21T05:52:51.684 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-09-21T05:52:51.684 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-09-21T05:52:51.685 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-09-21T05:52:51.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:52:51.685 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 90.0, 2024-09-21T05:52:51.685 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 147.8, 2024-09-21T05:52:51.685 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-09-21T05:52:51.685 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-09-21T05:52:51.685 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-09-21T05:52:51.685 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-09-21T05:52:51.685 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-09-21T05:52:51.685 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-09-21T05:52:51.685 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:52:51.685 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:52:51.685 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:52:51.685 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:52:51.685 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:52:51.685 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:52:51.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.680+0000 7f1d48c70640 1 -- 172.21.15.70:0/2984166462 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1d2c0b6510 msgr2=0x7f1d2c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:51.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.680+0000 7f1d48c70640 1 --2- 172.21.15.70:0/2984166462 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1d2c0b6510 0x7f1d2c0b8a20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c005fd0 tx=0x7f1d3c009ae0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.680+0000 7f1d48c70640 1 -- 172.21.15.70:0/2984166462 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d441083c0 msgr2=0x7f1d441995b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:51.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.680+0000 7f1d48c70640 1 --2- 172.21.15.70:0/2984166462 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d441083c0 0x7f1d441995b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f1d3800d740 tx=0x7f1d3800dc00 comp rx=0 tx=0).stop 2024-09-21T05:52:51.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.680+0000 7f1d48c70640 1 -- 172.21.15.70:0/2984166462 shutdown_connections 2024-09-21T05:52:51.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.681+0000 7f1d48c70640 1 --2- 172.21.15.70:0/2984166462 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1d2c0b6510 0x7f1d2c0b8a20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.681+0000 7f1d48c70640 1 --2- 172.21.15.70:0/2984166462 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d44108d10 0x7f1d44199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.681+0000 7f1d48c70640 1 --2- 172.21.15.70:0/2984166462 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d441083c0 0x7f1d441995b0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.681+0000 7f1d48c70640 1 --2- 172.21.15.70:0/2984166462 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d44102a80 0x7f1d44199070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.681+0000 7f1d48c70640 1 -- 172.21.15.70:0/2984166462 >> 172.21.15.70:0/2984166462 conn(0x7f1d44079740 msgr2=0x7f1d44101530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:51.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.681+0000 7f1d48c70640 1 -- 172.21.15.70:0/2984166462 shutdown_connections 2024-09-21T05:52:51.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:52:51.681+0000 7f1d48c70640 1 -- 172.21.15.70:0/2984166462 wait complete. 2024-09-21T05:52:51.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:51 smithi116 ceph-mon[34332]: pgmap v471: 129 pgs: 129 active+clean; 160 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 4.3 KiB/s wr, 10 op/s 2024-09-21T05:52:51.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:51 smithi160 ceph-mon[33979]: pgmap v471: 129 pgs: 129 active+clean; 160 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 4.3 KiB/s wr, 10 op/s 2024-09-21T05:52:52.477 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '4e5fcff8', total seconds elapsed: 31.4 2024-09-21T05:52:53.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:53 smithi070 ceph-mon[30981]: pgmap v472: 129 pgs: 129 active+clean; 160 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.5 KiB/s wr, 10 op/s 2024-09-21T05:52:53.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:53 smithi116 ceph-mon[34332]: pgmap v472: 129 pgs: 129 active+clean; 160 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.5 KiB/s wr, 10 op/s 2024-09-21T05:52:53.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:53 smithi160 ceph-mon[33979]: pgmap v472: 129 pgs: 129 active+clean; 160 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.5 KiB/s wr, 10 op/s 2024-09-21T05:52:55.700 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:55 smithi160 ceph-mon[33979]: pgmap v473: 129 pgs: 129 active+clean; 161 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 69 KiB/s wr, 16 op/s 2024-09-21T05:52:55.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:55 smithi070 ceph-mon[30981]: pgmap v473: 129 pgs: 129 active+clean; 161 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 69 KiB/s wr, 16 op/s 2024-09-21T05:52:55.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:55 smithi116 ceph-mon[34332]: pgmap v473: 129 pgs: 129 active+clean; 161 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 69 KiB/s wr, 16 op/s 2024-09-21T05:52:57.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:57 smithi070 ceph-mon[30981]: pgmap v474: 129 pgs: 129 active+clean; 164 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 353 KiB/s wr, 31 op/s 2024-09-21T05:52:57.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:57 smithi116 ceph-mon[34332]: pgmap v474: 129 pgs: 129 active+clean; 164 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 353 KiB/s wr, 31 op/s 2024-09-21T05:52:57.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:57 smithi160 ceph-mon[33979]: pgmap v474: 129 pgs: 129 active+clean; 164 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 353 KiB/s wr, 31 op/s 2024-09-21T05:52:59.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:52:59 smithi070 ceph-mon[30981]: pgmap v475: 129 pgs: 129 active+clean; 166 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 682 KiB/s wr, 61 op/s 2024-09-21T05:52:59.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:52:59 smithi116 ceph-mon[34332]: pgmap v475: 129 pgs: 129 active+clean; 166 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 682 KiB/s wr, 61 op/s 2024-09-21T05:52:59.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:52:59 smithi160 ceph-mon[33979]: pgmap v475: 129 pgs: 129 active+clean; 166 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 682 KiB/s wr, 61 op/s 2024-09-21T05:53:01.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:01 smithi070 ceph-mon[30981]: pgmap v476: 129 pgs: 129 active+clean; 166 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 909 KiB/s wr, 113 op/s 2024-09-21T05:53:01.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:01 smithi116 ceph-mon[34332]: pgmap v476: 129 pgs: 129 active+clean; 166 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 909 KiB/s wr, 113 op/s 2024-09-21T05:53:01.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:01 smithi160 ceph-mon[33979]: pgmap v476: 129 pgs: 129 active+clean; 166 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 909 KiB/s wr, 113 op/s 2024-09-21T05:53:02.293 INFO:tasks.workunit.client.0.smithi070.stderr:+ sync 2024-09-21T05:53:03.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:03 smithi070 ceph-mon[30981]: pgmap v477: 129 pgs: 129 active+clean; 170 MiB data, 738 MiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 1.3 MiB/s wr, 151 op/s 2024-09-21T05:53:03.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:03 smithi116 ceph-mon[34332]: pgmap v477: 129 pgs: 129 active+clean; 170 MiB data, 738 MiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 1.3 MiB/s wr, 151 op/s 2024-09-21T05:53:03.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:03 smithi160 ceph-mon[33979]: pgmap v477: 129 pgs: 129 active+clean; 170 MiB data, 738 MiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 1.3 MiB/s wr, 151 op/s 2024-09-21T05:53:04.327 INFO:tasks.workunit.client.0.smithi070.stderr:+ tar c linux-4.0.5 2024-09-21T05:53:05.649 INFO:tasks.workunit.client.0.smithi070.stderr:+ rm -rf linux-4.0.5 2024-09-21T05:53:05.744 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:05 smithi070 ceph-mon[30981]: pgmap v478: 129 pgs: 129 active+clean; 170 MiB data, 751 MiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 1.5 MiB/s wr, 198 op/s 2024-09-21T05:53:05.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:05 smithi116 ceph-mon[34332]: pgmap v478: 129 pgs: 129 active+clean; 170 MiB data, 751 MiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 1.5 MiB/s wr, 198 op/s 2024-09-21T05:53:05.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:05 smithi160 ceph-mon[33979]: pgmap v478: 129 pgs: 129 active+clean; 170 MiB data, 751 MiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 1.5 MiB/s wr, 198 op/s 2024-09-21T05:53:07.744 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:07 smithi070 ceph-mon[30981]: pgmap v479: 129 pgs: 129 active+clean; 169 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 1.5 MiB/s wr, 222 op/s 2024-09-21T05:53:07.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:07 smithi116 ceph-mon[34332]: pgmap v479: 129 pgs: 129 active+clean; 169 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 1.5 MiB/s wr, 222 op/s 2024-09-21T05:53:07.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:07 smithi160 ceph-mon[33979]: pgmap v479: 129 pgs: 129 active+clean; 169 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 1.5 MiB/s wr, 222 op/s 2024-09-21T05:53:09.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:09 smithi070 ceph-mon[30981]: pgmap v480: 129 pgs: 129 active+clean; 171 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 1.5 MiB/s wr, 235 op/s 2024-09-21T05:53:09.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:09 smithi070 ceph-mon[30981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:53:09.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:09 smithi116 ceph-mon[34332]: pgmap v480: 129 pgs: 129 active+clean; 171 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 1.5 MiB/s wr, 235 op/s 2024-09-21T05:53:09.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:09 smithi116 ceph-mon[34332]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:53:09.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:09 smithi160 ceph-mon[33979]: pgmap v480: 129 pgs: 129 active+clean; 171 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 1.5 MiB/s wr, 235 op/s 2024-09-21T05:53:09.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:09 smithi160 ceph-mon[33979]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:53:10.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:10 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:53:10.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:10 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:53:10.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:10 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:53:11.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:11 smithi070 ceph-mon[30981]: pgmap v481: 129 pgs: 129 active+clean; 170 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 659 KiB/s rd, 1.1 MiB/s wr, 223 op/s 2024-09-21T05:53:11.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:11 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:53:11.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:11 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:53:11.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:11 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:53:11.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:11 smithi116 ceph-mon[34332]: pgmap v481: 129 pgs: 129 active+clean; 170 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 659 KiB/s rd, 1.1 MiB/s wr, 223 op/s 2024-09-21T05:53:11.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:11 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:53:11.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:11 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:53:11.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:11 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:53:11.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:11 smithi160 ceph-mon[33979]: pgmap v481: 129 pgs: 129 active+clean; 170 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 659 KiB/s rd, 1.1 MiB/s wr, 223 op/s 2024-09-21T05:53:11.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:11 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:53:11.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:11 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:53:11.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:11 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:53:13.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:13 smithi070 ceph-mon[30981]: pgmap v482: 129 pgs: 129 active+clean; 174 MiB data, 769 MiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 1.2 MiB/s wr, 200 op/s 2024-09-21T05:53:13.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:13 smithi116 ceph-mon[34332]: pgmap v482: 129 pgs: 129 active+clean; 174 MiB data, 769 MiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 1.2 MiB/s wr, 200 op/s 2024-09-21T05:53:13.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:13 smithi160 ceph-mon[33979]: pgmap v482: 129 pgs: 129 active+clean; 174 MiB data, 769 MiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 1.2 MiB/s wr, 200 op/s 2024-09-21T05:53:14.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:14 smithi070 ceph-mon[30981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:53:14.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:14 smithi116 ceph-mon[34332]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:53:14.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:14 smithi160 ceph-mon[33979]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:53:15.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:15 smithi070 ceph-mon[30981]: pgmap v483: 129 pgs: 129 active+clean; 173 MiB data, 764 MiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 817 KiB/s wr, 208 op/s 2024-09-21T05:53:15.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:15 smithi116 ceph-mon[34332]: pgmap v483: 129 pgs: 129 active+clean; 173 MiB data, 764 MiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 817 KiB/s wr, 208 op/s 2024-09-21T05:53:15.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:15 smithi160 ceph-mon[33979]: pgmap v483: 129 pgs: 129 active+clean; 173 MiB data, 764 MiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 817 KiB/s wr, 208 op/s 2024-09-21T05:53:16.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:16 smithi070 ceph-mon[30981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:53:16.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:16 smithi116 ceph-mon[34332]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:53:16.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:16 smithi160 ceph-mon[33979]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:53:17.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:17 smithi070 ceph-mon[30981]: pgmap v484: 129 pgs: 129 active+clean; 175 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 1001 KiB/s wr, 213 op/s 2024-09-21T05:53:17.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:17 smithi116 ceph-mon[34332]: pgmap v484: 129 pgs: 129 active+clean; 175 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 1001 KiB/s wr, 213 op/s 2024-09-21T05:53:17.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:17 smithi160 ceph-mon[33979]: pgmap v484: 129 pgs: 129 active+clean; 175 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 1001 KiB/s wr, 213 op/s 2024-09-21T05:53:19.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:19 smithi070 ceph-mon[30981]: pgmap v485: 129 pgs: 129 active+clean; 174 MiB data, 774 MiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 929 KiB/s wr, 218 op/s 2024-09-21T05:53:19.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:19 smithi116 ceph-mon[34332]: pgmap v485: 129 pgs: 129 active+clean; 174 MiB data, 774 MiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 929 KiB/s wr, 218 op/s 2024-09-21T05:53:19.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:19 smithi160 ceph-mon[33979]: pgmap v485: 129 pgs: 129 active+clean; 174 MiB data, 774 MiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 929 KiB/s wr, 218 op/s 2024-09-21T05:53:21.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:21 smithi070 ceph-mon[30981]: pgmap v486: 129 pgs: 129 active+clean; 173 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 801 KiB/s wr, 251 op/s 2024-09-21T05:53:21.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:21 smithi070 ceph-mon[30981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:53:21.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:21 smithi116 ceph-mon[34332]: pgmap v486: 129 pgs: 129 active+clean; 173 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 801 KiB/s wr, 251 op/s 2024-09-21T05:53:21.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:21 smithi116 ceph-mon[34332]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:53:21.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:21 smithi160 ceph-mon[33979]: pgmap v486: 129 pgs: 129 active+clean; 173 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 801 KiB/s wr, 251 op/s 2024-09-21T05:53:21.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:21 smithi160 ceph-mon[33979]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:53:22.421 INFO:tasks.workunit.client.0.smithi070.stderr:+ tar xf doc.tar 2024-09-21T05:53:22.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:22 smithi116 ceph-mon[34332]: pgmap v487: 129 pgs: 129 active+clean; 173 MiB data, 781 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 274 op/s 2024-09-21T05:53:22.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:22 smithi160 ceph-mon[33979]: pgmap v487: 129 pgs: 129 active+clean; 173 MiB data, 781 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 274 op/s 2024-09-21T05:53:22.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:22 smithi070 ceph-mon[30981]: pgmap v487: 129 pgs: 129 active+clean; 173 MiB data, 781 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 274 op/s 2024-09-21T05:53:24.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:24 smithi160 ceph-mon[33979]: pgmap v488: 129 pgs: 129 active+clean; 169 MiB data, 774 MiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 812 KiB/s wr, 288 op/s 2024-09-21T05:53:24.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:24 smithi070 ceph-mon[30981]: pgmap v488: 129 pgs: 129 active+clean; 169 MiB data, 774 MiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 812 KiB/s wr, 288 op/s 2024-09-21T05:53:25.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:24 smithi116 ceph-mon[34332]: pgmap v488: 129 pgs: 129 active+clean; 169 MiB data, 774 MiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 812 KiB/s wr, 288 op/s 2024-09-21T05:53:26.855 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:26 smithi116 ceph-mon[34332]: pgmap v489: 129 pgs: 129 active+clean; 169 MiB data, 770 MiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 1.0 MiB/s wr, 296 op/s 2024-09-21T05:53:26.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:26 smithi160 ceph-mon[33979]: pgmap v489: 129 pgs: 129 active+clean; 169 MiB data, 770 MiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 1.0 MiB/s wr, 296 op/s 2024-09-21T05:53:26.994 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:26 smithi070 ceph-mon[30981]: pgmap v489: 129 pgs: 129 active+clean; 169 MiB data, 770 MiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 1.0 MiB/s wr, 296 op/s 2024-09-21T05:53:28.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:28 smithi160 ceph-mon[33979]: pgmap v490: 129 pgs: 129 active+clean; 169 MiB data, 816 MiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 887 KiB/s wr, 328 op/s 2024-09-21T05:53:28.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:28 smithi070 ceph-mon[30981]: pgmap v490: 129 pgs: 129 active+clean; 169 MiB data, 816 MiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 887 KiB/s wr, 328 op/s 2024-09-21T05:53:29.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:28 smithi116 ceph-mon[34332]: pgmap v490: 129 pgs: 129 active+clean; 169 MiB data, 816 MiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 887 KiB/s wr, 328 op/s 2024-09-21T05:53:30.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:30 smithi160 ceph-mon[33979]: pgmap v491: 129 pgs: 129 active+clean; 173 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 361 op/s 2024-09-21T05:53:30.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:30 smithi070 ceph-mon[30981]: pgmap v491: 129 pgs: 129 active+clean; 173 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 361 op/s 2024-09-21T05:53:31.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:30 smithi116 ceph-mon[34332]: pgmap v491: 129 pgs: 129 active+clean; 173 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 361 op/s 2024-09-21T05:53:32.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:32 smithi160 ceph-mon[33979]: pgmap v492: 129 pgs: 129 active+clean; 179 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 352 op/s 2024-09-21T05:53:32.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:32 smithi070 ceph-mon[30981]: pgmap v492: 129 pgs: 129 active+clean; 179 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 352 op/s 2024-09-21T05:53:33.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:32 smithi116 ceph-mon[34332]: pgmap v492: 129 pgs: 129 active+clean; 179 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 352 op/s 2024-09-21T05:53:34.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:34 smithi160 ceph-mon[33979]: pgmap v493: 129 pgs: 129 active+clean; 185 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 2.0 MiB/s wr, 374 op/s 2024-09-21T05:53:34.994 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:34 smithi070 ceph-mon[30981]: pgmap v493: 129 pgs: 129 active+clean; 185 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 2.0 MiB/s wr, 374 op/s 2024-09-21T05:53:35.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:34 smithi116 ceph-mon[34332]: pgmap v493: 129 pgs: 129 active+clean; 185 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 2.0 MiB/s wr, 374 op/s 2024-09-21T05:53:36.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:36 smithi160 ceph-mon[33979]: pgmap v494: 129 pgs: 129 active+clean; 192 MiB data, 896 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.5 MiB/s wr, 359 op/s 2024-09-21T05:53:36.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:36 smithi070 ceph-mon[30981]: pgmap v494: 129 pgs: 129 active+clean; 192 MiB data, 896 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.5 MiB/s wr, 359 op/s 2024-09-21T05:53:37.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:36 smithi116 ceph-mon[34332]: pgmap v494: 129 pgs: 129 active+clean; 192 MiB data, 896 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.5 MiB/s wr, 359 op/s 2024-09-21T05:53:37.796 INFO:tasks.workunit.client.0.smithi070.stderr:+ sync 2024-09-21T05:53:38.658 INFO:tasks.workunit.client.0.smithi070.stderr:+ tar c linux-4.0.5 2024-09-21T05:53:38.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:38 smithi160 ceph-mon[33979]: pgmap v495: 129 pgs: 129 active+clean; 194 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 947 KiB/s rd, 2.5 MiB/s wr, 336 op/s 2024-09-21T05:53:38.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:38 smithi070 ceph-mon[30981]: pgmap v495: 129 pgs: 129 active+clean; 194 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 947 KiB/s rd, 2.5 MiB/s wr, 336 op/s 2024-09-21T05:53:39.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:38 smithi116 ceph-mon[34332]: pgmap v495: 129 pgs: 129 active+clean; 194 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 947 KiB/s rd, 2.5 MiB/s wr, 336 op/s 2024-09-21T05:53:40.103 INFO:tasks.workunit.client.0.smithi070.stdout:Ok 2024-09-21T05:53:40.104 INFO:tasks.workunit.client.0.smithi070.stderr:+ echo Ok 2024-09-21T05:53:40.104 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T05:53:40.105 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T05:53:40.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:40 smithi160 ceph-mon[33979]: pgmap v496: 129 pgs: 129 active+clean; 200 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 284 op/s 2024-09-21T05:53:40.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:40 smithi070 ceph-mon[30981]: pgmap v496: 129 pgs: 129 active+clean; 200 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 284 op/s 2024-09-21T05:53:41.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:40 smithi116 ceph-mon[34332]: pgmap v496: 129 pgs: 129 active+clean; 200 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 284 op/s 2024-09-21T05:53:42.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:42 smithi160 ceph-mon[33979]: pgmap v497: 129 pgs: 129 active+clean; 193 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 1018 KiB/s rd, 2.5 MiB/s wr, 233 op/s 2024-09-21T05:53:42.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:42 smithi070 ceph-mon[30981]: pgmap v497: 129 pgs: 129 active+clean; 193 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 1018 KiB/s rd, 2.5 MiB/s wr, 233 op/s 2024-09-21T05:53:43.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:42 smithi116 ceph-mon[34332]: pgmap v497: 129 pgs: 129 active+clean; 193 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 1018 KiB/s rd, 2.5 MiB/s wr, 233 op/s 2024-09-21T05:53:43.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:43 smithi160 ceph-mon[33979]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:53:43.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:43 smithi070 ceph-mon[30981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:53:44.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:43 smithi116 ceph-mon[34332]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:53:44.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:44 smithi160 ceph-mon[33979]: pgmap v498: 129 pgs: 129 active+clean; 135 MiB data, 896 MiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 2.1 MiB/s wr, 197 op/s 2024-09-21T05:53:44.994 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:44 smithi070 ceph-mon[30981]: pgmap v498: 129 pgs: 129 active+clean; 135 MiB data, 896 MiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 2.1 MiB/s wr, 197 op/s 2024-09-21T05:53:45.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:44 smithi116 ceph-mon[34332]: pgmap v498: 129 pgs: 129 active+clean; 135 MiB data, 896 MiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 2.1 MiB/s wr, 197 op/s 2024-09-21T05:53:46.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:46 smithi160 ceph-mon[33979]: pgmap v499: 129 pgs: 129 active+clean; 117 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 178 op/s 2024-09-21T05:53:46.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:46 smithi160 ceph-mon[33979]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:53:46.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:46 smithi070 ceph-mon[30981]: pgmap v499: 129 pgs: 129 active+clean; 117 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 178 op/s 2024-09-21T05:53:46.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:46 smithi070 ceph-mon[30981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:53:47.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:46 smithi116 ceph-mon[34332]: pgmap v499: 129 pgs: 129 active+clean; 117 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 178 op/s 2024-09-21T05:53:47.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:46 smithi116 ceph-mon[34332]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:53:48.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:48 smithi160 ceph-mon[33979]: pgmap v500: 129 pgs: 129 active+clean; 104 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 1.3 MiB/s wr, 197 op/s 2024-09-21T05:53:48.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:48 smithi160 ceph-mon[33979]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:53:48.994 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:48 smithi070 ceph-mon[30981]: pgmap v500: 129 pgs: 129 active+clean; 104 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 1.3 MiB/s wr, 197 op/s 2024-09-21T05:53:48.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:48 smithi070 ceph-mon[30981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:53:49.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:48 smithi116 ceph-mon[34332]: pgmap v500: 129 pgs: 129 active+clean; 104 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 1.3 MiB/s wr, 197 op/s 2024-09-21T05:53:49.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:48 smithi116 ceph-mon[34332]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:53:50.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:50 smithi160 ceph-mon[33979]: pgmap v501: 129 pgs: 129 active+clean; 107 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 226 op/s 2024-09-21T05:53:50.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:50 smithi070 ceph-mon[30981]: pgmap v501: 129 pgs: 129 active+clean; 107 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 226 op/s 2024-09-21T05:53:51.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:50 smithi116 ceph-mon[34332]: pgmap v501: 129 pgs: 129 active+clean; 107 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 226 op/s 2024-09-21T05:53:51.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:51 smithi160 ceph-mon[33979]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:53:51.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:51 smithi070 ceph-mon[30981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:53:52.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:51 smithi116 ceph-mon[34332]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:53:52.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:52 smithi160 ceph-mon[33979]: pgmap v502: 129 pgs: 129 active+clean; 108 MiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 1023 KiB/s wr, 225 op/s 2024-09-21T05:53:52.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:52 smithi070 ceph-mon[30981]: pgmap v502: 129 pgs: 129 active+clean; 108 MiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 1023 KiB/s wr, 225 op/s 2024-09-21T05:53:53.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:52 smithi116 ceph-mon[34332]: pgmap v502: 129 pgs: 129 active+clean; 108 MiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 1023 KiB/s wr, 225 op/s 2024-09-21T05:53:54.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:54 smithi160 ceph-mon[33979]: pgmap v503: 129 pgs: 129 active+clean; 105 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 901 KiB/s wr, 259 op/s 2024-09-21T05:53:54.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:54 smithi070 ceph-mon[30981]: pgmap v503: 129 pgs: 129 active+clean; 105 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 901 KiB/s wr, 259 op/s 2024-09-21T05:53:55.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:54 smithi116 ceph-mon[34332]: pgmap v503: 129 pgs: 129 active+clean; 105 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 901 KiB/s wr, 259 op/s 2024-09-21T05:53:56.794 INFO:tasks.workunit:Stopping ['fs/norstats'] on client.0... 2024-09-21T05:53:56.794 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T05:53:56.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:56 smithi160 ceph-mon[33979]: pgmap v504: 129 pgs: 129 active+clean; 105 MiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 291 op/s 2024-09-21T05:53:56.994 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:56 smithi070 ceph-mon[30981]: pgmap v504: 129 pgs: 129 active+clean; 105 MiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 291 op/s 2024-09-21T05:53:57.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:56 smithi116 ceph-mon[34332]: pgmap v504: 129 pgs: 129 active+clean; 105 MiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 291 op/s 2024-09-21T05:53:57.073 DEBUG:teuthology.parallel:result is None 2024-09-21T05:53:57.073 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T05:53:57.109 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T05:53:57.109 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-21T05:53:57.119 INFO:tasks.quiescer:joining Quiescers 2024-09-21T05:53:57.119 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-21T05:53:57.119 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:53:57.450 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:57.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.920+0000 7fd18bb42640 1 -- 172.21.15.70:0/3424888156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1841083a0 msgr2=0x7fd1841087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:57.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.920+0000 7fd18bb42640 1 --2- 172.21.15.70:0/3424888156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1841083a0 0x7fd1841087b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd174009900 tx=0x7fd17402a410 comp rx=0 tx=0).stop 2024-09-21T05:53:57.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.920+0000 7fd18bb42640 1 -- 172.21.15.70:0/3424888156 shutdown_connections 2024-09-21T05:53:57.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.920+0000 7fd18bb42640 1 --2- 172.21.15.70:0/3424888156 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd184108cf0 0x7fd18410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.920+0000 7fd18bb42640 1 --2- 172.21.15.70:0/3424888156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1841083a0 0x7fd1841087b0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.920+0000 7fd18bb42640 1 --2- 172.21.15.70:0/3424888156 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd184102a60 0x7fd184102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.920+0000 7fd18bb42640 1 -- 172.21.15.70:0/3424888156 >> 172.21.15.70:0/3424888156 conn(0x7fd184079730 msgr2=0x7fd184079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:57.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.920+0000 7fd18bb42640 1 -- 172.21.15.70:0/3424888156 shutdown_connections 2024-09-21T05:53:57.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.920+0000 7fd18bb42640 1 -- 172.21.15.70:0/3424888156 wait complete. 2024-09-21T05:53:57.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.920+0000 7fd18bb42640 1 Processor -- start 2024-09-21T05:53:57.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.921+0000 7fd18bb42640 1 -- start start 2024-09-21T05:53:57.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.921+0000 7fd18bb42640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd184102a60 0x7fd1840ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:57.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.921+0000 7fd18bb42640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1841083a0 0x7fd1840ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:57.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.921+0000 7fd18bb42640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd184108cf0 0x7fd1841000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:57.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.921+0000 7fd18bb42640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd184112930 con 0x7fd1841083a0 2024-09-21T05:53:57.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.921+0000 7fd18bb42640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd1841127b0 con 0x7fd184102a60 2024-09-21T05:53:57.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.921+0000 7fd18bb42640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd184112ab0 con 0x7fd184108cf0 2024-09-21T05:53:57.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.921+0000 7fd1890dd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1841083a0 0x7fd1840ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:57.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.921+0000 7fd1890dd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1841083a0 0x7fd1840ffbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44162/0 (socket says 172.21.15.70:44162) 2024-09-21T05:53:57.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.921+0000 7fd1890dd640 1 -- 172.21.15.70:0/2806967227 learned_addr learned my addr 172.21.15.70:0/2806967227 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:53:57.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.921+0000 7fd18a0df640 1 --2- 172.21.15.70:0/2806967227 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd184108cf0 0x7fd1841000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:57.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.921+0000 7fd1898de640 1 --2- 172.21.15.70:0/2806967227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd184102a60 0x7fd1840ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:57.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.921+0000 7fd1890dd640 1 -- 172.21.15.70:0/2806967227 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd184108cf0 msgr2=0x7fd1841000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:57.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.921+0000 7fd1890dd640 1 --2- 172.21.15.70:0/2806967227 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd184108cf0 0x7fd1841000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.921+0000 7fd1890dd640 1 -- 172.21.15.70:0/2806967227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd184102a60 msgr2=0x7fd1840ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:57.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.921+0000 7fd1890dd640 1 --2- 172.21.15.70:0/2806967227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd184102a60 0x7fd1840ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.921+0000 7fd1890dd640 1 -- 172.21.15.70:0/2806967227 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1841a87f0 con 0x7fd1841083a0 2024-09-21T05:53:57.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.922+0000 7fd1890dd640 1 --2- 172.21.15.70:0/2806967227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1841083a0 0x7fd1840ffbb0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fd174032fd0 tx=0x7fd174004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:57.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.922+0000 7fd17affd640 1 -- 172.21.15.70:0/2806967227 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd17403f030 con 0x7fd1841083a0 2024-09-21T05:53:57.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.922+0000 7fd17affd640 1 -- 172.21.15.70:0/2806967227 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fd174004490 con 0x7fd1841083a0 2024-09-21T05:53:57.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.922+0000 7fd18bb42640 1 -- 172.21.15.70:0/2806967227 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1841a8a80 con 0x7fd1841083a0 2024-09-21T05:53:57.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.922+0000 7fd17affd640 1 -- 172.21.15.70:0/2806967227 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd174035070 con 0x7fd1841083a0 2024-09-21T05:53:57.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.922+0000 7fd18bb42640 1 -- 172.21.15.70:0/2806967227 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1841a8fb0 con 0x7fd1841083a0 2024-09-21T05:53:57.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.923+0000 7fd18bb42640 1 -- 172.21.15.70:0/2806967227 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd184102e70 con 0x7fd1841083a0 2024-09-21T05:53:57.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.926+0000 7fd17affd640 1 -- 172.21.15.70:0/2806967227 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7fd174042030 con 0x7fd1841083a0 2024-09-21T05:53:57.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.926+0000 7fd17affd640 1 --2- 172.21.15.70:0/2806967227 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd1700b6590 0x7fd1700b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:57.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.927+0000 7fd1898de640 1 --2- 172.21.15.70:0/2806967227 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd1700b6590 0x7fd1700b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:57.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.927+0000 7fd17affd640 1 -- 172.21.15.70:0/2806967227 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fd174107e10 con 0x7fd1841083a0 2024-09-21T05:53:57.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.927+0000 7fd1898de640 1 --2- 172.21.15.70:0/2806967227 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd1700b6590 0x7fd1700b8aa0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd1800058c0 tx=0x7fd18000a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:57.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:57.929+0000 7fd17affd640 1 -- 172.21.15.70:0/2806967227 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd1740d2690 con 0x7fd1841083a0 2024-09-21T05:53:58.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:58.151+0000 7fd18bb42640 1 -- 172.21.15.70:0/2806967227 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd184100970 con 0x7fd1841083a0 2024-09-21T05:53:58.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:58.152+0000 7fd17affd640 1 -- 172.21.15.70:0/2806967227 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+12017 (secure 0 0 0) 0x7fd1740d75d0 con 0x7fd1841083a0 2024-09-21T05:53:58.154 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:53:58.155 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":37,"btime":"2024-09-21T05:53:50:615298+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3519318330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3519318330},{"type":"v1","addr":"172.21.15.70:6835","nonce":3519318330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2706663460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2706663460},{"type":"v1","addr":"172.21.15.70:6837","nonce":2706663460}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:47:06.246985+0000","modified":"2024-09-21T05:53:50.122439+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24628,"mds_2":24611,"mds_3":24610,"mds_4":24598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/1914209867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1914209867},{"type":"v1","addr":"172.21.15.70:6839","nonce":1914209867}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3392175775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3392175775},{"type":"v1","addr":"172.21.15.70:6841","nonce":3392175775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/3543945704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3543945704},{"type":"v1","addr":"172.21.15.160:6833","nonce":3543945704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6833/283778129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":283778129},{"type":"v1","addr":"172.21.15.116:6833","nonce":283778129}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/3787256790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3787256790},{"type":"v1","addr":"172.21.15.116:6835","nonce":3787256790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.160:6835/2001692372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2001692372},{"type":"v1","addr":"172.21.15.160:6835","nonce":2001692372}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.160:6837/2558120045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2558120045},{"type":"v1","addr":"172.21.15.160:6837","nonce":2558120045}]},"join_fscid":-1,"export_targets":[0,1,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24611":{"gid":24611,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/444312934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":444312934},{"type":"v1","addr":"172.21.15.116:6837","nonce":444312934}]},"join_fscid":-1,"export_targets":[0,1,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.160:6839/1339744282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1339744282},{"type":"v1","addr":"172.21.15.160:6839","nonce":1339744282}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/3952175670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3952175670},{"type":"v1","addr":"172.21.15.116:6839","nonce":3952175670}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24641,"qdb_cluster":[24641,24628,24610,24611,24598]},"id":1}]} 2024-09-21T05:53:58.155 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 37 2024-09-21T05:53:58.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:58.154+0000 7fd18bb42640 1 -- 172.21.15.70:0/2806967227 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd1700b6590 msgr2=0x7fd1700b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:58.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:58.154+0000 7fd18bb42640 1 --2- 172.21.15.70:0/2806967227 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd1700b6590 0x7fd1700b8aa0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd1800058c0 tx=0x7fd18000a250 comp rx=0 tx=0).stop 2024-09-21T05:53:58.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:58.154+0000 7fd18bb42640 1 -- 172.21.15.70:0/2806967227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1841083a0 msgr2=0x7fd1840ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:58.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:58.154+0000 7fd18bb42640 1 --2- 172.21.15.70:0/2806967227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1841083a0 0x7fd1840ffbb0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fd174032fd0 tx=0x7fd174004270 comp rx=0 tx=0).stop 2024-09-21T05:53:58.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:58.154+0000 7fd18bb42640 1 -- 172.21.15.70:0/2806967227 shutdown_connections 2024-09-21T05:53:58.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:58.154+0000 7fd18bb42640 1 --2- 172.21.15.70:0/2806967227 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fd1700b6590 0x7fd1700b8aa0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:58.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:58.154+0000 7fd18bb42640 1 --2- 172.21.15.70:0/2806967227 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd184108cf0 0x7fd1841000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:58.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:58.154+0000 7fd18bb42640 1 --2- 172.21.15.70:0/2806967227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1841083a0 0x7fd1840ffbb0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:58.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:58.154+0000 7fd18bb42640 1 --2- 172.21.15.70:0/2806967227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd184102a60 0x7fd1840ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:58.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:58.154+0000 7fd18bb42640 1 -- 172.21.15.70:0/2806967227 >> 172.21.15.70:0/2806967227 conn(0x7fd184079730 msgr2=0x7fd18406b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:58.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:58.155+0000 7fd18bb42640 1 -- 172.21.15.70:0/2806967227 shutdown_connections 2024-09-21T05:53:58.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:53:58.155+0000 7fd18bb42640 1 -- 172.21.15.70:0/2806967227 wait complete. 2024-09-21T05:53:58.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:58 smithi160 ceph-mon[33979]: pgmap v505: 129 pgs: 129 active+clean; 103 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 316 op/s 2024-09-21T05:53:58.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:53:58 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2806967227' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:58.907 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:58 smithi070 ceph-mon[30981]: pgmap v505: 129 pgs: 129 active+clean; 103 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 316 op/s 2024-09-21T05:53:58.907 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:53:58 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2806967227' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:58.935 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24641 quiesce db --cancel --all' 2024-09-21T05:53:58.936 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24641 quiesce db --cancel --all 2024-09-21T05:53:59.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:58 smithi116 ceph-mon[34332]: pgmap v505: 129 pgs: 129 active+clean; 103 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 316 op/s 2024-09-21T05:53:59.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:53:58 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2806967227' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:59.191 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:54:00.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.302+0000 7f8230341640 1 -- 172.21.15.70:0/102687033 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8228105240 msgr2=0x7f8228105650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:00.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.302+0000 7f8230341640 1 --2- 172.21.15.70:0/102687033 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8228105240 0x7f8228105650 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f8218009900 tx=0x7f821802a410 comp rx=0 tx=0).stop 2024-09-21T05:54:00.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.302+0000 7f8230341640 1 -- 172.21.15.70:0/102687033 shutdown_connections 2024-09-21T05:54:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.302+0000 7f8230341640 1 --2- 172.21.15.70:0/102687033 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8228105b90 0x7f822810f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.302+0000 7f8230341640 1 --2- 172.21.15.70:0/102687033 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8228105240 0x7f8228105650 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.302+0000 7f8230341640 1 --2- 172.21.15.70:0/102687033 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8228103270 0x7f8228103680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.302+0000 7f8230341640 1 -- 172.21.15.70:0/102687033 >> 172.21.15.70:0/102687033 conn(0x7f8228079ec0 msgr2=0x7f822807a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.302+0000 7f8230341640 1 -- 172.21.15.70:0/102687033 shutdown_connections 2024-09-21T05:54:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.302+0000 7f8230341640 1 -- 172.21.15.70:0/102687033 wait complete. 2024-09-21T05:54:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.303+0000 7f8230341640 1 Processor -- start 2024-09-21T05:54:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.303+0000 7f8230341640 1 -- start start 2024-09-21T05:54:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.303+0000 7f8230341640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8228103270 0x7f8228113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.303+0000 7f8230341640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8228105240 0x7f8228113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.303+0000 7f8230341640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8228105b90 0x7f8228113cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.303+0000 7f8230341640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f82281129e0 con 0x7f8228105b90 2024-09-21T05:54:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.303+0000 7f8230341640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8228112860 con 0x7f8228103270 2024-09-21T05:54:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.303+0000 7f8230341640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8228112b60 con 0x7f8228105240 2024-09-21T05:54:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.303+0000 7f822e8de640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8228105b90 0x7f8228113cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:00.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.303+0000 7f822e8de640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8228105b90 0x7f8228113cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52798/0 (socket says 172.21.15.70:52798) 2024-09-21T05:54:00.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.303+0000 7f822e8de640 1 -- 172.21.15.70:0/1787453341 learned_addr learned my addr 172.21.15.70:0/1787453341 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:54:00.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.303+0000 7f822e0dd640 1 --2- 172.21.15.70:0/1787453341 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8228103270 0x7f8228113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:00.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.303+0000 7f822d8dc640 1 --2- 172.21.15.70:0/1787453341 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8228105240 0x7f8228113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:00.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.303+0000 7f822e8de640 1 -- 172.21.15.70:0/1787453341 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8228105240 msgr2=0x7f8228113770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:00.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.303+0000 7f822e8de640 1 --2- 172.21.15.70:0/1787453341 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8228105240 0x7f8228113770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.303+0000 7f822e8de640 1 -- 172.21.15.70:0/1787453341 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8228103270 msgr2=0x7f8228113230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:00.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.303+0000 7f822e8de640 1 --2- 172.21.15.70:0/1787453341 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8228103270 0x7f8228113230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.303+0000 7f822e8de640 1 -- 172.21.15.70:0/1787453341 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82281a8790 con 0x7f8228105b90 2024-09-21T05:54:00.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.303+0000 7f822e0dd640 1 --2- 172.21.15.70:0/1787453341 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8228103270 0x7f8228113230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:54:00.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.304+0000 7f822e8de640 1 --2- 172.21.15.70:0/1787453341 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8228105b90 0x7f8228113cb0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f822000eaa0 tx=0x7f822000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:00.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.304+0000 7f821f7fe640 1 -- 172.21.15.70:0/1787453341 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822000cdb0 con 0x7f8228105b90 2024-09-21T05:54:00.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.304+0000 7f821f7fe640 1 -- 172.21.15.70:0/1787453341 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f8220005020 con 0x7f8228105b90 2024-09-21T05:54:00.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.304+0000 7f8230341640 1 -- 172.21.15.70:0/1787453341 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82281a8a80 con 0x7f8228105b90 2024-09-21T05:54:00.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.304+0000 7f821f7fe640 1 -- 172.21.15.70:0/1787453341 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82200116d0 con 0x7f8228105b90 2024-09-21T05:54:00.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.304+0000 7f8230341640 1 -- 172.21.15.70:0/1787453341 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82281a8fc0 con 0x7f8228105b90 2024-09-21T05:54:00.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.306+0000 7f821f7fe640 1 -- 172.21.15.70:0/1787453341 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f8220005580 con 0x7f8228105b90 2024-09-21T05:54:00.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.306+0000 7f82368b5740 1 Processor -- start 2024-09-21T05:54:00.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.307+0000 7f82368b5740 1 -- start start 2024-09-21T05:54:00.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.307+0000 7f82368b5740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bfe75dd2d0 0x55bfe7984310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:00.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.307+0000 7f82368b5740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bfe75b4410 0x55bfe7984850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:00.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.307+0000 7f82368b5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfe75bc5f0 0x55bfe7984d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:00.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.307+0000 7f82368b5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bfe78fadd0 con 0x55bfe75bc5f0 2024-09-21T05:54:00.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.307+0000 7f82368b5740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55bfe78ea200 con 0x55bfe75b4410 2024-09-21T05:54:00.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.307+0000 7f82368b5740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55bfe78ee010 con 0x55bfe75dd2d0 2024-09-21T05:54:00.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.307+0000 7f822d8dc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfe75bc5f0 0x55bfe7984d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:00.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.307+0000 7f822e0dd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bfe75b4410 0x55bfe7984850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:00.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.307+0000 7f822d8dc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfe75bc5f0 0x55bfe7984d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52802/0 (socket says 172.21.15.70:52802) 2024-09-21T05:54:00.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.307+0000 7f822d8dc640 1 -- 172.21.15.70:0/2000491926 learned_addr learned my addr 172.21.15.70:0/2000491926 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:54:00.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.307+0000 7f822d8dc640 1 --2- 172.21.15.70:0/2000491926 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bfe75dd2d0 0x55bfe7984310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:00.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.307+0000 7f821f7fe640 1 --2- 172.21.15.70:0/1787453341 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f82140b6590 0x7f82140b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:00.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.307+0000 7f822e0dd640 1 -- 172.21.15.70:0/2000491926 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bfe75dd2d0 msgr2=0x55bfe7984310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:00.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.307+0000 7f822e0dd640 1 --2- 172.21.15.70:0/2000491926 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bfe75dd2d0 0x55bfe7984310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.308+0000 7f822e0dd640 1 -- 172.21.15.70:0/2000491926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfe75bc5f0 msgr2=0x55bfe7984d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:00.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.308+0000 7f822e8de640 1 --2- 172.21.15.70:0/1787453341 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f82140b6590 0x7f82140b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:00.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.308+0000 7f822e0dd640 1 --2- 172.21.15.70:0/2000491926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfe75bc5f0 0x55bfe7984d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.308+0000 7f822e0dd640 1 -- 172.21.15.70:0/2000491926 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfe76488b0 con 0x55bfe75b4410 2024-09-21T05:54:00.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.308+0000 7f822d8dc640 1 --2- 172.21.15.70:0/2000491926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfe75bc5f0 0x55bfe7984d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:54:00.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.308+0000 7f821f7fe640 1 -- 172.21.15.70:0/1787453341 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f82200e7940 con 0x7f8228105b90 2024-09-21T05:54:00.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.308+0000 7f822e0dd640 1 --2- 172.21.15.70:0/2000491926 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bfe75b4410 0x55bfe7984850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8224009c00 tx=0x7f82240117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4780acd783a58cbc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:00.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.308+0000 7f822e8de640 1 --2- 172.21.15.70:0/1787453341 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f82140b6590 0x7f82140b8aa0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f82200ad3e0 tx=0x7f8220071c10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:00.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.308+0000 7f821cd9a640 1 -- 172.21.15.70:0/2000491926 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8224012450 con 0x55bfe75b4410 2024-09-21T05:54:00.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.308+0000 7f821cd9a640 1 -- 172.21.15.70:0/2000491926 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f8224012aa0 con 0x55bfe75b4410 2024-09-21T05:54:00.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.308+0000 7f821cd9a640 1 -- 172.21.15.70:0/2000491926 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822400fa10 con 0x55bfe75b4410 2024-09-21T05:54:00.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.309+0000 7f82368b5740 1 -- 172.21.15.70:0/2000491926 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bfe75b4410 msgr2=0x55bfe7984850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:00.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.309+0000 7f82368b5740 1 --2- 172.21.15.70:0/2000491926 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bfe75b4410 0x55bfe7984850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8224009c00 tx=0x7f82240117b0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.309+0000 7f82368b5740 1 -- 172.21.15.70:0/2000491926 shutdown_connections 2024-09-21T05:54:00.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.309+0000 7f82368b5740 1 --2- 172.21.15.70:0/2000491926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfe75bc5f0 0x55bfe7984d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.309+0000 7f82368b5740 1 --2- 172.21.15.70:0/2000491926 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bfe75b4410 0x55bfe7984850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.309+0000 7f82368b5740 1 --2- 172.21.15.70:0/2000491926 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bfe75dd2d0 0x55bfe7984310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.309+0000 7f82368b5740 1 -- 172.21.15.70:0/2000491926 >> 172.21.15.70:0/2000491926 conn(0x55bfe75d16c0 msgr2=0x55bfe7982200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:00.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.309+0000 7f82368b5740 1 -- 172.21.15.70:0/2000491926 shutdown_connections 2024-09-21T05:54:00.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.309+0000 7f82368b5740 1 -- 172.21.15.70:0/2000491926 wait complete. 2024-09-21T05:54:00.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.309+0000 7f82368b5740 1 -- start start 2024-09-21T05:54:00.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.310+0000 7f82368b5740 1 Processor -- start 2024-09-21T05:54:00.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.310+0000 7f82368b5740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bfe75b4410 0x55bfe798feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:00.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.310+0000 7f82368b5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfe75bc5f0 0x55bfe79903f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:00.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.310+0000 7f82368b5740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bfe75dd2d0 0x55bfe799be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:00.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.310+0000 7f82368b5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bfe774b810 con 0x55bfe75bc5f0 2024-09-21T05:54:00.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.310+0000 7f82368b5740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55bfe7885080 con 0x55bfe75dd2d0 2024-09-21T05:54:00.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.310+0000 7f82368b5740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55bfe7992af0 con 0x55bfe75b4410 2024-09-21T05:54:00.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.310+0000 7f82368b5740 10 client.0 _ll_register_callbacks cb 0x55bfe7895960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:54:00.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.310+0000 7f822e0dd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfe75bc5f0 0x55bfe79903f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:00.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.310+0000 7f822e0dd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfe75bc5f0 0x55bfe79903f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52816/0 (socket says 172.21.15.70:52816) 2024-09-21T05:54:00.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.310+0000 7f822e0dd640 1 -- 172.21.15.70:0/4208451060 learned_addr learned my addr 172.21.15.70:0/4208451060 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:54:00.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.310+0000 7f822d8dc640 1 --2- 172.21.15.70:0/4208451060 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bfe75dd2d0 0x55bfe799be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:00.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.310+0000 7f822d8dc640 1 --2- 172.21.15.70:0/4208451060 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bfe75b4410 0x55bfe798feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:00.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.310+0000 7f822e0dd640 1 -- 172.21.15.70:0/4208451060 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bfe75b4410 msgr2=0x55bfe798feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:00.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.310+0000 7f822e0dd640 1 --2- 172.21.15.70:0/4208451060 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bfe75b4410 0x55bfe798feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.310+0000 7f822e0dd640 1 -- 172.21.15.70:0/4208451060 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bfe75dd2d0 msgr2=0x55bfe799be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:00.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.310+0000 7f822e0dd640 1 --2- 172.21.15.70:0/4208451060 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bfe75dd2d0 0x55bfe799be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.310+0000 7f822e0dd640 1 -- 172.21.15.70:0/4208451060 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfe788f460 con 0x55bfe75bc5f0 2024-09-21T05:54:00.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.310+0000 7f822d8dc640 1 --2- 172.21.15.70:0/4208451060 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bfe75b4410 0x55bfe798feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:54:00.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.310+0000 7f822e0dd640 1 --2- 172.21.15.70:0/4208451060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfe75bc5f0 0x55bfe79903f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f8224000c00 tx=0x7f8224009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16793afa083952f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:00.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.310+0000 7f8211ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:54:00.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.311+0000 7f8211ffb640 1 -- 172.21.15.70:0/4208451060 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8224029030 con 0x55bfe75bc5f0 2024-09-21T05:54:00.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.311+0000 7f8211ffb640 1 -- 172.21.15.70:0/4208451060 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f8224020040 con 0x55bfe75bc5f0 2024-09-21T05:54:00.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.311+0000 7f82368b5740 1 -- 172.21.15.70:0/4208451060 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8224012aa0 con 0x55bfe75bc5f0 2024-09-21T05:54:00.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.311+0000 7f8211ffb640 1 -- 172.21.15.70:0/4208451060 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f8224033050 con 0x55bfe75bc5f0 2024-09-21T05:54:00.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.311+0000 7f82368b5740 10 client.15849 fetch_fsmap learned FSMap version 37 2024-09-21T05:54:00.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.311+0000 7f82368b5740 1 -- 172.21.15.70:0/4208451060 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55bfe799eb30 con 0x55bfe75bc5f0 2024-09-21T05:54:00.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.311+0000 7f8211ffb640 1 -- 172.21.15.70:0/4208451060 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f8224012aa0 con 0x55bfe75bc5f0 2024-09-21T05:54:00.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.311+0000 7f8211ffb640 1 -- 172.21.15.70:0/4208451060 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8442+0+0 (secure 0 0 0) 0x7f82240053e0 con 0x55bfe75bc5f0 2024-09-21T05:54:00.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.311+0000 7f82368b5740 10 client.15849 fetch_fsmap finished waiting for FSMap version 37 2024-09-21T05:54:00.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.311+0000 7f82368b5740 10 client.15849 resolve_mds: validated gid 24641 aka daemon mds.b 2024-09-21T05:54:00.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.311+0000 7f82368b5740 20 client.15849 populate_metadata read hostname 'smithi070' 2024-09-21T05:54:00.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.311+0000 7f82368b5740 1 --2- 172.21.15.70:0/4208451060 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55bfe759bc50 0x55bfe79a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:00.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.311+0000 7f82368b5740 4 client.15849 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:54:00.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.311+0000 7f82368b5740 1 -- 172.21.15.70:0/4208451060 --> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bfe78fcd20 con 0x55bfe759bc50 2024-09-21T05:54:00.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.312+0000 7f822d8dc640 1 --2- 172.21.15.70:0/4208451060 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55bfe759bc50 0x55bfe79a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:00.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.312+0000 7f8211ffb640 10 client.15849 ms_handle_connect on v2:172.21.15.116:6838/3952175670 2024-09-21T05:54:00.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.312+0000 7f822d8dc640 1 --2- 172.21.15.70:0/4208451060 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55bfe759bc50 0x55bfe79a1fa0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc1a48cc52dc7ec0 server_cookie=ff05c595abcab716 in_seq=0 out_seq=0 2024-09-21T05:54:00.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.313+0000 7f8211ffb640 1 -- 172.21.15.70:0/4208451060 <== mds.0 v2:172.21.15.116:6838/3952175670 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bfe78fcd20 con 0x55bfe759bc50 2024-09-21T05:54:00.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.313+0000 7f8211ffb640 10 client.15849 handle_command_reply: tid=0 2024-09-21T05:54:00.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.313+0000 7f82368b5740 1 client.15849 shutdown 2024-09-21T05:54:00.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.313+0000 7f82368b5740 1 -- 172.21.15.70:0/4208451060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfe75bc5f0 msgr2=0x55bfe79903f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:00.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.313+0000 7f82368b5740 1 --2- 172.21.15.70:0/4208451060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfe75bc5f0 0x55bfe79903f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f8224000c00 tx=0x7f8224009d70 comp rx=0 tx=0).stop 2024-09-21T05:54:00.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.313+0000 7f82368b5740 1 -- 172.21.15.70:0/4208451060 shutdown_connections 2024-09-21T05:54:00.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.313+0000 7f82368b5740 1 --2- 172.21.15.70:0/4208451060 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55bfe759bc50 0x55bfe79a1fa0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.313+0000 7f82368b5740 1 --2- 172.21.15.70:0/4208451060 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bfe75dd2d0 0x55bfe799be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.313+0000 7f82368b5740 1 --2- 172.21.15.70:0/4208451060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfe75bc5f0 0x55bfe79903f0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.313+0000 7f8211ffb640 0 client.15849 ms_handle_reset on v2:172.21.15.116:6838/3952175670 2024-09-21T05:54:00.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.313+0000 7f82368b5740 1 --2- 172.21.15.70:0/4208451060 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bfe75b4410 0x55bfe798feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.313+0000 7f82368b5740 1 -- 172.21.15.70:0/4208451060 >> 172.21.15.70:0/4208451060 conn(0x55bfe75d16c0 msgr2=0x55bfe79874a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:00.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.313+0000 7f82368b5740 1 -- 172.21.15.70:0/4208451060 shutdown_connections 2024-09-21T05:54:00.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.313+0000 7f82368b5740 1 -- 172.21.15.70:0/4208451060 wait complete. 2024-09-21T05:54:00.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.313+0000 7f82368b5740 20 client.15849 trim_cache size 0 max 16384 2024-09-21T05:54:00.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.330+0000 7f82368b5740 1 Processor -- start 2024-09-21T05:54:00.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.330+0000 7f82368b5740 1 -- start start 2024-09-21T05:54:00.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.331+0000 7f82368b5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfe75b4410 0x55bfe798b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:00.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.331+0000 7f82368b5740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bfe75bc5f0 0x55bfe7985d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:00.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.331+0000 7f82368b5740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bfe75dd2d0 0x55bfe79918e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:00.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.331+0000 7f82368b5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f82281b2ed0 con 0x55bfe75b4410 2024-09-21T05:54:00.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.331+0000 7f82368b5740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f82281b4ce0 con 0x55bfe75dd2d0 2024-09-21T05:54:00.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.331+0000 7f82368b5740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f82281b3660 con 0x55bfe75bc5f0 2024-09-21T05:54:00.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.331+0000 7f822d8dc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfe75b4410 0x55bfe798b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:00.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.331+0000 7f822d8dc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfe75b4410 0x55bfe798b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52830/0 (socket says 172.21.15.70:52830) 2024-09-21T05:54:00.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.331+0000 7f822d8dc640 1 -- 172.21.15.70:0/2337507043 learned_addr learned my addr 172.21.15.70:0/2337507043 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:54:00.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.331+0000 7f822d8dc640 1 -- 172.21.15.70:0/2337507043 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bfe75bc5f0 msgr2=0x55bfe7985d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:00.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.331+0000 7f822d8dc640 1 --2- 172.21.15.70:0/2337507043 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bfe75bc5f0 0x55bfe7985d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.331+0000 7f822d8dc640 1 -- 172.21.15.70:0/2337507043 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bfe75dd2d0 msgr2=0x55bfe79918e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:00.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.331+0000 7f822d8dc640 1 --2- 172.21.15.70:0/2337507043 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bfe75dd2d0 0x55bfe79918e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.331+0000 7f822d8dc640 1 -- 172.21.15.70:0/2337507043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfe79a2310 con 0x55bfe75b4410 2024-09-21T05:54:00.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.331+0000 7f822d8dc640 1 --2- 172.21.15.70:0/2337507043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfe75b4410 0x55bfe798b4d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f82180057c0 tx=0x7f8218005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d428fba84f050 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:00.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.331+0000 7f8213fff640 1 -- 172.21.15.70:0/2337507043 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8218035040 con 0x55bfe75b4410 2024-09-21T05:54:00.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.331+0000 7f8213fff640 1 -- 172.21.15.70:0/2337507043 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f8218003aa0 con 0x55bfe75b4410 2024-09-21T05:54:00.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.332+0000 7f8213fff640 1 -- 172.21.15.70:0/2337507043 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8218032420 con 0x55bfe75b4410 2024-09-21T05:54:00.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.332+0000 7f82368b5740 1 -- 172.21.15.70:0/2337507043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfe75b4410 msgr2=0x55bfe798b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:00.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.332+0000 7f82368b5740 1 --2- 172.21.15.70:0/2337507043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfe75b4410 0x55bfe798b4d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f82180057c0 tx=0x7f8218005fd0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.333+0000 7f82368b5740 1 -- 172.21.15.70:0/2337507043 shutdown_connections 2024-09-21T05:54:00.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.333+0000 7f82368b5740 1 --2- 172.21.15.70:0/2337507043 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bfe75bc5f0 0x55bfe7985d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.333+0000 7f82368b5740 1 --2- 172.21.15.70:0/2337507043 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bfe75dd2d0 0x55bfe79918e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.333+0000 7f82368b5740 1 --2- 172.21.15.70:0/2337507043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfe75b4410 0x55bfe798b4d0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.333+0000 7f82368b5740 1 -- 172.21.15.70:0/2337507043 >> 172.21.15.70:0/2337507043 conn(0x55bfe75d16c0 msgr2=0x55bfe79911d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:00.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.333+0000 7f82368b5740 1 -- 172.21.15.70:0/2337507043 shutdown_connections 2024-09-21T05:54:00.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.333+0000 7f82368b5740 1 -- 172.21.15.70:0/2337507043 wait complete. 2024-09-21T05:54:00.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.333+0000 7f82368b5740 1 -- start start 2024-09-21T05:54:00.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.333+0000 7f82368b5740 1 Processor -- start 2024-09-21T05:54:00.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.333+0000 7f82368b5740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bfe75b4410 0x55bfe79944c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:00.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.333+0000 7f82368b5740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bfe75bc5f0 0x55bfe7994a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:00.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.333+0000 7f82368b5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfe75dd2d0 0x55bfe7a0b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:00.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.333+0000 7f82368b5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f82281b4550 con 0x55bfe75dd2d0 2024-09-21T05:54:00.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.333+0000 7f82368b5740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f82281b3dc0 con 0x55bfe75b4410 2024-09-21T05:54:00.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.333+0000 7f82368b5740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f82281b0eb0 con 0x55bfe75bc5f0 2024-09-21T05:54:00.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.333+0000 7f82368b5740 10 client.0 _ll_register_callbacks cb 0x7f8224009a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:54:00.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.333+0000 7f822d8dc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfe75dd2d0 0x55bfe7a0b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:00.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.333+0000 7f822d8dc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfe75dd2d0 0x55bfe7a0b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52836/0 (socket says 172.21.15.70:52836) 2024-09-21T05:54:00.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.334+0000 7f822d8dc640 1 -- 172.21.15.70:0/102039500 learned_addr learned my addr 172.21.15.70:0/102039500 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:54:00.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.334+0000 7f822d8dc640 1 --2- 172.21.15.70:0/102039500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bfe75b4410 0x55bfe79944c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:00.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.334+0000 7f822e0dd640 1 --2- 172.21.15.70:0/102039500 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bfe75bc5f0 0x55bfe7994a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:00.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.334+0000 7f822d8dc640 1 -- 172.21.15.70:0/102039500 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bfe75bc5f0 msgr2=0x55bfe7994a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:00.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.334+0000 7f822d8dc640 1 --2- 172.21.15.70:0/102039500 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bfe75bc5f0 0x55bfe7994a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.334+0000 7f822d8dc640 1 -- 172.21.15.70:0/102039500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bfe75b4410 msgr2=0x55bfe79944c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:00.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.334+0000 7f822d8dc640 1 --2- 172.21.15.70:0/102039500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bfe75b4410 0x55bfe79944c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.334+0000 7f822d8dc640 1 -- 172.21.15.70:0/102039500 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfe7a0bcd0 con 0x55bfe75dd2d0 2024-09-21T05:54:00.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.334+0000 7f822d8dc640 1 --2- 172.21.15.70:0/102039500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfe75dd2d0 0x55bfe7a0b740 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f82180041c0 tx=0x7f82180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d2aa880228f8ac0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:00.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.334+0000 7f8211ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-21T05:54:00.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.334+0000 7f8211ffb640 1 -- 172.21.15.70:0/102039500 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8218035070 con 0x55bfe75dd2d0 2024-09-21T05:54:00.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.334+0000 7f8211ffb640 1 -- 172.21.15.70:0/102039500 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f82180035f0 con 0x55bfe75dd2d0 2024-09-21T05:54:00.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.334+0000 7f82368b5740 1 -- 172.21.15.70:0/102039500 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8218003aa0 con 0x55bfe75dd2d0 2024-09-21T05:54:00.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.334+0000 7f8211ffb640 1 -- 172.21.15.70:0/102039500 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f82180037f0 con 0x55bfe75dd2d0 2024-09-21T05:54:00.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.334+0000 7f82368b5740 10 client.15855 fetch_fsmap learned FSMap version 37 2024-09-21T05:54:00.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.334+0000 7f82368b5740 1 -- 172.21.15.70:0/102039500 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55bfe7a0cf10 con 0x55bfe75dd2d0 2024-09-21T05:54:00.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.335+0000 7f8211ffb640 1 -- 172.21.15.70:0/102039500 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f8218003aa0 con 0x55bfe75dd2d0 2024-09-21T05:54:00.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.335+0000 7f8211ffb640 1 -- 172.21.15.70:0/102039500 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8442+0+0 (secure 0 0 0) 0x7f821805d020 con 0x55bfe75dd2d0 2024-09-21T05:54:00.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.335+0000 7f82368b5740 10 client.15855 fetch_fsmap finished waiting for FSMap version 37 2024-09-21T05:54:00.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.335+0000 7f82368b5740 10 client.15855 resolve_mds: validated gid 24641 aka daemon mds.b 2024-09-21T05:54:00.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.335+0000 7f82368b5740 20 client.15855 populate_metadata read hostname 'smithi070' 2024-09-21T05:54:00.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.335+0000 7f82368b5740 1 --2- 172.21.15.70:0/102039500 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55bfe7571000 0x55bfe7a0f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:00.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.335+0000 7f82368b5740 4 client.15855 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-21T05:54:00.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.335+0000 7f82368b5740 1 -- 172.21.15.70:0/102039500 --> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55bfe78f87d0 con 0x55bfe7571000 2024-09-21T05:54:00.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.335+0000 7f822e0dd640 1 --2- 172.21.15.70:0/102039500 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55bfe7571000 0x55bfe7a0f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:00.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.336+0000 7f822e0dd640 1 --2- 172.21.15.70:0/102039500 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55bfe7571000 0x55bfe7a0f730 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7ba1dac98ff4722 server_cookie=df83c19f082e0c5e in_seq=0 out_seq=0 2024-09-21T05:54:00.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.336+0000 7f8211ffb640 10 client.15855 ms_handle_connect on v2:172.21.15.116:6838/3952175670 2024-09-21T05:54:00.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.336+0000 7f8211ffb640 1 -- 172.21.15.70:0/102039500 <== mds.0 v2:172.21.15.116:6838/3952175670 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x55bfe78f87d0 con 0x55bfe7571000 2024-09-21T05:54:00.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.336+0000 7f8211ffb640 10 client.15855 handle_command_reply: tid=0 2024-09-21T05:54:00.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.336+0000 7f82368b5740 1 client.15855 shutdown 2024-09-21T05:54:00.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.336+0000 7f82368b5740 1 -- 172.21.15.70:0/102039500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfe75dd2d0 msgr2=0x55bfe7a0b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:00.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.336+0000 7f82368b5740 1 --2- 172.21.15.70:0/102039500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfe75dd2d0 0x55bfe7a0b740 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f82180041c0 tx=0x7f82180057f0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.336+0000 7f82368b5740 1 -- 172.21.15.70:0/102039500 shutdown_connections 2024-09-21T05:54:00.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.336+0000 7f82368b5740 1 --2- 172.21.15.70:0/102039500 >> [v2:172.21.15.116:6838/3952175670,v1:172.21.15.116:6839/3952175670] conn(0x55bfe7571000 0x55bfe7a0f730 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.336+0000 7f82368b5740 1 --2- 172.21.15.70:0/102039500 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bfe75bc5f0 0x55bfe7994a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.336+0000 7f82368b5740 1 --2- 172.21.15.70:0/102039500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfe75dd2d0 0x55bfe7a0b740 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.336+0000 7f82368b5740 1 --2- 172.21.15.70:0/102039500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bfe75b4410 0x55bfe79944c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.336+0000 7f8211ffb640 0 client.15855 ms_handle_reset on v2:172.21.15.116:6838/3952175670 2024-09-21T05:54:00.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.336+0000 7f82368b5740 1 -- 172.21.15.70:0/102039500 >> 172.21.15.70:0/102039500 conn(0x55bfe75d16c0 msgr2=0x55bfe7991b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:00.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.336+0000 7f82368b5740 1 -- 172.21.15.70:0/102039500 shutdown_connections 2024-09-21T05:54:00.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.336+0000 7f82368b5740 1 -- 172.21.15.70:0/102039500 wait complete. 2024-09-21T05:54:00.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.337+0000 7f82368b5740 20 client.15855 trim_cache size 0 max 16384 2024-09-21T05:54:00.342 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:54:00.343 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 37, 2024-09-21T05:54:00.343 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 24641, 2024-09-21T05:54:00.343 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 16, 2024-09-21T05:54:00.343 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": {} 2024-09-21T05:54:00.343 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:54:00.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.337+0000 7f8230341640 1 -- 172.21.15.70:0/1787453341 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f82140b6590 msgr2=0x7f82140b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:00.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.337+0000 7f8230341640 1 --2- 172.21.15.70:0/1787453341 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f82140b6590 0x7f82140b8aa0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f82200ad3e0 tx=0x7f8220071c10 comp rx=0 tx=0).stop 2024-09-21T05:54:00.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.337+0000 7f8230341640 1 -- 172.21.15.70:0/1787453341 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8228105b90 msgr2=0x7f8228113cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:00.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.337+0000 7f8230341640 1 --2- 172.21.15.70:0/1787453341 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8228105b90 0x7f8228113cb0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f822000eaa0 tx=0x7f822000ef60 comp rx=0 tx=0).stop 2024-09-21T05:54:00.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.337+0000 7f8230341640 1 -- 172.21.15.70:0/1787453341 shutdown_connections 2024-09-21T05:54:00.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.337+0000 7f8230341640 1 --2- 172.21.15.70:0/1787453341 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f82140b6590 0x7f82140b8aa0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.337+0000 7f8230341640 1 --2- 172.21.15.70:0/1787453341 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8228105240 0x7f8228113770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.337+0000 7f8230341640 1 --2- 172.21.15.70:0/1787453341 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8228105b90 0x7f8228113cb0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.337+0000 7f8230341640 1 --2- 172.21.15.70:0/1787453341 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8228103270 0x7f8228113230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:00.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.337+0000 7f8230341640 1 -- 172.21.15.70:0/1787453341 >> 172.21.15.70:0/1787453341 conn(0x7f8228079ec0 msgr2=0x7f8228107340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:00.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.337+0000 7f8230341640 1 -- 172.21.15.70:0/1787453341 shutdown_connections 2024-09-21T05:54:00.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:00.337+0000 7f8230341640 1 -- 172.21.15.70:0/1787453341 wait complete. 2024-09-21T05:54:00.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:00 smithi160 ceph-mon[33979]: pgmap v506: 129 pgs: 129 active+clean; 99 MiB data, 782 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 317 op/s 2024-09-21T05:54:00.946 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:00 smithi070 ceph-mon[30981]: pgmap v506: 129 pgs: 129 active+clean; 99 MiB data, 782 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 317 op/s 2024-09-21T05:54:01.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:00 smithi116 ceph-mon[34332]: pgmap v506: 129 pgs: 129 active+clean; 99 MiB data, 782 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 317 op/s 2024-09-21T05:54:01.152 INFO:tasks.quiescer:done joining Quiescers 2024-09-21T05:54:01.152 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-21T05:54:01.162 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T05:54:01.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.271+0000 7fedb2c9b640 1 -- 172.21.15.70:0/636572373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedac1046f0 msgr2=0x7fedac104b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:01.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.271+0000 7fedb2c9b640 1 --2- 172.21.15.70:0/636572373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedac1046f0 0x7fedac104b00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fed9c009ca0 tx=0x7fed9c02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:54:01.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.271+0000 7fedb2c9b640 1 -- 172.21.15.70:0/636572373 shutdown_connections 2024-09-21T05:54:01.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.271+0000 7fedb2c9b640 1 --2- 172.21.15.70:0/636572373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fedac105090 0x7fedac10ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:01.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.271+0000 7fedb2c9b640 1 --2- 172.21.15.70:0/636572373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedac1046f0 0x7fedac104b00 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:01.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.271+0000 7fedb2c9b640 1 --2- 172.21.15.70:0/636572373 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fedac103670 0x7fedac103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:01.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.271+0000 7fedb2c9b640 1 -- 172.21.15.70:0/636572373 >> 172.21.15.70:0/636572373 conn(0x7fedac0fefd0 msgr2=0x7fedac101460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:01.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.271+0000 7fedb2c9b640 1 -- 172.21.15.70:0/636572373 shutdown_connections 2024-09-21T05:54:01.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.271+0000 7fedb2c9b640 1 -- 172.21.15.70:0/636572373 wait complete. 2024-09-21T05:54:01.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.272+0000 7fedb2c9b640 1 Processor -- start 2024-09-21T05:54:01.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.272+0000 7fedb2c9b640 1 -- start start 2024-09-21T05:54:01.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.272+0000 7fedb2c9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedac103670 0x7fedac199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:01.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.272+0000 7fedb2c9b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fedac1046f0 0x7fedac19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:01.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.272+0000 7fedb2c9b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fedac105090 0x7fedac19b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:01.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.272+0000 7fedb2c9b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fedac10f310 con 0x7fedac103670 2024-09-21T05:54:01.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.272+0000 7fedb2c9b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fedac10f190 con 0x7fedac105090 2024-09-21T05:54:01.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.272+0000 7fedb2c9b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fedac10f490 con 0x7fedac1046f0 2024-09-21T05:54:01.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.272+0000 7fedb0a37640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedac103670 0x7fedac199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:01.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.272+0000 7fedb0a37640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedac103670 0x7fedac199f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52866/0 (socket says 172.21.15.70:52866) 2024-09-21T05:54:01.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.272+0000 7fedb0a37640 1 -- 172.21.15.70:0/3199560007 learned_addr learned my addr 172.21.15.70:0/3199560007 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:54:01.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.272+0000 7fedabfff640 1 --2- 172.21.15.70:0/3199560007 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fedac1046f0 0x7fedac19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:01.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.273+0000 7fedb1238640 1 --2- 172.21.15.70:0/3199560007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fedac105090 0x7fedac19b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:01.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.273+0000 7fedb0a37640 1 -- 172.21.15.70:0/3199560007 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fedac1046f0 msgr2=0x7fedac19a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:01.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.273+0000 7fedb0a37640 1 --2- 172.21.15.70:0/3199560007 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fedac1046f0 0x7fedac19a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:01.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.273+0000 7fedb0a37640 1 -- 172.21.15.70:0/3199560007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fedac105090 msgr2=0x7fedac19b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:01.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.273+0000 7fedb0a37640 1 --2- 172.21.15.70:0/3199560007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fedac105090 0x7fedac19b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:01.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.273+0000 7fedb0a37640 1 -- 172.21.15.70:0/3199560007 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedac19b8d0 con 0x7fedac103670 2024-09-21T05:54:01.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.273+0000 7fedb1238640 1 --2- 172.21.15.70:0/3199560007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fedac105090 0x7fedac19b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:54:01.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.273+0000 7fedb0a37640 1 --2- 172.21.15.70:0/3199560007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedac103670 0x7fedac199f20 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7feda400d770 tx=0x7feda400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:01.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.273+0000 7feda9ffb640 1 -- 172.21.15.70:0/3199560007 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda4017070 con 0x7fedac103670 2024-09-21T05:54:01.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.273+0000 7feda9ffb640 1 -- 172.21.15.70:0/3199560007 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7feda40054d0 con 0x7fedac103670 2024-09-21T05:54:01.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.273+0000 7fedb2c9b640 1 -- 172.21.15.70:0/3199560007 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedac19bbc0 con 0x7fedac103670 2024-09-21T05:54:01.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.273+0000 7feda9ffb640 1 -- 172.21.15.70:0/3199560007 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda4004c80 con 0x7fedac103670 2024-09-21T05:54:01.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.273+0000 7fedb2c9b640 1 -- 172.21.15.70:0/3199560007 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedac1a2160 con 0x7fedac103670 2024-09-21T05:54:01.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.274+0000 7fedb2c9b640 1 -- 172.21.15.70:0/3199560007 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedac10a840 con 0x7fedac103670 2024-09-21T05:54:01.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.276+0000 7feda9ffb640 1 -- 172.21.15.70:0/3199560007 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7feda4004e20 con 0x7fedac103670 2024-09-21T05:54:01.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.277+0000 7feda9ffb640 1 --2- 172.21.15.70:0/3199560007 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fed980b6510 0x7fed980b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:01.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.277+0000 7fedabfff640 1 --2- 172.21.15.70:0/3199560007 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fed980b6510 0x7fed980b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:01.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.277+0000 7feda9ffb640 1 -- 172.21.15.70:0/3199560007 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7feda40e71d0 con 0x7fedac103670 2024-09-21T05:54:01.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.277+0000 7fedabfff640 1 --2- 172.21.15.70:0/3199560007 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fed980b6510 0x7fed980b8a20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fed9c0094e0 tx=0x7fed9c031990 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:01.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.281+0000 7feda9ffb640 1 -- 172.21.15.70:0/3199560007 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feda40ad670 con 0x7fedac103670 2024-09-21T05:54:01.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.459+0000 7fedb2c9b640 1 -- 172.21.15.70:0/3199560007 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fedac063fc0 con 0x7fedac103670 2024-09-21T05:54:01.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.461+0000 7feda9ffb640 1 -- 172.21.15.70:0/3199560007 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24983 (secure 0 0 0) 0x7feda40b1a50 con 0x7fedac103670 2024-09-21T05:54:01.463 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:54:01.463 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":85,"fsid":"96c6636e-77db-11ef-baf5-efdc52797490","created":"2024-09-21T05:38:42.297307+0000","modified":"2024-09-21T05:48:38.706309+0000","last_up_change":"2024-09-21T05:46:15.910344+0000","last_in_change":"2024-09-21T05:45:53.382766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:42:25.611590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:47:01.987981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:47:04.388107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T05:47:10.651871+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00be8b82-7cb1-443f-ad18-02916f734df7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6803","nonce":1667051447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6805","nonce":1667051447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6809","nonce":1667051447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6807","nonce":1667051447}]},"public_addr":"172.21.15.70:6803/1667051447","cluster_addr":"172.21.15.70:6805/1667051447","heartbeat_back_addr":"172.21.15.70:6809/1667051447","heartbeat_front_addr":"172.21.15.70:6807/1667051447","state":["exists","up"]},{"osd":1,"uuid":"28ca8c5c-5e81-4e64-ac0e-3c8c3c2d3930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6801","nonce":1037621846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6803","nonce":1037621846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6807","nonce":1037621846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6805","nonce":1037621846}]},"public_addr":"172.21.15.116:6801/1037621846","cluster_addr":"172.21.15.116:6803/1037621846","heartbeat_back_addr":"172.21.15.116:6807/1037621846","heartbeat_front_addr":"172.21.15.116:6805/1037621846","state":["exists","up"]},{"osd":2,"uuid":"e9b42bf2-a38b-4cf9-8774-4950de12d0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6801","nonce":69260815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6803","nonce":69260815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6807","nonce":69260815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6805","nonce":69260815}]},"public_addr":"172.21.15.160:6801/69260815","cluster_addr":"172.21.15.160:6803/69260815","heartbeat_back_addr":"172.21.15.160:6807/69260815","heartbeat_front_addr":"172.21.15.160:6805/69260815","state":["exists","up"]},{"osd":3,"uuid":"25d8e9a8-3c14-43d6-9bb1-b44cd377133f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6811","nonce":3849416072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6813","nonce":3849416072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6817","nonce":3849416072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6815","nonce":3849416072}]},"public_addr":"172.21.15.70:6811/3849416072","cluster_addr":"172.21.15.70:6813/3849416072","heartbeat_back_addr":"172.21.15.70:6817/3849416072","heartbeat_front_addr":"172.21.15.70:6815/3849416072","state":["exists","up"]},{"osd":4,"uuid":"bdb84cbd-d718-4f69-90d0-2e732e580df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6809","nonce":3444857438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6811","nonce":3444857438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6815","nonce":3444857438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6813","nonce":3444857438}]},"public_addr":"172.21.15.116:6809/3444857438","cluster_addr":"172.21.15.116:6811/3444857438","heartbeat_back_addr":"172.21.15.116:6815/3444857438","heartbeat_front_addr":"172.21.15.116:6813/3444857438","state":["exists","up"]},{"osd":5,"uuid":"a490eeba-549f-4caa-8cd5-4168a23dafa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6809","nonce":3063220427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6811","nonce":3063220427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6815","nonce":3063220427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6813","nonce":3063220427}]},"public_addr":"172.21.15.160:6809/3063220427","cluster_addr":"172.21.15.160:6811/3063220427","heartbeat_back_addr":"172.21.15.160:6815/3063220427","heartbeat_front_addr":"172.21.15.160:6813/3063220427","state":["exists","up"]},{"osd":6,"uuid":"1bf22f48-c02f-4f09-b0fe-2597a55fd795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6819","nonce":3650315688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6821","nonce":3650315688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6825","nonce":3650315688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6823","nonce":3650315688}]},"public_addr":"172.21.15.70:6819/3650315688","cluster_addr":"172.21.15.70:6821/3650315688","heartbeat_back_addr":"172.21.15.70:6825/3650315688","heartbeat_front_addr":"172.21.15.70:6823/3650315688","state":["exists","up"]},{"osd":7,"uuid":"40d59744-4860-4a92-aa21-3f33e575e5b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6817","nonce":2034132009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6819","nonce":2034132009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6823","nonce":2034132009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6821","nonce":2034132009}]},"public_addr":"172.21.15.116:6817/2034132009","cluster_addr":"172.21.15.116:6819/2034132009","heartbeat_back_addr":"172.21.15.116:6823/2034132009","heartbeat_front_addr":"172.21.15.116:6821/2034132009","state":["exists","up"]},{"osd":8,"uuid":"65dc02e7-0dcd-4fa7-955a-4d5c00fbe4cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6817","nonce":3381625184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6819","nonce":3381625184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6823","nonce":3381625184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6821","nonce":3381625184}]},"public_addr":"172.21.15.160:6817/3381625184","cluster_addr":"172.21.15.160:6819/3381625184","heartbeat_back_addr":"172.21.15.160:6823/3381625184","heartbeat_front_addr":"172.21.15.160:6821/3381625184","state":["exists","up"]},{"osd":9,"uuid":"d8438a9c-012f-4082-be3f-9653cdfaac78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6827","nonce":3555256209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6829","nonce":3555256209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6833","nonce":3555256209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6831","nonce":3555256209}]},"public_addr":"172.21.15.70:6827/3555256209","cluster_addr":"172.21.15.70:6829/3555256209","heartbeat_back_addr":"172.21.15.70:6833/3555256209","heartbeat_front_addr":"172.21.15.70:6831/3555256209","state":["exists","up"]},{"osd":10,"uuid":"871619b0-181e-4020-9511-2cec296bfe70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6825","nonce":541280433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6827","nonce":541280433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6831","nonce":541280433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6829","nonce":541280433}]},"public_addr":"172.21.15.116:6825/541280433","cluster_addr":"172.21.15.116:6827/541280433","heartbeat_back_addr":"172.21.15.116:6831/541280433","heartbeat_front_addr":"172.21.15.116:6829/541280433","state":["exists","up"]},{"osd":11,"uuid":"302da945-7929-4b0c-a20b-099175752c41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6825","nonce":2632369083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6827","nonce":2632369083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6831","nonce":2632369083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6829","nonce":2632369083}]},"public_addr":"172.21.15.160:6825/2632369083","cluster_addr":"172.21.15.160:6827/2632369083","heartbeat_back_addr":"172.21.15.160:6831/2632369083","heartbeat_front_addr":"172.21.15.160:6829/2632369083","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:41:34.446744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:41:59.336955+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:42:23.958219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:42:49.396007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:43:15.325344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:43:41.923141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:07.873970+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:33.897951+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:58.397680+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:24.568406+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:49.504565+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:14.698577+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.e","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6800/605055695":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/897886925":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/1968357524":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/693721445":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/2810307308":"2024-09-22T05:39:12.492271+0000","172.21.15.70:6801/605055695":"2024-09-22T05:39:37.296630+0000","172.21.15.70:6801/1668927582":"2024-09-22T05:39:12.492271+0000","172.21.15.70:6800/1668927582":"2024-09-22T05:39:12.492271+0000","172.21.15.70:0/1979536420":"2024-09-22T05:39:12.492271+0000","172.21.15.70:0/2674019604":"2024-09-22T05:39:12.492271+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:54:01.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.463+0000 7fedb2c9b640 1 -- 172.21.15.70:0/3199560007 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fed980b6510 msgr2=0x7fed980b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:01.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.463+0000 7fedb2c9b640 1 --2- 172.21.15.70:0/3199560007 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fed980b6510 0x7fed980b8a20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fed9c0094e0 tx=0x7fed9c031990 comp rx=0 tx=0).stop 2024-09-21T05:54:01.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.463+0000 7fedb2c9b640 1 -- 172.21.15.70:0/3199560007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedac103670 msgr2=0x7fedac199f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:01.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.463+0000 7fedb2c9b640 1 --2- 172.21.15.70:0/3199560007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedac103670 0x7fedac199f20 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7feda400d770 tx=0x7feda400dc30 comp rx=0 tx=0).stop 2024-09-21T05:54:01.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.463+0000 7fedb2c9b640 1 -- 172.21.15.70:0/3199560007 shutdown_connections 2024-09-21T05:54:01.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.463+0000 7fedb2c9b640 1 --2- 172.21.15.70:0/3199560007 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fed980b6510 0x7fed980b8a20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:01.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.463+0000 7fedb2c9b640 1 --2- 172.21.15.70:0/3199560007 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fedac1046f0 0x7fedac19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:01.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.463+0000 7fedb2c9b640 1 --2- 172.21.15.70:0/3199560007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fedac105090 0x7fedac19b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:01.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.463+0000 7fedb2c9b640 1 --2- 172.21.15.70:0/3199560007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedac103670 0x7fedac199f20 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:01.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.463+0000 7fedb2c9b640 1 -- 172.21.15.70:0/3199560007 >> 172.21.15.70:0/3199560007 conn(0x7fedac0fefd0 msgr2=0x7fedac107a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:01.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.463+0000 7fedb2c9b640 1 -- 172.21.15.70:0/3199560007 shutdown_connections 2024-09-21T05:54:01.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.463+0000 7fedb2c9b640 1 -- 172.21.15.70:0/3199560007 wait complete. 2024-09-21T05:54:01.477 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T05:42:25.611590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T05:47:01.987981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T05:47:04.388107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-21T05:47:10.651871+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-21T05:54:01.478 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T05:54:01.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.587+0000 7f1c70894640 1 -- 172.21.15.70:0/623905118 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c6c1036a0 msgr2=0x7f1c6c103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:01.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.587+0000 7f1c70894640 1 --2- 172.21.15.70:0/623905118 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c6c1036a0 0x7f1c6c103b10 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c009900 tx=0x7f1c5c02a410 comp rx=0 tx=0).stop 2024-09-21T05:54:01.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.587+0000 7f1c70894640 1 -- 172.21.15.70:0/623905118 shutdown_connections 2024-09-21T05:54:01.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.587+0000 7f1c70894640 1 --2- 172.21.15.70:0/623905118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c6c1050c0 0x7f1c6c10ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:01.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.587+0000 7f1c70894640 1 --2- 172.21.15.70:0/623905118 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c6c104720 0x7f1c6c104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:01.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.587+0000 7f1c70894640 1 --2- 172.21.15.70:0/623905118 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c6c1036a0 0x7f1c6c103b10 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:01.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.587+0000 7f1c70894640 1 -- 172.21.15.70:0/623905118 >> 172.21.15.70:0/623905118 conn(0x7f1c6c0ff020 msgr2=0x7f1c6c101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:01.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.587+0000 7f1c70894640 1 -- 172.21.15.70:0/623905118 shutdown_connections 2024-09-21T05:54:01.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.587+0000 7f1c70894640 1 -- 172.21.15.70:0/623905118 wait complete. 2024-09-21T05:54:01.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.588+0000 7f1c70894640 1 Processor -- start 2024-09-21T05:54:01.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.588+0000 7f1c70894640 1 -- start start 2024-09-21T05:54:01.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.588+0000 7f1c70894640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c6c1036a0 0x7f1c6c199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:01.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.588+0000 7f1c70894640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c6c104720 0x7f1c6c19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:01.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.588+0000 7f1c70894640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c6c1050c0 0x7f1c6c19b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:01.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.588+0000 7f1c70894640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6c10f330 con 0x7f1c6c1050c0 2024-09-21T05:54:01.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.588+0000 7f1c70894640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6c10f1b0 con 0x7f1c6c104720 2024-09-21T05:54:01.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.588+0000 7f1c70894640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6c10f4b0 con 0x7f1c6c1036a0 2024-09-21T05:54:01.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.589+0000 7f1c6ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c6c1050c0 0x7f1c6c19b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:01.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.589+0000 7f1c6ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c6c1050c0 0x7f1c6c19b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52874/0 (socket says 172.21.15.70:52874) 2024-09-21T05:54:01.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.589+0000 7f1c6ad9d640 1 -- 172.21.15.70:0/2516610953 learned_addr learned my addr 172.21.15.70:0/2516610953 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:54:01.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.589+0000 7f1c6a59c640 1 --2- 172.21.15.70:0/2516610953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c6c1036a0 0x7f1c6c199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:01.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.589+0000 7f1c69d9b640 1 --2- 172.21.15.70:0/2516610953 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c6c104720 0x7f1c6c19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:01.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.589+0000 7f1c6ad9d640 1 -- 172.21.15.70:0/2516610953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c6c1036a0 msgr2=0x7f1c6c199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:01.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.589+0000 7f1c6ad9d640 1 --2- 172.21.15.70:0/2516610953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c6c1036a0 0x7f1c6c199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:01.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.589+0000 7f1c6ad9d640 1 -- 172.21.15.70:0/2516610953 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c6c104720 msgr2=0x7f1c6c19a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:01.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.589+0000 7f1c6ad9d640 1 --2- 172.21.15.70:0/2516610953 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c6c104720 0x7f1c6c19a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:01.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.589+0000 7f1c6ad9d640 1 -- 172.21.15.70:0/2516610953 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c6c19b9f0 con 0x7f1c6c1050c0 2024-09-21T05:54:01.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.589+0000 7f1c6ad9d640 1 --2- 172.21.15.70:0/2516610953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c6c1050c0 0x7f1c6c19b1d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1c6400b970 tx=0x7f1c6400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:01.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.589+0000 7f1c5b7fe640 1 -- 172.21.15.70:0/2516610953 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c64019070 con 0x7f1c6c1050c0 2024-09-21T05:54:01.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.589+0000 7f1c70894640 1 -- 172.21.15.70:0/2516610953 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c6c19bce0 con 0x7f1c6c1050c0 2024-09-21T05:54:01.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.589+0000 7f1c5b7fe640 1 -- 172.21.15.70:0/2516610953 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f1c64014440 con 0x7f1c6c1050c0 2024-09-21T05:54:01.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.589+0000 7f1c5b7fe640 1 -- 172.21.15.70:0/2516610953 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c640075d0 con 0x7f1c6c1050c0 2024-09-21T05:54:01.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.589+0000 7f1c70894640 1 -- 172.21.15.70:0/2516610953 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c6c1a23d0 con 0x7f1c6c1050c0 2024-09-21T05:54:01.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.590+0000 7f1c70894640 1 -- 172.21.15.70:0/2516610953 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c6c10a870 con 0x7f1c6c1050c0 2024-09-21T05:54:01.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.592+0000 7f1c5b7fe640 1 -- 172.21.15.70:0/2516610953 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f1c6401c070 con 0x7f1c6c1050c0 2024-09-21T05:54:01.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.592+0000 7f1c5b7fe640 1 --2- 172.21.15.70:0/2516610953 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1c540b6510 0x7f1c540b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:01.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.592+0000 7f1c6a59c640 1 --2- 172.21.15.70:0/2516610953 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1c540b6510 0x7f1c540b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:01.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.592+0000 7f1c5b7fe640 1 -- 172.21.15.70:0/2516610953 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f1c640e6bd0 con 0x7f1c6c1050c0 2024-09-21T05:54:01.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.593+0000 7f1c6a59c640 1 --2- 172.21.15.70:0/2516610953 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1c540b6510 0x7f1c540b8a20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c006010 tx=0x7f1c5c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:01.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.597+0000 7f1c5b7fe640 1 -- 172.21.15.70:0/2516610953 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1c640b1450 con 0x7f1c6c1050c0 2024-09-21T05:54:01.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:01 smithi070 ceph-mon[30981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:54:01.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:01 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3199560007' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:54:01.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.780+0000 7f1c70894640 1 -- 172.21.15.70:0/2516610953 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1c6c063fc0 con 0x7f1c6c1050c0 2024-09-21T05:54:01.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.781+0000 7f1c5b7fe640 1 -- 172.21.15.70:0/2516610953 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) ==== 93+0+10 (secure 0 0 0) 0x7f1c640b6390 con 0x7f1c6c1050c0 2024-09-21T05:54:01.783 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-09-21T05:54:01.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.783+0000 7f1c70894640 1 -- 172.21.15.70:0/2516610953 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1c540b6510 msgr2=0x7f1c540b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:01.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.783+0000 7f1c70894640 1 --2- 172.21.15.70:0/2516610953 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1c540b6510 0x7f1c540b8a20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c006010 tx=0x7f1c5c000bc0 comp rx=0 tx=0).stop 2024-09-21T05:54:01.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.783+0000 7f1c70894640 1 -- 172.21.15.70:0/2516610953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c6c1050c0 msgr2=0x7f1c6c19b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:01.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.783+0000 7f1c70894640 1 --2- 172.21.15.70:0/2516610953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c6c1050c0 0x7f1c6c19b1d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1c6400b970 tx=0x7f1c6400be30 comp rx=0 tx=0).stop 2024-09-21T05:54:01.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.783+0000 7f1c70894640 1 -- 172.21.15.70:0/2516610953 shutdown_connections 2024-09-21T05:54:01.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.783+0000 7f1c70894640 1 --2- 172.21.15.70:0/2516610953 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f1c540b6510 0x7f1c540b8a20 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:01.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.783+0000 7f1c70894640 1 --2- 172.21.15.70:0/2516610953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c6c1050c0 0x7f1c6c19b1d0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:01.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.783+0000 7f1c70894640 1 --2- 172.21.15.70:0/2516610953 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c6c104720 0x7f1c6c19a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:01.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.783+0000 7f1c70894640 1 --2- 172.21.15.70:0/2516610953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c6c1036a0 0x7f1c6c199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:01.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.783+0000 7f1c70894640 1 -- 172.21.15.70:0/2516610953 >> 172.21.15.70:0/2516610953 conn(0x7f1c6c0ff020 msgr2=0x7f1c6c107a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:01.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.783+0000 7f1c70894640 1 -- 172.21.15.70:0/2516610953 shutdown_connections 2024-09-21T05:54:01.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.783+0000 7f1c70894640 1 -- 172.21.15.70:0/2516610953 wait complete. 2024-09-21T05:54:01.796 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T05:54:01.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.907+0000 7fba03c7e640 1 -- 172.21.15.70:0/244394286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9fc103600 msgr2=0x7fb9fc103a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:01.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.907+0000 7fba03c7e640 1 --2- 172.21.15.70:0/244394286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9fc103600 0x7fb9fc103a10 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec009900 tx=0x7fb9ec02a410 comp rx=0 tx=0).stop 2024-09-21T05:54:01.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.907+0000 7fba03c7e640 1 -- 172.21.15.70:0/244394286 shutdown_connections 2024-09-21T05:54:01.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.907+0000 7fba03c7e640 1 --2- 172.21.15.70:0/244394286 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9fc103fa0 0x7fb9fc10a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:01.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.907+0000 7fba03c7e640 1 --2- 172.21.15.70:0/244394286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9fc103600 0x7fb9fc103a10 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:01.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.907+0000 7fba03c7e640 1 --2- 172.21.15.70:0/244394286 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9fc102580 0x7fb9fc1029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:01.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.907+0000 7fba03c7e640 1 -- 172.21.15.70:0/244394286 >> 172.21.15.70:0/244394286 conn(0x7fb9fc0fdee0 msgr2=0x7fb9fc100370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:01.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.907+0000 7fba03c7e640 1 -- 172.21.15.70:0/244394286 shutdown_connections 2024-09-21T05:54:01.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.907+0000 7fba03c7e640 1 -- 172.21.15.70:0/244394286 wait complete. 2024-09-21T05:54:01.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.908+0000 7fba03c7e640 1 Processor -- start 2024-09-21T05:54:01.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.908+0000 7fba03c7e640 1 -- start start 2024-09-21T05:54:01.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.908+0000 7fba03c7e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9fc102580 0x7fb9fc198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:01.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.908+0000 7fba03c7e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9fc103600 0x7fb9fc199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:01.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.908+0000 7fba03c7e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9fc103fa0 0x7fb9fc199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:01.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.908+0000 7fba03c7e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc10e1d0 con 0x7fb9fc103fa0 2024-09-21T05:54:01.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.908+0000 7fba03c7e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc10e050 con 0x7fb9fc102580 2024-09-21T05:54:01.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.908+0000 7fba03c7e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc10e350 con 0x7fb9fc103600 2024-09-21T05:54:01.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.908+0000 7fba0221b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9fc103fa0 0x7fb9fc199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:01.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.908+0000 7fba0221b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9fc103fa0 0x7fb9fc199fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52886/0 (socket says 172.21.15.70:52886) 2024-09-21T05:54:01.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.908+0000 7fba0221b640 1 -- 172.21.15.70:0/3087283678 learned_addr learned my addr 172.21.15.70:0/3087283678 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:54:01.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.908+0000 7fba01a1a640 1 --2- 172.21.15.70:0/3087283678 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9fc102580 0x7fb9fc198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:01.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.908+0000 7fba01219640 1 --2- 172.21.15.70:0/3087283678 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9fc103600 0x7fb9fc199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:01.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.908+0000 7fba0221b640 1 -- 172.21.15.70:0/3087283678 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9fc103600 msgr2=0x7fb9fc199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:01.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.908+0000 7fba0221b640 1 --2- 172.21.15.70:0/3087283678 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9fc103600 0x7fb9fc199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:01.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.908+0000 7fba0221b640 1 -- 172.21.15.70:0/3087283678 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9fc102580 msgr2=0x7fb9fc198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:01.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.908+0000 7fba0221b640 1 --2- 172.21.15.70:0/3087283678 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9fc102580 0x7fb9fc198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:01.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.908+0000 7fba0221b640 1 -- 172.21.15.70:0/3087283678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9fc19a800 con 0x7fb9fc103fa0 2024-09-21T05:54:01.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.908+0000 7fba0221b640 1 --2- 172.21.15.70:0/3087283678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9fc103fa0 0x7fb9fc199fe0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb9f400cad0 tx=0x7fb9f400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:01.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.909+0000 7fb9f2ffd640 1 -- 172.21.15.70:0/3087283678 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f400ae20 con 0x7fb9fc103fa0 2024-09-21T05:54:01.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.909+0000 7fb9f2ffd640 1 -- 172.21.15.70:0/3087283678 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fb9f4005020 con 0x7fb9fc103fa0 2024-09-21T05:54:01.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.909+0000 7fba03c7e640 1 -- 172.21.15.70:0/3087283678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9fc19aaf0 con 0x7fb9fc103fa0 2024-09-21T05:54:01.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.909+0000 7fb9f2ffd640 1 -- 172.21.15.70:0/3087283678 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f400f6b0 con 0x7fb9fc103fa0 2024-09-21T05:54:01.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.909+0000 7fba03c7e640 1 -- 172.21.15.70:0/3087283678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9fc1a11e0 con 0x7fb9fc103fa0 2024-09-21T05:54:01.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.910+0000 7fba03c7e640 1 -- 172.21.15.70:0/3087283678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9fc109730 con 0x7fb9fc103fa0 2024-09-21T05:54:01.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.911+0000 7fb9f2ffd640 1 -- 172.21.15.70:0/3087283678 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7fb9f4005580 con 0x7fb9fc103fa0 2024-09-21T05:54:01.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.912+0000 7fb9f2ffd640 1 --2- 172.21.15.70:0/3087283678 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb9e80b6590 0x7fb9e80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:01.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.912+0000 7fba01a1a640 1 --2- 172.21.15.70:0/3087283678 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb9e80b6590 0x7fb9e80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:01.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.912+0000 7fb9f2ffd640 1 -- 172.21.15.70:0/3087283678 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fb9f40e77d0 con 0x7fb9fc103fa0 2024-09-21T05:54:01.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.913+0000 7fba01a1a640 1 --2- 172.21.15.70:0/3087283678 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb9e80b6590 0x7fb9e80b8aa0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb9f80058c0 tx=0x7fb9f800a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:01.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:01.917+0000 7fb9f2ffd640 1 -- 172.21.15.70:0/3087283678 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb9f4014030 con 0x7fb9fc103fa0 2024-09-21T05:54:02.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:01 smithi116 ceph-mon[34332]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:54:02.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:01 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3199560007' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:54:02.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.092+0000 7fba03c7e640 1 -- 172.21.15.70:0/3087283678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb9fc063fc0 con 0x7fb9fc103fa0 2024-09-21T05:54:02.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.093+0000 7fb9f2ffd640 1 -- 172.21.15.70:0/3087283678 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) ==== 104+0+11 (secure 0 0 0) 0x7fb9f40adc70 con 0x7fb9fc103fa0 2024-09-21T05:54:02.095 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2024-09-21T05:54:02.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.095+0000 7fba03c7e640 1 -- 172.21.15.70:0/3087283678 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb9e80b6590 msgr2=0x7fb9e80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:02.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.095+0000 7fba03c7e640 1 --2- 172.21.15.70:0/3087283678 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb9e80b6590 0x7fb9e80b8aa0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb9f80058c0 tx=0x7fb9f800a4c0 comp rx=0 tx=0).stop 2024-09-21T05:54:02.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.095+0000 7fba03c7e640 1 -- 172.21.15.70:0/3087283678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9fc103fa0 msgr2=0x7fb9fc199fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:02.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.095+0000 7fba03c7e640 1 --2- 172.21.15.70:0/3087283678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9fc103fa0 0x7fb9fc199fe0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb9f400cad0 tx=0x7fb9f400cf90 comp rx=0 tx=0).stop 2024-09-21T05:54:02.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.095+0000 7fba03c7e640 1 -- 172.21.15.70:0/3087283678 shutdown_connections 2024-09-21T05:54:02.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.095+0000 7fba03c7e640 1 --2- 172.21.15.70:0/3087283678 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb9e80b6590 0x7fb9e80b8aa0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:02.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.095+0000 7fba03c7e640 1 --2- 172.21.15.70:0/3087283678 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9fc103600 0x7fb9fc199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:02.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.095+0000 7fba03c7e640 1 --2- 172.21.15.70:0/3087283678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9fc103fa0 0x7fb9fc199fe0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:02.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.095+0000 7fba03c7e640 1 --2- 172.21.15.70:0/3087283678 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9fc102580 0x7fb9fc198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:02.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.095+0000 7fba03c7e640 1 -- 172.21.15.70:0/3087283678 >> 172.21.15.70:0/3087283678 conn(0x7fb9fc0fdee0 msgr2=0x7fb9fc106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:02.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.095+0000 7fba03c7e640 1 -- 172.21.15.70:0/3087283678 shutdown_connections 2024-09-21T05:54:02.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.095+0000 7fba03c7e640 1 -- 172.21.15.70:0/3087283678 wait complete. 2024-09-21T05:54:02.108 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T05:54:02.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:01 smithi160 ceph-mon[33979]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T05:54:02.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:01 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3199560007' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:54:02.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.218+0000 7f148f8de640 1 -- 172.21.15.70:0/3322329617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14881056b0 msgr2=0x7f1488107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:02.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.218+0000 7f148f8de640 1 --2- 172.21.15.70:0/3322329617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14881056b0 0x7f1488107b90 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f147c009900 tx=0x7f147c02a410 comp rx=0 tx=0).stop 2024-09-21T05:54:02.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.218+0000 7f148f8de640 1 -- 172.21.15.70:0/3322329617 shutdown_connections 2024-09-21T05:54:02.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.218+0000 7f148f8de640 1 --2- 172.21.15.70:0/3322329617 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14881082d0 0x7f148810a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:02.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.218+0000 7f148f8de640 1 --2- 172.21.15.70:0/3322329617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14881056b0 0x7f1488107b90 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:02.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.218+0000 7f148f8de640 1 --2- 172.21.15.70:0/3322329617 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1488102c50 0x7f1488105070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:02.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.218+0000 7f148f8de640 1 -- 172.21.15.70:0/3322329617 >> 172.21.15.70:0/3322329617 conn(0x7f14880fd660 msgr2=0x7f14880ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:02.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.218+0000 7f148f8de640 1 -- 172.21.15.70:0/3322329617 shutdown_connections 2024-09-21T05:54:02.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.218+0000 7f148f8de640 1 -- 172.21.15.70:0/3322329617 wait complete. 2024-09-21T05:54:02.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.218+0000 7f148f8de640 1 Processor -- start 2024-09-21T05:54:02.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.219+0000 7f148f8de640 1 -- start start 2024-09-21T05:54:02.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.219+0000 7f148f8de640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1488102c50 0x7f1488102150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:02.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.219+0000 7f148f8de640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14881056b0 0x7f148819ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:02.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.219+0000 7f148f8de640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14881082d0 0x7f14881a1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:02.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.219+0000 7f148f8de640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f148810e1c0 con 0x7f14881082d0 2024-09-21T05:54:02.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.219+0000 7f148f8de640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f148810e040 con 0x7f14881056b0 2024-09-21T05:54:02.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.219+0000 7f148f8de640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f148810e340 con 0x7f1488102c50 2024-09-21T05:54:02.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.219+0000 7f148de7b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14881082d0 0x7f14881a1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:02.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.219+0000 7f148de7b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14881082d0 0x7f14881a1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52908/0 (socket says 172.21.15.70:52908) 2024-09-21T05:54:02.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.219+0000 7f148de7b640 1 -- 172.21.15.70:0/386924375 learned_addr learned my addr 172.21.15.70:0/386924375 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:54:02.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.219+0000 7f148d67a640 1 --2- 172.21.15.70:0/386924375 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1488102c50 0x7f1488102150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:02.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.219+0000 7f148ce79640 1 --2- 172.21.15.70:0/386924375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14881056b0 0x7f148819ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:02.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.219+0000 7f148de7b640 1 -- 172.21.15.70:0/386924375 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1488102c50 msgr2=0x7f1488102150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:02.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.219+0000 7f148de7b640 1 --2- 172.21.15.70:0/386924375 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1488102c50 0x7f1488102150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:02.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.219+0000 7f148de7b640 1 -- 172.21.15.70:0/386924375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14881056b0 msgr2=0x7f148819ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:02.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.219+0000 7f148de7b640 1 --2- 172.21.15.70:0/386924375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14881056b0 0x7f148819ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:02.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.219+0000 7f148de7b640 1 -- 172.21.15.70:0/386924375 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14881a19a0 con 0x7f14881082d0 2024-09-21T05:54:02.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.219+0000 7f148d67a640 1 --2- 172.21.15.70:0/386924375 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1488102c50 0x7f1488102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:54:02.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.219+0000 7f148de7b640 1 --2- 172.21.15.70:0/386924375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14881082d0 0x7f14881a1210 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f148000eaa0 tx=0x7f148000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:02.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.219+0000 7f14867fc640 1 -- 172.21.15.70:0/386924375 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148000cdb0 con 0x7f14881082d0 2024-09-21T05:54:02.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.220+0000 7f14867fc640 1 -- 172.21.15.70:0/386924375 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f1480005020 con 0x7f14881082d0 2024-09-21T05:54:02.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.220+0000 7f148f8de640 1 -- 172.21.15.70:0/386924375 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14881a1c90 con 0x7f14881082d0 2024-09-21T05:54:02.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.220+0000 7f14867fc640 1 -- 172.21.15.70:0/386924375 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14800116d0 con 0x7f14881082d0 2024-09-21T05:54:02.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.220+0000 7f148f8de640 1 -- 172.21.15.70:0/386924375 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14881a2180 con 0x7f14881082d0 2024-09-21T05:54:02.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.220+0000 7f148f8de640 1 -- 172.21.15.70:0/386924375 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14880ff180 con 0x7f14881082d0 2024-09-21T05:54:02.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.222+0000 7f14867fc640 1 -- 172.21.15.70:0/386924375 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f1480005580 con 0x7f14881082d0 2024-09-21T05:54:02.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.223+0000 7f14867fc640 1 --2- 172.21.15.70:0/386924375 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f14700b6590 0x7f14700b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:02.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.223+0000 7f148d67a640 1 --2- 172.21.15.70:0/386924375 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f14700b6590 0x7f14700b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:02.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.223+0000 7f14867fc640 1 -- 172.21.15.70:0/386924375 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f14800e7c90 con 0x7f14881082d0 2024-09-21T05:54:02.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.223+0000 7f148d67a640 1 --2- 172.21.15.70:0/386924375 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f14700b6590 0x7f14700b8aa0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f147800abe0 tx=0x7f147800a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:02.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.226+0000 7f14867fc640 1 -- 172.21.15.70:0/386924375 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1480016030 con 0x7f14881082d0 2024-09-21T05:54:02.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.403+0000 7f148f8de640 1 -- 172.21.15.70:0/386924375 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1488064060 con 0x7f14881082d0 2024-09-21T05:54:02.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.404+0000 7f14867fc640 1 -- 172.21.15.70:0/386924375 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) ==== 100+0+11 (secure 0 0 0) 0x7f14800a9030 con 0x7f14881082d0 2024-09-21T05:54:02.406 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2024-09-21T05:54:02.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.406+0000 7f148f8de640 1 -- 172.21.15.70:0/386924375 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f14700b6590 msgr2=0x7f14700b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:02.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.406+0000 7f148f8de640 1 --2- 172.21.15.70:0/386924375 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f14700b6590 0x7f14700b8aa0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f147800abe0 tx=0x7f147800a5c0 comp rx=0 tx=0).stop 2024-09-21T05:54:02.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.406+0000 7f148f8de640 1 -- 172.21.15.70:0/386924375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14881082d0 msgr2=0x7f14881a1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:02.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.406+0000 7f148f8de640 1 --2- 172.21.15.70:0/386924375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14881082d0 0x7f14881a1210 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f148000eaa0 tx=0x7f148000ef60 comp rx=0 tx=0).stop 2024-09-21T05:54:02.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.406+0000 7f148f8de640 1 -- 172.21.15.70:0/386924375 shutdown_connections 2024-09-21T05:54:02.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.406+0000 7f148f8de640 1 --2- 172.21.15.70:0/386924375 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f14700b6590 0x7f14700b8aa0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:02.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.406+0000 7f148f8de640 1 --2- 172.21.15.70:0/386924375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14881082d0 0x7f14881a1210 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:02.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.406+0000 7f148f8de640 1 --2- 172.21.15.70:0/386924375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14881056b0 0x7f148819ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:02.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.406+0000 7f148f8de640 1 --2- 172.21.15.70:0/386924375 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1488102c50 0x7f1488102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:02.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.406+0000 7f148f8de640 1 -- 172.21.15.70:0/386924375 >> 172.21.15.70:0/386924375 conn(0x7f14880fd660 msgr2=0x7f1488103b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:02.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.406+0000 7f148f8de640 1 -- 172.21.15.70:0/386924375 shutdown_connections 2024-09-21T05:54:02.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.406+0000 7f148f8de640 1 -- 172.21.15.70:0/386924375 wait complete. 2024-09-21T05:54:02.420 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-21T05:54:02.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.530+0000 7fdd05513640 1 -- 172.21.15.70:0/1317717175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdd00104090 msgr2=0x7fdd0010ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:02.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.530+0000 7fdd05513640 1 --2- 172.21.15.70:0/1317717175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdd00104090 0x7fdd0010ab20 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8009900 tx=0x7fdcf802a410 comp rx=0 tx=0).stop 2024-09-21T05:54:02.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.530+0000 7fdd05513640 1 -- 172.21.15.70:0/1317717175 shutdown_connections 2024-09-21T05:54:02.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.530+0000 7fdd05513640 1 --2- 172.21.15.70:0/1317717175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdd00104090 0x7fdd0010ab20 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:02.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.530+0000 7fdd05513640 1 --2- 172.21.15.70:0/1317717175 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd00103480 0x7fdd00103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:02.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.530+0000 7fdd05513640 1 --2- 172.21.15.70:0/1317717175 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd00102aa0 0x7fdd00102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:02.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.530+0000 7fdd05513640 1 -- 172.21.15.70:0/1317717175 >> 172.21.15.70:0/1317717175 conn(0x7fdd000fd690 msgr2=0x7fdd000ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:02.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.530+0000 7fdd05513640 1 -- 172.21.15.70:0/1317717175 shutdown_connections 2024-09-21T05:54:02.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.530+0000 7fdd05513640 1 -- 172.21.15.70:0/1317717175 wait complete. 2024-09-21T05:54:02.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.530+0000 7fdd05513640 1 Processor -- start 2024-09-21T05:54:02.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.531+0000 7fdd05513640 1 -- start start 2024-09-21T05:54:02.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.531+0000 7fdd05513640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd00102aa0 0x7fdd00102000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:02.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.531+0000 7fdd05513640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd00103480 0x7fdd0019ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:02.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.531+0000 7fdd05513640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdd00104090 0x7fdd001a1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:02.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.531+0000 7fdd05513640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0010e1d0 con 0x7fdd00104090 2024-09-21T05:54:02.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.531+0000 7fdd05513640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0010e050 con 0x7fdd00102aa0 2024-09-21T05:54:02.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.531+0000 7fdd05513640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0010e350 con 0x7fdd00103480 2024-09-21T05:54:02.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.531+0000 7fdcff7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdd00104090 0x7fdd001a1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:02.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.531+0000 7fdcff7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdd00104090 0x7fdd001a1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52920/0 (socket says 172.21.15.70:52920) 2024-09-21T05:54:02.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.531+0000 7fdcff7fe640 1 -- 172.21.15.70:0/4187128101 learned_addr learned my addr 172.21.15.70:0/4187128101 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:54:02.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.531+0000 7fdcfe7fc640 1 --2- 172.21.15.70:0/4187128101 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd00103480 0x7fdd0019ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:02.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.531+0000 7fdcfeffd640 1 --2- 172.21.15.70:0/4187128101 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd00102aa0 0x7fdd00102000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:02.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.531+0000 7fdcff7fe640 1 -- 172.21.15.70:0/4187128101 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd00103480 msgr2=0x7fdd0019ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:02.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.531+0000 7fdcff7fe640 1 --2- 172.21.15.70:0/4187128101 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd00103480 0x7fdd0019ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:02.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.531+0000 7fdcff7fe640 1 -- 172.21.15.70:0/4187128101 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd00102aa0 msgr2=0x7fdd00102000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:02.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.531+0000 7fdcff7fe640 1 --2- 172.21.15.70:0/4187128101 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd00102aa0 0x7fdd00102000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:02.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.531+0000 7fdcff7fe640 1 -- 172.21.15.70:0/4187128101 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd001a1890 con 0x7fdd00104090 2024-09-21T05:54:02.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.531+0000 7fdcff7fe640 1 --2- 172.21.15.70:0/4187128101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdd00104090 0x7fdd001a1120 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8005940 tx=0x7fdcf80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:02.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.532+0000 7fdcf7fff640 1 -- 172.21.15.70:0/4187128101 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf803f030 con 0x7fdd00104090 2024-09-21T05:54:02.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.532+0000 7fdd05513640 1 -- 172.21.15.70:0/4187128101 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd001a1b20 con 0x7fdd00104090 2024-09-21T05:54:02.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.532+0000 7fdcf7fff640 1 -- 172.21.15.70:0/4187128101 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fdcf8003cb0 con 0x7fdd00104090 2024-09-21T05:54:02.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.532+0000 7fdcf7fff640 1 -- 172.21.15.70:0/4187128101 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf8035070 con 0x7fdd00104090 2024-09-21T05:54:02.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.532+0000 7fdd05513640 1 -- 172.21.15.70:0/4187128101 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd001a2010 con 0x7fdd00104090 2024-09-21T05:54:02.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.533+0000 7fdd05513640 1 -- 172.21.15.70:0/4187128101 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd00109930 con 0x7fdd00104090 2024-09-21T05:54:02.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.534+0000 7fdcf7fff640 1 -- 172.21.15.70:0/4187128101 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7fdcf8042030 con 0x7fdd00104090 2024-09-21T05:54:02.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.535+0000 7fdcf7fff640 1 --2- 172.21.15.70:0/4187128101 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdcec0b6510 0x7fdcec0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:02.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.535+0000 7fdcfeffd640 1 --2- 172.21.15.70:0/4187128101 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdcec0b6510 0x7fdcec0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:02.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.535+0000 7fdcf7fff640 1 -- 172.21.15.70:0/4187128101 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fdcf8108190 con 0x7fdd00104090 2024-09-21T05:54:02.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.535+0000 7fdcfeffd640 1 --2- 172.21.15.70:0/4187128101 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdcec0b6510 0x7fdcec0b8a20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0005fd0 tx=0x7fdcf0009870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:02.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.538+0000 7fdcf7fff640 1 -- 172.21.15.70:0/4187128101 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdcf80ce630 con 0x7fdd00104090 2024-09-21T05:54:02.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.717+0000 7fdd05513640 1 -- 172.21.15.70:0/4187128101 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fdd0002e890 con 0x7fdd00104090 2024-09-21T05:54:02.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.718+0000 7fdcf7fff640 1 -- 172.21.15.70:0/4187128101 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v85) ==== 103+0+11 (secure 0 0 0) 0x7fdcf80d2a10 con 0x7fdd00104090 2024-09-21T05:54:02.720 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2024-09-21T05:54:02.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.720+0000 7fdd05513640 1 -- 172.21.15.70:0/4187128101 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdcec0b6510 msgr2=0x7fdcec0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:02.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.720+0000 7fdd05513640 1 --2- 172.21.15.70:0/4187128101 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdcec0b6510 0x7fdcec0b8a20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0005fd0 tx=0x7fdcf0009870 comp rx=0 tx=0).stop 2024-09-21T05:54:02.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.720+0000 7fdd05513640 1 -- 172.21.15.70:0/4187128101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdd00104090 msgr2=0x7fdd001a1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:02.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.720+0000 7fdd05513640 1 --2- 172.21.15.70:0/4187128101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdd00104090 0x7fdd001a1120 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8005940 tx=0x7fdcf80042f0 comp rx=0 tx=0).stop 2024-09-21T05:54:02.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.720+0000 7fdd05513640 1 -- 172.21.15.70:0/4187128101 shutdown_connections 2024-09-21T05:54:02.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.720+0000 7fdd05513640 1 --2- 172.21.15.70:0/4187128101 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fdcec0b6510 0x7fdcec0b8a20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:02.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.720+0000 7fdd05513640 1 --2- 172.21.15.70:0/4187128101 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd00103480 0x7fdd0019ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:02.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.720+0000 7fdd05513640 1 --2- 172.21.15.70:0/4187128101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdd00104090 0x7fdd001a1120 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:02.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.720+0000 7fdd05513640 1 --2- 172.21.15.70:0/4187128101 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd00102aa0 0x7fdd00102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:02.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.720+0000 7fdd05513640 1 -- 172.21.15.70:0/4187128101 >> 172.21.15.70:0/4187128101 conn(0x7fdd000fd690 msgr2=0x7fdd00106b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:02.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.720+0000 7fdd05513640 1 -- 172.21.15.70:0/4187128101 shutdown_connections 2024-09-21T05:54:02.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.720+0000 7fdd05513640 1 -- 172.21.15.70:0/4187128101 wait complete. 2024-09-21T05:54:02.733 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:02 smithi070 ceph-mon[30981]: pgmap v507: 129 pgs: 129 active+clean; 99 MiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 776 KiB/s wr, 277 op/s 2024-09-21T05:54:02.733 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:02 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2516610953' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T05:54:02.733 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:02 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3087283678' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T05:54:02.733 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:02 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/386924375' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T05:54:02.734 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-21T05:54:02.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.840+0000 7f89c6b39640 1 -- 172.21.15.70:0/3898682300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89c0104740 msgr2=0x7f89c0104b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:02.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.840+0000 7f89c6b39640 1 --2- 172.21.15.70:0/3898682300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89c0104740 0x7f89c0104b50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f89ac009900 tx=0x7f89ac02a410 comp rx=0 tx=0).stop 2024-09-21T05:54:02.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.840+0000 7f89c6b39640 1 -- 172.21.15.70:0/3898682300 shutdown_connections 2024-09-21T05:54:02.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.840+0000 7f89c6b39640 1 --2- 172.21.15.70:0/3898682300 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89c01050e0 0x7f89c010ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:02.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.840+0000 7f89c6b39640 1 --2- 172.21.15.70:0/3898682300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89c0104740 0x7f89c0104b50 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:02.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.840+0000 7f89c6b39640 1 --2- 172.21.15.70:0/3898682300 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89c01036c0 0x7f89c0103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:02.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.840+0000 7f89c6b39640 1 -- 172.21.15.70:0/3898682300 >> 172.21.15.70:0/3898682300 conn(0x7f89c00ff000 msgr2=0x7f89c01014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:02.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.840+0000 7f89c6b39640 1 -- 172.21.15.70:0/3898682300 shutdown_connections 2024-09-21T05:54:02.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.840+0000 7f89c6b39640 1 -- 172.21.15.70:0/3898682300 wait complete. 2024-09-21T05:54:02.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.841+0000 7f89c6b39640 1 Processor -- start 2024-09-21T05:54:02.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.841+0000 7f89c6b39640 1 -- start start 2024-09-21T05:54:02.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.841+0000 7f89c6b39640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89c01036c0 0x7f89c0199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:02.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.841+0000 7f89c6b39640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89c0104740 0x7f89c019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:02.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.841+0000 7f89c6b39640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89c01050e0 0x7f89c019b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:02.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.841+0000 7f89c6b39640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f89c010f310 con 0x7f89c01036c0 2024-09-21T05:54:02.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.841+0000 7f89c6b39640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f89c010f190 con 0x7f89c0104740 2024-09-21T05:54:02.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.841+0000 7f89c6b39640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f89c010f490 con 0x7f89c01050e0 2024-09-21T05:54:02.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.841+0000 7f89c48d5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89c01036c0 0x7f89c0199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:02.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.841+0000 7f89c48d5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89c01036c0 0x7f89c0199f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52932/0 (socket says 172.21.15.70:52932) 2024-09-21T05:54:02.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.841+0000 7f89c48d5640 1 -- 172.21.15.70:0/3842602631 learned_addr learned my addr 172.21.15.70:0/3842602631 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:54:02.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.841+0000 7f89bffff640 1 --2- 172.21.15.70:0/3842602631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89c0104740 0x7f89c019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:02.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.841+0000 7f89c50d6640 1 --2- 172.21.15.70:0/3842602631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89c01050e0 0x7f89c019b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:02.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.842+0000 7f89c48d5640 1 -- 172.21.15.70:0/3842602631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89c01050e0 msgr2=0x7f89c019b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:02.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.842+0000 7f89c48d5640 1 --2- 172.21.15.70:0/3842602631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89c01050e0 0x7f89c019b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:02.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.842+0000 7f89c48d5640 1 -- 172.21.15.70:0/3842602631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89c0104740 msgr2=0x7f89c019a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:02.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.842+0000 7f89c48d5640 1 --2- 172.21.15.70:0/3842602631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89c0104740 0x7f89c019a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:02.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.842+0000 7f89c48d5640 1 -- 172.21.15.70:0/3842602631 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c019b920 con 0x7f89c01036c0 2024-09-21T05:54:02.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.842+0000 7f89c50d6640 1 --2- 172.21.15.70:0/3842602631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89c01050e0 0x7f89c019b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:54:02.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.842+0000 7f89c48d5640 1 --2- 172.21.15.70:0/3842602631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89c01036c0 0x7f89c0199f70 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f89b400c970 tx=0x7f89b400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:02.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.842+0000 7f89bdffb640 1 -- 172.21.15.70:0/3842602631 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b4007bb0 con 0x7f89c01036c0 2024-09-21T05:54:02.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.842+0000 7f89c6b39640 1 -- 172.21.15.70:0/3842602631 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89c019bc10 con 0x7f89c01036c0 2024-09-21T05:54:02.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.842+0000 7f89bdffb640 1 -- 172.21.15.70:0/3842602631 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f89b4007d50 con 0x7f89c01036c0 2024-09-21T05:54:02.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.842+0000 7f89bdffb640 1 -- 172.21.15.70:0/3842602631 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b400f450 con 0x7f89c01036c0 2024-09-21T05:54:02.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.842+0000 7f89c6b39640 1 -- 172.21.15.70:0/3842602631 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89c01a21b0 con 0x7f89c01036c0 2024-09-21T05:54:02.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.843+0000 7f89c6b39640 1 -- 172.21.15.70:0/3842602631 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89c010a890 con 0x7f89c01036c0 2024-09-21T05:54:02.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.845+0000 7f89bdffb640 1 -- 172.21.15.70:0/3842602631 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f89b40046c0 con 0x7f89c01036c0 2024-09-21T05:54:02.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.845+0000 7f89bdffb640 1 --2- 172.21.15.70:0/3842602631 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f89b00b6510 0x7f89b00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:02.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.845+0000 7f89bffff640 1 --2- 172.21.15.70:0/3842602631 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f89b00b6510 0x7f89b00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:02.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.846+0000 7f89bdffb640 1 -- 172.21.15.70:0/3842602631 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f89b40e73f0 con 0x7f89c01036c0 2024-09-21T05:54:02.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.846+0000 7f89bffff640 1 --2- 172.21.15.70:0/3842602631 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f89b00b6510 0x7f89b00b8a20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f89ac006010 tx=0x7f89ac000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:02.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:02.850+0000 7f89bdffb640 1 -- 172.21.15.70:0/3842602631 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f89b4014030 con 0x7f89c01036c0 2024-09-21T05:54:03.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:02 smithi116 ceph-mon[34332]: pgmap v507: 129 pgs: 129 active+clean; 99 MiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 776 KiB/s wr, 277 op/s 2024-09-21T05:54:03.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:02 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2516610953' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T05:54:03.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:02 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3087283678' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T05:54:03.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:02 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/386924375' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T05:54:03.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:03.074+0000 7f89c6b39640 1 -- 172.21.15.70:0/3842602631 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f89c0063fc0 con 0x7f89c01036c0 2024-09-21T05:54:03.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:03.082+0000 7f89bdffb640 1 -- 172.21.15.70:0/3842602631 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v20) ==== 81+0+833522 (secure 0 0 0) 0x7f89b40ad890 con 0x7f89c01036c0 2024-09-21T05:54:03.094 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:54:03.094 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:54:03.094 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 20, 2024-09-21T05:54:03.094 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.095 INFO:teuthology.orchestra.run.smithi070.stdout: "active_gid": 14150, 2024-09-21T05:54:03.095 INFO:teuthology.orchestra.run.smithi070.stdout: "active_name": "x", 2024-09-21T05:54:03.095 INFO:teuthology.orchestra.run.smithi070.stdout: "active_addrs": { 2024-09-21T05:54:03.095 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-21T05:54:03.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.095 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-21T05:54:03.095 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6800", 2024-09-21T05:54:03.095 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1366013939 2024-09-21T05:54:03.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.095 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-21T05:54:03.096 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6801", 2024-09-21T05:54:03.096 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1366013939 2024-09-21T05:54:03.096 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.096 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-21T05:54:03.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.096 INFO:teuthology.orchestra.run.smithi070.stdout: "active_addr": "172.21.15.70:6801/1366013939", 2024-09-21T05:54:03.096 INFO:teuthology.orchestra.run.smithi070.stdout: "active_change": "2024-09-21T05:39:37.296750+0000", 2024-09-21T05:54:03.096 INFO:teuthology.orchestra.run.smithi070.stdout: "active_mgr_features": 4540719139924082687, 2024-09-21T05:54:03.096 INFO:teuthology.orchestra.run.smithi070.stdout: "available": true, 2024-09-21T05:54:03.096 INFO:teuthology.orchestra.run.smithi070.stdout: "standbys": [ 2024-09-21T05:54:03.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.096 INFO:teuthology.orchestra.run.smithi070.stdout: "gid": 24124, 2024-09-21T05:54:03.096 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "z", 2024-09-21T05:54:03.097 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_features": 4540719139924082687, 2024-09-21T05:54:03.097 INFO:teuthology.orchestra.run.smithi070.stdout: "available_modules": [ 2024-09-21T05:54:03.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.097 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "alerts", 2024-09-21T05:54:03.097 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.097 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.097 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.097 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-21T05:54:03.097 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-21T05:54:03.097 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.097 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.097 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.097 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-21T05:54:03.097 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.098 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.098 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.098 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T05:54:03.098 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.098 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.098 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.098 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.098 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.098 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.098 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.098 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.098 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.098 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.099 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.099 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.099 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.099 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.099 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.099 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.099 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.099 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.099 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.099 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.099 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.099 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.099 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.100 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.100 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.100 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.100 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.100 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.100 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.100 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.100 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.100 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.100 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.100 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.100 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.100 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.100 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.101 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.101 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.101 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.101 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.101 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.101 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.101 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.101 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.101 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.101 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.101 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.101 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.101 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.101 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.101 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.102 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.102 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.102 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.102 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.102 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.102 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.102 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.102 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.102 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.102 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.102 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.102 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.102 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.103 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.103 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.103 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.103 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.103 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_destination": { 2024-09-21T05:54:03.103 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_destination", 2024-09-21T05:54:03.103 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.103 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.103 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.103 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.103 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.103 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.103 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.104 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T05:54:03.104 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.104 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.104 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.104 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_from_name": { 2024-09-21T05:54:03.104 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_from_name", 2024-09-21T05:54:03.104 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.104 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.104 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.104 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "Ceph", 2024-09-21T05:54:03.104 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.104 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.104 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.105 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email From: name", 2024-09-21T05:54:03.105 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.105 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.105 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.105 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_host": { 2024-09-21T05:54:03.105 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_host", 2024-09-21T05:54:03.105 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.105 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.105 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.105 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.105 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.105 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.105 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.106 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP server", 2024-09-21T05:54:03.106 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.106 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.106 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.106 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_password": { 2024-09-21T05:54:03.106 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_password", 2024-09-21T05:54:03.106 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.106 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.106 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.106 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.106 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.107 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.107 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.107 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Password to authenticate with", 2024-09-21T05:54:03.107 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.107 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.107 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.107 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_port": { 2024-09-21T05:54:03.107 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_port", 2024-09-21T05:54:03.107 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.107 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.107 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.107 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "465", 2024-09-21T05:54:03.108 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.108 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.108 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.108 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP port", 2024-09-21T05:54:03.108 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.108 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.108 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.108 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_sender": { 2024-09-21T05:54:03.108 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_sender", 2024-09-21T05:54:03.108 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.108 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.108 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.108 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.108 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.109 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.109 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.109 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP envelope sender", 2024-09-21T05:54:03.109 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.109 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.109 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.109 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_ssl": { 2024-09-21T05:54:03.109 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_ssl", 2024-09-21T05:54:03.109 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.109 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.109 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.109 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.110 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.110 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.110 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.110 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T05:54:03.110 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.110 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.110 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.110 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_user": { 2024-09-21T05:54:03.110 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_user", 2024-09-21T05:54:03.110 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.110 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.110 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.110 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.110 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.111 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.111 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.111 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "User to authenticate as", 2024-09-21T05:54:03.111 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.111 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.111 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.111 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.111 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.111 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.111 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.111 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.111 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.111 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.111 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.112 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.112 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.112 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.112 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.112 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.112 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.112 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.112 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "balancer", 2024-09-21T05:54:03.112 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.112 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.112 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.112 INFO:teuthology.orchestra.run.smithi070.stdout: "active": { 2024-09-21T05:54:03.112 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "active", 2024-09-21T05:54:03.113 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.113 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.113 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.113 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.113 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.113 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.113 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.113 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T05:54:03.113 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.113 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.113 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.113 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_time": { 2024-09-21T05:54:03.114 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_time", 2024-09-21T05:54:03.114 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.114 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.114 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.114 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0000", 2024-09-21T05:54:03.114 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.114 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.114 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.114 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T05:54:03.114 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T05:54:03.114 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.114 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.114 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_weekday": { 2024-09-21T05:54:03.115 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_weekday", 2024-09-21T05:54:03.115 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-21T05:54:03.115 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.115 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.115 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.115 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2024-09-21T05:54:03.115 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2024-09-21T05:54:03.115 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.115 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T05:54:03.115 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T05:54:03.115 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.115 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.115 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_max_iterations": { 2024-09-21T05:54:03.115 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_max_iterations", 2024-09-21T05:54:03.116 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-21T05:54:03.116 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.116 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.116 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "25", 2024-09-21T05:54:03.116 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-21T05:54:03.116 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "250", 2024-09-21T05:54:03.116 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.116 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T05:54:03.116 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.116 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.116 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.116 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_metrics": { 2024-09-21T05:54:03.116 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_metrics", 2024-09-21T05:54:03.116 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.117 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.117 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.117 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T05:54:03.117 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.117 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.117 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.117 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T05:54:03.117 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T05:54:03.117 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.117 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.117 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_step": { 2024-09-21T05:54:03.117 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_step", 2024-09-21T05:54:03.117 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-21T05:54:03.117 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.118 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.118 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.5", 2024-09-21T05:54:03.118 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0.001", 2024-09-21T05:54:03.118 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "0.999", 2024-09-21T05:54:03.118 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.118 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "aggressiveness of optimization", 2024-09-21T05:54:03.118 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T05:54:03.118 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.118 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.118 INFO:teuthology.orchestra.run.smithi070.stdout: "end_time": { 2024-09-21T05:54:03.118 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_time", 2024-09-21T05:54:03.118 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.118 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.118 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.119 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2359", 2024-09-21T05:54:03.119 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.119 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.119 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.119 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T05:54:03.119 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T05:54:03.119 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.119 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.119 INFO:teuthology.orchestra.run.smithi070.stdout: "end_weekday": { 2024-09-21T05:54:03.119 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_weekday", 2024-09-21T05:54:03.119 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-21T05:54:03.119 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.119 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.119 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.119 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2024-09-21T05:54:03.120 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2024-09-21T05:54:03.120 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.120 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T05:54:03.120 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T05:54:03.120 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.120 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.120 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.120 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.120 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.120 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.120 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.120 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.120 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.121 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.121 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.121 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.121 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.121 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.121 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.121 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.121 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.121 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.121 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.121 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.122 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.122 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.122 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.122 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.122 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.122 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.122 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.122 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.122 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.122 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.122 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.122 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.122 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.123 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.123 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.123 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.123 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.123 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.123 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.123 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.123 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.123 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.123 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.123 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.123 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.123 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.123 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.124 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.124 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.124 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.124 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.124 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.124 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.124 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.124 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.124 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.124 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.124 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.124 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.124 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.124 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.125 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.125 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.125 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.125 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.125 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.125 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.125 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.125 INFO:teuthology.orchestra.run.smithi070.stdout: "min_score": { 2024-09-21T05:54:03.125 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_score", 2024-09-21T05:54:03.125 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-21T05:54:03.125 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.125 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.125 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.125 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.125 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.126 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.126 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T05:54:03.126 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.126 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.126 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.126 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2024-09-21T05:54:03.126 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2024-09-21T05:54:03.126 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.126 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.126 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.126 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "upmap", 2024-09-21T05:54:03.126 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.126 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.127 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.127 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-compat", 2024-09-21T05:54:03.127 INFO:teuthology.orchestra.run.smithi070.stdout: "none", 2024-09-21T05:54:03.127 INFO:teuthology.orchestra.run.smithi070.stdout: "read", 2024-09-21T05:54:03.127 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap", 2024-09-21T05:54:03.127 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap-read" 2024-09-21T05:54:03.127 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.127 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Balancer mode", 2024-09-21T05:54:03.127 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.127 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.127 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.127 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_ids": { 2024-09-21T05:54:03.127 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_ids", 2024-09-21T05:54:03.127 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.127 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.128 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.128 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.128 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.128 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.128 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.128 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T05:54:03.128 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.128 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.128 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.128 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-21T05:54:03.128 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-21T05:54:03.128 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.128 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.128 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.128 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-21T05:54:03.129 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.129 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.129 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.129 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T05:54:03.129 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.129 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.129 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.129 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.129 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.129 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.129 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.129 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.129 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.129 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.130 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.130 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.130 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.130 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.130 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.130 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.130 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_deviation": { 2024-09-21T05:54:03.130 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_deviation", 2024-09-21T05:54:03.130 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.130 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.130 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.130 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-21T05:54:03.130 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-21T05:54:03.130 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.131 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.131 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T05:54:03.131 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T05:54:03.131 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.131 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.131 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_optimizations": { 2024-09-21T05:54:03.131 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_optimizations", 2024-09-21T05:54:03.131 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-21T05:54:03.131 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.131 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.131 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-21T05:54:03.131 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.131 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.131 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.132 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T05:54:03.132 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.132 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.132 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.132 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.132 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.132 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm", 2024-09-21T05:54:03.132 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.132 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.132 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.132 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_down_multiplier": { 2024-09-21T05:54:03.132 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_down_multiplier", 2024-09-21T05:54:03.132 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-21T05:54:03.133 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.133 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.133 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2024-09-21T05:54:03.133 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.133 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.133 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.133 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T05:54:03.133 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.133 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.133 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.133 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_refresh_rate": { 2024-09-21T05:54:03.133 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_refresh_rate", 2024-09-21T05:54:03.133 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.133 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.134 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.134 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "20", 2024-09-21T05:54:03.134 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.134 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.134 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.134 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T05:54:03.134 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.134 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.134 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.134 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_starting_port": { 2024-09-21T05:54:03.134 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_starting_port", 2024-09-21T05:54:03.134 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.134 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.135 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.135 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4721", 2024-09-21T05:54:03.135 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.135 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.135 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.135 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T05:54:03.135 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.135 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.135 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.135 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_ptrace": { 2024-09-21T05:54:03.135 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_ptrace", 2024-09-21T05:54:03.135 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.135 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.135 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.136 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.136 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.136 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.136 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.136 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T05:54:03.136 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T05:54:03.136 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.136 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.136 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_interval": { 2024-09-21T05:54:03.136 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_interval", 2024-09-21T05:54:03.136 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.136 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.136 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.137 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-21T05:54:03.137 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.137 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.137 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.137 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T05:54:03.137 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.137 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.137 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.137 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_memory_target_ratio": { 2024-09-21T05:54:03.137 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T05:54:03.137 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-21T05:54:03.137 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.137 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.137 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.7", 2024-09-21T05:54:03.138 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.138 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.138 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.138 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T05:54:03.138 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.138 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.138 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.138 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm_log_destination": { 2024-09-21T05:54:03.138 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm_log_destination", 2024-09-21T05:54:03.138 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.138 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.138 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.138 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.139 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.139 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.139 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.139 INFO:teuthology.orchestra.run.smithi070.stdout: "file", 2024-09-21T05:54:03.139 INFO:teuthology.orchestra.run.smithi070.stdout: "file,syslog", 2024-09-21T05:54:03.139 INFO:teuthology.orchestra.run.smithi070.stdout: "syslog" 2024-09-21T05:54:03.139 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.139 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T05:54:03.139 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.139 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.139 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.140 INFO:teuthology.orchestra.run.smithi070.stdout: "cgroups_split": { 2024-09-21T05:54:03.140 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cgroups_split", 2024-09-21T05:54:03.140 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.140 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.140 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.140 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.140 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.140 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.140 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.140 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T05:54:03.140 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.140 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.140 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.140 INFO:teuthology.orchestra.run.smithi070.stdout: "config_checks_enabled": { 2024-09-21T05:54:03.141 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_checks_enabled", 2024-09-21T05:54:03.141 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.141 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.141 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.141 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.141 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.141 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.141 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.141 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T05:54:03.141 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.141 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.141 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.141 INFO:teuthology.orchestra.run.smithi070.stdout: "config_dashboard": { 2024-09-21T05:54:03.142 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_dashboard", 2024-09-21T05:54:03.142 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.142 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.142 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.142 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.142 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.142 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.142 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.142 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T05:54:03.142 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.142 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.142 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.142 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_alertmanager": { 2024-09-21T05:54:03.143 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_alertmanager", 2024-09-21T05:54:03.143 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.143 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.143 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.143 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T05:54:03.143 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.143 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.143 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.143 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-21T05:54:03.143 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.143 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.143 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.143 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_base": { 2024-09-21T05:54:03.143 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_base", 2024-09-21T05:54:03.144 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.144 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.144 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.144 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T05:54:03.144 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.144 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.144 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.144 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Container image name, without the tag", 2024-09-21T05:54:03.144 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.144 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.144 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.144 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_elasticsearch": { 2024-09-21T05:54:03.144 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_elasticsearch", 2024-09-21T05:54:03.144 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.144 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.145 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.145 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T05:54:03.145 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.145 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.145 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.145 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "elasticsearch container image", 2024-09-21T05:54:03.145 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.145 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.145 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.145 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_grafana": { 2024-09-21T05:54:03.145 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_grafana", 2024-09-21T05:54:03.145 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.146 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.146 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.146 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T05:54:03.146 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.146 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.146 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.146 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-21T05:54:03.146 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.146 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.146 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.146 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_haproxy": { 2024-09-21T05:54:03.146 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_haproxy", 2024-09-21T05:54:03.146 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.146 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.147 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.147 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T05:54:03.147 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.147 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.147 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.147 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "HAproxy container image", 2024-09-21T05:54:03.147 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.147 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.147 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.147 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_agent": { 2024-09-21T05:54:03.147 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_agent", 2024-09-21T05:54:03.147 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.147 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.147 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.148 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T05:54:03.148 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.148 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.148 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.148 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger agent container image", 2024-09-21T05:54:03.148 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.148 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.148 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.148 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_collector": { 2024-09-21T05:54:03.148 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_collector", 2024-09-21T05:54:03.148 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.148 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.148 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.148 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T05:54:03.149 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.149 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.149 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.149 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger collector container image", 2024-09-21T05:54:03.149 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.149 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.149 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.149 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_query": { 2024-09-21T05:54:03.149 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_query", 2024-09-21T05:54:03.149 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.149 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.149 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.149 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T05:54:03.149 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.149 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.150 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.150 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger query container image", 2024-09-21T05:54:03.150 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.150 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.150 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.150 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_keepalived": { 2024-09-21T05:54:03.150 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_keepalived", 2024-09-21T05:54:03.150 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.150 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.150 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.150 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T05:54:03.150 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.150 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.150 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.151 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Keepalived container image", 2024-09-21T05:54:03.151 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.151 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.151 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.151 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_loki": { 2024-09-21T05:54:03.151 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_loki", 2024-09-21T05:54:03.151 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.151 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.151 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.151 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T05:54:03.151 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.151 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.151 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.151 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Loki container image", 2024-09-21T05:54:03.152 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.152 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.152 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.152 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_nginx": { 2024-09-21T05:54:03.152 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_nginx", 2024-09-21T05:54:03.152 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.152 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.152 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.152 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T05:54:03.152 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.152 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.152 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.152 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Nginx container image", 2024-09-21T05:54:03.152 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.153 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.153 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.153 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_node_exporter": { 2024-09-21T05:54:03.153 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_node_exporter", 2024-09-21T05:54:03.153 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.153 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.153 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.153 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T05:54:03.153 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.153 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.153 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.153 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-21T05:54:03.153 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.153 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.153 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.154 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_nvmeof": { 2024-09-21T05:54:03.154 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_nvmeof", 2024-09-21T05:54:03.154 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.154 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.154 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.154 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T05:54:03.154 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.154 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.154 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.154 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Nvme-of container image", 2024-09-21T05:54:03.154 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.154 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.154 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.155 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_oauth2_proxy": { 2024-09-21T05:54:03.155 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T05:54:03.155 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.155 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.155 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.155 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T05:54:03.155 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.155 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.155 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.155 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "oauth2-proxy container image", 2024-09-21T05:54:03.155 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.155 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.155 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.156 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_prometheus": { 2024-09-21T05:54:03.156 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_prometheus", 2024-09-21T05:54:03.156 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.156 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.156 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.156 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T05:54:03.156 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.156 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.156 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.156 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-21T05:54:03.156 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.156 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.156 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.157 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_promtail": { 2024-09-21T05:54:03.157 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_promtail", 2024-09-21T05:54:03.157 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.157 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.157 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.157 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T05:54:03.157 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.157 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.157 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.157 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Promtail container image", 2024-09-21T05:54:03.157 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.157 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.157 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.157 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_samba": { 2024-09-21T05:54:03.158 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_samba", 2024-09-21T05:54:03.158 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.158 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.158 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.158 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T05:54:03.158 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.158 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.158 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.158 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Samba/SMB container image", 2024-09-21T05:54:03.158 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.158 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.158 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.158 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_samba_metrics": { 2024-09-21T05:54:03.158 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_samba_metrics", 2024-09-21T05:54:03.159 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.159 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.159 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.159 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T05:54:03.159 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.159 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.159 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.159 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T05:54:03.159 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.159 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.159 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.159 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_snmp_gateway": { 2024-09-21T05:54:03.159 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_snmp_gateway", 2024-09-21T05:54:03.160 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.160 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.160 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.160 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T05:54:03.160 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.160 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.160 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.160 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SNMP Gateway container image", 2024-09-21T05:54:03.160 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.160 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.160 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.160 INFO:teuthology.orchestra.run.smithi070.stdout: "container_init": { 2024-09-21T05:54:03.160 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_init", 2024-09-21T05:54:03.160 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.161 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.161 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.161 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.161 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.161 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.161 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.161 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T05:54:03.161 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.161 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.161 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.161 INFO:teuthology.orchestra.run.smithi070.stdout: "daemon_cache_timeout": { 2024-09-21T05:54:03.161 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "daemon_cache_timeout", 2024-09-21T05:54:03.161 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.161 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.162 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.162 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-21T05:54:03.162 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.162 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.162 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.162 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T05:54:03.162 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.162 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.162 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.162 INFO:teuthology.orchestra.run.smithi070.stdout: "default_cephadm_command_timeout": { 2024-09-21T05:54:03.162 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T05:54:03.162 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.162 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.162 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.163 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "900", 2024-09-21T05:54:03.163 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.163 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.163 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.163 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T05:54:03.163 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.163 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.163 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.163 INFO:teuthology.orchestra.run.smithi070.stdout: "default_registry": { 2024-09-21T05:54:03.163 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_registry", 2024-09-21T05:54:03.163 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.163 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.163 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.163 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io", 2024-09-21T05:54:03.163 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.164 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.164 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.164 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T05:54:03.164 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.164 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.164 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.164 INFO:teuthology.orchestra.run.smithi070.stdout: "device_cache_timeout": { 2024-09-21T05:54:03.164 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_cache_timeout", 2024-09-21T05:54:03.164 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.164 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.164 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.164 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1800", 2024-09-21T05:54:03.164 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.164 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.165 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.165 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache device inventory", 2024-09-21T05:54:03.165 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.165 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.165 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.165 INFO:teuthology.orchestra.run.smithi070.stdout: "device_enhanced_scan": { 2024-09-21T05:54:03.165 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_enhanced_scan", 2024-09-21T05:54:03.165 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.165 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.165 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.165 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.165 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.165 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.165 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.166 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T05:54:03.166 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.166 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.166 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.166 INFO:teuthology.orchestra.run.smithi070.stdout: "facts_cache_timeout": { 2024-09-21T05:54:03.166 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "facts_cache_timeout", 2024-09-21T05:54:03.166 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.166 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.166 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.166 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-21T05:54:03.166 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.166 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.166 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.166 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache host facts data", 2024-09-21T05:54:03.167 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.167 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.167 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.167 INFO:teuthology.orchestra.run.smithi070.stdout: "grafana_dashboards_path": { 2024-09-21T05:54:03.167 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "grafana_dashboards_path", 2024-09-21T05:54:03.167 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.167 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.167 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.167 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T05:54:03.167 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.167 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.167 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.167 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T05:54:03.168 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.168 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.168 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.168 INFO:teuthology.orchestra.run.smithi070.stdout: "host_check_interval": { 2024-09-21T05:54:03.168 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "host_check_interval", 2024-09-21T05:54:03.168 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.168 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.168 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.168 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-21T05:54:03.168 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.168 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.168 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.168 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to perform a host check", 2024-09-21T05:54:03.168 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.169 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.169 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.169 INFO:teuthology.orchestra.run.smithi070.stdout: "hw_monitoring": { 2024-09-21T05:54:03.169 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hw_monitoring", 2024-09-21T05:54:03.169 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.169 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.169 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.169 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.169 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.169 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.169 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.169 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T05:54:03.169 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.169 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.169 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.170 INFO:teuthology.orchestra.run.smithi070.stdout: "inventory_list_all": { 2024-09-21T05:54:03.170 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "inventory_list_all", 2024-09-21T05:54:03.170 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.170 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.170 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.170 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.170 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.170 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.170 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.170 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T05:54:03.170 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.170 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.171 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.171 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.171 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.171 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.171 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.171 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.171 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.171 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.171 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.171 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.171 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.171 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.171 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.172 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.172 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.172 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.172 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.172 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.172 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.172 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.172 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.172 INFO:teuthology.orchestra.run.smithi070.stdout: "log_refresh_metadata": { 2024-09-21T05:54:03.172 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_refresh_metadata", 2024-09-21T05:54:03.172 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.172 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.172 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.172 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.173 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.173 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.173 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.173 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T05:54:03.173 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.173 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.173 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.173 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.173 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.173 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.173 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.173 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.173 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.173 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.174 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.174 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.174 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T05:54:03.174 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.174 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.174 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.174 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.174 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.174 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.174 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.174 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.174 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.174 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.174 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.175 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.175 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.175 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.175 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.175 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.175 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.175 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.175 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.175 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.175 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.175 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.175 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.175 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.175 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.176 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.176 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.176 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.176 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.176 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.176 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.176 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.176 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.176 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.176 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.176 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.176 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T05:54:03.176 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T05:54:03.176 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.177 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.177 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.177 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.177 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.177 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.177 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.177 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T05:54:03.177 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.177 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.177 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.177 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T05:54:03.177 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T05:54:03.177 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.178 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.178 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.178 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "*", 2024-09-21T05:54:03.178 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.178 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.178 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.178 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T05:54:03.178 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.178 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.178 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.178 INFO:teuthology.orchestra.run.smithi070.stdout: "max_count_per_host": { 2024-09-21T05:54:03.178 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_count_per_host", 2024-09-21T05:54:03.178 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.178 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.179 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.179 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-21T05:54:03.179 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.179 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.179 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.179 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of daemons per service per host", 2024-09-21T05:54:03.179 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.179 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.179 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.179 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd_draining_count": { 2024-09-21T05:54:03.179 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_osd_draining_count", 2024-09-21T05:54:03.179 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.179 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.180 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.180 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-21T05:54:03.180 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.180 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.180 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.180 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T05:54:03.180 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.180 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.180 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.180 INFO:teuthology.orchestra.run.smithi070.stdout: "migration_current": { 2024-09-21T05:54:03.180 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "migration_current", 2024-09-21T05:54:03.180 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.180 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.180 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.181 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.181 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.181 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.181 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.181 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "internal - do not modify", 2024-09-21T05:54:03.181 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.181 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.181 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.181 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2024-09-21T05:54:03.181 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2024-09-21T05:54:03.181 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.181 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.181 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.182 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "root", 2024-09-21T05:54:03.182 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.182 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.182 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.182 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm-package", 2024-09-21T05:54:03.182 INFO:teuthology.orchestra.run.smithi070.stdout: "root" 2024-09-21T05:54:03.182 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.182 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T05:54:03.182 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.182 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.182 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.182 INFO:teuthology.orchestra.run.smithi070.stdout: "oob_default_addr": { 2024-09-21T05:54:03.182 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "oob_default_addr", 2024-09-21T05:54:03.182 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.183 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.183 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.183 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "169.254.1.1", 2024-09-21T05:54:03.183 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.183 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.183 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.183 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T05:54:03.183 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.183 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.183 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.183 INFO:teuthology.orchestra.run.smithi070.stdout: "prometheus_alerts_path": { 2024-09-21T05:54:03.183 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus_alerts_path", 2024-09-21T05:54:03.183 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.183 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.184 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.184 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T05:54:03.184 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.184 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.184 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.184 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T05:54:03.184 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.184 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.184 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.184 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_insecure": { 2024-09-21T05:54:03.184 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_insecure", 2024-09-21T05:54:03.184 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.184 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.185 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.185 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.185 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.185 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.185 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.185 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T05:54:03.185 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.185 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.185 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.185 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_password": { 2024-09-21T05:54:03.185 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_password", 2024-09-21T05:54:03.185 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.185 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.185 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.186 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.186 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.186 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.186 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.186 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T05:54:03.186 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.186 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.186 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.186 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_url": { 2024-09-21T05:54:03.186 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_url", 2024-09-21T05:54:03.186 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.186 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.186 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.187 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.187 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.187 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.187 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.187 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T05:54:03.187 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.187 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.187 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.187 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_username": { 2024-09-21T05:54:03.187 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_username", 2024-09-21T05:54:03.187 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.187 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.187 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.187 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.188 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.188 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.188 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.188 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T05:54:03.188 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.188 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.188 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.188 INFO:teuthology.orchestra.run.smithi070.stdout: "secure_monitoring_stack": { 2024-09-21T05:54:03.188 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "secure_monitoring_stack", 2024-09-21T05:54:03.188 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.188 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.188 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.188 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.188 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.189 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.189 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.189 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T05:54:03.189 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.189 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.189 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.189 INFO:teuthology.orchestra.run.smithi070.stdout: "service_discovery_port": { 2024-09-21T05:54:03.189 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "service_discovery_port", 2024-09-21T05:54:03.189 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.189 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.189 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.189 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8765", 2024-09-21T05:54:03.189 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.189 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.189 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.190 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "cephadm service discovery port", 2024-09-21T05:54:03.190 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.190 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.190 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.190 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.190 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.190 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.190 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.190 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.190 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.190 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.190 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.190 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.190 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.191 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.191 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.191 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.191 INFO:teuthology.orchestra.run.smithi070.stdout: "ssh_config_file": { 2024-09-21T05:54:03.191 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssh_config_file", 2024-09-21T05:54:03.191 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.191 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.191 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.191 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.191 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.191 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.191 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.191 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T05:54:03.191 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.192 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.192 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.192 INFO:teuthology.orchestra.run.smithi070.stdout: "ssh_keepalive_count_max": { 2024-09-21T05:54:03.192 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T05:54:03.192 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.192 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.192 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.192 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3", 2024-09-21T05:54:03.192 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.192 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.192 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.192 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T05:54:03.192 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.193 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.193 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.193 INFO:teuthology.orchestra.run.smithi070.stdout: "ssh_keepalive_interval": { 2024-09-21T05:54:03.193 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssh_keepalive_interval", 2024-09-21T05:54:03.193 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.193 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.193 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.193 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7", 2024-09-21T05:54:03.193 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.193 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.193 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.193 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T05:54:03.193 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.193 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.194 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.194 INFO:teuthology.orchestra.run.smithi070.stdout: "use_agent": { 2024-09-21T05:54:03.194 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_agent", 2024-09-21T05:54:03.194 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.194 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.194 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.194 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.194 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.194 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.194 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.194 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T05:54:03.194 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.194 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.194 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.195 INFO:teuthology.orchestra.run.smithi070.stdout: "use_repo_digest": { 2024-09-21T05:54:03.195 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_repo_digest", 2024-09-21T05:54:03.195 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.195 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.195 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.195 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.195 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.195 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.195 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.195 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T05:54:03.195 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.195 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.196 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.196 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_failed_host_check": { 2024-09-21T05:54:03.196 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_failed_host_check", 2024-09-21T05:54:03.196 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.196 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.196 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.196 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.196 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.196 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.196 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.196 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T05:54:03.196 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.196 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.197 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.197 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_daemons": { 2024-09-21T05:54:03.197 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_daemons", 2024-09-21T05:54:03.197 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.197 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.197 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.197 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.197 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.197 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.197 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.197 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T05:54:03.197 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.198 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.198 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.198 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_hosts": { 2024-09-21T05:54:03.198 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_hosts", 2024-09-21T05:54:03.198 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.198 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.198 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.198 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.198 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.198 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.198 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.198 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T05:54:03.198 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.199 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.199 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.199 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.199 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.199 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crash", 2024-09-21T05:54:03.199 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.199 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.199 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.199 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.199 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.199 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.200 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.200 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.200 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.200 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.200 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.200 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.200 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.200 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.200 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.200 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.200 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.200 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.200 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.200 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.201 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.201 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.201 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.201 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.201 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.201 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.201 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.201 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.201 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.201 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.201 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.201 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.201 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.201 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.202 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.202 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.202 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.202 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.202 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.202 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.202 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.202 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.202 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.202 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.202 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.202 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.202 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.202 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.203 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.203 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.203 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.203 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.203 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.203 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.203 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.203 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.203 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.203 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.203 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.203 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.203 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.204 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.204 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.204 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.204 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.204 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.204 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.204 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.204 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.204 INFO:teuthology.orchestra.run.smithi070.stdout: "retain_interval": { 2024-09-21T05:54:03.204 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retain_interval", 2024-09-21T05:54:03.204 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.204 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.204 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.204 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "31536000", 2024-09-21T05:54:03.205 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.205 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.205 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.205 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T05:54:03.205 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.205 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.205 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.205 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.205 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.205 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.205 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.205 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.205 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.205 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.206 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.206 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.206 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.206 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.206 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.206 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.206 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_recent_interval": { 2024-09-21T05:54:03.206 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_recent_interval", 2024-09-21T05:54:03.206 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.206 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.206 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.206 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1209600", 2024-09-21T05:54:03.206 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.207 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.207 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.207 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T05:54:03.207 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.207 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.207 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.207 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dashboard", 2024-09-21T05:54:03.207 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.207 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.207 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.208 INFO:teuthology.orchestra.run.smithi070.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T05:54:03.208 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T05:54:03.208 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.208 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.208 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.208 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-21T05:54:03.208 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.208 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.208 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.208 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.208 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.208 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.208 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.208 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T05:54:03.209 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T05:54:03.209 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.209 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.209 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.209 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.209 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.209 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.209 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.209 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.209 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.209 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.209 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.209 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T05:54:03.209 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T05:54:03.210 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.210 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.210 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.210 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.210 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.210 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.210 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.210 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.210 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.210 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.210 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.210 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_ENABLED": { 2024-09-21T05:54:03.210 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T05:54:03.210 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.211 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.211 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.211 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.211 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.211 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.211 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.211 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.211 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.211 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.211 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.211 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T05:54:03.211 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T05:54:03.211 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.211 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.211 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.212 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.212 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.212 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.212 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.212 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.212 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.212 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.212 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.212 INFO:teuthology.orchestra.run.smithi070.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T05:54:03.212 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T05:54:03.212 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.212 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.212 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.212 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.212 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.213 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.213 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.213 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.213 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.213 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.213 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.213 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T05:54:03.213 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T05:54:03.213 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.213 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.213 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.213 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.213 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.213 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.214 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.214 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.214 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.214 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.214 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.214 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T05:54:03.214 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T05:54:03.214 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.214 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.214 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.214 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.214 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.214 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.214 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.215 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.215 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.215 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.215 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.215 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T05:54:03.215 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T05:54:03.215 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.215 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.215 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.215 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.215 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.215 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.215 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.215 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.216 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.216 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.216 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.216 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T05:54:03.216 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T05:54:03.216 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.216 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.216 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.216 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.216 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.216 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.216 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.217 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.217 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.217 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.217 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.217 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T05:54:03.217 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T05:54:03.217 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.217 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.217 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.217 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.217 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.217 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.217 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.217 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.217 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.218 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.218 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.218 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T05:54:03.218 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T05:54:03.218 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.218 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.218 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.218 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.218 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.218 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.218 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.218 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.218 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.218 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.219 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.219 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T05:54:03.219 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T05:54:03.219 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.219 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.219 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.219 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.219 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.219 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.219 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.219 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.219 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.219 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.219 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.220 INFO:teuthology.orchestra.run.smithi070.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T05:54:03.220 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T05:54:03.220 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.220 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.220 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.220 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.220 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.220 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.220 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.220 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.220 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.220 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.220 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.221 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T05:54:03.221 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T05:54:03.221 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.221 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.221 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.221 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-09-21T05:54:03.221 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.221 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.221 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.221 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.221 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.221 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.221 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.221 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T05:54:03.222 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T05:54:03.222 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.222 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.222 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.222 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.222 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.222 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.222 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.222 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.222 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.222 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.222 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.222 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_URL": { 2024-09-21T05:54:03.222 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_URL", 2024-09-21T05:54:03.223 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.223 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.223 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.223 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.223 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.223 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.223 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.223 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.223 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.223 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.223 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.223 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T05:54:03.223 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T05:54:03.223 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.223 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.224 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.224 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-09-21T05:54:03.224 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.224 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.224 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.224 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.224 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.224 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.224 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.224 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T05:54:03.224 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T05:54:03.224 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.224 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.224 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.225 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.225 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.225 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.225 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.225 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.225 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.225 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.225 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.225 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T05:54:03.225 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T05:54:03.225 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.225 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.225 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.225 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.226 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.226 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.226 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.226 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.226 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.226 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.226 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.226 INFO:teuthology.orchestra.run.smithi070.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T05:54:03.226 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T05:54:03.226 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.226 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.226 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.226 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.226 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.227 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.227 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.227 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.227 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.227 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.227 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.227 INFO:teuthology.orchestra.run.smithi070.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T05:54:03.227 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T05:54:03.227 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.227 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.227 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.227 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.227 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.227 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.228 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.228 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.228 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.228 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.228 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.228 INFO:teuthology.orchestra.run.smithi070.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T05:54:03.228 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T05:54:03.228 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.228 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.228 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.228 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "[]", 2024-09-21T05:54:03.228 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.228 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.228 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.228 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.229 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.229 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.229 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.229 INFO:teuthology.orchestra.run.smithi070.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T05:54:03.229 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T05:54:03.229 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.229 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.229 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.229 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "{}", 2024-09-21T05:54:03.229 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.229 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.229 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.229 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.229 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.230 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.230 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.230 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T05:54:03.230 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T05:54:03.230 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.230 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.230 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.230 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.230 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.230 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.230 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.230 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.230 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.230 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.231 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.231 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T05:54:03.231 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T05:54:03.231 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.231 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.231 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.231 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.231 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.231 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.231 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.231 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.231 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.231 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.231 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.232 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T05:54:03.232 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T05:54:03.232 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.232 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.232 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.232 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.232 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.232 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.232 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.232 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.232 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.232 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.232 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.233 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T05:54:03.233 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T05:54:03.233 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.233 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.233 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.233 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.233 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.233 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.233 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.233 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.233 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.233 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.233 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.233 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T05:54:03.234 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T05:54:03.234 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.234 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.234 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.234 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.234 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.234 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.234 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.234 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.234 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.234 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.234 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.234 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T05:54:03.234 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T05:54:03.235 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.235 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.235 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.235 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.235 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.235 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.235 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.235 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.235 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.235 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.235 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.235 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T05:54:03.235 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T05:54:03.236 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.236 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.236 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.236 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.236 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.236 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.236 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.236 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.236 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.236 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.236 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.236 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T05:54:03.236 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T05:54:03.236 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.237 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.237 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.237 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.237 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.237 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.237 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.237 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.237 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.237 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.237 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.237 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T05:54:03.237 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T05:54:03.237 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.237 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.238 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.238 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.238 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.238 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.238 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.238 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.238 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.238 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.238 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.238 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T05:54:03.238 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T05:54:03.238 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.238 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.239 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.239 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.239 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.239 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.239 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.239 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.239 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.239 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.239 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.239 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T05:54:03.239 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T05:54:03.239 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.239 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.239 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.240 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T05:54:03.240 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.240 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.240 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.240 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.240 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.240 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.240 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.240 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T05:54:03.240 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T05:54:03.240 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.240 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.240 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.241 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-21T05:54:03.241 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.241 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.241 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.241 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.241 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.241 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.241 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.241 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T05:54:03.241 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T05:54:03.241 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.241 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.241 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.242 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8", 2024-09-21T05:54:03.242 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.242 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.242 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.242 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.242 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.242 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.242 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.242 INFO:teuthology.orchestra.run.smithi070.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T05:54:03.242 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T05:54:03.242 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.242 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.242 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.242 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "45", 2024-09-21T05:54:03.243 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.243 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.243 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.243 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.243 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.243 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.243 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.243 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T05:54:03.243 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T05:54:03.243 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.243 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.243 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.243 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.244 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.244 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.244 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.244 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.244 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.244 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.244 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.244 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T05:54:03.244 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T05:54:03.244 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.244 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.244 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.244 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-09-21T05:54:03.245 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.245 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.245 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.245 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.245 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.245 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.245 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.245 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T05:54:03.245 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T05:54:03.245 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.245 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.245 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.245 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.245 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.246 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.246 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.246 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.246 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.246 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.246 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.246 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T05:54:03.246 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T05:54:03.246 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.246 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.246 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.246 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.247 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.247 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.247 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.247 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.247 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.247 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.247 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.247 INFO:teuthology.orchestra.run.smithi070.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T05:54:03.247 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T05:54:03.247 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.247 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.247 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.247 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.247 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.248 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.248 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.248 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.248 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.248 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.248 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.248 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T05:54:03.248 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T05:54:03.248 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.248 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.248 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.248 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.248 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.248 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.249 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.249 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.249 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.249 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.249 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.249 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T05:54:03.249 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T05:54:03.249 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.249 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.249 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.249 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-21T05:54:03.249 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.249 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.249 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.249 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.250 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.250 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.250 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.250 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T05:54:03.250 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T05:54:03.250 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.250 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.250 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.250 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-21T05:54:03.250 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.250 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.250 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.250 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.250 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.251 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.251 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.251 INFO:teuthology.orchestra.run.smithi070.stdout: "cross_origin_url": { 2024-09-21T05:54:03.251 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cross_origin_url", 2024-09-21T05:54:03.251 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.251 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.251 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.251 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.251 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.251 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.251 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.251 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.251 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.251 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.251 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.252 INFO:teuthology.orchestra.run.smithi070.stdout: "crt_file": { 2024-09-21T05:54:03.252 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crt_file", 2024-09-21T05:54:03.252 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.252 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.252 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.252 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.252 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.252 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.252 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.252 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.252 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.252 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.252 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.253 INFO:teuthology.orchestra.run.smithi070.stdout: "debug": { 2024-09-21T05:54:03.253 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "debug", 2024-09-21T05:54:03.253 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.253 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.253 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.253 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.253 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.253 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.253 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.253 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable/disable debug options", 2024-09-21T05:54:03.253 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.253 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.253 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.254 INFO:teuthology.orchestra.run.smithi070.stdout: "jwt_token_ttl": { 2024-09-21T05:54:03.254 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "jwt_token_ttl", 2024-09-21T05:54:03.254 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.254 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.254 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.254 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "28800", 2024-09-21T05:54:03.254 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.254 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.254 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.254 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.254 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.254 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.254 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.255 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2024-09-21T05:54:03.255 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2024-09-21T05:54:03.255 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.255 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.255 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.255 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.255 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.255 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.255 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.255 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.255 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.255 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.255 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.256 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.256 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.256 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.256 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.256 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.256 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.256 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.256 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.256 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.256 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.256 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.256 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.256 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.257 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.257 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.257 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.257 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.257 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.257 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.257 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.257 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.257 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.257 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.257 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.257 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.257 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.257 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.258 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.258 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.258 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.258 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.258 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.258 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.258 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.258 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.258 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.258 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.258 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.258 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.258 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.259 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.259 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.259 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.259 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.259 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.259 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.259 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.259 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.259 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.259 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.259 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.259 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.259 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.259 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.260 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.260 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.260 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.260 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.260 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.260 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.260 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.260 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.260 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.260 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.260 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.260 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.260 INFO:teuthology.orchestra.run.smithi070.stdout: "motd": { 2024-09-21T05:54:03.260 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "motd", 2024-09-21T05:54:03.260 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.261 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.261 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.261 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.261 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.261 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.261 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.261 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "The message of the day", 2024-09-21T05:54:03.261 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.261 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.261 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.261 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect_resolve_ip_addr": { 2024-09-21T05:54:03.261 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T05:54:03.261 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.261 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.262 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.262 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.262 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.262 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.262 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.262 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.262 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.262 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.262 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.262 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-09-21T05:54:03.262 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-09-21T05:54:03.262 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.262 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.262 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.262 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2024-09-21T05:54:03.262 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.263 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.263 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.263 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.263 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.263 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.263 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.263 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-09-21T05:54:03.263 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-09-21T05:54:03.263 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.263 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.263 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.263 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8080", 2024-09-21T05:54:03.263 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.263 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.264 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.264 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.264 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.264 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.264 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.264 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.264 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.264 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.264 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.264 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.264 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.264 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.264 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.264 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.264 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.265 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.265 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.265 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.265 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2024-09-21T05:54:03.265 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2024-09-21T05:54:03.265 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.265 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.265 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.265 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.265 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.265 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.265 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.265 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.265 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.265 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.266 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.266 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl_server_port": { 2024-09-21T05:54:03.266 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl_server_port", 2024-09-21T05:54:03.266 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.266 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.266 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.266 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8443", 2024-09-21T05:54:03.266 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.266 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.266 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.266 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.266 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.267 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.267 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.267 INFO:teuthology.orchestra.run.smithi070.stdout: "sso_oauth2": { 2024-09-21T05:54:03.267 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sso_oauth2", 2024-09-21T05:54:03.267 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.267 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.267 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.267 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.267 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.267 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.267 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.267 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.267 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.267 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.267 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.268 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2024-09-21T05:54:03.268 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2024-09-21T05:54:03.268 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.268 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.268 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.268 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "redirect", 2024-09-21T05:54:03.268 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.268 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.268 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.268 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.268 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect" 2024-09-21T05:54:03.268 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.268 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.268 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.268 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.269 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.269 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2024-09-21T05:54:03.269 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2024-09-21T05:54:03.269 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.269 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.269 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.269 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-09-21T05:54:03.269 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2024-09-21T05:54:03.269 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2024-09-21T05:54:03.269 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.269 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.269 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.269 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.269 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.270 INFO:teuthology.orchestra.run.smithi070.stdout: "url_prefix": { 2024-09-21T05:54:03.270 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url_prefix", 2024-09-21T05:54:03.270 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.270 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.270 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.270 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.270 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.270 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.270 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.270 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.270 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.270 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.270 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.270 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.270 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.271 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "devicehealth", 2024-09-21T05:54:03.271 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.271 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.271 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.271 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_monitoring": { 2024-09-21T05:54:03.271 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_monitoring", 2024-09-21T05:54:03.271 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.271 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.271 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.271 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.271 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.271 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.271 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.271 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "monitor device health metrics", 2024-09-21T05:54:03.272 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.272 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.272 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.272 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.272 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.272 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.272 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.272 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.272 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.272 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.272 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.272 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.272 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.272 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.272 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.272 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.273 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.273 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.273 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.273 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.273 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.273 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.273 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.273 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.273 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.273 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.273 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.273 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.273 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.273 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.273 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.274 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.274 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.274 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.274 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.274 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.274 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.274 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.274 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.274 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.274 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.274 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.274 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.274 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.274 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.275 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.275 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.275 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.275 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.275 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.275 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.275 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.275 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.275 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.275 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.275 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.275 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.275 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.275 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.275 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.276 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.276 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.276 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.276 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.276 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.276 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.276 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.276 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.276 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.276 INFO:teuthology.orchestra.run.smithi070.stdout: "mark_out_threshold": { 2024-09-21T05:54:03.276 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mark_out_threshold", 2024-09-21T05:54:03.276 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.276 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.277 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.277 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2419200", 2024-09-21T05:54:03.277 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.277 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.277 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.277 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T05:54:03.277 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.277 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.277 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.277 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": { 2024-09-21T05:54:03.277 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_name", 2024-09-21T05:54:03.277 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.277 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.277 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.277 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "device_health_metrics", 2024-09-21T05:54:03.278 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.278 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.278 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.278 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T05:54:03.278 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.278 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.278 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.278 INFO:teuthology.orchestra.run.smithi070.stdout: "retention_period": { 2024-09-21T05:54:03.278 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retention_period", 2024-09-21T05:54:03.278 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.278 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.278 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.278 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15552000", 2024-09-21T05:54:03.279 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.279 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.279 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.279 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain device health metrics", 2024-09-21T05:54:03.279 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.279 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.279 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.279 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_frequency": { 2024-09-21T05:54:03.279 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_frequency", 2024-09-21T05:54:03.279 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.279 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.279 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.279 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2024-09-21T05:54:03.280 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.280 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.280 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.280 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T05:54:03.280 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.280 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.280 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.280 INFO:teuthology.orchestra.run.smithi070.stdout: "self_heal": { 2024-09-21T05:54:03.280 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "self_heal", 2024-09-21T05:54:03.280 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.280 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.280 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.280 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.280 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.281 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.281 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.281 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T05:54:03.281 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.281 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.281 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.281 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-21T05:54:03.281 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-21T05:54:03.281 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.281 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.281 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.281 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-21T05:54:03.281 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.282 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.282 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.282 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T05:54:03.282 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.282 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.282 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.282 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.282 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.282 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.282 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.282 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.282 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.282 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.282 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.283 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.283 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.283 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.283 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.283 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.283 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_threshold": { 2024-09-21T05:54:03.283 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_threshold", 2024-09-21T05:54:03.283 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.283 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.283 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.283 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7257600", 2024-09-21T05:54:03.283 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.284 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.284 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.284 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T05:54:03.284 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.284 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.284 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.284 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.284 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.284 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "diskprediction_local", 2024-09-21T05:54:03.284 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.284 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.284 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.284 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.285 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.285 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.285 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.285 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.285 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.285 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.285 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.285 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.285 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.285 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.285 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.285 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.285 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.285 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.285 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.286 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.286 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.286 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.286 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.286 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.286 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.286 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.286 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.286 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.286 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.286 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.286 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.287 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.287 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.287 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.287 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.287 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.287 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.287 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.287 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.287 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.287 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.287 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.287 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.287 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.288 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.288 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.288 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.288 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.288 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.288 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.288 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.288 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.288 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.288 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.288 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.288 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.288 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.288 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.289 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.289 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.289 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.289 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.289 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.289 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.289 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.289 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.289 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.289 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.289 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.289 INFO:teuthology.orchestra.run.smithi070.stdout: "predict_interval": { 2024-09-21T05:54:03.289 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predict_interval", 2024-09-21T05:54:03.289 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.290 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.290 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.290 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2024-09-21T05:54:03.290 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.290 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.290 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.290 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.290 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.290 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.290 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.290 INFO:teuthology.orchestra.run.smithi070.stdout: "predictor_model": { 2024-09-21T05:54:03.290 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predictor_model", 2024-09-21T05:54:03.290 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.291 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.291 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.291 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "prophetstor", 2024-09-21T05:54:03.291 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.291 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.291 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.291 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.291 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.291 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.291 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.291 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-21T05:54:03.291 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-21T05:54:03.291 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.291 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.292 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.292 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-21T05:54:03.292 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.292 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.292 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.292 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.292 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.292 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.292 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.292 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.292 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.292 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.292 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.293 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.293 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.293 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.293 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.293 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.293 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.293 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.293 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.293 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.293 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.293 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.293 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "influx", 2024-09-21T05:54:03.293 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": false, 2024-09-21T05:54:03.294 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "influxdb python module not found", 2024-09-21T05:54:03.294 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.294 INFO:teuthology.orchestra.run.smithi070.stdout: "batch_size": { 2024-09-21T05:54:03.294 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "batch_size", 2024-09-21T05:54:03.294 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.294 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.294 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.294 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5000", 2024-09-21T05:54:03.294 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.294 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.294 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.294 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T05:54:03.294 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.294 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.294 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.295 INFO:teuthology.orchestra.run.smithi070.stdout: "database": { 2024-09-21T05:54:03.295 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "database", 2024-09-21T05:54:03.295 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.295 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.295 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.295 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "ceph", 2024-09-21T05:54:03.295 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.295 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.295 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.295 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T05:54:03.295 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.295 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.295 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.296 INFO:teuthology.orchestra.run.smithi070.stdout: "hostname": { 2024-09-21T05:54:03.296 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hostname", 2024-09-21T05:54:03.296 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.296 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.296 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.296 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.296 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.296 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.296 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.296 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server hostname", 2024-09-21T05:54:03.296 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.296 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.296 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.297 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-21T05:54:03.297 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-21T05:54:03.297 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.297 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.297 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.297 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "30", 2024-09-21T05:54:03.297 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "5", 2024-09-21T05:54:03.297 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.297 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.297 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T05:54:03.297 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.297 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.297 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.297 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.298 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.298 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.298 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.298 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.298 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.298 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.298 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.298 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.298 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.298 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.298 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.298 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.298 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.298 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.298 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.299 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.299 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.299 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.299 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.299 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.299 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.299 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.299 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.299 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.299 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.299 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.299 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.299 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.299 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.299 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.300 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.300 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.300 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.300 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.300 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.300 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.300 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.300 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.300 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.300 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.300 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.300 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.300 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.300 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.300 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.300 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.301 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.301 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.301 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.301 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.301 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.301 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.301 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.301 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.301 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.301 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.301 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.301 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.301 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.301 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.301 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.301 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.302 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.302 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.302 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.302 INFO:teuthology.orchestra.run.smithi070.stdout: "password": { 2024-09-21T05:54:03.302 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "password", 2024-09-21T05:54:03.302 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.302 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.302 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.302 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.302 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.302 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.302 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.302 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "password of InfluxDB server user", 2024-09-21T05:54:03.302 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.302 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.303 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.303 INFO:teuthology.orchestra.run.smithi070.stdout: "port": { 2024-09-21T05:54:03.303 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "port", 2024-09-21T05:54:03.303 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.303 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.303 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.303 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8086", 2024-09-21T05:54:03.303 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.303 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.303 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.303 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server port", 2024-09-21T05:54:03.303 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.303 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.303 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.304 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.304 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.304 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.304 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.304 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.304 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.304 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.304 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.304 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.304 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.304 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.304 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.304 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.304 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2024-09-21T05:54:03.305 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2024-09-21T05:54:03.305 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.305 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.305 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.305 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "false", 2024-09-21T05:54:03.305 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.305 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.305 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.305 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T05:54:03.305 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.305 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.305 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.305 INFO:teuthology.orchestra.run.smithi070.stdout: "threads": { 2024-09-21T05:54:03.305 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threads", 2024-09-21T05:54:03.305 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.306 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.306 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.306 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-21T05:54:03.306 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-21T05:54:03.306 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "32", 2024-09-21T05:54:03.306 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.306 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T05:54:03.306 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.306 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.306 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.306 INFO:teuthology.orchestra.run.smithi070.stdout: "username": { 2024-09-21T05:54:03.306 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "username", 2024-09-21T05:54:03.307 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.307 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.307 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.307 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.307 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.307 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.307 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.307 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "username of InfluxDB server user", 2024-09-21T05:54:03.307 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.307 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.307 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.307 INFO:teuthology.orchestra.run.smithi070.stdout: "verify_ssl": { 2024-09-21T05:54:03.307 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "verify_ssl", 2024-09-21T05:54:03.307 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.307 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.308 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.308 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "true", 2024-09-21T05:54:03.308 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.308 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.308 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.308 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T05:54:03.308 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.308 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.308 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.308 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.308 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.308 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "insights", 2024-09-21T05:54:03.308 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.308 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.309 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.309 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.309 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.309 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.309 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.309 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.309 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.309 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.309 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.309 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.309 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.309 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.309 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.309 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.309 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.309 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.309 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.310 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.310 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.310 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.310 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.310 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.310 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.310 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.310 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.310 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.310 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.310 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.310 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.310 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.310 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.311 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.311 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.311 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.311 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.311 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.311 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.311 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.311 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.311 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.311 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.311 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.311 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.311 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.311 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.311 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.312 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.312 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.312 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.312 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.312 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.312 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.312 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.312 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.312 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.312 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.312 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.312 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.312 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.312 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.312 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.312 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.313 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.313 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.313 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.313 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.313 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.313 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.313 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.313 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.313 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.313 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.313 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.313 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.313 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.313 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.313 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.314 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.314 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.314 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.314 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.314 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.314 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "iostat", 2024-09-21T05:54:03.314 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.314 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.314 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.314 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.314 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.315 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.315 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.315 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.315 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.315 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.315 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.315 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.315 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.315 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.315 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.315 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.315 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.315 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.315 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.315 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.315 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.316 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.316 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.316 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.316 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.316 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.316 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.316 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.316 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.316 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.316 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.316 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.316 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.316 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.316 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.317 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.317 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.317 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.317 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.317 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.317 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.317 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.317 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.317 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.317 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.317 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.317 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.317 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.317 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.318 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.318 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.318 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.318 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.318 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.318 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.318 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.318 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.318 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.318 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.318 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.318 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.318 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.318 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.319 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.319 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.319 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.319 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.319 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.319 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.319 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.319 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.319 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.319 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.319 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.319 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.319 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.319 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.319 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.319 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.320 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.320 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.320 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.320 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.320 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.320 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "k8sevents", 2024-09-21T05:54:03.320 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.320 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.320 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.320 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_event_retention_days": { 2024-09-21T05:54:03.320 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ceph_event_retention_days", 2024-09-21T05:54:03.320 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.320 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.320 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.321 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7", 2024-09-21T05:54:03.321 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.321 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.321 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.321 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T05:54:03.321 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.321 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.321 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.321 INFO:teuthology.orchestra.run.smithi070.stdout: "config_check_secs": { 2024-09-21T05:54:03.321 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_check_secs", 2024-09-21T05:54:03.321 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.321 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.321 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.322 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-21T05:54:03.322 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "10", 2024-09-21T05:54:03.322 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.322 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.322 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T05:54:03.322 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.322 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.322 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.322 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.322 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.322 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.322 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.322 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.323 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.323 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.323 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.323 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.323 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.323 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.323 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.323 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.323 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.323 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.323 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.323 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.323 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.323 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.323 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.324 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.324 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.324 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.324 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.324 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.324 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.324 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.324 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.324 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.324 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.324 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.324 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.324 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.325 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.325 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.325 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.325 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.325 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.325 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.325 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.325 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.325 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.325 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.325 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.325 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.325 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.325 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.326 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.326 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.326 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.326 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.326 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.326 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.326 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.326 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.326 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.326 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.326 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.326 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.326 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.327 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.327 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.327 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.327 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.327 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.327 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.327 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.327 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.327 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.327 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.327 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.327 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.327 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.327 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.327 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.328 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.328 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.328 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.328 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.328 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "localpool", 2024-09-21T05:54:03.328 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.328 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.328 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.328 INFO:teuthology.orchestra.run.smithi070.stdout: "failure_domain": { 2024-09-21T05:54:03.328 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "failure_domain", 2024-09-21T05:54:03.328 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.329 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.329 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.329 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "host", 2024-09-21T05:54:03.329 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.329 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.329 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.329 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "failure domain for any created local pool", 2024-09-21T05:54:03.329 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T05:54:03.329 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.329 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.329 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.329 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.329 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.330 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.330 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.330 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.330 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.330 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.330 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.330 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.330 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.330 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.330 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.330 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.330 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.330 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.330 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.330 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.330 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.331 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.331 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.331 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.331 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.331 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.331 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.331 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.331 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.331 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.331 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.331 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.331 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.331 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.331 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.332 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.332 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.332 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.332 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.332 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.332 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.332 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.332 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.332 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.332 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.332 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.332 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.332 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.332 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.332 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.332 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.333 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.333 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.333 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.333 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.333 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.333 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.333 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.333 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.333 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.333 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.333 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.333 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.333 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.333 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.334 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.334 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.334 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.334 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": { 2024-09-21T05:54:03.334 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_size", 2024-09-21T05:54:03.334 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.334 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.334 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.334 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.334 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.334 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.334 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.334 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default min_size for any created local pool", 2024-09-21T05:54:03.334 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T05:54:03.335 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.335 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.335 INFO:teuthology.orchestra.run.smithi070.stdout: "num_rep": { 2024-09-21T05:54:03.335 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "num_rep", 2024-09-21T05:54:03.335 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.335 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.335 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.335 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3", 2024-09-21T05:54:03.335 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.335 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.335 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.335 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default replica count for any created local pool", 2024-09-21T05:54:03.335 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.335 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.336 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.336 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": { 2024-09-21T05:54:03.336 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_num", 2024-09-21T05:54:03.336 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.336 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.336 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.336 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "128", 2024-09-21T05:54:03.336 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.336 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.336 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.336 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T05:54:03.336 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.336 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.336 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.337 INFO:teuthology.orchestra.run.smithi070.stdout: "prefix": { 2024-09-21T05:54:03.337 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prefix", 2024-09-21T05:54:03.337 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.337 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.337 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.337 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.337 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.337 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.337 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.337 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name prefix for any created local pool", 2024-09-21T05:54:03.337 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.337 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.337 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.337 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.337 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.338 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.338 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.338 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.338 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.338 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.338 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.338 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.338 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.338 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.338 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.338 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.338 INFO:teuthology.orchestra.run.smithi070.stdout: "subtree": { 2024-09-21T05:54:03.338 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "subtree", 2024-09-21T05:54:03.338 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.338 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.339 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.339 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "rack", 2024-09-21T05:54:03.339 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.339 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.339 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.339 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T05:54:03.339 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T05:54:03.339 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.339 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.339 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.339 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.339 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mds_autoscaler", 2024-09-21T05:54:03.339 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.340 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.340 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.340 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.340 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.340 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.340 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.340 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.340 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.340 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.340 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.340 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.340 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.340 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.340 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.340 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.340 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.340 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.341 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.341 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.341 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.341 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.341 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.341 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.341 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.341 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.341 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.341 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.341 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.341 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.341 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.342 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.342 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.342 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.342 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.342 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.342 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.342 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.342 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.342 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.342 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.342 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.342 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.342 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.342 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.343 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.343 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.343 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.343 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.343 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.343 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.343 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.343 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.343 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.343 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.343 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.343 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.343 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.344 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.344 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.344 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.344 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.344 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.344 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.344 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.344 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.344 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.344 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.344 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.344 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.344 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.344 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.345 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.345 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.345 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.345 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.345 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.345 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.345 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.345 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.345 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.345 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.345 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.345 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.346 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirroring", 2024-09-21T05:54:03.346 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.346 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.346 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.346 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.346 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.346 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.346 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.346 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.346 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.346 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.346 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.346 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.346 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.347 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.347 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.347 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.347 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.347 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.347 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.347 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.347 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.347 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.347 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.347 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.347 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.347 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.348 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.348 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.348 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.348 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.348 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.348 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.348 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.348 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.348 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.348 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.348 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.348 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.348 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.348 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.349 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.349 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.349 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.349 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.349 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.349 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.349 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.349 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.349 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.349 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.349 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.349 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.349 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.349 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.349 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.350 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.350 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.350 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.350 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.350 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.350 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.350 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.350 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.350 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.350 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.350 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.350 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.350 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.350 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.351 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.351 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.351 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.351 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.351 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.351 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.351 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.351 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.351 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.351 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.351 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.351 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.351 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.351 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.351 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.352 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "nfs", 2024-09-21T05:54:03.352 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.352 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.352 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.352 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.352 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.352 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.352 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.352 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.352 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.352 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.352 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.352 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.352 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.353 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.353 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.353 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.353 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.353 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.353 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.353 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.353 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.353 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.353 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.353 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.353 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.353 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.353 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.353 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.354 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.354 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.354 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.354 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.354 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.354 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.354 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.354 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.354 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.354 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.354 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.354 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.354 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.355 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.355 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.355 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.355 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.355 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.355 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.355 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.355 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.355 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.355 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.355 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.355 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.355 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.355 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.355 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.356 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.356 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.356 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.356 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.356 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.356 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.356 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.356 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.356 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.356 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.356 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.356 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.356 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.357 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.357 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.357 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.357 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.357 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.357 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.357 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.357 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.357 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.357 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.357 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.357 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.357 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.357 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.357 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.358 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2024-09-21T05:54:03.358 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.358 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.358 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.358 INFO:teuthology.orchestra.run.smithi070.stdout: "fail_fs": { 2024-09-21T05:54:03.358 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "fail_fs", 2024-09-21T05:54:03.358 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.358 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.358 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.358 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.358 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.358 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.358 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.358 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T05:54:03.359 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.359 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.359 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.359 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.359 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.359 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.359 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.359 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.359 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.359 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.359 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.359 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.359 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.360 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.360 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.360 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.360 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.360 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.360 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.360 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.360 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.360 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.360 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.360 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.360 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.360 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.360 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.360 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.361 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.361 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.361 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.361 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.361 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.361 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.361 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.361 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.361 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.361 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.361 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.361 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.361 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.361 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.361 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.362 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.362 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.362 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.362 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.362 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.362 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.362 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.362 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.362 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.362 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.362 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.362 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.362 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.362 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.363 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.363 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.363 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.363 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.363 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.363 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.363 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.363 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.363 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.363 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.363 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.363 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.363 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator": { 2024-09-21T05:54:03.363 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2024-09-21T05:54:03.364 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.364 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.364 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.364 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.364 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.364 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.364 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.364 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm", 2024-09-21T05:54:03.364 INFO:teuthology.orchestra.run.smithi070.stdout: "rook", 2024-09-21T05:54:03.364 INFO:teuthology.orchestra.run.smithi070.stdout: "test_orchestrator" 2024-09-21T05:54:03.364 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.364 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Orchestrator backend", 2024-09-21T05:54:03.364 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.364 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.364 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.365 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.365 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.365 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.365 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.365 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.365 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.365 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.365 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.365 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.365 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.365 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.365 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.365 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.365 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.365 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.366 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_perf_query", 2024-09-21T05:54:03.366 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.366 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.366 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.366 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.366 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.366 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.366 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.366 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.366 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.366 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.366 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.366 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.367 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.367 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.367 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.367 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.367 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.367 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.367 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.367 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.367 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.367 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.367 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.367 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.367 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.367 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.367 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.368 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.368 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.368 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.368 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.368 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.368 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.368 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.368 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.368 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.368 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.368 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.368 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.368 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.368 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.369 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.369 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.369 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.369 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.369 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.369 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.369 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.369 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.369 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.369 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.369 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.369 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.369 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.369 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.370 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.370 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.370 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.370 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.370 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.370 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.370 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.370 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.370 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.370 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.370 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.370 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.370 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.370 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.371 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.371 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.371 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.371 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.371 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.371 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.371 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.371 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.371 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.371 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.371 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.371 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.371 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.371 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.371 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.372 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_support", 2024-09-21T05:54:03.372 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.372 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.372 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.372 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.372 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.372 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.372 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.372 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.372 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.372 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.372 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.372 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.372 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.373 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.373 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.373 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.373 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.373 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.373 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.373 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.373 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.373 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.373 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.373 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.373 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.373 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.373 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.373 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.374 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.374 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.374 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.374 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.374 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.374 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.374 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.374 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.374 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.374 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.374 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.374 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.374 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.375 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.375 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.375 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.375 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.375 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.375 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.375 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.375 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.375 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.375 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.375 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.375 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.375 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.375 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.375 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.376 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.376 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.376 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.376 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.376 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.376 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.376 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.376 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.376 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.376 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.376 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.376 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.376 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.377 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.377 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.377 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.377 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.377 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.377 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.377 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.377 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.377 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.377 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.377 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.377 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.377 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.377 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.377 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.378 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_autoscaler", 2024-09-21T05:54:03.378 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.378 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.378 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.378 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.378 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.378 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.378 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.378 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.378 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.378 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.378 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.378 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.379 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.379 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.379 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.379 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.379 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.379 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.379 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.379 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.379 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.379 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.379 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.379 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.379 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.379 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.380 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.380 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.380 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.380 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.380 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.380 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.380 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.380 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.380 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.380 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.380 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.380 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.381 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.381 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.381 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.381 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.381 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.381 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.381 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.381 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.381 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.381 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.381 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.381 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.381 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.381 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.381 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.382 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.382 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.382 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.382 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.382 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.382 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.382 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.382 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.382 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.382 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.382 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.382 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.382 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.382 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.383 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.383 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.383 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-21T05:54:03.383 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-21T05:54:03.383 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.383 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.383 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.383 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-21T05:54:03.383 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.383 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.383 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.383 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.383 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.383 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.384 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.384 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.384 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.384 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.384 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.384 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.384 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.384 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.384 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.384 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.384 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.384 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.384 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.384 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.385 INFO:teuthology.orchestra.run.smithi070.stdout: "threshold": { 2024-09-21T05:54:03.385 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threshold", 2024-09-21T05:54:03.385 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-21T05:54:03.385 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.385 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.385 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2024-09-21T05:54:03.385 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1.0", 2024-09-21T05:54:03.385 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.385 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.385 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "scaling threshold", 2024-09-21T05:54:03.385 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T05:54:03.385 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.385 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.385 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.386 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.386 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "progress", 2024-09-21T05:54:03.386 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.386 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.386 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.386 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_pg_recovery_event": { 2024-09-21T05:54:03.386 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_pg_recovery_event", 2024-09-21T05:54:03.386 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.386 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.386 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.386 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.386 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.386 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.387 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.387 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T05:54:03.387 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.387 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.387 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.387 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2024-09-21T05:54:03.387 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2024-09-21T05:54:03.387 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.387 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.387 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.387 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.387 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.387 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.387 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.388 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.388 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.388 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.388 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.388 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.388 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.388 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.388 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.388 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.388 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.388 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.388 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.389 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.389 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.389 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.389 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.389 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.389 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.389 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.389 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.389 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.389 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.389 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.389 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.389 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.389 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.390 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.390 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.390 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.390 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.390 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.390 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.390 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.390 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.390 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.390 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.390 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.390 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.390 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.391 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.391 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.391 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.391 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.391 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.391 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.391 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.391 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.391 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.391 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.391 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.391 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.391 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.391 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.392 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.392 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.392 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.392 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.392 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.392 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.392 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.392 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.392 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.392 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.392 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.392 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.392 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.393 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.393 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.393 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.393 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.393 INFO:teuthology.orchestra.run.smithi070.stdout: "max_completed_events": { 2024-09-21T05:54:03.393 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_completed_events", 2024-09-21T05:54:03.393 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.393 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.394 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.394 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "50", 2024-09-21T05:54:03.394 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.394 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.394 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.394 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "number of past completed events to remember", 2024-09-21T05:54:03.394 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.394 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.394 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.394 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-21T05:54:03.394 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-21T05:54:03.394 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.395 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.395 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.395 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-21T05:54:03.395 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.395 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.395 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.395 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long the module is going to sleep", 2024-09-21T05:54:03.395 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.395 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.395 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.395 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.396 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.396 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.396 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.396 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.396 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.396 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.396 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.396 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.396 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.396 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.396 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.396 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.396 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.397 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.397 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus", 2024-09-21T05:54:03.397 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.397 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.397 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.397 INFO:teuthology.orchestra.run.smithi070.stdout: "cache": { 2024-09-21T05:54:03.397 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cache", 2024-09-21T05:54:03.397 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.397 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.397 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.397 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.397 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.397 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.398 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.398 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.398 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.398 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.398 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.398 INFO:teuthology.orchestra.run.smithi070.stdout: "exclude_perf_counters": { 2024-09-21T05:54:03.398 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "exclude_perf_counters", 2024-09-21T05:54:03.398 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.398 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.398 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.398 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.398 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.398 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.399 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.399 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T05:54:03.399 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T05:54:03.399 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.399 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.399 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.399 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.399 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.399 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.399 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.399 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.399 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.399 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.399 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.400 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.400 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.400 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.400 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.400 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.400 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.400 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.400 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.400 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.400 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.400 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.400 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.400 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.401 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.401 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.401 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.401 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.401 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.401 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.401 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.401 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.401 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.401 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.401 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.401 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.402 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.402 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.402 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.402 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.402 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.402 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.402 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.402 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.402 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.402 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.402 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.402 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.402 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.402 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.402 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.403 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.403 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.403 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.403 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.403 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.403 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.403 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.403 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.403 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.403 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.403 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.403 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.403 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.403 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.403 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.404 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.404 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.404 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools": { 2024-09-21T05:54:03.404 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools", 2024-09-21T05:54:03.404 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.404 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.404 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.404 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.404 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.404 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.404 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.404 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.404 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.404 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.404 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.405 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T05:54:03.405 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T05:54:03.405 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.405 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.405 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.405 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "300", 2024-09-21T05:54:03.405 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.405 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.405 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.405 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.405 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.405 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.405 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.406 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_interval": { 2024-09-21T05:54:03.406 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_interval", 2024-09-21T05:54:03.406 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-21T05:54:03.406 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.406 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.406 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15.0", 2024-09-21T05:54:03.406 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.406 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.406 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.406 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.406 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.406 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.406 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.407 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-09-21T05:54:03.407 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-09-21T05:54:03.407 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.407 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.407 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.407 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2024-09-21T05:54:03.407 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.407 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.407 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.407 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T05:54:03.407 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.407 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.407 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.407 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-09-21T05:54:03.407 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-09-21T05:54:03.408 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.408 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.408 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.408 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "9283", 2024-09-21T05:54:03.408 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.408 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.408 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.408 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T05:54:03.408 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.408 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.408 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.408 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.408 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.408 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.408 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.409 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.409 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.409 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.409 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.409 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.409 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.409 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.409 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.409 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.409 INFO:teuthology.orchestra.run.smithi070.stdout: "stale_cache_strategy": { 2024-09-21T05:54:03.409 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stale_cache_strategy", 2024-09-21T05:54:03.409 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.410 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.410 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.410 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "log", 2024-09-21T05:54:03.410 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.410 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.410 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.410 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.410 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.410 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.410 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.410 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2024-09-21T05:54:03.410 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2024-09-21T05:54:03.410 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.411 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.411 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.411 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "default", 2024-09-21T05:54:03.411 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.411 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.411 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.411 INFO:teuthology.orchestra.run.smithi070.stdout: "default", 2024-09-21T05:54:03.411 INFO:teuthology.orchestra.run.smithi070.stdout: "error" 2024-09-21T05:54:03.411 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.411 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.411 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.411 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.411 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.412 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2024-09-21T05:54:03.412 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2024-09-21T05:54:03.412 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.412 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.412 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.412 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-09-21T05:54:03.412 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2024-09-21T05:54:03.412 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2024-09-21T05:54:03.412 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.412 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.412 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.412 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.412 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.412 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.412 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.413 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_support", 2024-09-21T05:54:03.413 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.413 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.413 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.413 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.413 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.413 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.413 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.413 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.413 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.413 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.413 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.413 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.414 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.414 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.414 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.414 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.414 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.414 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.414 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.414 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.414 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.414 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.414 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.414 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.414 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.415 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.415 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.415 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.415 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.415 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.415 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.415 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.415 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.415 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.415 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.415 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.415 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.415 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.416 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.416 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.416 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.416 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.416 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.416 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.416 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.416 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.416 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.416 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.416 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.416 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.416 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.416 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.416 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.417 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.417 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.417 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.417 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.417 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.417 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.417 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.417 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.417 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.417 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.417 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.417 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.417 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.417 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.417 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.417 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.418 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_snap_create": { 2024-09-21T05:54:03.418 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_snap_create", 2024-09-21T05:54:03.418 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.418 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.418 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.418 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-21T05:54:03.418 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.418 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.418 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.418 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.418 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.418 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.418 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.418 INFO:teuthology.orchestra.run.smithi070.stdout: "mirror_snapshot_schedule": { 2024-09-21T05:54:03.419 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T05:54:03.419 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.419 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.419 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.419 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.419 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.419 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.419 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.419 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.419 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.419 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.419 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.419 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.419 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.420 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.420 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.420 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.420 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.420 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.420 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.420 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.420 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.420 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.420 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.420 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.420 INFO:teuthology.orchestra.run.smithi070.stdout: "trash_purge_schedule": { 2024-09-21T05:54:03.420 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "trash_purge_schedule", 2024-09-21T05:54:03.421 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.421 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.421 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.421 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.421 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.421 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.421 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.421 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.421 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.421 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.421 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.421 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.421 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.421 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "restful", 2024-09-21T05:54:03.422 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.422 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.422 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.422 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_auth": { 2024-09-21T05:54:03.422 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_auth", 2024-09-21T05:54:03.422 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.422 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.422 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.422 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.422 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.422 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.422 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.422 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.422 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.422 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.422 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.423 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2024-09-21T05:54:03.423 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2024-09-21T05:54:03.423 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.423 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.423 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.423 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.423 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.423 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.423 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.423 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.423 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.423 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.423 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.424 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.424 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.424 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.424 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.424 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.424 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.424 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.424 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.424 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.424 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.424 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.424 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.424 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.424 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.424 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.424 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.424 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.425 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.425 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.425 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.425 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.425 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.425 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.425 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.425 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.425 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.425 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.425 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.425 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.425 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.425 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.425 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.426 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.426 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.426 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.426 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.426 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.426 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.426 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.426 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.426 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.426 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.426 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.426 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.426 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.427 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.427 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.427 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.427 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.427 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.427 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.427 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.427 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.427 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.427 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.427 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.427 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.427 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.427 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.427 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.428 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.428 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.428 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.428 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.428 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.428 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.428 INFO:teuthology.orchestra.run.smithi070.stdout: "max_requests": { 2024-09-21T05:54:03.428 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_requests", 2024-09-21T05:54:03.428 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.428 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.428 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.428 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-09-21T05:54:03.428 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.428 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.428 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.428 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T05:54:03.429 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.429 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.429 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.429 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-09-21T05:54:03.429 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-09-21T05:54:03.429 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.429 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.429 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.429 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.429 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.429 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.429 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.429 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.429 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.429 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.430 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.430 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-09-21T05:54:03.430 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-09-21T05:54:03.430 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.430 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.430 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.430 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.430 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.430 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.430 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.430 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.430 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.430 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.430 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.431 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.431 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.431 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.431 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.431 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.431 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.431 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.431 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.431 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.431 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.431 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.431 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.432 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.432 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.432 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.432 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rgw", 2024-09-21T05:54:03.432 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.432 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.432 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.432 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.432 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.432 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.432 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.432 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.432 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.432 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.433 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.433 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.433 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.433 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.433 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.433 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.433 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.433 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.433 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.433 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.433 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.433 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.433 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.433 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.433 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.434 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.434 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.434 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.434 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.434 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.434 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.434 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.434 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.434 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.434 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.434 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.434 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.434 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.434 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.435 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.435 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.435 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.435 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.435 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.435 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.435 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.435 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.435 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.435 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.435 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.435 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.435 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.435 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.435 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.435 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.435 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.436 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.436 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.436 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.436 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.436 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.436 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.436 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.436 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.436 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.436 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.436 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.436 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.436 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.436 INFO:teuthology.orchestra.run.smithi070.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T05:54:03.437 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T05:54:03.437 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.437 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.437 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.437 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-21T05:54:03.437 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.437 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.437 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.437 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T05:54:03.437 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.437 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.437 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.437 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.437 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.437 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.438 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.438 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.438 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.438 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.438 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.438 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.438 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.438 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.438 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.438 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.438 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.438 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.438 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rook", 2024-09-21T05:54:03.439 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.439 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.439 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.439 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.439 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.439 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.439 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.439 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.439 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.439 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.439 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.439 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.439 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.439 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.439 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.439 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.439 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.440 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.440 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.440 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.440 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.440 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.440 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.440 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.440 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.440 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.440 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.440 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.440 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.440 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.440 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.441 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.441 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.441 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.441 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.441 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.441 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.441 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.441 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.441 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.441 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.441 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.441 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.441 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.441 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.441 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.441 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.442 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.442 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.442 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.442 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.442 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.442 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.442 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.442 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.442 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.442 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.442 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.442 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.442 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.442 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.442 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.442 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.443 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.443 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.443 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.443 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.443 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.443 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.443 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.443 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.443 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.443 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.443 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.443 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.443 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.444 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.444 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.444 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.444 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.444 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.444 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.444 INFO:teuthology.orchestra.run.smithi070.stdout: "storage_class": { 2024-09-21T05:54:03.444 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "storage_class", 2024-09-21T05:54:03.444 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.444 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.444 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.444 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "local", 2024-09-21T05:54:03.444 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.444 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.444 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.444 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T05:54:03.445 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.445 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.445 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.445 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.445 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.445 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "selftest", 2024-09-21T05:54:03.445 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.445 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.445 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.445 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.445 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.445 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.445 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.445 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.446 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.446 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.446 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.446 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.446 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.446 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.446 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.446 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.446 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.446 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.446 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.446 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.446 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.446 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.446 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.447 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.447 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.447 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.447 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.447 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.447 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.447 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.447 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.447 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.447 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.447 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.447 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.447 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.447 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.447 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.447 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.448 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.448 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.448 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.448 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.448 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.448 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.448 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.448 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.448 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.448 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.448 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.448 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.448 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.448 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.448 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.448 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.449 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.449 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.449 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.449 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.449 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.449 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.449 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.449 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.449 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.449 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.449 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.449 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.449 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.449 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.449 INFO:teuthology.orchestra.run.smithi070.stdout: "roption1": { 2024-09-21T05:54:03.450 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption1", 2024-09-21T05:54:03.450 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.450 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.450 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.450 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.450 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.450 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.450 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.450 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.450 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.450 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.450 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.450 INFO:teuthology.orchestra.run.smithi070.stdout: "roption2": { 2024-09-21T05:54:03.450 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption2", 2024-09-21T05:54:03.450 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.450 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.451 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.451 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "xyz", 2024-09-21T05:54:03.451 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.451 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.451 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.451 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.451 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.451 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.451 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.451 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption1": { 2024-09-21T05:54:03.451 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption1", 2024-09-21T05:54:03.451 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.451 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.451 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.451 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.451 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.452 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.452 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.452 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.452 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.452 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.452 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.452 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption2": { 2024-09-21T05:54:03.452 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption2", 2024-09-21T05:54:03.452 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.452 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.452 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.452 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.452 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.452 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.452 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.452 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.453 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.453 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.453 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.453 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption3": { 2024-09-21T05:54:03.453 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption3", 2024-09-21T05:54:03.453 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-21T05:54:03.453 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.453 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.453 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.453 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.453 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.453 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.453 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.453 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.453 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.453 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.454 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption4": { 2024-09-21T05:54:03.454 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption4", 2024-09-21T05:54:03.454 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.454 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.454 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.454 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.454 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.454 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.454 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.454 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.454 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.454 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.454 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.454 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption5": { 2024-09-21T05:54:03.454 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption5", 2024-09-21T05:54:03.455 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.455 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.455 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.455 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.455 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.455 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.455 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.455 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.455 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.455 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.455 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.455 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption6": { 2024-09-21T05:54:03.455 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption6", 2024-09-21T05:54:03.455 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.456 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.456 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.456 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.456 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.456 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.456 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.456 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.456 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.456 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.456 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.456 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption7": { 2024-09-21T05:54:03.456 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption7", 2024-09-21T05:54:03.456 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.456 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.457 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.457 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.457 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-21T05:54:03.457 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "42", 2024-09-21T05:54:03.457 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.457 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.457 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.457 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.457 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.457 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.457 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.457 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.457 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.457 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.457 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.457 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.458 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.458 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.458 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.458 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.458 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.458 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.458 INFO:teuthology.orchestra.run.smithi070.stdout: "testkey": { 2024-09-21T05:54:03.458 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testkey", 2024-09-21T05:54:03.458 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.458 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.458 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.458 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.458 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.459 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.459 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.459 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.459 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.459 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.459 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.459 INFO:teuthology.orchestra.run.smithi070.stdout: "testlkey": { 2024-09-21T05:54:03.459 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testlkey", 2024-09-21T05:54:03.459 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.459 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.459 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.459 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.459 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.459 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.460 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.460 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.460 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.460 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.460 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.460 INFO:teuthology.orchestra.run.smithi070.stdout: "testnewline": { 2024-09-21T05:54:03.460 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testnewline", 2024-09-21T05:54:03.460 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.460 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.460 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.460 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.460 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.460 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.460 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.460 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.461 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.461 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.461 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.461 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.461 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.461 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smb", 2024-09-21T05:54:03.461 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.461 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.461 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.461 INFO:teuthology.orchestra.run.smithi070.stdout: "internal_store_backend": { 2024-09-21T05:54:03.461 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "internal_store_backend", 2024-09-21T05:54:03.461 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.461 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.461 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.462 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.462 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.462 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.462 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.462 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T05:54:03.462 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.462 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.462 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.462 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.462 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.462 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.462 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.462 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.462 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.463 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.463 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.463 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.463 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.463 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.463 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.463 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.463 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.463 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.463 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.463 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.463 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.463 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.463 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.463 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.464 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.464 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.464 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.464 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.464 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.464 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.464 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.464 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.464 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.464 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.464 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.464 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.464 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.464 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.464 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.464 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.465 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.465 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.465 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.465 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.465 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.465 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.465 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.465 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.465 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.465 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.465 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.465 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.465 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.465 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.465 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.465 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.466 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.466 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.466 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.466 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.466 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.466 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.466 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.466 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.466 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.466 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.466 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.466 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.466 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.467 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.467 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.467 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.467 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.467 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.467 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.467 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.467 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.467 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.467 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.467 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.467 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.467 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.467 INFO:teuthology.orchestra.run.smithi070.stdout: "update_orchestration": { 2024-09-21T05:54:03.467 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "update_orchestration", 2024-09-21T05:54:03.468 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.468 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.468 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.468 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.468 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.468 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.468 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.468 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T05:54:03.468 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.468 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.468 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.468 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.468 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.468 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snap_schedule", 2024-09-21T05:54:03.469 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.469 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.469 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.469 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_m_granularity": { 2024-09-21T05:54:03.469 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_m_granularity", 2024-09-21T05:54:03.469 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.469 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.469 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.469 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.469 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.469 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.469 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.469 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T05:54:03.469 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.469 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.469 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.470 INFO:teuthology.orchestra.run.smithi070.stdout: "dump_on_update": { 2024-09-21T05:54:03.470 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dump_on_update", 2024-09-21T05:54:03.470 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.470 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.470 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.470 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.470 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.470 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.470 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.470 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "dump database to debug log on update", 2024-09-21T05:54:03.470 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.470 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.470 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.471 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.471 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.471 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.471 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.471 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.471 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.471 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.471 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.471 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.471 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.471 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.471 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.471 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.471 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.472 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.472 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.472 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.472 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.472 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.472 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.472 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.472 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.472 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.472 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.472 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.472 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.472 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.472 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.472 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.472 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.473 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.473 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.473 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.473 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.473 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.473 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.473 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.473 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.473 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.473 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.473 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.473 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.473 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.473 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.473 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.474 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.474 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.474 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.474 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.474 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.474 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.474 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.474 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.474 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.474 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.474 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.474 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.474 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.474 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.475 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.475 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.475 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.475 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.475 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.475 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.475 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.475 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.475 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.475 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.475 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.475 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.475 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.475 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.476 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.476 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.476 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.476 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.476 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.476 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.476 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.476 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.476 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stats", 2024-09-21T05:54:03.476 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.476 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.476 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.476 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.477 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.477 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.477 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.477 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.477 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.477 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.477 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.477 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.477 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.477 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.477 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.477 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.477 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.477 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.477 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.478 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.478 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.478 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.478 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.478 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.478 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.478 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.478 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.478 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.478 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.478 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.478 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.478 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.478 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.478 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.479 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.479 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.479 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.479 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.479 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.479 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.479 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.479 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.479 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.479 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.479 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.479 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.479 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.479 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.480 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.480 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.480 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.480 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.480 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.480 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.480 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.480 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.480 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.480 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.480 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.480 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.480 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.480 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.480 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.481 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.481 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.481 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.481 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.481 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.481 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.481 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.481 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.481 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.481 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.481 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.481 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.481 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.482 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.482 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.482 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.482 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.482 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.482 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.482 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.482 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.482 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "status", 2024-09-21T05:54:03.482 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.482 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.482 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.482 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.483 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.483 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.483 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.483 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.483 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.483 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.483 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.483 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.483 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.483 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.483 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.483 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.483 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.483 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.484 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.484 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.484 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.484 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.484 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.484 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.484 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.484 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.484 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.484 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.484 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.484 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.484 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.484 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.485 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.485 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.485 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.485 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.485 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.485 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.485 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.485 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.485 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.485 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.485 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.485 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.485 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.485 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.486 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.486 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.486 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.486 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.486 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.486 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.486 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.486 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.486 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.486 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.486 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.486 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.486 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.486 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.486 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.487 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.487 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.487 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.487 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.487 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.487 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.487 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.487 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.487 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.487 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.487 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.487 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.487 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.487 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.487 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.487 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.488 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.488 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.488 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.488 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.488 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.488 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.488 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.488 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telegraf", 2024-09-21T05:54:03.488 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.488 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.488 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.488 INFO:teuthology.orchestra.run.smithi070.stdout: "address": { 2024-09-21T05:54:03.489 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "address", 2024-09-21T05:54:03.489 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.489 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.489 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.489 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T05:54:03.489 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.489 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.489 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.489 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.489 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.489 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.489 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.489 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-21T05:54:03.490 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-21T05:54:03.490 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.490 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.490 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.490 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15", 2024-09-21T05:54:03.490 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.490 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.490 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.490 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.490 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.490 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.490 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.490 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.491 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.491 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.491 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.491 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.491 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.491 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.491 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.491 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.491 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.491 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.491 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.491 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.491 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.491 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.491 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.491 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.491 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.492 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.492 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.492 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.492 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.492 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.492 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.492 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.492 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.492 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.492 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.492 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.492 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.492 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.493 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.493 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.493 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.493 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.493 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.493 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.493 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.493 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.493 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.493 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.493 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.493 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.493 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.493 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.494 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.494 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.494 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.494 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.494 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.494 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.494 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.494 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.494 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.494 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.494 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.494 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.494 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.494 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.495 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.495 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.495 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.495 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.495 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.495 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.495 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.495 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.495 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.495 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.495 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.495 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.495 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.495 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.496 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.496 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.496 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.496 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.496 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.496 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.496 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.496 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.496 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telemetry", 2024-09-21T05:54:03.496 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.496 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.496 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.496 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_basic": { 2024-09-21T05:54:03.497 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_basic", 2024-09-21T05:54:03.497 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.497 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.497 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.497 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.497 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.497 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.497 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.497 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T05:54:03.497 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.497 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.497 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.497 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_crash": { 2024-09-21T05:54:03.497 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_crash", 2024-09-21T05:54:03.497 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.498 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.498 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.498 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.498 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.498 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.498 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.498 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T05:54:03.498 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.498 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.498 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.498 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_device": { 2024-09-21T05:54:03.498 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_device", 2024-09-21T05:54:03.498 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.498 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.499 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.499 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.499 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.499 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.499 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.499 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T05:54:03.499 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.499 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.499 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.499 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_ident": { 2024-09-21T05:54:03.499 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_ident", 2024-09-21T05:54:03.499 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.499 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.499 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.499 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.500 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.500 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.500 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.500 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T05:54:03.500 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.500 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.500 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.500 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_perf": { 2024-09-21T05:54:03.500 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_perf", 2024-09-21T05:54:03.500 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.500 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.500 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.500 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.500 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.500 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.500 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.501 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T05:54:03.501 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.501 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.501 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.501 INFO:teuthology.orchestra.run.smithi070.stdout: "contact": { 2024-09-21T05:54:03.501 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "contact", 2024-09-21T05:54:03.501 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.501 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.501 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.501 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.501 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.501 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.501 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.501 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.501 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.501 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.502 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.502 INFO:teuthology.orchestra.run.smithi070.stdout: "description": { 2024-09-21T05:54:03.502 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "description", 2024-09-21T05:54:03.502 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.502 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.502 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.502 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.502 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.502 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.502 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.502 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.502 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.502 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.502 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.503 INFO:teuthology.orchestra.run.smithi070.stdout: "device_url": { 2024-09-21T05:54:03.503 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_url", 2024-09-21T05:54:03.503 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.503 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.503 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.503 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T05:54:03.503 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.503 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.503 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.503 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.503 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.503 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.503 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.503 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2024-09-21T05:54:03.503 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2024-09-21T05:54:03.504 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.504 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.504 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.504 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.504 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.504 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.504 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.504 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.504 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.504 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.504 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.504 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-21T05:54:03.504 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-21T05:54:03.504 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.504 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.504 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.504 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "24", 2024-09-21T05:54:03.505 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "8", 2024-09-21T05:54:03.505 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.505 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.505 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.505 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.505 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.505 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.505 INFO:teuthology.orchestra.run.smithi070.stdout: "last_opt_revision": { 2024-09-21T05:54:03.505 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "last_opt_revision", 2024-09-21T05:54:03.505 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.505 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.505 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.505 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1", 2024-09-21T05:54:03.505 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.505 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.506 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.506 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.506 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.506 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.506 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.506 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard": { 2024-09-21T05:54:03.506 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard", 2024-09-21T05:54:03.506 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.506 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.506 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.506 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.506 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.506 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.506 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.506 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.507 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.507 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.507 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.507 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard_description": { 2024-09-21T05:54:03.507 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard_description", 2024-09-21T05:54:03.507 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.507 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.507 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.507 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.507 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.507 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.507 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.507 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.507 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.507 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.508 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.508 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.508 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.508 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.508 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.508 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.508 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.508 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.508 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.508 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.508 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.508 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.508 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.508 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.508 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.509 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.509 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.509 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.509 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.509 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.509 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.509 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.509 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.509 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.509 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.509 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.509 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.509 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.509 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.509 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.509 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.510 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.510 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.510 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.510 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.510 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.510 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.510 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.510 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.510 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.510 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.510 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.510 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.510 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.510 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.511 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.511 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.511 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.511 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.511 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.511 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.511 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.511 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.511 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.511 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.511 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.511 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.511 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.511 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.511 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.512 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.512 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.512 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.512 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.512 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.512 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.512 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.512 INFO:teuthology.orchestra.run.smithi070.stdout: "organization": { 2024-09-21T05:54:03.512 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "organization", 2024-09-21T05:54:03.512 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.512 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.512 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.512 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.512 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.513 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.513 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.513 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.513 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.513 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.513 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.513 INFO:teuthology.orchestra.run.smithi070.stdout: "proxy": { 2024-09-21T05:54:03.513 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "proxy", 2024-09-21T05:54:03.513 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.513 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.513 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.513 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.513 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.513 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.513 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.513 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.514 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.514 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.514 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.514 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.514 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.514 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.514 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.514 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.514 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.514 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.514 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.514 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.515 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.515 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.515 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.515 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.515 INFO:teuthology.orchestra.run.smithi070.stdout: "url": { 2024-09-21T05:54:03.515 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url", 2024-09-21T05:54:03.515 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.515 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.515 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.515 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T05:54:03.515 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.515 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.516 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.516 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.516 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.516 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.516 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.516 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.516 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.516 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "test_orchestrator", 2024-09-21T05:54:03.516 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.516 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.516 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.516 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.516 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.516 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.516 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.517 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.517 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.517 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.517 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.517 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.517 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.517 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.517 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.517 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.517 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.517 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.517 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.517 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.517 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.517 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.517 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.518 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.518 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.518 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.518 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.518 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.518 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.518 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.518 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.518 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.518 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.518 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.518 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.518 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.518 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.519 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.519 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.519 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.519 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.519 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.519 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.519 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.519 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.519 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.519 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.519 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.519 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.519 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.519 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.519 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.519 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.520 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.520 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.520 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.520 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.520 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.520 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.520 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.520 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.520 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.520 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.520 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.520 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.520 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.520 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.520 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.520 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.521 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.521 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.521 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.521 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.521 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.521 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.521 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.521 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.521 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.521 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.521 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.521 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.521 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.521 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.521 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.522 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "volumes", 2024-09-21T05:54:03.522 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.522 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.522 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.522 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.522 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.522 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.522 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.522 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.522 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.522 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.522 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.522 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.522 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.523 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.523 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.523 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.523 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.523 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.523 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.523 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.523 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.523 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.523 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.523 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.523 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.523 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.523 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.523 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.523 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.524 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.524 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.524 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.524 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.524 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.524 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.524 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.524 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.524 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.524 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.524 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.524 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.524 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.524 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.524 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.525 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.525 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.525 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.525 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.525 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.525 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.525 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.525 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.525 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.525 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.525 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.525 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.525 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.525 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.525 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.525 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.526 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.526 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.526 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.526 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.526 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.526 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.526 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.526 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.526 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.526 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_clones": { 2024-09-21T05:54:03.526 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_clones", 2024-09-21T05:54:03.526 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.526 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.526 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.527 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4", 2024-09-21T05:54:03.527 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.527 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.527 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.527 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T05:54:03.527 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.527 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.527 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.527 INFO:teuthology.orchestra.run.smithi070.stdout: "periodic_async_work": { 2024-09-21T05:54:03.527 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "periodic_async_work", 2024-09-21T05:54:03.527 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.527 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.527 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.527 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.527 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.528 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.528 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.528 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Periodically check for async work", 2024-09-21T05:54:03.528 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.528 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.528 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.528 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_delay": { 2024-09-21T05:54:03.528 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_delay", 2024-09-21T05:54:03.528 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.528 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.528 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.528 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.528 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.528 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.528 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.528 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T05:54:03.529 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.529 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.529 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.529 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_no_wait": { 2024-09-21T05:54:03.529 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T05:54:03.529 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.529 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.529 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.529 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.529 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.529 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.529 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.529 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T05:54:03.529 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.529 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.529 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.530 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.530 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.530 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.530 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.530 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.530 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.530 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.530 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.530 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.530 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.530 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.530 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.530 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.530 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.531 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix", 2024-09-21T05:54:03.531 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.531 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.531 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.531 INFO:teuthology.orchestra.run.smithi070.stdout: "discovery_interval": { 2024-09-21T05:54:03.531 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "discovery_interval", 2024-09-21T05:54:03.531 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-21T05:54:03.531 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.531 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.531 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "100", 2024-09-21T05:54:03.531 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.531 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.531 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.532 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.532 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.532 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.532 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.532 INFO:teuthology.orchestra.run.smithi070.stdout: "identifier": { 2024-09-21T05:54:03.532 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "identifier", 2024-09-21T05:54:03.532 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.532 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.532 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.532 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.532 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.532 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.532 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.532 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.532 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.532 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.533 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.533 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-21T05:54:03.533 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-21T05:54:03.533 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.533 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.533 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.533 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-21T05:54:03.533 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.533 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.533 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.533 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.533 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.533 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.533 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.533 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.534 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.534 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.534 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.534 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.534 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.534 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.534 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.534 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.534 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.534 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.534 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.534 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.534 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.534 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.535 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.535 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.535 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.535 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.535 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.535 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.535 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.535 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.535 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.535 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.535 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.536 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.536 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.536 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.536 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.536 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.536 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.536 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.536 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.536 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.536 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.536 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.536 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.537 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.537 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.537 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.537 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.537 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.537 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.537 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.537 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.537 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.537 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.537 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.537 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.537 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.537 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.537 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.538 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.538 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.538 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.538 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.538 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.538 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.538 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.538 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.538 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.538 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.538 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.538 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.538 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.539 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.539 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.539 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.539 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.539 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.539 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.539 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.539 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.539 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.539 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.539 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.539 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.539 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.539 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_host": { 2024-09-21T05:54:03.539 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_host", 2024-09-21T05:54:03.540 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.540 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.540 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.540 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.540 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.540 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.540 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.540 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.540 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.540 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.540 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.540 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_port": { 2024-09-21T05:54:03.540 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_port", 2024-09-21T05:54:03.540 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.540 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.541 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.541 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10051", 2024-09-21T05:54:03.541 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.541 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.541 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.541 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.541 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.541 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.541 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.541 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_sender": { 2024-09-21T05:54:03.541 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_sender", 2024-09-21T05:54:03.541 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.541 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.541 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.541 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T05:54:03.542 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.542 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.542 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.542 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.542 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.542 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.542 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.542 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.542 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.542 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.542 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-21T05:54:03.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.543 INFO:teuthology.orchestra.run.smithi070.stdout: "gid": 24134, 2024-09-21T05:54:03.543 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "y", 2024-09-21T05:54:03.543 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_features": 4540719139924082687, 2024-09-21T05:54:03.543 INFO:teuthology.orchestra.run.smithi070.stdout: "available_modules": [ 2024-09-21T05:54:03.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.543 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "alerts", 2024-09-21T05:54:03.543 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.543 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.543 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.543 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-21T05:54:03.543 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-21T05:54:03.543 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.543 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.543 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.543 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-21T05:54:03.543 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.544 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.544 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.544 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T05:54:03.544 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.544 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.544 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.544 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.544 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.544 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.544 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.544 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.544 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.544 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.544 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.545 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.545 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.545 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.545 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.545 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.545 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.545 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.545 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.545 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.545 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.545 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.545 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.545 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.545 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.545 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.546 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.546 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.546 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.546 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.546 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.546 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.546 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.546 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.546 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.546 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.546 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.546 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.546 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.546 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.546 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.547 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.547 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.547 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.547 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.547 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.547 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.547 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.547 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.547 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.547 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.547 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.547 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.547 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.547 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.547 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.548 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.548 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.548 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.548 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.548 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.548 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.548 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.548 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.548 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.548 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.548 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.548 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.548 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.548 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_destination": { 2024-09-21T05:54:03.549 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_destination", 2024-09-21T05:54:03.549 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.549 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.549 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.549 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.549 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.549 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.549 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.549 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T05:54:03.549 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.549 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.549 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.549 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_from_name": { 2024-09-21T05:54:03.550 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_from_name", 2024-09-21T05:54:03.550 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.550 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.550 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.550 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "Ceph", 2024-09-21T05:54:03.550 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.550 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.550 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.550 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email From: name", 2024-09-21T05:54:03.550 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.550 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.550 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.550 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_host": { 2024-09-21T05:54:03.550 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_host", 2024-09-21T05:54:03.551 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.551 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.551 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.551 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.551 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.551 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.551 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.551 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP server", 2024-09-21T05:54:03.551 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.551 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.551 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.551 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_password": { 2024-09-21T05:54:03.551 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_password", 2024-09-21T05:54:03.551 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.552 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.552 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.552 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.552 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.552 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.552 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.552 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Password to authenticate with", 2024-09-21T05:54:03.552 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.552 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.552 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.552 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_port": { 2024-09-21T05:54:03.552 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_port", 2024-09-21T05:54:03.552 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.553 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.553 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.553 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "465", 2024-09-21T05:54:03.553 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.553 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.553 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.553 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP port", 2024-09-21T05:54:03.553 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.553 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.553 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.553 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_sender": { 2024-09-21T05:54:03.553 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_sender", 2024-09-21T05:54:03.554 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.554 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.554 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.554 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.554 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.554 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.554 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.554 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP envelope sender", 2024-09-21T05:54:03.554 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.554 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.554 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.554 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_ssl": { 2024-09-21T05:54:03.554 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_ssl", 2024-09-21T05:54:03.555 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.555 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.555 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.555 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.555 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.555 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.555 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.555 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T05:54:03.555 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.555 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.555 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.555 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_user": { 2024-09-21T05:54:03.555 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_user", 2024-09-21T05:54:03.556 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.556 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.556 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.556 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.556 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.556 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.556 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.556 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "User to authenticate as", 2024-09-21T05:54:03.556 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.556 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.556 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.556 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.556 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.556 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.556 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.557 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.557 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.557 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.557 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.557 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.557 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.557 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.557 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.557 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.557 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.557 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.557 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "balancer", 2024-09-21T05:54:03.557 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.557 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.558 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.558 INFO:teuthology.orchestra.run.smithi070.stdout: "active": { 2024-09-21T05:54:03.558 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "active", 2024-09-21T05:54:03.558 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.558 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.558 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.558 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.558 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.558 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.558 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.558 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T05:54:03.558 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.558 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.558 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.559 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_time": { 2024-09-21T05:54:03.559 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_time", 2024-09-21T05:54:03.559 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.559 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.559 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.559 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0000", 2024-09-21T05:54:03.559 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.559 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.559 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.559 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T05:54:03.559 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T05:54:03.559 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.559 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.559 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_weekday": { 2024-09-21T05:54:03.559 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_weekday", 2024-09-21T05:54:03.560 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-21T05:54:03.560 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.560 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.560 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.560 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2024-09-21T05:54:03.560 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2024-09-21T05:54:03.560 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.560 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T05:54:03.560 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T05:54:03.560 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.560 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.560 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_max_iterations": { 2024-09-21T05:54:03.560 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_max_iterations", 2024-09-21T05:54:03.560 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-21T05:54:03.560 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.561 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.561 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "25", 2024-09-21T05:54:03.561 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-21T05:54:03.561 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "250", 2024-09-21T05:54:03.561 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.561 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T05:54:03.561 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.561 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.561 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.561 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_metrics": { 2024-09-21T05:54:03.561 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_metrics", 2024-09-21T05:54:03.561 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.561 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.561 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.562 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T05:54:03.562 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.562 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.562 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.562 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T05:54:03.562 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T05:54:03.562 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.562 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.562 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_step": { 2024-09-21T05:54:03.562 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_step", 2024-09-21T05:54:03.562 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-21T05:54:03.562 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.562 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.562 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.5", 2024-09-21T05:54:03.562 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0.001", 2024-09-21T05:54:03.563 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "0.999", 2024-09-21T05:54:03.563 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.563 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "aggressiveness of optimization", 2024-09-21T05:54:03.563 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T05:54:03.563 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.563 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.563 INFO:teuthology.orchestra.run.smithi070.stdout: "end_time": { 2024-09-21T05:54:03.563 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_time", 2024-09-21T05:54:03.563 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.563 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.563 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.563 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2359", 2024-09-21T05:54:03.563 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.563 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.563 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.564 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T05:54:03.564 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T05:54:03.564 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.564 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.564 INFO:teuthology.orchestra.run.smithi070.stdout: "end_weekday": { 2024-09-21T05:54:03.564 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_weekday", 2024-09-21T05:54:03.564 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-21T05:54:03.564 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.564 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.564 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.564 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2024-09-21T05:54:03.564 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2024-09-21T05:54:03.564 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.564 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T05:54:03.564 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T05:54:03.565 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.565 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.565 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.565 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.565 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.565 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.565 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.565 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.565 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.565 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.565 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.565 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.565 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.565 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.565 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.565 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.566 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.566 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.566 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.566 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.566 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.566 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.566 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.566 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.566 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.566 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.566 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.566 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.566 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.567 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.567 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.567 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.567 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.567 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.567 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.567 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.567 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.567 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.567 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.567 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.567 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.567 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.567 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.567 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.568 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.568 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.568 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.568 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.568 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.568 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.568 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.568 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.568 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.568 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.568 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.568 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.568 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.568 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.568 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.568 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.569 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.569 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.569 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.569 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.569 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.569 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.569 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.569 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.569 INFO:teuthology.orchestra.run.smithi070.stdout: "min_score": { 2024-09-21T05:54:03.569 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_score", 2024-09-21T05:54:03.569 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-21T05:54:03.569 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.569 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.569 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.569 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.570 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.570 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.570 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T05:54:03.570 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.570 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.570 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.570 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2024-09-21T05:54:03.570 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2024-09-21T05:54:03.570 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.570 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.570 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.570 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "upmap", 2024-09-21T05:54:03.570 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.570 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.570 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.571 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-compat", 2024-09-21T05:54:03.571 INFO:teuthology.orchestra.run.smithi070.stdout: "none", 2024-09-21T05:54:03.571 INFO:teuthology.orchestra.run.smithi070.stdout: "read", 2024-09-21T05:54:03.571 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap", 2024-09-21T05:54:03.571 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap-read" 2024-09-21T05:54:03.571 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.571 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Balancer mode", 2024-09-21T05:54:03.571 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.571 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.571 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.571 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_ids": { 2024-09-21T05:54:03.571 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_ids", 2024-09-21T05:54:03.571 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.571 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.571 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.572 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.572 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.572 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.572 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.572 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T05:54:03.572 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.572 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.572 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.572 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-21T05:54:03.572 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-21T05:54:03.572 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.572 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.572 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.573 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-21T05:54:03.573 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.573 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.573 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.573 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T05:54:03.573 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.573 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.573 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.573 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.573 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.573 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.573 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.573 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.574 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.574 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.574 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.574 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.574 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.574 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.574 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.574 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.574 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_deviation": { 2024-09-21T05:54:03.574 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_deviation", 2024-09-21T05:54:03.574 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.574 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.574 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.575 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-21T05:54:03.575 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-21T05:54:03.575 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.575 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.575 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T05:54:03.575 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T05:54:03.575 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.575 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.575 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_optimizations": { 2024-09-21T05:54:03.575 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_optimizations", 2024-09-21T05:54:03.575 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-21T05:54:03.575 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.575 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.575 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-21T05:54:03.575 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.576 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.576 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.576 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T05:54:03.576 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.576 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.576 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.576 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.576 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.576 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm", 2024-09-21T05:54:03.576 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.576 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.576 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.576 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_down_multiplier": { 2024-09-21T05:54:03.577 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_down_multiplier", 2024-09-21T05:54:03.577 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-21T05:54:03.577 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.577 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.577 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2024-09-21T05:54:03.577 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.577 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.577 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.577 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T05:54:03.577 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.577 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.577 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.577 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_refresh_rate": { 2024-09-21T05:54:03.578 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_refresh_rate", 2024-09-21T05:54:03.578 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.578 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.578 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.578 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "20", 2024-09-21T05:54:03.578 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.578 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.578 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.578 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T05:54:03.578 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.578 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.578 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.579 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_starting_port": { 2024-09-21T05:54:03.579 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_starting_port", 2024-09-21T05:54:03.579 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.579 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.579 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.579 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4721", 2024-09-21T05:54:03.579 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.579 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.579 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.579 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T05:54:03.579 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.579 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.579 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.580 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_ptrace": { 2024-09-21T05:54:03.580 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_ptrace", 2024-09-21T05:54:03.580 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.580 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.580 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.580 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.580 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.580 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.580 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.580 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T05:54:03.580 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T05:54:03.580 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.580 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.581 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_interval": { 2024-09-21T05:54:03.581 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_interval", 2024-09-21T05:54:03.581 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.581 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.581 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.581 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-21T05:54:03.581 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.581 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.581 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.581 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T05:54:03.581 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.581 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.581 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.582 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_memory_target_ratio": { 2024-09-21T05:54:03.582 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T05:54:03.582 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-21T05:54:03.582 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.582 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.582 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.7", 2024-09-21T05:54:03.582 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.582 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.582 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.582 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T05:54:03.582 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.582 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.583 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.583 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm_log_destination": { 2024-09-21T05:54:03.583 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm_log_destination", 2024-09-21T05:54:03.583 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.583 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.583 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.583 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.583 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.583 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.583 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.583 INFO:teuthology.orchestra.run.smithi070.stdout: "file", 2024-09-21T05:54:03.583 INFO:teuthology.orchestra.run.smithi070.stdout: "file,syslog", 2024-09-21T05:54:03.584 INFO:teuthology.orchestra.run.smithi070.stdout: "syslog" 2024-09-21T05:54:03.584 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.584 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T05:54:03.584 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.584 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.584 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.584 INFO:teuthology.orchestra.run.smithi070.stdout: "cgroups_split": { 2024-09-21T05:54:03.584 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cgroups_split", 2024-09-21T05:54:03.584 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.584 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.584 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.584 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.584 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.584 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.585 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.585 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T05:54:03.585 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.585 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.585 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.585 INFO:teuthology.orchestra.run.smithi070.stdout: "config_checks_enabled": { 2024-09-21T05:54:03.585 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_checks_enabled", 2024-09-21T05:54:03.585 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.585 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.585 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.585 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.585 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.585 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.585 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.586 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T05:54:03.586 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.586 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.586 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.586 INFO:teuthology.orchestra.run.smithi070.stdout: "config_dashboard": { 2024-09-21T05:54:03.586 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_dashboard", 2024-09-21T05:54:03.586 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.586 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.586 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.586 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.586 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.586 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.587 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.587 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T05:54:03.587 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.587 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.587 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.587 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_alertmanager": { 2024-09-21T05:54:03.587 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_alertmanager", 2024-09-21T05:54:03.587 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.587 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.587 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.587 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T05:54:03.587 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.587 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.587 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.587 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-21T05:54:03.588 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.588 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.588 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.588 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_base": { 2024-09-21T05:54:03.588 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_base", 2024-09-21T05:54:03.588 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.588 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.588 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.588 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T05:54:03.588 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.588 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.588 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.588 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Container image name, without the tag", 2024-09-21T05:54:03.588 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.589 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.589 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.589 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_elasticsearch": { 2024-09-21T05:54:03.589 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_elasticsearch", 2024-09-21T05:54:03.589 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.589 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.589 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.589 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T05:54:03.589 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.589 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.589 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.589 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "elasticsearch container image", 2024-09-21T05:54:03.589 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.589 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.589 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.590 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_grafana": { 2024-09-21T05:54:03.590 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_grafana", 2024-09-21T05:54:03.590 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.590 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.590 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.590 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T05:54:03.590 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.590 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.590 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.590 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-21T05:54:03.590 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.590 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.590 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.591 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_haproxy": { 2024-09-21T05:54:03.591 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_haproxy", 2024-09-21T05:54:03.591 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.591 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.591 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.591 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T05:54:03.591 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.591 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.591 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.591 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "HAproxy container image", 2024-09-21T05:54:03.591 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.591 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.591 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.591 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_agent": { 2024-09-21T05:54:03.592 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_agent", 2024-09-21T05:54:03.592 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.592 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.592 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.592 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T05:54:03.592 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.592 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.592 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.592 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger agent container image", 2024-09-21T05:54:03.592 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.592 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.592 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.593 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_collector": { 2024-09-21T05:54:03.593 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_collector", 2024-09-21T05:54:03.593 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.593 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.593 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.593 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T05:54:03.593 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.593 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.593 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.593 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger collector container image", 2024-09-21T05:54:03.593 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.593 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.593 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.593 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_query": { 2024-09-21T05:54:03.593 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_query", 2024-09-21T05:54:03.594 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.594 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.594 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.594 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T05:54:03.594 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.594 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.594 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.594 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger query container image", 2024-09-21T05:54:03.594 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.594 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.594 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.594 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_keepalived": { 2024-09-21T05:54:03.594 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_keepalived", 2024-09-21T05:54:03.594 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.595 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.595 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.595 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T05:54:03.595 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.595 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.595 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.595 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Keepalived container image", 2024-09-21T05:54:03.595 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.595 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.595 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.595 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_loki": { 2024-09-21T05:54:03.595 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_loki", 2024-09-21T05:54:03.596 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.596 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.596 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.596 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T05:54:03.596 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.596 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.596 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.596 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Loki container image", 2024-09-21T05:54:03.596 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.596 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.596 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.596 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_nginx": { 2024-09-21T05:54:03.596 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_nginx", 2024-09-21T05:54:03.596 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.597 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.597 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.597 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T05:54:03.597 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.597 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.597 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.597 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Nginx container image", 2024-09-21T05:54:03.597 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.597 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.597 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.597 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_node_exporter": { 2024-09-21T05:54:03.597 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_node_exporter", 2024-09-21T05:54:03.597 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.597 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.597 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.598 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T05:54:03.598 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.598 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.598 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.598 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-21T05:54:03.598 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.598 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.598 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.598 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_nvmeof": { 2024-09-21T05:54:03.598 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_nvmeof", 2024-09-21T05:54:03.598 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.598 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.598 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.598 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T05:54:03.599 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.599 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.599 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.599 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Nvme-of container image", 2024-09-21T05:54:03.599 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.599 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.599 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.599 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_oauth2_proxy": { 2024-09-21T05:54:03.599 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T05:54:03.599 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.599 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.599 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.599 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T05:54:03.599 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.600 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.600 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.600 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "oauth2-proxy container image", 2024-09-21T05:54:03.600 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.600 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.600 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.600 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_prometheus": { 2024-09-21T05:54:03.600 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_prometheus", 2024-09-21T05:54:03.600 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.600 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.600 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.600 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T05:54:03.600 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.600 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.600 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.601 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-21T05:54:03.601 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.601 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.601 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.601 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_promtail": { 2024-09-21T05:54:03.601 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_promtail", 2024-09-21T05:54:03.601 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.601 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.601 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.601 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T05:54:03.601 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.601 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.601 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.602 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Promtail container image", 2024-09-21T05:54:03.602 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.602 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.602 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.602 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_samba": { 2024-09-21T05:54:03.602 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_samba", 2024-09-21T05:54:03.602 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.602 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.602 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.602 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T05:54:03.602 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.602 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.602 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.602 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Samba/SMB container image", 2024-09-21T05:54:03.603 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.603 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.603 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.603 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_samba_metrics": { 2024-09-21T05:54:03.603 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_samba_metrics", 2024-09-21T05:54:03.603 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.603 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.603 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.603 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T05:54:03.603 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.603 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.603 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.603 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T05:54:03.603 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.604 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.604 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.604 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_snmp_gateway": { 2024-09-21T05:54:03.604 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_snmp_gateway", 2024-09-21T05:54:03.604 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.604 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.604 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.604 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T05:54:03.604 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.604 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.604 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.604 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SNMP Gateway container image", 2024-09-21T05:54:03.604 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.604 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.604 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.605 INFO:teuthology.orchestra.run.smithi070.stdout: "container_init": { 2024-09-21T05:54:03.605 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_init", 2024-09-21T05:54:03.605 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.605 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.605 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.605 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.605 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.605 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.605 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.605 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T05:54:03.605 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.605 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.606 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.606 INFO:teuthology.orchestra.run.smithi070.stdout: "daemon_cache_timeout": { 2024-09-21T05:54:03.606 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "daemon_cache_timeout", 2024-09-21T05:54:03.606 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.606 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.606 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.606 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-21T05:54:03.606 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.606 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.606 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.606 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T05:54:03.606 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.606 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.607 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.607 INFO:teuthology.orchestra.run.smithi070.stdout: "default_cephadm_command_timeout": { 2024-09-21T05:54:03.607 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T05:54:03.607 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.607 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.607 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.607 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "900", 2024-09-21T05:54:03.607 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.607 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.607 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.607 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T05:54:03.607 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.607 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.607 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.608 INFO:teuthology.orchestra.run.smithi070.stdout: "default_registry": { 2024-09-21T05:54:03.608 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_registry", 2024-09-21T05:54:03.608 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.608 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.608 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.608 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io", 2024-09-21T05:54:03.608 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.608 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.608 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.608 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T05:54:03.608 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.608 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.608 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.609 INFO:teuthology.orchestra.run.smithi070.stdout: "device_cache_timeout": { 2024-09-21T05:54:03.609 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_cache_timeout", 2024-09-21T05:54:03.609 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.609 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.609 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.609 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1800", 2024-09-21T05:54:03.609 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.609 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.609 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.609 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache device inventory", 2024-09-21T05:54:03.609 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.609 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.609 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.609 INFO:teuthology.orchestra.run.smithi070.stdout: "device_enhanced_scan": { 2024-09-21T05:54:03.609 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_enhanced_scan", 2024-09-21T05:54:03.610 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.610 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.610 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.610 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.610 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.610 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.610 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.610 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T05:54:03.610 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.610 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.610 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.610 INFO:teuthology.orchestra.run.smithi070.stdout: "facts_cache_timeout": { 2024-09-21T05:54:03.610 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "facts_cache_timeout", 2024-09-21T05:54:03.610 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.610 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.611 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.611 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-21T05:54:03.611 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.611 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.611 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.611 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache host facts data", 2024-09-21T05:54:03.611 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.611 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.611 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.611 INFO:teuthology.orchestra.run.smithi070.stdout: "grafana_dashboards_path": { 2024-09-21T05:54:03.611 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "grafana_dashboards_path", 2024-09-21T05:54:03.611 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.611 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.611 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.611 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T05:54:03.612 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.612 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.612 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.612 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T05:54:03.612 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.612 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.612 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.612 INFO:teuthology.orchestra.run.smithi070.stdout: "host_check_interval": { 2024-09-21T05:54:03.612 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "host_check_interval", 2024-09-21T05:54:03.612 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.612 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.612 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.612 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-21T05:54:03.612 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.613 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.613 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.613 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to perform a host check", 2024-09-21T05:54:03.613 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.613 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.613 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.613 INFO:teuthology.orchestra.run.smithi070.stdout: "hw_monitoring": { 2024-09-21T05:54:03.613 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hw_monitoring", 2024-09-21T05:54:03.613 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.613 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.613 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.613 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.613 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.613 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.613 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.614 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T05:54:03.614 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.614 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.614 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.614 INFO:teuthology.orchestra.run.smithi070.stdout: "inventory_list_all": { 2024-09-21T05:54:03.614 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "inventory_list_all", 2024-09-21T05:54:03.614 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.614 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.614 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.614 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.614 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.614 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.615 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.615 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T05:54:03.615 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.615 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.615 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.615 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.615 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.615 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.615 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.615 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.615 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.615 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.615 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.615 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.616 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.616 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.616 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.616 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.616 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.616 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.616 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.616 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.616 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.616 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.616 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.616 INFO:teuthology.orchestra.run.smithi070.stdout: "log_refresh_metadata": { 2024-09-21T05:54:03.617 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_refresh_metadata", 2024-09-21T05:54:03.617 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.617 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.617 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.617 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.617 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.617 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.617 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.617 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T05:54:03.617 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.617 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.617 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.618 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.618 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.618 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.618 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.618 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.618 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.618 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.618 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.618 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.618 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T05:54:03.618 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.618 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.618 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.619 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.619 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.619 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.619 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.619 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.619 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.619 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.619 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.619 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.619 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.619 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.619 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.619 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.619 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.620 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.620 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.620 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.620 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.620 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.620 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.620 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.620 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.620 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.620 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.620 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.620 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.620 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.621 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.621 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.621 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.621 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.621 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.621 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.621 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T05:54:03.621 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T05:54:03.621 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.621 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.621 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.621 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.621 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.621 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.622 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.622 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T05:54:03.622 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.622 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.622 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.622 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T05:54:03.622 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T05:54:03.622 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.622 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.622 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.622 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "*", 2024-09-21T05:54:03.623 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.623 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.623 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.623 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T05:54:03.623 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.623 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.623 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.623 INFO:teuthology.orchestra.run.smithi070.stdout: "max_count_per_host": { 2024-09-21T05:54:03.623 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_count_per_host", 2024-09-21T05:54:03.623 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.623 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.623 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.623 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-21T05:54:03.624 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.624 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.624 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.624 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of daemons per service per host", 2024-09-21T05:54:03.624 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.624 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.624 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.624 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd_draining_count": { 2024-09-21T05:54:03.624 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_osd_draining_count", 2024-09-21T05:54:03.624 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.624 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.624 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.624 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-21T05:54:03.624 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.625 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.625 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.625 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T05:54:03.625 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.625 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.625 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.625 INFO:teuthology.orchestra.run.smithi070.stdout: "migration_current": { 2024-09-21T05:54:03.625 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "migration_current", 2024-09-21T05:54:03.625 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.625 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.625 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.625 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.625 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.625 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.626 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.626 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "internal - do not modify", 2024-09-21T05:54:03.626 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.626 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.626 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.626 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2024-09-21T05:54:03.626 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2024-09-21T05:54:03.626 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.626 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.626 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.626 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "root", 2024-09-21T05:54:03.626 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.626 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.627 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.627 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm-package", 2024-09-21T05:54:03.627 INFO:teuthology.orchestra.run.smithi070.stdout: "root" 2024-09-21T05:54:03.627 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.627 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T05:54:03.627 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.627 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.627 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.627 INFO:teuthology.orchestra.run.smithi070.stdout: "oob_default_addr": { 2024-09-21T05:54:03.627 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "oob_default_addr", 2024-09-21T05:54:03.627 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.627 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.627 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.627 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "169.254.1.1", 2024-09-21T05:54:03.628 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.628 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.628 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.628 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T05:54:03.628 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.628 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.628 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.628 INFO:teuthology.orchestra.run.smithi070.stdout: "prometheus_alerts_path": { 2024-09-21T05:54:03.628 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus_alerts_path", 2024-09-21T05:54:03.628 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.628 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.628 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.628 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T05:54:03.628 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.628 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.629 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.629 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T05:54:03.629 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.629 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.629 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.629 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_insecure": { 2024-09-21T05:54:03.629 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_insecure", 2024-09-21T05:54:03.629 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.629 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.629 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.629 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.629 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.629 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.629 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.629 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T05:54:03.630 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.630 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.630 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.630 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_password": { 2024-09-21T05:54:03.630 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_password", 2024-09-21T05:54:03.630 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.630 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.630 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.630 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.630 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.630 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.630 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.630 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T05:54:03.630 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.631 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.631 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.631 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_url": { 2024-09-21T05:54:03.631 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_url", 2024-09-21T05:54:03.631 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.631 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.631 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.631 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.631 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.631 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.631 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.631 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T05:54:03.631 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.631 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.631 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.632 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_username": { 2024-09-21T05:54:03.632 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_username", 2024-09-21T05:54:03.632 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.632 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.632 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.632 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.632 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.632 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.632 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.632 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T05:54:03.632 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.632 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.632 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.632 INFO:teuthology.orchestra.run.smithi070.stdout: "secure_monitoring_stack": { 2024-09-21T05:54:03.633 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "secure_monitoring_stack", 2024-09-21T05:54:03.633 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.633 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.633 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.633 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.633 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.633 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.633 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.633 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T05:54:03.633 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.633 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.633 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.633 INFO:teuthology.orchestra.run.smithi070.stdout: "service_discovery_port": { 2024-09-21T05:54:03.633 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "service_discovery_port", 2024-09-21T05:54:03.634 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.634 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.634 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.634 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8765", 2024-09-21T05:54:03.634 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.634 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.634 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.634 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "cephadm service discovery port", 2024-09-21T05:54:03.634 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.634 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.634 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.634 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.634 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.634 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.634 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.635 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.635 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.635 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.635 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.635 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.635 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.635 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.635 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.635 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.635 INFO:teuthology.orchestra.run.smithi070.stdout: "ssh_config_file": { 2024-09-21T05:54:03.635 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssh_config_file", 2024-09-21T05:54:03.635 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.635 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.636 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.636 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.636 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.636 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.636 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.636 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T05:54:03.636 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.636 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.636 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.636 INFO:teuthology.orchestra.run.smithi070.stdout: "ssh_keepalive_count_max": { 2024-09-21T05:54:03.636 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T05:54:03.636 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.636 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.637 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.637 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3", 2024-09-21T05:54:03.637 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.637 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.637 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.637 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T05:54:03.637 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.637 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.637 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.637 INFO:teuthology.orchestra.run.smithi070.stdout: "ssh_keepalive_interval": { 2024-09-21T05:54:03.637 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssh_keepalive_interval", 2024-09-21T05:54:03.637 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.637 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.637 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.637 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7", 2024-09-21T05:54:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T05:54:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: "use_agent": { 2024-09-21T05:54:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_agent", 2024-09-21T05:54:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T05:54:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: "use_repo_digest": { 2024-09-21T05:54:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_repo_digest", 2024-09-21T05:54:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T05:54:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_failed_host_check": { 2024-09-21T05:54:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_failed_host_check", 2024-09-21T05:54:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T05:54:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_daemons": { 2024-09-21T05:54:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_daemons", 2024-09-21T05:54:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T05:54:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_hosts": { 2024-09-21T05:54:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_hosts", 2024-09-21T05:54:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T05:54:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crash", 2024-09-21T05:54:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: "retain_interval": { 2024-09-21T05:54:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retain_interval", 2024-09-21T05:54:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "31536000", 2024-09-21T05:54:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T05:54:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_recent_interval": { 2024-09-21T05:54:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_recent_interval", 2024-09-21T05:54:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1209600", 2024-09-21T05:54:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T05:54:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dashboard", 2024-09-21T05:54:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T05:54:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T05:54:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-21T05:54:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T05:54:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T05:54:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T05:54:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T05:54:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_ENABLED": { 2024-09-21T05:54:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T05:54:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T05:54:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T05:54:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T05:54:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T05:54:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T05:54:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T05:54:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T05:54:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T05:54:03.659 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.659 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.659 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.659 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.659 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.659 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.659 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.659 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.659 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.659 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.659 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.659 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T05:54:03.659 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T05:54:03.659 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.659 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T05:54:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T05:54:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T05:54:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T05:54:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T05:54:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T05:54:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T05:54:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T05:54:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T05:54:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T05:54:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T05:54:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T05:54:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-09-21T05:54:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T05:54:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T05:54:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_URL": { 2024-09-21T05:54:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_URL", 2024-09-21T05:54:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T05:54:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T05:54:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-09-21T05:54:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T05:54:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T05:54:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T05:54:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T05:54:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T05:54:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T05:54:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T05:54:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T05:54:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T05:54:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T05:54:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "[]", 2024-09-21T05:54:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T05:54:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T05:54:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "{}", 2024-09-21T05:54:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T05:54:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T05:54:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T05:54:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T05:54:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T05:54:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T05:54:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T05:54:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T05:54:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T05:54:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T05:54:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T05:54:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T05:54:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T05:54:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T05:54:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T05:54:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T05:54:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T05:54:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T05:54:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T05:54:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T05:54:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T05:54:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T05:54:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T05:54:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T05:54:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T05:54:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-21T05:54:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T05:54:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T05:54:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8", 2024-09-21T05:54:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T05:54:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T05:54:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "45", 2024-09-21T05:54:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T05:54:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T05:54:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T05:54:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T05:54:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-09-21T05:54:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T05:54:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T05:54:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T05:54:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T05:54:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T05:54:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T05:54:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T05:54:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T05:54:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T05:54:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T05:54:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-21T05:54:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T05:54:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T05:54:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-21T05:54:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: "cross_origin_url": { 2024-09-21T05:54:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cross_origin_url", 2024-09-21T05:54:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: "crt_file": { 2024-09-21T05:54:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crt_file", 2024-09-21T05:54:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: "debug": { 2024-09-21T05:54:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "debug", 2024-09-21T05:54:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable/disable debug options", 2024-09-21T05:54:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: "jwt_token_ttl": { 2024-09-21T05:54:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "jwt_token_ttl", 2024-09-21T05:54:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "28800", 2024-09-21T05:54:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2024-09-21T05:54:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2024-09-21T05:54:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.699 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.699 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.699 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.699 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.699 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.699 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.699 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.699 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.699 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.699 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.699 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.699 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.699 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.699 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: "motd": { 2024-09-21T05:54:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "motd", 2024-09-21T05:54:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "The message of the day", 2024-09-21T05:54:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect_resolve_ip_addr": { 2024-09-21T05:54:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T05:54:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-09-21T05:54:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-09-21T05:54:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2024-09-21T05:54:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-09-21T05:54:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-09-21T05:54:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8080", 2024-09-21T05:54:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2024-09-21T05:54:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2024-09-21T05:54:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl_server_port": { 2024-09-21T05:54:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl_server_port", 2024-09-21T05:54:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8443", 2024-09-21T05:54:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.709 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.709 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.709 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.709 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.709 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.709 INFO:teuthology.orchestra.run.smithi070.stdout: "sso_oauth2": { 2024-09-21T05:54:03.709 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sso_oauth2", 2024-09-21T05:54:03.709 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.709 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.709 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.709 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2024-09-21T05:54:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2024-09-21T05:54:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "redirect", 2024-09-21T05:54:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect" 2024-09-21T05:54:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2024-09-21T05:54:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2024-09-21T05:54:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-09-21T05:54:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2024-09-21T05:54:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2024-09-21T05:54:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: "url_prefix": { 2024-09-21T05:54:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url_prefix", 2024-09-21T05:54:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "devicehealth", 2024-09-21T05:54:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_monitoring": { 2024-09-21T05:54:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_monitoring", 2024-09-21T05:54:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "monitor device health metrics", 2024-09-21T05:54:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "mark_out_threshold": { 2024-09-21T05:54:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mark_out_threshold", 2024-09-21T05:54:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2419200", 2024-09-21T05:54:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T05:54:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": { 2024-09-21T05:54:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_name", 2024-09-21T05:54:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "device_health_metrics", 2024-09-21T05:54:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T05:54:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: "retention_period": { 2024-09-21T05:54:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retention_period", 2024-09-21T05:54:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15552000", 2024-09-21T05:54:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain device health metrics", 2024-09-21T05:54:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_frequency": { 2024-09-21T05:54:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_frequency", 2024-09-21T05:54:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2024-09-21T05:54:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T05:54:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: "self_heal": { 2024-09-21T05:54:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "self_heal", 2024-09-21T05:54:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T05:54:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-21T05:54:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-21T05:54:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-21T05:54:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T05:54:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_threshold": { 2024-09-21T05:54:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_threshold", 2024-09-21T05:54:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7257600", 2024-09-21T05:54:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T05:54:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "diskprediction_local", 2024-09-21T05:54:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: "predict_interval": { 2024-09-21T05:54:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predict_interval", 2024-09-21T05:54:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2024-09-21T05:54:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "predictor_model": { 2024-09-21T05:54:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predictor_model", 2024-09-21T05:54:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "prophetstor", 2024-09-21T05:54:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-21T05:54:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-21T05:54:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-21T05:54:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "influx", 2024-09-21T05:54:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": false, 2024-09-21T05:54:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "influxdb python module not found", 2024-09-21T05:54:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: "batch_size": { 2024-09-21T05:54:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "batch_size", 2024-09-21T05:54:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5000", 2024-09-21T05:54:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T05:54:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: "database": { 2024-09-21T05:54:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "database", 2024-09-21T05:54:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "ceph", 2024-09-21T05:54:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T05:54:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: "hostname": { 2024-09-21T05:54:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hostname", 2024-09-21T05:54:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server hostname", 2024-09-21T05:54:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-21T05:54:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-21T05:54:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "30", 2024-09-21T05:54:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "5", 2024-09-21T05:54:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T05:54:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: "password": { 2024-09-21T05:54:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "password", 2024-09-21T05:54:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "password of InfluxDB server user", 2024-09-21T05:54:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: "port": { 2024-09-21T05:54:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "port", 2024-09-21T05:54:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8086", 2024-09-21T05:54:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server port", 2024-09-21T05:54:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2024-09-21T05:54:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2024-09-21T05:54:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "false", 2024-09-21T05:54:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T05:54:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: "threads": { 2024-09-21T05:54:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threads", 2024-09-21T05:54:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-21T05:54:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-21T05:54:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "32", 2024-09-21T05:54:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T05:54:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: "username": { 2024-09-21T05:54:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "username", 2024-09-21T05:54:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "username of InfluxDB server user", 2024-09-21T05:54:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: "verify_ssl": { 2024-09-21T05:54:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "verify_ssl", 2024-09-21T05:54:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "true", 2024-09-21T05:54:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T05:54:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.750 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.750 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.750 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.750 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.750 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "insights", 2024-09-21T05:54:03.750 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.750 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.750 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.750 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.750 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.750 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.750 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.750 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.750 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.751 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.751 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.751 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.751 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.751 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.751 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.751 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.751 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.751 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.751 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.751 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.751 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.751 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.751 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.751 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.751 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.752 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.752 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.752 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.752 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.752 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.752 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.752 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.752 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.752 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.752 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.752 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.752 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.752 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.752 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.752 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.753 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.753 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.753 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.753 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.753 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.753 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.753 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.753 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.753 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.753 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.753 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.753 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.753 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.753 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.754 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.754 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.754 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.754 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.754 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.754 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.754 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.754 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.754 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.754 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.754 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.754 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.754 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.754 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.754 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.755 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.755 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.755 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.755 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.755 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.755 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.755 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.755 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.755 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.755 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.755 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.755 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.755 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.756 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.756 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.756 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "iostat", 2024-09-21T05:54:03.756 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.756 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.756 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.756 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.756 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.756 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.756 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.756 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.756 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.756 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.756 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.756 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.757 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.757 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.757 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.757 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.757 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.757 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.757 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.757 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.757 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.757 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.757 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.757 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.757 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.757 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.757 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.757 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.758 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.758 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.758 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.758 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.758 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.758 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.758 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.758 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.758 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.758 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.758 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.758 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.758 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.758 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.758 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.759 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.759 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.759 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.759 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.759 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.759 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.759 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.759 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.759 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.759 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.759 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.759 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.759 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.759 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.759 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.760 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.760 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.760 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.760 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.760 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.760 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.760 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.760 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.760 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.760 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.760 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.760 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.760 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.760 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.761 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.761 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.761 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.761 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.761 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.761 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.761 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.761 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.761 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.761 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.761 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.761 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.761 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "k8sevents", 2024-09-21T05:54:03.761 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.762 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.762 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.762 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_event_retention_days": { 2024-09-21T05:54:03.762 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ceph_event_retention_days", 2024-09-21T05:54:03.762 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.762 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.762 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.762 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7", 2024-09-21T05:54:03.762 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.762 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.762 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.762 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T05:54:03.762 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.762 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.763 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.763 INFO:teuthology.orchestra.run.smithi070.stdout: "config_check_secs": { 2024-09-21T05:54:03.763 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_check_secs", 2024-09-21T05:54:03.763 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.763 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.763 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.763 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-21T05:54:03.763 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "10", 2024-09-21T05:54:03.763 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.763 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.763 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T05:54:03.763 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.763 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.763 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.763 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.764 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.764 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.764 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.764 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.764 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.764 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.764 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.764 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.764 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.764 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.764 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.764 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.764 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.764 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.764 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.765 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.765 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.765 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.765 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.765 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.765 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.765 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.765 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.765 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.765 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.765 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.765 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.765 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.766 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.766 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.766 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.766 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.766 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.766 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.766 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.766 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.766 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.766 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.766 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.766 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.767 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.767 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.767 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.767 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.767 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.767 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.767 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.767 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.767 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.767 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.767 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.767 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.768 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.768 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.768 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.768 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.768 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.768 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.768 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.768 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.768 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.768 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.768 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.768 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.768 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.769 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.769 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.769 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.769 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.769 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.769 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.769 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.769 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.769 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.769 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.769 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.769 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.769 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.770 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "localpool", 2024-09-21T05:54:03.770 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.770 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.770 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.770 INFO:teuthology.orchestra.run.smithi070.stdout: "failure_domain": { 2024-09-21T05:54:03.770 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "failure_domain", 2024-09-21T05:54:03.770 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.770 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.770 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.770 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "host", 2024-09-21T05:54:03.770 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.770 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.770 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.771 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "failure domain for any created local pool", 2024-09-21T05:54:03.771 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T05:54:03.771 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.771 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.771 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.771 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.771 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.771 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.771 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.771 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.771 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.771 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.771 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.771 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.772 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.772 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.772 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.772 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.772 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.772 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.772 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.772 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.772 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.772 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.772 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.772 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.772 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.772 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.772 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.773 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.773 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.773 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.773 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.773 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.773 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.773 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.773 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.773 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.773 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.773 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.774 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.774 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.774 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.774 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.774 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.774 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.774 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.774 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.774 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.774 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.774 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.774 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.774 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.774 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.774 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.775 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.775 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.775 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.775 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.775 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.775 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.775 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.775 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.775 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.775 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.775 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.775 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.776 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.776 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.776 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.776 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": { 2024-09-21T05:54:03.776 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_size", 2024-09-21T05:54:03.776 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.776 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.776 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.776 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.776 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.776 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.776 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.776 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default min_size for any created local pool", 2024-09-21T05:54:03.776 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T05:54:03.776 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.777 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.777 INFO:teuthology.orchestra.run.smithi070.stdout: "num_rep": { 2024-09-21T05:54:03.777 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "num_rep", 2024-09-21T05:54:03.777 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.777 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.777 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.777 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3", 2024-09-21T05:54:03.777 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.777 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.777 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.777 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default replica count for any created local pool", 2024-09-21T05:54:03.777 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.777 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.777 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.778 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": { 2024-09-21T05:54:03.778 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_num", 2024-09-21T05:54:03.778 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.778 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.778 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.778 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "128", 2024-09-21T05:54:03.778 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.778 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.778 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.778 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T05:54:03.778 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.778 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.778 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.778 INFO:teuthology.orchestra.run.smithi070.stdout: "prefix": { 2024-09-21T05:54:03.778 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prefix", 2024-09-21T05:54:03.779 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.779 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.779 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.779 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.779 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.779 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.779 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.779 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name prefix for any created local pool", 2024-09-21T05:54:03.779 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.779 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.779 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.779 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.779 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.779 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.780 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.780 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.780 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.780 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.780 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.780 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.780 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.780 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.780 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.780 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.780 INFO:teuthology.orchestra.run.smithi070.stdout: "subtree": { 2024-09-21T05:54:03.780 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "subtree", 2024-09-21T05:54:03.780 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.781 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.781 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.781 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "rack", 2024-09-21T05:54:03.781 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.781 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.781 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.781 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T05:54:03.781 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T05:54:03.781 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.781 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.781 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.781 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.781 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mds_autoscaler", 2024-09-21T05:54:03.782 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.782 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.782 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.782 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.782 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.782 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.782 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.782 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.782 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.782 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.782 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.782 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.782 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.782 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.782 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.783 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.783 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.783 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.783 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.783 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.783 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.783 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.783 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.783 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.783 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.783 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.783 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.784 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.784 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.784 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.784 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.784 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.784 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.784 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.784 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.784 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.784 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.784 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.784 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.784 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.784 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.784 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.785 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.785 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.785 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.785 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.785 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.785 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.785 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.785 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.785 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.785 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.785 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.785 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.785 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.785 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.785 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.785 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.786 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.786 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.786 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.786 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.786 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.786 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.786 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.786 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.786 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.786 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.786 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.786 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.786 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.787 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.787 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.787 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.787 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.787 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.787 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.787 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.787 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.787 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.787 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.787 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.787 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.787 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.787 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirroring", 2024-09-21T05:54:03.788 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.788 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.788 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.788 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.788 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.788 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.788 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.788 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.788 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.788 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.788 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.788 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.788 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.788 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.788 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.788 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.789 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.789 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.789 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.789 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.789 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.789 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.789 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.789 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.789 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.789 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.789 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.789 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.789 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.789 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.789 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.790 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.790 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.790 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.790 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.790 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.790 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.790 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.790 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.790 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.790 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.790 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.790 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.790 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.790 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.790 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.791 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.791 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.791 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.791 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.791 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.791 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.791 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.791 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.791 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.791 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.791 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.791 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.791 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.791 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.792 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.792 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.792 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.792 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.792 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.792 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.792 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.792 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.792 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.792 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.792 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.792 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.792 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.792 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.792 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.792 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.793 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.793 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.793 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.793 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.793 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.793 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.793 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.793 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.793 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "nfs", 2024-09-21T05:54:03.793 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.793 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.793 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.793 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.793 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.793 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.793 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.794 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.794 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.794 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.794 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.794 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.794 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.794 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.794 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.794 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.794 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.794 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.794 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.794 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.794 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.794 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.794 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.795 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.795 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.795 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.795 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.795 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.795 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.795 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.795 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.795 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.795 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.795 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.795 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.795 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.795 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.795 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.796 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.796 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.796 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.796 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.796 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.796 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.796 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.796 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.796 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.796 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.796 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.796 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.796 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.796 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.797 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.797 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.797 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.797 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.797 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.797 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.797 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.797 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.797 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.797 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.797 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.797 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.797 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.798 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.798 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.798 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.798 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.798 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.798 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.798 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.798 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.798 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.798 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.798 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.798 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.798 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.798 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.799 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.799 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.799 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.799 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.799 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.799 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2024-09-21T05:54:03.799 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.799 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.799 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.799 INFO:teuthology.orchestra.run.smithi070.stdout: "fail_fs": { 2024-09-21T05:54:03.799 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "fail_fs", 2024-09-21T05:54:03.799 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.799 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.799 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.800 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.800 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.800 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.800 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.800 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T05:54:03.800 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.800 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.800 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.800 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.800 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.800 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.800 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.800 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.801 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.801 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.801 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.801 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.801 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.801 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.801 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.801 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.801 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.801 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.801 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.801 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.801 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.801 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.801 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.802 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.802 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.802 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.802 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.802 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.802 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.802 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.802 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.802 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.802 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.802 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.802 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.802 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.802 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.802 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.803 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.803 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.803 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.803 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.803 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.803 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.803 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.803 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.803 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.803 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.803 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.803 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.803 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.803 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.803 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.803 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.803 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.804 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.804 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.804 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.804 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.804 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.804 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.804 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.804 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.804 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.804 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.804 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.804 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.804 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.804 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.805 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator": { 2024-09-21T05:54:03.805 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2024-09-21T05:54:03.805 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.805 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.805 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.805 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.805 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.805 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.805 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.805 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm", 2024-09-21T05:54:03.805 INFO:teuthology.orchestra.run.smithi070.stdout: "rook", 2024-09-21T05:54:03.805 INFO:teuthology.orchestra.run.smithi070.stdout: "test_orchestrator" 2024-09-21T05:54:03.805 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.805 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Orchestrator backend", 2024-09-21T05:54:03.805 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.806 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.806 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.806 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.806 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.806 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.806 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.806 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.806 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.806 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.806 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.806 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.806 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.806 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.807 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.807 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.807 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.807 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.807 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_perf_query", 2024-09-21T05:54:03.807 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.807 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.807 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.807 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.807 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.807 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.807 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.808 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.808 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.808 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.808 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.808 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.808 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.808 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.808 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.808 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.808 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.808 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.808 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.808 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.808 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.809 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.809 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.809 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.809 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.809 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.809 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.809 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.809 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.809 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.809 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.809 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.809 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.809 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.810 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.810 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.810 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.810 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.810 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.810 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.810 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.810 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.810 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.810 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.810 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.810 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.810 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.810 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.811 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.811 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.811 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.811 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.811 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.811 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.811 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.811 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.811 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.811 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.811 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.811 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.811 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.812 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.812 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.812 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.812 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.812 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.812 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.812 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.812 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.812 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.812 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.812 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.812 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.812 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.813 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.813 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.813 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.813 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.813 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.813 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.813 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.813 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.813 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.813 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.813 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_support", 2024-09-21T05:54:03.814 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.814 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.814 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.814 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.814 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.814 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.814 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.814 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.814 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.814 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.814 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.814 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.814 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.814 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.814 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.814 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.815 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.815 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.815 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.815 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.815 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.815 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.815 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.815 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.815 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.815 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.815 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.815 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.815 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.815 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.816 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.816 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.816 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.816 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.816 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.816 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.816 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.816 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.816 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.816 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.816 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.816 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.816 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.816 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.817 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.817 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.817 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.817 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.817 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.817 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.817 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.817 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.817 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.817 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.817 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.817 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.817 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.817 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.817 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.818 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.818 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.818 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.818 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.818 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.818 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.818 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.818 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.818 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.818 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.818 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.818 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.818 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.818 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.818 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.819 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.819 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.819 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.819 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.819 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.819 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.819 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.819 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.819 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.819 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.819 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_autoscaler", 2024-09-21T05:54:03.819 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.819 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.819 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.820 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.820 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.820 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.820 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.820 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.820 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.820 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.820 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.820 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.820 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.820 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.820 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.820 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.820 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.820 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.820 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.821 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.821 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.821 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.821 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.821 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.821 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.821 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.821 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.821 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.821 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.821 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.821 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.821 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.821 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.821 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.822 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.822 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.822 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.822 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.822 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.822 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.822 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.822 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.822 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.822 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.822 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.822 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.822 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.823 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.823 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.823 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.823 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.823 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.823 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.823 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.823 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.823 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.823 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.823 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.823 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.823 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.823 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.823 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.823 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.824 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.824 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.824 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.824 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.824 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.824 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.824 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-21T05:54:03.824 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-21T05:54:03.824 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.824 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.824 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.824 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-21T05:54:03.825 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.825 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.825 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.825 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.825 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.825 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.825 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.825 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.825 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.825 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.825 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.825 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.825 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.826 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.826 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.826 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.826 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.826 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.826 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.826 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.826 INFO:teuthology.orchestra.run.smithi070.stdout: "threshold": { 2024-09-21T05:54:03.826 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threshold", 2024-09-21T05:54:03.826 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-21T05:54:03.826 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.826 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.827 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2024-09-21T05:54:03.827 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1.0", 2024-09-21T05:54:03.827 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.827 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.827 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "scaling threshold", 2024-09-21T05:54:03.827 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T05:54:03.827 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.827 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.827 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.827 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.827 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "progress", 2024-09-21T05:54:03.827 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.828 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.828 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.828 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_pg_recovery_event": { 2024-09-21T05:54:03.828 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_pg_recovery_event", 2024-09-21T05:54:03.828 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.828 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.828 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.828 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.828 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.828 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.828 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.828 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T05:54:03.828 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.828 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.828 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.829 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2024-09-21T05:54:03.829 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2024-09-21T05:54:03.829 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.829 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.829 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.829 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.829 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.829 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.829 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.829 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.829 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.829 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.829 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.829 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.830 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.830 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.830 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.830 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.830 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.830 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.830 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.830 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.830 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.830 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.830 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.830 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.830 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.830 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.830 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.830 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.831 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.831 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.831 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.831 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.831 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.831 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.831 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.831 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.831 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.831 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.831 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.831 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.831 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.831 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.831 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.831 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.832 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.832 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.832 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.832 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.832 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.832 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.832 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.832 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.832 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.832 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.832 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.832 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.832 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.832 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.832 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.832 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.833 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.833 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.833 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.833 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.833 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.833 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.833 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.833 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.833 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.833 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.833 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.833 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.833 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.833 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.833 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.834 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.834 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.834 INFO:teuthology.orchestra.run.smithi070.stdout: "max_completed_events": { 2024-09-21T05:54:03.834 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_completed_events", 2024-09-21T05:54:03.834 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.834 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.834 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.834 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "50", 2024-09-21T05:54:03.834 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.834 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.834 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.834 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "number of past completed events to remember", 2024-09-21T05:54:03.834 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.834 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.835 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.835 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-21T05:54:03.835 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-21T05:54:03.835 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.835 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.835 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.835 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-21T05:54:03.835 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.835 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.835 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.835 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long the module is going to sleep", 2024-09-21T05:54:03.835 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.835 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.835 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.835 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.836 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.836 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.836 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.836 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.836 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.836 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.836 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.836 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.836 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.836 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.836 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.836 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.836 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.836 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.837 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus", 2024-09-21T05:54:03.837 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.837 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.837 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.837 INFO:teuthology.orchestra.run.smithi070.stdout: "cache": { 2024-09-21T05:54:03.837 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cache", 2024-09-21T05:54:03.837 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.837 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.837 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.837 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.837 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.837 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.837 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.837 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.837 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.837 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.838 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.838 INFO:teuthology.orchestra.run.smithi070.stdout: "exclude_perf_counters": { 2024-09-21T05:54:03.838 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "exclude_perf_counters", 2024-09-21T05:54:03.838 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.838 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.838 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.838 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.838 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.838 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.838 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.838 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T05:54:03.838 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T05:54:03.838 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.838 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.839 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.839 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.839 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.839 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.839 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.839 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.839 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.839 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.839 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.839 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.839 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.839 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.839 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.839 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.839 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.839 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.840 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.840 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.840 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.840 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.840 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.840 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.840 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.840 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.840 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.840 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.840 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.840 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.840 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.840 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.841 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.841 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.841 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.841 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.841 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.841 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.841 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.841 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.841 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.841 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.841 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.841 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.841 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.841 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.842 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.842 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.842 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.842 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.842 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.842 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.842 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.842 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.842 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.842 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.842 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.842 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.842 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.842 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.843 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.843 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.843 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.843 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.843 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.843 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.843 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.843 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.843 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools": { 2024-09-21T05:54:03.843 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools", 2024-09-21T05:54:03.843 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.843 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.843 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.843 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.843 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.844 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.844 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.844 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.844 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.844 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.844 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.844 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T05:54:03.844 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T05:54:03.844 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.844 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.844 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.844 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "300", 2024-09-21T05:54:03.844 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.844 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.845 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.845 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.845 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.845 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.845 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.845 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_interval": { 2024-09-21T05:54:03.845 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_interval", 2024-09-21T05:54:03.845 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-21T05:54:03.845 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.845 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.845 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15.0", 2024-09-21T05:54:03.845 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.845 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.846 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.846 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.846 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.846 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.846 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.846 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-09-21T05:54:03.846 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-09-21T05:54:03.846 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.846 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.846 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.846 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2024-09-21T05:54:03.846 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.846 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.847 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.847 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T05:54:03.847 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.847 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.847 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.847 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-09-21T05:54:03.847 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-09-21T05:54:03.847 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.847 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.847 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.847 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "9283", 2024-09-21T05:54:03.847 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.847 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.847 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.848 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T05:54:03.848 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.848 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.848 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.848 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.848 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.848 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.848 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.848 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.848 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.848 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.848 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.848 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.848 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.849 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.849 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.849 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.849 INFO:teuthology.orchestra.run.smithi070.stdout: "stale_cache_strategy": { 2024-09-21T05:54:03.849 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stale_cache_strategy", 2024-09-21T05:54:03.849 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.849 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.849 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.849 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "log", 2024-09-21T05:54:03.849 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.849 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.849 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.849 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.849 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.849 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.849 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.850 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2024-09-21T05:54:03.850 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2024-09-21T05:54:03.850 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.850 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.850 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.850 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "default", 2024-09-21T05:54:03.850 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.850 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.850 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.850 INFO:teuthology.orchestra.run.smithi070.stdout: "default", 2024-09-21T05:54:03.850 INFO:teuthology.orchestra.run.smithi070.stdout: "error" 2024-09-21T05:54:03.850 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.850 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.850 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.850 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.851 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.851 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2024-09-21T05:54:03.851 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2024-09-21T05:54:03.851 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.851 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.851 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.851 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-09-21T05:54:03.851 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2024-09-21T05:54:03.851 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2024-09-21T05:54:03.851 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.851 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.851 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.851 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.851 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.852 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.852 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.852 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_support", 2024-09-21T05:54:03.852 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.852 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.852 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.852 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.852 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.852 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.852 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.852 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.852 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.852 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.852 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.852 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.853 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.853 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.853 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.853 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.853 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.853 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.853 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.853 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.853 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.853 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.853 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.853 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.853 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.853 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.854 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.854 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.854 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.854 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.854 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.854 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.854 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.854 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.854 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.854 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.854 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.854 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.854 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.854 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.855 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.855 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.855 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.855 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.855 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.855 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.855 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.855 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.855 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.855 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.855 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.855 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.855 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.855 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.855 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.855 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.856 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.856 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.856 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.856 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.856 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.856 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.856 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.856 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.856 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.856 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.856 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.856 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.856 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.856 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_snap_create": { 2024-09-21T05:54:03.856 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_snap_create", 2024-09-21T05:54:03.857 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.857 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.857 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.857 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-21T05:54:03.857 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.857 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.857 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.857 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.857 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.857 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.857 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.857 INFO:teuthology.orchestra.run.smithi070.stdout: "mirror_snapshot_schedule": { 2024-09-21T05:54:03.857 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T05:54:03.857 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.857 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.857 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.858 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.858 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.858 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.858 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.858 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.858 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.858 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.858 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.858 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.858 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.858 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.858 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.858 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.858 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.858 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.859 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.859 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.859 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.859 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.859 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.859 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.859 INFO:teuthology.orchestra.run.smithi070.stdout: "trash_purge_schedule": { 2024-09-21T05:54:03.859 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "trash_purge_schedule", 2024-09-21T05:54:03.859 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.859 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.859 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.859 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.859 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.859 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.859 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.860 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.860 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.860 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.860 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.860 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.860 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.860 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "restful", 2024-09-21T05:54:03.860 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.860 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.860 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.860 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_auth": { 2024-09-21T05:54:03.860 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_auth", 2024-09-21T05:54:03.860 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.860 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.861 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.861 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.861 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.861 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.861 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.861 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.861 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.861 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.861 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.861 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2024-09-21T05:54:03.861 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2024-09-21T05:54:03.861 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.861 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.861 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.861 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.862 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.862 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.862 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.862 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.862 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.862 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.862 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.862 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.862 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.862 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.862 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.862 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.862 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.863 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.863 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.863 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.863 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.863 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.863 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.863 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.863 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.863 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.863 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.863 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.863 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.863 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.863 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.864 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.864 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.864 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.864 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.864 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.864 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.864 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.864 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.864 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.864 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.864 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.864 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.864 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.865 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.865 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.865 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.865 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.865 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.865 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.865 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.865 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.865 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.865 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.865 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.865 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.865 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.866 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.866 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.866 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.866 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.866 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.866 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.866 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.866 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.866 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.866 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.866 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.866 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.866 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.867 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.867 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.867 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.867 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.867 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.867 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.867 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.867 INFO:teuthology.orchestra.run.smithi070.stdout: "max_requests": { 2024-09-21T05:54:03.867 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_requests", 2024-09-21T05:54:03.867 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.867 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.867 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.867 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-09-21T05:54:03.867 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.868 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.868 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.868 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T05:54:03.868 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.868 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.868 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.868 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-09-21T05:54:03.868 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-09-21T05:54:03.868 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.868 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.868 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.868 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.868 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.868 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.869 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.869 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.869 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.869 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.869 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.869 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-09-21T05:54:03.869 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-09-21T05:54:03.869 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.869 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.869 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.869 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.869 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.869 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.869 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.869 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.870 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.870 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.870 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.870 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.870 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.870 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.870 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.870 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.870 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.870 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.870 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.870 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.870 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.870 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.870 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.871 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.871 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.871 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.871 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rgw", 2024-09-21T05:54:03.871 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.871 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.871 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.871 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.871 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.871 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.871 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.871 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.871 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.872 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.872 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.872 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.872 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.872 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.872 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.872 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.872 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.872 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.872 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.872 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.872 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.872 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.872 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.872 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.872 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.873 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.873 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.873 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.873 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.873 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.873 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.873 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.873 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.873 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.873 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.873 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.873 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.873 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.874 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.874 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.874 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.874 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.874 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.874 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.874 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.874 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.874 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.874 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.874 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.874 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.874 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.874 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.874 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.874 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.875 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.875 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.875 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.875 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.875 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.875 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.875 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.875 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.875 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.875 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.875 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.875 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.875 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.875 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.876 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.876 INFO:teuthology.orchestra.run.smithi070.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T05:54:03.876 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T05:54:03.876 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.876 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.876 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.876 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-21T05:54:03.876 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.876 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.876 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.876 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T05:54:03.876 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.876 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.876 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.876 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.877 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.877 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.877 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.877 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.877 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.877 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.877 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.877 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.877 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.877 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.877 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.877 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.877 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.877 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.878 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rook", 2024-09-21T05:54:03.878 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.878 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.878 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.878 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.878 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.878 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.878 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.878 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.878 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.878 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.878 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.878 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.878 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.878 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.878 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.879 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.879 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.879 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.879 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.879 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.879 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.879 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.879 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.879 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.879 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.879 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.879 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.879 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.879 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.880 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.880 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.880 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.880 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.880 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.880 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.880 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.880 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.880 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.880 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.880 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.880 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.880 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.880 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.880 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.881 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.881 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.881 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.881 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.881 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.881 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.881 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.881 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.881 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.881 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.881 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.881 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.881 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.881 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.881 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.882 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.882 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.882 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.882 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.882 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.882 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.882 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.882 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.882 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.882 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.882 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.882 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.882 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.882 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.883 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.883 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.883 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.883 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.883 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.883 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.883 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.883 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.883 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.883 INFO:teuthology.orchestra.run.smithi070.stdout: "storage_class": { 2024-09-21T05:54:03.883 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "storage_class", 2024-09-21T05:54:03.883 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.883 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.883 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.884 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "local", 2024-09-21T05:54:03.884 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.884 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.884 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.884 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T05:54:03.884 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.884 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.884 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.884 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.884 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.884 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "selftest", 2024-09-21T05:54:03.884 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.884 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.884 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.884 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.885 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.885 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.885 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.885 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.885 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.885 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.885 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.885 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.885 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.885 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.885 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.885 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.885 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.885 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.885 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.886 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.886 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.886 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.886 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.886 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.886 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.886 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.886 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.886 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.886 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.886 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.886 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.887 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.887 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.887 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.887 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.887 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.887 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.887 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.887 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.887 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.887 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.887 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.887 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.887 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.887 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.887 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.888 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.888 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.888 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.888 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.888 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.888 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.888 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.888 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.888 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.888 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.888 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.888 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.888 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.888 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.888 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.888 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.889 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.889 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.889 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.889 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.889 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.889 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.889 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.889 INFO:teuthology.orchestra.run.smithi070.stdout: "roption1": { 2024-09-21T05:54:03.889 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption1", 2024-09-21T05:54:03.889 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.889 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.889 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.889 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.889 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.890 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.890 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.890 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.890 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.890 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.890 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.890 INFO:teuthology.orchestra.run.smithi070.stdout: "roption2": { 2024-09-21T05:54:03.890 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption2", 2024-09-21T05:54:03.890 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.890 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.890 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.890 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "xyz", 2024-09-21T05:54:03.890 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.890 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.890 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.891 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.891 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.891 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.891 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.891 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption1": { 2024-09-21T05:54:03.891 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption1", 2024-09-21T05:54:03.891 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.891 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.891 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.891 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.891 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.891 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.891 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.891 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.892 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.892 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.892 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.892 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption2": { 2024-09-21T05:54:03.892 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption2", 2024-09-21T05:54:03.892 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.892 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.892 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.892 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.892 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.892 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.892 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.892 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.892 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.892 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.892 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.893 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption3": { 2024-09-21T05:54:03.893 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption3", 2024-09-21T05:54:03.893 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-21T05:54:03.893 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.893 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.893 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.893 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.893 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.893 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.893 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.893 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.893 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.893 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.893 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption4": { 2024-09-21T05:54:03.893 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption4", 2024-09-21T05:54:03.893 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.894 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.894 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.894 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.894 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.894 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.894 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.894 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.894 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.894 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.894 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.894 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption5": { 2024-09-21T05:54:03.894 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption5", 2024-09-21T05:54:03.894 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.894 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.895 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.895 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.895 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.895 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.895 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.895 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.895 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.895 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.895 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.895 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption6": { 2024-09-21T05:54:03.895 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption6", 2024-09-21T05:54:03.895 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.895 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.895 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.896 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.896 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.896 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.896 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.896 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.896 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.896 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.896 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.896 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption7": { 2024-09-21T05:54:03.896 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption7", 2024-09-21T05:54:03.896 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.896 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.896 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.896 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.896 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-21T05:54:03.897 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "42", 2024-09-21T05:54:03.897 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.897 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.897 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.897 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.897 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.897 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.897 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.897 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.897 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.897 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.897 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.897 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.897 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.897 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.897 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.898 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.898 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.898 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.898 INFO:teuthology.orchestra.run.smithi070.stdout: "testkey": { 2024-09-21T05:54:03.898 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testkey", 2024-09-21T05:54:03.898 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.898 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.898 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.898 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.898 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.898 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.898 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.898 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.898 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.898 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.899 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.899 INFO:teuthology.orchestra.run.smithi070.stdout: "testlkey": { 2024-09-21T05:54:03.899 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testlkey", 2024-09-21T05:54:03.899 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.899 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.899 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.899 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.899 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.899 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.899 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.899 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.899 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.899 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.899 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.900 INFO:teuthology.orchestra.run.smithi070.stdout: "testnewline": { 2024-09-21T05:54:03.900 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testnewline", 2024-09-21T05:54:03.900 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.900 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.900 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.900 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.900 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.900 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.900 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.900 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.900 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.900 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.900 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.900 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.900 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.901 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smb", 2024-09-21T05:54:03.901 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.901 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.901 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.901 INFO:teuthology.orchestra.run.smithi070.stdout: "internal_store_backend": { 2024-09-21T05:54:03.901 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "internal_store_backend", 2024-09-21T05:54:03.901 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.901 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.901 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.901 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.901 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.901 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.901 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.901 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T05:54:03.901 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.901 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.902 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.902 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.902 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.902 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.902 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.902 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.902 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.902 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.902 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.902 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.902 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.902 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.902 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.902 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.902 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.903 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.903 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.903 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.903 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.903 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.903 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.903 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.903 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.903 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.903 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.903 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.903 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.903 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.903 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.903 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.903 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.904 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.904 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.904 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.904 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.904 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.904 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.904 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.904 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.904 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.904 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.904 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.904 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.904 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.904 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.904 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.904 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.905 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.905 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.905 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.905 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.905 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.905 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.905 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.905 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.905 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.905 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.905 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.905 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.905 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.905 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.905 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.905 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.906 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.906 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.906 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.906 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.906 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.906 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.906 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.906 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.906 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.906 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.906 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.906 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.907 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.907 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.907 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.907 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.907 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.907 INFO:teuthology.orchestra.run.smithi070.stdout: "update_orchestration": { 2024-09-21T05:54:03.907 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "update_orchestration", 2024-09-21T05:54:03.907 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.907 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.907 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.907 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.907 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.907 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.907 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.908 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T05:54:03.908 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.908 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.908 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.908 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.908 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.908 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snap_schedule", 2024-09-21T05:54:03.908 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.908 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.908 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.908 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_m_granularity": { 2024-09-21T05:54:03.908 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_m_granularity", 2024-09-21T05:54:03.908 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.908 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.909 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.909 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.909 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.909 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.909 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.909 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T05:54:03.909 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.909 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.909 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.909 INFO:teuthology.orchestra.run.smithi070.stdout: "dump_on_update": { 2024-09-21T05:54:03.909 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dump_on_update", 2024-09-21T05:54:03.909 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.909 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.909 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.909 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.909 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.910 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.910 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.910 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "dump database to debug log on update", 2024-09-21T05:54:03.910 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.910 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.910 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.910 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.910 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.910 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.910 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.910 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.910 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.910 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.910 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.910 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.911 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.911 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.911 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.911 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.911 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.911 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.911 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.911 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.911 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.911 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.911 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.911 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.911 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.912 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.912 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.912 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.912 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.912 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.912 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.912 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.912 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.912 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.912 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.912 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.912 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.912 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.912 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.912 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.912 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.913 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.913 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.913 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.913 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.913 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.913 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.913 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.913 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.913 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.913 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.913 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.913 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.913 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.913 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.913 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.914 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.914 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.914 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.914 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.914 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.914 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.914 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.914 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.914 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.914 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.914 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.914 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.914 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.915 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.915 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.915 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.915 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.915 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.915 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.915 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.915 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.915 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.915 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.915 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.915 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.915 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.915 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.916 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.916 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stats", 2024-09-21T05:54:03.916 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.916 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.916 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.916 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.916 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.916 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.916 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.916 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.916 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.916 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.916 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.917 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.917 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.917 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.917 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.917 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.917 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.917 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.917 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.917 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.917 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.917 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.917 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.917 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.917 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.917 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.917 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.918 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.918 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.918 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.918 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.918 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.918 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.918 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.918 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.918 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.918 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.918 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.918 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.918 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.919 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.919 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.919 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.919 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.919 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.919 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.919 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.919 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.919 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.919 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.919 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.919 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.919 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.919 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.920 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.920 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.920 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.920 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.920 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.920 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.920 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.920 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.920 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.920 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.920 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.920 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.920 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.920 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.920 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.921 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.921 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.921 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.921 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.921 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.921 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.921 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.921 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.921 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.921 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.921 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.921 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.921 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.922 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.922 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.922 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "status", 2024-09-21T05:54:03.922 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.922 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.922 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.922 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.922 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.922 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.922 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.922 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.923 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.923 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.923 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.923 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.923 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.923 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.923 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.923 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.923 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.923 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.923 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.923 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.923 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.923 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.924 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.924 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.924 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.924 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.924 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.924 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.924 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.924 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.924 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.924 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.924 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.924 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.924 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.924 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.925 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.925 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.925 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.925 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.925 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.925 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.925 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.925 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.925 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.925 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.925 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.925 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.925 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.925 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.926 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.926 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.926 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.926 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.926 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.926 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.926 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.926 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.926 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.926 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.926 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.926 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.926 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.926 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.927 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.927 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.927 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.927 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.927 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.927 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.927 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.927 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.927 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.927 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.927 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.927 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.927 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.927 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.927 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.928 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.928 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.928 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.928 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.928 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.928 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telegraf", 2024-09-21T05:54:03.928 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.928 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.928 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.928 INFO:teuthology.orchestra.run.smithi070.stdout: "address": { 2024-09-21T05:54:03.928 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "address", 2024-09-21T05:54:03.928 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.928 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.928 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.929 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T05:54:03.929 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.929 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.929 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.929 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.929 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.929 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.929 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.929 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-21T05:54:03.929 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-21T05:54:03.929 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.929 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.929 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.929 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15", 2024-09-21T05:54:03.929 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.929 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.930 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.930 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.930 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.930 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.930 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.930 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.930 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.930 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.930 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.930 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.930 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.930 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.930 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.930 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.930 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.931 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.931 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.931 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.931 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.931 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.931 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.931 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.931 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.931 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.931 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.931 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.931 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.931 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.931 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.931 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.931 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.932 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.932 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.932 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.932 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.932 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.932 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.932 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.932 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.932 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.932 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.932 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.932 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.932 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.933 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.933 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.933 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.933 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.933 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.933 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.933 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.933 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.933 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.933 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.933 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.933 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.933 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.933 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.934 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.934 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.934 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.934 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.934 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.934 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.934 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.934 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.934 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.934 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.934 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.934 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.934 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.934 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.934 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.935 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.935 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.935 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.935 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.935 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.935 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.935 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.935 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.935 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.935 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.935 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.935 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.935 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.936 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telemetry", 2024-09-21T05:54:03.936 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.936 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.936 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.936 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_basic": { 2024-09-21T05:54:03.936 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_basic", 2024-09-21T05:54:03.936 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.936 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.936 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.936 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.936 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.936 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.936 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.936 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T05:54:03.936 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.936 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.937 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.937 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_crash": { 2024-09-21T05:54:03.937 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_crash", 2024-09-21T05:54:03.937 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.937 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.937 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.937 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.937 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.937 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.937 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.937 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T05:54:03.937 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.937 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.937 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.938 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_device": { 2024-09-21T05:54:03.938 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_device", 2024-09-21T05:54:03.938 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.938 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.938 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.938 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.938 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.938 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.938 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.938 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T05:54:03.938 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.938 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.938 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.939 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_ident": { 2024-09-21T05:54:03.939 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_ident", 2024-09-21T05:54:03.939 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.939 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.939 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.939 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.939 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.939 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.939 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.939 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T05:54:03.939 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.939 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.939 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.939 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_perf": { 2024-09-21T05:54:03.940 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_perf", 2024-09-21T05:54:03.940 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.940 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.940 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.940 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.940 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.940 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.940 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.940 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T05:54:03.940 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.940 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.940 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.940 INFO:teuthology.orchestra.run.smithi070.stdout: "contact": { 2024-09-21T05:54:03.940 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "contact", 2024-09-21T05:54:03.941 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.941 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.941 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.941 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.941 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.941 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.941 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.941 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.941 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.941 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.941 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.941 INFO:teuthology.orchestra.run.smithi070.stdout: "description": { 2024-09-21T05:54:03.941 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "description", 2024-09-21T05:54:03.942 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.942 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.942 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.942 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.942 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.942 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.942 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.942 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.942 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.942 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.942 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.942 INFO:teuthology.orchestra.run.smithi070.stdout: "device_url": { 2024-09-21T05:54:03.942 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_url", 2024-09-21T05:54:03.942 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.943 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.943 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.943 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T05:54:03.943 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.943 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.943 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.943 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.943 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.943 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.943 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.943 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2024-09-21T05:54:03.943 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2024-09-21T05:54:03.943 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.943 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.943 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.943 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.944 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.944 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.944 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.944 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.944 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.944 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.944 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.944 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-21T05:54:03.944 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-21T05:54:03.944 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.944 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.944 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.944 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "24", 2024-09-21T05:54:03.944 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "8", 2024-09-21T05:54:03.944 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.945 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.945 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.945 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.945 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.945 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.945 INFO:teuthology.orchestra.run.smithi070.stdout: "last_opt_revision": { 2024-09-21T05:54:03.945 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "last_opt_revision", 2024-09-21T05:54:03.945 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.945 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.945 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.945 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1", 2024-09-21T05:54:03.945 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.945 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.945 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.946 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.946 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.946 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.946 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.946 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard": { 2024-09-21T05:54:03.946 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard", 2024-09-21T05:54:03.946 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.946 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.946 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.946 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.946 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.946 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.946 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.946 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.946 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.947 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.947 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.947 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard_description": { 2024-09-21T05:54:03.947 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard_description", 2024-09-21T05:54:03.947 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.947 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.947 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.947 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.947 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.947 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.947 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.947 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.947 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.947 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.947 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.948 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.948 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.948 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.948 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.948 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.948 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.948 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.948 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.948 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.948 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.948 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.948 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.948 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.948 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.948 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.948 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.949 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.949 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.949 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.949 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.949 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.949 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.949 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.949 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.949 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.949 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.949 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.949 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.949 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.949 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.949 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.950 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.950 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.950 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.950 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.950 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.950 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.950 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.950 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.950 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.950 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.950 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.950 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.950 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.950 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.951 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.951 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.951 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.951 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.951 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.951 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.951 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.951 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.951 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.951 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.951 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.951 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.951 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.951 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.952 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.952 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.952 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.952 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.952 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.952 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.952 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.952 INFO:teuthology.orchestra.run.smithi070.stdout: "organization": { 2024-09-21T05:54:03.952 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "organization", 2024-09-21T05:54:03.952 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.952 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.952 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.952 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.952 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.952 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.952 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.953 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.953 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.953 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.953 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.953 INFO:teuthology.orchestra.run.smithi070.stdout: "proxy": { 2024-09-21T05:54:03.953 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "proxy", 2024-09-21T05:54:03.953 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.953 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.953 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.953 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.953 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.953 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.953 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.953 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.953 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.953 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.954 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.954 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.954 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.954 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.954 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.954 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.954 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.954 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.954 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.954 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.954 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.954 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.954 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.954 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.955 INFO:teuthology.orchestra.run.smithi070.stdout: "url": { 2024-09-21T05:54:03.955 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url", 2024-09-21T05:54:03.955 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.955 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.955 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.955 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T05:54:03.955 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.955 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.955 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.955 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.955 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.955 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.955 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.955 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.955 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.956 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "test_orchestrator", 2024-09-21T05:54:03.956 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.956 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.956 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.956 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.956 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.956 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.956 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.956 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.956 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.956 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.957 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.957 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.957 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.957 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.957 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.957 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.957 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.957 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.957 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.957 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.957 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.957 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.957 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.957 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.958 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.958 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.958 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.958 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.958 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.958 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.958 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.958 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.958 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.958 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.958 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.958 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.959 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.959 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.959 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.959 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.959 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.959 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.959 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.959 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.959 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.959 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.959 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.959 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.959 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.959 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.960 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.960 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.960 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.960 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.960 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.960 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.960 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.960 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.960 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.960 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.960 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.960 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.960 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.960 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.961 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.961 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.961 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.961 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.961 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.961 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.961 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.961 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.961 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.961 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.961 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.961 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.961 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.961 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.962 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.962 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.962 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.962 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.962 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.962 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.962 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "volumes", 2024-09-21T05:54:03.962 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.962 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.962 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.962 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.962 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.963 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.963 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.963 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.963 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.963 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.963 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.963 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.963 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.963 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.963 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.963 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.963 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.964 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.964 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.964 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.964 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.964 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.964 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.964 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.964 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.964 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.964 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.964 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.964 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.965 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.965 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.965 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.965 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.965 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.965 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.965 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.965 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.965 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.965 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.965 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.965 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.966 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.966 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.966 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.966 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.966 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.966 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.966 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.966 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.966 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.966 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.966 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.966 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.966 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.966 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.967 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.967 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.967 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.967 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.967 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.967 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.967 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.967 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.967 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.967 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.967 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.967 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.967 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.967 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.968 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_clones": { 2024-09-21T05:54:03.968 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_clones", 2024-09-21T05:54:03.968 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.968 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.968 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.968 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4", 2024-09-21T05:54:03.968 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.968 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.968 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.968 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T05:54:03.968 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.968 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.968 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.969 INFO:teuthology.orchestra.run.smithi070.stdout: "periodic_async_work": { 2024-09-21T05:54:03.969 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "periodic_async_work", 2024-09-21T05:54:03.969 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.969 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.969 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.969 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.969 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.969 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.969 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.969 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Periodically check for async work", 2024-09-21T05:54:03.969 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.969 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.969 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.969 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_delay": { 2024-09-21T05:54:03.970 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_delay", 2024-09-21T05:54:03.970 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.970 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.970 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.970 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.970 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.970 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.970 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.970 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T05:54:03.970 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.970 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.970 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.970 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_no_wait": { 2024-09-21T05:54:03.970 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T05:54:03.971 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.971 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.971 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.971 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.971 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.971 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.971 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.971 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T05:54:03.971 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.971 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.971 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.971 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.972 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.972 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.972 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.972 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.972 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.972 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.972 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.972 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.972 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.972 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.972 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.972 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.972 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.972 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.973 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix", 2024-09-21T05:54:03.973 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.973 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.973 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.973 INFO:teuthology.orchestra.run.smithi070.stdout: "discovery_interval": { 2024-09-21T05:54:03.973 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "discovery_interval", 2024-09-21T05:54:03.973 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-21T05:54:03.973 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.973 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.973 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "100", 2024-09-21T05:54:03.973 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.973 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.973 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.973 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.973 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.974 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.974 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.974 INFO:teuthology.orchestra.run.smithi070.stdout: "identifier": { 2024-09-21T05:54:03.974 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "identifier", 2024-09-21T05:54:03.974 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.974 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.974 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.974 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.974 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.974 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.974 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.974 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.974 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.975 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.975 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.975 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-21T05:54:03.975 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-21T05:54:03.975 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.975 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.975 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.975 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-21T05:54:03.975 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.975 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.975 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.975 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.975 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.976 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.976 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.976 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.976 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.976 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.976 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.976 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.976 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.976 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.976 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.976 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.976 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.976 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.977 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.977 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.977 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.977 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.977 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.977 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.977 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.977 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.977 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.977 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.977 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.977 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.977 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.977 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.977 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.977 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.978 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.978 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.978 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.978 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.978 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.978 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.978 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.978 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.978 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.978 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.978 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.978 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.978 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.978 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.979 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.979 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.979 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.979 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.979 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.979 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.979 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.979 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.979 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.979 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.979 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.979 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.980 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.980 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.980 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.980 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.980 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.980 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.980 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.980 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.980 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.980 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.980 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.980 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.980 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.980 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:03.981 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:03.981 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.981 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:03.981 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.981 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:03.981 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.981 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.981 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.981 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.981 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.981 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.981 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.981 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_host": { 2024-09-21T05:54:03.982 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_host", 2024-09-21T05:54:03.982 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.982 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.982 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.982 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.982 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.982 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.982 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.982 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.982 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.982 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.982 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.982 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_port": { 2024-09-21T05:54:03.983 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_port", 2024-09-21T05:54:03.983 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.983 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.983 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.983 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10051", 2024-09-21T05:54:03.983 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.983 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.983 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.983 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.983 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.983 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.983 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.983 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_sender": { 2024-09-21T05:54:03.984 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_sender", 2024-09-21T05:54:03.984 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.984 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.984 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:03.984 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T05:54:03.984 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.984 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.984 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.984 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.984 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.984 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.984 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.984 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.984 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.984 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.985 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-21T05:54:03.985 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:03.985 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.985 INFO:teuthology.orchestra.run.smithi070.stdout: "modules": [ 2024-09-21T05:54:03.985 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm", 2024-09-21T05:54:03.985 INFO:teuthology.orchestra.run.smithi070.stdout: "dashboard", 2024-09-21T05:54:03.985 INFO:teuthology.orchestra.run.smithi070.stdout: "iostat", 2024-09-21T05:54:03.985 INFO:teuthology.orchestra.run.smithi070.stdout: "nfs", 2024-09-21T05:54:03.985 INFO:teuthology.orchestra.run.smithi070.stdout: "restful" 2024-09-21T05:54:03.985 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.985 INFO:teuthology.orchestra.run.smithi070.stdout: "available_modules": [ 2024-09-21T05:54:03.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:03.985 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "alerts", 2024-09-21T05:54:03.985 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:03.986 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:03.986 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:03.986 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-21T05:54:03.986 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-21T05:54:03.986 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:03.986 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.986 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.986 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-21T05:54:03.986 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.986 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.986 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.986 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T05:54:03.986 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.986 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.987 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.987 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:03.987 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:03.987 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.987 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.987 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.987 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.987 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.987 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.987 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.987 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.987 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.987 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.987 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.988 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.988 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.988 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.988 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.988 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.988 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.988 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.988 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:03.988 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:03.988 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.988 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.988 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.988 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.988 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.989 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.989 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.989 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.989 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.989 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.989 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.989 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:03.989 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:03.989 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.989 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.989 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.989 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:03.989 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.990 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.990 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:03.990 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:03.990 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:03.990 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:03.990 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:03.990 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:03.990 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:03.990 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:03.990 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.990 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.990 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.990 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.990 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:03.991 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:03.991 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.991 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.991 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.991 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:03.991 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.991 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.991 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.991 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:03.991 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.991 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.991 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.991 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_destination": { 2024-09-21T05:54:03.992 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_destination", 2024-09-21T05:54:03.992 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.992 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.992 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.992 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.992 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.992 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.992 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.992 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T05:54:03.992 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.992 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.992 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.992 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_from_name": { 2024-09-21T05:54:03.992 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_from_name", 2024-09-21T05:54:03.992 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.993 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.993 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.993 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "Ceph", 2024-09-21T05:54:03.993 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.993 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.993 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.993 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email From: name", 2024-09-21T05:54:03.993 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.993 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.993 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.993 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_host": { 2024-09-21T05:54:03.993 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_host", 2024-09-21T05:54:03.993 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.994 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.994 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.994 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.994 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.994 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.994 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.994 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP server", 2024-09-21T05:54:03.994 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.994 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.994 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.994 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_password": { 2024-09-21T05:54:03.994 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_password", 2024-09-21T05:54:03.995 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.995 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.995 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.995 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.995 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.995 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.995 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.995 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Password to authenticate with", 2024-09-21T05:54:03.995 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.995 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.995 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.996 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_port": { 2024-09-21T05:54:03.996 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_port", 2024-09-21T05:54:03.996 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:03.996 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.996 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.996 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "465", 2024-09-21T05:54:03.996 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.996 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.996 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.996 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP port", 2024-09-21T05:54:03.997 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.997 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.997 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.997 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_sender": { 2024-09-21T05:54:03.997 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_sender", 2024-09-21T05:54:03.997 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:03.997 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.997 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.997 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:03.997 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.998 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.998 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.998 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP envelope sender", 2024-09-21T05:54:03.998 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.998 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.998 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.998 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_ssl": { 2024-09-21T05:54:03.998 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_ssl", 2024-09-21T05:54:03.998 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:03.999 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:03.999 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:03.999 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:03.999 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:03.999 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:03.999 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:03.999 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T05:54:03.999 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:03.999 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:03.999 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:03.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:03.999 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_user": { 2024-09-21T05:54:03.999 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_user", 2024-09-21T05:54:04.000 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.000 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.000 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.000 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.000 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.000 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.000 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.000 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "User to authenticate as", 2024-09-21T05:54:04.000 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.000 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.000 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.000 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.001 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.001 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.001 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.001 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.001 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.001 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.001 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.001 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.001 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.001 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.001 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.001 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.001 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.002 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.002 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "balancer", 2024-09-21T05:54:04.002 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.002 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.002 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.002 INFO:teuthology.orchestra.run.smithi070.stdout: "active": { 2024-09-21T05:54:04.002 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "active", 2024-09-21T05:54:04.002 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.002 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.002 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.002 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.002 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.003 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.003 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.003 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T05:54:04.003 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.003 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.003 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.003 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_time": { 2024-09-21T05:54:04.003 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_time", 2024-09-21T05:54:04.003 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.003 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.003 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.003 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0000", 2024-09-21T05:54:04.004 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.004 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.004 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.004 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T05:54:04.004 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T05:54:04.004 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.004 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.004 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_weekday": { 2024-09-21T05:54:04.004 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_weekday", 2024-09-21T05:54:04.004 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-21T05:54:04.004 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.004 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.005 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.005 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2024-09-21T05:54:04.005 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2024-09-21T05:54:04.005 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.005 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T05:54:04.005 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T05:54:04.005 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.005 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.005 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_max_iterations": { 2024-09-21T05:54:04.005 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_max_iterations", 2024-09-21T05:54:04.005 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-21T05:54:04.005 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.005 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.005 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "25", 2024-09-21T05:54:04.006 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-21T05:54:04.006 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "250", 2024-09-21T05:54:04.006 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.006 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T05:54:04.006 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.006 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.006 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.006 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_metrics": { 2024-09-21T05:54:04.006 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_metrics", 2024-09-21T05:54:04.006 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.006 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.006 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.006 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T05:54:04.007 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.007 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.007 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.007 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T05:54:04.007 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T05:54:04.007 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.007 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.007 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_step": { 2024-09-21T05:54:04.007 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_step", 2024-09-21T05:54:04.007 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-21T05:54:04.007 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.007 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.007 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.5", 2024-09-21T05:54:04.008 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0.001", 2024-09-21T05:54:04.008 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "0.999", 2024-09-21T05:54:04.008 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.008 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "aggressiveness of optimization", 2024-09-21T05:54:04.008 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T05:54:04.008 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.008 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.008 INFO:teuthology.orchestra.run.smithi070.stdout: "end_time": { 2024-09-21T05:54:04.008 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_time", 2024-09-21T05:54:04.008 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.008 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.008 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.008 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2359", 2024-09-21T05:54:04.008 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.009 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.009 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.009 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T05:54:04.009 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T05:54:04.009 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.009 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.009 INFO:teuthology.orchestra.run.smithi070.stdout: "end_weekday": { 2024-09-21T05:54:04.009 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_weekday", 2024-09-21T05:54:04.009 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-21T05:54:04.009 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.009 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.009 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.009 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2024-09-21T05:54:04.009 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2024-09-21T05:54:04.009 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.010 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T05:54:04.010 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T05:54:04.010 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.010 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.010 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.010 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.010 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.010 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.010 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.010 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.010 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.010 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.010 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.011 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.011 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.011 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.011 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.011 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.011 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.011 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.011 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.011 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.011 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.011 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.011 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.011 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.012 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.012 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.012 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.012 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.012 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.012 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.012 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.012 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.012 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.012 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.012 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.012 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.012 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.012 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.013 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.013 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.013 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.013 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.013 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.013 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.013 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.013 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.013 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.013 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.013 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.013 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.013 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.013 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.013 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.014 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.014 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.014 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.014 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.014 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.014 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.014 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.014 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.014 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.014 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.014 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.014 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.014 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.014 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.015 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.015 INFO:teuthology.orchestra.run.smithi070.stdout: "min_score": { 2024-09-21T05:54:04.015 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_score", 2024-09-21T05:54:04.015 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-21T05:54:04.015 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.015 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.015 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.015 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.015 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.015 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.015 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T05:54:04.015 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.015 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.016 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.016 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2024-09-21T05:54:04.016 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2024-09-21T05:54:04.016 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.016 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.016 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.016 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "upmap", 2024-09-21T05:54:04.016 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.016 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.016 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.016 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-compat", 2024-09-21T05:54:04.016 INFO:teuthology.orchestra.run.smithi070.stdout: "none", 2024-09-21T05:54:04.016 INFO:teuthology.orchestra.run.smithi070.stdout: "read", 2024-09-21T05:54:04.017 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap", 2024-09-21T05:54:04.017 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap-read" 2024-09-21T05:54:04.017 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.017 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Balancer mode", 2024-09-21T05:54:04.017 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.017 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.017 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.017 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_ids": { 2024-09-21T05:54:04.017 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_ids", 2024-09-21T05:54:04.017 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.017 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.017 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.017 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.018 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.018 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.018 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.018 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T05:54:04.018 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.018 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.018 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.018 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-21T05:54:04.018 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-21T05:54:04.018 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:04.018 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.018 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.018 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-21T05:54:04.018 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.019 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.019 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.019 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T05:54:04.019 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.019 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.019 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.019 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.019 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.019 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.019 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.019 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.019 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.020 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.020 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.020 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.020 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.020 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.020 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.020 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.020 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_deviation": { 2024-09-21T05:54:04.020 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_deviation", 2024-09-21T05:54:04.020 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.020 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.020 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.020 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-21T05:54:04.021 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-21T05:54:04.021 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.021 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.021 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T05:54:04.021 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T05:54:04.021 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.021 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.021 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_optimizations": { 2024-09-21T05:54:04.021 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_optimizations", 2024-09-21T05:54:04.021 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-21T05:54:04.021 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.021 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.021 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-21T05:54:04.022 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.022 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.022 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.022 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T05:54:04.022 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.022 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.022 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.022 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.022 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.022 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm", 2024-09-21T05:54:04.022 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.022 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.022 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.023 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_down_multiplier": { 2024-09-21T05:54:04.023 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_down_multiplier", 2024-09-21T05:54:04.023 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-21T05:54:04.023 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.023 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.023 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2024-09-21T05:54:04.023 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.023 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.023 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.023 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T05:54:04.023 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.023 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.023 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.024 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_refresh_rate": { 2024-09-21T05:54:04.024 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_refresh_rate", 2024-09-21T05:54:04.024 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:04.024 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.024 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.024 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "20", 2024-09-21T05:54:04.024 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.024 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.024 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.024 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T05:54:04.024 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.024 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.024 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.024 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_starting_port": { 2024-09-21T05:54:04.024 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_starting_port", 2024-09-21T05:54:04.025 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.025 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.025 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.025 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4721", 2024-09-21T05:54:04.025 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.025 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.025 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.025 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T05:54:04.025 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.025 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.025 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.025 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_ptrace": { 2024-09-21T05:54:04.025 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_ptrace", 2024-09-21T05:54:04.025 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.025 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.026 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.026 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.026 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.026 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.026 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.026 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T05:54:04.026 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T05:54:04.026 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.026 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.026 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_interval": { 2024-09-21T05:54:04.026 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_interval", 2024-09-21T05:54:04.026 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:04.026 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.027 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.027 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-21T05:54:04.027 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.027 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.027 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.027 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T05:54:04.027 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.027 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.027 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.027 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_memory_target_ratio": { 2024-09-21T05:54:04.027 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T05:54:04.027 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-21T05:54:04.027 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.027 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.028 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.7", 2024-09-21T05:54:04.028 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.028 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.028 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.028 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T05:54:04.028 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.028 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.028 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.028 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm_log_destination": { 2024-09-21T05:54:04.028 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm_log_destination", 2024-09-21T05:54:04.028 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.028 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.028 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.028 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.028 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.029 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.029 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.029 INFO:teuthology.orchestra.run.smithi070.stdout: "file", 2024-09-21T05:54:04.029 INFO:teuthology.orchestra.run.smithi070.stdout: "file,syslog", 2024-09-21T05:54:04.029 INFO:teuthology.orchestra.run.smithi070.stdout: "syslog" 2024-09-21T05:54:04.029 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.029 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T05:54:04.029 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.029 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.029 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.029 INFO:teuthology.orchestra.run.smithi070.stdout: "cgroups_split": { 2024-09-21T05:54:04.029 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cgroups_split", 2024-09-21T05:54:04.029 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.029 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.029 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.030 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.030 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.030 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.030 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.030 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T05:54:04.030 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.030 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.030 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.030 INFO:teuthology.orchestra.run.smithi070.stdout: "config_checks_enabled": { 2024-09-21T05:54:04.030 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_checks_enabled", 2024-09-21T05:54:04.030 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.030 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.030 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.030 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.030 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.031 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.031 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.031 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T05:54:04.031 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.031 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.031 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.031 INFO:teuthology.orchestra.run.smithi070.stdout: "config_dashboard": { 2024-09-21T05:54:04.031 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_dashboard", 2024-09-21T05:54:04.031 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.031 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.031 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.031 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.031 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.031 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.032 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.032 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T05:54:04.032 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.032 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.032 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.032 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_alertmanager": { 2024-09-21T05:54:04.032 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_alertmanager", 2024-09-21T05:54:04.032 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.032 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.032 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.032 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T05:54:04.032 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.032 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.032 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.032 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-21T05:54:04.032 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.033 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.033 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.033 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_base": { 2024-09-21T05:54:04.033 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_base", 2024-09-21T05:54:04.033 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.033 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.033 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.033 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T05:54:04.033 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.033 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.033 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.033 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Container image name, without the tag", 2024-09-21T05:54:04.033 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.033 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.033 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.034 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_elasticsearch": { 2024-09-21T05:54:04.034 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_elasticsearch", 2024-09-21T05:54:04.034 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.034 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.034 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.034 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T05:54:04.034 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.034 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.034 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.034 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "elasticsearch container image", 2024-09-21T05:54:04.034 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.034 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.034 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.035 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_grafana": { 2024-09-21T05:54:04.035 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_grafana", 2024-09-21T05:54:04.035 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.035 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.035 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.035 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T05:54:04.035 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.035 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.035 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.035 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-21T05:54:04.035 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.035 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.035 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.035 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_haproxy": { 2024-09-21T05:54:04.035 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_haproxy", 2024-09-21T05:54:04.036 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.036 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.036 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.036 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T05:54:04.036 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.036 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.036 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.036 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "HAproxy container image", 2024-09-21T05:54:04.036 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.036 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.036 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.036 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_agent": { 2024-09-21T05:54:04.036 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_agent", 2024-09-21T05:54:04.036 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.036 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.037 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.037 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T05:54:04.037 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.037 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.037 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.037 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger agent container image", 2024-09-21T05:54:04.037 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.037 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.037 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.037 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_collector": { 2024-09-21T05:54:04.037 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_collector", 2024-09-21T05:54:04.037 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.037 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.038 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.038 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T05:54:04.038 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.038 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.038 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.038 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger collector container image", 2024-09-21T05:54:04.038 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.038 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.038 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.038 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_query": { 2024-09-21T05:54:04.038 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_query", 2024-09-21T05:54:04.038 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.038 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.039 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.039 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T05:54:04.039 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.039 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.039 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.039 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger query container image", 2024-09-21T05:54:04.039 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.039 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.039 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.039 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_keepalived": { 2024-09-21T05:54:04.039 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_keepalived", 2024-09-21T05:54:04.039 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.040 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.040 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.040 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T05:54:04.040 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.040 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.040 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.040 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Keepalived container image", 2024-09-21T05:54:04.040 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.040 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.040 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.040 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_loki": { 2024-09-21T05:54:04.040 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_loki", 2024-09-21T05:54:04.040 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.041 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.041 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.041 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T05:54:04.041 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.041 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.041 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.041 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Loki container image", 2024-09-21T05:54:04.041 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.041 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.041 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.041 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_nginx": { 2024-09-21T05:54:04.041 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_nginx", 2024-09-21T05:54:04.041 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.042 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.042 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.042 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T05:54:04.042 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.042 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.042 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.042 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Nginx container image", 2024-09-21T05:54:04.042 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.042 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.042 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.042 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_node_exporter": { 2024-09-21T05:54:04.042 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_node_exporter", 2024-09-21T05:54:04.043 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.043 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.043 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.043 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T05:54:04.043 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.043 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.043 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.043 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-21T05:54:04.043 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.043 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.043 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.044 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_nvmeof": { 2024-09-21T05:54:04.044 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_nvmeof", 2024-09-21T05:54:04.044 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.044 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.044 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.044 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T05:54:04.044 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.044 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.044 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.044 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Nvme-of container image", 2024-09-21T05:54:04.044 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.044 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.044 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.044 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_oauth2_proxy": { 2024-09-21T05:54:04.044 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T05:54:04.045 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.045 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.045 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.045 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T05:54:04.045 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.045 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.045 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.045 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "oauth2-proxy container image", 2024-09-21T05:54:04.045 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.046 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.046 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.046 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_prometheus": { 2024-09-21T05:54:04.046 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_prometheus", 2024-09-21T05:54:04.046 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.046 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.046 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.046 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T05:54:04.046 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.046 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.046 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.046 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-21T05:54:04.046 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.047 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.047 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.047 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_promtail": { 2024-09-21T05:54:04.047 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_promtail", 2024-09-21T05:54:04.047 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.047 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.047 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.047 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T05:54:04.047 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.047 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.047 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.047 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Promtail container image", 2024-09-21T05:54:04.047 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.047 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.047 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.048 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_samba": { 2024-09-21T05:54:04.048 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_samba", 2024-09-21T05:54:04.048 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.048 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.048 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.048 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T05:54:04.048 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.048 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.048 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.048 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Samba/SMB container image", 2024-09-21T05:54:04.048 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.048 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.048 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.048 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_samba_metrics": { 2024-09-21T05:54:04.049 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_samba_metrics", 2024-09-21T05:54:04.049 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.049 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.049 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.049 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T05:54:04.049 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.049 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.049 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.049 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T05:54:04.049 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.049 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.049 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.049 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_snmp_gateway": { 2024-09-21T05:54:04.049 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_snmp_gateway", 2024-09-21T05:54:04.049 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.049 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.050 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.050 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T05:54:04.050 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.050 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.050 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.050 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SNMP Gateway container image", 2024-09-21T05:54:04.050 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.050 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.050 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.050 INFO:teuthology.orchestra.run.smithi070.stdout: "container_init": { 2024-09-21T05:54:04.050 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_init", 2024-09-21T05:54:04.050 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.050 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.050 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.051 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.051 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.051 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.051 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.051 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T05:54:04.051 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.051 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.051 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.051 INFO:teuthology.orchestra.run.smithi070.stdout: "daemon_cache_timeout": { 2024-09-21T05:54:04.051 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "daemon_cache_timeout", 2024-09-21T05:54:04.051 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:04.051 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.051 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.051 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-21T05:54:04.051 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.051 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.052 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.052 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T05:54:04.052 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.052 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.052 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.052 INFO:teuthology.orchestra.run.smithi070.stdout: "default_cephadm_command_timeout": { 2024-09-21T05:54:04.052 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T05:54:04.052 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.052 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.052 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.052 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "900", 2024-09-21T05:54:04.052 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.052 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.052 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.052 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T05:54:04.052 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.053 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.053 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.053 INFO:teuthology.orchestra.run.smithi070.stdout: "default_registry": { 2024-09-21T05:54:04.053 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_registry", 2024-09-21T05:54:04.053 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.053 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.053 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.053 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io", 2024-09-21T05:54:04.053 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.053 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.053 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.053 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T05:54:04.053 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.053 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.053 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.054 INFO:teuthology.orchestra.run.smithi070.stdout: "device_cache_timeout": { 2024-09-21T05:54:04.054 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_cache_timeout", 2024-09-21T05:54:04.054 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:04.054 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.054 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.054 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1800", 2024-09-21T05:54:04.054 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.054 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.054 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.054 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache device inventory", 2024-09-21T05:54:04.054 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.054 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.054 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.054 INFO:teuthology.orchestra.run.smithi070.stdout: "device_enhanced_scan": { 2024-09-21T05:54:04.055 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_enhanced_scan", 2024-09-21T05:54:04.055 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.055 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.055 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.055 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.055 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.055 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.055 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.055 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T05:54:04.055 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.055 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.055 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.055 INFO:teuthology.orchestra.run.smithi070.stdout: "facts_cache_timeout": { 2024-09-21T05:54:04.055 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "facts_cache_timeout", 2024-09-21T05:54:04.055 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:04.056 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.056 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.056 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-21T05:54:04.056 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.056 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.056 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.056 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache host facts data", 2024-09-21T05:54:04.056 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.056 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.056 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.056 INFO:teuthology.orchestra.run.smithi070.stdout: "grafana_dashboards_path": { 2024-09-21T05:54:04.056 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "grafana_dashboards_path", 2024-09-21T05:54:04.056 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.056 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.057 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.057 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T05:54:04.057 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.057 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.057 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.057 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T05:54:04.057 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.057 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.057 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.057 INFO:teuthology.orchestra.run.smithi070.stdout: "host_check_interval": { 2024-09-21T05:54:04.057 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "host_check_interval", 2024-09-21T05:54:04.057 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:04.057 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.057 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.057 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-21T05:54:04.057 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.058 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.058 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.058 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to perform a host check", 2024-09-21T05:54:04.058 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.058 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.058 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.058 INFO:teuthology.orchestra.run.smithi070.stdout: "hw_monitoring": { 2024-09-21T05:54:04.058 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hw_monitoring", 2024-09-21T05:54:04.058 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.058 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.058 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.058 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.058 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.058 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.058 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.059 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T05:54:04.059 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.059 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.059 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.059 INFO:teuthology.orchestra.run.smithi070.stdout: "inventory_list_all": { 2024-09-21T05:54:04.059 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "inventory_list_all", 2024-09-21T05:54:04.059 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.059 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.059 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.059 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.059 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.059 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.059 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.059 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T05:54:04.059 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.060 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.060 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.060 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.060 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.060 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.060 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.060 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.060 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.060 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.060 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.060 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.060 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.060 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.060 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.060 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.060 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.061 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.061 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.061 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.061 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.061 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.061 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.061 INFO:teuthology.orchestra.run.smithi070.stdout: "log_refresh_metadata": { 2024-09-21T05:54:04.061 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_refresh_metadata", 2024-09-21T05:54:04.061 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.061 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.061 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.061 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.061 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.061 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.061 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.061 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T05:54:04.062 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.062 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.062 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.062 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.062 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.062 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.062 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.062 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.062 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.062 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.062 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.062 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.062 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T05:54:04.062 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.062 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.063 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.063 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.063 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.063 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.063 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.063 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.063 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.063 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.063 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.063 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.063 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.063 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.063 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.063 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.063 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.064 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.064 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.064 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.064 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.064 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.064 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.064 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.064 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.064 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.064 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.064 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.064 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.064 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.064 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.065 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.065 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.065 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.065 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.065 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.065 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T05:54:04.065 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T05:54:04.065 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.065 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.065 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.065 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.065 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.065 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.066 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.066 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T05:54:04.066 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.066 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.066 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.066 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T05:54:04.066 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T05:54:04.066 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.066 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.066 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.066 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "*", 2024-09-21T05:54:04.066 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.066 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.067 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.067 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T05:54:04.067 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.067 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.067 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.067 INFO:teuthology.orchestra.run.smithi070.stdout: "max_count_per_host": { 2024-09-21T05:54:04.067 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_count_per_host", 2024-09-21T05:54:04.067 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.067 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.067 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.067 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-21T05:54:04.067 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.068 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.068 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.068 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of daemons per service per host", 2024-09-21T05:54:04.068 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.068 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.068 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.068 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd_draining_count": { 2024-09-21T05:54:04.068 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_osd_draining_count", 2024-09-21T05:54:04.068 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.068 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.068 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.068 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-21T05:54:04.068 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.069 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.069 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.069 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T05:54:04.069 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.069 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.069 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.069 INFO:teuthology.orchestra.run.smithi070.stdout: "migration_current": { 2024-09-21T05:54:04.069 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "migration_current", 2024-09-21T05:54:04.069 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.069 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.069 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.070 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.070 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.070 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.070 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.070 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "internal - do not modify", 2024-09-21T05:54:04.070 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.070 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.070 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.071 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2024-09-21T05:54:04.071 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2024-09-21T05:54:04.071 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.071 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.071 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.071 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "root", 2024-09-21T05:54:04.071 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.071 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.071 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.071 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm-package", 2024-09-21T05:54:04.072 INFO:teuthology.orchestra.run.smithi070.stdout: "root" 2024-09-21T05:54:04.072 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.072 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T05:54:04.072 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.072 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.072 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.072 INFO:teuthology.orchestra.run.smithi070.stdout: "oob_default_addr": { 2024-09-21T05:54:04.072 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "oob_default_addr", 2024-09-21T05:54:04.072 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.072 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.073 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.073 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "169.254.1.1", 2024-09-21T05:54:04.073 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.073 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.073 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.073 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T05:54:04.073 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.073 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.073 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.073 INFO:teuthology.orchestra.run.smithi070.stdout: "prometheus_alerts_path": { 2024-09-21T05:54:04.073 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus_alerts_path", 2024-09-21T05:54:04.073 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.074 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.074 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.074 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T05:54:04.074 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.074 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.074 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.074 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T05:54:04.074 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.074 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.074 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.074 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_insecure": { 2024-09-21T05:54:04.074 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_insecure", 2024-09-21T05:54:04.074 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.075 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.075 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.075 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.075 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.075 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.075 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.075 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T05:54:04.075 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.075 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.075 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.075 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_password": { 2024-09-21T05:54:04.075 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_password", 2024-09-21T05:54:04.076 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.076 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.076 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.076 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.076 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.076 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.076 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.076 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T05:54:04.076 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.076 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.076 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.076 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_url": { 2024-09-21T05:54:04.077 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_url", 2024-09-21T05:54:04.077 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.077 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.077 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.077 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.077 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.077 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.077 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.077 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T05:54:04.077 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.077 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.077 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.077 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_username": { 2024-09-21T05:54:04.078 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_username", 2024-09-21T05:54:04.078 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.078 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.078 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.078 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.078 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.078 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.078 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.078 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T05:54:04.078 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.078 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.078 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.078 INFO:teuthology.orchestra.run.smithi070.stdout: "secure_monitoring_stack": { 2024-09-21T05:54:04.079 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "secure_monitoring_stack", 2024-09-21T05:54:04.079 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.079 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.079 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.079 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.079 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.079 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.079 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.079 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T05:54:04.079 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.079 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.079 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.079 INFO:teuthology.orchestra.run.smithi070.stdout: "service_discovery_port": { 2024-09-21T05:54:04.080 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "service_discovery_port", 2024-09-21T05:54:04.080 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.080 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.080 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.080 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8765", 2024-09-21T05:54:04.080 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.080 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.080 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.080 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "cephadm service discovery port", 2024-09-21T05:54:04.080 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.080 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.080 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.080 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.080 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.081 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.081 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.081 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.081 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.081 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.081 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.081 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.081 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.081 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.081 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.081 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.081 INFO:teuthology.orchestra.run.smithi070.stdout: "ssh_config_file": { 2024-09-21T05:54:04.082 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssh_config_file", 2024-09-21T05:54:04.082 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.082 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.082 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.082 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.082 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.082 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.082 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.082 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T05:54:04.082 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.082 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.082 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.082 INFO:teuthology.orchestra.run.smithi070.stdout: "ssh_keepalive_count_max": { 2024-09-21T05:54:04.083 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T05:54:04.083 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.083 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.083 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.083 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3", 2024-09-21T05:54:04.083 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.083 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.083 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.083 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T05:54:04.083 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.083 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.083 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.083 INFO:teuthology.orchestra.run.smithi070.stdout: "ssh_keepalive_interval": { 2024-09-21T05:54:04.083 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssh_keepalive_interval", 2024-09-21T05:54:04.084 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.084 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.084 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.084 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7", 2024-09-21T05:54:04.084 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.084 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.084 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.084 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T05:54:04.084 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.084 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.084 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.084 INFO:teuthology.orchestra.run.smithi070.stdout: "use_agent": { 2024-09-21T05:54:04.084 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_agent", 2024-09-21T05:54:04.085 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.085 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.085 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.085 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.085 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.085 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.085 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.085 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T05:54:04.085 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.085 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.085 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.085 INFO:teuthology.orchestra.run.smithi070.stdout: "use_repo_digest": { 2024-09-21T05:54:04.085 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_repo_digest", 2024-09-21T05:54:04.086 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.086 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.086 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.086 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.086 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.086 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.086 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.086 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T05:54:04.086 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.087 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.087 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.087 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_failed_host_check": { 2024-09-21T05:54:04.087 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_failed_host_check", 2024-09-21T05:54:04.087 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.087 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.087 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.087 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.087 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.088 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.088 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.088 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T05:54:04.088 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.088 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.088 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.088 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_daemons": { 2024-09-21T05:54:04.088 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_daemons", 2024-09-21T05:54:04.088 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.088 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.088 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.089 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.089 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.089 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.089 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.089 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T05:54:04.089 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.089 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.089 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.089 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_hosts": { 2024-09-21T05:54:04.089 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_hosts", 2024-09-21T05:54:04.089 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.089 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.089 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.089 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.090 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.090 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.090 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.090 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T05:54:04.090 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.090 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.090 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.090 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.090 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.090 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crash", 2024-09-21T05:54:04.090 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.091 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.091 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.091 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.091 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.091 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.091 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.091 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.091 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.091 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.091 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.091 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.091 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.091 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.091 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.092 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.092 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.092 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.092 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.092 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.092 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.092 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.092 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.092 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.092 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.092 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.092 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.092 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.093 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.093 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.093 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.093 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.093 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.093 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.093 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.093 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.093 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.093 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.093 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.093 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.093 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.093 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.094 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.094 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.094 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.094 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.094 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.094 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.094 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.094 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.094 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.094 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.094 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.094 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.094 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.094 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.095 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.095 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.095 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.095 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.095 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.095 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.095 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.095 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.095 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.095 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.095 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.095 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.095 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.096 INFO:teuthology.orchestra.run.smithi070.stdout: "retain_interval": { 2024-09-21T05:54:04.096 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retain_interval", 2024-09-21T05:54:04.096 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:04.096 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.096 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.096 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "31536000", 2024-09-21T05:54:04.096 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.096 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.096 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.096 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T05:54:04.096 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.096 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.096 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.097 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.097 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.097 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.097 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.097 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.097 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.097 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.097 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.097 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.097 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.097 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.097 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.097 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.098 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_recent_interval": { 2024-09-21T05:54:04.098 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_recent_interval", 2024-09-21T05:54:04.098 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:04.098 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.098 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.098 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1209600", 2024-09-21T05:54:04.098 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.098 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.098 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.098 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T05:54:04.098 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.098 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.098 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.099 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.099 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.099 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dashboard", 2024-09-21T05:54:04.099 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.099 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.099 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.099 INFO:teuthology.orchestra.run.smithi070.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T05:54:04.099 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T05:54:04.099 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.099 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.099 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.099 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-21T05:54:04.100 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.100 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.100 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.100 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.100 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.100 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.100 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.100 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T05:54:04.100 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T05:54:04.100 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.100 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.101 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.101 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.101 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.101 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.101 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.101 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.101 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.101 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.101 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.101 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T05:54:04.102 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T05:54:04.102 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.102 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.102 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.102 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.102 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.102 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.102 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.102 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.102 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.103 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.103 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.103 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_ENABLED": { 2024-09-21T05:54:04.103 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T05:54:04.103 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.103 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.103 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.103 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.103 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.103 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.103 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.103 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.103 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.104 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.104 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.104 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T05:54:04.104 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T05:54:04.104 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.104 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.104 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.104 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.104 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.104 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.104 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.104 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.105 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.105 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.105 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.105 INFO:teuthology.orchestra.run.smithi070.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T05:54:04.105 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T05:54:04.105 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.105 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.105 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.105 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.105 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.105 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.105 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.105 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.105 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.106 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.106 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.106 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T05:54:04.106 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T05:54:04.106 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.106 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.106 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.106 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.106 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.106 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.106 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.106 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.107 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.107 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.107 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.107 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T05:54:04.107 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T05:54:04.107 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.107 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.107 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.107 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.107 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.107 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.107 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.108 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.108 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.108 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.108 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.108 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T05:54:04.108 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T05:54:04.108 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.108 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.108 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.108 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.108 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.108 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.109 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.109 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.109 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.109 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.109 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.109 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T05:54:04.109 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T05:54:04.109 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.109 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.109 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.109 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.109 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.109 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.109 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.110 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.110 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.110 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.110 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.110 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T05:54:04.110 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T05:54:04.110 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.110 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.110 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.110 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.110 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.110 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.110 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.111 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.111 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.111 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.111 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.111 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T05:54:04.111 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T05:54:04.111 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.111 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.111 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.111 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.111 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.111 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.112 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.112 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.112 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.112 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.112 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.112 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T05:54:04.112 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T05:54:04.112 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.112 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.112 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.112 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.112 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.113 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.113 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.113 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.113 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.113 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.113 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.113 INFO:teuthology.orchestra.run.smithi070.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T05:54:04.113 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T05:54:04.113 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.113 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.113 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.113 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.114 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.114 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.114 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.114 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.114 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.114 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.114 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.114 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T05:54:04.114 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T05:54:04.114 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.114 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.114 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.114 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-09-21T05:54:04.115 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.115 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.115 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.115 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.115 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.115 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.115 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.115 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T05:54:04.115 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T05:54:04.115 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.115 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.115 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.115 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.115 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.116 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.116 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.116 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.116 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.116 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.116 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.116 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_URL": { 2024-09-21T05:54:04.116 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_URL", 2024-09-21T05:54:04.116 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.116 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.116 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.116 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.116 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.117 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.117 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.117 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.117 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.117 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.117 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.117 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T05:54:04.117 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T05:54:04.117 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.117 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.118 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.118 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-09-21T05:54:04.118 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.118 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.118 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.118 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.118 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.118 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.118 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.118 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T05:54:04.118 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T05:54:04.119 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.119 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.119 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.119 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.119 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.119 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.119 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.119 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.119 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.119 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.119 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.119 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T05:54:04.120 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T05:54:04.120 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.120 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.120 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.120 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.120 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.120 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.120 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.120 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.120 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.120 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.120 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.120 INFO:teuthology.orchestra.run.smithi070.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T05:54:04.120 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T05:54:04.120 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.121 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.121 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.121 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.121 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.121 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.121 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.121 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.121 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.121 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.121 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.121 INFO:teuthology.orchestra.run.smithi070.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T05:54:04.121 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T05:54:04.121 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.121 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.121 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.121 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.122 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.122 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.122 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.122 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.122 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.122 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.122 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.122 INFO:teuthology.orchestra.run.smithi070.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T05:54:04.122 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T05:54:04.122 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.122 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.122 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.122 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "[]", 2024-09-21T05:54:04.122 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.123 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.123 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.123 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.123 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.123 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.123 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.123 INFO:teuthology.orchestra.run.smithi070.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T05:54:04.123 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T05:54:04.123 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.123 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.123 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.123 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "{}", 2024-09-21T05:54:04.123 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.123 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.124 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.124 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.124 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.124 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.124 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.124 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T05:54:04.124 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T05:54:04.124 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.124 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.124 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.124 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.124 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.124 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.124 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.125 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.125 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.125 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.125 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.125 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T05:54:04.125 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T05:54:04.125 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.125 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.125 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.125 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.125 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.125 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.125 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.125 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.125 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.126 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.126 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.126 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T05:54:04.126 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T05:54:04.126 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.126 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.126 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.126 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.126 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.126 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.126 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.126 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.126 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.127 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.127 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.127 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T05:54:04.127 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T05:54:04.127 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.127 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.127 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.127 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.127 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.127 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.127 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.127 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.127 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.127 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.128 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.128 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T05:54:04.128 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T05:54:04.128 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.128 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.128 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.128 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.128 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.128 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.128 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.128 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.128 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.128 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.128 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.129 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T05:54:04.129 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T05:54:04.129 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.129 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.129 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.129 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.129 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.129 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.129 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.129 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.129 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.129 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.129 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.130 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T05:54:04.130 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T05:54:04.130 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.130 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.130 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.130 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.130 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.130 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.130 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.130 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.130 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.130 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.130 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.131 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T05:54:04.131 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T05:54:04.131 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.131 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.131 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.131 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.131 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.131 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.131 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.131 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.131 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.131 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.131 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.131 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T05:54:04.132 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T05:54:04.132 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.132 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.132 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.132 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.132 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.132 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.132 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.132 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.132 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.132 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.132 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.132 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T05:54:04.132 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T05:54:04.132 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.133 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.133 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.133 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.133 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.133 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.133 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.133 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.133 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.133 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.133 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.133 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T05:54:04.133 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T05:54:04.133 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.133 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.133 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.134 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T05:54:04.134 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.134 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.134 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.134 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.134 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.134 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.134 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.134 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T05:54:04.134 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T05:54:04.134 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.134 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.134 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.134 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-21T05:54:04.134 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.135 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.135 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.135 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.135 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.135 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.135 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.135 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T05:54:04.135 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T05:54:04.135 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.135 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.135 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.135 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8", 2024-09-21T05:54:04.135 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.135 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.135 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.135 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.136 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.136 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.136 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.136 INFO:teuthology.orchestra.run.smithi070.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T05:54:04.136 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T05:54:04.136 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.136 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.136 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.136 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "45", 2024-09-21T05:54:04.136 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.136 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.136 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.136 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.136 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.137 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.137 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.137 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T05:54:04.137 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T05:54:04.137 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.137 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.137 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.137 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.137 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.137 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.137 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.137 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.137 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.137 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.137 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.138 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T05:54:04.138 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T05:54:04.138 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.138 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.138 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.138 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-09-21T05:54:04.138 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.138 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.138 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.138 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.138 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.138 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.138 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.138 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T05:54:04.138 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T05:54:04.139 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.139 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.139 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.139 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.139 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.139 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.139 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.139 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.139 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.139 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.139 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.139 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T05:54:04.139 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T05:54:04.139 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.139 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.140 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.140 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.140 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.140 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.140 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.140 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.140 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.140 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.140 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.140 INFO:teuthology.orchestra.run.smithi070.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T05:54:04.140 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T05:54:04.140 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.140 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.140 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.140 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.141 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.141 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.141 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.141 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.141 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.141 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.141 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.141 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T05:54:04.141 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T05:54:04.141 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.141 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.141 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.141 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.141 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.141 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.141 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.142 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.142 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.142 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.142 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.142 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T05:54:04.142 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T05:54:04.142 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.142 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.142 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.142 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-21T05:54:04.142 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.142 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.142 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.142 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.143 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.143 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.143 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.143 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T05:54:04.143 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T05:54:04.143 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.143 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.143 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.143 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-21T05:54:04.143 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.143 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.143 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.143 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.143 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.143 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.144 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.144 INFO:teuthology.orchestra.run.smithi070.stdout: "cross_origin_url": { 2024-09-21T05:54:04.144 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cross_origin_url", 2024-09-21T05:54:04.144 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.144 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.144 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.144 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.144 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.144 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.144 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.144 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.144 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.144 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.144 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.144 INFO:teuthology.orchestra.run.smithi070.stdout: "crt_file": { 2024-09-21T05:54:04.145 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crt_file", 2024-09-21T05:54:04.145 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.145 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.145 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.145 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.145 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.145 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.145 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.145 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.145 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.145 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.145 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.145 INFO:teuthology.orchestra.run.smithi070.stdout: "debug": { 2024-09-21T05:54:04.145 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "debug", 2024-09-21T05:54:04.146 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.146 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.146 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.146 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.146 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.146 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.146 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.146 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable/disable debug options", 2024-09-21T05:54:04.146 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.146 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.146 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.146 INFO:teuthology.orchestra.run.smithi070.stdout: "jwt_token_ttl": { 2024-09-21T05:54:04.147 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "jwt_token_ttl", 2024-09-21T05:54:04.147 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.147 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.147 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.147 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "28800", 2024-09-21T05:54:04.147 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.147 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.147 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.147 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.147 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.147 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.147 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.147 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2024-09-21T05:54:04.147 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2024-09-21T05:54:04.148 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.148 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.148 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.148 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.148 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.148 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.148 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.148 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.148 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.148 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.148 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.148 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.148 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.149 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.149 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.149 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.149 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.149 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.149 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.149 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.149 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.149 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.149 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.149 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.149 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.149 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.149 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.149 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.150 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.150 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.150 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.150 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.150 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.150 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.150 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.150 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.150 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.150 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.150 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.150 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.150 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.150 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.151 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.151 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.151 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.151 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.151 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.151 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.151 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.151 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.151 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.151 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.151 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.151 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.151 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.152 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.152 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.152 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.152 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.152 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.152 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.152 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.152 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.152 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.152 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.152 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.152 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.152 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.152 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.153 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.153 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.153 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.153 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.153 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.153 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.153 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.153 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.153 INFO:teuthology.orchestra.run.smithi070.stdout: "motd": { 2024-09-21T05:54:04.153 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "motd", 2024-09-21T05:54:04.153 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.153 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.153 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.153 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.153 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.154 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.154 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.154 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "The message of the day", 2024-09-21T05:54:04.154 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.154 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.154 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.154 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect_resolve_ip_addr": { 2024-09-21T05:54:04.154 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T05:54:04.154 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.154 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.154 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.154 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.154 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.155 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.155 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.155 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.155 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.155 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.155 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.155 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-09-21T05:54:04.155 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-09-21T05:54:04.155 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.155 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.155 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.155 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2024-09-21T05:54:04.155 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.155 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.156 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.156 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.156 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.156 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.156 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.156 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-09-21T05:54:04.156 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-09-21T05:54:04.156 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.156 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.156 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.156 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8080", 2024-09-21T05:54:04.156 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.156 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.157 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.157 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.157 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.157 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.157 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.157 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.157 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.157 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.157 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.157 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.157 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.157 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.157 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.157 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.157 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.157 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.158 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.158 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.158 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2024-09-21T05:54:04.158 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2024-09-21T05:54:04.158 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.158 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.158 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.158 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.158 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.158 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.158 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.158 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.158 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.159 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.159 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.159 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl_server_port": { 2024-09-21T05:54:04.159 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl_server_port", 2024-09-21T05:54:04.159 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.159 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.159 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.159 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8443", 2024-09-21T05:54:04.159 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.159 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.159 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.159 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.159 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.159 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.159 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.160 INFO:teuthology.orchestra.run.smithi070.stdout: "sso_oauth2": { 2024-09-21T05:54:04.160 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sso_oauth2", 2024-09-21T05:54:04.160 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.160 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.160 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.160 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.160 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.160 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.160 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.160 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.160 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.160 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.160 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.160 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2024-09-21T05:54:04.160 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2024-09-21T05:54:04.161 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.161 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.161 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.161 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "redirect", 2024-09-21T05:54:04.161 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.161 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.161 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.161 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.161 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect" 2024-09-21T05:54:04.161 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.161 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.161 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.161 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.161 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.161 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2024-09-21T05:54:04.161 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2024-09-21T05:54:04.162 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.162 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.162 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.162 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-09-21T05:54:04.162 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2024-09-21T05:54:04.162 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2024-09-21T05:54:04.162 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.162 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.162 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.162 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.162 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.162 INFO:teuthology.orchestra.run.smithi070.stdout: "url_prefix": { 2024-09-21T05:54:04.162 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url_prefix", 2024-09-21T05:54:04.162 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.163 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.163 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.163 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.163 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.163 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.163 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.163 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.163 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.163 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.163 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.163 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.163 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.163 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "devicehealth", 2024-09-21T05:54:04.163 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.164 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.164 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.164 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_monitoring": { 2024-09-21T05:54:04.164 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_monitoring", 2024-09-21T05:54:04.164 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.164 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.164 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.164 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.164 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.164 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.164 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.164 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "monitor device health metrics", 2024-09-21T05:54:04.164 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.164 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.164 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.164 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.165 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.165 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.165 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.165 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.165 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.165 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.165 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.165 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.165 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.165 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.165 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.165 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.165 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.165 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.165 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.165 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.166 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.166 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.166 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.166 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.166 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.166 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.166 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.166 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.166 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.166 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.166 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.166 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.166 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.166 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.166 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.167 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.167 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.167 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.167 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.167 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.167 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.167 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.167 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.167 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.167 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.167 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.167 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.167 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.167 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.167 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.167 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.168 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.168 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.168 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.168 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.168 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.168 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.168 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.168 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.168 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.168 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.168 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.168 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.168 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.168 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.168 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.168 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.169 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.169 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.169 INFO:teuthology.orchestra.run.smithi070.stdout: "mark_out_threshold": { 2024-09-21T05:54:04.169 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mark_out_threshold", 2024-09-21T05:54:04.169 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:04.169 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.169 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.169 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2419200", 2024-09-21T05:54:04.169 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.169 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.169 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.169 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T05:54:04.169 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.169 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.170 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.170 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": { 2024-09-21T05:54:04.170 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_name", 2024-09-21T05:54:04.170 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.170 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.170 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.170 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "device_health_metrics", 2024-09-21T05:54:04.170 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.170 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.170 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.170 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T05:54:04.170 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.170 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.171 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.171 INFO:teuthology.orchestra.run.smithi070.stdout: "retention_period": { 2024-09-21T05:54:04.171 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retention_period", 2024-09-21T05:54:04.171 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:04.171 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.171 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.171 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15552000", 2024-09-21T05:54:04.171 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.171 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.171 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.171 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain device health metrics", 2024-09-21T05:54:04.171 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.171 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.172 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.172 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_frequency": { 2024-09-21T05:54:04.172 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_frequency", 2024-09-21T05:54:04.172 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:04.172 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.172 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.172 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2024-09-21T05:54:04.172 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.172 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.172 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.172 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T05:54:04.172 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.172 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.172 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.173 INFO:teuthology.orchestra.run.smithi070.stdout: "self_heal": { 2024-09-21T05:54:04.173 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "self_heal", 2024-09-21T05:54:04.173 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.173 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.173 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.173 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.173 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.173 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.173 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.173 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T05:54:04.173 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.173 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.173 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.174 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-21T05:54:04.174 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-21T05:54:04.174 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:04.174 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.174 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.174 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-21T05:54:04.174 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.174 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.174 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.174 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T05:54:04.174 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.174 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.174 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.175 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.175 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.175 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.175 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.175 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.175 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.175 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.175 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.175 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.175 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.175 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.175 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.175 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.176 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_threshold": { 2024-09-21T05:54:04.176 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_threshold", 2024-09-21T05:54:04.176 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:04.176 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.176 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.176 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7257600", 2024-09-21T05:54:04.176 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.176 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.176 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.176 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T05:54:04.176 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.176 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.176 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.177 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "diskprediction_local", 2024-09-21T05:54:04.177 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.177 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.177 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.177 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.177 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.177 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.177 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.177 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.177 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.177 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.178 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.178 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.178 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.178 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.178 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.178 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.178 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.178 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.178 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.178 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.178 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.178 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.178 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.179 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.179 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.179 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.179 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.179 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.179 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.179 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.179 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.179 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.179 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.179 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.179 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.179 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.179 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.180 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.180 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.180 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.180 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.180 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.180 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.180 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.180 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.180 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.180 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.180 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.180 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.180 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.180 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.181 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.181 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.181 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.181 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.181 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.181 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.181 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.181 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.181 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.181 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.181 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.181 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.181 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.181 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.182 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.182 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.182 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.182 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.182 INFO:teuthology.orchestra.run.smithi070.stdout: "predict_interval": { 2024-09-21T05:54:04.182 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predict_interval", 2024-09-21T05:54:04.182 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.182 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.182 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.182 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2024-09-21T05:54:04.182 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.182 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.182 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.183 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.183 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.183 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.183 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.183 INFO:teuthology.orchestra.run.smithi070.stdout: "predictor_model": { 2024-09-21T05:54:04.183 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predictor_model", 2024-09-21T05:54:04.183 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.183 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.183 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.183 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "prophetstor", 2024-09-21T05:54:04.183 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.183 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.183 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.183 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.184 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.184 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.184 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.184 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-21T05:54:04.184 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-21T05:54:04.184 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.184 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.184 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.184 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-21T05:54:04.184 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.184 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.184 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.184 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.184 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.185 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.185 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.185 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.185 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.185 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.185 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.185 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.185 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.185 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.185 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.185 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.185 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.185 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.185 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.185 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.186 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.186 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.186 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "influx", 2024-09-21T05:54:04.186 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": false, 2024-09-21T05:54:04.186 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "influxdb python module not found", 2024-09-21T05:54:04.186 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.186 INFO:teuthology.orchestra.run.smithi070.stdout: "batch_size": { 2024-09-21T05:54:04.186 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "batch_size", 2024-09-21T05:54:04.186 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.186 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.186 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.186 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5000", 2024-09-21T05:54:04.186 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.187 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.187 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.187 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T05:54:04.187 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.187 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.187 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.187 INFO:teuthology.orchestra.run.smithi070.stdout: "database": { 2024-09-21T05:54:04.187 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "database", 2024-09-21T05:54:04.187 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.187 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.187 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.187 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "ceph", 2024-09-21T05:54:04.187 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.188 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.188 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.188 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T05:54:04.188 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.188 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.188 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.188 INFO:teuthology.orchestra.run.smithi070.stdout: "hostname": { 2024-09-21T05:54:04.188 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hostname", 2024-09-21T05:54:04.188 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.188 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.188 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.188 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.189 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.189 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.189 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.189 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server hostname", 2024-09-21T05:54:04.189 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.189 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.189 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.189 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-21T05:54:04.189 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-21T05:54:04.189 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:04.189 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.189 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.189 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "30", 2024-09-21T05:54:04.189 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "5", 2024-09-21T05:54:04.190 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.190 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.190 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T05:54:04.190 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.190 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.190 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.190 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.190 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.190 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.190 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.190 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.190 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.191 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.191 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.191 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.191 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.191 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.191 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.191 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.191 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.191 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.191 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.191 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.191 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.191 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.192 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.192 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.192 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.192 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.192 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.192 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.192 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.192 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.192 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.192 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.192 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.192 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.192 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.193 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.193 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.193 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.193 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.193 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.193 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.193 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.193 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.193 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.193 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.193 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.193 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.193 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.194 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.194 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.194 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.194 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.194 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.194 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.194 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.194 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.194 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.194 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.194 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.194 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.194 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.194 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.195 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.195 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.195 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.195 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.195 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.195 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.195 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.195 INFO:teuthology.orchestra.run.smithi070.stdout: "password": { 2024-09-21T05:54:04.195 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "password", 2024-09-21T05:54:04.195 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.195 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.196 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.196 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.196 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.196 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.196 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.196 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "password of InfluxDB server user", 2024-09-21T05:54:04.196 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.196 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.196 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.196 INFO:teuthology.orchestra.run.smithi070.stdout: "port": { 2024-09-21T05:54:04.196 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "port", 2024-09-21T05:54:04.196 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.196 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.196 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.197 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8086", 2024-09-21T05:54:04.197 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.197 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.197 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.197 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server port", 2024-09-21T05:54:04.197 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.197 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.197 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.197 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.197 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.197 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.197 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.197 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.197 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.197 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.198 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.198 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.198 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.198 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.198 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.198 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.198 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2024-09-21T05:54:04.198 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2024-09-21T05:54:04.198 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.198 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.198 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.198 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "false", 2024-09-21T05:54:04.198 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.198 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.199 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.199 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T05:54:04.199 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.199 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.199 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.199 INFO:teuthology.orchestra.run.smithi070.stdout: "threads": { 2024-09-21T05:54:04.199 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threads", 2024-09-21T05:54:04.199 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.199 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.199 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.199 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-21T05:54:04.199 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-21T05:54:04.199 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "32", 2024-09-21T05:54:04.199 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.199 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T05:54:04.200 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.200 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.200 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.200 INFO:teuthology.orchestra.run.smithi070.stdout: "username": { 2024-09-21T05:54:04.200 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "username", 2024-09-21T05:54:04.200 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.200 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.200 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.200 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.200 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.200 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.200 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.200 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "username of InfluxDB server user", 2024-09-21T05:54:04.200 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.200 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.201 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.201 INFO:teuthology.orchestra.run.smithi070.stdout: "verify_ssl": { 2024-09-21T05:54:04.201 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "verify_ssl", 2024-09-21T05:54:04.201 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.201 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.201 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.201 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "true", 2024-09-21T05:54:04.201 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.201 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.201 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.201 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T05:54:04.201 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.201 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.201 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.202 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.202 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.202 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "insights", 2024-09-21T05:54:04.202 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.202 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.202 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.202 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.202 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.202 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.202 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.202 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.203 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.203 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.203 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.203 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.203 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.203 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.203 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.203 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.203 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.203 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.203 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.203 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.203 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.203 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.204 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.204 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.204 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.204 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.204 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.204 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.204 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.204 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.204 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.204 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.204 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.204 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.205 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.205 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.205 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.205 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.205 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.205 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.205 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.205 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.205 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.205 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.205 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.205 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.205 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.205 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.206 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.206 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.206 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.206 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.206 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.206 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.206 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.206 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.206 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.206 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.206 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.206 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.206 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.206 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.207 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.207 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.207 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.207 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.207 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.207 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.207 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.207 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.207 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.207 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.207 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.207 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.207 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.207 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.207 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.208 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.208 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.208 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.208 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.208 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.208 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.208 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.208 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "iostat", 2024-09-21T05:54:04.208 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.208 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.208 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.208 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.208 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.208 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.208 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.209 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.209 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.209 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.209 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.209 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.209 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.209 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.209 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.209 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.209 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.209 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.209 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.209 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.209 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.209 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.209 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.210 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.210 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.210 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.210 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.210 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.210 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.210 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.210 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.210 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.210 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.210 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.210 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.210 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.210 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.210 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.211 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.211 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.211 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.211 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.211 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.211 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.211 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.211 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.211 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.211 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.211 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.211 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.211 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.211 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.211 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.211 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.212 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.212 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.212 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.212 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.212 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.212 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.212 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.212 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.212 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.212 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.212 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.212 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.212 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.212 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.212 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.213 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.213 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.213 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.213 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.213 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.213 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.213 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.213 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.213 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.213 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.213 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.213 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.213 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.213 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.213 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.214 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "k8sevents", 2024-09-21T05:54:04.214 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.214 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.214 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.214 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_event_retention_days": { 2024-09-21T05:54:04.214 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ceph_event_retention_days", 2024-09-21T05:54:04.214 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.214 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.214 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.214 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7", 2024-09-21T05:54:04.214 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.214 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.214 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.214 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T05:54:04.214 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.215 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.215 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.215 INFO:teuthology.orchestra.run.smithi070.stdout: "config_check_secs": { 2024-09-21T05:54:04.215 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_check_secs", 2024-09-21T05:54:04.215 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.215 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.215 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.215 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-21T05:54:04.215 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "10", 2024-09-21T05:54:04.215 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.215 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.215 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T05:54:04.215 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.215 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.216 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.216 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.216 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.216 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.216 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.216 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.216 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.216 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.216 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.216 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.216 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.216 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.216 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.216 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.217 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.217 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.217 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.217 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.217 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.217 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.217 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.217 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.217 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.217 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.217 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.218 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.218 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.218 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.218 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.218 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.218 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.218 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.218 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.218 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.218 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.218 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.219 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.219 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.219 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.219 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.219 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.219 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.219 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.219 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.219 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.219 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.219 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.220 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.220 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.220 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.220 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.220 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.220 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.220 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.220 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.220 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.220 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.220 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.220 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.220 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.220 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.220 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.221 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.221 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.221 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.221 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.221 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.221 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.221 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.221 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.221 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.221 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.221 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.222 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.222 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.222 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.222 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.222 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.222 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.222 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.222 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.222 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.222 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "localpool", 2024-09-21T05:54:04.222 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.222 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.222 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.223 INFO:teuthology.orchestra.run.smithi070.stdout: "failure_domain": { 2024-09-21T05:54:04.223 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "failure_domain", 2024-09-21T05:54:04.223 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.223 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.223 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.223 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "host", 2024-09-21T05:54:04.223 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.223 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.223 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.223 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "failure domain for any created local pool", 2024-09-21T05:54:04.223 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T05:54:04.223 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.223 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.223 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.224 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.224 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.224 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.224 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.224 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.224 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.224 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.224 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.224 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.224 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.224 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.224 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.224 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.225 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.225 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.225 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.225 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.225 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.225 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.225 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.225 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.225 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.225 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.225 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.225 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.225 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.226 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.226 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.226 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.226 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.226 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.226 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.226 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.226 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.226 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.226 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.226 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.226 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.226 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.226 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.227 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.227 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.227 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.227 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.227 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.227 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.227 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.227 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.227 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.227 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.227 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.227 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.227 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.228 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.228 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.228 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.228 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.228 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.228 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.228 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.228 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.228 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.228 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.228 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.228 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.228 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": { 2024-09-21T05:54:04.228 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_size", 2024-09-21T05:54:04.229 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.229 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.229 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.229 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.229 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.229 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.229 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.229 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default min_size for any created local pool", 2024-09-21T05:54:04.229 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T05:54:04.229 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.229 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.229 INFO:teuthology.orchestra.run.smithi070.stdout: "num_rep": { 2024-09-21T05:54:04.229 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "num_rep", 2024-09-21T05:54:04.229 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.230 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.230 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.230 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3", 2024-09-21T05:54:04.230 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.230 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.230 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.230 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default replica count for any created local pool", 2024-09-21T05:54:04.230 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.230 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.230 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.230 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": { 2024-09-21T05:54:04.231 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_num", 2024-09-21T05:54:04.231 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.231 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.231 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.231 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "128", 2024-09-21T05:54:04.231 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.231 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.231 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.231 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T05:54:04.231 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.231 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.231 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.231 INFO:teuthology.orchestra.run.smithi070.stdout: "prefix": { 2024-09-21T05:54:04.232 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prefix", 2024-09-21T05:54:04.232 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.232 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.232 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.232 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.232 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.232 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.232 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.232 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name prefix for any created local pool", 2024-09-21T05:54:04.232 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.232 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.232 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.232 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.232 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.233 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.233 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.233 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.233 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.233 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.233 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.233 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.233 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.233 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.233 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.233 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.233 INFO:teuthology.orchestra.run.smithi070.stdout: "subtree": { 2024-09-21T05:54:04.233 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "subtree", 2024-09-21T05:54:04.233 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.234 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.234 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.234 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "rack", 2024-09-21T05:54:04.234 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.234 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.234 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.234 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T05:54:04.234 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T05:54:04.234 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.234 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.234 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.234 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.235 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mds_autoscaler", 2024-09-21T05:54:04.235 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.235 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.235 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.235 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.235 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.235 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.235 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.235 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.235 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.235 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.235 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.235 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.235 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.235 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirroring", 2024-09-21T05:54:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "nfs", 2024-09-21T05:54:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2024-09-21T05:54:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: "fail_fs": { 2024-09-21T05:54:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "fail_fs", 2024-09-21T05:54:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T05:54:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator": { 2024-09-21T05:54:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2024-09-21T05:54:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm", 2024-09-21T05:54:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "rook", 2024-09-21T05:54:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "test_orchestrator" 2024-09-21T05:54:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Orchestrator backend", 2024-09-21T05:54:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_perf_query", 2024-09-21T05:54:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_support", 2024-09-21T05:54:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_autoscaler", 2024-09-21T05:54:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-21T05:54:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-21T05:54:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-21T05:54:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: "threshold": { 2024-09-21T05:54:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threshold", 2024-09-21T05:54:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-21T05:54:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2024-09-21T05:54:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1.0", 2024-09-21T05:54:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "scaling threshold", 2024-09-21T05:54:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T05:54:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "progress", 2024-09-21T05:54:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_pg_recovery_event": { 2024-09-21T05:54:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_pg_recovery_event", 2024-09-21T05:54:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T05:54:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2024-09-21T05:54:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2024-09-21T05:54:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.284 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.284 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.284 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.284 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.284 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.284 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.284 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.284 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.284 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.284 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.284 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.284 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.284 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.284 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.284 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.284 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.285 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.285 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.285 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.285 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.285 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.285 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.285 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.285 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.285 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.285 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.285 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.285 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.285 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.285 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.286 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.286 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.286 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.286 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.286 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.286 INFO:teuthology.orchestra.run.smithi070.stdout: "max_completed_events": { 2024-09-21T05:54:04.286 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_completed_events", 2024-09-21T05:54:04.286 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.286 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.286 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.286 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "50", 2024-09-21T05:54:04.286 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.286 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.286 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.287 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "number of past completed events to remember", 2024-09-21T05:54:04.287 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.287 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.287 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.287 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-21T05:54:04.287 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-21T05:54:04.287 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:04.287 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.287 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.287 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-21T05:54:04.287 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.287 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.287 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.287 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long the module is going to sleep", 2024-09-21T05:54:04.287 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.288 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.288 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.288 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.288 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.288 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.288 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.288 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.288 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.288 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.288 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.288 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.288 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.288 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.288 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.289 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.289 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.289 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.289 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus", 2024-09-21T05:54:04.289 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.289 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.289 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.289 INFO:teuthology.orchestra.run.smithi070.stdout: "cache": { 2024-09-21T05:54:04.289 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cache", 2024-09-21T05:54:04.289 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.289 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.289 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.289 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.289 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.289 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.290 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.290 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.290 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.290 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.290 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.290 INFO:teuthology.orchestra.run.smithi070.stdout: "exclude_perf_counters": { 2024-09-21T05:54:04.290 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "exclude_perf_counters", 2024-09-21T05:54:04.290 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.290 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.290 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.290 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.290 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.290 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.290 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.290 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T05:54:04.291 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T05:54:04.291 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.291 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.291 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.291 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.291 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.291 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.291 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.291 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.291 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.291 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.291 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.291 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.291 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.291 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.291 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.292 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.292 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.292 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.292 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.292 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.292 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.292 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.292 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.292 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.292 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.292 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.292 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.292 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.292 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.292 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.293 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.293 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.293 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.293 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.293 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.293 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.293 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.293 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.293 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.293 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.293 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.293 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.293 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.293 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.293 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.294 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.294 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.294 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.294 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.294 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.294 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.294 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.294 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.294 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.294 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.294 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.294 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.294 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.294 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.294 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.295 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.295 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.295 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.295 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.295 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.295 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.295 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.295 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.295 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools": { 2024-09-21T05:54:04.295 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools", 2024-09-21T05:54:04.295 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.295 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.295 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.295 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.296 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.296 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.296 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.296 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.296 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.296 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.296 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.296 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T05:54:04.296 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T05:54:04.296 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.296 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.296 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.296 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "300", 2024-09-21T05:54:04.296 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.296 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.297 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.297 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.297 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.297 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.297 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.297 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_interval": { 2024-09-21T05:54:04.297 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_interval", 2024-09-21T05:54:04.297 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-21T05:54:04.297 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.297 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.297 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15.0", 2024-09-21T05:54:04.297 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.297 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.297 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.298 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.298 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.298 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.298 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.298 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-09-21T05:54:04.298 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-09-21T05:54:04.298 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.298 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.298 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.298 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2024-09-21T05:54:04.298 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.299 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.299 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.299 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T05:54:04.299 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.299 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.299 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.299 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-09-21T05:54:04.299 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-09-21T05:54:04.299 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.299 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.299 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.299 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "9283", 2024-09-21T05:54:04.299 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.300 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.300 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.300 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T05:54:04.300 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.300 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.300 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.300 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.300 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.300 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.300 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.300 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.300 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.300 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.300 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.301 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.301 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.301 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.301 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.301 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.301 INFO:teuthology.orchestra.run.smithi070.stdout: "stale_cache_strategy": { 2024-09-21T05:54:04.301 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stale_cache_strategy", 2024-09-21T05:54:04.301 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.301 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.301 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.301 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "log", 2024-09-21T05:54:04.301 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.301 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.301 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.301 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.301 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.302 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.302 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.302 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2024-09-21T05:54:04.302 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2024-09-21T05:54:04.302 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.302 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.302 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.302 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "default", 2024-09-21T05:54:04.302 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.302 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.302 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.302 INFO:teuthology.orchestra.run.smithi070.stdout: "default", 2024-09-21T05:54:04.302 INFO:teuthology.orchestra.run.smithi070.stdout: "error" 2024-09-21T05:54:04.302 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.303 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.303 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.303 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.303 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.303 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2024-09-21T05:54:04.303 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2024-09-21T05:54:04.303 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.303 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.303 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.303 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-09-21T05:54:04.303 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2024-09-21T05:54:04.303 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2024-09-21T05:54:04.303 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.304 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.304 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.304 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.304 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.304 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_support", 2024-09-21T05:54:04.304 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.304 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.304 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.304 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.304 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.304 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.304 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.304 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.305 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.305 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.305 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.305 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.305 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.305 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.305 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.305 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.305 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.305 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.305 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.305 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.305 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.305 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.305 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.306 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.306 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.306 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.306 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.306 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.306 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.306 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.306 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.306 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.306 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.306 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.306 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.306 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.307 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.307 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.307 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.307 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.307 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.307 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.307 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.307 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.307 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.307 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.307 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.307 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.307 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.307 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.307 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.309 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.309 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.309 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.309 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_snap_create": { 2024-09-21T05:54:04.309 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_snap_create", 2024-09-21T05:54:04.309 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.309 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.309 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.309 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-21T05:54:04.309 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.309 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.309 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.309 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.309 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.309 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.310 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.310 INFO:teuthology.orchestra.run.smithi070.stdout: "mirror_snapshot_schedule": { 2024-09-21T05:54:04.310 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T05:54:04.310 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.310 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.310 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.310 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.310 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.310 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.310 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.310 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.310 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.310 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.310 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.311 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.311 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.311 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.311 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.311 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.311 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.311 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.311 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.311 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.311 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.311 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.311 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.311 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.311 INFO:teuthology.orchestra.run.smithi070.stdout: "trash_purge_schedule": { 2024-09-21T05:54:04.311 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "trash_purge_schedule", 2024-09-21T05:54:04.312 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.312 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.312 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.312 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.312 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.312 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.312 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.312 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.312 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.312 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.312 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.312 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.312 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.313 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "restful", 2024-09-21T05:54:04.313 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.313 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.313 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.313 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_auth": { 2024-09-21T05:54:04.313 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_auth", 2024-09-21T05:54:04.313 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.313 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.313 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.313 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.313 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.313 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.313 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.314 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.314 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.314 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.314 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.314 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2024-09-21T05:54:04.314 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2024-09-21T05:54:04.314 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.314 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.314 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.314 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.314 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.314 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.314 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.315 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.315 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.315 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.315 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.315 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.315 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.315 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.315 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.315 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.315 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.315 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.315 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.315 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.316 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.316 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.316 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.316 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.316 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.316 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.316 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.316 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.316 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.316 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.316 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.316 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.316 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.317 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.317 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.317 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.317 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.317 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.317 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.317 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.317 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.317 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.317 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.317 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.317 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.317 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.317 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.317 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.317 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.318 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.318 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.318 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.318 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.318 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.318 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.318 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.318 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.318 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.318 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.318 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.318 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.318 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.318 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.318 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.319 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.319 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.319 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.319 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.319 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.319 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.319 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.319 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.319 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.319 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.319 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.319 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.319 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.320 INFO:teuthology.orchestra.run.smithi070.stdout: "max_requests": { 2024-09-21T05:54:04.320 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_requests", 2024-09-21T05:54:04.320 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.320 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.320 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.320 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-09-21T05:54:04.320 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.320 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.320 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.320 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T05:54:04.320 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.320 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.320 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.320 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-09-21T05:54:04.321 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-09-21T05:54:04.321 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.321 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.321 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.321 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.321 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.321 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.321 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.321 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.321 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.321 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.321 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.321 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-09-21T05:54:04.321 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-09-21T05:54:04.321 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.321 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.322 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.322 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.322 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.322 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.322 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.322 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.322 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.322 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.322 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.322 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.322 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.322 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.322 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.322 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.322 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.323 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.323 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.323 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.323 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.323 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.323 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.323 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.323 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.323 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.323 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rgw", 2024-09-21T05:54:04.323 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.323 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.323 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.323 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.324 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.324 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.324 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.324 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.324 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.324 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.324 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.324 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.324 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.324 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.324 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.324 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.324 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.324 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.324 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.324 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.324 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.325 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.325 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.325 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.325 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.325 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.325 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.325 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.325 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.325 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.325 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.325 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.325 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.325 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.325 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.325 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.326 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.326 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.326 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.326 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.326 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.326 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.326 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.326 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.326 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.326 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.326 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.326 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.326 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.326 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.326 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.327 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.327 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.327 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.327 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.327 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.327 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.327 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.327 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.327 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.327 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.327 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.327 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.327 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.328 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.328 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.328 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.328 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.328 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.328 INFO:teuthology.orchestra.run.smithi070.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T05:54:04.328 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T05:54:04.328 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.328 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.328 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.328 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-21T05:54:04.328 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.328 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.328 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.329 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T05:54:04.329 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.329 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.329 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.329 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.329 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.329 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.329 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.329 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.329 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.329 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.329 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.329 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.329 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.329 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.330 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.330 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.330 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.330 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.330 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rook", 2024-09-21T05:54:04.330 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.330 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.330 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.330 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.330 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.330 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.330 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.330 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.331 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.331 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.331 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.331 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.331 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.331 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.331 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.331 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.331 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.331 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.331 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.331 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.331 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.331 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.331 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.332 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.332 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.332 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.332 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.332 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.332 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.332 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.332 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.332 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.332 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.332 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.332 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.332 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.332 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.332 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.333 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.333 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.333 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.333 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.333 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.333 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.333 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.333 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.333 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.333 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.333 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.333 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.333 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.333 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.333 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.333 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.333 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.334 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.334 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.334 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.334 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.334 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.334 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.334 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.334 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.334 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.334 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.334 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.334 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.334 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.334 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.335 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.335 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.335 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.335 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.335 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.335 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.335 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.335 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.335 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.335 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.335 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.335 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.335 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.335 INFO:teuthology.orchestra.run.smithi070.stdout: "storage_class": { 2024-09-21T05:54:04.335 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "storage_class", 2024-09-21T05:54:04.336 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.336 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.336 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.336 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "local", 2024-09-21T05:54:04.336 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.336 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.336 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.336 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T05:54:04.336 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.336 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.336 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.336 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.336 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.336 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "selftest", 2024-09-21T05:54:04.337 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.337 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.337 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.337 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.337 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.337 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.337 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.337 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.337 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.337 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.337 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.337 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.337 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.337 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.337 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.338 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.338 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.338 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.338 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.338 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.338 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.338 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.338 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.338 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.338 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.338 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.338 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.338 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.339 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.339 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.339 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.339 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.339 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.339 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.339 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.339 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.339 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.339 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.339 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.339 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.339 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.340 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.340 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.340 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.340 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.340 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.340 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.340 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.340 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.340 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.340 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.340 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.340 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.340 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.340 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.340 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.341 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.341 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.341 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.341 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.341 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.341 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.341 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.341 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.341 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.341 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.341 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.341 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.341 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.342 INFO:teuthology.orchestra.run.smithi070.stdout: "roption1": { 2024-09-21T05:54:04.342 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption1", 2024-09-21T05:54:04.342 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.342 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.342 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.342 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.342 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.342 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.342 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.342 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.342 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.342 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.342 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.343 INFO:teuthology.orchestra.run.smithi070.stdout: "roption2": { 2024-09-21T05:54:04.343 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption2", 2024-09-21T05:54:04.343 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.343 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.343 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.343 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "xyz", 2024-09-21T05:54:04.343 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.343 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.343 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.343 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.343 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.343 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.343 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.344 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption1": { 2024-09-21T05:54:04.344 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption1", 2024-09-21T05:54:04.344 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.344 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.344 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.344 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.344 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.344 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.344 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.344 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.344 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.344 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.344 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.345 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption2": { 2024-09-21T05:54:04.345 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption2", 2024-09-21T05:54:04.345 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.345 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.345 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.345 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.345 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.345 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.345 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.345 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.345 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.345 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.345 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.346 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption3": { 2024-09-21T05:54:04.346 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption3", 2024-09-21T05:54:04.346 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-21T05:54:04.346 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.346 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.346 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.346 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.346 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.346 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.346 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.346 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.346 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.346 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.347 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption4": { 2024-09-21T05:54:04.347 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption4", 2024-09-21T05:54:04.347 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.347 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.347 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.347 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.347 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.347 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.347 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.347 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.347 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.347 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.347 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.347 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption5": { 2024-09-21T05:54:04.348 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption5", 2024-09-21T05:54:04.348 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.348 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.348 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.348 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.348 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.348 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.348 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.348 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.348 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.348 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.348 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.348 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption6": { 2024-09-21T05:54:04.348 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption6", 2024-09-21T05:54:04.348 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.349 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.349 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.349 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.349 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.349 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.349 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.349 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.349 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.349 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.349 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.349 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption7": { 2024-09-21T05:54:04.349 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption7", 2024-09-21T05:54:04.349 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.349 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.349 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.349 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.350 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-21T05:54:04.350 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "42", 2024-09-21T05:54:04.350 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.350 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.350 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.350 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.350 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.350 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.350 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.350 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.350 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.350 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.350 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.351 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.351 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.351 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.351 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.351 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.351 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.351 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.351 INFO:teuthology.orchestra.run.smithi070.stdout: "testkey": { 2024-09-21T05:54:04.351 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testkey", 2024-09-21T05:54:04.351 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.351 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.351 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.351 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.352 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.352 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.352 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.352 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.352 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.352 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.352 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.352 INFO:teuthology.orchestra.run.smithi070.stdout: "testlkey": { 2024-09-21T05:54:04.352 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testlkey", 2024-09-21T05:54:04.352 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.352 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.352 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.352 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.353 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.353 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.353 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.353 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.353 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.353 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.353 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.353 INFO:teuthology.orchestra.run.smithi070.stdout: "testnewline": { 2024-09-21T05:54:04.353 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testnewline", 2024-09-21T05:54:04.353 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.353 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.353 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.353 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.354 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.354 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.354 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.354 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.354 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.354 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.354 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.354 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.354 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.354 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smb", 2024-09-21T05:54:04.354 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.354 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.355 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.355 INFO:teuthology.orchestra.run.smithi070.stdout: "internal_store_backend": { 2024-09-21T05:54:04.355 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "internal_store_backend", 2024-09-21T05:54:04.355 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.355 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.355 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.355 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.355 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.355 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.355 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.355 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T05:54:04.355 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.355 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.355 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.356 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.356 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.356 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.356 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.356 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.356 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.356 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.356 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.356 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.356 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.356 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.356 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.356 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.357 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.357 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.357 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.357 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.357 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.357 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.357 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.357 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.357 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.357 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.357 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.357 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.357 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.358 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.358 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.358 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.358 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.358 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.358 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.358 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.358 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.358 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.358 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.358 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.358 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.359 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.359 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.359 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.359 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.359 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.359 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.359 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.359 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.359 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.359 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.359 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.359 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.359 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.359 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.360 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.360 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.360 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.360 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.360 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.360 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.360 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.360 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.360 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.360 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.360 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.360 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.360 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.360 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.361 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.361 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.361 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.361 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.361 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.361 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.361 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.361 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.361 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.361 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.361 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.361 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.361 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.361 INFO:teuthology.orchestra.run.smithi070.stdout: "update_orchestration": { 2024-09-21T05:54:04.362 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "update_orchestration", 2024-09-21T05:54:04.362 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.362 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.362 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.362 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.362 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.362 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.362 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.362 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T05:54:04.362 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.362 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.362 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.362 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.362 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.363 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snap_schedule", 2024-09-21T05:54:04.363 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.363 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.363 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.363 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_m_granularity": { 2024-09-21T05:54:04.363 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_m_granularity", 2024-09-21T05:54:04.363 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.363 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.363 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.363 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.363 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.363 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.364 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.364 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T05:54:04.364 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.364 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.364 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.364 INFO:teuthology.orchestra.run.smithi070.stdout: "dump_on_update": { 2024-09-21T05:54:04.364 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dump_on_update", 2024-09-21T05:54:04.364 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.364 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.364 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.364 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.364 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.364 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.364 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.365 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "dump database to debug log on update", 2024-09-21T05:54:04.365 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.365 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.365 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.365 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.365 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.365 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.365 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.365 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.365 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.365 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.365 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.365 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.365 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.366 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.366 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.366 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.366 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.366 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.366 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.366 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.366 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.366 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.366 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.366 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.366 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.366 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.366 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.367 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.367 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.367 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.367 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.367 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.367 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.367 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.367 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.367 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.367 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.367 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.367 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.367 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.368 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.368 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.368 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.368 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.368 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.368 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.368 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.368 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.368 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.368 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.368 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.368 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.368 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.368 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.368 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.368 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.369 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.369 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.369 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.369 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.369 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.369 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.369 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.369 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.369 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.369 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.369 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.369 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.369 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.369 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.370 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.370 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.370 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.370 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.370 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.370 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.370 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.370 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.370 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.370 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.370 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.370 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.370 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.370 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.371 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stats", 2024-09-21T05:54:04.371 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.371 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.371 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.371 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.371 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.371 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.372 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.372 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.372 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.372 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.372 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.372 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.372 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.372 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.372 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.372 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.372 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.373 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.373 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.373 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.373 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.373 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.373 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.373 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.373 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.373 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.373 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.373 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.373 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.373 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.374 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.374 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.374 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.374 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.374 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.374 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.374 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.374 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.374 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.374 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.374 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.374 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.374 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.375 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.375 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.375 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.375 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.375 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.375 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.375 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.375 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.375 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.375 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.375 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.375 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.375 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.376 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.376 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.376 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.376 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.376 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.376 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.376 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.376 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.376 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.376 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.376 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.376 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.376 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.377 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.377 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.377 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.377 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.377 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.377 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.377 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.377 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.377 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.377 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.377 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.377 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.377 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.377 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.377 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.378 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "status", 2024-09-21T05:54:04.378 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.378 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.378 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.378 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.378 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.378 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.378 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.378 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.378 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.378 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.378 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.378 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.378 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.379 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.379 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.379 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.379 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.379 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.379 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.379 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.379 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.379 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.379 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.379 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.379 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.379 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.380 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.380 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.380 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.380 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.380 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.380 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.380 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.380 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.380 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.380 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.380 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.380 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.381 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.381 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.381 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.381 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.381 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.381 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.381 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.381 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.381 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.381 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.381 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.381 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.381 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.381 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.382 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.382 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.382 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.382 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.382 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.382 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.382 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.382 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.382 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.382 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.382 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.382 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.382 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.383 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.383 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.383 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.383 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.383 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.383 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.383 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.383 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.383 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.383 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.383 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.383 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.383 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.383 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.383 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.384 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.384 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.384 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.384 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.384 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telegraf", 2024-09-21T05:54:04.384 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.384 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.384 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.384 INFO:teuthology.orchestra.run.smithi070.stdout: "address": { 2024-09-21T05:54:04.384 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "address", 2024-09-21T05:54:04.384 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.384 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.385 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.385 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T05:54:04.385 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.385 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.385 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.385 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.385 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.385 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.385 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.385 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-21T05:54:04.385 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-21T05:54:04.385 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:04.385 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.385 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.386 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15", 2024-09-21T05:54:04.386 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.386 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.386 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.386 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.386 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.386 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.386 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.386 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.386 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.386 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.386 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.386 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.386 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.387 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.387 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.387 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.387 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.387 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.387 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.387 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.387 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.387 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.387 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.387 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.387 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.387 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.387 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.388 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.388 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.388 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.388 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.388 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.388 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.388 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.388 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.388 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.388 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.388 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.388 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.388 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.388 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.388 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.389 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.389 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.389 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.389 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.389 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.389 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.389 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.389 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.389 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.389 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.389 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.389 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.389 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.389 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.389 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.389 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.390 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.390 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.390 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.390 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.390 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.390 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.390 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.390 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.390 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.390 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.390 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.390 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.390 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.391 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.391 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.391 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.391 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.391 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.391 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.391 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.391 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.391 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.391 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.391 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.391 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.391 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.391 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.391 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.392 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.392 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.392 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telemetry", 2024-09-21T05:54:04.392 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.392 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.392 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.392 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_basic": { 2024-09-21T05:54:04.392 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_basic", 2024-09-21T05:54:04.392 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.392 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.392 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.392 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.392 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.393 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.393 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.393 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T05:54:04.393 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.393 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.393 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.393 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_crash": { 2024-09-21T05:54:04.393 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_crash", 2024-09-21T05:54:04.393 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.393 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.393 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.393 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.393 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.393 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.393 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.394 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T05:54:04.394 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.394 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.394 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.394 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_device": { 2024-09-21T05:54:04.394 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_device", 2024-09-21T05:54:04.394 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.394 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.394 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.394 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.394 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.394 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.394 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.395 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T05:54:04.395 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.395 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.395 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.395 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_ident": { 2024-09-21T05:54:04.395 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_ident", 2024-09-21T05:54:04.395 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.395 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.395 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.395 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.395 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.395 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.395 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.395 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T05:54:04.396 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.396 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.396 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.396 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_perf": { 2024-09-21T05:54:04.396 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_perf", 2024-09-21T05:54:04.396 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.396 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.396 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.396 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.396 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.396 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.396 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.396 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T05:54:04.396 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.396 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.397 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.397 INFO:teuthology.orchestra.run.smithi070.stdout: "contact": { 2024-09-21T05:54:04.397 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "contact", 2024-09-21T05:54:04.397 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.397 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.397 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.397 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.397 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.397 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.397 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.397 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.397 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.397 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.397 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.398 INFO:teuthology.orchestra.run.smithi070.stdout: "description": { 2024-09-21T05:54:04.398 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "description", 2024-09-21T05:54:04.398 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.398 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.398 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.398 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.398 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.398 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.398 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.398 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.398 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.398 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.398 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.398 INFO:teuthology.orchestra.run.smithi070.stdout: "device_url": { 2024-09-21T05:54:04.399 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_url", 2024-09-21T05:54:04.399 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.399 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.399 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.399 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T05:54:04.399 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.399 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.399 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.399 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.399 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.399 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.399 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.399 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2024-09-21T05:54:04.399 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2024-09-21T05:54:04.400 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.400 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.400 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.400 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.400 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.400 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.400 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.400 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.400 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.400 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.400 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.400 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-21T05:54:04.400 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-21T05:54:04.400 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.400 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.400 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.401 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "24", 2024-09-21T05:54:04.401 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "8", 2024-09-21T05:54:04.401 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.401 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.401 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.401 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.401 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.401 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.401 INFO:teuthology.orchestra.run.smithi070.stdout: "last_opt_revision": { 2024-09-21T05:54:04.401 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "last_opt_revision", 2024-09-21T05:54:04.401 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.401 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.401 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.401 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1", 2024-09-21T05:54:04.401 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.402 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.402 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.402 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.402 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.402 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.402 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.402 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard": { 2024-09-21T05:54:04.402 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard", 2024-09-21T05:54:04.402 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.402 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.402 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.402 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.402 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.402 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.402 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.403 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.403 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.403 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.403 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.403 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard_description": { 2024-09-21T05:54:04.403 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard_description", 2024-09-21T05:54:04.403 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.403 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.403 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.403 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.403 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.403 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.403 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.403 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.403 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.404 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.404 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.404 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.404 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.404 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.404 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.404 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.404 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.404 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.404 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.404 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.404 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.404 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.404 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.405 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.405 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.405 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.405 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.405 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.405 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.405 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.405 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.405 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.405 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.405 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.405 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.405 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.406 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.406 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.406 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.406 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.406 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.406 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.406 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.406 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.406 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.406 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.406 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.406 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.406 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.407 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.407 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.407 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.407 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.407 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.407 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.407 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.407 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.407 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.407 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.407 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.407 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.407 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.407 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.407 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.407 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.408 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.408 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.408 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.408 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.408 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.408 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.408 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.408 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.408 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.408 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.408 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.408 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.408 INFO:teuthology.orchestra.run.smithi070.stdout: "organization": { 2024-09-21T05:54:04.408 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "organization", 2024-09-21T05:54:04.408 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.408 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.409 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.409 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.409 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.409 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.409 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.409 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.409 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.409 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.409 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.409 INFO:teuthology.orchestra.run.smithi070.stdout: "proxy": { 2024-09-21T05:54:04.409 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "proxy", 2024-09-21T05:54:04.409 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.409 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.409 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.409 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.409 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.410 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.410 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.410 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.410 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.410 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.410 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.410 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.410 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.410 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.410 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.410 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.410 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.410 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.410 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.410 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.411 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.411 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.411 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.411 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.411 INFO:teuthology.orchestra.run.smithi070.stdout: "url": { 2024-09-21T05:54:04.411 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url", 2024-09-21T05:54:04.411 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.411 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.411 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.411 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T05:54:04.411 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.411 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.411 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.411 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.411 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.411 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.412 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.412 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.412 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.412 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "test_orchestrator", 2024-09-21T05:54:04.412 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.412 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.412 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.412 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.412 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.412 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.412 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.412 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.412 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.413 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.413 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.413 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.413 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.413 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.413 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.413 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.413 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.413 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.413 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.413 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.413 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.413 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.413 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.413 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.413 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.414 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.414 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.414 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.414 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.414 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.414 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.414 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.414 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.414 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.414 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.414 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.414 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.414 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.414 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.414 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.415 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.415 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.415 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.415 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.415 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.415 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.415 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.415 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.415 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.415 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.415 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.415 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.415 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.415 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.415 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.416 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.416 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.416 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.416 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.416 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.416 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.416 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.416 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.416 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.416 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.416 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.416 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.416 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.416 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.417 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.417 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.417 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.417 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.417 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.417 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.417 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.417 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.417 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.417 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.417 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.417 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.417 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.417 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.418 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.418 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "volumes", 2024-09-21T05:54:04.418 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.418 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.418 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.418 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.418 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.418 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.418 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.418 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.418 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.418 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.419 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.419 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.419 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.419 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.419 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.419 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.419 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.419 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.419 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.419 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.419 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.419 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.419 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.419 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.419 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.420 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.420 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.420 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.420 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.420 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.420 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.420 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.420 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.420 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.420 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.420 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.420 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.420 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.420 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.420 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.420 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.421 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.421 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.421 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.421 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.421 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.421 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.421 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.421 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.421 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.421 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.421 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.421 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.421 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.421 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.421 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.422 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.422 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.422 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.422 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.422 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.422 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.422 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.422 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.422 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.422 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.422 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.422 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.422 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.423 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_clones": { 2024-09-21T05:54:04.423 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_clones", 2024-09-21T05:54:04.423 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.423 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.423 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.423 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4", 2024-09-21T05:54:04.423 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.423 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.423 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.423 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T05:54:04.423 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.423 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.423 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.424 INFO:teuthology.orchestra.run.smithi070.stdout: "periodic_async_work": { 2024-09-21T05:54:04.424 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "periodic_async_work", 2024-09-21T05:54:04.424 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.424 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.424 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.424 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.424 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.424 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.424 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.424 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Periodically check for async work", 2024-09-21T05:54:04.424 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.424 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.424 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.425 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_delay": { 2024-09-21T05:54:04.425 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_delay", 2024-09-21T05:54:04.425 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.425 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.425 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.425 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.425 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.425 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.425 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.425 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T05:54:04.425 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.425 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.425 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.425 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_no_wait": { 2024-09-21T05:54:04.425 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T05:54:04.425 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.426 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.426 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.426 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-21T05:54:04.426 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.426 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.426 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.426 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T05:54:04.426 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.426 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.426 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.426 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.426 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.426 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.426 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.427 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.427 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.427 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.427 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.427 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.427 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.427 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.427 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.427 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.427 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.427 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.427 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix", 2024-09-21T05:54:04.427 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-21T05:54:04.428 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-21T05:54:04.428 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-21T05:54:04.428 INFO:teuthology.orchestra.run.smithi070.stdout: "discovery_interval": { 2024-09-21T05:54:04.428 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "discovery_interval", 2024-09-21T05:54:04.428 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-21T05:54:04.428 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.428 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.428 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "100", 2024-09-21T05:54:04.428 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.428 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.428 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.428 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.428 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.428 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.428 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.429 INFO:teuthology.orchestra.run.smithi070.stdout: "identifier": { 2024-09-21T05:54:04.429 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "identifier", 2024-09-21T05:54:04.429 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.429 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.429 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.429 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.429 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.429 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.429 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.429 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.429 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.429 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.429 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.429 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-21T05:54:04.429 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-21T05:54:04.429 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-21T05:54:04.430 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.430 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.430 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-21T05:54:04.430 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.430 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.430 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.430 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.430 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.430 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.430 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.430 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-21T05:54:04.430 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-21T05:54:04.430 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.430 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.431 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.431 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.431 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.431 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.431 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.431 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.431 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.431 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.431 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.431 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.431 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.431 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.431 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.431 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.431 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.431 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-21T05:54:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-21T05:54:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-21T05:54:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-21T05:54:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.433 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.433 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.433 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-21T05:54:04.433 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.433 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.433 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-21T05:54:04.433 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-21T05:54:04.433 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-21T05:54:04.433 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-21T05:54:04.433 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-21T05:54:04.433 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-21T05:54:04.433 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-21T05:54:04.433 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.433 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.433 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.433 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.434 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.434 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-21T05:54:04.434 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-21T05:54:04.434 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-21T05:54:04.434 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.434 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.434 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-21T05:54:04.434 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.434 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.434 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.434 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.434 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.434 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.434 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.435 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-09-21T05:54:04.435 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-09-21T05:54:04.435 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.435 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-09-21T05:54:04.435 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-21T05:54:04.435 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-21T05:54:04.435 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.435 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.435 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.435 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.435 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.435 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.435 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.435 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_host": { 2024-09-21T05:54:04.435 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_host", 2024-09-21T05:54:04.436 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.436 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.436 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.436 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-21T05:54:04.436 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.436 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.436 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.436 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.436 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.436 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.436 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.436 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_port": { 2024-09-21T05:54:04.436 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_port", 2024-09-21T05:54:04.436 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-21T05:54:04.436 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.436 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.437 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10051", 2024-09-21T05:54:04.437 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.437 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.437 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.437 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.437 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.437 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.437 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.437 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_sender": { 2024-09-21T05:54:04.437 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_sender", 2024-09-21T05:54:04.437 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-21T05:54:04.437 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-21T05:54:04.437 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-21T05:54:04.437 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T05:54:04.437 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-21T05:54:04.437 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-21T05:54:04.438 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-21T05:54:04.438 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-21T05:54:04.438 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-21T05:54:04.438 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-21T05:54:04.438 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-21T05:54:04.438 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.438 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.438 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.438 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.438 INFO:teuthology.orchestra.run.smithi070.stdout: "services": { 2024-09-21T05:54:04.438 INFO:teuthology.orchestra.run.smithi070.stdout: "dashboard": "https://172.21.15.70:8443/" 2024-09-21T05:54:04.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.438 INFO:teuthology.orchestra.run.smithi070.stdout: "always_on_modules": { 2024-09-21T05:54:04.438 INFO:teuthology.orchestra.run.smithi070.stdout: "octopus": [ 2024-09-21T05:54:04.439 INFO:teuthology.orchestra.run.smithi070.stdout: "balancer", 2024-09-21T05:54:04.439 INFO:teuthology.orchestra.run.smithi070.stdout: "crash", 2024-09-21T05:54:04.439 INFO:teuthology.orchestra.run.smithi070.stdout: "devicehealth", 2024-09-21T05:54:04.439 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator", 2024-09-21T05:54:04.439 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscaler", 2024-09-21T05:54:04.439 INFO:teuthology.orchestra.run.smithi070.stdout: "progress", 2024-09-21T05:54:04.439 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_support", 2024-09-21T05:54:04.439 INFO:teuthology.orchestra.run.smithi070.stdout: "status", 2024-09-21T05:54:04.439 INFO:teuthology.orchestra.run.smithi070.stdout: "telemetry", 2024-09-21T05:54:04.439 INFO:teuthology.orchestra.run.smithi070.stdout: "volumes" 2024-09-21T05:54:04.439 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.439 INFO:teuthology.orchestra.run.smithi070.stdout: "pacific": [ 2024-09-21T05:54:04.439 INFO:teuthology.orchestra.run.smithi070.stdout: "balancer", 2024-09-21T05:54:04.439 INFO:teuthology.orchestra.run.smithi070.stdout: "crash", 2024-09-21T05:54:04.439 INFO:teuthology.orchestra.run.smithi070.stdout: "devicehealth", 2024-09-21T05:54:04.439 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator", 2024-09-21T05:54:04.440 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscaler", 2024-09-21T05:54:04.440 INFO:teuthology.orchestra.run.smithi070.stdout: "progress", 2024-09-21T05:54:04.440 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_support", 2024-09-21T05:54:04.440 INFO:teuthology.orchestra.run.smithi070.stdout: "status", 2024-09-21T05:54:04.440 INFO:teuthology.orchestra.run.smithi070.stdout: "telemetry", 2024-09-21T05:54:04.440 INFO:teuthology.orchestra.run.smithi070.stdout: "volumes" 2024-09-21T05:54:04.440 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.440 INFO:teuthology.orchestra.run.smithi070.stdout: "quincy": [ 2024-09-21T05:54:04.440 INFO:teuthology.orchestra.run.smithi070.stdout: "balancer", 2024-09-21T05:54:04.440 INFO:teuthology.orchestra.run.smithi070.stdout: "crash", 2024-09-21T05:54:04.440 INFO:teuthology.orchestra.run.smithi070.stdout: "devicehealth", 2024-09-21T05:54:04.440 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator", 2024-09-21T05:54:04.440 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscaler", 2024-09-21T05:54:04.440 INFO:teuthology.orchestra.run.smithi070.stdout: "progress", 2024-09-21T05:54:04.441 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_support", 2024-09-21T05:54:04.441 INFO:teuthology.orchestra.run.smithi070.stdout: "status", 2024-09-21T05:54:04.441 INFO:teuthology.orchestra.run.smithi070.stdout: "telemetry", 2024-09-21T05:54:04.441 INFO:teuthology.orchestra.run.smithi070.stdout: "volumes" 2024-09-21T05:54:04.441 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.441 INFO:teuthology.orchestra.run.smithi070.stdout: "reef": [ 2024-09-21T05:54:04.441 INFO:teuthology.orchestra.run.smithi070.stdout: "balancer", 2024-09-21T05:54:04.441 INFO:teuthology.orchestra.run.smithi070.stdout: "crash", 2024-09-21T05:54:04.441 INFO:teuthology.orchestra.run.smithi070.stdout: "devicehealth", 2024-09-21T05:54:04.441 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator", 2024-09-21T05:54:04.441 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscaler", 2024-09-21T05:54:04.441 INFO:teuthology.orchestra.run.smithi070.stdout: "progress", 2024-09-21T05:54:04.441 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_support", 2024-09-21T05:54:04.441 INFO:teuthology.orchestra.run.smithi070.stdout: "status", 2024-09-21T05:54:04.441 INFO:teuthology.orchestra.run.smithi070.stdout: "telemetry", 2024-09-21T05:54:04.442 INFO:teuthology.orchestra.run.smithi070.stdout: "volumes" 2024-09-21T05:54:04.442 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-21T05:54:04.442 INFO:teuthology.orchestra.run.smithi070.stdout: "squid": [ 2024-09-21T05:54:04.442 INFO:teuthology.orchestra.run.smithi070.stdout: "balancer", 2024-09-21T05:54:04.442 INFO:teuthology.orchestra.run.smithi070.stdout: "crash", 2024-09-21T05:54:04.442 INFO:teuthology.orchestra.run.smithi070.stdout: "devicehealth", 2024-09-21T05:54:04.442 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator", 2024-09-21T05:54:04.442 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscaler", 2024-09-21T05:54:04.442 INFO:teuthology.orchestra.run.smithi070.stdout: "progress", 2024-09-21T05:54:04.442 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_support", 2024-09-21T05:54:04.442 INFO:teuthology.orchestra.run.smithi070.stdout: "status", 2024-09-21T05:54:04.442 INFO:teuthology.orchestra.run.smithi070.stdout: "telemetry", 2024-09-21T05:54:04.442 INFO:teuthology.orchestra.run.smithi070.stdout: "volumes" 2024-09-21T05:54:04.442 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-21T05:54:04.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.443 INFO:teuthology.orchestra.run.smithi070.stdout: "last_failure_osd_epoch": 3, 2024-09-21T05:54:04.443 INFO:teuthology.orchestra.run.smithi070.stdout: "active_clients": [ 2024-09-21T05:54:04.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.443 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "devicehealth", 2024-09-21T05:54:04.443 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-21T05:54:04.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.443 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-21T05:54:04.443 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2024-09-21T05:54:04.443 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2968459946 2024-09-21T05:54:04.443 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.443 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-21T05:54:04.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.443 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "libcephsqlite", 2024-09-21T05:54:04.443 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-21T05:54:04.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.444 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-21T05:54:04.444 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2024-09-21T05:54:04.444 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2487540417 2024-09-21T05:54:04.444 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.444 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-21T05:54:04.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.444 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_support", 2024-09-21T05:54:04.444 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-21T05:54:04.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.444 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-21T05:54:04.444 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2024-09-21T05:54:04.444 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 753344669 2024-09-21T05:54:04.444 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.444 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-21T05:54:04.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:04.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.445 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "volumes", 2024-09-21T05:54:04.445 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-21T05:54:04.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-21T05:54:04.445 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-21T05:54:04.445 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2024-09-21T05:54:04.445 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1404558720 2024-09-21T05:54:04.445 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.445 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-21T05:54:04.445 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:04.445 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-21T05:54:04.445 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:54:04.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:03.088+0000 7f89c6b39640 1 -- 172.21.15.70:0/3842602631 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f89b00b6510 msgr2=0x7f89b00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:04.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:03.088+0000 7f89c6b39640 1 --2- 172.21.15.70:0/3842602631 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f89b00b6510 0x7f89b00b8a20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f89ac006010 tx=0x7f89ac000bc0 comp rx=0 tx=0).stop 2024-09-21T05:54:04.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:03.088+0000 7f89c6b39640 1 -- 172.21.15.70:0/3842602631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89c01036c0 msgr2=0x7f89c0199f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:04.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:03.088+0000 7f89c6b39640 1 --2- 172.21.15.70:0/3842602631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89c01036c0 0x7f89c0199f70 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f89b400c970 tx=0x7f89b400ce30 comp rx=0 tx=0).stop 2024-09-21T05:54:04.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:03.088+0000 7f89c6b39640 1 -- 172.21.15.70:0/3842602631 shutdown_connections 2024-09-21T05:54:04.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:03.088+0000 7f89c6b39640 1 --2- 172.21.15.70:0/3842602631 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f89b00b6510 0x7f89b00b8a20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:04.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:03.088+0000 7f89c6b39640 1 --2- 172.21.15.70:0/3842602631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89c01050e0 0x7f89c019b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:04.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:03.088+0000 7f89c6b39640 1 --2- 172.21.15.70:0/3842602631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89c0104740 0x7f89c019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:04.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:03.088+0000 7f89c6b39640 1 --2- 172.21.15.70:0/3842602631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89c01036c0 0x7f89c0199f70 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:04.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:03.088+0000 7f89c6b39640 1 -- 172.21.15.70:0/3842602631 >> 172.21.15.70:0/3842602631 conn(0x7f89c00ff000 msgr2=0x7f89c0107a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:04.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:03.088+0000 7f89c6b39640 1 -- 172.21.15.70:0/3842602631 shutdown_connections 2024-09-21T05:54:04.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:03.088+0000 7f89c6b39640 1 -- 172.21.15.70:0/3842602631 wait complete. 2024-09-21T05:54:04.491 DEBUG:tasks.check_counter:Getting stats from a 2024-09-21T05:54:04.491 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph daemon mds.a perf dump 2024-09-21T05:54:04.491 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:03 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/4187128101' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T05:54:04.491 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:03 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3842602631' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T05:54:04.492 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:03 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/4187128101' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T05:54:04.492 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:03 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3842602631' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T05:54:04.493 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:02 smithi160 ceph-mon[33979]: pgmap v507: 129 pgs: 129 active+clean; 99 MiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 776 KiB/s wr, 277 op/s 2024-09-21T05:54:04.493 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:02 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2516610953' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T05:54:04.493 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:02 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3087283678' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T05:54:04.493 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:02 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/386924375' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T05:54:04.493 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:03 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/4187128101' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T05:54:04.493 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:03 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3842602631' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T05:54:04.757 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:54:04.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:04 smithi070 ceph-mon[30981]: pgmap v508: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 672 KiB/s wr, 248 op/s 2024-09-21T05:54:05.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:04 smithi116 ceph-mon[34332]: pgmap v508: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 672 KiB/s wr, 248 op/s 2024-09-21T05:54:05.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:04 smithi160 ceph-mon[33979]: pgmap v508: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 672 KiB/s wr, 248 op/s 2024-09-21T05:54:06.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:06 smithi070 ceph-mon[30981]: pgmap v509: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 666 KiB/s wr, 199 op/s 2024-09-21T05:54:07.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:06 smithi116 ceph-mon[34332]: pgmap v509: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 666 KiB/s wr, 199 op/s 2024-09-21T05:54:07.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:06 smithi160 ceph-mon[33979]: pgmap v509: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 666 KiB/s wr, 199 op/s 2024-09-21T05:54:08.023 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:54:08.023 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T05:54:08.023 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 806, 2024-09-21T05:54:08.023 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 808, 2024-09-21T05:54:08.023 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 2642809, 2024-09-21T05:54:08.023 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 256309, 2024-09-21T05:54:08.023 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 6, 2024-09-21T05:54:08.024 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 2, 2024-09-21T05:54:08.024 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.081656084, 2024-09-21T05:54:08.024 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.034444384, 2024-09-21T05:54:08.024 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.020125720, 2024-09-21T05:54:08.024 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.020489003, 2024-09-21T05:54:08.024 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:08.024 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 806, 2024-09-21T05:54:08.024 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.024633097, 2024-09-21T05:54:08.024 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000030562 2024-09-21T05:54:08.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.024 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:08.024 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.024 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.024 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.025 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T05:54:08.025 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T05:54:08.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.025 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T05:54:08.025 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 144, 2024-09-21T05:54:08.025 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 128, 2024-09-21T05:54:08.025 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 902958, 2024-09-21T05:54:08.025 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 74414, 2024-09-21T05:54:08.025 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 4, 2024-09-21T05:54:08.025 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 3, 2024-09-21T05:54:08.025 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.023698655, 2024-09-21T05:54:08.025 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.009019732, 2024-09-21T05:54:08.025 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.022453685, 2024-09-21T05:54:08.025 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000066814, 2024-09-21T05:54:08.026 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:08.026 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 127, 2024-09-21T05:54:08.026 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.008167854, 2024-09-21T05:54:08.026 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000064313 2024-09-21T05:54:08.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.026 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:08.026 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.026 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.026 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.026 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 901568, 2024-09-21T05:54:08.026 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 73392 2024-09-21T05:54:08.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.027 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T05:54:08.027 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 280, 2024-09-21T05:54:08.027 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 367, 2024-09-21T05:54:08.027 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 70824, 2024-09-21T05:54:08.027 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 317242, 2024-09-21T05:54:08.027 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 5, 2024-09-21T05:54:08.027 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 4, 2024-09-21T05:54:08.027 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.038201252, 2024-09-21T05:54:08.027 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.017260552, 2024-09-21T05:54:08.027 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.009087280, 2024-09-21T05:54:08.027 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.008940893, 2024-09-21T05:54:08.027 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:08.027 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 366, 2024-09-21T05:54:08.027 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.017994033, 2024-09-21T05:54:08.028 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000049164 2024-09-21T05:54:08.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.028 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:08.028 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.028 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.028 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.028 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T05:54:08.028 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 229792 2024-09-21T05:54:08.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.028 INFO:teuthology.orchestra.run.smithi070.stdout: "cct": { 2024-09-21T05:54:08.028 INFO:teuthology.orchestra.run.smithi070.stdout: "total_workers": 1, 2024-09-21T05:54:08.028 INFO:teuthology.orchestra.run.smithi070.stdout: "unhealthy_workers": 0 2024-09-21T05:54:08.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.028 INFO:teuthology.orchestra.run.smithi070.stdout: "finisher-MDSRank": { 2024-09-21T05:54:08.029 INFO:teuthology.orchestra.run.smithi070.stdout: "queue_len": 0, 2024-09-21T05:54:08.029 INFO:teuthology.orchestra.run.smithi070.stdout: "complete_latency": { 2024-09-21T05:54:08.029 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 1826, 2024-09-21T05:54:08.029 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.047490630, 2024-09-21T05:54:08.029 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000026008 2024-09-21T05:54:08.029 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:08.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.029 INFO:teuthology.orchestra.run.smithi070.stdout: "finisher-PurgeQueue": { 2024-09-21T05:54:08.029 INFO:teuthology.orchestra.run.smithi070.stdout: "queue_len": 0, 2024-09-21T05:54:08.029 INFO:teuthology.orchestra.run.smithi070.stdout: "complete_latency": { 2024-09-21T05:54:08.029 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.029 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.029 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.029 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:08.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.030 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": { 2024-09-21T05:54:08.030 INFO:teuthology.orchestra.run.smithi070.stdout: "request": 0, 2024-09-21T05:54:08.030 INFO:teuthology.orchestra.run.smithi070.stdout: "reply": 0, 2024-09-21T05:54:08.030 INFO:teuthology.orchestra.run.smithi070.stdout: "reply_latency": { 2024-09-21T05:54:08.030 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.030 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.030 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.030 INFO:teuthology.orchestra.run.smithi070.stdout: "slow_reply": 0, 2024-09-21T05:54:08.030 INFO:teuthology.orchestra.run.smithi070.stdout: "forward": 0, 2024-09-21T05:54:08.030 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_fetch_complete": 0, 2024-09-21T05:54:08.030 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_fetch_keys": 0, 2024-09-21T05:54:08.030 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_commit": 0, 2024-09-21T05:54:08.031 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_split": 0, 2024-09-21T05:54:08.031 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_merge": 0, 2024-09-21T05:54:08.031 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes": 395, 2024-09-21T05:54:08.031 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_top": 0, 2024-09-21T05:54:08.031 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_bottom": 395, 2024-09-21T05:54:08.031 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_pin_tail": 0, 2024-09-21T05:54:08.031 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_pinned": 395, 2024-09-21T05:54:08.031 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_expired": 0, 2024-09-21T05:54:08.031 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_with_caps": 0, 2024-09-21T05:54:08.031 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": 0, 2024-09-21T05:54:08.031 INFO:teuthology.orchestra.run.smithi070.stdout: "subtrees": 1, 2024-09-21T05:54:08.031 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse": 0, 2024-09-21T05:54:08.031 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_hit": 0, 2024-09-21T05:54:08.031 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_forward": 0, 2024-09-21T05:54:08.032 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_discover": 0, 2024-09-21T05:54:08.032 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_dir_fetch": 0, 2024-09-21T05:54:08.032 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_remote_ino": 0, 2024-09-21T05:54:08.032 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_lock": 0, 2024-09-21T05:54:08.032 INFO:teuthology.orchestra.run.smithi070.stdout: "load_cent": 0, 2024-09-21T05:54:08.032 INFO:teuthology.orchestra.run.smithi070.stdout: "q": 0, 2024-09-21T05:54:08.032 INFO:teuthology.orchestra.run.smithi070.stdout: "exported": 0, 2024-09-21T05:54:08.032 INFO:teuthology.orchestra.run.smithi070.stdout: "exported_inodes": 0, 2024-09-21T05:54:08.032 INFO:teuthology.orchestra.run.smithi070.stdout: "imported": 0, 2024-09-21T05:54:08.032 INFO:teuthology.orchestra.run.smithi070.stdout: "imported_inodes": 0, 2024-09-21T05:54:08.032 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_dir_fetch": 0, 2024-09-21T05:54:08.032 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_backtrace_fetch": 0, 2024-09-21T05:54:08.032 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_peer_discover": 0, 2024-09-21T05:54:08.032 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rfiles": 0, 2024-09-21T05:54:08.032 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rbytes": 0, 2024-09-21T05:54:08.033 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rsnaps": 0, 2024-09-21T05:54:08.033 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T05:54:08.033 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_set_tag": 0, 2024-09-21T05:54:08.033 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T05:54:08.033 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_inotable_repaired": 0, 2024-09-21T05:54:08.033 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dir_inodes": 0, 2024-09-21T05:54:08.033 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T05:54:08.033 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T05:54:08.033 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_file_inodes": 0, 2024-09-21T05:54:08.033 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_inode_file_caps": 0, 2024-09-21T05:54:08.033 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T05:54:08.033 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_grant": 0, 2024-09-21T05:54:08.033 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T05:54:08.034 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T05:54:08.034 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T05:54:08.034 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_caps": 0, 2024-09-21T05:54:08.034 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_caps_dirty": 0, 2024-09-21T05:54:08.034 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_cap_release": 0, 2024-09-21T05:54:08.035 INFO:teuthology.orchestra.run.smithi070.stdout: "process_request_cap_release": 0 2024-09-21T05:54:08.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.035 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache": { 2024-09-21T05:54:08.035 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_update": 0, 2024-09-21T05:54:08.035 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_update_receipt": 0, 2024-09-21T05:54:08.035 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_try_discover": 0, 2024-09-21T05:54:08.035 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_send_discover": 0, 2024-09-21T05:54:08.035 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_handle_discover": 0, 2024-09-21T05:54:08.035 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays": 0, 2024-09-21T05:54:08.035 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays_delayed": 0, 2024-09-21T05:54:08.035 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays_enqueuing": 0, 2024-09-21T05:54:08.035 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_created": 0, 2024-09-21T05:54:08.035 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_enqueued": 0, 2024-09-21T05:54:08.035 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_reintegrated": 0, 2024-09-21T05:54:08.035 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_migrated": 0, 2024-09-21T05:54:08.036 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_processing": 0, 2024-09-21T05:54:08.036 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_enqueued": 0, 2024-09-21T05:54:08.036 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_prioritized": 0, 2024-09-21T05:54:08.036 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_started": 0, 2024-09-21T05:54:08.036 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_completed": 0, 2024-09-21T05:54:08.036 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_quiesce_path": 0, 2024-09-21T05:54:08.036 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_quiesce_inode": 0, 2024-09-21T05:54:08.036 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T05:54:08.036 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_exportdir": 0, 2024-09-21T05:54:08.036 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_flush": 0, 2024-09-21T05:54:08.036 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_fragmentdir": 0, 2024-09-21T05:54:08.036 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_fragstats": 0, 2024-09-21T05:54:08.036 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_inodestats": 0, 2024-09-21T05:54:08.036 INFO:teuthology.orchestra.run.smithi070.stdout: "uninline_started": 0, 2024-09-21T05:54:08.036 INFO:teuthology.orchestra.run.smithi070.stdout: "uninline_succeeded": 0, 2024-09-21T05:54:08.036 INFO:teuthology.orchestra.run.smithi070.stdout: "uninline_write_failed": 0 2024-09-21T05:54:08.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.037 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log": { 2024-09-21T05:54:08.037 INFO:teuthology.orchestra.run.smithi070.stdout: "evlrg": 0, 2024-09-21T05:54:08.037 INFO:teuthology.orchestra.run.smithi070.stdout: "evadd": 0, 2024-09-21T05:54:08.037 INFO:teuthology.orchestra.run.smithi070.stdout: "evex": 0, 2024-09-21T05:54:08.037 INFO:teuthology.orchestra.run.smithi070.stdout: "evtrm": 0, 2024-09-21T05:54:08.037 INFO:teuthology.orchestra.run.smithi070.stdout: "ev": 1338, 2024-09-21T05:54:08.037 INFO:teuthology.orchestra.run.smithi070.stdout: "evexg": 0, 2024-09-21T05:54:08.037 INFO:teuthology.orchestra.run.smithi070.stdout: "evexd": 0, 2024-09-21T05:54:08.037 INFO:teuthology.orchestra.run.smithi070.stdout: "segadd": 0, 2024-09-21T05:54:08.037 INFO:teuthology.orchestra.run.smithi070.stdout: "segex": 0, 2024-09-21T05:54:08.037 INFO:teuthology.orchestra.run.smithi070.stdout: "segtrm": 0, 2024-09-21T05:54:08.037 INFO:teuthology.orchestra.run.smithi070.stdout: "seg": 3, 2024-09-21T05:54:08.037 INFO:teuthology.orchestra.run.smithi070.stdout: "segmjr": 2, 2024-09-21T05:54:08.037 INFO:teuthology.orchestra.run.smithi070.stdout: "segexg": 0, 2024-09-21T05:54:08.038 INFO:teuthology.orchestra.run.smithi070.stdout: "segexd": 0, 2024-09-21T05:54:08.038 INFO:teuthology.orchestra.run.smithi070.stdout: "expos": 4194304, 2024-09-21T05:54:08.038 INFO:teuthology.orchestra.run.smithi070.stdout: "wrpos": 6598840, 2024-09-21T05:54:08.038 INFO:teuthology.orchestra.run.smithi070.stdout: "rdpos": 6597702, 2024-09-21T05:54:08.038 INFO:teuthology.orchestra.run.smithi070.stdout: "jlat": { 2024-09-21T05:54:08.038 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.038 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.038 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.038 INFO:teuthology.orchestra.run.smithi070.stdout: "replayed": 1338 2024-09-21T05:54:08.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.038 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_mem": { 2024-09-21T05:54:08.038 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 6, 2024-09-21T05:54:08.038 INFO:teuthology.orchestra.run.smithi070.stdout: "ino+": 442, 2024-09-21T05:54:08.039 INFO:teuthology.orchestra.run.smithi070.stdout: "ino-": 436, 2024-09-21T05:54:08.039 INFO:teuthology.orchestra.run.smithi070.stdout: "dir": 4, 2024-09-21T05:54:08.039 INFO:teuthology.orchestra.run.smithi070.stdout: "dir+": 97, 2024-09-21T05:54:08.039 INFO:teuthology.orchestra.run.smithi070.stdout: "dir-": 93, 2024-09-21T05:54:08.039 INFO:teuthology.orchestra.run.smithi070.stdout: "dn": 395, 2024-09-21T05:54:08.039 INFO:teuthology.orchestra.run.smithi070.stdout: "dn+": 786, 2024-09-21T05:54:08.039 INFO:teuthology.orchestra.run.smithi070.stdout: "dn-": 391, 2024-09-21T05:54:08.039 INFO:teuthology.orchestra.run.smithi070.stdout: "cap": 0, 2024-09-21T05:54:08.039 INFO:teuthology.orchestra.run.smithi070.stdout: "cap+": 0, 2024-09-21T05:54:08.039 INFO:teuthology.orchestra.run.smithi070.stdout: "cap-": 0, 2024-09-21T05:54:08.039 INFO:teuthology.orchestra.run.smithi070.stdout: "rss": 121456, 2024-09-21T05:54:08.039 INFO:teuthology.orchestra.run.smithi070.stdout: "heap": 320679936 2024-09-21T05:54:08.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.039 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_server": { 2024-09-21T05:54:08.039 INFO:teuthology.orchestra.run.smithi070.stdout: "dispatch_client_request": 0, 2024-09-21T05:54:08.040 INFO:teuthology.orchestra.run.smithi070.stdout: "dispatch_server_request": 0, 2024-09-21T05:54:08.040 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_request": 0, 2024-09-21T05:54:08.040 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_session": 0, 2024-09-21T05:54:08.040 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_peer_request": 0, 2024-09-21T05:54:08.040 INFO:teuthology.orchestra.run.smithi070.stdout: "req_create_latency": { 2024-09-21T05:54:08.040 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.040 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.040 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.040 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getattr_latency": { 2024-09-21T05:54:08.040 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.040 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.040 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.040 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getfilelock_latency": { 2024-09-21T05:54:08.041 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.041 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.041 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.041 INFO:teuthology.orchestra.run.smithi070.stdout: "req_link_latency": { 2024-09-21T05:54:08.041 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.041 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.041 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.041 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookup_latency": { 2024-09-21T05:54:08.041 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.041 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.041 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.041 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookuphash_latency": { 2024-09-21T05:54:08.042 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.042 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.042 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.042 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupino_latency": { 2024-09-21T05:54:08.042 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.042 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.042 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.042 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupname_latency": { 2024-09-21T05:54:08.042 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.042 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.042 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.043 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupparent_latency": { 2024-09-21T05:54:08.043 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.043 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.043 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.043 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupsnap_latency": { 2024-09-21T05:54:08.043 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.043 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.043 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.043 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lssnap_latency": { 2024-09-21T05:54:08.043 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.043 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.044 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.044 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mkdir_latency": { 2024-09-21T05:54:08.044 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.044 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.044 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.044 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mknod_latency": { 2024-09-21T05:54:08.045 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.045 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.045 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.045 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mksnap_latency": { 2024-09-21T05:54:08.045 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.045 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.045 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.045 INFO:teuthology.orchestra.run.smithi070.stdout: "req_open_latency": { 2024-09-21T05:54:08.045 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.045 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.045 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.046 INFO:teuthology.orchestra.run.smithi070.stdout: "req_readdir_latency": { 2024-09-21T05:54:08.046 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.046 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.046 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.046 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rename_latency": { 2024-09-21T05:54:08.046 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.046 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.046 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.046 INFO:teuthology.orchestra.run.smithi070.stdout: "req_renamesnap_latency": { 2024-09-21T05:54:08.046 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.046 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.046 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.047 INFO:teuthology.orchestra.run.smithi070.stdout: "req_snapdiff_latency": { 2024-09-21T05:54:08.047 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.047 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.047 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.047 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmdir_latency": { 2024-09-21T05:54:08.047 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.047 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.047 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.047 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmsnap_latency": { 2024-09-21T05:54:08.047 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.047 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.048 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.048 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmxattr_latency": { 2024-09-21T05:54:08.048 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.048 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.048 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.048 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setattr_latency": { 2024-09-21T05:54:08.048 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.048 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.048 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.048 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setdirlayout_latency": { 2024-09-21T05:54:08.048 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.048 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.049 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.049 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setfilelock_latency": { 2024-09-21T05:54:08.049 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.049 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.049 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.049 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setlayout_latency": { 2024-09-21T05:54:08.049 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.049 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.049 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.049 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setxattr_latency": { 2024-09-21T05:54:08.049 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.049 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.050 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.050 INFO:teuthology.orchestra.run.smithi070.stdout: "req_symlink_latency": { 2024-09-21T05:54:08.050 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.050 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.050 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.050 INFO:teuthology.orchestra.run.smithi070.stdout: "req_unlink_latency": { 2024-09-21T05:54:08.050 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.050 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.050 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.050 INFO:teuthology.orchestra.run.smithi070.stdout: "cap_revoke_eviction": 0, 2024-09-21T05:54:08.050 INFO:teuthology.orchestra.run.smithi070.stdout: "cap_acquisition_throttle": 0, 2024-09-21T05:54:08.050 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getvxattr_latency": { 2024-09-21T05:54:08.051 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.051 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.051 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.051 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:08.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.051 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_sessions": { 2024-09-21T05:54:08.051 INFO:teuthology.orchestra.run.smithi070.stdout: "session_count": 1, 2024-09-21T05:54:08.051 INFO:teuthology.orchestra.run.smithi070.stdout: "session_add": 1, 2024-09-21T05:54:08.051 INFO:teuthology.orchestra.run.smithi070.stdout: "session_remove": 0, 2024-09-21T05:54:08.051 INFO:teuthology.orchestra.run.smithi070.stdout: "sessions_open": 1, 2024-09-21T05:54:08.051 INFO:teuthology.orchestra.run.smithi070.stdout: "sessions_stale": 0, 2024-09-21T05:54:08.051 INFO:teuthology.orchestra.run.smithi070.stdout: "total_load": 0, 2024-09-21T05:54:08.051 INFO:teuthology.orchestra.run.smithi070.stdout: "average_load": 0, 2024-09-21T05:54:08.051 INFO:teuthology.orchestra.run.smithi070.stdout: "avg_session_uptime": 1366, 2024-09-21T05:54:08.051 INFO:teuthology.orchestra.run.smithi070.stdout: "mdthresh_evicted": 0 2024-09-21T05:54:08.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.052 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool": { 2024-09-21T05:54:08.052 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_bytes": 0, 2024-09-21T05:54:08.052 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_items": 0, 2024-09-21T05:54:08.052 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T05:54:08.052 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_items": 0, 2024-09-21T05:54:08.052 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T05:54:08.052 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_items": 0, 2024-09-21T05:54:08.052 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T05:54:08.052 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T05:54:08.052 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T05:54:08.052 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T05:54:08.052 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T05:54:08.052 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_items": 0, 2024-09-21T05:54:08.052 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T05:54:08.052 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T05:54:08.053 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_bytes": 0, 2024-09-21T05:54:08.053 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_items": 0, 2024-09-21T05:54:08.053 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_bytes": 0, 2024-09-21T05:54:08.053 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_items": 0, 2024-09-21T05:54:08.053 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T05:54:08.053 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T05:54:08.053 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T05:54:08.053 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T05:54:08.053 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T05:54:08.053 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_items": 0, 2024-09-21T05:54:08.053 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_bytes": 0, 2024-09-21T05:54:08.053 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_items": 0, 2024-09-21T05:54:08.053 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T05:54:08.053 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T05:54:08.053 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_bytes": 0, 2024-09-21T05:54:08.053 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_items": 0, 2024-09-21T05:54:08.054 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_bytes": 0, 2024-09-21T05:54:08.054 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_items": 0, 2024-09-21T05:54:08.054 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T05:54:08.054 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_items": 0, 2024-09-21T05:54:08.054 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T05:54:08.054 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_items": 0, 2024-09-21T05:54:08.054 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_bytes": 197359, 2024-09-21T05:54:08.054 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_items": 53, 2024-09-21T05:54:08.054 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_bytes": 0, 2024-09-21T05:54:08.054 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_items": 0, 2024-09-21T05:54:08.054 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bytes": 0, 2024-09-21T05:54:08.054 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_items": 0, 2024-09-21T05:54:08.054 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_bytes": 0, 2024-09-21T05:54:08.054 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_items": 0, 2024-09-21T05:54:08.055 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_bytes": 0, 2024-09-21T05:54:08.055 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_items": 0, 2024-09-21T05:54:08.055 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_bytes": 9144, 2024-09-21T05:54:08.055 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_items": 172, 2024-09-21T05:54:08.055 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T05:54:08.055 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_items": 0, 2024-09-21T05:54:08.055 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_bytes": 0, 2024-09-21T05:54:08.055 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_items": 0, 2024-09-21T05:54:08.055 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_bytes": 288197, 2024-09-21T05:54:08.055 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_items": 1884, 2024-09-21T05:54:08.056 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_bytes": 0, 2024-09-21T05:54:08.056 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_items": 0, 2024-09-21T05:54:08.056 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_bytes": 0, 2024-09-21T05:54:08.056 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_items": 0 2024-09-21T05:54:08.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.056 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter": { 2024-09-21T05:54:08.057 INFO:teuthology.orchestra.run.smithi070.stdout: "op_active": 0, 2024-09-21T05:54:08.057 INFO:teuthology.orchestra.run.smithi070.stdout: "op_laggy": 0, 2024-09-21T05:54:08.057 INFO:teuthology.orchestra.run.smithi070.stdout: "op_send": 1084, 2024-09-21T05:54:08.057 INFO:teuthology.orchestra.run.smithi070.stdout: "op_send_bytes": 21, 2024-09-21T05:54:08.057 INFO:teuthology.orchestra.run.smithi070.stdout: "op_resend": 3, 2024-09-21T05:54:08.057 INFO:teuthology.orchestra.run.smithi070.stdout: "op_reply": 1084, 2024-09-21T05:54:08.058 INFO:teuthology.orchestra.run.smithi070.stdout: "op_latency": { 2024-09-21T05:54:08.058 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 1084, 2024-09-21T05:54:08.058 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.672980052, 2024-09-21T05:54:08.058 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000620830 2024-09-21T05:54:08.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.059 INFO:teuthology.orchestra.run.smithi070.stdout: "op_inflight": 0, 2024-09-21T05:54:08.059 INFO:teuthology.orchestra.run.smithi070.stdout: "oplen_avg": { 2024-09-21T05:54:08.059 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 1084, 2024-09-21T05:54:08.059 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 1085 2024-09-21T05:54:08.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.059 INFO:teuthology.orchestra.run.smithi070.stdout: "op": 1084, 2024-09-21T05:54:08.060 INFO:teuthology.orchestra.run.smithi070.stdout: "op_r": 1084, 2024-09-21T05:54:08.060 INFO:teuthology.orchestra.run.smithi070.stdout: "op_w": 0, 2024-09-21T05:54:08.060 INFO:teuthology.orchestra.run.smithi070.stdout: "op_rmw": 0, 2024-09-21T05:54:08.060 INFO:teuthology.orchestra.run.smithi070.stdout: "op_pg": 0, 2024-09-21T05:54:08.060 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_stat": 651, 2024-09-21T05:54:08.060 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_create": 0, 2024-09-21T05:54:08.061 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_read": 431, 2024-09-21T05:54:08.061 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_write": 0, 2024-09-21T05:54:08.061 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_writefull": 0, 2024-09-21T05:54:08.061 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_writesame": 0, 2024-09-21T05:54:08.061 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_append": 0, 2024-09-21T05:54:08.061 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_zero": 0, 2024-09-21T05:54:08.062 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_truncate": 0, 2024-09-21T05:54:08.062 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_delete": 0, 2024-09-21T05:54:08.062 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_mapext": 0, 2024-09-21T05:54:08.062 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_sparse_read": 0, 2024-09-21T05:54:08.062 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_clonerange": 0, 2024-09-21T05:54:08.062 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_getxattr": 1, 2024-09-21T05:54:08.063 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_setxattr": 0, 2024-09-21T05:54:08.063 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_cmpxattr": 0, 2024-09-21T05:54:08.063 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_rmxattr": 0, 2024-09-21T05:54:08.063 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_resetxattrs": 0, 2024-09-21T05:54:08.063 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_call": 0, 2024-09-21T05:54:08.064 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_watch": 0, 2024-09-21T05:54:08.064 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_notify": 0, 2024-09-21T05:54:08.064 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T05:54:08.064 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_pgls": 0, 2024-09-21T05:54:08.064 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_pgls_filter": 0, 2024-09-21T05:54:08.064 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_other": 0, 2024-09-21T05:54:08.065 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_active": 0, 2024-09-21T05:54:08.065 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_send": 0, 2024-09-21T05:54:08.065 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_resend": 0, 2024-09-21T05:54:08.065 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_ping": 0, 2024-09-21T05:54:08.065 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_active": 0, 2024-09-21T05:54:08.065 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_send": 0, 2024-09-21T05:54:08.066 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_resend": 0, 2024-09-21T05:54:08.066 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_active": 0, 2024-09-21T05:54:08.066 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_send": 0, 2024-09-21T05:54:08.066 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_resend": 0, 2024-09-21T05:54:08.066 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_active": 0, 2024-09-21T05:54:08.066 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_send": 0, 2024-09-21T05:54:08.067 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_resend": 0, 2024-09-21T05:54:08.067 INFO:teuthology.orchestra.run.smithi070.stdout: "command_active": 0, 2024-09-21T05:54:08.067 INFO:teuthology.orchestra.run.smithi070.stdout: "command_send": 0, 2024-09-21T05:54:08.067 INFO:teuthology.orchestra.run.smithi070.stdout: "command_resend": 0, 2024-09-21T05:54:08.067 INFO:teuthology.orchestra.run.smithi070.stdout: "map_epoch": 85, 2024-09-21T05:54:08.067 INFO:teuthology.orchestra.run.smithi070.stdout: "map_full": 0, 2024-09-21T05:54:08.068 INFO:teuthology.orchestra.run.smithi070.stdout: "map_inc": 2, 2024-09-21T05:54:08.068 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_sessions": 6, 2024-09-21T05:54:08.068 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_session_open": 6, 2024-09-21T05:54:08.068 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_session_close": 0, 2024-09-21T05:54:08.068 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_laggy": 0, 2024-09-21T05:54:08.068 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_wr": 0, 2024-09-21T05:54:08.069 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_rd": 2, 2024-09-21T05:54:08.069 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_del": 0 2024-09-21T05:54:08.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.069 INFO:teuthology.orchestra.run.smithi070.stdout: "oft": { 2024-09-21T05:54:08.069 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_objs": 0, 2024-09-21T05:54:08.069 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_kv_pairs": 0, 2024-09-21T05:54:08.070 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_updates": 0, 2024-09-21T05:54:08.070 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_removes": 0 2024-09-21T05:54:08.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.070 INFO:teuthology.orchestra.run.smithi070.stdout: "purge_queue": { 2024-09-21T05:54:08.070 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_ops": 0, 2024-09-21T05:54:08.070 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T05:54:08.070 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing": 0, 2024-09-21T05:54:08.070 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_high_water": 0, 2024-09-21T05:54:08.070 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executed_ops": 0, 2024-09-21T05:54:08.070 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executed": 0, 2024-09-21T05:54:08.071 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_item_in_journal": 0 2024-09-21T05:54:08.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.071 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T05:54:08.071 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-21T05:54:08.071 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-09-21T05:54:08.071 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-21T05:54:08.071 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 1226, 2024-09-21T05:54:08.071 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 3496104, 2024-09-21T05:54:08.071 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:08.071 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 1226, 2024-09-21T05:54:08.071 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-09-21T05:54:08.071 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-09-21T05:54:08.071 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 1226, 2024-09-21T05:54:08.072 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 3496104, 2024-09-21T05:54:08.072 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-21T05:54:08.072 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.072 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.072 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.072 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:08.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.072 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-objecter_bytes": { 2024-09-21T05:54:08.072 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-21T05:54:08.072 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-09-21T05:54:08.072 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-21T05:54:08.072 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-09-21T05:54:08.072 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-09-21T05:54:08.072 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:08.072 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-09-21T05:54:08.072 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 1084, 2024-09-21T05:54:08.073 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 2404541, 2024-09-21T05:54:08.073 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 1084, 2024-09-21T05:54:08.073 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 2404541, 2024-09-21T05:54:08.073 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-21T05:54:08.073 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.073 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.073 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.073 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:08.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.073 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-objecter_ops": { 2024-09-21T05:54:08.073 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-21T05:54:08.073 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 1024, 2024-09-21T05:54:08.073 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-21T05:54:08.073 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-09-21T05:54:08.073 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-09-21T05:54:08.073 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:08.074 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-09-21T05:54:08.074 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 1084, 2024-09-21T05:54:08.074 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 1084, 2024-09-21T05:54:08.074 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 1084, 2024-09-21T05:54:08.074 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 1084, 2024-09-21T05:54:08.074 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-21T05:54:08.074 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.074 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.074 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.074 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:08.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.074 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-write_buf_throttle": { 2024-09-21T05:54:08.074 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-21T05:54:08.074 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 3758096384, 2024-09-21T05:54:08.074 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-21T05:54:08.074 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-09-21T05:54:08.075 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-09-21T05:54:08.075 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:08.075 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-09-21T05:54:08.075 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-09-21T05:54:08.075 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-09-21T05:54:08.075 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 0, 2024-09-21T05:54:08.075 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 0, 2024-09-21T05:54:08.075 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-21T05:54:08.075 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.075 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.075 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.075 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:08.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.075 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-write_buf_throttle-0x5596030f9520": { 2024-09-21T05:54:08.075 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-21T05:54:08.076 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 3758096384, 2024-09-21T05:54:08.076 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-21T05:54:08.076 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-09-21T05:54:08.076 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-09-21T05:54:08.076 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:08.076 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-09-21T05:54:08.076 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-09-21T05:54:08.076 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-09-21T05:54:08.076 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 0, 2024-09-21T05:54:08.076 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 0, 2024-09-21T05:54:08.076 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-21T05:54:08.076 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:08.076 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:08.076 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:08.076 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:08.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:08.076 INFO:teuthology.orchestra.run.smithi070.stdout: "trackedop": { 2024-09-21T05:54:08.077 INFO:teuthology.orchestra.run.smithi070.stdout: "slow_ops_count": 0 2024-09-21T05:54:08.077 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:08.077 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:54:08.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:08 smithi070 ceph-mon[30981]: pgmap v510: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 450 KiB/s wr, 152 op/s 2024-09-21T05:54:08.932 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-21T05:54:08.932 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-21T05:54:08.932 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-09-21T05:54:08.932 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2024-09-21T05:54:08.932 DEBUG:tasks.check_counter:Getting stats from d 2024-09-21T05:54:08.933 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph daemon mds.d perf dump 2024-09-21T05:54:09.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:08 smithi116 ceph-mon[34332]: pgmap v510: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 450 KiB/s wr, 152 op/s 2024-09-21T05:54:09.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:08 smithi160 ceph-mon[33979]: pgmap v510: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 450 KiB/s wr, 152 op/s 2024-09-21T05:54:09.181 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:54:09.673 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:54:09.673 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T05:54:09.673 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 4, 2024-09-21T05:54:09.674 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 4, 2024-09-21T05:54:09.674 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 2992, 2024-09-21T05:54:09.674 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 448, 2024-09-21T05:54:09.674 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 4, 2024-09-21T05:54:09.674 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 0, 2024-09-21T05:54:09.674 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.002995739, 2024-09-21T05:54:09.674 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.000042336, 2024-09-21T05:54:09.674 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.002195609, 2024-09-21T05:54:09.674 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T05:54:09.674 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:09.674 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 3, 2024-09-21T05:54:09.674 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.003835604, 2024-09-21T05:54:09.674 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.001278534 2024-09-21T05:54:09.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:09.675 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:09.675 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:09.675 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:09.675 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:09.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:09.675 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T05:54:09.675 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T05:54:09.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:09.675 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T05:54:09.675 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 129, 2024-09-21T05:54:09.675 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 124, 2024-09-21T05:54:09.675 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 811120, 2024-09-21T05:54:09.675 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 75568, 2024-09-21T05:54:09.675 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 2, 2024-09-21T05:54:09.675 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 1, 2024-09-21T05:54:09.676 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.025266243, 2024-09-21T05:54:09.676 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.010146379, 2024-09-21T05:54:09.676 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.022956695, 2024-09-21T05:54:09.676 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T05:54:09.676 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:09.676 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 123, 2024-09-21T05:54:09.676 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.006508196, 2024-09-21T05:54:09.676 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000052912 2024-09-21T05:54:09.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:09.676 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:09.676 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:09.676 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:09.676 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:09.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:09.677 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 811120, 2024-09-21T05:54:09.677 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 75568 2024-09-21T05:54:09.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:09.677 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T05:54:09.677 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 1, 2024-09-21T05:54:09.677 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 94, 2024-09-21T05:54:09.677 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 160, 2024-09-21T05:54:09.677 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 96800, 2024-09-21T05:54:09.677 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 3, 2024-09-21T05:54:09.677 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 2, 2024-09-21T05:54:09.677 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.009224141, 2024-09-21T05:54:09.677 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.007118283, 2024-09-21T05:54:09.677 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.001237460, 2024-09-21T05:54:09.677 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T05:54:09.677 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:09.678 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 92, 2024-09-21T05:54:09.678 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.004075206, 2024-09-21T05:54:09.678 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000044295 2024-09-21T05:54:09.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:09.678 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:09.678 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:09.678 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:09.678 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:09.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:09.678 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T05:54:09.678 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 96800 2024-09-21T05:54:09.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:09.678 INFO:teuthology.orchestra.run.smithi070.stdout: "cct": { 2024-09-21T05:54:09.678 INFO:teuthology.orchestra.run.smithi070.stdout: "total_workers": 0, 2024-09-21T05:54:09.678 INFO:teuthology.orchestra.run.smithi070.stdout: "unhealthy_workers": 0 2024-09-21T05:54:09.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:09.679 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool": { 2024-09-21T05:54:09.679 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_bytes": 0, 2024-09-21T05:54:09.679 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_items": 0, 2024-09-21T05:54:09.679 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T05:54:09.679 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_items": 0, 2024-09-21T05:54:09.679 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T05:54:09.679 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_items": 0, 2024-09-21T05:54:09.679 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T05:54:09.679 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T05:54:09.679 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T05:54:09.679 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T05:54:09.679 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T05:54:09.679 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_items": 0, 2024-09-21T05:54:09.679 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T05:54:09.680 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T05:54:09.680 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_bytes": 0, 2024-09-21T05:54:09.680 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_items": 0, 2024-09-21T05:54:09.680 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_bytes": 0, 2024-09-21T05:54:09.680 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_items": 0, 2024-09-21T05:54:09.680 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T05:54:09.680 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T05:54:09.680 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T05:54:09.680 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T05:54:09.680 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T05:54:09.680 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_items": 0, 2024-09-21T05:54:09.680 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_bytes": 0, 2024-09-21T05:54:09.680 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_items": 0, 2024-09-21T05:54:09.680 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T05:54:09.680 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T05:54:09.680 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_bytes": 0, 2024-09-21T05:54:09.681 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_items": 0, 2024-09-21T05:54:09.681 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_bytes": 0, 2024-09-21T05:54:09.681 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_items": 0, 2024-09-21T05:54:09.681 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T05:54:09.681 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_items": 0, 2024-09-21T05:54:09.681 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T05:54:09.681 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_items": 0, 2024-09-21T05:54:09.681 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_bytes": 148880, 2024-09-21T05:54:09.681 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_items": 29, 2024-09-21T05:54:09.681 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_bytes": 0, 2024-09-21T05:54:09.681 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_items": 0, 2024-09-21T05:54:09.681 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bytes": 0, 2024-09-21T05:54:09.681 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_items": 0, 2024-09-21T05:54:09.681 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_bytes": 0, 2024-09-21T05:54:09.681 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_items": 0, 2024-09-21T05:54:09.682 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_bytes": 0, 2024-09-21T05:54:09.682 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_items": 0, 2024-09-21T05:54:09.682 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_bytes": 0, 2024-09-21T05:54:09.682 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_items": 0, 2024-09-21T05:54:09.682 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T05:54:09.682 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_items": 0, 2024-09-21T05:54:09.682 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_bytes": 0, 2024-09-21T05:54:09.682 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_items": 0, 2024-09-21T05:54:09.682 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_bytes": 968, 2024-09-21T05:54:09.682 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_items": 2, 2024-09-21T05:54:09.682 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_bytes": 0, 2024-09-21T05:54:09.682 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_items": 0, 2024-09-21T05:54:09.682 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_bytes": 0, 2024-09-21T05:54:09.682 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_items": 0 2024-09-21T05:54:09.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:09.683 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T05:54:09.683 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-21T05:54:09.683 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-09-21T05:54:09.683 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-21T05:54:09.683 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 130, 2024-09-21T05:54:09.683 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 792948, 2024-09-21T05:54:09.683 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:09.683 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 130, 2024-09-21T05:54:09.683 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-09-21T05:54:09.683 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-09-21T05:54:09.683 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 130, 2024-09-21T05:54:09.683 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 792948, 2024-09-21T05:54:09.683 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-21T05:54:09.683 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:09.683 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:09.683 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:09.684 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:09.684 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:09.684 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:54:10.517 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-21T05:54:10.517 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-21T05:54:10.518 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-21T05:54:10.518 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-21T05:54:10.518 DEBUG:tasks.check_counter:Getting stats from g 2024-09-21T05:54:10.518 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph daemon mds.g perf dump 2024-09-21T05:54:10.771 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:54:10.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:10 smithi070 ceph-mon[30981]: pgmap v511: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 68 KiB/s wr, 84 op/s 2024-09-21T05:54:10.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:10 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:54:11.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:10 smithi116 ceph-mon[34332]: pgmap v511: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 68 KiB/s wr, 84 op/s 2024-09-21T05:54:11.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:10 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:54:11.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:10 smithi160 ceph-mon[33979]: pgmap v511: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 68 KiB/s wr, 84 op/s 2024-09-21T05:54:11.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:10 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:54:11.247 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:54:11.248 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T05:54:11.248 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 386, 2024-09-21T05:54:11.248 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 386, 2024-09-21T05:54:11.248 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 131289, 2024-09-21T05:54:11.248 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 121925, 2024-09-21T05:54:11.248 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 6, 2024-09-21T05:54:11.248 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 2, 2024-09-21T05:54:11.248 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.052203937, 2024-09-21T05:54:11.248 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.025208600, 2024-09-21T05:54:11.248 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.011652635, 2024-09-21T05:54:11.248 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.011099218, 2024-09-21T05:54:11.248 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:11.248 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 385, 2024-09-21T05:54:11.248 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.022908728, 2024-09-21T05:54:11.248 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000059503 2024-09-21T05:54:11.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.249 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:11.249 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.249 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.249 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.249 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T05:54:11.249 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T05:54:11.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.249 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T05:54:11.249 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 695, 2024-09-21T05:54:11.249 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 785, 2024-09-21T05:54:11.249 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 805969, 2024-09-21T05:54:11.249 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 451901, 2024-09-21T05:54:11.249 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 5, 2024-09-21T05:54:11.250 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 4, 2024-09-21T05:54:11.250 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.060668225, 2024-09-21T05:54:11.250 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.026674667, 2024-09-21T05:54:11.250 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.013908367, 2024-09-21T05:54:11.250 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.016255473, 2024-09-21T05:54:11.250 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:11.250 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 783, 2024-09-21T05:54:11.250 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.029132583, 2024-09-21T05:54:11.250 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000037206 2024-09-21T05:54:11.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.250 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:11.250 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.250 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.250 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.251 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T05:54:11.251 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 231152 2024-09-21T05:54:11.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.251 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T05:54:11.251 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 146, 2024-09-21T05:54:11.251 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 130, 2024-09-21T05:54:11.251 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 903460, 2024-09-21T05:54:11.251 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 75637, 2024-09-21T05:54:11.251 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 4, 2024-09-21T05:54:11.251 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 3, 2024-09-21T05:54:11.251 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.026213430, 2024-09-21T05:54:11.251 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.010687433, 2024-09-21T05:54:11.251 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.023200479, 2024-09-21T05:54:11.251 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000085601, 2024-09-21T05:54:11.251 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:11.252 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 129, 2024-09-21T05:54:11.252 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.007981266, 2024-09-21T05:54:11.252 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000061870 2024-09-21T05:54:11.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.252 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:11.252 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.252 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.252 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.252 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 902112, 2024-09-21T05:54:11.252 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 74672 2024-09-21T05:54:11.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.252 INFO:teuthology.orchestra.run.smithi070.stdout: "cct": { 2024-09-21T05:54:11.252 INFO:teuthology.orchestra.run.smithi070.stdout: "total_workers": 1, 2024-09-21T05:54:11.252 INFO:teuthology.orchestra.run.smithi070.stdout: "unhealthy_workers": 0 2024-09-21T05:54:11.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.253 INFO:teuthology.orchestra.run.smithi070.stdout: "finisher-MDSRank": { 2024-09-21T05:54:11.253 INFO:teuthology.orchestra.run.smithi070.stdout: "queue_len": 0, 2024-09-21T05:54:11.253 INFO:teuthology.orchestra.run.smithi070.stdout: "complete_latency": { 2024-09-21T05:54:11.253 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 1863, 2024-09-21T05:54:11.253 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.047457142, 2024-09-21T05:54:11.253 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000025473 2024-09-21T05:54:11.253 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:11.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.253 INFO:teuthology.orchestra.run.smithi070.stdout: "finisher-PurgeQueue": { 2024-09-21T05:54:11.253 INFO:teuthology.orchestra.run.smithi070.stdout: "queue_len": 0, 2024-09-21T05:54:11.253 INFO:teuthology.orchestra.run.smithi070.stdout: "complete_latency": { 2024-09-21T05:54:11.253 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.253 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.253 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.253 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:11.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.254 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": { 2024-09-21T05:54:11.254 INFO:teuthology.orchestra.run.smithi070.stdout: "request": 0, 2024-09-21T05:54:11.254 INFO:teuthology.orchestra.run.smithi070.stdout: "reply": 0, 2024-09-21T05:54:11.254 INFO:teuthology.orchestra.run.smithi070.stdout: "reply_latency": { 2024-09-21T05:54:11.254 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.254 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.254 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.254 INFO:teuthology.orchestra.run.smithi070.stdout: "slow_reply": 0, 2024-09-21T05:54:11.254 INFO:teuthology.orchestra.run.smithi070.stdout: "forward": 0, 2024-09-21T05:54:11.254 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_fetch_complete": 0, 2024-09-21T05:54:11.254 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_fetch_keys": 0, 2024-09-21T05:54:11.254 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_commit": 0, 2024-09-21T05:54:11.254 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_split": 0, 2024-09-21T05:54:11.255 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_merge": 0, 2024-09-21T05:54:11.255 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes": 102, 2024-09-21T05:54:11.255 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_top": 0, 2024-09-21T05:54:11.255 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_bottom": 102, 2024-09-21T05:54:11.255 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_pin_tail": 0, 2024-09-21T05:54:11.255 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_pinned": 102, 2024-09-21T05:54:11.255 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_expired": 0, 2024-09-21T05:54:11.255 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_with_caps": 0, 2024-09-21T05:54:11.255 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": 0, 2024-09-21T05:54:11.255 INFO:teuthology.orchestra.run.smithi070.stdout: "subtrees": 1, 2024-09-21T05:54:11.255 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse": 0, 2024-09-21T05:54:11.255 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_hit": 0, 2024-09-21T05:54:11.255 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_forward": 0, 2024-09-21T05:54:11.255 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_discover": 0, 2024-09-21T05:54:11.255 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_dir_fetch": 0, 2024-09-21T05:54:11.256 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_remote_ino": 0, 2024-09-21T05:54:11.256 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_lock": 0, 2024-09-21T05:54:11.256 INFO:teuthology.orchestra.run.smithi070.stdout: "load_cent": 0, 2024-09-21T05:54:11.256 INFO:teuthology.orchestra.run.smithi070.stdout: "q": 0, 2024-09-21T05:54:11.256 INFO:teuthology.orchestra.run.smithi070.stdout: "exported": 0, 2024-09-21T05:54:11.256 INFO:teuthology.orchestra.run.smithi070.stdout: "exported_inodes": 0, 2024-09-21T05:54:11.256 INFO:teuthology.orchestra.run.smithi070.stdout: "imported": 0, 2024-09-21T05:54:11.256 INFO:teuthology.orchestra.run.smithi070.stdout: "imported_inodes": 0, 2024-09-21T05:54:11.256 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_dir_fetch": 0, 2024-09-21T05:54:11.256 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_backtrace_fetch": 0, 2024-09-21T05:54:11.256 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_peer_discover": 0, 2024-09-21T05:54:11.256 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rfiles": 0, 2024-09-21T05:54:11.256 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rbytes": 0, 2024-09-21T05:54:11.256 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rsnaps": 0, 2024-09-21T05:54:11.256 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T05:54:11.257 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_set_tag": 0, 2024-09-21T05:54:11.257 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T05:54:11.257 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_inotable_repaired": 0, 2024-09-21T05:54:11.257 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dir_inodes": 0, 2024-09-21T05:54:11.257 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T05:54:11.257 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T05:54:11.257 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_file_inodes": 0, 2024-09-21T05:54:11.257 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_inode_file_caps": 0, 2024-09-21T05:54:11.257 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T05:54:11.257 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_grant": 0, 2024-09-21T05:54:11.257 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T05:54:11.257 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T05:54:11.257 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T05:54:11.257 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_caps": 0, 2024-09-21T05:54:11.257 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_caps_dirty": 0, 2024-09-21T05:54:11.258 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_cap_release": 0, 2024-09-21T05:54:11.258 INFO:teuthology.orchestra.run.smithi070.stdout: "process_request_cap_release": 0 2024-09-21T05:54:11.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.258 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache": { 2024-09-21T05:54:11.258 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_update": 0, 2024-09-21T05:54:11.258 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_update_receipt": 0, 2024-09-21T05:54:11.258 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_try_discover": 0, 2024-09-21T05:54:11.258 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_send_discover": 0, 2024-09-21T05:54:11.258 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_handle_discover": 0, 2024-09-21T05:54:11.258 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays": 0, 2024-09-21T05:54:11.258 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays_delayed": 0, 2024-09-21T05:54:11.258 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays_enqueuing": 0, 2024-09-21T05:54:11.258 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_created": 0, 2024-09-21T05:54:11.258 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_enqueued": 0, 2024-09-21T05:54:11.258 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_reintegrated": 0, 2024-09-21T05:54:11.259 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_migrated": 0, 2024-09-21T05:54:11.259 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_processing": 0, 2024-09-21T05:54:11.259 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_enqueued": 0, 2024-09-21T05:54:11.259 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_prioritized": 0, 2024-09-21T05:54:11.259 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_started": 0, 2024-09-21T05:54:11.259 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_completed": 0, 2024-09-21T05:54:11.259 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_quiesce_path": 0, 2024-09-21T05:54:11.261 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_quiesce_inode": 0, 2024-09-21T05:54:11.261 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T05:54:11.261 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_exportdir": 0, 2024-09-21T05:54:11.261 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_flush": 0, 2024-09-21T05:54:11.261 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_fragmentdir": 0, 2024-09-21T05:54:11.262 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_fragstats": 0, 2024-09-21T05:54:11.262 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_inodestats": 0, 2024-09-21T05:54:11.262 INFO:teuthology.orchestra.run.smithi070.stdout: "uninline_started": 0, 2024-09-21T05:54:11.262 INFO:teuthology.orchestra.run.smithi070.stdout: "uninline_succeeded": 0, 2024-09-21T05:54:11.262 INFO:teuthology.orchestra.run.smithi070.stdout: "uninline_write_failed": 0 2024-09-21T05:54:11.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.262 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log": { 2024-09-21T05:54:11.262 INFO:teuthology.orchestra.run.smithi070.stdout: "evlrg": 0, 2024-09-21T05:54:11.262 INFO:teuthology.orchestra.run.smithi070.stdout: "evadd": 0, 2024-09-21T05:54:11.262 INFO:teuthology.orchestra.run.smithi070.stdout: "evex": 0, 2024-09-21T05:54:11.262 INFO:teuthology.orchestra.run.smithi070.stdout: "evtrm": 0, 2024-09-21T05:54:11.262 INFO:teuthology.orchestra.run.smithi070.stdout: "ev": 391, 2024-09-21T05:54:11.262 INFO:teuthology.orchestra.run.smithi070.stdout: "evexg": 0, 2024-09-21T05:54:11.262 INFO:teuthology.orchestra.run.smithi070.stdout: "evexd": 0, 2024-09-21T05:54:11.262 INFO:teuthology.orchestra.run.smithi070.stdout: "segadd": 0, 2024-09-21T05:54:11.263 INFO:teuthology.orchestra.run.smithi070.stdout: "segex": 0, 2024-09-21T05:54:11.263 INFO:teuthology.orchestra.run.smithi070.stdout: "segtrm": 0, 2024-09-21T05:54:11.263 INFO:teuthology.orchestra.run.smithi070.stdout: "seg": 2, 2024-09-21T05:54:11.263 INFO:teuthology.orchestra.run.smithi070.stdout: "segmjr": 2, 2024-09-21T05:54:11.263 INFO:teuthology.orchestra.run.smithi070.stdout: "segexg": 0, 2024-09-21T05:54:11.263 INFO:teuthology.orchestra.run.smithi070.stdout: "segexd": 0, 2024-09-21T05:54:11.263 INFO:teuthology.orchestra.run.smithi070.stdout: "expos": 4194304, 2024-09-21T05:54:11.263 INFO:teuthology.orchestra.run.smithi070.stdout: "wrpos": 4823229, 2024-09-21T05:54:11.263 INFO:teuthology.orchestra.run.smithi070.stdout: "rdpos": 4822091, 2024-09-21T05:54:11.263 INFO:teuthology.orchestra.run.smithi070.stdout: "jlat": { 2024-09-21T05:54:11.263 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.263 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.263 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.263 INFO:teuthology.orchestra.run.smithi070.stdout: "replayed": 391 2024-09-21T05:54:11.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.264 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_mem": { 2024-09-21T05:54:11.264 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 4, 2024-09-21T05:54:11.264 INFO:teuthology.orchestra.run.smithi070.stdout: "ino+": 152, 2024-09-21T05:54:11.264 INFO:teuthology.orchestra.run.smithi070.stdout: "ino-": 148, 2024-09-21T05:54:11.264 INFO:teuthology.orchestra.run.smithi070.stdout: "dir": 2, 2024-09-21T05:54:11.264 INFO:teuthology.orchestra.run.smithi070.stdout: "dir+": 62, 2024-09-21T05:54:11.264 INFO:teuthology.orchestra.run.smithi070.stdout: "dir-": 60, 2024-09-21T05:54:11.264 INFO:teuthology.orchestra.run.smithi070.stdout: "dn": 102, 2024-09-21T05:54:11.264 INFO:teuthology.orchestra.run.smithi070.stdout: "dn+": 237, 2024-09-21T05:54:11.264 INFO:teuthology.orchestra.run.smithi070.stdout: "dn-": 135, 2024-09-21T05:54:11.264 INFO:teuthology.orchestra.run.smithi070.stdout: "cap": 0, 2024-09-21T05:54:11.264 INFO:teuthology.orchestra.run.smithi070.stdout: "cap+": 0, 2024-09-21T05:54:11.264 INFO:teuthology.orchestra.run.smithi070.stdout: "cap-": 0, 2024-09-21T05:54:11.264 INFO:teuthology.orchestra.run.smithi070.stdout: "rss": 117880, 2024-09-21T05:54:11.265 INFO:teuthology.orchestra.run.smithi070.stdout: "heap": 317476864 2024-09-21T05:54:11.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.265 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_server": { 2024-09-21T05:54:11.265 INFO:teuthology.orchestra.run.smithi070.stdout: "dispatch_client_request": 0, 2024-09-21T05:54:11.265 INFO:teuthology.orchestra.run.smithi070.stdout: "dispatch_server_request": 0, 2024-09-21T05:54:11.265 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_request": 0, 2024-09-21T05:54:11.265 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_session": 0, 2024-09-21T05:54:11.265 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_peer_request": 0, 2024-09-21T05:54:11.265 INFO:teuthology.orchestra.run.smithi070.stdout: "req_create_latency": { 2024-09-21T05:54:11.265 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.265 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.265 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.265 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getattr_latency": { 2024-09-21T05:54:11.265 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.266 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.266 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.266 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getfilelock_latency": { 2024-09-21T05:54:11.266 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.266 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.266 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.266 INFO:teuthology.orchestra.run.smithi070.stdout: "req_link_latency": { 2024-09-21T05:54:11.266 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.266 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.266 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.266 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookup_latency": { 2024-09-21T05:54:11.266 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.267 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.267 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.267 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookuphash_latency": { 2024-09-21T05:54:11.267 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.267 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.267 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.267 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupino_latency": { 2024-09-21T05:54:11.267 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.267 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.267 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.267 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupname_latency": { 2024-09-21T05:54:11.267 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.268 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.268 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.268 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupparent_latency": { 2024-09-21T05:54:11.268 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.268 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.268 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.268 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupsnap_latency": { 2024-09-21T05:54:11.268 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.268 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.268 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.268 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lssnap_latency": { 2024-09-21T05:54:11.268 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.268 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.269 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.269 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mkdir_latency": { 2024-09-21T05:54:11.269 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.269 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.270 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.270 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mknod_latency": { 2024-09-21T05:54:11.270 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.270 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.270 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.270 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mksnap_latency": { 2024-09-21T05:54:11.270 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.270 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.270 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.270 INFO:teuthology.orchestra.run.smithi070.stdout: "req_open_latency": { 2024-09-21T05:54:11.270 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.270 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.271 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.271 INFO:teuthology.orchestra.run.smithi070.stdout: "req_readdir_latency": { 2024-09-21T05:54:11.271 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.271 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.271 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.271 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rename_latency": { 2024-09-21T05:54:11.271 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.271 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.271 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.271 INFO:teuthology.orchestra.run.smithi070.stdout: "req_renamesnap_latency": { 2024-09-21T05:54:11.271 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.271 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.272 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.272 INFO:teuthology.orchestra.run.smithi070.stdout: "req_snapdiff_latency": { 2024-09-21T05:54:11.272 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.272 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.272 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.272 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmdir_latency": { 2024-09-21T05:54:11.272 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.272 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.272 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.272 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmsnap_latency": { 2024-09-21T05:54:11.272 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.272 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.273 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.273 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmxattr_latency": { 2024-09-21T05:54:11.273 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.273 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.273 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.273 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setattr_latency": { 2024-09-21T05:54:11.273 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.273 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.273 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.273 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setdirlayout_latency": { 2024-09-21T05:54:11.273 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.273 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.274 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.274 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setfilelock_latency": { 2024-09-21T05:54:11.274 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.274 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.274 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.274 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setlayout_latency": { 2024-09-21T05:54:11.274 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.274 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.274 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.274 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setxattr_latency": { 2024-09-21T05:54:11.274 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.274 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.275 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.275 INFO:teuthology.orchestra.run.smithi070.stdout: "req_symlink_latency": { 2024-09-21T05:54:11.275 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.275 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.275 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.275 INFO:teuthology.orchestra.run.smithi070.stdout: "req_unlink_latency": { 2024-09-21T05:54:11.275 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.275 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.275 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.275 INFO:teuthology.orchestra.run.smithi070.stdout: "cap_revoke_eviction": 0, 2024-09-21T05:54:11.275 INFO:teuthology.orchestra.run.smithi070.stdout: "cap_acquisition_throttle": 0, 2024-09-21T05:54:11.275 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getvxattr_latency": { 2024-09-21T05:54:11.276 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.276 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.276 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.276 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:11.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.276 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_sessions": { 2024-09-21T05:54:11.276 INFO:teuthology.orchestra.run.smithi070.stdout: "session_count": 1, 2024-09-21T05:54:11.276 INFO:teuthology.orchestra.run.smithi070.stdout: "session_add": 2, 2024-09-21T05:54:11.276 INFO:teuthology.orchestra.run.smithi070.stdout: "session_remove": 1, 2024-09-21T05:54:11.276 INFO:teuthology.orchestra.run.smithi070.stdout: "sessions_open": 2, 2024-09-21T05:54:11.276 INFO:teuthology.orchestra.run.smithi070.stdout: "sessions_stale": 0, 2024-09-21T05:54:11.276 INFO:teuthology.orchestra.run.smithi070.stdout: "total_load": 0, 2024-09-21T05:54:11.276 INFO:teuthology.orchestra.run.smithi070.stdout: "average_load": 0, 2024-09-21T05:54:11.276 INFO:teuthology.orchestra.run.smithi070.stdout: "avg_session_uptime": 2472, 2024-09-21T05:54:11.276 INFO:teuthology.orchestra.run.smithi070.stdout: "mdthresh_evicted": 0 2024-09-21T05:54:11.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.277 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool": { 2024-09-21T05:54:11.277 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_bytes": 0, 2024-09-21T05:54:11.277 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_items": 0, 2024-09-21T05:54:11.277 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T05:54:11.277 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_items": 0, 2024-09-21T05:54:11.277 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T05:54:11.277 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_items": 0, 2024-09-21T05:54:11.277 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T05:54:11.277 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T05:54:11.277 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T05:54:11.277 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T05:54:11.277 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T05:54:11.277 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_items": 0, 2024-09-21T05:54:11.277 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T05:54:11.277 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T05:54:11.277 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_bytes": 0, 2024-09-21T05:54:11.278 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_items": 0, 2024-09-21T05:54:11.278 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_bytes": 0, 2024-09-21T05:54:11.278 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_items": 0, 2024-09-21T05:54:11.278 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T05:54:11.278 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T05:54:11.278 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T05:54:11.278 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T05:54:11.278 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T05:54:11.278 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_items": 0, 2024-09-21T05:54:11.278 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_bytes": 0, 2024-09-21T05:54:11.278 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_items": 0, 2024-09-21T05:54:11.278 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T05:54:11.278 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T05:54:11.278 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_bytes": 0, 2024-09-21T05:54:11.278 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_items": 0, 2024-09-21T05:54:11.278 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_bytes": 0, 2024-09-21T05:54:11.279 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_items": 0, 2024-09-21T05:54:11.279 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T05:54:11.279 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_items": 0, 2024-09-21T05:54:11.279 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T05:54:11.279 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_items": 0, 2024-09-21T05:54:11.279 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_bytes": 197359, 2024-09-21T05:54:11.279 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_items": 53, 2024-09-21T05:54:11.279 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_bytes": 0, 2024-09-21T05:54:11.279 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_items": 0, 2024-09-21T05:54:11.279 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bytes": 0, 2024-09-21T05:54:11.279 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_items": 0, 2024-09-21T05:54:11.279 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_bytes": 0, 2024-09-21T05:54:11.279 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_items": 0, 2024-09-21T05:54:11.279 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_bytes": 0, 2024-09-21T05:54:11.279 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_items": 0, 2024-09-21T05:54:11.280 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_bytes": 9144, 2024-09-21T05:54:11.280 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_items": 172, 2024-09-21T05:54:11.280 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T05:54:11.280 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_items": 0, 2024-09-21T05:54:11.280 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_bytes": 0, 2024-09-21T05:54:11.280 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_items": 0, 2024-09-21T05:54:11.280 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_bytes": 81616, 2024-09-21T05:54:11.280 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_items": 437, 2024-09-21T05:54:11.280 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_bytes": 0, 2024-09-21T05:54:11.280 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_items": 0, 2024-09-21T05:54:11.280 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_bytes": 0, 2024-09-21T05:54:11.280 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_items": 0 2024-09-21T05:54:11.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.280 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter": { 2024-09-21T05:54:11.280 INFO:teuthology.orchestra.run.smithi070.stdout: "op_active": 0, 2024-09-21T05:54:11.280 INFO:teuthology.orchestra.run.smithi070.stdout: "op_laggy": 0, 2024-09-21T05:54:11.280 INFO:teuthology.orchestra.run.smithi070.stdout: "op_send": 1079, 2024-09-21T05:54:11.281 INFO:teuthology.orchestra.run.smithi070.stdout: "op_send_bytes": 21, 2024-09-21T05:54:11.281 INFO:teuthology.orchestra.run.smithi070.stdout: "op_resend": 3, 2024-09-21T05:54:11.281 INFO:teuthology.orchestra.run.smithi070.stdout: "op_reply": 1079, 2024-09-21T05:54:11.281 INFO:teuthology.orchestra.run.smithi070.stdout: "op_latency": { 2024-09-21T05:54:11.281 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 1079, 2024-09-21T05:54:11.281 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.616981725, 2024-09-21T05:54:11.281 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000571808 2024-09-21T05:54:11.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.281 INFO:teuthology.orchestra.run.smithi070.stdout: "op_inflight": 0, 2024-09-21T05:54:11.281 INFO:teuthology.orchestra.run.smithi070.stdout: "oplen_avg": { 2024-09-21T05:54:11.281 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 1079, 2024-09-21T05:54:11.281 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 1080 2024-09-21T05:54:11.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.281 INFO:teuthology.orchestra.run.smithi070.stdout: "op": 1079, 2024-09-21T05:54:11.281 INFO:teuthology.orchestra.run.smithi070.stdout: "op_r": 1079, 2024-09-21T05:54:11.282 INFO:teuthology.orchestra.run.smithi070.stdout: "op_w": 0, 2024-09-21T05:54:11.282 INFO:teuthology.orchestra.run.smithi070.stdout: "op_rmw": 0, 2024-09-21T05:54:11.282 INFO:teuthology.orchestra.run.smithi070.stdout: "op_pg": 0, 2024-09-21T05:54:11.282 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_stat": 658, 2024-09-21T05:54:11.282 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_create": 0, 2024-09-21T05:54:11.282 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_read": 419, 2024-09-21T05:54:11.282 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_write": 0, 2024-09-21T05:54:11.282 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_writefull": 0, 2024-09-21T05:54:11.282 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_writesame": 0, 2024-09-21T05:54:11.282 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_append": 0, 2024-09-21T05:54:11.282 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_zero": 0, 2024-09-21T05:54:11.282 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_truncate": 0, 2024-09-21T05:54:11.282 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_delete": 0, 2024-09-21T05:54:11.282 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_mapext": 0, 2024-09-21T05:54:11.282 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_sparse_read": 0, 2024-09-21T05:54:11.282 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_clonerange": 0, 2024-09-21T05:54:11.283 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_getxattr": 1, 2024-09-21T05:54:11.283 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_setxattr": 0, 2024-09-21T05:54:11.283 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_cmpxattr": 0, 2024-09-21T05:54:11.283 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_rmxattr": 0, 2024-09-21T05:54:11.283 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_resetxattrs": 0, 2024-09-21T05:54:11.283 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_call": 0, 2024-09-21T05:54:11.283 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_watch": 0, 2024-09-21T05:54:11.283 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_notify": 0, 2024-09-21T05:54:11.283 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T05:54:11.283 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_pgls": 0, 2024-09-21T05:54:11.283 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_pgls_filter": 0, 2024-09-21T05:54:11.283 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_other": 0, 2024-09-21T05:54:11.283 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_active": 0, 2024-09-21T05:54:11.283 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_send": 0, 2024-09-21T05:54:11.283 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_resend": 0, 2024-09-21T05:54:11.283 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_ping": 0, 2024-09-21T05:54:11.284 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_active": 0, 2024-09-21T05:54:11.284 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_send": 0, 2024-09-21T05:54:11.284 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_resend": 0, 2024-09-21T05:54:11.284 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_active": 0, 2024-09-21T05:54:11.284 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_send": 0, 2024-09-21T05:54:11.284 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_resend": 0, 2024-09-21T05:54:11.284 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_active": 0, 2024-09-21T05:54:11.284 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_send": 0, 2024-09-21T05:54:11.284 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_resend": 0, 2024-09-21T05:54:11.284 INFO:teuthology.orchestra.run.smithi070.stdout: "command_active": 0, 2024-09-21T05:54:11.284 INFO:teuthology.orchestra.run.smithi070.stdout: "command_send": 0, 2024-09-21T05:54:11.284 INFO:teuthology.orchestra.run.smithi070.stdout: "command_resend": 0, 2024-09-21T05:54:11.284 INFO:teuthology.orchestra.run.smithi070.stdout: "map_epoch": 85, 2024-09-21T05:54:11.284 INFO:teuthology.orchestra.run.smithi070.stdout: "map_full": 0, 2024-09-21T05:54:11.284 INFO:teuthology.orchestra.run.smithi070.stdout: "map_inc": 2, 2024-09-21T05:54:11.284 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_sessions": 6, 2024-09-21T05:54:11.285 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_session_open": 6, 2024-09-21T05:54:11.285 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_session_close": 0, 2024-09-21T05:54:11.285 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_laggy": 0, 2024-09-21T05:54:11.285 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_wr": 0, 2024-09-21T05:54:11.285 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_rd": 2, 2024-09-21T05:54:11.285 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_del": 0 2024-09-21T05:54:11.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.285 INFO:teuthology.orchestra.run.smithi070.stdout: "oft": { 2024-09-21T05:54:11.285 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_objs": 0, 2024-09-21T05:54:11.285 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_kv_pairs": 0, 2024-09-21T05:54:11.285 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_updates": 0, 2024-09-21T05:54:11.285 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_removes": 0 2024-09-21T05:54:11.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.285 INFO:teuthology.orchestra.run.smithi070.stdout: "purge_queue": { 2024-09-21T05:54:11.285 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_ops": 0, 2024-09-21T05:54:11.285 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T05:54:11.286 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing": 0, 2024-09-21T05:54:11.286 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_high_water": 0, 2024-09-21T05:54:11.286 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executed_ops": 0, 2024-09-21T05:54:11.286 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executed": 0, 2024-09-21T05:54:11.286 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_item_in_journal": 0 2024-09-21T05:54:11.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.286 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T05:54:11.286 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-21T05:54:11.286 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-09-21T05:54:11.286 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-21T05:54:11.286 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 1223, 2024-09-21T05:54:11.286 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 1720397, 2024-09-21T05:54:11.286 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:11.286 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 1223, 2024-09-21T05:54:11.286 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-09-21T05:54:11.287 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-09-21T05:54:11.287 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 1223, 2024-09-21T05:54:11.287 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 1720397, 2024-09-21T05:54:11.287 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-21T05:54:11.287 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.287 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.287 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.287 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:11.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.287 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-objecter_bytes": { 2024-09-21T05:54:11.287 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-21T05:54:11.287 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-09-21T05:54:11.287 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-21T05:54:11.287 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-09-21T05:54:11.287 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-09-21T05:54:11.287 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:11.288 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-09-21T05:54:11.288 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 1079, 2024-09-21T05:54:11.288 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 628930, 2024-09-21T05:54:11.288 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 1079, 2024-09-21T05:54:11.288 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 628930, 2024-09-21T05:54:11.288 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-21T05:54:11.288 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.288 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.288 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.288 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:11.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.288 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-objecter_ops": { 2024-09-21T05:54:11.288 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-21T05:54:11.288 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 1024, 2024-09-21T05:54:11.288 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-21T05:54:11.288 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-09-21T05:54:11.289 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-09-21T05:54:11.289 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:11.289 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-09-21T05:54:11.289 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 1079, 2024-09-21T05:54:11.289 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 1079, 2024-09-21T05:54:11.289 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 1079, 2024-09-21T05:54:11.289 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 1079, 2024-09-21T05:54:11.289 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-21T05:54:11.289 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.289 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.289 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.289 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:11.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.289 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-write_buf_throttle": { 2024-09-21T05:54:11.289 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-21T05:54:11.289 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 3758096384, 2024-09-21T05:54:11.289 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-21T05:54:11.290 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-09-21T05:54:11.290 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-09-21T05:54:11.290 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:11.290 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-09-21T05:54:11.290 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-09-21T05:54:11.290 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-09-21T05:54:11.290 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 0, 2024-09-21T05:54:11.290 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 0, 2024-09-21T05:54:11.290 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-21T05:54:11.290 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.290 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.290 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.290 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:11.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.290 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-write_buf_throttle-0x55d4c8e4b380": { 2024-09-21T05:54:11.290 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-21T05:54:11.291 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 3758096384, 2024-09-21T05:54:11.291 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-21T05:54:11.291 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-09-21T05:54:11.291 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-09-21T05:54:11.291 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:11.291 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-09-21T05:54:11.291 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-09-21T05:54:11.291 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-09-21T05:54:11.291 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 0, 2024-09-21T05:54:11.291 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 0, 2024-09-21T05:54:11.291 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-21T05:54:11.291 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:11.291 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:11.291 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:11.291 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:11.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:11.292 INFO:teuthology.orchestra.run.smithi070.stdout: "trackedop": { 2024-09-21T05:54:11.292 INFO:teuthology.orchestra.run.smithi070.stdout: "slow_ops_count": 0 2024-09-21T05:54:11.292 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:11.292 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:54:11.983 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:11 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:54:11.983 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:11 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:54:11.983 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:11 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:54:12.009 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-21T05:54:12.010 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-21T05:54:12.010 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-09-21T05:54:12.010 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2024-09-21T05:54:12.010 DEBUG:tasks.check_counter:Getting stats from j 2024-09-21T05:54:12.010 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph daemon mds.j perf dump 2024-09-21T05:54:12.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:11 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:54:12.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:11 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:54:12.054 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:11 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:54:12.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:11 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:54:12.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:11 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:54:12.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:11 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' 2024-09-21T05:54:12.254 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:54:12.789 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-21T05:54:12.789 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T05:54:12.789 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 135, 2024-09-21T05:54:12.789 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 128, 2024-09-21T05:54:12.789 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 814656, 2024-09-21T05:54:12.789 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 77296, 2024-09-21T05:54:12.789 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 4, 2024-09-21T05:54:12.789 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 0, 2024-09-21T05:54:12.789 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.027064702, 2024-09-21T05:54:12.789 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.010154047, 2024-09-21T05:54:12.789 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.023391950, 2024-09-21T05:54:12.789 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T05:54:12.790 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:12.790 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 128, 2024-09-21T05:54:12.790 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.010006103, 2024-09-21T05:54:12.790 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000078172 2024-09-21T05:54:12.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:12.790 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:12.790 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:12.790 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:12.790 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:12.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:12.790 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 814656, 2024-09-21T05:54:12.790 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 77296 2024-09-21T05:54:12.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:12.790 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T05:54:12.790 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 1, 2024-09-21T05:54:12.791 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 96, 2024-09-21T05:54:12.791 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 160, 2024-09-21T05:54:12.791 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 97152, 2024-09-21T05:54:12.791 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 3, 2024-09-21T05:54:12.791 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 2, 2024-09-21T05:54:12.791 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.008798477, 2024-09-21T05:54:12.791 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.006718273, 2024-09-21T05:54:12.791 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.001221230, 2024-09-21T05:54:12.791 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T05:54:12.791 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:12.791 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 94, 2024-09-21T05:54:12.791 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.004089244, 2024-09-21T05:54:12.791 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000043502 2024-09-21T05:54:12.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:12.791 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:12.791 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:12.792 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:12.792 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:12.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:12.792 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T05:54:12.792 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 97152 2024-09-21T05:54:12.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:12.792 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T05:54:12.792 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 0, 2024-09-21T05:54:12.792 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 2, 2024-09-21T05:54:12.792 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 0, 2024-09-21T05:54:12.792 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 0, 2024-09-21T05:54:12.792 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 2, 2024-09-21T05:54:12.792 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 1, 2024-09-21T05:54:12.792 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.000397644, 2024-09-21T05:54:12.793 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T05:54:12.793 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.000331069, 2024-09-21T05:54:12.793 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T05:54:12.793 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:12.793 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:12.793 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:12.793 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:12.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:12.793 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:12.793 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:12.793 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:12.793 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:12.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:12.793 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T05:54:12.793 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T05:54:12.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:12.794 INFO:teuthology.orchestra.run.smithi070.stdout: "cct": { 2024-09-21T05:54:12.794 INFO:teuthology.orchestra.run.smithi070.stdout: "total_workers": 0, 2024-09-21T05:54:12.794 INFO:teuthology.orchestra.run.smithi070.stdout: "unhealthy_workers": 0 2024-09-21T05:54:12.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:12.794 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool": { 2024-09-21T05:54:12.794 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_bytes": 0, 2024-09-21T05:54:12.794 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_items": 0, 2024-09-21T05:54:12.794 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T05:54:12.794 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_items": 0, 2024-09-21T05:54:12.794 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T05:54:12.794 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_items": 0, 2024-09-21T05:54:12.794 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T05:54:12.794 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T05:54:12.794 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T05:54:12.795 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T05:54:12.795 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T05:54:12.795 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_items": 0, 2024-09-21T05:54:12.795 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T05:54:12.795 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T05:54:12.795 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_bytes": 0, 2024-09-21T05:54:12.795 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_items": 0, 2024-09-21T05:54:12.795 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_bytes": 0, 2024-09-21T05:54:12.795 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_items": 0, 2024-09-21T05:54:12.795 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T05:54:12.795 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T05:54:12.795 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T05:54:12.795 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T05:54:12.795 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T05:54:12.796 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_items": 0, 2024-09-21T05:54:12.796 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_bytes": 0, 2024-09-21T05:54:12.796 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_items": 0, 2024-09-21T05:54:12.796 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T05:54:12.796 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T05:54:12.796 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_bytes": 0, 2024-09-21T05:54:12.796 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_items": 0, 2024-09-21T05:54:12.796 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_bytes": 0, 2024-09-21T05:54:12.796 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_items": 0, 2024-09-21T05:54:12.796 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T05:54:12.796 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_items": 0, 2024-09-21T05:54:12.796 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T05:54:12.796 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_items": 0, 2024-09-21T05:54:12.796 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_bytes": 148863, 2024-09-21T05:54:12.796 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_items": 28, 2024-09-21T05:54:12.797 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_bytes": 0, 2024-09-21T05:54:12.797 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_items": 0, 2024-09-21T05:54:12.797 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bytes": 0, 2024-09-21T05:54:12.797 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_items": 0, 2024-09-21T05:54:12.797 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_bytes": 0, 2024-09-21T05:54:12.797 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_items": 0, 2024-09-21T05:54:12.797 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_bytes": 0, 2024-09-21T05:54:12.797 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_items": 0, 2024-09-21T05:54:12.797 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_bytes": 0, 2024-09-21T05:54:12.797 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_items": 0, 2024-09-21T05:54:12.797 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T05:54:12.797 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_items": 0, 2024-09-21T05:54:12.797 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_bytes": 0, 2024-09-21T05:54:12.797 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_items": 0, 2024-09-21T05:54:12.797 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_bytes": 968, 2024-09-21T05:54:12.798 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_items": 2, 2024-09-21T05:54:12.798 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_bytes": 0, 2024-09-21T05:54:12.798 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_items": 0, 2024-09-21T05:54:12.798 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_bytes": 0, 2024-09-21T05:54:12.798 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_items": 0 2024-09-21T05:54:12.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-21T05:54:12.798 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T05:54:12.798 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-21T05:54:12.798 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-09-21T05:54:12.798 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-21T05:54:12.798 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 132, 2024-09-21T05:54:12.798 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 793208, 2024-09-21T05:54:12.798 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:12.799 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 132, 2024-09-21T05:54:12.799 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-09-21T05:54:12.799 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-09-21T05:54:12.799 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 132, 2024-09-21T05:54:12.799 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 793208, 2024-09-21T05:54:12.799 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-21T05:54:12.799 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-21T05:54:12.799 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-21T05:54:12.799 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-21T05:54:12.799 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:12.799 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-21T05:54:12.799 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-21T05:54:13.487 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-21T05:54:13.488 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-21T05:54:13.488 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-21T05:54:13.488 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-21T05:54:13.488 DEBUG:tasks.check_counter:Getting stats from b 2024-09-21T05:54:13.488 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph daemon mds.b perf dump 2024-09-21T05:54:13.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:13 smithi070 ceph-mon[30981]: pgmap v512: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 49 KiB/s wr, 34 op/s 2024-09-21T05:54:13.747 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T05:54:13.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:13 smithi116 ceph-mon[34332]: pgmap v512: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 49 KiB/s wr, 34 op/s 2024-09-21T05:54:13.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:13 smithi160 ceph-mon[33979]: pgmap v512: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 49 KiB/s wr, 34 op/s 2024-09-21T05:54:14.407 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-21T05:54:14.407 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T05:54:14.407 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 68490, 2024-09-21T05:54:14.407 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 114163, 2024-09-21T05:54:14.407 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 22911632, 2024-09-21T05:54:14.408 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 77953671, 2024-09-21T05:54:14.408 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 19, 2024-09-21T05:54:14.408 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 5, 2024-09-21T05:54:14.408 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 5.875793468, 2024-09-21T05:54:14.408 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 3.241160754, 2024-09-21T05:54:14.408 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 2.723208632, 2024-09-21T05:54:14.408 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.241129427, 2024-09-21T05:54:14.408 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:14.408 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 114163, 2024-09-21T05:54:14.408 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 3.027961796, 2024-09-21T05:54:14.408 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000026523 2024-09-21T05:54:14.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.408 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:14.408 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 159628, 2024-09-21T05:54:14.409 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.025656523, 2024-09-21T05:54:14.409 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000160 2024-09-21T05:54:14.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.409 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 998944, 2024-09-21T05:54:14.409 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 114368 2024-09-21T05:54:14.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.409 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T05:54:14.409 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 17536, 2024-09-21T05:54:14.409 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 26281, 2024-09-21T05:54:14.409 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 4941473, 2024-09-21T05:54:14.409 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 38874054, 2024-09-21T05:54:14.409 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 12, 2024-09-21T05:54:14.409 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 7, 2024-09-21T05:54:14.409 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 1.800742737, 2024-09-21T05:54:14.409 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.885334446, 2024-09-21T05:54:14.410 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.556247140, 2024-09-21T05:54:14.410 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.305537640, 2024-09-21T05:54:14.410 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:14.410 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 26279, 2024-09-21T05:54:14.410 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 2.285716728, 2024-09-21T05:54:14.410 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000086978 2024-09-21T05:54:14.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.410 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:14.410 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 25623, 2024-09-21T05:54:14.410 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.004586409, 2024-09-21T05:54:14.410 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000178 2024-09-21T05:54:14.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.410 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T05:54:14.410 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 248992 2024-09-21T05:54:14.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.411 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T05:54:14.411 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 28779, 2024-09-21T05:54:14.411 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 44908, 2024-09-21T05:54:14.411 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 6615133, 2024-09-21T05:54:14.411 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 46793640, 2024-09-21T05:54:14.411 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 26, 2024-09-21T05:54:14.411 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 9, 2024-09-21T05:54:14.411 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 2.547232985, 2024-09-21T05:54:14.411 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 1.364051787, 2024-09-21T05:54:14.411 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.922942002, 2024-09-21T05:54:14.411 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.263218760, 2024-09-21T05:54:14.411 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:14.411 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 44906, 2024-09-21T05:54:14.411 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 1.585376649, 2024-09-21T05:54:14.412 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000035304 2024-09-21T05:54:14.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.412 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:14.412 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 57162, 2024-09-21T05:54:14.412 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.009363164, 2024-09-21T05:54:14.412 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000163 2024-09-21T05:54:14.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.412 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 29968, 2024-09-21T05:54:14.412 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 1856 2024-09-21T05:54:14.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.412 INFO:teuthology.orchestra.run.smithi116.stdout: "cct": { 2024-09-21T05:54:14.412 INFO:teuthology.orchestra.run.smithi116.stdout: "total_workers": 1, 2024-09-21T05:54:14.412 INFO:teuthology.orchestra.run.smithi116.stdout: "unhealthy_workers": 0 2024-09-21T05:54:14.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.412 INFO:teuthology.orchestra.run.smithi116.stdout: "finisher-MDSRank": { 2024-09-21T05:54:14.413 INFO:teuthology.orchestra.run.smithi116.stdout: "queue_len": 0, 2024-09-21T05:54:14.413 INFO:teuthology.orchestra.run.smithi116.stdout: "complete_latency": { 2024-09-21T05:54:14.413 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 4118, 2024-09-21T05:54:14.413 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 21.137613724, 2024-09-21T05:54:14.413 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.005132980 2024-09-21T05:54:14.413 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:14.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.413 INFO:teuthology.orchestra.run.smithi116.stdout: "finisher-PurgeQueue": { 2024-09-21T05:54:14.413 INFO:teuthology.orchestra.run.smithi116.stdout: "queue_len": 0, 2024-09-21T05:54:14.413 INFO:teuthology.orchestra.run.smithi116.stdout: "complete_latency": { 2024-09-21T05:54:14.413 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 17049, 2024-09-21T05:54:14.413 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 2.630882697, 2024-09-21T05:54:14.413 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000154313 2024-09-21T05:54:14.413 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:14.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.414 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": { 2024-09-21T05:54:14.414 INFO:teuthology.orchestra.run.smithi116.stdout: "request": 29867, 2024-09-21T05:54:14.414 INFO:teuthology.orchestra.run.smithi116.stdout: "reply": 28393, 2024-09-21T05:54:14.414 INFO:teuthology.orchestra.run.smithi116.stdout: "reply_latency": { 2024-09-21T05:54:14.414 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 28393, 2024-09-21T05:54:14.414 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 128.580473358, 2024-09-21T05:54:14.414 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.004528597 2024-09-21T05:54:14.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.414 INFO:teuthology.orchestra.run.smithi116.stdout: "slow_reply": 0, 2024-09-21T05:54:14.414 INFO:teuthology.orchestra.run.smithi116.stdout: "forward": 1474, 2024-09-21T05:54:14.414 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_fetch_complete": 0, 2024-09-21T05:54:14.414 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_fetch_keys": 0, 2024-09-21T05:54:14.414 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_commit": 113, 2024-09-21T05:54:14.415 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_split": 11, 2024-09-21T05:54:14.415 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_merge": 2, 2024-09-21T05:54:14.415 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes": 179, 2024-09-21T05:54:14.415 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_top": 80, 2024-09-21T05:54:14.415 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_bottom": 61, 2024-09-21T05:54:14.415 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_pin_tail": 38, 2024-09-21T05:54:14.415 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_pinned": 64, 2024-09-21T05:54:14.415 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_expired": 2081, 2024-09-21T05:54:14.415 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_with_caps": 2, 2024-09-21T05:54:14.415 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": 2, 2024-09-21T05:54:14.415 INFO:teuthology.orchestra.run.smithi116.stdout: "subtrees": 6, 2024-09-21T05:54:14.415 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse": 38494, 2024-09-21T05:54:14.415 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_hit": 34062, 2024-09-21T05:54:14.415 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_forward": 1405, 2024-09-21T05:54:14.415 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_discover": 92, 2024-09-21T05:54:14.416 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_dir_fetch": 0, 2024-09-21T05:54:14.416 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_remote_ino": 0, 2024-09-21T05:54:14.416 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_lock": 0, 2024-09-21T05:54:14.416 INFO:teuthology.orchestra.run.smithi116.stdout: "load_cent": 0, 2024-09-21T05:54:14.416 INFO:teuthology.orchestra.run.smithi116.stdout: "q": 0, 2024-09-21T05:54:14.416 INFO:teuthology.orchestra.run.smithi116.stdout: "exported": 81, 2024-09-21T05:54:14.416 INFO:teuthology.orchestra.run.smithi116.stdout: "exported_inodes": 1794, 2024-09-21T05:54:14.416 INFO:teuthology.orchestra.run.smithi116.stdout: "imported": 30, 2024-09-21T05:54:14.416 INFO:teuthology.orchestra.run.smithi116.stdout: "imported_inodes": 9, 2024-09-21T05:54:14.416 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_dir_fetch": 0, 2024-09-21T05:54:14.416 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_backtrace_fetch": 0, 2024-09-21T05:54:14.416 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_peer_discover": 0, 2024-09-21T05:54:14.416 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rfiles": 4, 2024-09-21T05:54:14.416 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rbytes": 234, 2024-09-21T05:54:14.416 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rsnaps": 0, 2024-09-21T05:54:14.417 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T05:54:14.417 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_set_tag": 0, 2024-09-21T05:54:14.417 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T05:54:14.417 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_inotable_repaired": 0, 2024-09-21T05:54:14.417 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dir_inodes": 0, 2024-09-21T05:54:14.417 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T05:54:14.417 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T05:54:14.417 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_file_inodes": 0, 2024-09-21T05:54:14.417 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_inode_file_caps": 0, 2024-09-21T05:54:14.417 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_revoke": 7326, 2024-09-21T05:54:14.417 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_grant": 20956, 2024-09-21T05:54:14.417 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T05:54:14.417 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T05:54:14.417 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T05:54:14.418 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_caps": 23162, 2024-09-21T05:54:14.418 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_caps_dirty": 9873, 2024-09-21T05:54:14.418 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_cap_release": 167, 2024-09-21T05:54:14.418 INFO:teuthology.orchestra.run.smithi116.stdout: "process_request_cap_release": 30148 2024-09-21T05:54:14.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.418 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_cache": { 2024-09-21T05:54:14.418 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_update": 2013, 2024-09-21T05:54:14.418 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_update_receipt": 292, 2024-09-21T05:54:14.418 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_try_discover": 192, 2024-09-21T05:54:14.418 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_send_discover": 208, 2024-09-21T05:54:14.418 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_handle_discover": 4147, 2024-09-21T05:54:14.418 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays": 41, 2024-09-21T05:54:14.418 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays_delayed": 0, 2024-09-21T05:54:14.418 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays_enqueuing": 0, 2024-09-21T05:54:14.419 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_created": 9429, 2024-09-21T05:54:14.419 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_enqueued": 9388, 2024-09-21T05:54:14.419 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_reintegrated": 0, 2024-09-21T05:54:14.419 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_migrated": 0, 2024-09-21T05:54:14.419 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_processing": 0, 2024-09-21T05:54:14.419 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_enqueued": 0, 2024-09-21T05:54:14.419 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_prioritized": 0, 2024-09-21T05:54:14.419 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_started": 0, 2024-09-21T05:54:14.419 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_completed": 0, 2024-09-21T05:54:14.419 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_quiesce_path": 4, 2024-09-21T05:54:14.419 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_quiesce_inode": 8282, 2024-09-21T05:54:14.419 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T05:54:14.419 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_exportdir": 81, 2024-09-21T05:54:14.419 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_flush": 0, 2024-09-21T05:54:14.419 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_fragmentdir": 15, 2024-09-21T05:54:14.420 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_fragstats": 0, 2024-09-21T05:54:14.420 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_inodestats": 0, 2024-09-21T05:54:14.420 INFO:teuthology.orchestra.run.smithi116.stdout: "uninline_started": 0, 2024-09-21T05:54:14.420 INFO:teuthology.orchestra.run.smithi116.stdout: "uninline_succeeded": 0, 2024-09-21T05:54:14.420 INFO:teuthology.orchestra.run.smithi116.stdout: "uninline_write_failed": 0 2024-09-21T05:54:14.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.420 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_log": { 2024-09-21T05:54:14.420 INFO:teuthology.orchestra.run.smithi116.stdout: "evlrg": 0, 2024-09-21T05:54:14.420 INFO:teuthology.orchestra.run.smithi116.stdout: "evadd": 44526, 2024-09-21T05:54:14.420 INFO:teuthology.orchestra.run.smithi116.stdout: "evex": 0, 2024-09-21T05:54:14.420 INFO:teuthology.orchestra.run.smithi116.stdout: "evtrm": 0, 2024-09-21T05:54:14.420 INFO:teuthology.orchestra.run.smithi116.stdout: "ev": 44526, 2024-09-21T05:54:14.420 INFO:teuthology.orchestra.run.smithi116.stdout: "evexg": 0, 2024-09-21T05:54:14.420 INFO:teuthology.orchestra.run.smithi116.stdout: "evexd": 0, 2024-09-21T05:54:14.421 INFO:teuthology.orchestra.run.smithi116.stdout: "segadd": 62, 2024-09-21T05:54:14.421 INFO:teuthology.orchestra.run.smithi116.stdout: "segex": 0, 2024-09-21T05:54:14.421 INFO:teuthology.orchestra.run.smithi116.stdout: "segtrm": 0, 2024-09-21T05:54:14.421 INFO:teuthology.orchestra.run.smithi116.stdout: "seg": 62, 2024-09-21T05:54:14.421 INFO:teuthology.orchestra.run.smithi116.stdout: "segmjr": 5, 2024-09-21T05:54:14.421 INFO:teuthology.orchestra.run.smithi116.stdout: "segexg": 0, 2024-09-21T05:54:14.421 INFO:teuthology.orchestra.run.smithi116.stdout: "segexd": 0, 2024-09-21T05:54:14.421 INFO:teuthology.orchestra.run.smithi116.stdout: "expos": 4194304, 2024-09-21T05:54:14.421 INFO:teuthology.orchestra.run.smithi116.stdout: "wrpos": 89732508, 2024-09-21T05:54:14.421 INFO:teuthology.orchestra.run.smithi116.stdout: "rdpos": 0, 2024-09-21T05:54:14.421 INFO:teuthology.orchestra.run.smithi116.stdout: "jlat": { 2024-09-21T05:54:14.421 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 3034, 2024-09-21T05:54:14.421 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 90.054259386, 2024-09-21T05:54:14.421 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.029681693 2024-09-21T05:54:14.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.422 INFO:teuthology.orchestra.run.smithi116.stdout: "replayed": 0 2024-09-21T05:54:14.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.422 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_mem": { 2024-09-21T05:54:14.422 INFO:teuthology.orchestra.run.smithi116.stdout: "ino": 77, 2024-09-21T05:54:14.422 INFO:teuthology.orchestra.run.smithi116.stdout: "ino+": 11352, 2024-09-21T05:54:14.422 INFO:teuthology.orchestra.run.smithi116.stdout: "ino-": 11275, 2024-09-21T05:54:14.422 INFO:teuthology.orchestra.run.smithi116.stdout: "dir": 90, 2024-09-21T05:54:14.422 INFO:teuthology.orchestra.run.smithi116.stdout: "dir+": 811, 2024-09-21T05:54:14.422 INFO:teuthology.orchestra.run.smithi116.stdout: "dir-": 721, 2024-09-21T05:54:14.422 INFO:teuthology.orchestra.run.smithi116.stdout: "dn": 179, 2024-09-21T05:54:14.422 INFO:teuthology.orchestra.run.smithi116.stdout: "dn+": 17353, 2024-09-21T05:54:14.422 INFO:teuthology.orchestra.run.smithi116.stdout: "dn-": 17174, 2024-09-21T05:54:14.422 INFO:teuthology.orchestra.run.smithi116.stdout: "cap": 2, 2024-09-21T05:54:14.423 INFO:teuthology.orchestra.run.smithi116.stdout: "cap+": 11358, 2024-09-21T05:54:14.423 INFO:teuthology.orchestra.run.smithi116.stdout: "cap-": 11356, 2024-09-21T05:54:14.423 INFO:teuthology.orchestra.run.smithi116.stdout: "rss": 163472, 2024-09-21T05:54:14.423 INFO:teuthology.orchestra.run.smithi116.stdout: "heap": 404635648 2024-09-21T05:54:14.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.423 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_server": { 2024-09-21T05:54:14.423 INFO:teuthology.orchestra.run.smithi116.stdout: "dispatch_client_request": 35320, 2024-09-21T05:54:14.423 INFO:teuthology.orchestra.run.smithi116.stdout: "dispatch_server_request": 385, 2024-09-21T05:54:14.423 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_request": 29867, 2024-09-21T05:54:14.423 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_session": 99, 2024-09-21T05:54:14.423 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_peer_request": 1173, 2024-09-21T05:54:14.423 INFO:teuthology.orchestra.run.smithi116.stdout: "req_create_latency": { 2024-09-21T05:54:14.423 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 10646, 2024-09-21T05:54:14.423 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 67.270006859, 2024-09-21T05:54:14.424 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.006318805 2024-09-21T05:54:14.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.424 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getattr_latency": { 2024-09-21T05:54:14.424 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 46, 2024-09-21T05:54:14.424 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.022258251, 2024-09-21T05:54:14.424 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000483875 2024-09-21T05:54:14.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.424 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getfilelock_latency": { 2024-09-21T05:54:14.424 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:14.424 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:14.424 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:14.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.424 INFO:teuthology.orchestra.run.smithi116.stdout: "req_link_latency": { 2024-09-21T05:54:14.425 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:14.425 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:14.425 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:14.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.425 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookup_latency": { 2024-09-21T05:54:14.425 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 6744, 2024-09-21T05:54:14.425 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 10.357952265, 2024-09-21T05:54:14.425 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.001535876 2024-09-21T05:54:14.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.425 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookuphash_latency": { 2024-09-21T05:54:14.425 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:14.425 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:14.425 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:14.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.426 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupino_latency": { 2024-09-21T05:54:14.426 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:14.426 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:14.426 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:14.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.426 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupname_latency": { 2024-09-21T05:54:14.426 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:14.426 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:14.426 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:14.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.426 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupparent_latency": { 2024-09-21T05:54:14.426 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:14.427 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:14.427 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:14.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.427 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupsnap_latency": { 2024-09-21T05:54:14.427 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:14.427 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:14.427 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:14.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.428 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lssnap_latency": { 2024-09-21T05:54:14.428 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:14.428 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:14.428 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:14.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.428 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mkdir_latency": { 2024-09-21T05:54:14.428 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 587, 2024-09-21T05:54:14.428 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.640251223, 2024-09-21T05:54:14.428 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.001090717 2024-09-21T05:54:14.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.428 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mknod_latency": { 2024-09-21T05:54:14.428 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:14.428 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:14.428 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:14.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.429 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mksnap_latency": { 2024-09-21T05:54:14.429 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:14.429 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:14.429 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:14.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.429 INFO:teuthology.orchestra.run.smithi116.stdout: "req_open_latency": { 2024-09-21T05:54:14.429 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:14.429 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:14.429 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:14.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.429 INFO:teuthology.orchestra.run.smithi116.stdout: "req_readdir_latency": { 2024-09-21T05:54:14.429 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 899, 2024-09-21T05:54:14.429 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 1.131822994, 2024-09-21T05:54:14.429 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.001258979 2024-09-21T05:54:14.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.430 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rename_latency": { 2024-09-21T05:54:14.430 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 2, 2024-09-21T05:54:14.430 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.002254448, 2024-09-21T05:54:14.430 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.001127224 2024-09-21T05:54:14.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.430 INFO:teuthology.orchestra.run.smithi116.stdout: "req_renamesnap_latency": { 2024-09-21T05:54:14.430 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:14.430 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:14.430 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:14.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.430 INFO:teuthology.orchestra.run.smithi116.stdout: "req_snapdiff_latency": { 2024-09-21T05:54:14.430 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:14.430 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:14.430 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:14.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.431 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmdir_latency": { 2024-09-21T05:54:14.431 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 472, 2024-09-21T05:54:14.431 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 7.921533859, 2024-09-21T05:54:14.431 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.016782910 2024-09-21T05:54:14.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.431 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmsnap_latency": { 2024-09-21T05:54:14.431 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:14.431 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:14.431 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:14.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.431 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmxattr_latency": { 2024-09-21T05:54:14.431 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:14.431 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:14.431 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:14.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.432 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setattr_latency": { 2024-09-21T05:54:14.432 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 29, 2024-09-21T05:54:14.432 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.078342304, 2024-09-21T05:54:14.432 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.002701458 2024-09-21T05:54:14.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.432 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setdirlayout_latency": { 2024-09-21T05:54:14.432 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:14.432 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:14.432 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:14.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.432 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setfilelock_latency": { 2024-09-21T05:54:14.432 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:14.432 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:14.432 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:14.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.433 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setlayout_latency": { 2024-09-21T05:54:14.433 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:14.433 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:14.433 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:14.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.433 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setxattr_latency": { 2024-09-21T05:54:14.433 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 11, 2024-09-21T05:54:14.433 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.026053827, 2024-09-21T05:54:14.433 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.002368529 2024-09-21T05:54:14.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.433 INFO:teuthology.orchestra.run.smithi116.stdout: "req_symlink_latency": { 2024-09-21T05:54:14.433 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:14.433 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:14.433 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:14.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.434 INFO:teuthology.orchestra.run.smithi116.stdout: "req_unlink_latency": { 2024-09-21T05:54:14.434 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 8957, 2024-09-21T05:54:14.434 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 41.129997328, 2024-09-21T05:54:14.434 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.004591938 2024-09-21T05:54:14.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.434 INFO:teuthology.orchestra.run.smithi116.stdout: "cap_revoke_eviction": 0, 2024-09-21T05:54:14.434 INFO:teuthology.orchestra.run.smithi116.stdout: "cap_acquisition_throttle": 0, 2024-09-21T05:54:14.434 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getvxattr_latency": { 2024-09-21T05:54:14.434 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:14.434 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:14.434 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:14.434 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:14.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.435 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_sessions": { 2024-09-21T05:54:14.435 INFO:teuthology.orchestra.run.smithi116.stdout: "session_count": 1, 2024-09-21T05:54:14.435 INFO:teuthology.orchestra.run.smithi116.stdout: "session_add": 4, 2024-09-21T05:54:14.435 INFO:teuthology.orchestra.run.smithi116.stdout: "session_remove": 3, 2024-09-21T05:54:14.435 INFO:teuthology.orchestra.run.smithi116.stdout: "sessions_open": 1, 2024-09-21T05:54:14.435 INFO:teuthology.orchestra.run.smithi116.stdout: "sessions_stale": 0, 2024-09-21T05:54:14.435 INFO:teuthology.orchestra.run.smithi116.stdout: "total_load": 13821, 2024-09-21T05:54:14.435 INFO:teuthology.orchestra.run.smithi116.stdout: "average_load": 13821, 2024-09-21T05:54:14.435 INFO:teuthology.orchestra.run.smithi116.stdout: "avg_session_uptime": 277, 2024-09-21T05:54:14.435 INFO:teuthology.orchestra.run.smithi116.stdout: "mdthresh_evicted": 0 2024-09-21T05:54:14.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.435 INFO:teuthology.orchestra.run.smithi116.stdout: "mempool": { 2024-09-21T05:54:14.435 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_bytes": 0, 2024-09-21T05:54:14.435 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_items": 0, 2024-09-21T05:54:14.435 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T05:54:14.436 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_items": 0, 2024-09-21T05:54:14.436 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T05:54:14.436 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_items": 0, 2024-09-21T05:54:14.436 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T05:54:14.436 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T05:54:14.436 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T05:54:14.436 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T05:54:14.436 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T05:54:14.436 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_items": 0, 2024-09-21T05:54:14.436 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T05:54:14.436 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T05:54:14.436 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_bytes": 0, 2024-09-21T05:54:14.436 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_items": 0, 2024-09-21T05:54:14.436 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_bytes": 0, 2024-09-21T05:54:14.437 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_items": 0, 2024-09-21T05:54:14.437 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T05:54:14.437 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T05:54:14.437 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T05:54:14.437 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T05:54:14.437 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T05:54:14.437 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_items": 0, 2024-09-21T05:54:14.437 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_bytes": 0, 2024-09-21T05:54:14.437 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_items": 0, 2024-09-21T05:54:14.437 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T05:54:14.437 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T05:54:14.437 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_bytes": 0, 2024-09-21T05:54:14.437 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_items": 0, 2024-09-21T05:54:14.437 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_bytes": 0, 2024-09-21T05:54:14.437 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_items": 0, 2024-09-21T05:54:14.438 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T05:54:14.438 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_items": 0, 2024-09-21T05:54:14.438 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T05:54:14.438 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_items": 0, 2024-09-21T05:54:14.438 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_bytes": 310823, 2024-09-21T05:54:14.438 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_items": 111, 2024-09-21T05:54:14.438 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_bytes": 0, 2024-09-21T05:54:14.438 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_items": 0, 2024-09-21T05:54:14.438 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_bytes": 0, 2024-09-21T05:54:14.438 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_items": 0, 2024-09-21T05:54:14.438 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_bytes": 0, 2024-09-21T05:54:14.438 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_items": 0, 2024-09-21T05:54:14.438 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_bytes": 0, 2024-09-21T05:54:14.438 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_items": 0, 2024-09-21T05:54:14.438 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_bytes": 9144, 2024-09-21T05:54:14.439 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_items": 172, 2024-09-21T05:54:14.439 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T05:54:14.439 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_items": 0, 2024-09-21T05:54:14.439 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_bytes": 0, 2024-09-21T05:54:14.439 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_items": 0, 2024-09-21T05:54:14.439 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_bytes": 439710, 2024-09-21T05:54:14.439 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_items": 8077, 2024-09-21T05:54:14.439 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_bytes": 0, 2024-09-21T05:54:14.439 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_items": 0, 2024-09-21T05:54:14.439 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_bytes": 0, 2024-09-21T05:54:14.439 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_items": 0 2024-09-21T05:54:14.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.439 INFO:teuthology.orchestra.run.smithi116.stdout: "objecter": { 2024-09-21T05:54:14.440 INFO:teuthology.orchestra.run.smithi116.stdout: "op_active": 0, 2024-09-21T05:54:14.440 INFO:teuthology.orchestra.run.smithi116.stdout: "op_laggy": 0, 2024-09-21T05:54:14.440 INFO:teuthology.orchestra.run.smithi116.stdout: "op_send": 22792, 2024-09-21T05:54:14.440 INFO:teuthology.orchestra.run.smithi116.stdout: "op_send_bytes": 89245536, 2024-09-21T05:54:14.440 INFO:teuthology.orchestra.run.smithi116.stdout: "op_resend": 37, 2024-09-21T05:54:14.440 INFO:teuthology.orchestra.run.smithi116.stdout: "op_reply": 22792, 2024-09-21T05:54:14.440 INFO:teuthology.orchestra.run.smithi116.stdout: "op_latency": { 2024-09-21T05:54:14.440 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 22792, 2024-09-21T05:54:14.440 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 88.977418902, 2024-09-21T05:54:14.440 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.003903888 2024-09-21T05:54:14.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.440 INFO:teuthology.orchestra.run.smithi116.stdout: "op_inflight": 0, 2024-09-21T05:54:14.440 INFO:teuthology.orchestra.run.smithi116.stdout: "oplen_avg": { 2024-09-21T05:54:14.440 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 22792, 2024-09-21T05:54:14.440 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 23129 2024-09-21T05:54:14.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.441 INFO:teuthology.orchestra.run.smithi116.stdout: "op": 22792, 2024-09-21T05:54:14.441 INFO:teuthology.orchestra.run.smithi116.stdout: "op_r": 200, 2024-09-21T05:54:14.441 INFO:teuthology.orchestra.run.smithi116.stdout: "op_w": 22592, 2024-09-21T05:54:14.441 INFO:teuthology.orchestra.run.smithi116.stdout: "op_rmw": 0, 2024-09-21T05:54:14.441 INFO:teuthology.orchestra.run.smithi116.stdout: "op_pg": 0, 2024-09-21T05:54:14.441 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_stat": 0, 2024-09-21T05:54:14.441 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_create": 11, 2024-09-21T05:54:14.441 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_read": 200, 2024-09-21T05:54:14.441 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_write": 3234, 2024-09-21T05:54:14.441 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_writefull": 119, 2024-09-21T05:54:14.441 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_writesame": 0, 2024-09-21T05:54:14.441 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_append": 0, 2024-09-21T05:54:14.441 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_zero": 0, 2024-09-21T05:54:14.441 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_truncate": 11, 2024-09-21T05:54:14.442 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_delete": 18962, 2024-09-21T05:54:14.442 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_mapext": 0, 2024-09-21T05:54:14.442 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_sparse_read": 0, 2024-09-21T05:54:14.442 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_clonerange": 0, 2024-09-21T05:54:14.442 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_getxattr": 0, 2024-09-21T05:54:14.442 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_setxattr": 22, 2024-09-21T05:54:14.442 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_cmpxattr": 0, 2024-09-21T05:54:14.442 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_rmxattr": 0, 2024-09-21T05:54:14.442 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_resetxattrs": 0, 2024-09-21T05:54:14.442 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_call": 0, 2024-09-21T05:54:14.442 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_watch": 0, 2024-09-21T05:54:14.442 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_notify": 0, 2024-09-21T05:54:14.442 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T05:54:14.442 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_pgls": 0, 2024-09-21T05:54:14.443 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_pgls_filter": 0, 2024-09-21T05:54:14.443 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_other": 0, 2024-09-21T05:54:14.443 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_active": 0, 2024-09-21T05:54:14.443 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_send": 0, 2024-09-21T05:54:14.443 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_resend": 0, 2024-09-21T05:54:14.443 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_ping": 0, 2024-09-21T05:54:14.443 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_active": 0, 2024-09-21T05:54:14.443 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_send": 0, 2024-09-21T05:54:14.443 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_resend": 0, 2024-09-21T05:54:14.443 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_active": 0, 2024-09-21T05:54:14.443 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_send": 0, 2024-09-21T05:54:14.443 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_resend": 0, 2024-09-21T05:54:14.443 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_active": 0, 2024-09-21T05:54:14.443 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_send": 0, 2024-09-21T05:54:14.444 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_resend": 0, 2024-09-21T05:54:14.444 INFO:teuthology.orchestra.run.smithi116.stdout: "command_active": 0, 2024-09-21T05:54:14.444 INFO:teuthology.orchestra.run.smithi116.stdout: "command_send": 0, 2024-09-21T05:54:14.444 INFO:teuthology.orchestra.run.smithi116.stdout: "command_resend": 0, 2024-09-21T05:54:14.444 INFO:teuthology.orchestra.run.smithi116.stdout: "map_epoch": 85, 2024-09-21T05:54:14.444 INFO:teuthology.orchestra.run.smithi116.stdout: "map_full": 0, 2024-09-21T05:54:14.444 INFO:teuthology.orchestra.run.smithi116.stdout: "map_inc": 10, 2024-09-21T05:54:14.444 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_sessions": 12, 2024-09-21T05:54:14.444 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_session_open": 12, 2024-09-21T05:54:14.444 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_session_close": 0, 2024-09-21T05:54:14.444 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_laggy": 0, 2024-09-21T05:54:14.444 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_wr": 461, 2024-09-21T05:54:14.444 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_rd": 0, 2024-09-21T05:54:14.444 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_del": 109 2024-09-21T05:54:14.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.445 INFO:teuthology.orchestra.run.smithi116.stdout: "oft": { 2024-09-21T05:54:14.445 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_objs": 1, 2024-09-21T05:54:14.445 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_kv_pairs": 0, 2024-09-21T05:54:14.445 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_updates": 0, 2024-09-21T05:54:14.445 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_removes": 0 2024-09-21T05:54:14.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.445 INFO:teuthology.orchestra.run.smithi116.stdout: "purge_queue": { 2024-09-21T05:54:14.445 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_ops": 0, 2024-09-21T05:54:14.445 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_ops_high_water": 21, 2024-09-21T05:54:14.445 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing": 0, 2024-09-21T05:54:14.445 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_high_water": 9, 2024-09-21T05:54:14.445 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executed_ops": 18422, 2024-09-21T05:54:14.445 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executed": 9388, 2024-09-21T05:54:14.445 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_item_in_journal": 0 2024-09-21T05:54:14.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.446 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T05:54:14.446 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-21T05:54:14.446 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2024-09-21T05:54:14.446 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-21T05:54:14.446 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 114801, 2024-09-21T05:54:14.446 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 24114384, 2024-09-21T05:54:14.446 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:14.446 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 114801, 2024-09-21T05:54:14.446 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-09-21T05:54:14.446 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-09-21T05:54:14.446 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 114801, 2024-09-21T05:54:14.446 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 24114384, 2024-09-21T05:54:14.446 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-21T05:54:14.447 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:14.447 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:14.447 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:14.447 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:14.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.447 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-objecter_bytes": { 2024-09-21T05:54:14.447 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-21T05:54:14.447 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2024-09-21T05:54:14.447 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-21T05:54:14.447 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-09-21T05:54:14.447 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-09-21T05:54:14.447 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:14.447 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-09-21T05:54:14.447 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 22792, 2024-09-21T05:54:14.447 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 90265444, 2024-09-21T05:54:14.447 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 22792, 2024-09-21T05:54:14.448 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 90265444, 2024-09-21T05:54:14.448 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-21T05:54:14.448 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:14.448 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:14.448 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:14.448 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:14.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.448 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-objecter_ops": { 2024-09-21T05:54:14.448 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-21T05:54:14.448 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 1024, 2024-09-21T05:54:14.448 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-21T05:54:14.448 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-09-21T05:54:14.448 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-09-21T05:54:14.448 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:14.449 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-09-21T05:54:14.449 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 22792, 2024-09-21T05:54:14.449 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 22792, 2024-09-21T05:54:14.449 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 22792, 2024-09-21T05:54:14.449 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 22792, 2024-09-21T05:54:14.449 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-21T05:54:14.449 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:14.449 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:14.449 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:14.449 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:14.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.449 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-write_buf_throttle": { 2024-09-21T05:54:14.449 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-21T05:54:14.449 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 3758096384, 2024-09-21T05:54:14.449 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-21T05:54:14.450 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 9388, 2024-09-21T05:54:14.450 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 1019908, 2024-09-21T05:54:14.450 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:14.450 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 9388, 2024-09-21T05:54:14.450 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-09-21T05:54:14.450 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-09-21T05:54:14.450 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 200, 2024-09-21T05:54:14.450 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 1019908, 2024-09-21T05:54:14.450 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-21T05:54:14.450 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:14.450 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:14.450 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:14.450 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:14.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.450 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-write_buf_throttle-0x55c839635380": { 2024-09-21T05:54:14.451 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-21T05:54:14.451 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 3758096384, 2024-09-21T05:54:14.451 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-21T05:54:14.451 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 44526, 2024-09-21T05:54:14.451 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 85538204, 2024-09-21T05:54:14.451 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:14.451 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 44526, 2024-09-21T05:54:14.451 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-09-21T05:54:14.451 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-09-21T05:54:14.451 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 3034, 2024-09-21T05:54:14.451 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 85538204, 2024-09-21T05:54:14.451 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-21T05:54:14.451 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:14.451 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:14.451 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:14.452 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:14.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:14.452 INFO:teuthology.orchestra.run.smithi116.stdout: "trackedop": { 2024-09-21T05:54:14.452 INFO:teuthology.orchestra.run.smithi116.stdout: "slow_ops_count": 8289 2024-09-21T05:54:14.452 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:14.452 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-21T05:54:15.337 INFO:tasks.check_counter:Daemon mds.b mds.exported=81 2024-09-21T05:54:15.337 INFO:tasks.check_counter:Daemon mds.b mds.imported=30 2024-09-21T05:54:15.337 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=2013 2024-09-21T05:54:15.337 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=292 2024-09-21T05:54:15.338 DEBUG:tasks.check_counter:Getting stats from e 2024-09-21T05:54:15.338 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph daemon mds.e perf dump 2024-09-21T05:54:15.588 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T05:54:15.709 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:15 smithi116 ceph-mon[34332]: pgmap v513: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.8 KiB/s wr, 15 op/s 2024-09-21T05:54:15.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:15 smithi070 ceph-mon[30981]: pgmap v513: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.8 KiB/s wr, 15 op/s 2024-09-21T05:54:15.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:15 smithi160 ceph-mon[33979]: pgmap v513: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.8 KiB/s wr, 15 op/s 2024-09-21T05:54:16.182 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-21T05:54:16.182 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T05:54:16.182 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 940, 2024-09-21T05:54:16.183 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 924, 2024-09-21T05:54:16.183 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 26305521, 2024-09-21T05:54:16.183 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 329094, 2024-09-21T05:54:16.183 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 7, 2024-09-21T05:54:16.183 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 3, 2024-09-21T05:54:16.183 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.121221934, 2024-09-21T05:54:16.183 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.051314884, 2024-09-21T05:54:16.183 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.052133584, 2024-09-21T05:54:16.183 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.019753508, 2024-09-21T05:54:16.183 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:16.183 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 923, 2024-09-21T05:54:16.183 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.038532986, 2024-09-21T05:54:16.183 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000041747 2024-09-21T05:54:16.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.184 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:16.184 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.184 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.184 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.184 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 903696, 2024-09-21T05:54:16.184 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 77552 2024-09-21T05:54:16.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.184 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T05:54:16.184 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 146, 2024-09-21T05:54:16.184 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 238, 2024-09-21T05:54:16.184 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 26859629, 2024-09-21T05:54:16.185 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 278856, 2024-09-21T05:54:16.185 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 6, 2024-09-21T05:54:16.185 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 5, 2024-09-21T05:54:16.185 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.037235047, 2024-09-21T05:54:16.185 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.009793774, 2024-09-21T05:54:16.185 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.022554273, 2024-09-21T05:54:16.185 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.003121781, 2024-09-21T05:54:16.185 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:16.185 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 237, 2024-09-21T05:54:16.185 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.018151798, 2024-09-21T05:54:16.185 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000076589 2024-09-21T05:54:16.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.185 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:16.185 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.185 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.186 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.186 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T05:54:16.186 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 233952 2024-09-21T05:54:16.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.186 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T05:54:16.186 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 422, 2024-09-21T05:54:16.186 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 423, 2024-09-21T05:54:16.186 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 33661677, 2024-09-21T05:54:16.186 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 133885, 2024-09-21T05:54:16.186 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 6, 2024-09-21T05:54:16.186 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 5, 2024-09-21T05:54:16.186 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.062041798, 2024-09-21T05:54:16.186 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.016601132, 2024-09-21T05:54:16.187 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.029811158, 2024-09-21T05:54:16.187 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.012352595, 2024-09-21T05:54:16.187 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:16.187 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 421, 2024-09-21T05:54:16.187 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.016595701, 2024-09-21T05:54:16.187 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000039419 2024-09-21T05:54:16.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.187 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:16.187 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.187 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.187 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.187 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T05:54:16.187 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T05:54:16.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.188 INFO:teuthology.orchestra.run.smithi116.stdout: "cct": { 2024-09-21T05:54:16.188 INFO:teuthology.orchestra.run.smithi116.stdout: "total_workers": 1, 2024-09-21T05:54:16.188 INFO:teuthology.orchestra.run.smithi116.stdout: "unhealthy_workers": 0 2024-09-21T05:54:16.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.188 INFO:teuthology.orchestra.run.smithi116.stdout: "finisher-MDSRank": { 2024-09-21T05:54:16.188 INFO:teuthology.orchestra.run.smithi116.stdout: "queue_len": 0, 2024-09-21T05:54:16.188 INFO:teuthology.orchestra.run.smithi116.stdout: "complete_latency": { 2024-09-21T05:54:16.188 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 2234, 2024-09-21T05:54:16.188 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.053780143, 2024-09-21T05:54:16.188 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000024073 2024-09-21T05:54:16.188 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:16.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.188 INFO:teuthology.orchestra.run.smithi116.stdout: "finisher-PurgeQueue": { 2024-09-21T05:54:16.188 INFO:teuthology.orchestra.run.smithi116.stdout: "queue_len": 0, 2024-09-21T05:54:16.188 INFO:teuthology.orchestra.run.smithi116.stdout: "complete_latency": { 2024-09-21T05:54:16.188 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.189 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.189 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.189 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:16.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.189 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": { 2024-09-21T05:54:16.189 INFO:teuthology.orchestra.run.smithi116.stdout: "request": 0, 2024-09-21T05:54:16.189 INFO:teuthology.orchestra.run.smithi116.stdout: "reply": 0, 2024-09-21T05:54:16.189 INFO:teuthology.orchestra.run.smithi116.stdout: "reply_latency": { 2024-09-21T05:54:16.189 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.189 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.189 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.189 INFO:teuthology.orchestra.run.smithi116.stdout: "slow_reply": 0, 2024-09-21T05:54:16.189 INFO:teuthology.orchestra.run.smithi116.stdout: "forward": 0, 2024-09-21T05:54:16.190 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_fetch_complete": 0, 2024-09-21T05:54:16.190 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_fetch_keys": 0, 2024-09-21T05:54:16.190 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_commit": 0, 2024-09-21T05:54:16.190 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_split": 0, 2024-09-21T05:54:16.190 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_merge": 0, 2024-09-21T05:54:16.190 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes": 10690, 2024-09-21T05:54:16.190 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_top": 0, 2024-09-21T05:54:16.190 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_bottom": 10690, 2024-09-21T05:54:16.190 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_pin_tail": 0, 2024-09-21T05:54:16.190 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_pinned": 10690, 2024-09-21T05:54:16.190 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_expired": 0, 2024-09-21T05:54:16.190 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_with_caps": 0, 2024-09-21T05:54:16.190 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": 0, 2024-09-21T05:54:16.190 INFO:teuthology.orchestra.run.smithi116.stdout: "subtrees": 2, 2024-09-21T05:54:16.191 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse": 0, 2024-09-21T05:54:16.191 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_hit": 0, 2024-09-21T05:54:16.191 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_forward": 0, 2024-09-21T05:54:16.191 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_discover": 0, 2024-09-21T05:54:16.191 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_dir_fetch": 0, 2024-09-21T05:54:16.191 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_remote_ino": 0, 2024-09-21T05:54:16.191 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_lock": 0, 2024-09-21T05:54:16.191 INFO:teuthology.orchestra.run.smithi116.stdout: "load_cent": 0, 2024-09-21T05:54:16.191 INFO:teuthology.orchestra.run.smithi116.stdout: "q": 0, 2024-09-21T05:54:16.191 INFO:teuthology.orchestra.run.smithi116.stdout: "exported": 0, 2024-09-21T05:54:16.191 INFO:teuthology.orchestra.run.smithi116.stdout: "exported_inodes": 0, 2024-09-21T05:54:16.191 INFO:teuthology.orchestra.run.smithi116.stdout: "imported": 0, 2024-09-21T05:54:16.191 INFO:teuthology.orchestra.run.smithi116.stdout: "imported_inodes": 0, 2024-09-21T05:54:16.191 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_dir_fetch": 0, 2024-09-21T05:54:16.192 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_backtrace_fetch": 0, 2024-09-21T05:54:16.192 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_peer_discover": 0, 2024-09-21T05:54:16.192 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rfiles": 4, 2024-09-21T05:54:16.192 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rbytes": 234, 2024-09-21T05:54:16.192 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rsnaps": 0, 2024-09-21T05:54:16.192 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T05:54:16.192 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_set_tag": 0, 2024-09-21T05:54:16.192 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T05:54:16.192 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_inotable_repaired": 0, 2024-09-21T05:54:16.192 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dir_inodes": 0, 2024-09-21T05:54:16.192 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T05:54:16.192 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T05:54:16.192 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_file_inodes": 0, 2024-09-21T05:54:16.192 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_inode_file_caps": 0, 2024-09-21T05:54:16.193 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T05:54:16.193 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_grant": 0, 2024-09-21T05:54:16.193 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T05:54:16.193 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T05:54:16.193 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T05:54:16.193 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_caps": 0, 2024-09-21T05:54:16.193 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_caps_dirty": 0, 2024-09-21T05:54:16.193 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_cap_release": 0, 2024-09-21T05:54:16.193 INFO:teuthology.orchestra.run.smithi116.stdout: "process_request_cap_release": 0 2024-09-21T05:54:16.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.193 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_cache": { 2024-09-21T05:54:16.193 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_update": 0, 2024-09-21T05:54:16.193 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_update_receipt": 0, 2024-09-21T05:54:16.193 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_try_discover": 0, 2024-09-21T05:54:16.194 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_send_discover": 0, 2024-09-21T05:54:16.194 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_handle_discover": 0, 2024-09-21T05:54:16.194 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays": 0, 2024-09-21T05:54:16.194 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays_delayed": 0, 2024-09-21T05:54:16.194 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays_enqueuing": 0, 2024-09-21T05:54:16.194 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_created": 0, 2024-09-21T05:54:16.194 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_enqueued": 0, 2024-09-21T05:54:16.194 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_reintegrated": 0, 2024-09-21T05:54:16.194 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_migrated": 0, 2024-09-21T05:54:16.194 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_processing": 0, 2024-09-21T05:54:16.194 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_enqueued": 0, 2024-09-21T05:54:16.194 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_prioritized": 0, 2024-09-21T05:54:16.194 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_started": 0, 2024-09-21T05:54:16.194 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_completed": 0, 2024-09-21T05:54:16.194 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_quiesce_path": 0, 2024-09-21T05:54:16.195 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_quiesce_inode": 0, 2024-09-21T05:54:16.195 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T05:54:16.195 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_exportdir": 0, 2024-09-21T05:54:16.195 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_flush": 0, 2024-09-21T05:54:16.195 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_fragmentdir": 0, 2024-09-21T05:54:16.195 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_fragstats": 0, 2024-09-21T05:54:16.195 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_inodestats": 0, 2024-09-21T05:54:16.195 INFO:teuthology.orchestra.run.smithi116.stdout: "uninline_started": 0, 2024-09-21T05:54:16.195 INFO:teuthology.orchestra.run.smithi116.stdout: "uninline_succeeded": 0, 2024-09-21T05:54:16.195 INFO:teuthology.orchestra.run.smithi116.stdout: "uninline_write_failed": 0 2024-09-21T05:54:16.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.195 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_log": { 2024-09-21T05:54:16.195 INFO:teuthology.orchestra.run.smithi116.stdout: "evlrg": 0, 2024-09-21T05:54:16.195 INFO:teuthology.orchestra.run.smithi116.stdout: "evadd": 0, 2024-09-21T05:54:16.196 INFO:teuthology.orchestra.run.smithi116.stdout: "evex": 0, 2024-09-21T05:54:16.196 INFO:teuthology.orchestra.run.smithi116.stdout: "evtrm": 0, 2024-09-21T05:54:16.196 INFO:teuthology.orchestra.run.smithi116.stdout: "ev": 44526, 2024-09-21T05:54:16.196 INFO:teuthology.orchestra.run.smithi116.stdout: "evexg": 0, 2024-09-21T05:54:16.196 INFO:teuthology.orchestra.run.smithi116.stdout: "evexd": 0, 2024-09-21T05:54:16.196 INFO:teuthology.orchestra.run.smithi116.stdout: "segadd": 0, 2024-09-21T05:54:16.196 INFO:teuthology.orchestra.run.smithi116.stdout: "segex": 0, 2024-09-21T05:54:16.196 INFO:teuthology.orchestra.run.smithi116.stdout: "segtrm": 0, 2024-09-21T05:54:16.196 INFO:teuthology.orchestra.run.smithi116.stdout: "seg": 62, 2024-09-21T05:54:16.196 INFO:teuthology.orchestra.run.smithi116.stdout: "segmjr": 5, 2024-09-21T05:54:16.196 INFO:teuthology.orchestra.run.smithi116.stdout: "segexg": 0, 2024-09-21T05:54:16.196 INFO:teuthology.orchestra.run.smithi116.stdout: "segexd": 0, 2024-09-21T05:54:16.196 INFO:teuthology.orchestra.run.smithi116.stdout: "expos": 4194304, 2024-09-21T05:54:16.196 INFO:teuthology.orchestra.run.smithi116.stdout: "wrpos": 89732508, 2024-09-21T05:54:16.196 INFO:teuthology.orchestra.run.smithi116.stdout: "rdpos": 89728750, 2024-09-21T05:54:16.196 INFO:teuthology.orchestra.run.smithi116.stdout: "jlat": { 2024-09-21T05:54:16.197 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.197 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.197 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.197 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.197 INFO:teuthology.orchestra.run.smithi116.stdout: "replayed": 44526 2024-09-21T05:54:16.197 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.197 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_mem": { 2024-09-21T05:54:16.197 INFO:teuthology.orchestra.run.smithi116.stdout: "ino": 64, 2024-09-21T05:54:16.197 INFO:teuthology.orchestra.run.smithi116.stdout: "ino+": 11248, 2024-09-21T05:54:16.197 INFO:teuthology.orchestra.run.smithi116.stdout: "ino-": 11184, 2024-09-21T05:54:16.197 INFO:teuthology.orchestra.run.smithi116.stdout: "dir": 77, 2024-09-21T05:54:16.197 INFO:teuthology.orchestra.run.smithi116.stdout: "dir+": 691, 2024-09-21T05:54:16.197 INFO:teuthology.orchestra.run.smithi116.stdout: "dir-": 614, 2024-09-21T05:54:16.198 INFO:teuthology.orchestra.run.smithi116.stdout: "dn": 10690, 2024-09-21T05:54:16.198 INFO:teuthology.orchestra.run.smithi116.stdout: "dn+": 17113, 2024-09-21T05:54:16.198 INFO:teuthology.orchestra.run.smithi116.stdout: "dn-": 6423, 2024-09-21T05:54:16.198 INFO:teuthology.orchestra.run.smithi116.stdout: "cap": 0, 2024-09-21T05:54:16.198 INFO:teuthology.orchestra.run.smithi116.stdout: "cap+": 0, 2024-09-21T05:54:16.198 INFO:teuthology.orchestra.run.smithi116.stdout: "cap-": 0, 2024-09-21T05:54:16.198 INFO:teuthology.orchestra.run.smithi116.stdout: "rss": 132192, 2024-09-21T05:54:16.198 INFO:teuthology.orchestra.run.smithi116.stdout: "heap": 343023616 2024-09-21T05:54:16.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.198 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_server": { 2024-09-21T05:54:16.198 INFO:teuthology.orchestra.run.smithi116.stdout: "dispatch_client_request": 0, 2024-09-21T05:54:16.198 INFO:teuthology.orchestra.run.smithi116.stdout: "dispatch_server_request": 0, 2024-09-21T05:54:16.198 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_request": 0, 2024-09-21T05:54:16.198 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_session": 0, 2024-09-21T05:54:16.199 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_peer_request": 0, 2024-09-21T05:54:16.199 INFO:teuthology.orchestra.run.smithi116.stdout: "req_create_latency": { 2024-09-21T05:54:16.199 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.199 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.199 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.199 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getattr_latency": { 2024-09-21T05:54:16.199 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.199 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.199 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.199 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getfilelock_latency": { 2024-09-21T05:54:16.199 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.199 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.200 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.200 INFO:teuthology.orchestra.run.smithi116.stdout: "req_link_latency": { 2024-09-21T05:54:16.200 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.200 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.200 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.200 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookup_latency": { 2024-09-21T05:54:16.200 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.200 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.200 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.200 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookuphash_latency": { 2024-09-21T05:54:16.200 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.200 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.200 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.201 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupino_latency": { 2024-09-21T05:54:16.201 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.201 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.201 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.201 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupname_latency": { 2024-09-21T05:54:16.201 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.201 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.201 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.201 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupparent_latency": { 2024-09-21T05:54:16.201 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.201 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.201 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.202 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupsnap_latency": { 2024-09-21T05:54:16.202 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.202 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.202 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.202 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lssnap_latency": { 2024-09-21T05:54:16.202 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.203 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.203 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.203 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mkdir_latency": { 2024-09-21T05:54:16.203 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.203 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.203 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.203 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mknod_latency": { 2024-09-21T05:54:16.203 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.203 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.203 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.204 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mksnap_latency": { 2024-09-21T05:54:16.204 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.204 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.204 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.204 INFO:teuthology.orchestra.run.smithi116.stdout: "req_open_latency": { 2024-09-21T05:54:16.204 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.204 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.204 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.204 INFO:teuthology.orchestra.run.smithi116.stdout: "req_readdir_latency": { 2024-09-21T05:54:16.204 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.204 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.204 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.204 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rename_latency": { 2024-09-21T05:54:16.204 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.205 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.205 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.205 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.205 INFO:teuthology.orchestra.run.smithi116.stdout: "req_renamesnap_latency": { 2024-09-21T05:54:16.205 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.205 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.205 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.205 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.205 INFO:teuthology.orchestra.run.smithi116.stdout: "req_snapdiff_latency": { 2024-09-21T05:54:16.205 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.205 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.205 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.205 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.205 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmdir_latency": { 2024-09-21T05:54:16.206 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.206 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.206 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.206 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.206 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmsnap_latency": { 2024-09-21T05:54:16.206 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.206 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.206 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.206 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.206 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmxattr_latency": { 2024-09-21T05:54:16.206 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.206 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.206 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.206 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.206 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setattr_latency": { 2024-09-21T05:54:16.206 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.207 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.207 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.207 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setdirlayout_latency": { 2024-09-21T05:54:16.207 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.207 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.207 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.207 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setfilelock_latency": { 2024-09-21T05:54:16.207 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.207 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.207 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.207 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setlayout_latency": { 2024-09-21T05:54:16.208 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.208 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.208 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.208 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.208 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setxattr_latency": { 2024-09-21T05:54:16.208 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.208 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.208 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.208 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.208 INFO:teuthology.orchestra.run.smithi116.stdout: "req_symlink_latency": { 2024-09-21T05:54:16.208 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.208 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.208 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.208 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.209 INFO:teuthology.orchestra.run.smithi116.stdout: "req_unlink_latency": { 2024-09-21T05:54:16.209 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.209 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.209 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.209 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.209 INFO:teuthology.orchestra.run.smithi116.stdout: "cap_revoke_eviction": 0, 2024-09-21T05:54:16.209 INFO:teuthology.orchestra.run.smithi116.stdout: "cap_acquisition_throttle": 0, 2024-09-21T05:54:16.209 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getvxattr_latency": { 2024-09-21T05:54:16.209 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.209 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.209 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.209 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:16.209 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.209 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_sessions": { 2024-09-21T05:54:16.209 INFO:teuthology.orchestra.run.smithi116.stdout: "session_count": 1, 2024-09-21T05:54:16.209 INFO:teuthology.orchestra.run.smithi116.stdout: "session_add": 4, 2024-09-21T05:54:16.210 INFO:teuthology.orchestra.run.smithi116.stdout: "session_remove": 3, 2024-09-21T05:54:16.210 INFO:teuthology.orchestra.run.smithi116.stdout: "sessions_open": 2, 2024-09-21T05:54:16.210 INFO:teuthology.orchestra.run.smithi116.stdout: "sessions_stale": 0, 2024-09-21T05:54:16.210 INFO:teuthology.orchestra.run.smithi116.stdout: "total_load": 0, 2024-09-21T05:54:16.210 INFO:teuthology.orchestra.run.smithi116.stdout: "average_load": 0, 2024-09-21T05:54:16.210 INFO:teuthology.orchestra.run.smithi116.stdout: "avg_session_uptime": 2456, 2024-09-21T05:54:16.210 INFO:teuthology.orchestra.run.smithi116.stdout: "mdthresh_evicted": 0 2024-09-21T05:54:16.210 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.210 INFO:teuthology.orchestra.run.smithi116.stdout: "mempool": { 2024-09-21T05:54:16.210 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_bytes": 0, 2024-09-21T05:54:16.210 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_items": 0, 2024-09-21T05:54:16.210 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T05:54:16.210 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_items": 0, 2024-09-21T05:54:16.210 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T05:54:16.211 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_items": 0, 2024-09-21T05:54:16.211 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T05:54:16.211 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T05:54:16.211 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T05:54:16.211 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T05:54:16.211 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T05:54:16.211 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_items": 0, 2024-09-21T05:54:16.211 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T05:54:16.211 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T05:54:16.211 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_bytes": 0, 2024-09-21T05:54:16.211 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_items": 0, 2024-09-21T05:54:16.211 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_bytes": 0, 2024-09-21T05:54:16.211 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_items": 0, 2024-09-21T05:54:16.211 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T05:54:16.211 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T05:54:16.212 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T05:54:16.212 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T05:54:16.212 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T05:54:16.212 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_items": 0, 2024-09-21T05:54:16.212 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_bytes": 0, 2024-09-21T05:54:16.212 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_items": 0, 2024-09-21T05:54:16.212 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T05:54:16.212 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T05:54:16.212 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_bytes": 0, 2024-09-21T05:54:16.212 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_items": 0, 2024-09-21T05:54:16.212 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_bytes": 0, 2024-09-21T05:54:16.212 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_items": 0, 2024-09-21T05:54:16.212 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T05:54:16.212 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_items": 0, 2024-09-21T05:54:16.212 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T05:54:16.213 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_items": 0, 2024-09-21T05:54:16.213 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_bytes": 230480, 2024-09-21T05:54:16.213 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_items": 72, 2024-09-21T05:54:16.213 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_bytes": 0, 2024-09-21T05:54:16.213 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_items": 0, 2024-09-21T05:54:16.213 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_bytes": 0, 2024-09-21T05:54:16.213 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_items": 0, 2024-09-21T05:54:16.213 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_bytes": 0, 2024-09-21T05:54:16.213 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_items": 0, 2024-09-21T05:54:16.213 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_bytes": 0, 2024-09-21T05:54:16.213 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_items": 0, 2024-09-21T05:54:16.213 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_bytes": 9144, 2024-09-21T05:54:16.213 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_items": 172, 2024-09-21T05:54:16.213 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T05:54:16.213 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_items": 0, 2024-09-21T05:54:16.214 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_bytes": 0, 2024-09-21T05:54:16.214 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_items": 0, 2024-09-21T05:54:16.214 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_bytes": 7525768, 2024-09-21T05:54:16.214 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_items": 53476, 2024-09-21T05:54:16.214 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_bytes": 0, 2024-09-21T05:54:16.214 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_items": 0, 2024-09-21T05:54:16.214 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_bytes": 0, 2024-09-21T05:54:16.214 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_items": 0 2024-09-21T05:54:16.214 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.214 INFO:teuthology.orchestra.run.smithi116.stdout: "objecter": { 2024-09-21T05:54:16.214 INFO:teuthology.orchestra.run.smithi116.stdout: "op_active": 0, 2024-09-21T05:54:16.214 INFO:teuthology.orchestra.run.smithi116.stdout: "op_laggy": 0, 2024-09-21T05:54:16.214 INFO:teuthology.orchestra.run.smithi116.stdout: "op_send": 1353, 2024-09-21T05:54:16.214 INFO:teuthology.orchestra.run.smithi116.stdout: "op_send_bytes": 26, 2024-09-21T05:54:16.214 INFO:teuthology.orchestra.run.smithi116.stdout: "op_resend": 4, 2024-09-21T05:54:16.215 INFO:teuthology.orchestra.run.smithi116.stdout: "op_reply": 1353, 2024-09-21T05:54:16.215 INFO:teuthology.orchestra.run.smithi116.stdout: "op_latency": { 2024-09-21T05:54:16.215 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 1353, 2024-09-21T05:54:16.215 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.907983879, 2024-09-21T05:54:16.215 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000671089 2024-09-21T05:54:16.215 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.215 INFO:teuthology.orchestra.run.smithi116.stdout: "op_inflight": 0, 2024-09-21T05:54:16.215 INFO:teuthology.orchestra.run.smithi116.stdout: "oplen_avg": { 2024-09-21T05:54:16.215 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 1353, 2024-09-21T05:54:16.215 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 1354 2024-09-21T05:54:16.215 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.215 INFO:teuthology.orchestra.run.smithi116.stdout: "op": 1353, 2024-09-21T05:54:16.215 INFO:teuthology.orchestra.run.smithi116.stdout: "op_r": 1353, 2024-09-21T05:54:16.215 INFO:teuthology.orchestra.run.smithi116.stdout: "op_w": 0, 2024-09-21T05:54:16.215 INFO:teuthology.orchestra.run.smithi116.stdout: "op_rmw": 0, 2024-09-21T05:54:16.215 INFO:teuthology.orchestra.run.smithi116.stdout: "op_pg": 0, 2024-09-21T05:54:16.215 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_stat": 812, 2024-09-21T05:54:16.216 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_create": 0, 2024-09-21T05:54:16.216 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_read": 538, 2024-09-21T05:54:16.216 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_write": 0, 2024-09-21T05:54:16.216 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_writefull": 0, 2024-09-21T05:54:16.216 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_writesame": 0, 2024-09-21T05:54:16.216 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_append": 0, 2024-09-21T05:54:16.216 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_zero": 0, 2024-09-21T05:54:16.216 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_truncate": 0, 2024-09-21T05:54:16.216 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_delete": 0, 2024-09-21T05:54:16.216 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_mapext": 0, 2024-09-21T05:54:16.216 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_sparse_read": 0, 2024-09-21T05:54:16.216 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_clonerange": 0, 2024-09-21T05:54:16.216 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_getxattr": 2, 2024-09-21T05:54:16.216 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_setxattr": 0, 2024-09-21T05:54:16.217 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_cmpxattr": 0, 2024-09-21T05:54:16.217 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_rmxattr": 0, 2024-09-21T05:54:16.217 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_resetxattrs": 0, 2024-09-21T05:54:16.217 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_call": 0, 2024-09-21T05:54:16.217 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_watch": 0, 2024-09-21T05:54:16.217 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_notify": 0, 2024-09-21T05:54:16.217 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T05:54:16.217 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_pgls": 0, 2024-09-21T05:54:16.217 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_pgls_filter": 0, 2024-09-21T05:54:16.217 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_other": 0, 2024-09-21T05:54:16.217 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_active": 0, 2024-09-21T05:54:16.217 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_send": 0, 2024-09-21T05:54:16.217 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_resend": 0, 2024-09-21T05:54:16.217 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_ping": 0, 2024-09-21T05:54:16.217 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_active": 0, 2024-09-21T05:54:16.218 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_send": 0, 2024-09-21T05:54:16.218 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_resend": 0, 2024-09-21T05:54:16.218 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_active": 0, 2024-09-21T05:54:16.218 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_send": 0, 2024-09-21T05:54:16.218 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_resend": 0, 2024-09-21T05:54:16.218 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_active": 0, 2024-09-21T05:54:16.218 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_send": 0, 2024-09-21T05:54:16.218 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_resend": 0, 2024-09-21T05:54:16.218 INFO:teuthology.orchestra.run.smithi116.stdout: "command_active": 0, 2024-09-21T05:54:16.218 INFO:teuthology.orchestra.run.smithi116.stdout: "command_send": 0, 2024-09-21T05:54:16.218 INFO:teuthology.orchestra.run.smithi116.stdout: "command_resend": 0, 2024-09-21T05:54:16.218 INFO:teuthology.orchestra.run.smithi116.stdout: "map_epoch": 85, 2024-09-21T05:54:16.218 INFO:teuthology.orchestra.run.smithi116.stdout: "map_full": 0, 2024-09-21T05:54:16.218 INFO:teuthology.orchestra.run.smithi116.stdout: "map_inc": 2, 2024-09-21T05:54:16.219 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_sessions": 10, 2024-09-21T05:54:16.219 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_session_open": 10, 2024-09-21T05:54:16.219 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_session_close": 0, 2024-09-21T05:54:16.219 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_laggy": 0, 2024-09-21T05:54:16.219 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_wr": 0, 2024-09-21T05:54:16.219 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_rd": 2, 2024-09-21T05:54:16.219 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_del": 0 2024-09-21T05:54:16.219 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.219 INFO:teuthology.orchestra.run.smithi116.stdout: "oft": { 2024-09-21T05:54:16.219 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_objs": 0, 2024-09-21T05:54:16.219 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_kv_pairs": 0, 2024-09-21T05:54:16.219 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_updates": 0, 2024-09-21T05:54:16.219 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_removes": 0 2024-09-21T05:54:16.219 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.219 INFO:teuthology.orchestra.run.smithi116.stdout: "purge_queue": { 2024-09-21T05:54:16.220 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_ops": 0, 2024-09-21T05:54:16.220 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T05:54:16.220 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing": 0, 2024-09-21T05:54:16.220 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_high_water": 0, 2024-09-21T05:54:16.220 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executed_ops": 0, 2024-09-21T05:54:16.220 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executed": 0, 2024-09-21T05:54:16.220 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_item_in_journal": 0 2024-09-21T05:54:16.220 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.220 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T05:54:16.220 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-21T05:54:16.220 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2024-09-21T05:54:16.220 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-21T05:54:16.220 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 1504, 2024-09-21T05:54:16.220 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 86680910, 2024-09-21T05:54:16.220 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:16.221 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 1504, 2024-09-21T05:54:16.221 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-09-21T05:54:16.221 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-09-21T05:54:16.221 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 1504, 2024-09-21T05:54:16.221 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 86680910, 2024-09-21T05:54:16.221 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-21T05:54:16.221 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.221 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.221 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.221 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:16.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.221 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-objecter_bytes": { 2024-09-21T05:54:16.221 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-21T05:54:16.221 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2024-09-21T05:54:16.221 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-21T05:54:16.222 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-09-21T05:54:16.222 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-09-21T05:54:16.222 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:16.222 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-09-21T05:54:16.222 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 1353, 2024-09-21T05:54:16.222 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 85542895, 2024-09-21T05:54:16.222 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 1353, 2024-09-21T05:54:16.222 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 85542895, 2024-09-21T05:54:16.222 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-21T05:54:16.222 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.222 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.222 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.222 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:16.223 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.223 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-objecter_ops": { 2024-09-21T05:54:16.223 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-21T05:54:16.223 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 1024, 2024-09-21T05:54:16.223 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-21T05:54:16.223 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-09-21T05:54:16.223 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-09-21T05:54:16.223 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:16.223 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-09-21T05:54:16.223 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 1353, 2024-09-21T05:54:16.223 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 1353, 2024-09-21T05:54:16.223 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 1353, 2024-09-21T05:54:16.223 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 1353, 2024-09-21T05:54:16.223 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-21T05:54:16.224 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.224 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.224 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.224 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:16.224 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.224 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-write_buf_throttle": { 2024-09-21T05:54:16.224 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-21T05:54:16.224 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 3758096384, 2024-09-21T05:54:16.224 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-21T05:54:16.224 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-09-21T05:54:16.224 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-09-21T05:54:16.224 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:16.224 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-09-21T05:54:16.225 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-09-21T05:54:16.225 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-09-21T05:54:16.225 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 0, 2024-09-21T05:54:16.225 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 0, 2024-09-21T05:54:16.225 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-21T05:54:16.225 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.225 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.225 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.225 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:16.225 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.225 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-write_buf_throttle-0x55a8bb82b2b0": { 2024-09-21T05:54:16.225 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-21T05:54:16.225 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 3758096384, 2024-09-21T05:54:16.225 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-21T05:54:16.225 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-09-21T05:54:16.225 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-09-21T05:54:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-09-21T05:54:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-09-21T05:54:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-09-21T05:54:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 0, 2024-09-21T05:54:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 0, 2024-09-21T05:54:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-21T05:54:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: "trackedop": { 2024-09-21T05:54:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: "slow_ops_count": 0 2024-09-21T05:54:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:16.227 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-21T05:54:17.029 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-21T05:54:17.082 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-21T05:54:17.082 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-21T05:54:17.082 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-21T05:54:17.082 DEBUG:tasks.check_counter:Getting stats from h 2024-09-21T05:54:17.083 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph daemon mds.h perf dump 2024-09-21T05:54:17.330 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T05:54:17.722 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:17 smithi116 ceph-mon[34332]: pgmap v514: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-21T05:54:17.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:17 smithi070 ceph-mon[30981]: pgmap v514: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-21T05:54:17.842 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-21T05:54:17.842 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T05:54:17.842 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 17798, 2024-09-21T05:54:17.843 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 8988, 2024-09-21T05:54:17.843 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 7338971, 2024-09-21T05:54:17.843 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 2707194, 2024-09-21T05:54:17.843 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 9, 2024-09-21T05:54:17.843 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 4, 2024-09-21T05:54:17.843 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.916424946, 2024-09-21T05:54:17.843 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.441239374, 2024-09-21T05:54:17.843 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.640427281, 2024-09-21T05:54:17.843 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.009361295, 2024-09-21T05:54:17.843 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:17.843 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 8989, 2024-09-21T05:54:17.843 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.167432224, 2024-09-21T05:54:17.843 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000018626 2024-09-21T05:54:17.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.844 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:17.844 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 25800, 2024-09-21T05:54:17.844 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.003413008, 2024-09-21T05:54:17.844 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000132 2024-09-21T05:54:17.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.844 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 927040, 2024-09-21T05:54:17.844 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 82096 2024-09-21T05:54:17.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.844 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T05:54:17.844 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 464, 2024-09-21T05:54:17.844 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 479, 2024-09-21T05:54:17.844 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 197818, 2024-09-21T05:54:17.844 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 453006, 2024-09-21T05:54:17.845 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 11, 2024-09-21T05:54:17.845 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 7, 2024-09-21T05:54:17.845 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.038588046, 2024-09-21T05:54:17.845 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.018041467, 2024-09-21T05:54:17.845 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.016226612, 2024-09-21T05:54:17.845 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.004665814, 2024-09-21T05:54:17.845 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:17.845 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 477, 2024-09-21T05:54:17.845 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.029425751, 2024-09-21T05:54:17.845 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000061689 2024-09-21T05:54:17.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.845 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:17.845 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 466, 2024-09-21T05:54:17.845 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000063598, 2024-09-21T05:54:17.845 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000136 2024-09-21T05:54:17.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.846 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T05:54:17.846 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 234992 2024-09-21T05:54:17.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.846 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T05:54:17.846 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 4446, 2024-09-21T05:54:17.846 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 3019, 2024-09-21T05:54:17.846 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 1671570, 2024-09-21T05:54:17.846 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 1001449, 2024-09-21T05:54:17.846 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 14, 2024-09-21T05:54:17.846 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 7, 2024-09-21T05:54:17.846 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.225518698, 2024-09-21T05:54:17.846 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.104930807, 2024-09-21T05:54:17.846 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.150238001, 2024-09-21T05:54:17.847 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.003976622, 2024-09-21T05:54:17.847 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:17.847 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 3016, 2024-09-21T05:54:17.847 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.073081403, 2024-09-21T05:54:17.847 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000024231 2024-09-21T05:54:17.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.847 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:17.847 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 6947, 2024-09-21T05:54:17.847 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000988265, 2024-09-21T05:54:17.847 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000142 2024-09-21T05:54:17.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.847 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 3920, 2024-09-21T05:54:17.847 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 1184 2024-09-21T05:54:17.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.847 INFO:teuthology.orchestra.run.smithi116.stdout: "cct": { 2024-09-21T05:54:17.847 INFO:teuthology.orchestra.run.smithi116.stdout: "total_workers": 1, 2024-09-21T05:54:17.848 INFO:teuthology.orchestra.run.smithi116.stdout: "unhealthy_workers": 0 2024-09-21T05:54:17.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.848 INFO:teuthology.orchestra.run.smithi116.stdout: "finisher-MDSRank": { 2024-09-21T05:54:17.848 INFO:teuthology.orchestra.run.smithi116.stdout: "queue_len": 0, 2024-09-21T05:54:17.848 INFO:teuthology.orchestra.run.smithi116.stdout: "complete_latency": { 2024-09-21T05:54:17.848 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 376, 2024-09-21T05:54:17.848 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.180506796, 2024-09-21T05:54:17.848 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000480071 2024-09-21T05:54:17.848 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:17.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.848 INFO:teuthology.orchestra.run.smithi116.stdout: "finisher-PurgeQueue": { 2024-09-21T05:54:17.848 INFO:teuthology.orchestra.run.smithi116.stdout: "queue_len": 0, 2024-09-21T05:54:17.848 INFO:teuthology.orchestra.run.smithi116.stdout: "complete_latency": { 2024-09-21T05:54:17.848 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 319, 2024-09-21T05:54:17.849 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.021174213, 2024-09-21T05:54:17.849 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000066376 2024-09-21T05:54:17.849 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:17.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.849 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": { 2024-09-21T05:54:17.849 INFO:teuthology.orchestra.run.smithi116.stdout: "request": 372, 2024-09-21T05:54:17.849 INFO:teuthology.orchestra.run.smithi116.stdout: "reply": 292, 2024-09-21T05:54:17.849 INFO:teuthology.orchestra.run.smithi116.stdout: "reply_latency": { 2024-09-21T05:54:17.849 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 292, 2024-09-21T05:54:17.849 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.443159074, 2024-09-21T05:54:17.849 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.001517668 2024-09-21T05:54:17.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.849 INFO:teuthology.orchestra.run.smithi116.stdout: "slow_reply": 0, 2024-09-21T05:54:17.849 INFO:teuthology.orchestra.run.smithi116.stdout: "forward": 80, 2024-09-21T05:54:17.849 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_fetch_complete": 0, 2024-09-21T05:54:17.850 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_fetch_keys": 0, 2024-09-21T05:54:17.850 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_commit": 11, 2024-09-21T05:54:17.850 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_split": 0, 2024-09-21T05:54:17.850 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_merge": 0, 2024-09-21T05:54:17.850 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes": 31, 2024-09-21T05:54:17.850 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_top": 11, 2024-09-21T05:54:17.850 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_bottom": 10, 2024-09-21T05:54:17.850 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_pin_tail": 10, 2024-09-21T05:54:17.850 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_pinned": 13, 2024-09-21T05:54:17.850 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_expired": 1235, 2024-09-21T05:54:17.850 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_with_caps": 1, 2024-09-21T05:54:17.850 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": 1, 2024-09-21T05:54:17.850 INFO:teuthology.orchestra.run.smithi116.stdout: "subtrees": 6, 2024-09-21T05:54:17.850 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse": 2075, 2024-09-21T05:54:17.850 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_hit": 1186, 2024-09-21T05:54:17.850 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_forward": 80, 2024-09-21T05:54:17.851 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_discover": 620, 2024-09-21T05:54:17.851 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_dir_fetch": 0, 2024-09-21T05:54:17.851 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_remote_ino": 0, 2024-09-21T05:54:17.851 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_lock": 0, 2024-09-21T05:54:17.851 INFO:teuthology.orchestra.run.smithi116.stdout: "load_cent": 0, 2024-09-21T05:54:17.851 INFO:teuthology.orchestra.run.smithi116.stdout: "q": 0, 2024-09-21T05:54:17.851 INFO:teuthology.orchestra.run.smithi116.stdout: "exported": 10, 2024-09-21T05:54:17.851 INFO:teuthology.orchestra.run.smithi116.stdout: "exported_inodes": 2, 2024-09-21T05:54:17.851 INFO:teuthology.orchestra.run.smithi116.stdout: "imported": 10, 2024-09-21T05:54:17.851 INFO:teuthology.orchestra.run.smithi116.stdout: "imported_inodes": 108, 2024-09-21T05:54:17.851 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_dir_fetch": 0, 2024-09-21T05:54:17.851 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_backtrace_fetch": 0, 2024-09-21T05:54:17.851 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_peer_discover": 0, 2024-09-21T05:54:17.851 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rfiles": 1896, 2024-09-21T05:54:17.851 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rbytes": 105867378, 2024-09-21T05:54:17.852 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rsnaps": 0, 2024-09-21T05:54:17.852 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T05:54:17.852 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_set_tag": 0, 2024-09-21T05:54:17.852 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T05:54:17.852 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_inotable_repaired": 0, 2024-09-21T05:54:17.852 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dir_inodes": 0, 2024-09-21T05:54:17.852 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T05:54:17.852 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T05:54:17.852 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_file_inodes": 0, 2024-09-21T05:54:17.852 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_inode_file_caps": 0, 2024-09-21T05:54:17.852 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_revoke": 69, 2024-09-21T05:54:17.852 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_grant": 186, 2024-09-21T05:54:17.852 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T05:54:17.852 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T05:54:17.852 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T05:54:17.852 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_caps": 238, 2024-09-21T05:54:17.853 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_caps_dirty": 128, 2024-09-21T05:54:17.853 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_cap_release": 16, 2024-09-21T05:54:17.853 INFO:teuthology.orchestra.run.smithi116.stdout: "process_request_cap_release": 294 2024-09-21T05:54:17.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.853 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_cache": { 2024-09-21T05:54:17.853 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_update": 63, 2024-09-21T05:54:17.853 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_update_receipt": 2044, 2024-09-21T05:54:17.853 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_try_discover": 1327, 2024-09-21T05:54:17.853 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_send_discover": 1398, 2024-09-21T05:54:17.853 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_handle_discover": 65, 2024-09-21T05:54:17.853 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays": 0, 2024-09-21T05:54:17.853 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays_delayed": 0, 2024-09-21T05:54:17.853 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays_enqueuing": 0, 2024-09-21T05:54:17.853 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_created": 134, 2024-09-21T05:54:17.853 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_enqueued": 134, 2024-09-21T05:54:17.853 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_reintegrated": 0, 2024-09-21T05:54:17.854 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_migrated": 0, 2024-09-21T05:54:17.854 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_processing": 0, 2024-09-21T05:54:17.854 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_enqueued": 0, 2024-09-21T05:54:17.854 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_prioritized": 0, 2024-09-21T05:54:17.854 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_started": 0, 2024-09-21T05:54:17.854 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_completed": 0, 2024-09-21T05:54:17.854 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_quiesce_path": 4, 2024-09-21T05:54:17.854 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_quiesce_inode": 695, 2024-09-21T05:54:17.854 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T05:54:17.854 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_exportdir": 10, 2024-09-21T05:54:17.854 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_flush": 0, 2024-09-21T05:54:17.854 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_fragmentdir": 0, 2024-09-21T05:54:17.854 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_fragstats": 0, 2024-09-21T05:54:17.855 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_inodestats": 0, 2024-09-21T05:54:17.855 INFO:teuthology.orchestra.run.smithi116.stdout: "uninline_started": 0, 2024-09-21T05:54:17.855 INFO:teuthology.orchestra.run.smithi116.stdout: "uninline_succeeded": 0, 2024-09-21T05:54:17.855 INFO:teuthology.orchestra.run.smithi116.stdout: "uninline_write_failed": 0 2024-09-21T05:54:17.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.855 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_log": { 2024-09-21T05:54:17.855 INFO:teuthology.orchestra.run.smithi116.stdout: "evlrg": 0, 2024-09-21T05:54:17.855 INFO:teuthology.orchestra.run.smithi116.stdout: "evadd": 557, 2024-09-21T05:54:17.855 INFO:teuthology.orchestra.run.smithi116.stdout: "evex": 0, 2024-09-21T05:54:17.855 INFO:teuthology.orchestra.run.smithi116.stdout: "evtrm": 0, 2024-09-21T05:54:17.855 INFO:teuthology.orchestra.run.smithi116.stdout: "ev": 557, 2024-09-21T05:54:17.855 INFO:teuthology.orchestra.run.smithi116.stdout: "evexg": 0, 2024-09-21T05:54:17.855 INFO:teuthology.orchestra.run.smithi116.stdout: "evexd": 0, 2024-09-21T05:54:17.855 INFO:teuthology.orchestra.run.smithi116.stdout: "segadd": 2, 2024-09-21T05:54:17.855 INFO:teuthology.orchestra.run.smithi116.stdout: "segex": 0, 2024-09-21T05:54:17.856 INFO:teuthology.orchestra.run.smithi116.stdout: "segtrm": 0, 2024-09-21T05:54:17.856 INFO:teuthology.orchestra.run.smithi116.stdout: "seg": 2, 2024-09-21T05:54:17.856 INFO:teuthology.orchestra.run.smithi116.stdout: "segmjr": 2, 2024-09-21T05:54:17.856 INFO:teuthology.orchestra.run.smithi116.stdout: "segexg": 0, 2024-09-21T05:54:17.856 INFO:teuthology.orchestra.run.smithi116.stdout: "segexd": 0, 2024-09-21T05:54:17.856 INFO:teuthology.orchestra.run.smithi116.stdout: "expos": 4194304, 2024-09-21T05:54:17.856 INFO:teuthology.orchestra.run.smithi116.stdout: "wrpos": 5050127, 2024-09-21T05:54:17.856 INFO:teuthology.orchestra.run.smithi116.stdout: "rdpos": 0, 2024-09-21T05:54:17.856 INFO:teuthology.orchestra.run.smithi116.stdout: "jlat": { 2024-09-21T05:54:17.856 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 150, 2024-09-21T05:54:17.856 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.377657013, 2024-09-21T05:54:17.856 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.002517713 2024-09-21T05:54:17.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.856 INFO:teuthology.orchestra.run.smithi116.stdout: "replayed": 0 2024-09-21T05:54:17.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.857 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_mem": { 2024-09-21T05:54:17.857 INFO:teuthology.orchestra.run.smithi116.stdout: "ino": 38, 2024-09-21T05:54:17.857 INFO:teuthology.orchestra.run.smithi116.stdout: "ino+": 790, 2024-09-21T05:54:17.857 INFO:teuthology.orchestra.run.smithi116.stdout: "ino-": 752, 2024-09-21T05:54:17.857 INFO:teuthology.orchestra.run.smithi116.stdout: "dir": 37, 2024-09-21T05:54:17.857 INFO:teuthology.orchestra.run.smithi116.stdout: "dir+": 790, 2024-09-21T05:54:17.857 INFO:teuthology.orchestra.run.smithi116.stdout: "dir-": 753, 2024-09-21T05:54:17.857 INFO:teuthology.orchestra.run.smithi116.stdout: "dn": 31, 2024-09-21T05:54:17.857 INFO:teuthology.orchestra.run.smithi116.stdout: "dn+": 1506, 2024-09-21T05:54:17.857 INFO:teuthology.orchestra.run.smithi116.stdout: "dn-": 1475, 2024-09-21T05:54:17.857 INFO:teuthology.orchestra.run.smithi116.stdout: "cap": 1, 2024-09-21T05:54:17.857 INFO:teuthology.orchestra.run.smithi116.stdout: "cap+": 147, 2024-09-21T05:54:17.857 INFO:teuthology.orchestra.run.smithi116.stdout: "cap-": 146, 2024-09-21T05:54:17.857 INFO:teuthology.orchestra.run.smithi116.stdout: "rss": 125140, 2024-09-21T05:54:17.858 INFO:teuthology.orchestra.run.smithi116.stdout: "heap": 332144640 2024-09-21T05:54:17.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.858 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_server": { 2024-09-21T05:54:17.858 INFO:teuthology.orchestra.run.smithi116.stdout: "dispatch_client_request": 592, 2024-09-21T05:54:17.858 INFO:teuthology.orchestra.run.smithi116.stdout: "dispatch_server_request": 55, 2024-09-21T05:54:17.858 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_request": 372, 2024-09-21T05:54:17.858 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_session": 9, 2024-09-21T05:54:17.858 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_peer_request": 188, 2024-09-21T05:54:17.858 INFO:teuthology.orchestra.run.smithi116.stdout: "req_create_latency": { 2024-09-21T05:54:17.858 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 26, 2024-09-21T05:54:17.858 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.080635360, 2024-09-21T05:54:17.858 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.003101360 2024-09-21T05:54:17.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.858 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getattr_latency": { 2024-09-21T05:54:17.858 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 1, 2024-09-21T05:54:17.859 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000226487, 2024-09-21T05:54:17.859 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000226487 2024-09-21T05:54:17.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.859 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getfilelock_latency": { 2024-09-21T05:54:17.859 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:17.859 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:17.859 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:17.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.859 INFO:teuthology.orchestra.run.smithi116.stdout: "req_link_latency": { 2024-09-21T05:54:17.859 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:17.859 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:17.859 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:17.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.859 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookup_latency": { 2024-09-21T05:54:17.860 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 117, 2024-09-21T05:54:17.860 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.067914930, 2024-09-21T05:54:17.860 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000580469 2024-09-21T05:54:17.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.860 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookuphash_latency": { 2024-09-21T05:54:17.860 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:17.860 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:17.860 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:17.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.860 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupino_latency": { 2024-09-21T05:54:17.860 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:17.860 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:17.860 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:17.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.860 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupname_latency": { 2024-09-21T05:54:17.861 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:17.861 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:17.861 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:17.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.861 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupparent_latency": { 2024-09-21T05:54:17.861 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:17.861 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:17.861 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:17.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.861 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupsnap_latency": { 2024-09-21T05:54:17.861 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:17.861 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:17.861 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:17.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.862 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lssnap_latency": { 2024-09-21T05:54:17.862 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:17.862 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:17.862 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:17.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.862 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mkdir_latency": { 2024-09-21T05:54:17.862 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:17.862 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:17.863 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:17.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.863 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mknod_latency": { 2024-09-21T05:54:17.863 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:17.863 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:17.863 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:17.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.863 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mksnap_latency": { 2024-09-21T05:54:17.863 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:17.863 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:17.863 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:17.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.863 INFO:teuthology.orchestra.run.smithi116.stdout: "req_open_latency": { 2024-09-21T05:54:17.863 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:17.864 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:17.864 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:17.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.864 INFO:teuthology.orchestra.run.smithi116.stdout: "req_readdir_latency": { 2024-09-21T05:54:17.864 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 14, 2024-09-21T05:54:17.864 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.009429153, 2024-09-21T05:54:17.864 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000673510 2024-09-21T05:54:17.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.864 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rename_latency": { 2024-09-21T05:54:17.864 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:17.864 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:17.864 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:17.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.864 INFO:teuthology.orchestra.run.smithi116.stdout: "req_renamesnap_latency": { 2024-09-21T05:54:17.864 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:17.865 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:17.865 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:17.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.865 INFO:teuthology.orchestra.run.smithi116.stdout: "req_snapdiff_latency": { 2024-09-21T05:54:17.865 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:17.865 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:17.865 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:17.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.865 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmdir_latency": { 2024-09-21T05:54:17.865 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 1, 2024-09-21T05:54:17.865 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.012932868, 2024-09-21T05:54:17.865 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.012932868 2024-09-21T05:54:17.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.865 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmsnap_latency": { 2024-09-21T05:54:17.865 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:17.866 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:17.866 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:17.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.866 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmxattr_latency": { 2024-09-21T05:54:17.866 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:17.866 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:17.866 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:17.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.866 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setattr_latency": { 2024-09-21T05:54:17.866 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:17.866 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:17.866 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:17.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.866 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setdirlayout_latency": { 2024-09-21T05:54:17.866 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:17.867 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:17.867 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:17.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.867 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setfilelock_latency": { 2024-09-21T05:54:17.867 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:17.867 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:17.867 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:17.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.867 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setlayout_latency": { 2024-09-21T05:54:17.867 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:17.867 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:17.867 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:17.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.867 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setxattr_latency": { 2024-09-21T05:54:17.867 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:17.868 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:17.868 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:17.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.868 INFO:teuthology.orchestra.run.smithi116.stdout: "req_symlink_latency": { 2024-09-21T05:54:17.868 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:17.868 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:17.868 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:17.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.868 INFO:teuthology.orchestra.run.smithi116.stdout: "req_unlink_latency": { 2024-09-21T05:54:17.868 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 133, 2024-09-21T05:54:17.868 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.272020276, 2024-09-21T05:54:17.868 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.002045265 2024-09-21T05:54:17.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.868 INFO:teuthology.orchestra.run.smithi116.stdout: "cap_revoke_eviction": 0, 2024-09-21T05:54:17.868 INFO:teuthology.orchestra.run.smithi116.stdout: "cap_acquisition_throttle": 0, 2024-09-21T05:54:17.869 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getvxattr_latency": { 2024-09-21T05:54:17.869 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:17.869 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:17.869 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:17.869 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:17.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.869 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_sessions": { 2024-09-21T05:54:17.869 INFO:teuthology.orchestra.run.smithi116.stdout: "session_count": 1, 2024-09-21T05:54:17.869 INFO:teuthology.orchestra.run.smithi116.stdout: "session_add": 2, 2024-09-21T05:54:17.869 INFO:teuthology.orchestra.run.smithi116.stdout: "session_remove": 1, 2024-09-21T05:54:17.869 INFO:teuthology.orchestra.run.smithi116.stdout: "sessions_open": 1, 2024-09-21T05:54:17.869 INFO:teuthology.orchestra.run.smithi116.stdout: "sessions_stale": 0, 2024-09-21T05:54:17.869 INFO:teuthology.orchestra.run.smithi116.stdout: "total_load": 204, 2024-09-21T05:54:17.869 INFO:teuthology.orchestra.run.smithi116.stdout: "average_load": 204, 2024-09-21T05:54:17.869 INFO:teuthology.orchestra.run.smithi116.stdout: "avg_session_uptime": 281, 2024-09-21T05:54:17.870 INFO:teuthology.orchestra.run.smithi116.stdout: "mdthresh_evicted": 0 2024-09-21T05:54:17.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.870 INFO:teuthology.orchestra.run.smithi116.stdout: "mempool": { 2024-09-21T05:54:17.870 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_bytes": 0, 2024-09-21T05:54:17.870 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_items": 0, 2024-09-21T05:54:17.870 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T05:54:17.870 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_items": 0, 2024-09-21T05:54:17.870 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T05:54:17.870 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_items": 0, 2024-09-21T05:54:17.870 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T05:54:17.870 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T05:54:17.870 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T05:54:17.870 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T05:54:17.870 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T05:54:17.871 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_items": 0, 2024-09-21T05:54:17.871 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T05:54:17.871 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T05:54:17.871 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_bytes": 0, 2024-09-21T05:54:17.871 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_items": 0, 2024-09-21T05:54:17.871 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_bytes": 0, 2024-09-21T05:54:17.871 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_items": 0, 2024-09-21T05:54:17.871 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T05:54:17.871 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T05:54:17.871 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T05:54:17.871 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T05:54:17.871 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T05:54:17.871 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_items": 0, 2024-09-21T05:54:17.871 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_bytes": 0, 2024-09-21T05:54:17.872 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_items": 0, 2024-09-21T05:54:17.872 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T05:54:17.872 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T05:54:17.872 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_bytes": 0, 2024-09-21T05:54:17.872 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_items": 0, 2024-09-21T05:54:17.872 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_bytes": 0, 2024-09-21T05:54:17.872 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_items": 0, 2024-09-21T05:54:17.872 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T05:54:17.872 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_items": 0, 2024-09-21T05:54:17.872 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T05:54:17.872 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_items": 0, 2024-09-21T05:54:17.872 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_bytes": 279255, 2024-09-21T05:54:17.872 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_items": 97, 2024-09-21T05:54:17.872 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_bytes": 0, 2024-09-21T05:54:17.872 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_items": 0, 2024-09-21T05:54:17.873 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_bytes": 0, 2024-09-21T05:54:17.873 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_items": 0, 2024-09-21T05:54:17.873 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_bytes": 0, 2024-09-21T05:54:17.873 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_items": 0, 2024-09-21T05:54:17.873 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_bytes": 0, 2024-09-21T05:54:17.873 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_items": 0, 2024-09-21T05:54:17.873 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_bytes": 9144, 2024-09-21T05:54:17.873 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_items": 172, 2024-09-21T05:54:17.873 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T05:54:17.873 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_items": 0, 2024-09-21T05:54:17.873 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_bytes": 0, 2024-09-21T05:54:17.873 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_items": 0, 2024-09-21T05:54:17.873 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_bytes": 156385, 2024-09-21T05:54:17.874 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_items": 591, 2024-09-21T05:54:17.874 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_bytes": 0, 2024-09-21T05:54:17.874 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_items": 0, 2024-09-21T05:54:17.874 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_bytes": 0, 2024-09-21T05:54:17.874 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_items": 0 2024-09-21T05:54:17.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.874 INFO:teuthology.orchestra.run.smithi116.stdout: "objecter": { 2024-09-21T05:54:17.874 INFO:teuthology.orchestra.run.smithi116.stdout: "op_active": 0, 2024-09-21T05:54:17.874 INFO:teuthology.orchestra.run.smithi116.stdout: "op_laggy": 0, 2024-09-21T05:54:17.874 INFO:teuthology.orchestra.run.smithi116.stdout: "op_send": 575, 2024-09-21T05:54:17.874 INFO:teuthology.orchestra.run.smithi116.stdout: "op_send_bytes": 901358, 2024-09-21T05:54:17.874 INFO:teuthology.orchestra.run.smithi116.stdout: "op_resend": 33, 2024-09-21T05:54:17.874 INFO:teuthology.orchestra.run.smithi116.stdout: "op_reply": 575, 2024-09-21T05:54:17.874 INFO:teuthology.orchestra.run.smithi116.stdout: "op_latency": { 2024-09-21T05:54:17.875 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 575, 2024-09-21T05:54:17.875 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 1.674970229, 2024-09-21T05:54:17.875 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.002912991 2024-09-21T05:54:17.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.875 INFO:teuthology.orchestra.run.smithi116.stdout: "op_inflight": 0, 2024-09-21T05:54:17.875 INFO:teuthology.orchestra.run.smithi116.stdout: "oplen_avg": { 2024-09-21T05:54:17.875 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 575, 2024-09-21T05:54:17.875 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 651 2024-09-21T05:54:17.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.875 INFO:teuthology.orchestra.run.smithi116.stdout: "op": 575, 2024-09-21T05:54:17.875 INFO:teuthology.orchestra.run.smithi116.stdout: "op_r": 24, 2024-09-21T05:54:17.875 INFO:teuthology.orchestra.run.smithi116.stdout: "op_w": 551, 2024-09-21T05:54:17.875 INFO:teuthology.orchestra.run.smithi116.stdout: "op_rmw": 0, 2024-09-21T05:54:17.875 INFO:teuthology.orchestra.run.smithi116.stdout: "op_pg": 0, 2024-09-21T05:54:17.875 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_stat": 0, 2024-09-21T05:54:17.876 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_create": 10, 2024-09-21T05:54:17.876 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_read": 24, 2024-09-21T05:54:17.876 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_write": 174, 2024-09-21T05:54:17.876 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_writefull": 31, 2024-09-21T05:54:17.876 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_writesame": 0, 2024-09-21T05:54:17.876 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_append": 0, 2024-09-21T05:54:17.876 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_zero": 0, 2024-09-21T05:54:17.876 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_truncate": 0, 2024-09-21T05:54:17.876 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_delete": 279, 2024-09-21T05:54:17.876 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_mapext": 0, 2024-09-21T05:54:17.876 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_sparse_read": 0, 2024-09-21T05:54:17.876 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_clonerange": 0, 2024-09-21T05:54:17.876 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_getxattr": 0, 2024-09-21T05:54:17.876 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_setxattr": 20, 2024-09-21T05:54:17.876 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_cmpxattr": 0, 2024-09-21T05:54:17.877 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_rmxattr": 0, 2024-09-21T05:54:17.877 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_resetxattrs": 0, 2024-09-21T05:54:17.877 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_call": 0, 2024-09-21T05:54:17.877 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_watch": 0, 2024-09-21T05:54:17.877 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_notify": 0, 2024-09-21T05:54:17.877 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T05:54:17.877 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_pgls": 0, 2024-09-21T05:54:17.877 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_pgls_filter": 0, 2024-09-21T05:54:17.877 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_other": 0, 2024-09-21T05:54:17.877 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_active": 0, 2024-09-21T05:54:17.877 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_send": 0, 2024-09-21T05:54:17.877 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_resend": 0, 2024-09-21T05:54:17.877 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_ping": 0, 2024-09-21T05:54:17.877 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_active": 0, 2024-09-21T05:54:17.877 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_send": 0, 2024-09-21T05:54:17.877 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_resend": 0, 2024-09-21T05:54:17.878 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_active": 0, 2024-09-21T05:54:17.878 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_send": 0, 2024-09-21T05:54:17.878 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_resend": 0, 2024-09-21T05:54:17.878 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_active": 0, 2024-09-21T05:54:17.878 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_send": 0, 2024-09-21T05:54:17.878 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_resend": 0, 2024-09-21T05:54:17.878 INFO:teuthology.orchestra.run.smithi116.stdout: "command_active": 0, 2024-09-21T05:54:17.878 INFO:teuthology.orchestra.run.smithi116.stdout: "command_send": 0, 2024-09-21T05:54:17.878 INFO:teuthology.orchestra.run.smithi116.stdout: "command_resend": 0, 2024-09-21T05:54:17.878 INFO:teuthology.orchestra.run.smithi116.stdout: "map_epoch": 85, 2024-09-21T05:54:17.878 INFO:teuthology.orchestra.run.smithi116.stdout: "map_full": 0, 2024-09-21T05:54:17.878 INFO:teuthology.orchestra.run.smithi116.stdout: "map_inc": 2, 2024-09-21T05:54:17.878 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_sessions": 12, 2024-09-21T05:54:17.879 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_session_open": 12, 2024-09-21T05:54:17.879 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_session_close": 0, 2024-09-21T05:54:17.879 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_laggy": 0, 2024-09-21T05:54:17.879 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_wr": 82, 2024-09-21T05:54:17.879 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_rd": 0, 2024-09-21T05:54:17.879 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_del": 31 2024-09-21T05:54:17.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.879 INFO:teuthology.orchestra.run.smithi116.stdout: "oft": { 2024-09-21T05:54:17.879 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_objs": 1, 2024-09-21T05:54:17.879 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_kv_pairs": 0, 2024-09-21T05:54:17.879 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_updates": 0, 2024-09-21T05:54:17.879 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_removes": 0 2024-09-21T05:54:17.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.879 INFO:teuthology.orchestra.run.smithi116.stdout: "purge_queue": { 2024-09-21T05:54:17.879 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_ops": 0, 2024-09-21T05:54:17.880 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_ops_high_water": 10, 2024-09-21T05:54:17.880 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing": 0, 2024-09-21T05:54:17.880 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_high_water": 5, 2024-09-21T05:54:17.880 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executed_ops": 267, 2024-09-21T05:54:17.880 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executed": 134, 2024-09-21T05:54:17.880 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_item_in_journal": 0 2024-09-21T05:54:17.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.880 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T05:54:17.880 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-21T05:54:17.880 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2024-09-21T05:54:17.880 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-21T05:54:17.880 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 22704, 2024-09-21T05:54:17.880 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 7152766, 2024-09-21T05:54:17.880 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:17.880 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 22704, 2024-09-21T05:54:17.881 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-09-21T05:54:17.881 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-09-21T05:54:17.881 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 22704, 2024-09-21T05:54:17.881 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 7152766, 2024-09-21T05:54:17.881 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-21T05:54:17.881 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:17.881 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:17.881 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:17.881 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:17.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.881 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-objecter_bytes": { 2024-09-21T05:54:17.881 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-21T05:54:17.881 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2024-09-21T05:54:17.881 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-21T05:54:17.882 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-09-21T05:54:17.882 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-09-21T05:54:17.882 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:17.882 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-09-21T05:54:17.882 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 575, 2024-09-21T05:54:17.882 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 915956, 2024-09-21T05:54:17.882 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 575, 2024-09-21T05:54:17.882 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 915956, 2024-09-21T05:54:17.882 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-21T05:54:17.882 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:17.882 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:17.882 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:17.882 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:17.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.882 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-objecter_ops": { 2024-09-21T05:54:17.883 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-21T05:54:17.883 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 1024, 2024-09-21T05:54:17.883 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-21T05:54:17.883 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-09-21T05:54:17.883 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-09-21T05:54:17.883 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:17.883 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-09-21T05:54:17.883 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 575, 2024-09-21T05:54:17.883 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 575, 2024-09-21T05:54:17.883 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 575, 2024-09-21T05:54:17.883 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 575, 2024-09-21T05:54:17.883 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-21T05:54:17.883 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:17.883 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:17.884 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:17.884 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:17.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.884 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-write_buf_throttle": { 2024-09-21T05:54:17.884 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-21T05:54:17.884 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 3758096384, 2024-09-21T05:54:17.884 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-21T05:54:17.884 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 134, 2024-09-21T05:54:17.884 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 14598, 2024-09-21T05:54:17.884 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:17.884 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 134, 2024-09-21T05:54:17.884 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-09-21T05:54:17.884 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-09-21T05:54:17.884 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 24, 2024-09-21T05:54:17.884 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 14598, 2024-09-21T05:54:17.884 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-21T05:54:17.885 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:17.885 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:17.885 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:17.885 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:17.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.885 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-write_buf_throttle-0x558130a07450": { 2024-09-21T05:54:17.885 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-21T05:54:17.885 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 3758096384, 2024-09-21T05:54:17.885 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-21T05:54:17.885 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 557, 2024-09-21T05:54:17.885 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 855823, 2024-09-21T05:54:17.885 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:17.885 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 557, 2024-09-21T05:54:17.885 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-09-21T05:54:17.885 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-09-21T05:54:17.886 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 150, 2024-09-21T05:54:17.886 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 855823, 2024-09-21T05:54:17.886 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-21T05:54:17.886 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:17.886 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:17.886 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:17.886 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:17.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:17.886 INFO:teuthology.orchestra.run.smithi116.stdout: "trackedop": { 2024-09-21T05:54:17.886 INFO:teuthology.orchestra.run.smithi116.stdout: "slow_ops_count": 699 2024-09-21T05:54:17.886 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:17.886 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-21T05:54:17.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:17 smithi160 ceph-mon[33979]: pgmap v514: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-21T05:54:18.543 INFO:tasks.check_counter:Daemon mds.h mds.exported=10 2024-09-21T05:54:18.543 INFO:tasks.check_counter:Daemon mds.h mds.imported=10 2024-09-21T05:54:18.543 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=63 2024-09-21T05:54:18.543 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=2044 2024-09-21T05:54:18.543 DEBUG:tasks.check_counter:Getting stats from k 2024-09-21T05:54:18.543 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph daemon mds.k perf dump 2024-09-21T05:54:18.793 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T05:54:19.301 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-21T05:54:19.301 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T05:54:19.301 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 539, 2024-09-21T05:54:19.301 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 523, 2024-09-21T05:54:19.301 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 1034720, 2024-09-21T05:54:19.302 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 202696, 2024-09-21T05:54:19.302 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 5, 2024-09-21T05:54:19.302 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 1, 2024-09-21T05:54:19.302 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.078712764, 2024-09-21T05:54:19.302 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.036085425, 2024-09-21T05:54:19.302 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.035822254, 2024-09-21T05:54:19.302 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.011114798, 2024-09-21T05:54:19.302 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:19.302 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 522, 2024-09-21T05:54:19.302 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.025199070, 2024-09-21T05:54:19.302 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000048274 2024-09-21T05:54:19.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.302 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:19.302 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.302 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.303 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.303 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 904352, 2024-09-21T05:54:19.303 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 79312 2024-09-21T05:54:19.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.303 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T05:54:19.303 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 25, 2024-09-21T05:54:19.303 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 122, 2024-09-21T05:54:19.303 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 6128, 2024-09-21T05:54:19.303 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 243390, 2024-09-21T05:54:19.303 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 5, 2024-09-21T05:54:19.303 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 4, 2024-09-21T05:54:19.303 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.010383447, 2024-09-21T05:54:19.303 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.006378914, 2024-09-21T05:54:19.303 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.002165609, 2024-09-21T05:54:19.303 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.000745742, 2024-09-21T05:54:19.304 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:19.304 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 120, 2024-09-21T05:54:19.304 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.006687198, 2024-09-21T05:54:19.304 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000055726 2024-09-21T05:54:19.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.304 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:19.304 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.304 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.304 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.304 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T05:54:19.304 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 235696 2024-09-21T05:54:19.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.304 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T05:54:19.304 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 722, 2024-09-21T05:54:19.305 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 721, 2024-09-21T05:54:19.305 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 12662372, 2024-09-21T05:54:19.305 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 228461, 2024-09-21T05:54:19.305 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 4, 2024-09-21T05:54:19.305 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 3, 2024-09-21T05:54:19.305 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.064947407, 2024-09-21T05:54:19.305 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.021248340, 2024-09-21T05:54:19.305 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.023569183, 2024-09-21T05:54:19.305 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.016864092, 2024-09-21T05:54:19.305 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:19.305 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 720, 2024-09-21T05:54:19.305 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.028393612, 2024-09-21T05:54:19.305 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000039435 2024-09-21T05:54:19.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.305 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:19.305 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.306 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.306 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.306 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T05:54:19.306 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T05:54:19.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.306 INFO:teuthology.orchestra.run.smithi116.stdout: "cct": { 2024-09-21T05:54:19.306 INFO:teuthology.orchestra.run.smithi116.stdout: "total_workers": 1, 2024-09-21T05:54:19.306 INFO:teuthology.orchestra.run.smithi116.stdout: "unhealthy_workers": 0 2024-09-21T05:54:19.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.306 INFO:teuthology.orchestra.run.smithi116.stdout: "finisher-MDSRank": { 2024-09-21T05:54:19.306 INFO:teuthology.orchestra.run.smithi116.stdout: "queue_len": 0, 2024-09-21T05:54:19.306 INFO:teuthology.orchestra.run.smithi116.stdout: "complete_latency": { 2024-09-21T05:54:19.306 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 1959, 2024-09-21T05:54:19.307 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.047634323, 2024-09-21T05:54:19.307 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000024315 2024-09-21T05:54:19.307 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:19.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.307 INFO:teuthology.orchestra.run.smithi116.stdout: "finisher-PurgeQueue": { 2024-09-21T05:54:19.307 INFO:teuthology.orchestra.run.smithi116.stdout: "queue_len": 0, 2024-09-21T05:54:19.307 INFO:teuthology.orchestra.run.smithi116.stdout: "complete_latency": { 2024-09-21T05:54:19.307 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.307 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.307 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.307 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:19.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.307 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": { 2024-09-21T05:54:19.307 INFO:teuthology.orchestra.run.smithi116.stdout: "request": 0, 2024-09-21T05:54:19.307 INFO:teuthology.orchestra.run.smithi116.stdout: "reply": 0, 2024-09-21T05:54:19.308 INFO:teuthology.orchestra.run.smithi116.stdout: "reply_latency": { 2024-09-21T05:54:19.308 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.308 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.308 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.308 INFO:teuthology.orchestra.run.smithi116.stdout: "slow_reply": 0, 2024-09-21T05:54:19.308 INFO:teuthology.orchestra.run.smithi116.stdout: "forward": 0, 2024-09-21T05:54:19.308 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_fetch_complete": 0, 2024-09-21T05:54:19.308 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_fetch_keys": 0, 2024-09-21T05:54:19.308 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_commit": 0, 2024-09-21T05:54:19.308 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_split": 0, 2024-09-21T05:54:19.308 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_merge": 0, 2024-09-21T05:54:19.308 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes": 2263, 2024-09-21T05:54:19.308 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_top": 0, 2024-09-21T05:54:19.308 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_bottom": 2263, 2024-09-21T05:54:19.308 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_pin_tail": 0, 2024-09-21T05:54:19.309 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_pinned": 2263, 2024-09-21T05:54:19.309 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_expired": 0, 2024-09-21T05:54:19.309 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_with_caps": 0, 2024-09-21T05:54:19.309 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": 0, 2024-09-21T05:54:19.309 INFO:teuthology.orchestra.run.smithi116.stdout: "subtrees": 1, 2024-09-21T05:54:19.309 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse": 0, 2024-09-21T05:54:19.309 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_hit": 0, 2024-09-21T05:54:19.309 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_forward": 0, 2024-09-21T05:54:19.309 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_discover": 0, 2024-09-21T05:54:19.309 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_dir_fetch": 0, 2024-09-21T05:54:19.309 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_remote_ino": 0, 2024-09-21T05:54:19.309 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_lock": 0, 2024-09-21T05:54:19.309 INFO:teuthology.orchestra.run.smithi116.stdout: "load_cent": 0, 2024-09-21T05:54:19.309 INFO:teuthology.orchestra.run.smithi116.stdout: "q": 0, 2024-09-21T05:54:19.309 INFO:teuthology.orchestra.run.smithi116.stdout: "exported": 0, 2024-09-21T05:54:19.310 INFO:teuthology.orchestra.run.smithi116.stdout: "exported_inodes": 0, 2024-09-21T05:54:19.310 INFO:teuthology.orchestra.run.smithi116.stdout: "imported": 0, 2024-09-21T05:54:19.310 INFO:teuthology.orchestra.run.smithi116.stdout: "imported_inodes": 0, 2024-09-21T05:54:19.310 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_dir_fetch": 0, 2024-09-21T05:54:19.310 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_backtrace_fetch": 0, 2024-09-21T05:54:19.310 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_peer_discover": 0, 2024-09-21T05:54:19.310 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rfiles": 0, 2024-09-21T05:54:19.310 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rbytes": 0, 2024-09-21T05:54:19.310 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rsnaps": 0, 2024-09-21T05:54:19.310 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T05:54:19.310 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_set_tag": 0, 2024-09-21T05:54:19.310 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T05:54:19.310 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_inotable_repaired": 0, 2024-09-21T05:54:19.310 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dir_inodes": 0, 2024-09-21T05:54:19.310 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T05:54:19.311 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T05:54:19.311 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_file_inodes": 0, 2024-09-21T05:54:19.311 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_inode_file_caps": 0, 2024-09-21T05:54:19.311 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T05:54:19.311 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_grant": 0, 2024-09-21T05:54:19.311 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T05:54:19.311 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T05:54:19.311 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T05:54:19.311 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_caps": 0, 2024-09-21T05:54:19.311 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_caps_dirty": 0, 2024-09-21T05:54:19.311 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_cap_release": 0, 2024-09-21T05:54:19.311 INFO:teuthology.orchestra.run.smithi116.stdout: "process_request_cap_release": 0 2024-09-21T05:54:19.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.311 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_cache": { 2024-09-21T05:54:19.311 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_update": 0, 2024-09-21T05:54:19.311 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_update_receipt": 0, 2024-09-21T05:54:19.312 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_try_discover": 0, 2024-09-21T05:54:19.312 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_send_discover": 0, 2024-09-21T05:54:19.312 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_handle_discover": 0, 2024-09-21T05:54:19.312 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays": 0, 2024-09-21T05:54:19.312 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays_delayed": 0, 2024-09-21T05:54:19.312 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays_enqueuing": 0, 2024-09-21T05:54:19.312 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_created": 0, 2024-09-21T05:54:19.312 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_enqueued": 0, 2024-09-21T05:54:19.312 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_reintegrated": 0, 2024-09-21T05:54:19.312 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_migrated": 0, 2024-09-21T05:54:19.312 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_processing": 0, 2024-09-21T05:54:19.312 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_enqueued": 0, 2024-09-21T05:54:19.312 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_prioritized": 0, 2024-09-21T05:54:19.312 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_started": 0, 2024-09-21T05:54:19.312 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_completed": 0, 2024-09-21T05:54:19.312 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_quiesce_path": 0, 2024-09-21T05:54:19.312 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_quiesce_inode": 0, 2024-09-21T05:54:19.313 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T05:54:19.313 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_exportdir": 0, 2024-09-21T05:54:19.313 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_flush": 0, 2024-09-21T05:54:19.313 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_fragmentdir": 0, 2024-09-21T05:54:19.313 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_fragstats": 0, 2024-09-21T05:54:19.313 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_inodestats": 0, 2024-09-21T05:54:19.313 INFO:teuthology.orchestra.run.smithi116.stdout: "uninline_started": 0, 2024-09-21T05:54:19.313 INFO:teuthology.orchestra.run.smithi116.stdout: "uninline_succeeded": 0, 2024-09-21T05:54:19.313 INFO:teuthology.orchestra.run.smithi116.stdout: "uninline_write_failed": 0 2024-09-21T05:54:19.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.313 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_log": { 2024-09-21T05:54:19.313 INFO:teuthology.orchestra.run.smithi116.stdout: "evlrg": 0, 2024-09-21T05:54:19.313 INFO:teuthology.orchestra.run.smithi116.stdout: "evadd": 0, 2024-09-21T05:54:19.313 INFO:teuthology.orchestra.run.smithi116.stdout: "evex": 0, 2024-09-21T05:54:19.313 INFO:teuthology.orchestra.run.smithi116.stdout: "evtrm": 0, 2024-09-21T05:54:19.314 INFO:teuthology.orchestra.run.smithi116.stdout: "ev": 6157, 2024-09-21T05:54:19.314 INFO:teuthology.orchestra.run.smithi116.stdout: "evexg": 0, 2024-09-21T05:54:19.314 INFO:teuthology.orchestra.run.smithi116.stdout: "evexd": 0, 2024-09-21T05:54:19.314 INFO:teuthology.orchestra.run.smithi116.stdout: "segadd": 0, 2024-09-21T05:54:19.314 INFO:teuthology.orchestra.run.smithi116.stdout: "segex": 0, 2024-09-21T05:54:19.314 INFO:teuthology.orchestra.run.smithi116.stdout: "segtrm": 0, 2024-09-21T05:54:19.314 INFO:teuthology.orchestra.run.smithi116.stdout: "seg": 8, 2024-09-21T05:54:19.314 INFO:teuthology.orchestra.run.smithi116.stdout: "segmjr": 2, 2024-09-21T05:54:19.314 INFO:teuthology.orchestra.run.smithi116.stdout: "segexg": 0, 2024-09-21T05:54:19.314 INFO:teuthology.orchestra.run.smithi116.stdout: "segexd": 0, 2024-09-21T05:54:19.314 INFO:teuthology.orchestra.run.smithi116.stdout: "expos": 4194304, 2024-09-21T05:54:19.314 INFO:teuthology.orchestra.run.smithi116.stdout: "wrpos": 16669655, 2024-09-21T05:54:19.314 INFO:teuthology.orchestra.run.smithi116.stdout: "rdpos": 16668517, 2024-09-21T05:54:19.314 INFO:teuthology.orchestra.run.smithi116.stdout: "jlat": { 2024-09-21T05:54:19.314 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.315 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.315 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.315 INFO:teuthology.orchestra.run.smithi116.stdout: "replayed": 6157 2024-09-21T05:54:19.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.315 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_mem": { 2024-09-21T05:54:19.315 INFO:teuthology.orchestra.run.smithi116.stdout: "ino": 29, 2024-09-21T05:54:19.315 INFO:teuthology.orchestra.run.smithi116.stdout: "ino+": 1867, 2024-09-21T05:54:19.315 INFO:teuthology.orchestra.run.smithi116.stdout: "ino-": 1838, 2024-09-21T05:54:19.315 INFO:teuthology.orchestra.run.smithi116.stdout: "dir": 27, 2024-09-21T05:54:19.315 INFO:teuthology.orchestra.run.smithi116.stdout: "dir+": 237, 2024-09-21T05:54:19.315 INFO:teuthology.orchestra.run.smithi116.stdout: "dir-": 210, 2024-09-21T05:54:19.315 INFO:teuthology.orchestra.run.smithi116.stdout: "dn": 2263, 2024-09-21T05:54:19.315 INFO:teuthology.orchestra.run.smithi116.stdout: "dn+": 3522, 2024-09-21T05:54:19.315 INFO:teuthology.orchestra.run.smithi116.stdout: "dn-": 1259, 2024-09-21T05:54:19.316 INFO:teuthology.orchestra.run.smithi116.stdout: "cap": 0, 2024-09-21T05:54:19.316 INFO:teuthology.orchestra.run.smithi116.stdout: "cap+": 0, 2024-09-21T05:54:19.316 INFO:teuthology.orchestra.run.smithi116.stdout: "cap-": 0, 2024-09-21T05:54:19.316 INFO:teuthology.orchestra.run.smithi116.stdout: "rss": 120560, 2024-09-21T05:54:19.316 INFO:teuthology.orchestra.run.smithi116.stdout: "heap": 325074944 2024-09-21T05:54:19.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.316 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_server": { 2024-09-21T05:54:19.316 INFO:teuthology.orchestra.run.smithi116.stdout: "dispatch_client_request": 0, 2024-09-21T05:54:19.316 INFO:teuthology.orchestra.run.smithi116.stdout: "dispatch_server_request": 0, 2024-09-21T05:54:19.316 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_request": 0, 2024-09-21T05:54:19.316 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_session": 0, 2024-09-21T05:54:19.316 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_peer_request": 0, 2024-09-21T05:54:19.316 INFO:teuthology.orchestra.run.smithi116.stdout: "req_create_latency": { 2024-09-21T05:54:19.316 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.316 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.316 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.317 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getattr_latency": { 2024-09-21T05:54:19.317 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.317 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.317 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.317 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getfilelock_latency": { 2024-09-21T05:54:19.317 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.317 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.317 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.317 INFO:teuthology.orchestra.run.smithi116.stdout: "req_link_latency": { 2024-09-21T05:54:19.317 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.317 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.317 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.318 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookup_latency": { 2024-09-21T05:54:19.318 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.318 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.318 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.318 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookuphash_latency": { 2024-09-21T05:54:19.318 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.318 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.318 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.318 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupino_latency": { 2024-09-21T05:54:19.318 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.318 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.318 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.319 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupname_latency": { 2024-09-21T05:54:19.319 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.319 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.319 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.319 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupparent_latency": { 2024-09-21T05:54:19.319 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.319 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.319 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.319 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupsnap_latency": { 2024-09-21T05:54:19.319 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.319 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.320 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.320 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lssnap_latency": { 2024-09-21T05:54:19.320 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.320 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.320 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.321 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mkdir_latency": { 2024-09-21T05:54:19.321 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.321 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.321 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.321 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mknod_latency": { 2024-09-21T05:54:19.321 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.321 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.321 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.321 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mksnap_latency": { 2024-09-21T05:54:19.321 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.321 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.321 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.322 INFO:teuthology.orchestra.run.smithi116.stdout: "req_open_latency": { 2024-09-21T05:54:19.322 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.322 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.322 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.322 INFO:teuthology.orchestra.run.smithi116.stdout: "req_readdir_latency": { 2024-09-21T05:54:19.322 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.322 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.322 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.322 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rename_latency": { 2024-09-21T05:54:19.322 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.322 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.322 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.323 INFO:teuthology.orchestra.run.smithi116.stdout: "req_renamesnap_latency": { 2024-09-21T05:54:19.323 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.323 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.323 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.323 INFO:teuthology.orchestra.run.smithi116.stdout: "req_snapdiff_latency": { 2024-09-21T05:54:19.323 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.323 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.323 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.323 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmdir_latency": { 2024-09-21T05:54:19.323 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.323 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.323 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.324 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmsnap_latency": { 2024-09-21T05:54:19.324 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.324 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.324 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.324 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmxattr_latency": { 2024-09-21T05:54:19.324 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.324 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.324 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.324 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setattr_latency": { 2024-09-21T05:54:19.324 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.324 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.324 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.325 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setdirlayout_latency": { 2024-09-21T05:54:19.325 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.325 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.325 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.325 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setfilelock_latency": { 2024-09-21T05:54:19.325 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.325 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.325 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.325 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setlayout_latency": { 2024-09-21T05:54:19.325 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.325 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.325 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.326 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setxattr_latency": { 2024-09-21T05:54:19.326 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.326 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.326 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.326 INFO:teuthology.orchestra.run.smithi116.stdout: "req_symlink_latency": { 2024-09-21T05:54:19.326 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.326 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.326 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.326 INFO:teuthology.orchestra.run.smithi116.stdout: "req_unlink_latency": { 2024-09-21T05:54:19.326 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.326 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.326 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.327 INFO:teuthology.orchestra.run.smithi116.stdout: "cap_revoke_eviction": 0, 2024-09-21T05:54:19.327 INFO:teuthology.orchestra.run.smithi116.stdout: "cap_acquisition_throttle": 0, 2024-09-21T05:54:19.327 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getvxattr_latency": { 2024-09-21T05:54:19.327 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.327 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.327 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.327 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:19.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.327 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_sessions": { 2024-09-21T05:54:19.327 INFO:teuthology.orchestra.run.smithi116.stdout: "session_count": 1, 2024-09-21T05:54:19.327 INFO:teuthology.orchestra.run.smithi116.stdout: "session_add": 2, 2024-09-21T05:54:19.327 INFO:teuthology.orchestra.run.smithi116.stdout: "session_remove": 1, 2024-09-21T05:54:19.327 INFO:teuthology.orchestra.run.smithi116.stdout: "sessions_open": 2, 2024-09-21T05:54:19.327 INFO:teuthology.orchestra.run.smithi116.stdout: "sessions_stale": 0, 2024-09-21T05:54:19.328 INFO:teuthology.orchestra.run.smithi116.stdout: "total_load": 0, 2024-09-21T05:54:19.328 INFO:teuthology.orchestra.run.smithi116.stdout: "average_load": 0, 2024-09-21T05:54:19.328 INFO:teuthology.orchestra.run.smithi116.stdout: "avg_session_uptime": 2463, 2024-09-21T05:54:19.328 INFO:teuthology.orchestra.run.smithi116.stdout: "mdthresh_evicted": 0 2024-09-21T05:54:19.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.328 INFO:teuthology.orchestra.run.smithi116.stdout: "mempool": { 2024-09-21T05:54:19.328 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_bytes": 0, 2024-09-21T05:54:19.328 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_items": 0, 2024-09-21T05:54:19.328 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T05:54:19.328 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_items": 0, 2024-09-21T05:54:19.328 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T05:54:19.328 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_items": 0, 2024-09-21T05:54:19.328 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T05:54:19.328 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T05:54:19.328 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T05:54:19.329 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T05:54:19.329 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T05:54:19.329 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_items": 0, 2024-09-21T05:54:19.329 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T05:54:19.329 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T05:54:19.329 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_bytes": 0, 2024-09-21T05:54:19.329 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_items": 0, 2024-09-21T05:54:19.329 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_bytes": 0, 2024-09-21T05:54:19.329 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_items": 0, 2024-09-21T05:54:19.329 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T05:54:19.329 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T05:54:19.329 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T05:54:19.329 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T05:54:19.329 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T05:54:19.329 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_items": 0, 2024-09-21T05:54:19.329 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_bytes": 0, 2024-09-21T05:54:19.330 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_items": 0, 2024-09-21T05:54:19.330 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T05:54:19.330 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T05:54:19.330 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_bytes": 0, 2024-09-21T05:54:19.330 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_items": 0, 2024-09-21T05:54:19.330 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_bytes": 0, 2024-09-21T05:54:19.330 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_items": 0, 2024-09-21T05:54:19.330 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T05:54:19.330 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_items": 0, 2024-09-21T05:54:19.330 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T05:54:19.330 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_items": 0, 2024-09-21T05:54:19.330 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_bytes": 189279, 2024-09-21T05:54:19.330 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_items": 49, 2024-09-21T05:54:19.331 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_bytes": 0, 2024-09-21T05:54:19.331 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_items": 0, 2024-09-21T05:54:19.331 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_bytes": 0, 2024-09-21T05:54:19.331 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_items": 0, 2024-09-21T05:54:19.331 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_bytes": 0, 2024-09-21T05:54:19.331 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_items": 0, 2024-09-21T05:54:19.331 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_bytes": 0, 2024-09-21T05:54:19.331 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_items": 0, 2024-09-21T05:54:19.331 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_bytes": 9144, 2024-09-21T05:54:19.331 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_items": 172, 2024-09-21T05:54:19.331 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T05:54:19.331 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_items": 0, 2024-09-21T05:54:19.331 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_bytes": 0, 2024-09-21T05:54:19.331 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_items": 0, 2024-09-21T05:54:19.331 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_bytes": 1646370, 2024-09-21T05:54:19.332 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_items": 15981, 2024-09-21T05:54:19.332 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_bytes": 0, 2024-09-21T05:54:19.332 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_items": 0, 2024-09-21T05:54:19.332 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_bytes": 0, 2024-09-21T05:54:19.332 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_items": 0 2024-09-21T05:54:19.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.332 INFO:teuthology.orchestra.run.smithi116.stdout: "objecter": { 2024-09-21T05:54:19.332 INFO:teuthology.orchestra.run.smithi116.stdout: "op_active": 0, 2024-09-21T05:54:19.332 INFO:teuthology.orchestra.run.smithi116.stdout: "op_laggy": 0, 2024-09-21T05:54:19.332 INFO:teuthology.orchestra.run.smithi116.stdout: "op_send": 1129, 2024-09-21T05:54:19.332 INFO:teuthology.orchestra.run.smithi116.stdout: "op_send_bytes": 21, 2024-09-21T05:54:19.332 INFO:teuthology.orchestra.run.smithi116.stdout: "op_resend": 3, 2024-09-21T05:54:19.332 INFO:teuthology.orchestra.run.smithi116.stdout: "op_reply": 1129, 2024-09-21T05:54:19.332 INFO:teuthology.orchestra.run.smithi116.stdout: "op_latency": { 2024-09-21T05:54:19.332 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 1129, 2024-09-21T05:54:19.332 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.761986489, 2024-09-21T05:54:19.333 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000674921 2024-09-21T05:54:19.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.333 INFO:teuthology.orchestra.run.smithi116.stdout: "op_inflight": 0, 2024-09-21T05:54:19.333 INFO:teuthology.orchestra.run.smithi116.stdout: "oplen_avg": { 2024-09-21T05:54:19.333 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 1129, 2024-09-21T05:54:19.333 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 1130 2024-09-21T05:54:19.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.333 INFO:teuthology.orchestra.run.smithi116.stdout: "op": 1129, 2024-09-21T05:54:19.333 INFO:teuthology.orchestra.run.smithi116.stdout: "op_r": 1129, 2024-09-21T05:54:19.333 INFO:teuthology.orchestra.run.smithi116.stdout: "op_w": 0, 2024-09-21T05:54:19.333 INFO:teuthology.orchestra.run.smithi116.stdout: "op_rmw": 0, 2024-09-21T05:54:19.333 INFO:teuthology.orchestra.run.smithi116.stdout: "op_pg": 0, 2024-09-21T05:54:19.333 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_stat": 673, 2024-09-21T05:54:19.333 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_create": 0, 2024-09-21T05:54:19.333 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_read": 454, 2024-09-21T05:54:19.333 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_write": 0, 2024-09-21T05:54:19.333 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_writefull": 0, 2024-09-21T05:54:19.334 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_writesame": 0, 2024-09-21T05:54:19.334 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_append": 0, 2024-09-21T05:54:19.334 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_zero": 0, 2024-09-21T05:54:19.334 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_truncate": 0, 2024-09-21T05:54:19.334 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_delete": 0, 2024-09-21T05:54:19.334 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_mapext": 0, 2024-09-21T05:54:19.334 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_sparse_read": 0, 2024-09-21T05:54:19.334 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_clonerange": 0, 2024-09-21T05:54:19.334 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_getxattr": 1, 2024-09-21T05:54:19.334 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_setxattr": 0, 2024-09-21T05:54:19.334 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_cmpxattr": 0, 2024-09-21T05:54:19.334 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_rmxattr": 0, 2024-09-21T05:54:19.334 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_resetxattrs": 0, 2024-09-21T05:54:19.334 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_call": 0, 2024-09-21T05:54:19.335 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_watch": 0, 2024-09-21T05:54:19.335 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_notify": 0, 2024-09-21T05:54:19.335 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T05:54:19.335 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_pgls": 0, 2024-09-21T05:54:19.335 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_pgls_filter": 0, 2024-09-21T05:54:19.335 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_other": 0, 2024-09-21T05:54:19.335 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_active": 0, 2024-09-21T05:54:19.335 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_send": 0, 2024-09-21T05:54:19.335 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_resend": 0, 2024-09-21T05:54:19.335 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_ping": 0, 2024-09-21T05:54:19.335 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_active": 0, 2024-09-21T05:54:19.335 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_send": 0, 2024-09-21T05:54:19.335 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_resend": 0, 2024-09-21T05:54:19.335 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_active": 0, 2024-09-21T05:54:19.335 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_send": 0, 2024-09-21T05:54:19.336 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_resend": 0, 2024-09-21T05:54:19.336 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_active": 0, 2024-09-21T05:54:19.336 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_send": 0, 2024-09-21T05:54:19.336 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_resend": 0, 2024-09-21T05:54:19.336 INFO:teuthology.orchestra.run.smithi116.stdout: "command_active": 0, 2024-09-21T05:54:19.336 INFO:teuthology.orchestra.run.smithi116.stdout: "command_send": 0, 2024-09-21T05:54:19.336 INFO:teuthology.orchestra.run.smithi116.stdout: "command_resend": 0, 2024-09-21T05:54:19.336 INFO:teuthology.orchestra.run.smithi116.stdout: "map_epoch": 85, 2024-09-21T05:54:19.336 INFO:teuthology.orchestra.run.smithi116.stdout: "map_full": 0, 2024-09-21T05:54:19.336 INFO:teuthology.orchestra.run.smithi116.stdout: "map_inc": 2, 2024-09-21T05:54:19.336 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_sessions": 5, 2024-09-21T05:54:19.336 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_session_open": 5, 2024-09-21T05:54:19.336 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_session_close": 0, 2024-09-21T05:54:19.336 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_laggy": 0, 2024-09-21T05:54:19.336 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_wr": 0, 2024-09-21T05:54:19.336 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_rd": 2, 2024-09-21T05:54:19.336 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_del": 0 2024-09-21T05:54:19.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.337 INFO:teuthology.orchestra.run.smithi116.stdout: "oft": { 2024-09-21T05:54:19.337 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_objs": 0, 2024-09-21T05:54:19.337 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_kv_pairs": 0, 2024-09-21T05:54:19.337 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_updates": 0, 2024-09-21T05:54:19.337 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_removes": 0 2024-09-21T05:54:19.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.337 INFO:teuthology.orchestra.run.smithi116.stdout: "purge_queue": { 2024-09-21T05:54:19.337 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_ops": 0, 2024-09-21T05:54:19.337 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T05:54:19.337 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing": 0, 2024-09-21T05:54:19.337 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_high_water": 0, 2024-09-21T05:54:19.337 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executed_ops": 0, 2024-09-21T05:54:19.337 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executed": 0, 2024-09-21T05:54:19.337 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_item_in_journal": 0 2024-09-21T05:54:19.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.338 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T05:54:19.338 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-21T05:54:19.338 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2024-09-21T05:54:19.338 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-21T05:54:19.338 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 1282, 2024-09-21T05:54:19.338 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 13577173, 2024-09-21T05:54:19.338 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:19.338 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 1282, 2024-09-21T05:54:19.338 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-09-21T05:54:19.338 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-09-21T05:54:19.338 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 1282, 2024-09-21T05:54:19.338 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 13577173, 2024-09-21T05:54:19.338 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-21T05:54:19.338 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.338 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.339 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.339 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:19.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.339 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-objecter_bytes": { 2024-09-21T05:54:19.339 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-21T05:54:19.339 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2024-09-21T05:54:19.339 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-21T05:54:19.339 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-09-21T05:54:19.339 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-09-21T05:54:19.339 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:19.339 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-09-21T05:54:19.339 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 1129, 2024-09-21T05:54:19.339 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 12475356, 2024-09-21T05:54:19.339 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 1129, 2024-09-21T05:54:19.339 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 12475356, 2024-09-21T05:54:19.339 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-21T05:54:19.340 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.340 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.340 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.340 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:19.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.340 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-objecter_ops": { 2024-09-21T05:54:19.340 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-21T05:54:19.340 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 1024, 2024-09-21T05:54:19.340 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-21T05:54:19.340 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-09-21T05:54:19.340 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-09-21T05:54:19.340 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:19.340 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-09-21T05:54:19.340 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 1129, 2024-09-21T05:54:19.340 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 1129, 2024-09-21T05:54:19.341 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 1129, 2024-09-21T05:54:19.341 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 1129, 2024-09-21T05:54:19.341 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-21T05:54:19.341 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.341 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.341 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.341 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:19.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.341 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-write_buf_throttle": { 2024-09-21T05:54:19.341 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-21T05:54:19.341 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 3758096384, 2024-09-21T05:54:19.341 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-21T05:54:19.341 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-09-21T05:54:19.341 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-09-21T05:54:19.341 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:19.342 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-09-21T05:54:19.342 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-09-21T05:54:19.342 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-09-21T05:54:19.342 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 0, 2024-09-21T05:54:19.342 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 0, 2024-09-21T05:54:19.342 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-21T05:54:19.342 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.342 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.342 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.342 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:19.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.342 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-write_buf_throttle-0x55a4b0a5d450": { 2024-09-21T05:54:19.342 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-21T05:54:19.342 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 3758096384, 2024-09-21T05:54:19.342 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-21T05:54:19.342 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-09-21T05:54:19.343 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-09-21T05:54:19.343 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:19.343 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-09-21T05:54:19.343 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-09-21T05:54:19.343 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-09-21T05:54:19.343 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 0, 2024-09-21T05:54:19.343 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 0, 2024-09-21T05:54:19.343 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-21T05:54:19.343 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-21T05:54:19.343 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-21T05:54:19.343 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-21T05:54:19.343 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:19.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-21T05:54:19.343 INFO:teuthology.orchestra.run.smithi116.stdout: "trackedop": { 2024-09-21T05:54:19.343 INFO:teuthology.orchestra.run.smithi116.stdout: "slow_ops_count": 0 2024-09-21T05:54:19.344 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-21T05:54:19.344 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-21T05:54:19.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:19 smithi116 ceph-mon[34332]: pgmap v515: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-21T05:54:19.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:19 smithi070 ceph-mon[30981]: pgmap v515: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-21T05:54:19.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:19 smithi160 ceph-mon[33979]: pgmap v515: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-21T05:54:20.131 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-21T05:54:20.132 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-21T05:54:20.132 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-09-21T05:54:20.132 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-09-21T05:54:20.132 DEBUG:tasks.check_counter:Getting stats from c 2024-09-21T05:54:20.132 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph daemon mds.c perf dump 2024-09-21T05:54:20.393 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:54:21.062 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-21T05:54:21.062 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T05:54:21.062 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 2068, 2024-09-21T05:54:21.062 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 3299, 2024-09-21T05:54:21.062 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 739744, 2024-09-21T05:54:21.062 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 4086629, 2024-09-21T05:54:21.062 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 14, 2024-09-21T05:54:21.062 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 6, 2024-09-21T05:54:21.062 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.177510332, 2024-09-21T05:54:21.063 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.093314759, 2024-09-21T05:54:21.063 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.072818220, 2024-09-21T05:54:21.063 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.015544580, 2024-09-21T05:54:21.063 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:21.063 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 3297, 2024-09-21T05:54:21.063 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.103937829, 2024-09-21T05:54:21.063 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000031524 2024-09-21T05:54:21.063 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.063 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:21.063 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 3696, 2024-09-21T05:54:21.063 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000604639, 2024-09-21T05:54:21.063 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000163 2024-09-21T05:54:21.063 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.063 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T05:54:21.064 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T05:54:21.064 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.064 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T05:54:21.064 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 4157, 2024-09-21T05:54:21.064 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 2464, 2024-09-21T05:54:21.064 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 1537027, 2024-09-21T05:54:21.064 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 828622, 2024-09-21T05:54:21.064 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 11, 2024-09-21T05:54:21.064 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 9, 2024-09-21T05:54:21.064 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.246594155, 2024-09-21T05:54:21.064 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.118731467, 2024-09-21T05:54:21.064 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.150448475, 2024-09-21T05:54:21.064 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.010514095, 2024-09-21T05:54:21.064 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:21.064 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 2462, 2024-09-21T05:54:21.065 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.074373339, 2024-09-21T05:54:21.065 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000030208 2024-09-21T05:54:21.065 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.065 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:21.065 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 5694, 2024-09-21T05:54:21.065 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000839472, 2024-09-21T05:54:21.065 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000147 2024-09-21T05:54:21.065 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.065 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T05:54:21.065 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 235168 2024-09-21T05:54:21.065 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.065 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T05:54:21.065 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 17953, 2024-09-21T05:54:21.065 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 9349, 2024-09-21T05:54:21.065 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 7591798, 2024-09-21T05:54:21.066 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 2004557, 2024-09-21T05:54:21.066 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 7, 2024-09-21T05:54:21.066 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 6, 2024-09-21T05:54:21.066 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.927839029, 2024-09-21T05:54:21.066 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.412415042, 2024-09-21T05:54:21.066 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.686117659, 2024-09-21T05:54:21.066 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.007699614, 2024-09-21T05:54:21.066 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:21.066 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 9349, 2024-09-21T05:54:21.066 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.200824936, 2024-09-21T05:54:21.066 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000021480 2024-09-21T05:54:21.066 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.066 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:21.067 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 26374, 2024-09-21T05:54:21.067 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.004094751, 2024-09-21T05:54:21.067 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000155 2024-09-21T05:54:21.067 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.067 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 924400, 2024-09-21T05:54:21.067 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 82688 2024-09-21T05:54:21.067 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.067 INFO:teuthology.orchestra.run.smithi160.stdout: "cct": { 2024-09-21T05:54:21.067 INFO:teuthology.orchestra.run.smithi160.stdout: "total_workers": 1, 2024-09-21T05:54:21.067 INFO:teuthology.orchestra.run.smithi160.stdout: "unhealthy_workers": 0 2024-09-21T05:54:21.067 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.067 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-MDSRank": { 2024-09-21T05:54:21.067 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2024-09-21T05:54:21.067 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2024-09-21T05:54:21.067 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 462, 2024-09-21T05:54:21.067 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.411924387, 2024-09-21T05:54:21.068 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000891611 2024-09-21T05:54:21.068 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:21.068 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.068 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-PurgeQueue": { 2024-09-21T05:54:21.068 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2024-09-21T05:54:21.068 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2024-09-21T05:54:21.068 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 789, 2024-09-21T05:54:21.068 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.055244536, 2024-09-21T05:54:21.068 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000070018 2024-09-21T05:54:21.068 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:21.068 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.068 INFO:teuthology.orchestra.run.smithi160.stdout: "mds": { 2024-09-21T05:54:21.068 INFO:teuthology.orchestra.run.smithi160.stdout: "request": 718, 2024-09-21T05:54:21.069 INFO:teuthology.orchestra.run.smithi160.stdout: "reply": 627, 2024-09-21T05:54:21.069 INFO:teuthology.orchestra.run.smithi160.stdout: "reply_latency": { 2024-09-21T05:54:21.069 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 627, 2024-09-21T05:54:21.069 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.932000466, 2024-09-21T05:54:21.069 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.001486444 2024-09-21T05:54:21.069 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.069 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_reply": 0, 2024-09-21T05:54:21.069 INFO:teuthology.orchestra.run.smithi160.stdout: "forward": 91, 2024-09-21T05:54:21.069 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_complete": 0, 2024-09-21T05:54:21.069 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_keys": 0, 2024-09-21T05:54:21.069 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_commit": 11, 2024-09-21T05:54:21.069 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_split": 0, 2024-09-21T05:54:21.069 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_merge": 0, 2024-09-21T05:54:21.069 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes": 28, 2024-09-21T05:54:21.070 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_top": 8, 2024-09-21T05:54:21.070 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_bottom": 9, 2024-09-21T05:54:21.070 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pin_tail": 11, 2024-09-21T05:54:21.070 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pinned": 14, 2024-09-21T05:54:21.070 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_expired": 1241, 2024-09-21T05:54:21.070 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_with_caps": 0, 2024-09-21T05:54:21.070 INFO:teuthology.orchestra.run.smithi160.stdout: "caps": 0, 2024-09-21T05:54:21.070 INFO:teuthology.orchestra.run.smithi160.stdout: "subtrees": 6, 2024-09-21T05:54:21.070 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse": 2528, 2024-09-21T05:54:21.070 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_hit": 1574, 2024-09-21T05:54:21.070 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_forward": 90, 2024-09-21T05:54:21.070 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_discover": 615, 2024-09-21T05:54:21.070 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_dir_fetch": 0, 2024-09-21T05:54:21.070 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_remote_ino": 0, 2024-09-21T05:54:21.070 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_lock": 0, 2024-09-21T05:54:21.071 INFO:teuthology.orchestra.run.smithi160.stdout: "load_cent": 0, 2024-09-21T05:54:21.071 INFO:teuthology.orchestra.run.smithi160.stdout: "q": 0, 2024-09-21T05:54:21.071 INFO:teuthology.orchestra.run.smithi160.stdout: "exported": 13, 2024-09-21T05:54:21.071 INFO:teuthology.orchestra.run.smithi160.stdout: "exported_inodes": 8, 2024-09-21T05:54:21.071 INFO:teuthology.orchestra.run.smithi160.stdout: "imported": 14, 2024-09-21T05:54:21.071 INFO:teuthology.orchestra.run.smithi160.stdout: "imported_inodes": 344, 2024-09-21T05:54:21.071 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_dir_fetch": 0, 2024-09-21T05:54:21.071 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_backtrace_fetch": 0, 2024-09-21T05:54:21.071 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_peer_discover": 0, 2024-09-21T05:54:21.071 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rfiles": 1896, 2024-09-21T05:54:21.071 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rbytes": 105867378, 2024-09-21T05:54:21.071 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rsnaps": 0, 2024-09-21T05:54:21.071 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T05:54:21.071 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_set_tag": 0, 2024-09-21T05:54:21.071 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T05:54:21.071 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_inotable_repaired": 0, 2024-09-21T05:54:21.072 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_inodes": 0, 2024-09-21T05:54:21.072 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T05:54:21.072 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T05:54:21.072 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_file_inodes": 0, 2024-09-21T05:54:21.072 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_inode_file_caps": 0, 2024-09-21T05:54:21.072 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_revoke": 144, 2024-09-21T05:54:21.072 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_grant": 477, 2024-09-21T05:54:21.072 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T05:54:21.072 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T05:54:21.072 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T05:54:21.072 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps": 559, 2024-09-21T05:54:21.072 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps_dirty": 358, 2024-09-21T05:54:21.072 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_cap_release": 25, 2024-09-21T05:54:21.072 INFO:teuthology.orchestra.run.smithi160.stdout: "process_request_cap_release": 787 2024-09-21T05:54:21.072 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.072 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_cache": { 2024-09-21T05:54:21.073 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update": 110, 2024-09-21T05:54:21.073 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update_receipt": 1997, 2024-09-21T05:54:21.073 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_try_discover": 1299, 2024-09-21T05:54:21.073 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_send_discover": 1370, 2024-09-21T05:54:21.073 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_handle_discover": 129, 2024-09-21T05:54:21.073 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays": 1, 2024-09-21T05:54:21.073 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_delayed": 0, 2024-09-21T05:54:21.073 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_enqueuing": 0, 2024-09-21T05:54:21.073 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_created": 377, 2024-09-21T05:54:21.073 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_enqueued": 376, 2024-09-21T05:54:21.073 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_reintegrated": 0, 2024-09-21T05:54:21.073 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_migrated": 0, 2024-09-21T05:54:21.073 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_processing": 0, 2024-09-21T05:54:21.073 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_enqueued": 0, 2024-09-21T05:54:21.073 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_prioritized": 0, 2024-09-21T05:54:21.073 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_started": 0, 2024-09-21T05:54:21.074 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_completed": 0, 2024-09-21T05:54:21.074 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_quiesce_path": 4, 2024-09-21T05:54:21.074 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_quiesce_inode": 709, 2024-09-21T05:54:21.074 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T05:54:21.074 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_exportdir": 13, 2024-09-21T05:54:21.074 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_flush": 0, 2024-09-21T05:54:21.074 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragmentdir": 0, 2024-09-21T05:54:21.074 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragstats": 0, 2024-09-21T05:54:21.074 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_inodestats": 0, 2024-09-21T05:54:21.074 INFO:teuthology.orchestra.run.smithi160.stdout: "uninline_started": 0, 2024-09-21T05:54:21.074 INFO:teuthology.orchestra.run.smithi160.stdout: "uninline_succeeded": 0, 2024-09-21T05:54:21.074 INFO:teuthology.orchestra.run.smithi160.stdout: "uninline_write_failed": 0 2024-09-21T05:54:21.074 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.074 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_log": { 2024-09-21T05:54:21.075 INFO:teuthology.orchestra.run.smithi160.stdout: "evlrg": 0, 2024-09-21T05:54:21.075 INFO:teuthology.orchestra.run.smithi160.stdout: "evadd": 1338, 2024-09-21T05:54:21.075 INFO:teuthology.orchestra.run.smithi160.stdout: "evex": 0, 2024-09-21T05:54:21.075 INFO:teuthology.orchestra.run.smithi160.stdout: "evtrm": 0, 2024-09-21T05:54:21.075 INFO:teuthology.orchestra.run.smithi160.stdout: "ev": 1338, 2024-09-21T05:54:21.075 INFO:teuthology.orchestra.run.smithi160.stdout: "evexg": 0, 2024-09-21T05:54:21.075 INFO:teuthology.orchestra.run.smithi160.stdout: "evexd": 0, 2024-09-21T05:54:21.075 INFO:teuthology.orchestra.run.smithi160.stdout: "segadd": 3, 2024-09-21T05:54:21.075 INFO:teuthology.orchestra.run.smithi160.stdout: "segex": 0, 2024-09-21T05:54:21.075 INFO:teuthology.orchestra.run.smithi160.stdout: "segtrm": 0, 2024-09-21T05:54:21.075 INFO:teuthology.orchestra.run.smithi160.stdout: "seg": 3, 2024-09-21T05:54:21.075 INFO:teuthology.orchestra.run.smithi160.stdout: "segmjr": 2, 2024-09-21T05:54:21.075 INFO:teuthology.orchestra.run.smithi160.stdout: "segexg": 0, 2024-09-21T05:54:21.075 INFO:teuthology.orchestra.run.smithi160.stdout: "segexd": 0, 2024-09-21T05:54:21.075 INFO:teuthology.orchestra.run.smithi160.stdout: "expos": 4194304, 2024-09-21T05:54:21.075 INFO:teuthology.orchestra.run.smithi160.stdout: "wrpos": 6598840, 2024-09-21T05:54:21.076 INFO:teuthology.orchestra.run.smithi160.stdout: "rdpos": 0, 2024-09-21T05:54:21.076 INFO:teuthology.orchestra.run.smithi160.stdout: "jlat": { 2024-09-21T05:54:21.076 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 194, 2024-09-21T05:54:21.076 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.450237847, 2024-09-21T05:54:21.076 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.002320813 2024-09-21T05:54:21.076 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.076 INFO:teuthology.orchestra.run.smithi160.stdout: "replayed": 0 2024-09-21T05:54:21.076 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.076 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_mem": { 2024-09-21T05:54:21.076 INFO:teuthology.orchestra.run.smithi160.stdout: "ino": 33, 2024-09-21T05:54:21.076 INFO:teuthology.orchestra.run.smithi160.stdout: "ino+": 1030, 2024-09-21T05:54:21.076 INFO:teuthology.orchestra.run.smithi160.stdout: "ino-": 997, 2024-09-21T05:54:21.076 INFO:teuthology.orchestra.run.smithi160.stdout: "dir": 32, 2024-09-21T05:54:21.076 INFO:teuthology.orchestra.run.smithi160.stdout: "dir+": 788, 2024-09-21T05:54:21.076 INFO:teuthology.orchestra.run.smithi160.stdout: "dir-": 756, 2024-09-21T05:54:21.076 INFO:teuthology.orchestra.run.smithi160.stdout: "dn": 28, 2024-09-21T05:54:21.076 INFO:teuthology.orchestra.run.smithi160.stdout: "dn+": 1979, 2024-09-21T05:54:21.077 INFO:teuthology.orchestra.run.smithi160.stdout: "dn-": 1951, 2024-09-21T05:54:21.077 INFO:teuthology.orchestra.run.smithi160.stdout: "cap": 0, 2024-09-21T05:54:21.077 INFO:teuthology.orchestra.run.smithi160.stdout: "cap+": 397, 2024-09-21T05:54:21.077 INFO:teuthology.orchestra.run.smithi160.stdout: "cap-": 397, 2024-09-21T05:54:21.077 INFO:teuthology.orchestra.run.smithi160.stdout: "rss": 129292, 2024-09-21T05:54:21.077 INFO:teuthology.orchestra.run.smithi160.stdout: "heap": 338575360 2024-09-21T05:54:21.077 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.077 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_server": { 2024-09-21T05:54:21.077 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_client_request": 1052, 2024-09-21T05:54:21.077 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_server_request": 56, 2024-09-21T05:54:21.077 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_request": 718, 2024-09-21T05:54:21.077 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_session": 5, 2024-09-21T05:54:21.077 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_peer_request": 214, 2024-09-21T05:54:21.077 INFO:teuthology.orchestra.run.smithi160.stdout: "req_create_latency": { 2024-09-21T05:54:21.077 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 33, 2024-09-21T05:54:21.078 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.064379448, 2024-09-21T05:54:21.078 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.001950892 2024-09-21T05:54:21.078 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.078 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getattr_latency": { 2024-09-21T05:54:21.078 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:21.078 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:21.078 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:21.078 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.078 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getfilelock_latency": { 2024-09-21T05:54:21.078 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:21.078 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:21.078 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:21.078 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.078 INFO:teuthology.orchestra.run.smithi160.stdout: "req_link_latency": { 2024-09-21T05:54:21.078 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:21.078 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:21.079 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:21.079 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.079 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookup_latency": { 2024-09-21T05:54:21.079 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 188, 2024-09-21T05:54:21.079 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.104125648, 2024-09-21T05:54:21.079 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000553859 2024-09-21T05:54:21.079 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.079 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookuphash_latency": { 2024-09-21T05:54:21.079 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:21.079 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:21.079 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:21.079 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.079 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupino_latency": { 2024-09-21T05:54:21.079 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:21.079 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:21.079 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:21.080 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.080 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupname_latency": { 2024-09-21T05:54:21.080 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:21.080 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:21.080 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:21.080 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.080 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupparent_latency": { 2024-09-21T05:54:21.080 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:21.080 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:21.080 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:21.080 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.080 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupsnap_latency": { 2024-09-21T05:54:21.080 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:21.080 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:21.081 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:21.081 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.081 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lssnap_latency": { 2024-09-21T05:54:21.081 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:21.081 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:21.081 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:21.081 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.081 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mkdir_latency": { 2024-09-21T05:54:21.081 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:21.081 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:21.082 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:21.082 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.082 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mknod_latency": { 2024-09-21T05:54:21.082 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:21.082 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:21.082 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:21.082 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.082 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mksnap_latency": { 2024-09-21T05:54:21.082 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:21.082 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:21.082 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:21.082 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.082 INFO:teuthology.orchestra.run.smithi160.stdout: "req_open_latency": { 2024-09-21T05:54:21.082 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:21.082 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:21.083 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:21.083 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.083 INFO:teuthology.orchestra.run.smithi160.stdout: "req_readdir_latency": { 2024-09-21T05:54:21.083 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 29, 2024-09-21T05:54:21.083 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.075399830, 2024-09-21T05:54:21.083 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.002599994 2024-09-21T05:54:21.083 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.083 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rename_latency": { 2024-09-21T05:54:21.083 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:21.083 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:21.083 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:21.083 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.083 INFO:teuthology.orchestra.run.smithi160.stdout: "req_renamesnap_latency": { 2024-09-21T05:54:21.083 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:21.083 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:21.083 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:21.084 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.084 INFO:teuthology.orchestra.run.smithi160.stdout: "req_snapdiff_latency": { 2024-09-21T05:54:21.084 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:21.084 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:21.084 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:21.084 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.084 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmdir_latency": { 2024-09-21T05:54:21.084 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 4, 2024-09-21T05:54:21.084 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.164993380, 2024-09-21T05:54:21.084 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.041248345 2024-09-21T05:54:21.084 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.084 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmsnap_latency": { 2024-09-21T05:54:21.084 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:21.084 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:21.084 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:21.085 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.085 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmxattr_latency": { 2024-09-21T05:54:21.085 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:21.085 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:21.085 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:21.085 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.085 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setattr_latency": { 2024-09-21T05:54:21.085 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:21.085 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:21.085 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:21.085 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.085 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setdirlayout_latency": { 2024-09-21T05:54:21.085 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:21.085 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:21.085 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:21.085 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.085 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setfilelock_latency": { 2024-09-21T05:54:21.086 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:21.086 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:21.086 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:21.086 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.086 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setlayout_latency": { 2024-09-21T05:54:21.086 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:21.086 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:21.086 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:21.086 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.086 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setxattr_latency": { 2024-09-21T05:54:21.086 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:21.086 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:21.086 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:21.086 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.087 INFO:teuthology.orchestra.run.smithi160.stdout: "req_symlink_latency": { 2024-09-21T05:54:21.087 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:21.087 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:21.087 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:21.087 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.087 INFO:teuthology.orchestra.run.smithi160.stdout: "req_unlink_latency": { 2024-09-21T05:54:21.087 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 373, 2024-09-21T05:54:21.087 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.523102160, 2024-09-21T05:54:21.087 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.001402418 2024-09-21T05:54:21.087 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.087 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_revoke_eviction": 0, 2024-09-21T05:54:21.087 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_acquisition_throttle": 0, 2024-09-21T05:54:21.087 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getvxattr_latency": { 2024-09-21T05:54:21.087 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:21.087 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:21.087 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:21.088 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:21.088 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.088 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_sessions": { 2024-09-21T05:54:21.088 INFO:teuthology.orchestra.run.smithi160.stdout: "session_count": 1, 2024-09-21T05:54:21.088 INFO:teuthology.orchestra.run.smithi160.stdout: "session_add": 1, 2024-09-21T05:54:21.088 INFO:teuthology.orchestra.run.smithi160.stdout: "session_remove": 0, 2024-09-21T05:54:21.088 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_open": 1, 2024-09-21T05:54:21.088 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_stale": 0, 2024-09-21T05:54:21.088 INFO:teuthology.orchestra.run.smithi160.stdout: "total_load": 515, 2024-09-21T05:54:21.088 INFO:teuthology.orchestra.run.smithi160.stdout: "average_load": 515, 2024-09-21T05:54:21.088 INFO:teuthology.orchestra.run.smithi160.stdout: "avg_session_uptime": 283, 2024-09-21T05:54:21.088 INFO:teuthology.orchestra.run.smithi160.stdout: "mdthresh_evicted": 0 2024-09-21T05:54:21.088 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.088 INFO:teuthology.orchestra.run.smithi160.stdout: "mempool": { 2024-09-21T05:54:21.088 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_bytes": 0, 2024-09-21T05:54:21.088 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_items": 0, 2024-09-21T05:54:21.089 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T05:54:21.089 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_items": 0, 2024-09-21T05:54:21.089 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T05:54:21.089 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_items": 0, 2024-09-21T05:54:21.089 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T05:54:21.089 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T05:54:21.089 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T05:54:21.089 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T05:54:21.089 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T05:54:21.089 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_items": 0, 2024-09-21T05:54:21.089 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T05:54:21.089 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T05:54:21.089 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_bytes": 0, 2024-09-21T05:54:21.089 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_items": 0, 2024-09-21T05:54:21.089 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_bytes": 0, 2024-09-21T05:54:21.089 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_items": 0, 2024-09-21T05:54:21.089 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T05:54:21.090 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T05:54:21.090 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T05:54:21.090 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T05:54:21.090 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T05:54:21.090 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_items": 0, 2024-09-21T05:54:21.090 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_bytes": 0, 2024-09-21T05:54:21.090 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_items": 0, 2024-09-21T05:54:21.090 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T05:54:21.090 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T05:54:21.090 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_bytes": 0, 2024-09-21T05:54:21.090 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_items": 0, 2024-09-21T05:54:21.090 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_bytes": 0, 2024-09-21T05:54:21.090 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_items": 0, 2024-09-21T05:54:21.090 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T05:54:21.090 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_items": 0, 2024-09-21T05:54:21.091 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T05:54:21.091 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_items": 0, 2024-09-21T05:54:21.091 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_bytes": 295687, 2024-09-21T05:54:21.091 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_items": 109, 2024-09-21T05:54:21.091 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_bytes": 0, 2024-09-21T05:54:21.091 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_items": 0, 2024-09-21T05:54:21.091 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_bytes": 0, 2024-09-21T05:54:21.091 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_items": 0, 2024-09-21T05:54:21.091 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_bytes": 0, 2024-09-21T05:54:21.091 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_items": 0, 2024-09-21T05:54:21.091 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_bytes": 0, 2024-09-21T05:54:21.091 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_items": 0, 2024-09-21T05:54:21.091 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_bytes": 9144, 2024-09-21T05:54:21.091 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_items": 172, 2024-09-21T05:54:21.091 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T05:54:21.091 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_items": 0, 2024-09-21T05:54:21.091 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_bytes": 0, 2024-09-21T05:54:21.092 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_items": 0, 2024-09-21T05:54:21.092 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_bytes": 137398, 2024-09-21T05:54:21.092 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_items": 713, 2024-09-21T05:54:21.092 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_bytes": 0, 2024-09-21T05:54:21.092 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_items": 0, 2024-09-21T05:54:21.092 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_bytes": 0, 2024-09-21T05:54:21.092 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_items": 0 2024-09-21T05:54:21.092 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.092 INFO:teuthology.orchestra.run.smithi160.stdout: "objecter": { 2024-09-21T05:54:21.092 INFO:teuthology.orchestra.run.smithi160.stdout: "op_active": 0, 2024-09-21T05:54:21.092 INFO:teuthology.orchestra.run.smithi160.stdout: "op_laggy": 0, 2024-09-21T05:54:21.092 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send": 1135, 2024-09-21T05:54:21.092 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send_bytes": 2499238, 2024-09-21T05:54:21.092 INFO:teuthology.orchestra.run.smithi160.stdout: "op_resend": 27, 2024-09-21T05:54:21.092 INFO:teuthology.orchestra.run.smithi160.stdout: "op_reply": 1135, 2024-09-21T05:54:21.092 INFO:teuthology.orchestra.run.smithi160.stdout: "op_latency": { 2024-09-21T05:54:21.093 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1135, 2024-09-21T05:54:21.093 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 4.382936668, 2024-09-21T05:54:21.093 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.003861618 2024-09-21T05:54:21.093 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.093 INFO:teuthology.orchestra.run.smithi160.stdout: "op_inflight": 0, 2024-09-21T05:54:21.093 INFO:teuthology.orchestra.run.smithi160.stdout: "oplen_avg": { 2024-09-21T05:54:21.093 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1135, 2024-09-21T05:54:21.093 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 1225 2024-09-21T05:54:21.093 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.093 INFO:teuthology.orchestra.run.smithi160.stdout: "op": 1135, 2024-09-21T05:54:21.093 INFO:teuthology.orchestra.run.smithi160.stdout: "op_r": 31, 2024-09-21T05:54:21.093 INFO:teuthology.orchestra.run.smithi160.stdout: "op_w": 1104, 2024-09-21T05:54:21.093 INFO:teuthology.orchestra.run.smithi160.stdout: "op_rmw": 0, 2024-09-21T05:54:21.093 INFO:teuthology.orchestra.run.smithi160.stdout: "op_pg": 0, 2024-09-21T05:54:21.094 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_stat": 0, 2024-09-21T05:54:21.094 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_create": 10, 2024-09-21T05:54:21.094 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_read": 31, 2024-09-21T05:54:21.094 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_write": 225, 2024-09-21T05:54:21.094 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writefull": 34, 2024-09-21T05:54:21.094 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writesame": 0, 2024-09-21T05:54:21.094 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_append": 0, 2024-09-21T05:54:21.094 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_zero": 0, 2024-09-21T05:54:21.094 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_truncate": 0, 2024-09-21T05:54:21.094 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_delete": 769, 2024-09-21T05:54:21.094 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_mapext": 0, 2024-09-21T05:54:21.094 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_sparse_read": 0, 2024-09-21T05:54:21.094 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_clonerange": 0, 2024-09-21T05:54:21.095 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_getxattr": 0, 2024-09-21T05:54:21.095 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_setxattr": 20, 2024-09-21T05:54:21.095 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_cmpxattr": 0, 2024-09-21T05:54:21.095 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_rmxattr": 0, 2024-09-21T05:54:21.095 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_resetxattrs": 0, 2024-09-21T05:54:21.095 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_call": 0, 2024-09-21T05:54:21.095 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_watch": 0, 2024-09-21T05:54:21.095 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_notify": 0, 2024-09-21T05:54:21.095 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T05:54:21.095 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls": 0, 2024-09-21T05:54:21.095 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls_filter": 0, 2024-09-21T05:54:21.095 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_other": 0, 2024-09-21T05:54:21.095 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_active": 0, 2024-09-21T05:54:21.095 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_send": 0, 2024-09-21T05:54:21.095 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_resend": 0, 2024-09-21T05:54:21.096 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_ping": 0, 2024-09-21T05:54:21.096 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_active": 0, 2024-09-21T05:54:21.096 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_send": 0, 2024-09-21T05:54:21.096 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_resend": 0, 2024-09-21T05:54:21.096 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_active": 0, 2024-09-21T05:54:21.096 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_send": 0, 2024-09-21T05:54:21.096 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_resend": 0, 2024-09-21T05:54:21.096 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_active": 0, 2024-09-21T05:54:21.096 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_send": 0, 2024-09-21T05:54:21.096 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_resend": 0, 2024-09-21T05:54:21.096 INFO:teuthology.orchestra.run.smithi160.stdout: "command_active": 0, 2024-09-21T05:54:21.096 INFO:teuthology.orchestra.run.smithi160.stdout: "command_send": 0, 2024-09-21T05:54:21.096 INFO:teuthology.orchestra.run.smithi160.stdout: "command_resend": 0, 2024-09-21T05:54:21.096 INFO:teuthology.orchestra.run.smithi160.stdout: "map_epoch": 85, 2024-09-21T05:54:21.096 INFO:teuthology.orchestra.run.smithi160.stdout: "map_full": 0, 2024-09-21T05:54:21.097 INFO:teuthology.orchestra.run.smithi160.stdout: "map_inc": 2, 2024-09-21T05:54:21.097 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_sessions": 12, 2024-09-21T05:54:21.097 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_open": 12, 2024-09-21T05:54:21.097 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_close": 0, 2024-09-21T05:54:21.097 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_laggy": 0, 2024-09-21T05:54:21.097 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_wr": 96, 2024-09-21T05:54:21.097 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_rd": 0, 2024-09-21T05:54:21.097 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_del": 40 2024-09-21T05:54:21.097 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.097 INFO:teuthology.orchestra.run.smithi160.stdout: "oft": { 2024-09-21T05:54:21.097 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_objs": 1, 2024-09-21T05:54:21.097 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_kv_pairs": 0, 2024-09-21T05:54:21.097 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_updates": 0, 2024-09-21T05:54:21.097 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_removes": 0 2024-09-21T05:54:21.097 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.098 INFO:teuthology.orchestra.run.smithi160.stdout: "purge_queue": { 2024-09-21T05:54:21.098 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops": 0, 2024-09-21T05:54:21.098 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops_high_water": 10, 2024-09-21T05:54:21.098 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing": 0, 2024-09-21T05:54:21.098 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_high_water": 5, 2024-09-21T05:54:21.098 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executed_ops": 757, 2024-09-21T05:54:21.098 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executed": 376, 2024-09-21T05:54:21.098 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_item_in_journal": 0 2024-09-21T05:54:21.098 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.098 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T05:54:21.098 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-21T05:54:21.098 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2024-09-21T05:54:21.098 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-21T05:54:21.098 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 24174, 2024-09-21T05:54:21.099 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 7681116, 2024-09-21T05:54:21.099 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:21.099 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 24174, 2024-09-21T05:54:21.099 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-09-21T05:54:21.099 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-09-21T05:54:21.099 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 24174, 2024-09-21T05:54:21.099 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 7681116, 2024-09-21T05:54:21.099 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-21T05:54:21.099 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:21.099 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:21.099 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:21.099 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:21.099 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.099 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_bytes": { 2024-09-21T05:54:21.099 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-21T05:54:21.100 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2024-09-21T05:54:21.100 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-21T05:54:21.100 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-09-21T05:54:21.100 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-09-21T05:54:21.100 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:21.100 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-09-21T05:54:21.100 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 1135, 2024-09-21T05:54:21.100 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 2540206, 2024-09-21T05:54:21.100 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 1135, 2024-09-21T05:54:21.100 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 2540206, 2024-09-21T05:54:21.100 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-21T05:54:21.100 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:21.100 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:21.100 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:21.100 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:21.101 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.101 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_ops": { 2024-09-21T05:54:21.101 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-21T05:54:21.101 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 1024, 2024-09-21T05:54:21.101 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-21T05:54:21.101 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-09-21T05:54:21.101 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-09-21T05:54:21.101 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:21.101 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-09-21T05:54:21.101 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 1135, 2024-09-21T05:54:21.101 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 1135, 2024-09-21T05:54:21.101 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 1135, 2024-09-21T05:54:21.101 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 1135, 2024-09-21T05:54:21.101 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-21T05:54:21.101 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:21.101 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:21.102 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:21.102 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:21.102 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.102 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle": { 2024-09-21T05:54:21.102 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-21T05:54:21.102 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2024-09-21T05:54:21.102 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-21T05:54:21.102 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 376, 2024-09-21T05:54:21.102 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 40968, 2024-09-21T05:54:21.102 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:21.102 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 376, 2024-09-21T05:54:21.102 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-09-21T05:54:21.102 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-09-21T05:54:21.102 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 31, 2024-09-21T05:54:21.103 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 40968, 2024-09-21T05:54:21.103 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-21T05:54:21.103 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:21.103 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:21.103 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:21.103 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:21.103 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.103 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle-0x5605990bf450": { 2024-09-21T05:54:21.103 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-21T05:54:21.103 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2024-09-21T05:54:21.103 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-21T05:54:21.103 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 1338, 2024-09-21T05:54:21.103 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 2404536, 2024-09-21T05:54:21.103 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:21.104 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 1338, 2024-09-21T05:54:21.104 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-09-21T05:54:21.104 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-09-21T05:54:21.104 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 194, 2024-09-21T05:54:21.104 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 2404536, 2024-09-21T05:54:21.104 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-21T05:54:21.104 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:21.104 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:21.104 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:21.104 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:21.104 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:21.104 INFO:teuthology.orchestra.run.smithi160.stdout: "trackedop": { 2024-09-21T05:54:21.104 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_ops_count": 713 2024-09-21T05:54:21.104 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:21.104 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-21T05:54:21.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:21 smithi160 ceph-mon[33979]: pgmap v516: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T05:54:21.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:21 smithi070 ceph-mon[30981]: pgmap v516: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T05:54:21.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:21 smithi116 ceph-mon[34332]: pgmap v516: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T05:54:21.955 INFO:tasks.check_counter:Daemon mds.c mds.exported=13 2024-09-21T05:54:21.955 INFO:tasks.check_counter:Daemon mds.c mds.imported=14 2024-09-21T05:54:21.955 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=110 2024-09-21T05:54:21.955 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=1997 2024-09-21T05:54:21.955 DEBUG:tasks.check_counter:Getting stats from f 2024-09-21T05:54:21.955 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph daemon mds.f perf dump 2024-09-21T05:54:22.224 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:54:22.761 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-21T05:54:22.761 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T05:54:22.761 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 817, 2024-09-21T05:54:22.762 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 1114, 2024-09-21T05:54:22.762 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 314177, 2024-09-21T05:54:22.762 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 1240469, 2024-09-21T05:54:22.762 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 17, 2024-09-21T05:54:22.762 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 6, 2024-09-21T05:54:22.762 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.074939689, 2024-09-21T05:54:22.762 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.034340149, 2024-09-21T05:54:22.762 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.036789576, 2024-09-21T05:54:22.763 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.006060289, 2024-09-21T05:54:22.763 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:22.763 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1111, 2024-09-21T05:54:22.763 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.067764929, 2024-09-21T05:54:22.763 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000060994 2024-09-21T05:54:22.763 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.763 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:22.763 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1345, 2024-09-21T05:54:22.763 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000277547, 2024-09-21T05:54:22.763 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000206 2024-09-21T05:54:22.764 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.764 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T05:54:22.764 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T05:54:22.764 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.764 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T05:54:22.764 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 17845, 2024-09-21T05:54:22.764 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 8844, 2024-09-21T05:54:22.764 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 7303952, 2024-09-21T05:54:22.764 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 1809194, 2024-09-21T05:54:22.765 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 8, 2024-09-21T05:54:22.765 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 6, 2024-09-21T05:54:22.765 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.907649170, 2024-09-21T05:54:22.765 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.403310309, 2024-09-21T05:54:22.765 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.676773924, 2024-09-21T05:54:22.765 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.004942766, 2024-09-21T05:54:22.765 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:22.765 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 8845, 2024-09-21T05:54:22.765 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.184644464, 2024-09-21T05:54:22.765 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000020875 2024-09-21T05:54:22.766 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.766 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:22.766 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 25873, 2024-09-21T05:54:22.766 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.004037440, 2024-09-21T05:54:22.766 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000156 2024-09-21T05:54:22.766 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.766 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 916544, 2024-09-21T05:54:22.767 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 83824 2024-09-21T05:54:22.767 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.767 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T05:54:22.767 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 3789, 2024-09-21T05:54:22.767 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 2062, 2024-09-21T05:54:22.767 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 1500754, 2024-09-21T05:54:22.767 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 687378, 2024-09-21T05:54:22.767 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 9, 2024-09-21T05:54:22.767 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 6, 2024-09-21T05:54:22.768 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.221729591, 2024-09-21T05:54:22.768 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.109188824, 2024-09-21T05:54:22.768 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.143624564, 2024-09-21T05:54:22.768 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.003874479, 2024-09-21T05:54:22.768 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:22.768 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 2060, 2024-09-21T05:54:22.768 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.061310205, 2024-09-21T05:54:22.768 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000029762 2024-09-21T05:54:22.768 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.768 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:22.768 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 5482, 2024-09-21T05:54:22.769 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000819687, 2024-09-21T05:54:22.769 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000149 2024-09-21T05:54:22.769 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.769 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 3536, 2024-09-21T05:54:22.769 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 241504 2024-09-21T05:54:22.769 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.769 INFO:teuthology.orchestra.run.smithi160.stdout: "cct": { 2024-09-21T05:54:22.769 INFO:teuthology.orchestra.run.smithi160.stdout: "total_workers": 1, 2024-09-21T05:54:22.769 INFO:teuthology.orchestra.run.smithi160.stdout: "unhealthy_workers": 0 2024-09-21T05:54:22.769 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.769 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-MDSRank": { 2024-09-21T05:54:22.769 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2024-09-21T05:54:22.769 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2024-09-21T05:54:22.770 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 272, 2024-09-21T05:54:22.770 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.128433974, 2024-09-21T05:54:22.770 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000472183 2024-09-21T05:54:22.770 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:22.770 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.770 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-PurgeQueue": { 2024-09-21T05:54:22.770 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2024-09-21T05:54:22.770 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2024-09-21T05:54:22.770 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 262, 2024-09-21T05:54:22.770 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.017177811, 2024-09-21T05:54:22.771 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000065564 2024-09-21T05:54:22.771 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:22.771 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.771 INFO:teuthology.orchestra.run.smithi160.stdout: "mds": { 2024-09-21T05:54:22.771 INFO:teuthology.orchestra.run.smithi160.stdout: "request": 292, 2024-09-21T05:54:22.771 INFO:teuthology.orchestra.run.smithi160.stdout: "reply": 206, 2024-09-21T05:54:22.771 INFO:teuthology.orchestra.run.smithi160.stdout: "reply_latency": { 2024-09-21T05:54:22.771 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 206, 2024-09-21T05:54:22.771 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.280332326, 2024-09-21T05:54:22.771 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.001360836 2024-09-21T05:54:22.771 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.772 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_reply": 0, 2024-09-21T05:54:22.772 INFO:teuthology.orchestra.run.smithi160.stdout: "forward": 86, 2024-09-21T05:54:22.772 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_complete": 0, 2024-09-21T05:54:22.772 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_keys": 0, 2024-09-21T05:54:22.772 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_commit": 11, 2024-09-21T05:54:22.772 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_split": 0, 2024-09-21T05:54:22.772 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_merge": 0, 2024-09-21T05:54:22.772 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes": 31, 2024-09-21T05:54:22.772 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_top": 11, 2024-09-21T05:54:22.773 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_bottom": 10, 2024-09-21T05:54:22.773 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pin_tail": 10, 2024-09-21T05:54:22.773 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pinned": 13, 2024-09-21T05:54:22.773 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_expired": 1237, 2024-09-21T05:54:22.773 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_with_caps": 0, 2024-09-21T05:54:22.773 INFO:teuthology.orchestra.run.smithi160.stdout: "caps": 0, 2024-09-21T05:54:22.773 INFO:teuthology.orchestra.run.smithi160.stdout: "subtrees": 6, 2024-09-21T05:54:22.773 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse": 1880, 2024-09-21T05:54:22.773 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_hit": 1071, 2024-09-21T05:54:22.773 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_forward": 85, 2024-09-21T05:54:22.774 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_discover": 613, 2024-09-21T05:54:22.774 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_dir_fetch": 0, 2024-09-21T05:54:22.774 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_remote_ino": 0, 2024-09-21T05:54:22.774 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_lock": 0, 2024-09-21T05:54:22.774 INFO:teuthology.orchestra.run.smithi160.stdout: "load_cent": 0, 2024-09-21T05:54:22.774 INFO:teuthology.orchestra.run.smithi160.stdout: "q": 0, 2024-09-21T05:54:22.774 INFO:teuthology.orchestra.run.smithi160.stdout: "exported": 7, 2024-09-21T05:54:22.774 INFO:teuthology.orchestra.run.smithi160.stdout: "exported_inodes": 4, 2024-09-21T05:54:22.774 INFO:teuthology.orchestra.run.smithi160.stdout: "imported": 7, 2024-09-21T05:54:22.774 INFO:teuthology.orchestra.run.smithi160.stdout: "imported_inodes": 87, 2024-09-21T05:54:22.774 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_dir_fetch": 0, 2024-09-21T05:54:22.774 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_backtrace_fetch": 0, 2024-09-21T05:54:22.774 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_peer_discover": 0, 2024-09-21T05:54:22.774 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rfiles": 1896, 2024-09-21T05:54:22.775 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rbytes": 105867378, 2024-09-21T05:54:22.775 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rsnaps": 0, 2024-09-21T05:54:22.775 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T05:54:22.775 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_set_tag": 0, 2024-09-21T05:54:22.775 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T05:54:22.775 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_inotable_repaired": 0, 2024-09-21T05:54:22.775 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_inodes": 0, 2024-09-21T05:54:22.775 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T05:54:22.775 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T05:54:22.775 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_file_inodes": 0, 2024-09-21T05:54:22.775 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_inode_file_caps": 0, 2024-09-21T05:54:22.775 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_revoke": 40, 2024-09-21T05:54:22.775 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_grant": 124, 2024-09-21T05:54:22.776 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T05:54:22.776 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T05:54:22.776 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T05:54:22.776 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps": 157, 2024-09-21T05:54:22.776 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps_dirty": 86, 2024-09-21T05:54:22.776 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_cap_release": 14, 2024-09-21T05:54:22.776 INFO:teuthology.orchestra.run.smithi160.stdout: "process_request_cap_release": 216 2024-09-21T05:54:22.776 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.776 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_cache": { 2024-09-21T05:54:22.776 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update": 41, 2024-09-21T05:54:22.776 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update_receipt": 2055, 2024-09-21T05:54:22.776 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_try_discover": 1331, 2024-09-21T05:54:22.776 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_send_discover": 1414, 2024-09-21T05:54:22.776 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_handle_discover": 50, 2024-09-21T05:54:22.777 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays": 0, 2024-09-21T05:54:22.777 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_delayed": 0, 2024-09-21T05:54:22.777 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_enqueuing": 0, 2024-09-21T05:54:22.777 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_created": 101, 2024-09-21T05:54:22.777 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_enqueued": 101, 2024-09-21T05:54:22.777 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_reintegrated": 0, 2024-09-21T05:54:22.777 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_migrated": 0, 2024-09-21T05:54:22.777 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_processing": 0, 2024-09-21T05:54:22.777 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_enqueued": 0, 2024-09-21T05:54:22.777 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_prioritized": 0, 2024-09-21T05:54:22.777 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_started": 0, 2024-09-21T05:54:22.777 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_completed": 0, 2024-09-21T05:54:22.777 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_quiesce_path": 4, 2024-09-21T05:54:22.777 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_quiesce_inode": 671, 2024-09-21T05:54:22.777 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T05:54:22.778 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_exportdir": 7, 2024-09-21T05:54:22.778 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_flush": 0, 2024-09-21T05:54:22.778 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragmentdir": 0, 2024-09-21T05:54:22.778 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragstats": 0, 2024-09-21T05:54:22.778 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_inodestats": 0, 2024-09-21T05:54:22.778 INFO:teuthology.orchestra.run.smithi160.stdout: "uninline_started": 0, 2024-09-21T05:54:22.778 INFO:teuthology.orchestra.run.smithi160.stdout: "uninline_succeeded": 0, 2024-09-21T05:54:22.778 INFO:teuthology.orchestra.run.smithi160.stdout: "uninline_write_failed": 0 2024-09-21T05:54:22.778 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.778 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_log": { 2024-09-21T05:54:22.779 INFO:teuthology.orchestra.run.smithi160.stdout: "evlrg": 0, 2024-09-21T05:54:22.779 INFO:teuthology.orchestra.run.smithi160.stdout: "evadd": 391, 2024-09-21T05:54:22.779 INFO:teuthology.orchestra.run.smithi160.stdout: "evex": 0, 2024-09-21T05:54:22.779 INFO:teuthology.orchestra.run.smithi160.stdout: "evtrm": 0, 2024-09-21T05:54:22.779 INFO:teuthology.orchestra.run.smithi160.stdout: "ev": 391, 2024-09-21T05:54:22.779 INFO:teuthology.orchestra.run.smithi160.stdout: "evexg": 0, 2024-09-21T05:54:22.779 INFO:teuthology.orchestra.run.smithi160.stdout: "evexd": 0, 2024-09-21T05:54:22.779 INFO:teuthology.orchestra.run.smithi160.stdout: "segadd": 2, 2024-09-21T05:54:22.779 INFO:teuthology.orchestra.run.smithi160.stdout: "segex": 0, 2024-09-21T05:54:22.779 INFO:teuthology.orchestra.run.smithi160.stdout: "segtrm": 0, 2024-09-21T05:54:22.779 INFO:teuthology.orchestra.run.smithi160.stdout: "seg": 2, 2024-09-21T05:54:22.779 INFO:teuthology.orchestra.run.smithi160.stdout: "segmjr": 2, 2024-09-21T05:54:22.780 INFO:teuthology.orchestra.run.smithi160.stdout: "segexg": 0, 2024-09-21T05:54:22.780 INFO:teuthology.orchestra.run.smithi160.stdout: "segexd": 0, 2024-09-21T05:54:22.780 INFO:teuthology.orchestra.run.smithi160.stdout: "expos": 4194304, 2024-09-21T05:54:22.780 INFO:teuthology.orchestra.run.smithi160.stdout: "wrpos": 4823229, 2024-09-21T05:54:22.780 INFO:teuthology.orchestra.run.smithi160.stdout: "rdpos": 0, 2024-09-21T05:54:22.780 INFO:teuthology.orchestra.run.smithi160.stdout: "jlat": { 2024-09-21T05:54:22.780 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 94, 2024-09-21T05:54:22.780 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.196547683, 2024-09-21T05:54:22.780 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.002090932 2024-09-21T05:54:22.780 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.781 INFO:teuthology.orchestra.run.smithi160.stdout: "replayed": 0 2024-09-21T05:54:22.781 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.781 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_mem": { 2024-09-21T05:54:22.781 INFO:teuthology.orchestra.run.smithi160.stdout: "ino": 38, 2024-09-21T05:54:22.781 INFO:teuthology.orchestra.run.smithi160.stdout: "ino+": 758, 2024-09-21T05:54:22.781 INFO:teuthology.orchestra.run.smithi160.stdout: "ino-": 720, 2024-09-21T05:54:22.781 INFO:teuthology.orchestra.run.smithi160.stdout: "dir": 37, 2024-09-21T05:54:22.781 INFO:teuthology.orchestra.run.smithi160.stdout: "dir+": 800, 2024-09-21T05:54:22.781 INFO:teuthology.orchestra.run.smithi160.stdout: "dir-": 763, 2024-09-21T05:54:22.781 INFO:teuthology.orchestra.run.smithi160.stdout: "dn": 31, 2024-09-21T05:54:22.781 INFO:teuthology.orchestra.run.smithi160.stdout: "dn+": 1452, 2024-09-21T05:54:22.781 INFO:teuthology.orchestra.run.smithi160.stdout: "dn-": 1421, 2024-09-21T05:54:22.781 INFO:teuthology.orchestra.run.smithi160.stdout: "cap": 0, 2024-09-21T05:54:22.781 INFO:teuthology.orchestra.run.smithi160.stdout: "cap+": 114, 2024-09-21T05:54:22.782 INFO:teuthology.orchestra.run.smithi160.stdout: "cap-": 114, 2024-09-21T05:54:22.782 INFO:teuthology.orchestra.run.smithi160.stdout: "rss": 125796, 2024-09-21T05:54:22.782 INFO:teuthology.orchestra.run.smithi160.stdout: "heap": 332152832 2024-09-21T05:54:22.782 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.782 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_server": { 2024-09-21T05:54:22.782 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_client_request": 435, 2024-09-21T05:54:22.782 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_server_request": 55, 2024-09-21T05:54:22.782 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_request": 292, 2024-09-21T05:54:22.782 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_session": 9, 2024-09-21T05:54:22.782 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_peer_request": 156, 2024-09-21T05:54:22.782 INFO:teuthology.orchestra.run.smithi160.stdout: "req_create_latency": { 2024-09-21T05:54:22.782 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 14, 2024-09-21T05:54:22.782 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.032239572, 2024-09-21T05:54:22.782 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.002302826 2024-09-21T05:54:22.782 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.783 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getattr_latency": { 2024-09-21T05:54:22.783 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1, 2024-09-21T05:54:22.783 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000222063, 2024-09-21T05:54:22.783 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000222063 2024-09-21T05:54:22.783 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.783 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getfilelock_latency": { 2024-09-21T05:54:22.783 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:22.783 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:22.783 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:22.783 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.783 INFO:teuthology.orchestra.run.smithi160.stdout: "req_link_latency": { 2024-09-21T05:54:22.783 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:22.783 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:22.783 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:22.784 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.784 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookup_latency": { 2024-09-21T05:54:22.784 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 78, 2024-09-21T05:54:22.784 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.042278367, 2024-09-21T05:54:22.784 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000542030 2024-09-21T05:54:22.784 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.784 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookuphash_latency": { 2024-09-21T05:54:22.784 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:22.784 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:22.784 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:22.784 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.784 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupino_latency": { 2024-09-21T05:54:22.784 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:22.784 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:22.784 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:22.785 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.785 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupname_latency": { 2024-09-21T05:54:22.785 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:22.785 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:22.785 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:22.785 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.785 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupparent_latency": { 2024-09-21T05:54:22.785 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:22.785 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:22.785 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:22.785 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.785 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupsnap_latency": { 2024-09-21T05:54:22.785 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:22.785 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:22.785 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:22.786 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.786 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lssnap_latency": { 2024-09-21T05:54:22.786 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:22.786 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:22.786 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:22.786 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.787 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mkdir_latency": { 2024-09-21T05:54:22.787 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:22.787 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:22.787 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:22.787 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.787 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mknod_latency": { 2024-09-21T05:54:22.787 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:22.787 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:22.787 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:22.787 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.787 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mksnap_latency": { 2024-09-21T05:54:22.787 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:22.787 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:22.787 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:22.788 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.788 INFO:teuthology.orchestra.run.smithi160.stdout: "req_open_latency": { 2024-09-21T05:54:22.788 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:22.788 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:22.788 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:22.788 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.788 INFO:teuthology.orchestra.run.smithi160.stdout: "req_readdir_latency": { 2024-09-21T05:54:22.788 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 12, 2024-09-21T05:54:22.788 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.007483836, 2024-09-21T05:54:22.788 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000623653 2024-09-21T05:54:22.788 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.788 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rename_latency": { 2024-09-21T05:54:22.788 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:22.788 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:22.789 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:22.789 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.789 INFO:teuthology.orchestra.run.smithi160.stdout: "req_renamesnap_latency": { 2024-09-21T05:54:22.789 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:22.789 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:22.789 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:22.789 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.789 INFO:teuthology.orchestra.run.smithi160.stdout: "req_snapdiff_latency": { 2024-09-21T05:54:22.789 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:22.789 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:22.789 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:22.789 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.789 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmdir_latency": { 2024-09-21T05:54:22.789 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 2, 2024-09-21T05:54:22.789 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.043325307, 2024-09-21T05:54:22.790 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.021662653 2024-09-21T05:54:22.790 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.790 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmsnap_latency": { 2024-09-21T05:54:22.790 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:22.790 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:22.790 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:22.790 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.790 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmxattr_latency": { 2024-09-21T05:54:22.790 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:22.790 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:22.790 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:22.790 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.790 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setattr_latency": { 2024-09-21T05:54:22.791 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:22.791 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:22.791 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:22.791 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.791 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setdirlayout_latency": { 2024-09-21T05:54:22.791 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:22.791 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:22.791 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:22.791 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.791 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setfilelock_latency": { 2024-09-21T05:54:22.791 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:22.791 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:22.791 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:22.791 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.792 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setlayout_latency": { 2024-09-21T05:54:22.792 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:22.792 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:22.792 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:22.792 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.792 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setxattr_latency": { 2024-09-21T05:54:22.792 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:22.792 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:22.792 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:22.792 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.792 INFO:teuthology.orchestra.run.smithi160.stdout: "req_symlink_latency": { 2024-09-21T05:54:22.792 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:22.792 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:22.792 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:22.793 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.793 INFO:teuthology.orchestra.run.smithi160.stdout: "req_unlink_latency": { 2024-09-21T05:54:22.793 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 99, 2024-09-21T05:54:22.793 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.154783181, 2024-09-21T05:54:22.793 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.001563466 2024-09-21T05:54:22.793 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.793 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_revoke_eviction": 0, 2024-09-21T05:54:22.793 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_acquisition_throttle": 0, 2024-09-21T05:54:22.793 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getvxattr_latency": { 2024-09-21T05:54:22.793 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:22.793 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:22.793 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:22.793 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:22.793 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.793 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_sessions": { 2024-09-21T05:54:22.794 INFO:teuthology.orchestra.run.smithi160.stdout: "session_count": 1, 2024-09-21T05:54:22.794 INFO:teuthology.orchestra.run.smithi160.stdout: "session_add": 2, 2024-09-21T05:54:22.794 INFO:teuthology.orchestra.run.smithi160.stdout: "session_remove": 1, 2024-09-21T05:54:22.794 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_open": 1, 2024-09-21T05:54:22.794 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_stale": 0, 2024-09-21T05:54:22.794 INFO:teuthology.orchestra.run.smithi160.stdout: "total_load": 159, 2024-09-21T05:54:22.794 INFO:teuthology.orchestra.run.smithi160.stdout: "average_load": 159, 2024-09-21T05:54:22.794 INFO:teuthology.orchestra.run.smithi160.stdout: "avg_session_uptime": 286, 2024-09-21T05:54:22.794 INFO:teuthology.orchestra.run.smithi160.stdout: "mdthresh_evicted": 0 2024-09-21T05:54:22.794 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.794 INFO:teuthology.orchestra.run.smithi160.stdout: "mempool": { 2024-09-21T05:54:22.794 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_bytes": 0, 2024-09-21T05:54:22.794 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_items": 0, 2024-09-21T05:54:22.794 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T05:54:22.795 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_items": 0, 2024-09-21T05:54:22.795 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T05:54:22.795 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_items": 0, 2024-09-21T05:54:22.795 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T05:54:22.795 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T05:54:22.795 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T05:54:22.795 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T05:54:22.795 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T05:54:22.795 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_items": 0, 2024-09-21T05:54:22.795 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T05:54:22.795 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T05:54:22.795 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_bytes": 0, 2024-09-21T05:54:22.795 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_items": 0, 2024-09-21T05:54:22.795 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_bytes": 0, 2024-09-21T05:54:22.795 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_items": 0, 2024-09-21T05:54:22.796 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T05:54:22.796 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T05:54:22.796 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T05:54:22.796 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T05:54:22.796 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T05:54:22.796 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_items": 0, 2024-09-21T05:54:22.796 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_bytes": 0, 2024-09-21T05:54:22.796 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_items": 0, 2024-09-21T05:54:22.796 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T05:54:22.796 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T05:54:22.796 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_bytes": 0, 2024-09-21T05:54:22.796 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_items": 0, 2024-09-21T05:54:22.796 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_bytes": 0, 2024-09-21T05:54:22.796 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_items": 0, 2024-09-21T05:54:22.797 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T05:54:22.797 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_items": 0, 2024-09-21T05:54:22.797 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T05:54:22.797 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_items": 0, 2024-09-21T05:54:22.797 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_bytes": 295111, 2024-09-21T05:54:22.797 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_items": 100, 2024-09-21T05:54:22.797 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_bytes": 0, 2024-09-21T05:54:22.797 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_items": 0, 2024-09-21T05:54:22.797 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_bytes": 0, 2024-09-21T05:54:22.797 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_items": 0, 2024-09-21T05:54:22.797 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_bytes": 0, 2024-09-21T05:54:22.797 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_items": 0, 2024-09-21T05:54:22.797 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_bytes": 0, 2024-09-21T05:54:22.798 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_items": 0, 2024-09-21T05:54:22.798 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_bytes": 9144, 2024-09-21T05:54:22.798 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_items": 172, 2024-09-21T05:54:22.798 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T05:54:22.798 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_items": 0, 2024-09-21T05:54:22.798 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_bytes": 0, 2024-09-21T05:54:22.798 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_items": 0, 2024-09-21T05:54:22.798 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_bytes": 156137, 2024-09-21T05:54:22.798 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_items": 598, 2024-09-21T05:54:22.798 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_bytes": 0, 2024-09-21T05:54:22.798 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_items": 0, 2024-09-21T05:54:22.798 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_bytes": 0, 2024-09-21T05:54:22.799 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_items": 0 2024-09-21T05:54:22.799 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.799 INFO:teuthology.orchestra.run.smithi160.stdout: "objecter": { 2024-09-21T05:54:22.799 INFO:teuthology.orchestra.run.smithi160.stdout: "op_active": 0, 2024-09-21T05:54:22.799 INFO:teuthology.orchestra.run.smithi160.stdout: "op_laggy": 0, 2024-09-21T05:54:22.799 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send": 430, 2024-09-21T05:54:22.799 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send_bytes": 661248, 2024-09-21T05:54:22.799 INFO:teuthology.orchestra.run.smithi160.stdout: "op_resend": 33, 2024-09-21T05:54:22.799 INFO:teuthology.orchestra.run.smithi160.stdout: "op_reply": 430, 2024-09-21T05:54:22.799 INFO:teuthology.orchestra.run.smithi160.stdout: "op_latency": { 2024-09-21T05:54:22.799 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 430, 2024-09-21T05:54:22.799 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 1.364980276, 2024-09-21T05:54:22.799 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.003174372 2024-09-21T05:54:22.799 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.800 INFO:teuthology.orchestra.run.smithi160.stdout: "op_inflight": 0, 2024-09-21T05:54:22.800 INFO:teuthology.orchestra.run.smithi160.stdout: "oplen_avg": { 2024-09-21T05:54:22.800 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 430, 2024-09-21T05:54:22.800 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 493 2024-09-21T05:54:22.800 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.800 INFO:teuthology.orchestra.run.smithi160.stdout: "op": 430, 2024-09-21T05:54:22.800 INFO:teuthology.orchestra.run.smithi160.stdout: "op_r": 20, 2024-09-21T05:54:22.800 INFO:teuthology.orchestra.run.smithi160.stdout: "op_w": 410, 2024-09-21T05:54:22.800 INFO:teuthology.orchestra.run.smithi160.stdout: "op_rmw": 0, 2024-09-21T05:54:22.800 INFO:teuthology.orchestra.run.smithi160.stdout: "op_pg": 0, 2024-09-21T05:54:22.800 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_stat": 0, 2024-09-21T05:54:22.800 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_create": 10, 2024-09-21T05:54:22.800 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_read": 20, 2024-09-21T05:54:22.800 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_write": 114, 2024-09-21T05:54:22.800 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writefull": 28, 2024-09-21T05:54:22.800 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writesame": 0, 2024-09-21T05:54:22.801 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_append": 0, 2024-09-21T05:54:22.801 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_zero": 0, 2024-09-21T05:54:22.801 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_truncate": 0, 2024-09-21T05:54:22.801 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_delete": 212, 2024-09-21T05:54:22.801 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_mapext": 0, 2024-09-21T05:54:22.801 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_sparse_read": 0, 2024-09-21T05:54:22.801 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_clonerange": 0, 2024-09-21T05:54:22.801 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_getxattr": 0, 2024-09-21T05:54:22.801 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_setxattr": 20, 2024-09-21T05:54:22.801 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_cmpxattr": 0, 2024-09-21T05:54:22.801 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_rmxattr": 0, 2024-09-21T05:54:22.801 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_resetxattrs": 0, 2024-09-21T05:54:22.801 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_call": 0, 2024-09-21T05:54:22.801 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_watch": 0, 2024-09-21T05:54:22.801 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_notify": 0, 2024-09-21T05:54:22.801 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T05:54:22.802 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls": 0, 2024-09-21T05:54:22.802 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls_filter": 0, 2024-09-21T05:54:22.802 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_other": 0, 2024-09-21T05:54:22.802 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_active": 0, 2024-09-21T05:54:22.802 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_send": 0, 2024-09-21T05:54:22.802 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_resend": 0, 2024-09-21T05:54:22.802 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_ping": 0, 2024-09-21T05:54:22.802 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_active": 0, 2024-09-21T05:54:22.802 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_send": 0, 2024-09-21T05:54:22.802 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_resend": 0, 2024-09-21T05:54:22.802 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_active": 0, 2024-09-21T05:54:22.802 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_send": 0, 2024-09-21T05:54:22.802 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_resend": 0, 2024-09-21T05:54:22.802 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_active": 0, 2024-09-21T05:54:22.802 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_send": 0, 2024-09-21T05:54:22.803 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_resend": 0, 2024-09-21T05:54:22.803 INFO:teuthology.orchestra.run.smithi160.stdout: "command_active": 0, 2024-09-21T05:54:22.803 INFO:teuthology.orchestra.run.smithi160.stdout: "command_send": 0, 2024-09-21T05:54:22.803 INFO:teuthology.orchestra.run.smithi160.stdout: "command_resend": 0, 2024-09-21T05:54:22.803 INFO:teuthology.orchestra.run.smithi160.stdout: "map_epoch": 85, 2024-09-21T05:54:22.803 INFO:teuthology.orchestra.run.smithi160.stdout: "map_full": 0, 2024-09-21T05:54:22.803 INFO:teuthology.orchestra.run.smithi160.stdout: "map_inc": 2, 2024-09-21T05:54:22.803 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_sessions": 12, 2024-09-21T05:54:22.803 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_open": 12, 2024-09-21T05:54:22.803 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_close": 0, 2024-09-21T05:54:22.803 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_laggy": 0, 2024-09-21T05:54:22.803 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_wr": 65, 2024-09-21T05:54:22.803 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_rd": 0, 2024-09-21T05:54:22.803 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_del": 24 2024-09-21T05:54:22.803 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.804 INFO:teuthology.orchestra.run.smithi160.stdout: "oft": { 2024-09-21T05:54:22.804 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_objs": 1, 2024-09-21T05:54:22.804 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_kv_pairs": 0, 2024-09-21T05:54:22.804 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_updates": 0, 2024-09-21T05:54:22.804 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_removes": 0 2024-09-21T05:54:22.804 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.804 INFO:teuthology.orchestra.run.smithi160.stdout: "purge_queue": { 2024-09-21T05:54:22.804 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops": 0, 2024-09-21T05:54:22.804 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops_high_water": 10, 2024-09-21T05:54:22.804 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing": 0, 2024-09-21T05:54:22.804 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_high_water": 5, 2024-09-21T05:54:22.804 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executed_ops": 200, 2024-09-21T05:54:22.804 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executed": 101, 2024-09-21T05:54:22.804 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_item_in_journal": 0 2024-09-21T05:54:22.804 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.805 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T05:54:22.805 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-21T05:54:22.805 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2024-09-21T05:54:22.805 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-21T05:54:22.805 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 22447, 2024-09-21T05:54:22.805 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 7086059, 2024-09-21T05:54:22.805 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:22.805 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 22447, 2024-09-21T05:54:22.805 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-09-21T05:54:22.805 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-09-21T05:54:22.805 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 22447, 2024-09-21T05:54:22.805 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 7086059, 2024-09-21T05:54:22.805 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-21T05:54:22.805 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:22.805 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:22.805 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:22.806 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:22.806 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.806 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_bytes": { 2024-09-21T05:54:22.806 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-21T05:54:22.806 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2024-09-21T05:54:22.806 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-21T05:54:22.806 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-09-21T05:54:22.806 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-09-21T05:54:22.806 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:22.806 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-09-21T05:54:22.806 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 430, 2024-09-21T05:54:22.806 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 672241, 2024-09-21T05:54:22.806 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 430, 2024-09-21T05:54:22.806 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 672241, 2024-09-21T05:54:22.806 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-21T05:54:22.807 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:22.807 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:22.807 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:22.807 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:22.807 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.807 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_ops": { 2024-09-21T05:54:22.807 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-21T05:54:22.807 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 1024, 2024-09-21T05:54:22.807 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-21T05:54:22.807 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-09-21T05:54:22.807 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-09-21T05:54:22.807 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:22.807 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-09-21T05:54:22.808 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 430, 2024-09-21T05:54:22.808 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 430, 2024-09-21T05:54:22.808 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 430, 2024-09-21T05:54:22.808 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 430, 2024-09-21T05:54:22.808 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-21T05:54:22.808 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:22.808 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:22.808 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:22.808 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:22.808 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.808 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle": { 2024-09-21T05:54:22.808 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-21T05:54:22.808 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2024-09-21T05:54:22.808 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-21T05:54:22.809 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 101, 2024-09-21T05:54:22.809 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 10993, 2024-09-21T05:54:22.809 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:22.809 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 101, 2024-09-21T05:54:22.809 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-09-21T05:54:22.809 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-09-21T05:54:22.809 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 20, 2024-09-21T05:54:22.809 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 10993, 2024-09-21T05:54:22.809 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-21T05:54:22.809 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:22.809 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:22.809 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:22.809 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:22.809 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.810 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle-0x5576fa503520": { 2024-09-21T05:54:22.810 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-21T05:54:22.810 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2024-09-21T05:54:22.810 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-21T05:54:22.810 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 391, 2024-09-21T05:54:22.810 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 628925, 2024-09-21T05:54:22.810 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:22.810 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 391, 2024-09-21T05:54:22.810 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-09-21T05:54:22.810 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-09-21T05:54:22.810 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 94, 2024-09-21T05:54:22.810 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 628925, 2024-09-21T05:54:22.810 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-21T05:54:22.810 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:22.810 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:22.811 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:22.811 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:22.811 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:22.811 INFO:teuthology.orchestra.run.smithi160.stdout: "trackedop": { 2024-09-21T05:54:22.811 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_ops_count": 675 2024-09-21T05:54:22.811 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:22.811 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-21T05:54:23.512 INFO:tasks.check_counter:Daemon mds.f mds.exported=7 2024-09-21T05:54:23.512 INFO:tasks.check_counter:Daemon mds.f mds.imported=7 2024-09-21T05:54:23.512 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=41 2024-09-21T05:54:23.512 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=2055 2024-09-21T05:54:23.512 DEBUG:tasks.check_counter:Getting stats from i 2024-09-21T05:54:23.512 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph daemon mds.i perf dump 2024-09-21T05:54:23.648 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:23 smithi160 ceph-mon[33979]: pgmap v517: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T05:54:23.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:23 smithi070 ceph-mon[30981]: pgmap v517: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T05:54:23.764 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:54:23.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:23 smithi116 ceph-mon[34332]: pgmap v517: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T05:54:24.295 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-21T05:54:24.296 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T05:54:24.296 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 23603, 2024-09-21T05:54:24.296 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 18097, 2024-09-21T05:54:24.296 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 9885411, 2024-09-21T05:54:24.296 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 17611180, 2024-09-21T05:54:24.296 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 11, 2024-09-21T05:54:24.296 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 7, 2024-09-21T05:54:24.296 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 1.500589693, 2024-09-21T05:54:24.296 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.727178579, 2024-09-21T05:54:24.296 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.903377333, 2024-09-21T05:54:24.296 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.061750422, 2024-09-21T05:54:24.296 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:24.297 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 18097, 2024-09-21T05:54:24.297 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.503757715, 2024-09-21T05:54:24.297 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000027836 2024-09-21T05:54:24.297 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.297 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:24.297 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 37714, 2024-09-21T05:54:24.297 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.006499672, 2024-09-21T05:54:24.297 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000172 2024-09-21T05:54:24.297 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.297 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 933488, 2024-09-21T05:54:24.297 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 82032 2024-09-21T05:54:24.297 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.297 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T05:54:24.297 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 9194, 2024-09-21T05:54:24.297 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 17055, 2024-09-21T05:54:24.298 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 2817134, 2024-09-21T05:54:24.298 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 8855095, 2024-09-21T05:54:24.298 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 13, 2024-09-21T05:54:24.298 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 8, 2024-09-21T05:54:24.298 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.910195844, 2024-09-21T05:54:24.298 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.512280853, 2024-09-21T05:54:24.298 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.390424307, 2024-09-21T05:54:24.298 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.045358853, 2024-09-21T05:54:24.298 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:24.298 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 17053, 2024-09-21T05:54:24.298 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.577349744, 2024-09-21T05:54:24.298 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000033856 2024-09-21T05:54:24.298 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.299 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:24.299 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 21697, 2024-09-21T05:54:24.299 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.004034776, 2024-09-21T05:54:24.299 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000185 2024-09-21T05:54:24.299 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.299 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T05:54:24.299 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 238448 2024-09-21T05:54:24.299 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.299 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T05:54:24.299 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 3495, 2024-09-21T05:54:24.299 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 5323, 2024-09-21T05:54:24.299 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 988599, 2024-09-21T05:54:24.299 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 2418885, 2024-09-21T05:54:24.299 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 9, 2024-09-21T05:54:24.300 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 7, 2024-09-21T05:54:24.300 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.361268395, 2024-09-21T05:54:24.300 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.173200624, 2024-09-21T05:54:24.300 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.133733301, 2024-09-21T05:54:24.300 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.048863517, 2024-09-21T05:54:24.300 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:24.300 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 5321, 2024-09-21T05:54:24.300 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.224281689, 2024-09-21T05:54:24.300 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000042150 2024-09-21T05:54:24.300 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.300 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:24.300 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 5426, 2024-09-21T05:54:24.300 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.001300000, 2024-09-21T05:54:24.300 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000239 2024-09-21T05:54:24.300 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.301 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 928, 2024-09-21T05:54:24.301 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 736 2024-09-21T05:54:24.301 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.301 INFO:teuthology.orchestra.run.smithi160.stdout: "cct": { 2024-09-21T05:54:24.301 INFO:teuthology.orchestra.run.smithi160.stdout: "total_workers": 1, 2024-09-21T05:54:24.301 INFO:teuthology.orchestra.run.smithi160.stdout: "unhealthy_workers": 0 2024-09-21T05:54:24.301 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.301 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-MDSRank": { 2024-09-21T05:54:24.301 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2024-09-21T05:54:24.301 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2024-09-21T05:54:24.301 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1325, 2024-09-21T05:54:24.301 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 2.598937434, 2024-09-21T05:54:24.301 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.001961462 2024-09-21T05:54:24.301 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:24.301 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.302 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-PurgeQueue": { 2024-09-21T05:54:24.302 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2024-09-21T05:54:24.302 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2024-09-21T05:54:24.302 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 3230, 2024-09-21T05:54:24.302 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.497529181, 2024-09-21T05:54:24.302 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000154033 2024-09-21T05:54:24.302 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:24.302 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.302 INFO:teuthology.orchestra.run.smithi160.stdout: "mds": { 2024-09-21T05:54:24.302 INFO:teuthology.orchestra.run.smithi160.stdout: "request": 3952, 2024-09-21T05:54:24.302 INFO:teuthology.orchestra.run.smithi160.stdout: "reply": 3851, 2024-09-21T05:54:24.302 INFO:teuthology.orchestra.run.smithi160.stdout: "reply_latency": { 2024-09-21T05:54:24.303 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 3851, 2024-09-21T05:54:24.303 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 6.295429691, 2024-09-21T05:54:24.303 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.001634751 2024-09-21T05:54:24.303 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.303 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_reply": 0, 2024-09-21T05:54:24.303 INFO:teuthology.orchestra.run.smithi160.stdout: "forward": 101, 2024-09-21T05:54:24.303 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_complete": 0, 2024-09-21T05:54:24.303 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_keys": 0, 2024-09-21T05:54:24.303 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_commit": 20, 2024-09-21T05:54:24.303 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_split": 1, 2024-09-21T05:54:24.303 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_merge": 0, 2024-09-21T05:54:24.303 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes": 92, 2024-09-21T05:54:24.303 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_top": 39, 2024-09-21T05:54:24.303 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_bottom": 23, 2024-09-21T05:54:24.304 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pin_tail": 30, 2024-09-21T05:54:24.304 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pinned": 33, 2024-09-21T05:54:24.304 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_expired": 1038, 2024-09-21T05:54:24.304 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_with_caps": 2, 2024-09-21T05:54:24.304 INFO:teuthology.orchestra.run.smithi160.stdout: "caps": 2, 2024-09-21T05:54:24.304 INFO:teuthology.orchestra.run.smithi160.stdout: "subtrees": 6, 2024-09-21T05:54:24.304 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse": 7268, 2024-09-21T05:54:24.304 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_hit": 5824, 2024-09-21T05:54:24.304 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_forward": 75, 2024-09-21T05:54:24.304 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_discover": 525, 2024-09-21T05:54:24.304 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_dir_fetch": 0, 2024-09-21T05:54:24.304 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_remote_ino": 0, 2024-09-21T05:54:24.304 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_lock": 0, 2024-09-21T05:54:24.304 INFO:teuthology.orchestra.run.smithi160.stdout: "load_cent": 0, 2024-09-21T05:54:24.304 INFO:teuthology.orchestra.run.smithi160.stdout: "q": 0, 2024-09-21T05:54:24.305 INFO:teuthology.orchestra.run.smithi160.stdout: "exported": 19, 2024-09-21T05:54:24.305 INFO:teuthology.orchestra.run.smithi160.stdout: "exported_inodes": 80, 2024-09-21T05:54:24.305 INFO:teuthology.orchestra.run.smithi160.stdout: "imported": 69, 2024-09-21T05:54:24.305 INFO:teuthology.orchestra.run.smithi160.stdout: "imported_inodes": 1340, 2024-09-21T05:54:24.305 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_dir_fetch": 0, 2024-09-21T05:54:24.305 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_backtrace_fetch": 0, 2024-09-21T05:54:24.305 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_peer_discover": 0, 2024-09-21T05:54:24.305 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rfiles": 1896, 2024-09-21T05:54:24.305 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rbytes": 105867378, 2024-09-21T05:54:24.305 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rsnaps": 0, 2024-09-21T05:54:24.305 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T05:54:24.305 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_set_tag": 0, 2024-09-21T05:54:24.305 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T05:54:24.305 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_inotable_repaired": 0, 2024-09-21T05:54:24.306 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_inodes": 0, 2024-09-21T05:54:24.306 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T05:54:24.306 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T05:54:24.306 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_file_inodes": 0, 2024-09-21T05:54:24.306 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_inode_file_caps": 80, 2024-09-21T05:54:24.306 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_revoke": 560, 2024-09-21T05:54:24.306 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_grant": 2373, 2024-09-21T05:54:24.306 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T05:54:24.306 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T05:54:24.306 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T05:54:24.306 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps": 2313, 2024-09-21T05:54:24.306 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps_dirty": 1678, 2024-09-21T05:54:24.306 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_cap_release": 40, 2024-09-21T05:54:24.307 INFO:teuthology.orchestra.run.smithi160.stdout: "process_request_cap_release": 3917 2024-09-21T05:54:24.307 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.307 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_cache": { 2024-09-21T05:54:24.307 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update": 563, 2024-09-21T05:54:24.307 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update_receipt": 1569, 2024-09-21T05:54:24.307 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_try_discover": 1018, 2024-09-21T05:54:24.307 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_send_discover": 1113, 2024-09-21T05:54:24.307 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_handle_discover": 1112, 2024-09-21T05:54:24.307 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays": 20, 2024-09-21T05:54:24.307 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_delayed": 0, 2024-09-21T05:54:24.307 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_enqueuing": 0, 2024-09-21T05:54:24.307 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_created": 1720, 2024-09-21T05:54:24.308 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_enqueued": 1700, 2024-09-21T05:54:24.308 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_reintegrated": 0, 2024-09-21T05:54:24.308 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_migrated": 0, 2024-09-21T05:54:24.308 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_processing": 0, 2024-09-21T05:54:24.308 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_enqueued": 0, 2024-09-21T05:54:24.308 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_prioritized": 0, 2024-09-21T05:54:24.308 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_started": 0, 2024-09-21T05:54:24.308 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_completed": 0, 2024-09-21T05:54:24.308 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_quiesce_path": 4, 2024-09-21T05:54:24.308 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_quiesce_inode": 783, 2024-09-21T05:54:24.308 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T05:54:24.308 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_exportdir": 19, 2024-09-21T05:54:24.308 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_flush": 0, 2024-09-21T05:54:24.308 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragmentdir": 1, 2024-09-21T05:54:24.309 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragstats": 0, 2024-09-21T05:54:24.309 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_inodestats": 0, 2024-09-21T05:54:24.309 INFO:teuthology.orchestra.run.smithi160.stdout: "uninline_started": 0, 2024-09-21T05:54:24.309 INFO:teuthology.orchestra.run.smithi160.stdout: "uninline_succeeded": 0, 2024-09-21T05:54:24.309 INFO:teuthology.orchestra.run.smithi160.stdout: "uninline_write_failed": 0 2024-09-21T05:54:24.309 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.309 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_log": { 2024-09-21T05:54:24.309 INFO:teuthology.orchestra.run.smithi160.stdout: "evlrg": 0, 2024-09-21T05:54:24.309 INFO:teuthology.orchestra.run.smithi160.stdout: "evadd": 6157, 2024-09-21T05:54:24.309 INFO:teuthology.orchestra.run.smithi160.stdout: "evex": 0, 2024-09-21T05:54:24.309 INFO:teuthology.orchestra.run.smithi160.stdout: "evtrm": 0, 2024-09-21T05:54:24.309 INFO:teuthology.orchestra.run.smithi160.stdout: "ev": 6157, 2024-09-21T05:54:24.309 INFO:teuthology.orchestra.run.smithi160.stdout: "evexg": 0, 2024-09-21T05:54:24.309 INFO:teuthology.orchestra.run.smithi160.stdout: "evexd": 0, 2024-09-21T05:54:24.309 INFO:teuthology.orchestra.run.smithi160.stdout: "segadd": 8, 2024-09-21T05:54:24.310 INFO:teuthology.orchestra.run.smithi160.stdout: "segex": 0, 2024-09-21T05:54:24.310 INFO:teuthology.orchestra.run.smithi160.stdout: "segtrm": 0, 2024-09-21T05:54:24.310 INFO:teuthology.orchestra.run.smithi160.stdout: "seg": 8, 2024-09-21T05:54:24.310 INFO:teuthology.orchestra.run.smithi160.stdout: "segmjr": 2, 2024-09-21T05:54:24.310 INFO:teuthology.orchestra.run.smithi160.stdout: "segexg": 0, 2024-09-21T05:54:24.310 INFO:teuthology.orchestra.run.smithi160.stdout: "segexd": 0, 2024-09-21T05:54:24.310 INFO:teuthology.orchestra.run.smithi160.stdout: "expos": 4194304, 2024-09-21T05:54:24.310 INFO:teuthology.orchestra.run.smithi160.stdout: "wrpos": 16669655, 2024-09-21T05:54:24.310 INFO:teuthology.orchestra.run.smithi160.stdout: "rdpos": 0, 2024-09-21T05:54:24.310 INFO:teuthology.orchestra.run.smithi160.stdout: "jlat": { 2024-09-21T05:54:24.310 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 689, 2024-09-21T05:54:24.310 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 5.030691798, 2024-09-21T05:54:24.310 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.007301439 2024-09-21T05:54:24.310 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.311 INFO:teuthology.orchestra.run.smithi160.stdout: "replayed": 0 2024-09-21T05:54:24.311 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.311 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_mem": { 2024-09-21T05:54:24.311 INFO:teuthology.orchestra.run.smithi160.stdout: "ino": 54, 2024-09-21T05:54:24.311 INFO:teuthology.orchestra.run.smithi160.stdout: "ino+": 2316, 2024-09-21T05:54:24.311 INFO:teuthology.orchestra.run.smithi160.stdout: "ino-": 2262, 2024-09-21T05:54:24.311 INFO:teuthology.orchestra.run.smithi160.stdout: "dir": 53, 2024-09-21T05:54:24.311 INFO:teuthology.orchestra.run.smithi160.stdout: "dir+": 775, 2024-09-21T05:54:24.311 INFO:teuthology.orchestra.run.smithi160.stdout: "dir-": 722, 2024-09-21T05:54:24.311 INFO:teuthology.orchestra.run.smithi160.stdout: "dn": 92, 2024-09-21T05:54:24.311 INFO:teuthology.orchestra.run.smithi160.stdout: "dn+": 4440, 2024-09-21T05:54:24.311 INFO:teuthology.orchestra.run.smithi160.stdout: "dn-": 4348, 2024-09-21T05:54:24.311 INFO:teuthology.orchestra.run.smithi160.stdout: "cap": 2, 2024-09-21T05:54:24.311 INFO:teuthology.orchestra.run.smithi160.stdout: "cap+": 1818, 2024-09-21T05:54:24.311 INFO:teuthology.orchestra.run.smithi160.stdout: "cap-": 1816, 2024-09-21T05:54:24.312 INFO:teuthology.orchestra.run.smithi160.stdout: "rss": 140028, 2024-09-21T05:54:24.312 INFO:teuthology.orchestra.run.smithi160.stdout: "heap": 348930048 2024-09-21T05:54:24.312 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.312 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_server": { 2024-09-21T05:54:24.312 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_client_request": 5633, 2024-09-21T05:54:24.312 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_server_request": 152, 2024-09-21T05:54:24.312 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_request": 3952, 2024-09-21T05:54:24.312 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_session": 16, 2024-09-21T05:54:24.312 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_peer_request": 594, 2024-09-21T05:54:24.312 INFO:teuthology.orchestra.run.smithi160.stdout: "req_create_latency": { 2024-09-21T05:54:24.312 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 429, 2024-09-21T05:54:24.312 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.623165229, 2024-09-21T05:54:24.312 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.001452599 2024-09-21T05:54:24.313 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.313 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getattr_latency": { 2024-09-21T05:54:24.313 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 3, 2024-09-21T05:54:24.313 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.002864695, 2024-09-21T05:54:24.313 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000954898 2024-09-21T05:54:24.313 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.313 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getfilelock_latency": { 2024-09-21T05:54:24.313 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:24.313 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:24.313 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:24.313 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.313 INFO:teuthology.orchestra.run.smithi160.stdout: "req_link_latency": { 2024-09-21T05:54:24.313 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:24.313 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:24.314 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:24.314 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.314 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookup_latency": { 2024-09-21T05:54:24.314 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1445, 2024-09-21T05:54:24.314 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.658504748, 2024-09-21T05:54:24.314 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000455712 2024-09-21T05:54:24.314 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.314 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookuphash_latency": { 2024-09-21T05:54:24.314 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:24.314 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:24.314 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:24.314 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.315 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupino_latency": { 2024-09-21T05:54:24.315 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:24.315 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:24.315 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:24.315 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.315 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupname_latency": { 2024-09-21T05:54:24.315 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:24.315 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:24.315 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:24.315 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.315 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupparent_latency": { 2024-09-21T05:54:24.315 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:24.315 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:24.315 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:24.316 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.316 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupsnap_latency": { 2024-09-21T05:54:24.316 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:24.316 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:24.316 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:24.317 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.317 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lssnap_latency": { 2024-09-21T05:54:24.317 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:24.317 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:24.317 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:24.317 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.317 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mkdir_latency": { 2024-09-21T05:54:24.317 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 36, 2024-09-21T05:54:24.317 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.034402137, 2024-09-21T05:54:24.317 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000955614 2024-09-21T05:54:24.317 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.317 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mknod_latency": { 2024-09-21T05:54:24.317 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:24.318 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:24.318 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:24.318 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.318 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mksnap_latency": { 2024-09-21T05:54:24.318 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:24.318 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:24.318 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:24.318 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.318 INFO:teuthology.orchestra.run.smithi160.stdout: "req_open_latency": { 2024-09-21T05:54:24.318 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:24.318 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:24.318 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:24.318 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.318 INFO:teuthology.orchestra.run.smithi160.stdout: "req_readdir_latency": { 2024-09-21T05:54:24.319 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 218, 2024-09-21T05:54:24.319 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.295687436, 2024-09-21T05:54:24.319 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.001356364 2024-09-21T05:54:24.319 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.319 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rename_latency": { 2024-09-21T05:54:24.319 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:24.319 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:24.319 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:24.319 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.319 INFO:teuthology.orchestra.run.smithi160.stdout: "req_renamesnap_latency": { 2024-09-21T05:54:24.319 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:24.319 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:24.319 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:24.320 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.320 INFO:teuthology.orchestra.run.smithi160.stdout: "req_snapdiff_latency": { 2024-09-21T05:54:24.320 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:24.320 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:24.320 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:24.320 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.320 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmdir_latency": { 2024-09-21T05:54:24.320 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 138, 2024-09-21T05:54:24.320 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 2.234438148, 2024-09-21T05:54:24.320 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.016191580 2024-09-21T05:54:24.320 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.320 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmsnap_latency": { 2024-09-21T05:54:24.320 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:24.320 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:24.320 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:24.321 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.321 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmxattr_latency": { 2024-09-21T05:54:24.321 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:24.321 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:24.321 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:24.321 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.321 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setattr_latency": { 2024-09-21T05:54:24.321 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:24.321 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:24.322 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:24.322 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.322 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setdirlayout_latency": { 2024-09-21T05:54:24.322 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:24.322 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:24.322 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:24.322 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.322 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setfilelock_latency": { 2024-09-21T05:54:24.322 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:24.322 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:24.322 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:24.322 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.322 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setlayout_latency": { 2024-09-21T05:54:24.322 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:24.323 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:24.323 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:24.323 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.323 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setxattr_latency": { 2024-09-21T05:54:24.323 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:24.323 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:24.323 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:24.323 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.323 INFO:teuthology.orchestra.run.smithi160.stdout: "req_symlink_latency": { 2024-09-21T05:54:24.323 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:24.324 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:24.324 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:24.324 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.324 INFO:teuthology.orchestra.run.smithi160.stdout: "req_unlink_latency": { 2024-09-21T05:54:24.324 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1582, 2024-09-21T05:54:24.324 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 2.446367298, 2024-09-21T05:54:24.324 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.001546376 2024-09-21T05:54:24.324 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.324 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_revoke_eviction": 0, 2024-09-21T05:54:24.324 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_acquisition_throttle": 0, 2024-09-21T05:54:24.324 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getvxattr_latency": { 2024-09-21T05:54:24.324 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:24.324 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:24.324 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:24.324 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:24.325 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.325 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_sessions": { 2024-09-21T05:54:24.325 INFO:teuthology.orchestra.run.smithi160.stdout: "session_count": 1, 2024-09-21T05:54:24.325 INFO:teuthology.orchestra.run.smithi160.stdout: "session_add": 2, 2024-09-21T05:54:24.325 INFO:teuthology.orchestra.run.smithi160.stdout: "session_remove": 1, 2024-09-21T05:54:24.325 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_open": 1, 2024-09-21T05:54:24.325 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_stale": 0, 2024-09-21T05:54:24.325 INFO:teuthology.orchestra.run.smithi160.stdout: "total_load": 3154, 2024-09-21T05:54:24.325 INFO:teuthology.orchestra.run.smithi160.stdout: "average_load": 3154, 2024-09-21T05:54:24.325 INFO:teuthology.orchestra.run.smithi160.stdout: "avg_session_uptime": 288, 2024-09-21T05:54:24.325 INFO:teuthology.orchestra.run.smithi160.stdout: "mdthresh_evicted": 0 2024-09-21T05:54:24.326 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.326 INFO:teuthology.orchestra.run.smithi160.stdout: "mempool": { 2024-09-21T05:54:24.326 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_bytes": 0, 2024-09-21T05:54:24.326 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_items": 0, 2024-09-21T05:54:24.326 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T05:54:24.326 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_items": 0, 2024-09-21T05:54:24.326 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T05:54:24.326 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_items": 0, 2024-09-21T05:54:24.326 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T05:54:24.326 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T05:54:24.326 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T05:54:24.326 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T05:54:24.327 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T05:54:24.327 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_items": 0, 2024-09-21T05:54:24.327 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T05:54:24.327 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T05:54:24.327 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_bytes": 0, 2024-09-21T05:54:24.327 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_items": 0, 2024-09-21T05:54:24.327 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_bytes": 0, 2024-09-21T05:54:24.327 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_items": 0, 2024-09-21T05:54:24.327 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T05:54:24.327 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T05:54:24.327 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T05:54:24.327 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T05:54:24.328 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T05:54:24.328 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_items": 0, 2024-09-21T05:54:24.328 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_bytes": 0, 2024-09-21T05:54:24.328 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_items": 0, 2024-09-21T05:54:24.328 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T05:54:24.328 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T05:54:24.328 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_bytes": 0, 2024-09-21T05:54:24.328 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_items": 0, 2024-09-21T05:54:24.328 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_bytes": 0, 2024-09-21T05:54:24.328 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_items": 0, 2024-09-21T05:54:24.328 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T05:54:24.328 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_items": 0, 2024-09-21T05:54:24.328 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T05:54:24.328 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_items": 0, 2024-09-21T05:54:24.328 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_bytes": 303799, 2024-09-21T05:54:24.329 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_items": 111, 2024-09-21T05:54:24.329 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_bytes": 0, 2024-09-21T05:54:24.329 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_items": 0, 2024-09-21T05:54:24.329 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_bytes": 0, 2024-09-21T05:54:24.329 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_items": 0, 2024-09-21T05:54:24.329 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_bytes": 0, 2024-09-21T05:54:24.329 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_items": 0, 2024-09-21T05:54:24.329 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_bytes": 0, 2024-09-21T05:54:24.329 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_items": 0, 2024-09-21T05:54:24.329 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_bytes": 9144, 2024-09-21T05:54:24.329 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_items": 172, 2024-09-21T05:54:24.329 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T05:54:24.329 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_items": 0, 2024-09-21T05:54:24.329 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_bytes": 0, 2024-09-21T05:54:24.330 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_items": 0, 2024-09-21T05:54:24.330 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_bytes": 265518, 2024-09-21T05:54:24.330 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_items": 4436, 2024-09-21T05:54:24.330 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_bytes": 0, 2024-09-21T05:54:24.330 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_items": 0, 2024-09-21T05:54:24.330 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_bytes": 0, 2024-09-21T05:54:24.330 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_items": 0 2024-09-21T05:54:24.330 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.330 INFO:teuthology.orchestra.run.smithi160.stdout: "objecter": { 2024-09-21T05:54:24.330 INFO:teuthology.orchestra.run.smithi160.stdout: "op_active": 0, 2024-09-21T05:54:24.330 INFO:teuthology.orchestra.run.smithi160.stdout: "op_laggy": 0, 2024-09-21T05:54:24.330 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send": 4328, 2024-09-21T05:54:24.330 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send_bytes": 12990410, 2024-09-21T05:54:24.331 INFO:teuthology.orchestra.run.smithi160.stdout: "op_resend": 28, 2024-09-21T05:54:24.331 INFO:teuthology.orchestra.run.smithi160.stdout: "op_reply": 4328, 2024-09-21T05:54:24.331 INFO:teuthology.orchestra.run.smithi160.stdout: "op_latency": { 2024-09-21T05:54:24.333 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 4328, 2024-09-21T05:54:24.333 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 13.986797832, 2024-09-21T05:54:24.334 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.003231700 2024-09-21T05:54:24.334 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.334 INFO:teuthology.orchestra.run.smithi160.stdout: "op_inflight": 0, 2024-09-21T05:54:24.334 INFO:teuthology.orchestra.run.smithi160.stdout: "oplen_avg": { 2024-09-21T05:54:24.334 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 4328, 2024-09-21T05:54:24.334 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 4451 2024-09-21T05:54:24.334 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.334 INFO:teuthology.orchestra.run.smithi160.stdout: "op": 4328, 2024-09-21T05:54:24.334 INFO:teuthology.orchestra.run.smithi160.stdout: "op_r": 87, 2024-09-21T05:54:24.334 INFO:teuthology.orchestra.run.smithi160.stdout: "op_w": 4241, 2024-09-21T05:54:24.334 INFO:teuthology.orchestra.run.smithi160.stdout: "op_rmw": 0, 2024-09-21T05:54:24.334 INFO:teuthology.orchestra.run.smithi160.stdout: "op_pg": 0, 2024-09-21T05:54:24.335 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_stat": 0, 2024-09-21T05:54:24.335 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_create": 10, 2024-09-21T05:54:24.335 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_read": 87, 2024-09-21T05:54:24.335 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_write": 776, 2024-09-21T05:54:24.335 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writefull": 61, 2024-09-21T05:54:24.335 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writesame": 0, 2024-09-21T05:54:24.335 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_append": 0, 2024-09-21T05:54:24.335 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_zero": 0, 2024-09-21T05:54:24.335 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_truncate": 1, 2024-09-21T05:54:24.335 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_delete": 3304, 2024-09-21T05:54:24.336 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_mapext": 0, 2024-09-21T05:54:24.336 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_sparse_read": 0, 2024-09-21T05:54:24.336 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_clonerange": 0, 2024-09-21T05:54:24.336 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_getxattr": 0, 2024-09-21T05:54:24.336 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_setxattr": 20, 2024-09-21T05:54:24.336 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_cmpxattr": 0, 2024-09-21T05:54:24.336 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_rmxattr": 0, 2024-09-21T05:54:24.336 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_resetxattrs": 0, 2024-09-21T05:54:24.336 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_call": 0, 2024-09-21T05:54:24.336 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_watch": 0, 2024-09-21T05:54:24.336 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_notify": 0, 2024-09-21T05:54:24.336 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T05:54:24.337 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls": 0, 2024-09-21T05:54:24.337 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls_filter": 0, 2024-09-21T05:54:24.337 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_other": 0, 2024-09-21T05:54:24.337 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_active": 0, 2024-09-21T05:54:24.337 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_send": 0, 2024-09-21T05:54:24.337 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_resend": 0, 2024-09-21T05:54:24.337 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_ping": 0, 2024-09-21T05:54:24.337 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_active": 0, 2024-09-21T05:54:24.337 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_send": 0, 2024-09-21T05:54:24.337 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_resend": 0, 2024-09-21T05:54:24.337 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_active": 0, 2024-09-21T05:54:24.337 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_send": 0, 2024-09-21T05:54:24.337 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_resend": 0, 2024-09-21T05:54:24.337 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_active": 0, 2024-09-21T05:54:24.337 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_send": 0, 2024-09-21T05:54:24.337 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_resend": 0, 2024-09-21T05:54:24.338 INFO:teuthology.orchestra.run.smithi160.stdout: "command_active": 0, 2024-09-21T05:54:24.338 INFO:teuthology.orchestra.run.smithi160.stdout: "command_send": 0, 2024-09-21T05:54:24.338 INFO:teuthology.orchestra.run.smithi160.stdout: "command_resend": 0, 2024-09-21T05:54:24.338 INFO:teuthology.orchestra.run.smithi160.stdout: "map_epoch": 85, 2024-09-21T05:54:24.338 INFO:teuthology.orchestra.run.smithi160.stdout: "map_full": 0, 2024-09-21T05:54:24.338 INFO:teuthology.orchestra.run.smithi160.stdout: "map_inc": 2, 2024-09-21T05:54:24.338 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_sessions": 12, 2024-09-21T05:54:24.338 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_open": 12, 2024-09-21T05:54:24.338 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_close": 0, 2024-09-21T05:54:24.338 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_laggy": 0, 2024-09-21T05:54:24.338 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_wr": 141, 2024-09-21T05:54:24.338 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_rd": 0, 2024-09-21T05:54:24.338 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_del": 51 2024-09-21T05:54:24.339 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.339 INFO:teuthology.orchestra.run.smithi160.stdout: "oft": { 2024-09-21T05:54:24.339 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_objs": 1, 2024-09-21T05:54:24.339 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_kv_pairs": 0, 2024-09-21T05:54:24.339 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_updates": 0, 2024-09-21T05:54:24.339 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_removes": 0 2024-09-21T05:54:24.339 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.339 INFO:teuthology.orchestra.run.smithi160.stdout: "purge_queue": { 2024-09-21T05:54:24.339 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops": 0, 2024-09-21T05:54:24.339 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops_high_water": 10, 2024-09-21T05:54:24.339 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing": 0, 2024-09-21T05:54:24.339 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_high_water": 9, 2024-09-21T05:54:24.339 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executed_ops": 3290, 2024-09-21T05:54:24.339 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executed": 1700, 2024-09-21T05:54:24.340 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_item_in_journal": 0 2024-09-21T05:54:24.340 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.340 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T05:54:24.340 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-21T05:54:24.340 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2024-09-21T05:54:24.340 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-21T05:54:24.340 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 36288, 2024-09-21T05:54:24.340 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 10413079, 2024-09-21T05:54:24.340 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:24.340 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 36288, 2024-09-21T05:54:24.340 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-09-21T05:54:24.340 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-09-21T05:54:24.340 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 36288, 2024-09-21T05:54:24.341 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 10413079, 2024-09-21T05:54:24.341 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-21T05:54:24.341 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:24.341 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:24.341 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:24.341 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:24.341 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.341 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_bytes": { 2024-09-21T05:54:24.341 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-21T05:54:24.341 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2024-09-21T05:54:24.341 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-21T05:54:24.341 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-09-21T05:54:24.341 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-09-21T05:54:24.341 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:24.342 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-09-21T05:54:24.342 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 4328, 2024-09-21T05:54:24.342 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 13174774, 2024-09-21T05:54:24.342 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 4328, 2024-09-21T05:54:24.342 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 13174774, 2024-09-21T05:54:24.342 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-21T05:54:24.342 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:24.342 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:24.342 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:24.342 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:24.342 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.342 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_ops": { 2024-09-21T05:54:24.342 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-21T05:54:24.342 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 1024, 2024-09-21T05:54:24.343 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-21T05:54:24.343 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-09-21T05:54:24.343 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-09-21T05:54:24.343 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:24.343 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-09-21T05:54:24.343 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 4328, 2024-09-21T05:54:24.343 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 4328, 2024-09-21T05:54:24.343 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 4328, 2024-09-21T05:54:24.343 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 4328, 2024-09-21T05:54:24.343 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-21T05:54:24.343 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:24.343 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:24.343 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:24.343 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:24.343 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.343 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle": { 2024-09-21T05:54:24.344 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-21T05:54:24.344 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2024-09-21T05:54:24.344 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-21T05:54:24.344 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 1700, 2024-09-21T05:54:24.344 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 184364, 2024-09-21T05:54:24.344 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:24.344 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 1700, 2024-09-21T05:54:24.344 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-09-21T05:54:24.344 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-09-21T05:54:24.344 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 87, 2024-09-21T05:54:24.344 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 184364, 2024-09-21T05:54:24.344 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-21T05:54:24.344 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:24.345 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:24.345 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:24.345 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:24.345 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.345 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle-0x5573dbd81520": { 2024-09-21T05:54:24.345 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-21T05:54:24.345 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2024-09-21T05:54:24.345 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-21T05:54:24.345 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 6157, 2024-09-21T05:54:24.345 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 12475351, 2024-09-21T05:54:24.345 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:24.345 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 6157, 2024-09-21T05:54:24.345 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-09-21T05:54:24.345 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-09-21T05:54:24.346 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 689, 2024-09-21T05:54:24.346 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 12475351, 2024-09-21T05:54:24.346 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-21T05:54:24.346 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:24.346 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:24.346 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:24.346 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:24.346 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:24.346 INFO:teuthology.orchestra.run.smithi160.stdout: "trackedop": { 2024-09-21T05:54:24.346 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_ops_count": 787 2024-09-21T05:54:24.346 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:24.346 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-21T05:54:25.111 INFO:tasks.check_counter:Daemon mds.i mds.exported=19 2024-09-21T05:54:25.112 INFO:tasks.check_counter:Daemon mds.i mds.imported=69 2024-09-21T05:54:25.112 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=563 2024-09-21T05:54:25.112 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=1569 2024-09-21T05:54:25.112 DEBUG:tasks.check_counter:Getting stats from l 2024-09-21T05:54:25.112 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph daemon mds.l perf dump 2024-09-21T05:54:25.362 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:54:25.681 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:25 smithi160 ceph-mon[33979]: pgmap v518: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T05:54:25.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:25 smithi070 ceph-mon[30981]: pgmap v518: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T05:54:25.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:25 smithi116 ceph-mon[34332]: pgmap v518: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T05:54:25.936 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-21T05:54:25.936 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T05:54:25.936 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 443, 2024-09-21T05:54:25.936 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 445, 2024-09-21T05:54:25.936 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 971808, 2024-09-21T05:54:25.936 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 140938, 2024-09-21T05:54:25.936 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 6, 2024-09-21T05:54:25.936 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 2, 2024-09-21T05:54:25.936 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.049491543, 2024-09-21T05:54:25.937 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.020625335, 2024-09-21T05:54:25.937 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.012227996, 2024-09-21T05:54:25.937 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.011909358, 2024-09-21T05:54:25.937 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:25.937 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 443, 2024-09-21T05:54:25.937 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.019626405, 2024-09-21T05:54:25.937 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000044303 2024-09-21T05:54:25.937 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.937 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:25.937 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.937 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.937 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.937 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.937 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T05:54:25.938 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T05:54:25.938 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.938 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T05:54:25.938 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 477, 2024-09-21T05:54:25.938 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 459, 2024-09-21T05:54:25.938 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 986630, 2024-09-21T05:54:25.938 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 182805, 2024-09-21T05:54:25.938 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 4, 2024-09-21T05:54:25.938 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 3, 2024-09-21T05:54:25.938 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.065415508, 2024-09-21T05:54:25.938 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.025296767, 2024-09-21T05:54:25.938 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.036599350, 2024-09-21T05:54:25.938 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.010862032, 2024-09-21T05:54:25.938 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:25.939 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 459, 2024-09-21T05:54:25.939 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.022584709, 2024-09-21T05:54:25.939 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000049204 2024-09-21T05:54:25.939 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.939 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:25.939 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.939 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.939 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.939 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.939 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 907888, 2024-09-21T05:54:25.939 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 81040 2024-09-21T05:54:25.939 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.939 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T05:54:25.939 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 396, 2024-09-21T05:54:25.940 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 494, 2024-09-21T05:54:25.940 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 132880, 2024-09-21T05:54:25.940 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 363114, 2024-09-21T05:54:25.940 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 4, 2024-09-21T05:54:25.940 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 3, 2024-09-21T05:54:25.940 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.064725348, 2024-09-21T05:54:25.940 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.029958657, 2024-09-21T05:54:25.940 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.013678267, 2024-09-21T05:54:25.940 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.015756601, 2024-09-21T05:54:25.940 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T05:54:25.940 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 492, 2024-09-21T05:54:25.940 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.027776728, 2024-09-21T05:54:25.940 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000056456 2024-09-21T05:54:25.940 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.940 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2024-09-21T05:54:25.941 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.941 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.941 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.941 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.941 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T05:54:25.941 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 237504 2024-09-21T05:54:25.941 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.941 INFO:teuthology.orchestra.run.smithi160.stdout: "cct": { 2024-09-21T05:54:25.941 INFO:teuthology.orchestra.run.smithi160.stdout: "total_workers": 1, 2024-09-21T05:54:25.941 INFO:teuthology.orchestra.run.smithi160.stdout: "unhealthy_workers": 0 2024-09-21T05:54:25.941 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.941 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-MDSRank": { 2024-09-21T05:54:25.941 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2024-09-21T05:54:25.941 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2024-09-21T05:54:25.941 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1950, 2024-09-21T05:54:25.942 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.061846345, 2024-09-21T05:54:25.942 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000031716 2024-09-21T05:54:25.942 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:25.942 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.942 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-PurgeQueue": { 2024-09-21T05:54:25.942 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2024-09-21T05:54:25.942 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2024-09-21T05:54:25.942 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.942 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.942 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.942 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:25.942 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.942 INFO:teuthology.orchestra.run.smithi160.stdout: "mds": { 2024-09-21T05:54:25.942 INFO:teuthology.orchestra.run.smithi160.stdout: "request": 0, 2024-09-21T05:54:25.942 INFO:teuthology.orchestra.run.smithi160.stdout: "reply": 0, 2024-09-21T05:54:25.943 INFO:teuthology.orchestra.run.smithi160.stdout: "reply_latency": { 2024-09-21T05:54:25.943 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.943 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.943 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.943 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.943 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_reply": 0, 2024-09-21T05:54:25.943 INFO:teuthology.orchestra.run.smithi160.stdout: "forward": 0, 2024-09-21T05:54:25.943 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_complete": 0, 2024-09-21T05:54:25.943 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_keys": 0, 2024-09-21T05:54:25.943 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_commit": 0, 2024-09-21T05:54:25.943 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_split": 0, 2024-09-21T05:54:25.943 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_merge": 0, 2024-09-21T05:54:25.943 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes": 135, 2024-09-21T05:54:25.943 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_top": 0, 2024-09-21T05:54:25.943 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_bottom": 135, 2024-09-21T05:54:25.944 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pin_tail": 0, 2024-09-21T05:54:25.944 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pinned": 135, 2024-09-21T05:54:25.944 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_expired": 0, 2024-09-21T05:54:25.944 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_with_caps": 0, 2024-09-21T05:54:25.944 INFO:teuthology.orchestra.run.smithi160.stdout: "caps": 0, 2024-09-21T05:54:25.944 INFO:teuthology.orchestra.run.smithi160.stdout: "subtrees": 1, 2024-09-21T05:54:25.944 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse": 0, 2024-09-21T05:54:25.944 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_hit": 0, 2024-09-21T05:54:25.944 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_forward": 0, 2024-09-21T05:54:25.944 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_discover": 0, 2024-09-21T05:54:25.944 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_dir_fetch": 0, 2024-09-21T05:54:25.944 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_remote_ino": 0, 2024-09-21T05:54:25.944 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_lock": 0, 2024-09-21T05:54:25.944 INFO:teuthology.orchestra.run.smithi160.stdout: "load_cent": 0, 2024-09-21T05:54:25.944 INFO:teuthology.orchestra.run.smithi160.stdout: "q": 0, 2024-09-21T05:54:25.945 INFO:teuthology.orchestra.run.smithi160.stdout: "exported": 0, 2024-09-21T05:54:25.945 INFO:teuthology.orchestra.run.smithi160.stdout: "exported_inodes": 0, 2024-09-21T05:54:25.945 INFO:teuthology.orchestra.run.smithi160.stdout: "imported": 0, 2024-09-21T05:54:25.945 INFO:teuthology.orchestra.run.smithi160.stdout: "imported_inodes": 0, 2024-09-21T05:54:25.945 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_dir_fetch": 0, 2024-09-21T05:54:25.945 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_backtrace_fetch": 0, 2024-09-21T05:54:25.945 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_peer_discover": 0, 2024-09-21T05:54:25.945 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rfiles": 0, 2024-09-21T05:54:25.945 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rbytes": 0, 2024-09-21T05:54:25.945 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rsnaps": 0, 2024-09-21T05:54:25.945 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T05:54:25.945 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_set_tag": 0, 2024-09-21T05:54:25.945 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T05:54:25.945 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_inotable_repaired": 0, 2024-09-21T05:54:25.945 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_inodes": 0, 2024-09-21T05:54:25.945 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T05:54:25.946 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T05:54:25.946 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_file_inodes": 0, 2024-09-21T05:54:25.946 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_inode_file_caps": 0, 2024-09-21T05:54:25.946 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T05:54:25.946 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_grant": 0, 2024-09-21T05:54:25.946 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T05:54:25.946 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T05:54:25.946 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T05:54:25.946 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps": 0, 2024-09-21T05:54:25.946 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps_dirty": 0, 2024-09-21T05:54:25.946 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_cap_release": 0, 2024-09-21T05:54:25.946 INFO:teuthology.orchestra.run.smithi160.stdout: "process_request_cap_release": 0 2024-09-21T05:54:25.946 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.946 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_cache": { 2024-09-21T05:54:25.947 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update": 0, 2024-09-21T05:54:25.947 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update_receipt": 0, 2024-09-21T05:54:25.947 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_try_discover": 0, 2024-09-21T05:54:25.947 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_send_discover": 0, 2024-09-21T05:54:25.947 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_handle_discover": 0, 2024-09-21T05:54:25.947 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays": 0, 2024-09-21T05:54:25.947 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_delayed": 0, 2024-09-21T05:54:25.947 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_enqueuing": 0, 2024-09-21T05:54:25.947 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_created": 0, 2024-09-21T05:54:25.947 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_enqueued": 0, 2024-09-21T05:54:25.947 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_reintegrated": 0, 2024-09-21T05:54:25.947 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_migrated": 0, 2024-09-21T05:54:25.947 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_processing": 0, 2024-09-21T05:54:25.947 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_enqueued": 0, 2024-09-21T05:54:25.947 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_prioritized": 0, 2024-09-21T05:54:25.948 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_started": 0, 2024-09-21T05:54:25.948 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_completed": 0, 2024-09-21T05:54:25.948 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_quiesce_path": 0, 2024-09-21T05:54:25.948 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_quiesce_inode": 0, 2024-09-21T05:54:25.948 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T05:54:25.948 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_exportdir": 0, 2024-09-21T05:54:25.948 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_flush": 0, 2024-09-21T05:54:25.948 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragmentdir": 0, 2024-09-21T05:54:25.948 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragstats": 0, 2024-09-21T05:54:25.948 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_inodestats": 0, 2024-09-21T05:54:25.948 INFO:teuthology.orchestra.run.smithi160.stdout: "uninline_started": 0, 2024-09-21T05:54:25.948 INFO:teuthology.orchestra.run.smithi160.stdout: "uninline_succeeded": 0, 2024-09-21T05:54:25.948 INFO:teuthology.orchestra.run.smithi160.stdout: "uninline_write_failed": 0 2024-09-21T05:54:25.948 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.949 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_log": { 2024-09-21T05:54:25.949 INFO:teuthology.orchestra.run.smithi160.stdout: "evlrg": 0, 2024-09-21T05:54:25.949 INFO:teuthology.orchestra.run.smithi160.stdout: "evadd": 0, 2024-09-21T05:54:25.949 INFO:teuthology.orchestra.run.smithi160.stdout: "evex": 0, 2024-09-21T05:54:25.949 INFO:teuthology.orchestra.run.smithi160.stdout: "evtrm": 0, 2024-09-21T05:54:25.949 INFO:teuthology.orchestra.run.smithi160.stdout: "ev": 557, 2024-09-21T05:54:25.949 INFO:teuthology.orchestra.run.smithi160.stdout: "evexg": 0, 2024-09-21T05:54:25.949 INFO:teuthology.orchestra.run.smithi160.stdout: "evexd": 0, 2024-09-21T05:54:25.949 INFO:teuthology.orchestra.run.smithi160.stdout: "segadd": 0, 2024-09-21T05:54:25.949 INFO:teuthology.orchestra.run.smithi160.stdout: "segex": 0, 2024-09-21T05:54:25.949 INFO:teuthology.orchestra.run.smithi160.stdout: "segtrm": 0, 2024-09-21T05:54:25.949 INFO:teuthology.orchestra.run.smithi160.stdout: "seg": 2, 2024-09-21T05:54:25.949 INFO:teuthology.orchestra.run.smithi160.stdout: "segmjr": 2, 2024-09-21T05:54:25.949 INFO:teuthology.orchestra.run.smithi160.stdout: "segexg": 0, 2024-09-21T05:54:25.949 INFO:teuthology.orchestra.run.smithi160.stdout: "segexd": 0, 2024-09-21T05:54:25.950 INFO:teuthology.orchestra.run.smithi160.stdout: "expos": 4194304, 2024-09-21T05:54:25.950 INFO:teuthology.orchestra.run.smithi160.stdout: "wrpos": 5050127, 2024-09-21T05:54:25.950 INFO:teuthology.orchestra.run.smithi160.stdout: "rdpos": 5048989, 2024-09-21T05:54:25.950 INFO:teuthology.orchestra.run.smithi160.stdout: "jlat": { 2024-09-21T05:54:25.950 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.950 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.950 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.950 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.950 INFO:teuthology.orchestra.run.smithi160.stdout: "replayed": 557 2024-09-21T05:54:25.950 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.950 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_mem": { 2024-09-21T05:54:25.950 INFO:teuthology.orchestra.run.smithi160.stdout: "ino": 4, 2024-09-21T05:54:25.950 INFO:teuthology.orchestra.run.smithi160.stdout: "ino+": 189, 2024-09-21T05:54:25.950 INFO:teuthology.orchestra.run.smithi160.stdout: "ino-": 185, 2024-09-21T05:54:25.950 INFO:teuthology.orchestra.run.smithi160.stdout: "dir": 2, 2024-09-21T05:54:25.951 INFO:teuthology.orchestra.run.smithi160.stdout: "dir+": 76, 2024-09-21T05:54:25.951 INFO:teuthology.orchestra.run.smithi160.stdout: "dir-": 74, 2024-09-21T05:54:25.951 INFO:teuthology.orchestra.run.smithi160.stdout: "dn": 135, 2024-09-21T05:54:25.951 INFO:teuthology.orchestra.run.smithi160.stdout: "dn+": 296, 2024-09-21T05:54:25.951 INFO:teuthology.orchestra.run.smithi160.stdout: "dn-": 161, 2024-09-21T05:54:25.951 INFO:teuthology.orchestra.run.smithi160.stdout: "cap": 0, 2024-09-21T05:54:25.951 INFO:teuthology.orchestra.run.smithi160.stdout: "cap+": 0, 2024-09-21T05:54:25.951 INFO:teuthology.orchestra.run.smithi160.stdout: "cap-": 0, 2024-09-21T05:54:25.951 INFO:teuthology.orchestra.run.smithi160.stdout: "rss": 117408, 2024-09-21T05:54:25.951 INFO:teuthology.orchestra.run.smithi160.stdout: "heap": 317468672 2024-09-21T05:54:25.951 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.951 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_server": { 2024-09-21T05:54:25.951 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_client_request": 0, 2024-09-21T05:54:25.951 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_server_request": 0, 2024-09-21T05:54:25.952 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_request": 0, 2024-09-21T05:54:25.952 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_session": 0, 2024-09-21T05:54:25.952 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_peer_request": 0, 2024-09-21T05:54:25.952 INFO:teuthology.orchestra.run.smithi160.stdout: "req_create_latency": { 2024-09-21T05:54:25.952 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.952 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.952 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.952 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.952 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getattr_latency": { 2024-09-21T05:54:25.952 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.952 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.952 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.952 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.952 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getfilelock_latency": { 2024-09-21T05:54:25.952 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.952 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.953 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.953 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.953 INFO:teuthology.orchestra.run.smithi160.stdout: "req_link_latency": { 2024-09-21T05:54:25.953 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.953 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.953 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.953 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.953 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookup_latency": { 2024-09-21T05:54:25.953 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.953 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.953 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.953 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.953 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookuphash_latency": { 2024-09-21T05:54:25.953 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.953 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.954 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.954 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.954 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupino_latency": { 2024-09-21T05:54:25.954 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.954 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.954 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.954 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.954 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupname_latency": { 2024-09-21T05:54:25.954 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.954 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.954 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.954 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.954 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupparent_latency": { 2024-09-21T05:54:25.954 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.954 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.955 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.955 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.955 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupsnap_latency": { 2024-09-21T05:54:25.955 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.955 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.955 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.955 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.955 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lssnap_latency": { 2024-09-21T05:54:25.955 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.955 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.956 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.956 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.956 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mkdir_latency": { 2024-09-21T05:54:25.956 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.956 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.956 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.956 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.956 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mknod_latency": { 2024-09-21T05:54:25.956 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.956 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.956 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.957 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.957 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mksnap_latency": { 2024-09-21T05:54:25.957 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.957 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.957 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.957 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.957 INFO:teuthology.orchestra.run.smithi160.stdout: "req_open_latency": { 2024-09-21T05:54:25.957 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.957 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.957 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.957 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.957 INFO:teuthology.orchestra.run.smithi160.stdout: "req_readdir_latency": { 2024-09-21T05:54:25.957 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.957 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.957 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.957 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.958 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rename_latency": { 2024-09-21T05:54:25.958 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.958 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.958 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.958 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.958 INFO:teuthology.orchestra.run.smithi160.stdout: "req_renamesnap_latency": { 2024-09-21T05:54:25.958 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.958 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.958 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.958 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.958 INFO:teuthology.orchestra.run.smithi160.stdout: "req_snapdiff_latency": { 2024-09-21T05:54:25.958 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.958 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.958 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.958 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.959 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmdir_latency": { 2024-09-21T05:54:25.959 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.959 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.959 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.959 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.959 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmsnap_latency": { 2024-09-21T05:54:25.959 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.959 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.959 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.959 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.959 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmxattr_latency": { 2024-09-21T05:54:25.959 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.959 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.959 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.959 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.959 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setattr_latency": { 2024-09-21T05:54:25.959 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.960 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.960 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.960 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.960 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setdirlayout_latency": { 2024-09-21T05:54:25.960 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.960 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.960 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.960 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.960 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setfilelock_latency": { 2024-09-21T05:54:25.960 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.960 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.960 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.960 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.960 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setlayout_latency": { 2024-09-21T05:54:25.960 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.960 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.960 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.961 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.961 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setxattr_latency": { 2024-09-21T05:54:25.961 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.961 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.961 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.961 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.961 INFO:teuthology.orchestra.run.smithi160.stdout: "req_symlink_latency": { 2024-09-21T05:54:25.961 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.961 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.961 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.961 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.961 INFO:teuthology.orchestra.run.smithi160.stdout: "req_unlink_latency": { 2024-09-21T05:54:25.961 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.961 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.961 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.961 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.962 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_revoke_eviction": 0, 2024-09-21T05:54:25.962 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_acquisition_throttle": 0, 2024-09-21T05:54:25.962 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getvxattr_latency": { 2024-09-21T05:54:25.962 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.962 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.962 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.962 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:25.962 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.962 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_sessions": { 2024-09-21T05:54:25.962 INFO:teuthology.orchestra.run.smithi160.stdout: "session_count": 1, 2024-09-21T05:54:25.962 INFO:teuthology.orchestra.run.smithi160.stdout: "session_add": 2, 2024-09-21T05:54:25.962 INFO:teuthology.orchestra.run.smithi160.stdout: "session_remove": 1, 2024-09-21T05:54:25.962 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_open": 1, 2024-09-21T05:54:25.962 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_stale": 0, 2024-09-21T05:54:25.962 INFO:teuthology.orchestra.run.smithi160.stdout: "total_load": 0, 2024-09-21T05:54:25.963 INFO:teuthology.orchestra.run.smithi160.stdout: "average_load": 0, 2024-09-21T05:54:25.963 INFO:teuthology.orchestra.run.smithi160.stdout: "avg_session_uptime": 1373, 2024-09-21T05:54:25.963 INFO:teuthology.orchestra.run.smithi160.stdout: "mdthresh_evicted": 0 2024-09-21T05:54:25.963 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.963 INFO:teuthology.orchestra.run.smithi160.stdout: "mempool": { 2024-09-21T05:54:25.963 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_bytes": 0, 2024-09-21T05:54:25.963 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_items": 0, 2024-09-21T05:54:25.963 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T05:54:25.963 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_items": 0, 2024-09-21T05:54:25.963 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T05:54:25.963 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_items": 0, 2024-09-21T05:54:25.963 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T05:54:25.963 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T05:54:25.963 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T05:54:25.963 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T05:54:25.963 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T05:54:25.964 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_items": 0, 2024-09-21T05:54:25.964 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T05:54:25.964 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T05:54:25.964 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_bytes": 0, 2024-09-21T05:54:25.964 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_items": 0, 2024-09-21T05:54:25.964 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_bytes": 0, 2024-09-21T05:54:25.964 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_items": 0, 2024-09-21T05:54:25.964 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T05:54:25.964 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T05:54:25.964 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T05:54:25.964 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T05:54:25.964 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T05:54:25.964 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_items": 0, 2024-09-21T05:54:25.964 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_bytes": 0, 2024-09-21T05:54:25.964 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_items": 0, 2024-09-21T05:54:25.964 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T05:54:25.965 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T05:54:25.965 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_bytes": 0, 2024-09-21T05:54:25.965 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_items": 0, 2024-09-21T05:54:25.965 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_bytes": 0, 2024-09-21T05:54:25.965 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_items": 0, 2024-09-21T05:54:25.965 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T05:54:25.965 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_items": 0, 2024-09-21T05:54:25.965 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T05:54:25.965 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_items": 0, 2024-09-21T05:54:25.965 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_bytes": 189239, 2024-09-21T05:54:25.965 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_items": 48, 2024-09-21T05:54:25.965 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_bytes": 0, 2024-09-21T05:54:25.965 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_items": 0, 2024-09-21T05:54:25.965 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_bytes": 0, 2024-09-21T05:54:25.965 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_items": 0, 2024-09-21T05:54:25.965 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_bytes": 0, 2024-09-21T05:54:25.965 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_items": 0, 2024-09-21T05:54:25.966 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_bytes": 0, 2024-09-21T05:54:25.966 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_items": 0, 2024-09-21T05:54:25.966 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_bytes": 9144, 2024-09-21T05:54:25.966 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_items": 172, 2024-09-21T05:54:25.966 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T05:54:25.966 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_items": 0, 2024-09-21T05:54:25.966 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_bytes": 0, 2024-09-21T05:54:25.966 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_items": 0, 2024-09-21T05:54:25.966 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_bytes": 104056, 2024-09-21T05:54:25.966 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_items": 569, 2024-09-21T05:54:25.966 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_bytes": 0, 2024-09-21T05:54:25.966 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_items": 0, 2024-09-21T05:54:25.966 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_bytes": 0, 2024-09-21T05:54:25.966 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_items": 0 2024-09-21T05:54:25.967 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.967 INFO:teuthology.orchestra.run.smithi160.stdout: "objecter": { 2024-09-21T05:54:25.967 INFO:teuthology.orchestra.run.smithi160.stdout: "op_active": 0, 2024-09-21T05:54:25.967 INFO:teuthology.orchestra.run.smithi160.stdout: "op_laggy": 0, 2024-09-21T05:54:25.967 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send": 1158, 2024-09-21T05:54:25.967 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send_bytes": 21, 2024-09-21T05:54:25.967 INFO:teuthology.orchestra.run.smithi160.stdout: "op_resend": 3, 2024-09-21T05:54:25.967 INFO:teuthology.orchestra.run.smithi160.stdout: "op_reply": 1158, 2024-09-21T05:54:25.967 INFO:teuthology.orchestra.run.smithi160.stdout: "op_latency": { 2024-09-21T05:54:25.967 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1158, 2024-09-21T05:54:25.967 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.651990566, 2024-09-21T05:54:25.967 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000563031 2024-09-21T05:54:25.968 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.968 INFO:teuthology.orchestra.run.smithi160.stdout: "op_inflight": 0, 2024-09-21T05:54:25.968 INFO:teuthology.orchestra.run.smithi160.stdout: "oplen_avg": { 2024-09-21T05:54:25.968 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1158, 2024-09-21T05:54:25.968 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 1159 2024-09-21T05:54:25.968 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.968 INFO:teuthology.orchestra.run.smithi160.stdout: "op": 1158, 2024-09-21T05:54:25.968 INFO:teuthology.orchestra.run.smithi160.stdout: "op_r": 1158, 2024-09-21T05:54:25.968 INFO:teuthology.orchestra.run.smithi160.stdout: "op_w": 0, 2024-09-21T05:54:25.968 INFO:teuthology.orchestra.run.smithi160.stdout: "op_rmw": 0, 2024-09-21T05:54:25.968 INFO:teuthology.orchestra.run.smithi160.stdout: "op_pg": 0, 2024-09-21T05:54:25.968 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_stat": 713, 2024-09-21T05:54:25.968 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_create": 0, 2024-09-21T05:54:25.968 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_read": 443, 2024-09-21T05:54:25.968 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_write": 0, 2024-09-21T05:54:25.969 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writefull": 0, 2024-09-21T05:54:25.969 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writesame": 0, 2024-09-21T05:54:25.969 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_append": 0, 2024-09-21T05:54:25.969 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_zero": 0, 2024-09-21T05:54:25.969 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_truncate": 0, 2024-09-21T05:54:25.969 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_delete": 0, 2024-09-21T05:54:25.969 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_mapext": 0, 2024-09-21T05:54:25.969 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_sparse_read": 0, 2024-09-21T05:54:25.969 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_clonerange": 0, 2024-09-21T05:54:25.969 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_getxattr": 1, 2024-09-21T05:54:25.969 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_setxattr": 0, 2024-09-21T05:54:25.969 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_cmpxattr": 0, 2024-09-21T05:54:25.969 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_rmxattr": 0, 2024-09-21T05:54:25.969 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_resetxattrs": 0, 2024-09-21T05:54:25.969 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_call": 0, 2024-09-21T05:54:25.970 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_watch": 0, 2024-09-21T05:54:25.970 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_notify": 0, 2024-09-21T05:54:25.970 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T05:54:25.970 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls": 0, 2024-09-21T05:54:25.970 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls_filter": 0, 2024-09-21T05:54:25.970 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_other": 0, 2024-09-21T05:54:25.970 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_active": 0, 2024-09-21T05:54:25.970 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_send": 0, 2024-09-21T05:54:25.970 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_resend": 0, 2024-09-21T05:54:25.970 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_ping": 0, 2024-09-21T05:54:25.970 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_active": 0, 2024-09-21T05:54:25.970 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_send": 0, 2024-09-21T05:54:25.970 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_resend": 0, 2024-09-21T05:54:25.970 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_active": 0, 2024-09-21T05:54:25.970 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_send": 0, 2024-09-21T05:54:25.970 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_resend": 0, 2024-09-21T05:54:25.971 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_active": 0, 2024-09-21T05:54:25.971 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_send": 0, 2024-09-21T05:54:25.971 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_resend": 0, 2024-09-21T05:54:25.971 INFO:teuthology.orchestra.run.smithi160.stdout: "command_active": 0, 2024-09-21T05:54:25.971 INFO:teuthology.orchestra.run.smithi160.stdout: "command_send": 0, 2024-09-21T05:54:25.971 INFO:teuthology.orchestra.run.smithi160.stdout: "command_resend": 0, 2024-09-21T05:54:25.971 INFO:teuthology.orchestra.run.smithi160.stdout: "map_epoch": 85, 2024-09-21T05:54:25.971 INFO:teuthology.orchestra.run.smithi160.stdout: "map_full": 0, 2024-09-21T05:54:25.971 INFO:teuthology.orchestra.run.smithi160.stdout: "map_inc": 2, 2024-09-21T05:54:25.971 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_sessions": 5, 2024-09-21T05:54:25.971 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_open": 5, 2024-09-21T05:54:25.971 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_close": 0, 2024-09-21T05:54:25.971 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_laggy": 0, 2024-09-21T05:54:25.971 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_wr": 0, 2024-09-21T05:54:25.971 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_rd": 2, 2024-09-21T05:54:25.972 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_del": 0 2024-09-21T05:54:25.972 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.972 INFO:teuthology.orchestra.run.smithi160.stdout: "oft": { 2024-09-21T05:54:25.972 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_objs": 0, 2024-09-21T05:54:25.972 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_kv_pairs": 0, 2024-09-21T05:54:25.972 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_updates": 0, 2024-09-21T05:54:25.972 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_removes": 0 2024-09-21T05:54:25.972 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.972 INFO:teuthology.orchestra.run.smithi160.stdout: "purge_queue": { 2024-09-21T05:54:25.972 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops": 0, 2024-09-21T05:54:25.972 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T05:54:25.972 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing": 0, 2024-09-21T05:54:25.972 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_high_water": 0, 2024-09-21T05:54:25.972 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executed_ops": 0, 2024-09-21T05:54:25.972 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executed": 0, 2024-09-21T05:54:25.972 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_item_in_journal": 0 2024-09-21T05:54:25.973 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.973 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T05:54:25.973 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-21T05:54:25.973 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2024-09-21T05:54:25.973 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-21T05:54:25.973 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 1312, 2024-09-21T05:54:25.973 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 1962467, 2024-09-21T05:54:25.973 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:25.973 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 1312, 2024-09-21T05:54:25.973 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-09-21T05:54:25.973 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-09-21T05:54:25.973 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 1312, 2024-09-21T05:54:25.973 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 1962467, 2024-09-21T05:54:25.973 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-21T05:54:25.973 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.974 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.974 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.974 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:25.974 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.974 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_bytes": { 2024-09-21T05:54:25.974 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-21T05:54:25.974 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2024-09-21T05:54:25.974 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-21T05:54:25.974 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-09-21T05:54:25.974 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-09-21T05:54:25.974 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:25.974 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-09-21T05:54:25.974 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 1158, 2024-09-21T05:54:25.974 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 855828, 2024-09-21T05:54:25.974 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 1158, 2024-09-21T05:54:25.975 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 855828, 2024-09-21T05:54:25.975 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-21T05:54:25.975 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.975 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.975 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.975 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:25.975 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.975 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_ops": { 2024-09-21T05:54:25.975 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-21T05:54:25.975 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 1024, 2024-09-21T05:54:25.975 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-21T05:54:25.975 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-09-21T05:54:25.975 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-09-21T05:54:25.975 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:25.976 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-09-21T05:54:25.976 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 1158, 2024-09-21T05:54:25.976 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 1158, 2024-09-21T05:54:25.976 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 1158, 2024-09-21T05:54:25.976 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 1158, 2024-09-21T05:54:25.976 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-21T05:54:25.976 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.976 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.976 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.976 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:25.976 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.976 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle": { 2024-09-21T05:54:25.976 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-21T05:54:25.976 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2024-09-21T05:54:25.976 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-21T05:54:25.977 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-09-21T05:54:25.977 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-09-21T05:54:25.977 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:25.977 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-09-21T05:54:25.977 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-09-21T05:54:25.977 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-09-21T05:54:25.977 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 0, 2024-09-21T05:54:25.977 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 0, 2024-09-21T05:54:25.977 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-21T05:54:25.977 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.977 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.977 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.977 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:25.977 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.977 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle-0x55ace41db1e0": { 2024-09-21T05:54:25.978 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2024-09-21T05:54:25.978 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2024-09-21T05:54:25.978 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2024-09-21T05:54:25.978 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2024-09-21T05:54:25.978 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2024-09-21T05:54:25.978 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2024-09-21T05:54:25.978 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2024-09-21T05:54:25.978 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2024-09-21T05:54:25.978 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2024-09-21T05:54:25.978 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 0, 2024-09-21T05:54:25.978 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 0, 2024-09-21T05:54:25.978 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2024-09-21T05:54:25.978 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2024-09-21T05:54:25.978 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2024-09-21T05:54:25.978 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2024-09-21T05:54:25.978 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:25.979 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-21T05:54:25.979 INFO:teuthology.orchestra.run.smithi160.stdout: "trackedop": { 2024-09-21T05:54:25.979 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_ops_count": 0 2024-09-21T05:54:25.979 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-21T05:54:25.979 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-21T05:54:26.768 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-21T05:54:26.768 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-21T05:54:26.769 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-09-21T05:54:26.769 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-09-21T05:54:26.769 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-21T05:54:26.778 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-21T05:54:26.778 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-21T05:54:26.778 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T05:54:26.800 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-21T05:54:26.800 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T05:54:26.860 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T05:54:27.156 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:54:27.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:27 smithi070 ceph-mon[30981]: pgmap v519: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T05:54:27.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.626+0000 7f69139a1640 1 -- 172.21.15.70:0/2760172319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f690c1049c0 msgr2=0x7f690c104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:27.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.626+0000 7f69139a1640 1 --2- 172.21.15.70:0/2760172319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f690c1049c0 0x7f690c104dd0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f6908009900 tx=0x7f690802a410 comp rx=0 tx=0).stop 2024-09-21T05:54:27.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.626+0000 7f69139a1640 1 -- 172.21.15.70:0/2760172319 shutdown_connections 2024-09-21T05:54:27.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.626+0000 7f69139a1640 1 --2- 172.21.15.70:0/2760172319 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f690c10de20 0x7f690c110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.626+0000 7f69139a1640 1 --2- 172.21.15.70:0/2760172319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f690c105310 0x7f690c10d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.626+0000 7f69139a1640 1 --2- 172.21.15.70:0/2760172319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f690c1049c0 0x7f690c104dd0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.626+0000 7f69139a1640 1 -- 172.21.15.70:0/2760172319 >> 172.21.15.70:0/2760172319 conn(0x7f690c079710 msgr2=0x7f690c079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:27.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.626+0000 7f69139a1640 1 -- 172.21.15.70:0/2760172319 shutdown_connections 2024-09-21T05:54:27.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.626+0000 7f69139a1640 1 -- 172.21.15.70:0/2760172319 wait complete. 2024-09-21T05:54:27.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.627+0000 7f69139a1640 1 Processor -- start 2024-09-21T05:54:27.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.627+0000 7f69139a1640 1 -- start start 2024-09-21T05:54:27.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.627+0000 7f69139a1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f690c1049c0 0x7f690c19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:27.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.627+0000 7f69139a1640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f690c105310 0x7f690c19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:27.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.627+0000 7f69139a1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f690c10de20 0x7f690c19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:27.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.627+0000 7f69139a1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f690c113a70 con 0x7f690c1049c0 2024-09-21T05:54:27.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.627+0000 7f69139a1640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f690c1138f0 con 0x7f690c10de20 2024-09-21T05:54:27.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.627+0000 7f69139a1640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f690c113bf0 con 0x7f690c105310 2024-09-21T05:54:27.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.627+0000 7f691173d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f690c1049c0 0x7f690c19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:27.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.628+0000 7f691173d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f690c1049c0 0x7f690c19a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46110/0 (socket says 172.21.15.70:46110) 2024-09-21T05:54:27.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.628+0000 7f691173d640 1 -- 172.21.15.70:0/2935533830 learned_addr learned my addr 172.21.15.70:0/2935533830 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:54:27.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.628+0000 7f6911f3e640 1 --2- 172.21.15.70:0/2935533830 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f690c10de20 0x7f690c19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:27.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.628+0000 7f6910f3c640 1 --2- 172.21.15.70:0/2935533830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f690c105310 0x7f690c19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:27.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.628+0000 7f691173d640 1 -- 172.21.15.70:0/2935533830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f690c105310 msgr2=0x7f690c19aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:27.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.628+0000 7f691173d640 1 --2- 172.21.15.70:0/2935533830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f690c105310 0x7f690c19aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.628+0000 7f691173d640 1 -- 172.21.15.70:0/2935533830 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f690c10de20 msgr2=0x7f690c19fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:27.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.628+0000 7f691173d640 1 --2- 172.21.15.70:0/2935533830 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f690c10de20 0x7f690c19fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.628+0000 7f691173d640 1 -- 172.21.15.70:0/2935533830 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f690c1a0330 con 0x7f690c1049c0 2024-09-21T05:54:27.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.628+0000 7f6910f3c640 1 --2- 172.21.15.70:0/2935533830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f690c105310 0x7f690c19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:54:27.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.628+0000 7f691173d640 1 --2- 172.21.15.70:0/2935533830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f690c1049c0 0x7f690c19a480 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6908005940 tx=0x7f69080042d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:27.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.628+0000 7f69027fc640 1 -- 172.21.15.70:0/2935533830 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f690803f070 con 0x7f690c1049c0 2024-09-21T05:54:27.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.628+0000 7f69139a1640 1 -- 172.21.15.70:0/2935533830 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f690c1a05c0 con 0x7f690c1049c0 2024-09-21T05:54:27.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.628+0000 7f69027fc640 1 -- 172.21.15.70:0/2935533830 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f6908003aa0 con 0x7f690c1049c0 2024-09-21T05:54:27.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.628+0000 7f69027fc640 1 -- 172.21.15.70:0/2935533830 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6908035030 con 0x7f690c1049c0 2024-09-21T05:54:27.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.628+0000 7f69139a1640 1 -- 172.21.15.70:0/2935533830 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f690c1a0af0 con 0x7f690c1049c0 2024-09-21T05:54:27.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.630+0000 7f68f7fff640 1 -- 172.21.15.70:0/2935533830 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68ec005290 con 0x7f690c1049c0 2024-09-21T05:54:27.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.632+0000 7f69027fc640 1 -- 172.21.15.70:0/2935533830 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f6908042070 con 0x7f690c1049c0 2024-09-21T05:54:27.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.633+0000 7f69027fc640 1 --2- 172.21.15.70:0/2935533830 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f68f80b6540 0x7f68f80b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:27.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.633+0000 7f6910f3c640 1 --2- 172.21.15.70:0/2935533830 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f68f80b6540 0x7f68f80b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:27.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.633+0000 7f69027fc640 1 -- 172.21.15.70:0/2935533830 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f6908107e70 con 0x7f690c1049c0 2024-09-21T05:54:27.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.633+0000 7f6910f3c640 1 --2- 172.21.15.70:0/2935533830 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f68f80b6540 0x7f68f80b8a50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f690c102460 tx=0x7f68fc005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:27.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.640+0000 7f69027fc640 1 -- 172.21.15.70:0/2935533830 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f690c1a0af0 con 0x7f690c1049c0 2024-09-21T05:54:27.780 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:27 smithi160 ceph-mon[33979]: pgmap v519: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T05:54:27.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:27 smithi116 ceph-mon[34332]: pgmap v519: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T05:54:27.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.837+0000 7f68f7fff640 1 -- 172.21.15.70:0/2935533830 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f68ec005580 con 0x7f690c1049c0 2024-09-21T05:54:27.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.838+0000 7f69027fc640 1 -- 172.21.15.70:0/2935533830 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v85) ==== 81+0+588 (secure 0 0 0) 0x7f6908049060 con 0x7f690c1049c0 2024-09-21T05:54:27.840 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/605055695 2024-09-22T05:39:37.296630+0000 2024-09-21T05:54:27.840 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/897886925 2024-09-22T05:39:37.296630+0000 2024-09-21T05:54:27.841 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/1968357524 2024-09-22T05:39:37.296630+0000 2024-09-21T05:54:27.841 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/693721445 2024-09-22T05:39:37.296630+0000 2024-09-21T05:54:27.841 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/2810307308 2024-09-22T05:39:12.492271+0000 2024-09-21T05:54:27.841 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/605055695 2024-09-22T05:39:37.296630+0000 2024-09-21T05:54:27.841 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/1668927582 2024-09-22T05:39:12.492271+0000 2024-09-21T05:54:27.841 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/1668927582 2024-09-22T05:39:12.492271+0000 2024-09-21T05:54:27.841 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/1979536420 2024-09-22T05:39:12.492271+0000 2024-09-21T05:54:27.841 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/2674019604 2024-09-22T05:39:12.492271+0000 2024-09-21T05:54:27.841 INFO:teuthology.orchestra.run.smithi070.stderr:listed 10 entries 2024-09-21T05:54:27.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.841+0000 7f68f7fff640 1 -- 172.21.15.70:0/2935533830 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f68f80b6540 msgr2=0x7f68f80b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:27.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.841+0000 7f68f7fff640 1 --2- 172.21.15.70:0/2935533830 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f68f80b6540 0x7f68f80b8a50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f690c102460 tx=0x7f68fc005ec0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.841+0000 7f68f7fff640 1 -- 172.21.15.70:0/2935533830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f690c1049c0 msgr2=0x7f690c19a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:27.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.841+0000 7f68f7fff640 1 --2- 172.21.15.70:0/2935533830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f690c1049c0 0x7f690c19a480 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6908005940 tx=0x7f69080042d0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.841+0000 7f68f7fff640 1 -- 172.21.15.70:0/2935533830 shutdown_connections 2024-09-21T05:54:27.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.841+0000 7f68f7fff640 1 --2- 172.21.15.70:0/2935533830 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f68f80b6540 0x7f68f80b8a50 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.841+0000 7f68f7fff640 1 --2- 172.21.15.70:0/2935533830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f690c105310 0x7f690c19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.841+0000 7f68f7fff640 1 --2- 172.21.15.70:0/2935533830 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f690c10de20 0x7f690c19fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.841+0000 7f68f7fff640 1 --2- 172.21.15.70:0/2935533830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f690c1049c0 0x7f690c19a480 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.841+0000 7f68f7fff640 1 -- 172.21.15.70:0/2935533830 >> 172.21.15.70:0/2935533830 conn(0x7f690c079710 msgr2=0x7f690c1007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:27.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.841+0000 7f68f7fff640 1 -- 172.21.15.70:0/2935533830 shutdown_connections 2024-09-21T05:54:27.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:27.841+0000 7f68f7fff640 1 -- 172.21.15.70:0/2935533830 wait complete. 2024-09-21T05:54:28.566 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:28 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2935533830' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T05:54:28.594 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-21T05:54:28.594 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T05:54:28.612 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T05:54:28.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:28 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2935533830' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T05:54:28.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:28 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2935533830' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T05:54:28.904 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:54:29.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.417+0000 7f9844b13640 1 -- 172.21.15.70:0/4144457132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9840102a70 msgr2=0x7f9840102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:29.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.417+0000 7f9844b13640 1 --2- 172.21.15.70:0/4144457132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9840102a70 0x7f9840102e80 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f9830009900 tx=0x7f983002a410 comp rx=0 tx=0).stop 2024-09-21T05:54:29.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.417+0000 7f9844b13640 1 -- 172.21.15.70:0/4144457132 shutdown_connections 2024-09-21T05:54:29.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.417+0000 7f9844b13640 1 --2- 172.21.15.70:0/4144457132 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98401083b0 0x7f98401087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:29.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.417+0000 7f9844b13640 1 --2- 172.21.15.70:0/4144457132 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9840108d00 0x7f984010f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:29.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.417+0000 7f9844b13640 1 --2- 172.21.15.70:0/4144457132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9840102a70 0x7f9840102e80 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:29.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.417+0000 7f9844b13640 1 -- 172.21.15.70:0/4144457132 >> 172.21.15.70:0/4144457132 conn(0x7f9840079730 msgr2=0x7f9840079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:29.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.417+0000 7f9844b13640 1 -- 172.21.15.70:0/4144457132 shutdown_connections 2024-09-21T05:54:29.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.417+0000 7f9844b13640 1 -- 172.21.15.70:0/4144457132 wait complete. 2024-09-21T05:54:29.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.418+0000 7f9844b13640 1 Processor -- start 2024-09-21T05:54:29.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.418+0000 7f9844b13640 1 -- start start 2024-09-21T05:54:29.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.418+0000 7f9844b13640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9840102a70 0x7f984019b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:29.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.418+0000 7f9844b13640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98401083b0 0x7f984019b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:29.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.418+0000 7f9844b13640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9840108d00 0x7f984019bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:29.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.418+0000 7f9844b13640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f98401129c0 con 0x7f98401083b0 2024-09-21T05:54:29.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.418+0000 7f9844b13640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9840112840 con 0x7f9840102a70 2024-09-21T05:54:29.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.418+0000 7f9844b13640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9840112b40 con 0x7f9840108d00 2024-09-21T05:54:29.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.419+0000 7f983dd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98401083b0 0x7f984019b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:29.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.419+0000 7f983dd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98401083b0 0x7f984019b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46134/0 (socket says 172.21.15.70:46134) 2024-09-21T05:54:29.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.419+0000 7f983dd9b640 1 -- 172.21.15.70:0/3859658167 learned_addr learned my addr 172.21.15.70:0/3859658167 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:54:29.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.419+0000 7f983e59c640 1 --2- 172.21.15.70:0/3859658167 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9840102a70 0x7f984019b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:29.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.419+0000 7f983ed9d640 1 --2- 172.21.15.70:0/3859658167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9840108d00 0x7f984019bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:29.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.419+0000 7f983dd9b640 1 -- 172.21.15.70:0/3859658167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9840108d00 msgr2=0x7f984019bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:29.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.419+0000 7f983dd9b640 1 --2- 172.21.15.70:0/3859658167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9840108d00 0x7f984019bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:29.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.419+0000 7f983dd9b640 1 -- 172.21.15.70:0/3859658167 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9840102a70 msgr2=0x7f984019b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:29.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.419+0000 7f983dd9b640 1 --2- 172.21.15.70:0/3859658167 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9840102a70 0x7f984019b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:29.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.419+0000 7f983dd9b640 1 -- 172.21.15.70:0/3859658167 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98401a6590 con 0x7f98401083b0 2024-09-21T05:54:29.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.419+0000 7f983dd9b640 1 --2- 172.21.15.70:0/3859658167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98401083b0 0x7f984019b810 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f983400b450 tx=0x7f983400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:29.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.419+0000 7f982f7fe640 1 -- 172.21.15.70:0/3859658167 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9834015020 con 0x7f98401083b0 2024-09-21T05:54:29.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.419+0000 7f9844b13640 1 -- 172.21.15.70:0/3859658167 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98401a6880 con 0x7f98401083b0 2024-09-21T05:54:29.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.419+0000 7f982f7fe640 1 -- 172.21.15.70:0/3859658167 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f9834011d40 con 0x7f98401083b0 2024-09-21T05:54:29.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.419+0000 7f982f7fe640 1 -- 172.21.15.70:0/3859658167 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983400f340 con 0x7f98401083b0 2024-09-21T05:54:29.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.419+0000 7f9844b13640 1 -- 172.21.15.70:0/3859658167 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98401a6e40 con 0x7f98401083b0 2024-09-21T05:54:29.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.420+0000 7f9844b13640 1 -- 172.21.15.70:0/3859658167 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9840103cf0 con 0x7f98401083b0 2024-09-21T05:54:29.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.423+0000 7f982f7fe640 1 -- 172.21.15.70:0/3859658167 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f9834018020 con 0x7f98401083b0 2024-09-21T05:54:29.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.423+0000 7f982f7fe640 1 --2- 172.21.15.70:0/3859658167 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f98280b6510 0x7f98280b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:29.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.424+0000 7f983e59c640 1 --2- 172.21.15.70:0/3859658167 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f98280b6510 0x7f98280b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:29.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.424+0000 7f982f7fe640 1 -- 172.21.15.70:0/3859658167 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f98340e7620 con 0x7f98401083b0 2024-09-21T05:54:29.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.424+0000 7f983e59c640 1 --2- 172.21.15.70:0/3859658167 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f98280b6510 0x7f98280b8a20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9830000c00 tx=0x7f9830005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:29.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.427+0000 7f982f7fe640 1 -- 172.21.15.70:0/3859658167 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f983401f020 con 0x7f98401083b0 2024-09-21T05:54:29.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.619+0000 7f9844b13640 1 -- 172.21.15.70:0/3859658167 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9840102e80 con 0x7f98401083b0 2024-09-21T05:54:29.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:29 smithi070 ceph-mon[30981]: pgmap v520: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T05:54:29.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.620+0000 7f982f7fe640 1 -- 172.21.15.70:0/3859658167 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v85) ==== 81+0+588 (secure 0 0 0) 0x7f983400d040 con 0x7f98401083b0 2024-09-21T05:54:29.622 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/605055695 2024-09-22T05:39:37.296630+0000 2024-09-21T05:54:29.622 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/897886925 2024-09-22T05:39:37.296630+0000 2024-09-21T05:54:29.622 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/1968357524 2024-09-22T05:39:37.296630+0000 2024-09-21T05:54:29.622 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/693721445 2024-09-22T05:39:37.296630+0000 2024-09-21T05:54:29.622 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/2810307308 2024-09-22T05:39:12.492271+0000 2024-09-21T05:54:29.623 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/605055695 2024-09-22T05:39:37.296630+0000 2024-09-21T05:54:29.623 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/1668927582 2024-09-22T05:39:12.492271+0000 2024-09-21T05:54:29.623 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/1668927582 2024-09-22T05:39:12.492271+0000 2024-09-21T05:54:29.623 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/1979536420 2024-09-22T05:39:12.492271+0000 2024-09-21T05:54:29.623 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/2674019604 2024-09-22T05:39:12.492271+0000 2024-09-21T05:54:29.623 INFO:teuthology.orchestra.run.smithi070.stderr:listed 10 entries 2024-09-21T05:54:29.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.622+0000 7f9844b13640 1 -- 172.21.15.70:0/3859658167 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f98280b6510 msgr2=0x7f98280b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:29.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.622+0000 7f9844b13640 1 --2- 172.21.15.70:0/3859658167 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f98280b6510 0x7f98280b8a20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9830000c00 tx=0x7f9830005d50 comp rx=0 tx=0).stop 2024-09-21T05:54:29.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.622+0000 7f9844b13640 1 -- 172.21.15.70:0/3859658167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98401083b0 msgr2=0x7f984019b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:29.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.622+0000 7f9844b13640 1 --2- 172.21.15.70:0/3859658167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98401083b0 0x7f984019b810 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f983400b450 tx=0x7f983400b910 comp rx=0 tx=0).stop 2024-09-21T05:54:29.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.622+0000 7f9844b13640 1 -- 172.21.15.70:0/3859658167 shutdown_connections 2024-09-21T05:54:29.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.622+0000 7f9844b13640 1 --2- 172.21.15.70:0/3859658167 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f98280b6510 0x7f98280b8a20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:29.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.622+0000 7f9844b13640 1 --2- 172.21.15.70:0/3859658167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9840108d00 0x7f984019bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:29.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.622+0000 7f9844b13640 1 --2- 172.21.15.70:0/3859658167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98401083b0 0x7f984019b810 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:29.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.622+0000 7f9844b13640 1 --2- 172.21.15.70:0/3859658167 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9840102a70 0x7f984019b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:29.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.622+0000 7f9844b13640 1 -- 172.21.15.70:0/3859658167 >> 172.21.15.70:0/3859658167 conn(0x7f9840079730 msgr2=0x7f9840101400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:29.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.622+0000 7f9844b13640 1 -- 172.21.15.70:0/3859658167 shutdown_connections 2024-09-21T05:54:29.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:29.622+0000 7f9844b13640 1 -- 172.21.15.70:0/3859658167 wait complete. 2024-09-21T05:54:29.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:29 smithi116 ceph-mon[34332]: pgmap v520: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T05:54:29.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:29 smithi160 ceph-mon[33979]: pgmap v520: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T05:54:30.361 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi070.front.sepia.ceph.com... 2024-09-21T05:54:30.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:54:30.361 DEBUG:teuthology.orchestra.run.smithi070:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-21T05:54:30.387 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:ceph-fuse[85834]: fuse finished with error 0 and tester_r 0 2024-09-21T05:54:30.389 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T05:54:30.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:30 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/3859658167' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T05:54:30.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:30 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/3859658167' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T05:54:30.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:30 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/3859658167' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T05:54:31.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:31 smithi070 ceph-mon[30981]: pgmap v521: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T05:54:31.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:31 smithi116 ceph-mon[34332]: pgmap v521: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T05:54:31.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:31 smithi160 ceph-mon[33979]: pgmap v521: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T05:54:33.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:33 smithi070 ceph-mon[30981]: pgmap v522: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-21T05:54:33.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:33 smithi116 ceph-mon[34332]: pgmap v522: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-21T05:54:33.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:33 smithi160 ceph-mon[33979]: pgmap v522: 129 pgs: 129 active+clean; 99 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-21T05:54:35.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:35 smithi070 ceph-mon[30981]: pgmap v523: 129 pgs: 129 active+clean; 99 MiB data, 772 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-21T05:54:35.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:35 smithi116 ceph-mon[34332]: pgmap v523: 129 pgs: 129 active+clean; 99 MiB data, 772 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-21T05:54:35.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:35 smithi160 ceph-mon[33979]: pgmap v523: 129 pgs: 129 active+clean; 99 MiB data, 772 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-21T05:54:36.490 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi070.front.sepia.ceph.com 2024-09-21T05:54:36.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:54:36.491 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T05:54:36.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:54:36.511 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2024-09-21T05:54:36.569 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T05:54:36.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:54:36.570 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T05:54:36.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:54:36.640 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link delete ceph-brx 2024-09-21T05:54:36.755 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T05:54:36.764 INFO:tasks.cephadm:Teardown begin 2024-09-21T05:54:36.765 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T05:54:36.765 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:54:37.019 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:54:37.724 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:37 smithi070 ceph-mon[30981]: pgmap v524: 129 pgs: 129 active+clean; 99 MiB data, 772 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T05:54:37.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.721+0000 7f6944c74640 1 -- 172.21.15.70:0/483568340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6940109df0 msgr2=0x7f6940110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:37.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.721+0000 7f6944c74640 1 --2- 172.21.15.70:0/483568340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6940109df0 0x7f6940110620 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f6938009ca0 tx=0x7f693802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:54:37.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.722+0000 7f6944c74640 1 -- 172.21.15.70:0/483568340 shutdown_connections 2024-09-21T05:54:37.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.722+0000 7f6944c74640 1 --2- 172.21.15.70:0/483568340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6940109df0 0x7f6940110620 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:37.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.722+0000 7f6944c74640 1 --2- 172.21.15.70:0/483568340 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f69401094a0 0x7f69401098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:37.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.722+0000 7f6944c74640 1 --2- 172.21.15.70:0/483568340 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6940103b60 0x7f6940103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:37.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.722+0000 7f6944c74640 1 -- 172.21.15.70:0/483568340 >> 172.21.15.70:0/483568340 conn(0x7f694007b850 msgr2=0x7f694007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:37.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.722+0000 7f6944c74640 1 -- 172.21.15.70:0/483568340 shutdown_connections 2024-09-21T05:54:37.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.722+0000 7f6944c74640 1 -- 172.21.15.70:0/483568340 wait complete. 2024-09-21T05:54:37.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.723+0000 7f6944c74640 1 Processor -- start 2024-09-21T05:54:37.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.723+0000 7f6944c74640 1 -- start start 2024-09-21T05:54:37.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.723+0000 7f6944c74640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6940103b60 0x7f69401a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:37.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.723+0000 7f6944c74640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f69401094a0 0x7f69401a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:37.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.723+0000 7f6944c74640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6940109df0 0x7f69401a2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:37.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.723+0000 7f6944c74640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6940113aa0 con 0x7f6940109df0 2024-09-21T05:54:37.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.723+0000 7f6944c74640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6940113920 con 0x7f6940103b60 2024-09-21T05:54:37.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.723+0000 7f6944c74640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6940113c20 con 0x7f69401094a0 2024-09-21T05:54:37.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.723+0000 7f693ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6940109df0 0x7f69401a2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:37.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.723+0000 7f693ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6940109df0 0x7f69401a2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34240/0 (socket says 172.21.15.70:34240) 2024-09-21T05:54:37.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.723+0000 7f693ed9d640 1 -- 172.21.15.70:0/1799176257 learned_addr learned my addr 172.21.15.70:0/1799176257 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:54:37.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.723+0000 7f693e59c640 1 --2- 172.21.15.70:0/1799176257 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6940103b60 0x7f69401a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:37.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.723+0000 7f693dd9b640 1 --2- 172.21.15.70:0/1799176257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f69401094a0 0x7f69401a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:37.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.723+0000 7f693ed9d640 1 -- 172.21.15.70:0/1799176257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f69401094a0 msgr2=0x7f69401a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:37.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.723+0000 7f693ed9d640 1 --2- 172.21.15.70:0/1799176257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f69401094a0 0x7f69401a1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:37.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.723+0000 7f693ed9d640 1 -- 172.21.15.70:0/1799176257 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6940103b60 msgr2=0x7f69401a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:37.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.723+0000 7f693ed9d640 1 --2- 172.21.15.70:0/1799176257 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6940103b60 0x7f69401a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:37.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.723+0000 7f693ed9d640 1 -- 172.21.15.70:0/1799176257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69401acac0 con 0x7f6940109df0 2024-09-21T05:54:37.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.724+0000 7f693ed9d640 1 --2- 172.21.15.70:0/1799176257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6940109df0 0x7f69401a2220 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f6938031040 tx=0x7f69380093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:37.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.724+0000 7f692f7fe640 1 -- 172.21.15.70:0/1799176257 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6938003d30 con 0x7f6940109df0 2024-09-21T05:54:37.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.724+0000 7f692f7fe640 1 -- 172.21.15.70:0/1799176257 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f69380044f0 con 0x7f6940109df0 2024-09-21T05:54:37.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.724+0000 7f6944c74640 1 -- 172.21.15.70:0/1799176257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69401acd50 con 0x7f6940109df0 2024-09-21T05:54:37.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.724+0000 7f692f7fe640 1 -- 172.21.15.70:0/1799176257 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6938030c10 con 0x7f6940109df0 2024-09-21T05:54:37.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.724+0000 7f6944c74640 1 -- 172.21.15.70:0/1799176257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69401ad230 con 0x7f6940109df0 2024-09-21T05:54:37.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.725+0000 7f6944c74640 1 -- 172.21.15.70:0/1799176257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6940103f70 con 0x7f6940109df0 2024-09-21T05:54:37.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.726+0000 7f692f7fe640 1 -- 172.21.15.70:0/1799176257 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f69380046a0 con 0x7f6940109df0 2024-09-21T05:54:37.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.727+0000 7f692f7fe640 1 --2- 172.21.15.70:0/1799176257 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f69280b6510 0x7f69280b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:37.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.727+0000 7f693e59c640 1 --2- 172.21.15.70:0/1799176257 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f69280b6510 0x7f69280b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:37.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.727+0000 7f692f7fe640 1 -- 172.21.15.70:0/1799176257 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f6938108e20 con 0x7f6940109df0 2024-09-21T05:54:37.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.728+0000 7f693e59c640 1 --2- 172.21.15.70:0/1799176257 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f69280b6510 0x7f69280b8a20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6930005fd0 tx=0x7f6930005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:37.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.730+0000 7f692f7fe640 1 -- 172.21.15.70:0/1799176257 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f69380cf350 con 0x7f6940109df0 2024-09-21T05:54:37.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:37 smithi116 ceph-mon[34332]: pgmap v524: 129 pgs: 129 active+clean; 99 MiB data, 772 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T05:54:37.821 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:37 smithi160 ceph-mon[33979]: pgmap v524: 129 pgs: 129 active+clean; 99 MiB data, 772 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T05:54:37.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.947+0000 7f6944c74640 1 -- 172.21.15.70:0/1799176257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f694010ff10 con 0x7f6940109df0 2024-09-21T05:54:37.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.947+0000 7f692f7fe640 1 -- 172.21.15.70:0/1799176257 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+12019 (secure 0 0 0) 0x7f694010ff10 con 0x7f6940109df0 2024-09-21T05:54:37.950 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:54:37.950 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":38,"btime":"2024-09-21T05:54:00:635553+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3519318330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3519318330},{"type":"v1","addr":"172.21.15.70:6835","nonce":3519318330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2706663460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2706663460},{"type":"v1","addr":"172.21.15.70:6837","nonce":2706663460}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:47:06.246985+0000","modified":"2024-09-21T05:54:00.122725+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24628,"mds_2":24611,"mds_3":24610,"mds_4":24598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/1914209867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1914209867},{"type":"v1","addr":"172.21.15.70:6839","nonce":1914209867}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3392175775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3392175775},{"type":"v1","addr":"172.21.15.70:6841","nonce":3392175775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/3543945704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3543945704},{"type":"v1","addr":"172.21.15.160:6833","nonce":3543945704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6833/283778129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":283778129},{"type":"v1","addr":"172.21.15.116:6833","nonce":283778129}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/3787256790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3787256790},{"type":"v1","addr":"172.21.15.116:6835","nonce":3787256790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.160:6835/2001692372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2001692372},{"type":"v1","addr":"172.21.15.160:6835","nonce":2001692372}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.160:6837/2558120045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2558120045},{"type":"v1","addr":"172.21.15.160:6837","nonce":2558120045}]},"join_fscid":-1,"export_targets":[0,1,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24611":{"gid":24611,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/444312934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":444312934},{"type":"v1","addr":"172.21.15.116:6837","nonce":444312934}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.160:6839/1339744282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1339744282},{"type":"v1","addr":"172.21.15.160:6839","nonce":1339744282}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/3952175670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3952175670},{"type":"v1","addr":"172.21.15.116:6839","nonce":3952175670}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24641,"qdb_cluster":[24598,24611,24610,24628,24641]},"id":1}]} 2024-09-21T05:54:37.950 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 38 2024-09-21T05:54:37.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.950+0000 7f6944c74640 1 -- 172.21.15.70:0/1799176257 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f69280b6510 msgr2=0x7f69280b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:37.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.950+0000 7f6944c74640 1 --2- 172.21.15.70:0/1799176257 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f69280b6510 0x7f69280b8a20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6930005fd0 tx=0x7f6930005850 comp rx=0 tx=0).stop 2024-09-21T05:54:37.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.950+0000 7f6944c74640 1 -- 172.21.15.70:0/1799176257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6940109df0 msgr2=0x7f69401a2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:37.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.950+0000 7f6944c74640 1 --2- 172.21.15.70:0/1799176257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6940109df0 0x7f69401a2220 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f6938031040 tx=0x7f69380093d0 comp rx=0 tx=0).stop 2024-09-21T05:54:37.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.950+0000 7f6944c74640 1 -- 172.21.15.70:0/1799176257 shutdown_connections 2024-09-21T05:54:37.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.950+0000 7f6944c74640 1 --2- 172.21.15.70:0/1799176257 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f69280b6510 0x7f69280b8a20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:37.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.950+0000 7f6944c74640 1 --2- 172.21.15.70:0/1799176257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f69401094a0 0x7f69401a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:37.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.950+0000 7f6944c74640 1 --2- 172.21.15.70:0/1799176257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6940109df0 0x7f69401a2220 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:37.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.950+0000 7f6944c74640 1 --2- 172.21.15.70:0/1799176257 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6940103b60 0x7f69401a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:37.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.950+0000 7f6944c74640 1 -- 172.21.15.70:0/1799176257 >> 172.21.15.70:0/1799176257 conn(0x7f694007b850 msgr2=0x7f6940105290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:37.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.950+0000 7f6944c74640 1 -- 172.21.15.70:0/1799176257 shutdown_connections 2024-09-21T05:54:37.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:37.950+0000 7f6944c74640 1 -- 172.21.15.70:0/1799176257 wait complete. 2024-09-21T05:54:38.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:38 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1799176257' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:54:38.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:38 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1799176257' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:54:38.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:38 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1799176257' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:54:38.950 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:54:39.200 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:54:39.491 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:39 smithi070 ceph-mon[30981]: pgmap v525: 129 pgs: 129 active+clean; 99 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-09-21T05:54:39.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.686+0000 7fc3bee14640 1 -- 172.21.15.70:0/992060420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3b8109500 msgr2=0x7fc3b8109910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:39.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.686+0000 7fc3bee14640 1 --2- 172.21.15.70:0/992060420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3b8109500 0x7fc3b8109910 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4009900 tx=0x7fc3a402a410 comp rx=0 tx=0).stop 2024-09-21T05:54:39.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.686+0000 7fc3bee14640 1 -- 172.21.15.70:0/992060420 shutdown_connections 2024-09-21T05:54:39.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.686+0000 7fc3bee14640 1 --2- 172.21.15.70:0/992060420 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3b8109e50 0x7fc3b8110680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:39.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.686+0000 7fc3bee14640 1 --2- 172.21.15.70:0/992060420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3b8109500 0x7fc3b8109910 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:39.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.686+0000 7fc3bee14640 1 --2- 172.21.15.70:0/992060420 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc3b8101fc0 0x7fc3b81023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:39.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.686+0000 7fc3bee14640 1 -- 172.21.15.70:0/992060420 >> 172.21.15.70:0/992060420 conn(0x7fc3b8079f90 msgr2=0x7fc3b807a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:39.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.686+0000 7fc3bee14640 1 -- 172.21.15.70:0/992060420 shutdown_connections 2024-09-21T05:54:39.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.686+0000 7fc3bee14640 1 -- 172.21.15.70:0/992060420 wait complete. 2024-09-21T05:54:39.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.686+0000 7fc3bee14640 1 Processor -- start 2024-09-21T05:54:39.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.686+0000 7fc3bee14640 1 -- start start 2024-09-21T05:54:39.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.687+0000 7fc3bee14640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3b8101fc0 0x7fc3b8102f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:39.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.687+0000 7fc3bee14640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3b8109500 0x7fc3b81034a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:39.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.687+0000 7fc3bee14640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc3b8109e50 0x7fc3b81039e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:39.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.687+0000 7fc3bee14640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b8113ae0 con 0x7fc3b8101fc0 2024-09-21T05:54:39.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.687+0000 7fc3bee14640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b8113960 con 0x7fc3b8109500 2024-09-21T05:54:39.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.687+0000 7fc3bee14640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b8113c60 con 0x7fc3b8109e50 2024-09-21T05:54:39.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.687+0000 7fc3bcbb0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3b8101fc0 0x7fc3b8102f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:39.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.687+0000 7fc3bcbb0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3b8101fc0 0x7fc3b8102f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34262/0 (socket says 172.21.15.70:34262) 2024-09-21T05:54:39.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.687+0000 7fc3bcbb0640 1 -- 172.21.15.70:0/1053538482 learned_addr learned my addr 172.21.15.70:0/1053538482 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:54:39.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.687+0000 7fc3bd3b1640 1 --2- 172.21.15.70:0/1053538482 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc3b8109e50 0x7fc3b81039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:39.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.687+0000 7fc3b7fff640 1 --2- 172.21.15.70:0/1053538482 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3b8109500 0x7fc3b81034a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:39.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.687+0000 7fc3bcbb0640 1 -- 172.21.15.70:0/1053538482 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc3b8109e50 msgr2=0x7fc3b81039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:39.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.687+0000 7fc3bcbb0640 1 --2- 172.21.15.70:0/1053538482 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc3b8109e50 0x7fc3b81039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:39.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.687+0000 7fc3bcbb0640 1 -- 172.21.15.70:0/1053538482 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3b8109500 msgr2=0x7fc3b81034a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:39.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.687+0000 7fc3bcbb0640 1 --2- 172.21.15.70:0/1053538482 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3b8109500 0x7fc3b81034a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:39.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.687+0000 7fc3bcbb0640 1 -- 172.21.15.70:0/1053538482 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b81a8790 con 0x7fc3b8101fc0 2024-09-21T05:54:39.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.687+0000 7fc3bcbb0640 1 --2- 172.21.15.70:0/1053538482 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3b8101fc0 0x7fc3b8102f60 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac00e9f0 tx=0x7fc3ac00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:39.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.687+0000 7fc3b5ffb640 1 -- 172.21.15.70:0/1053538482 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac00cd80 con 0x7fc3b8101fc0 2024-09-21T05:54:39.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.688+0000 7fc3b5ffb640 1 -- 172.21.15.70:0/1053538482 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fc3ac0054d0 con 0x7fc3b8101fc0 2024-09-21T05:54:39.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.688+0000 7fc3bee14640 1 -- 172.21.15.70:0/1053538482 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3b81a8a80 con 0x7fc3b8101fc0 2024-09-21T05:54:39.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.688+0000 7fc3b5ffb640 1 -- 172.21.15.70:0/1053538482 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac010690 con 0x7fc3b8101fc0 2024-09-21T05:54:39.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.688+0000 7fc3bee14640 1 -- 172.21.15.70:0/1053538482 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3b81a8f40 con 0x7fc3b8101fc0 2024-09-21T05:54:39.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.689+0000 7fc3bee14640 1 -- 172.21.15.70:0/1053538482 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3b81023d0 con 0x7fc3b8101fc0 2024-09-21T05:54:39.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.690+0000 7fc3b5ffb640 1 -- 172.21.15.70:0/1053538482 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7fc3ac0046c0 con 0x7fc3b8101fc0 2024-09-21T05:54:39.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.691+0000 7fc3b5ffb640 1 --2- 172.21.15.70:0/1053538482 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc3a80b6510 0x7fc3a80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:39.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.691+0000 7fc3b7fff640 1 --2- 172.21.15.70:0/1053538482 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc3a80b6510 0x7fc3a80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:39.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.691+0000 7fc3b5ffb640 1 -- 172.21.15.70:0/1053538482 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7fc3ac0e7b70 con 0x7fc3b8101fc0 2024-09-21T05:54:39.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.691+0000 7fc3b7fff640 1 --2- 172.21.15.70:0/1053538482 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc3a80b6510 0x7fc3a80b8a20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4009230 tx=0x7fc3a4005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:39.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.695+0000 7fc3b5ffb640 1 -- 172.21.15.70:0/1053538482 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc3ac0ae010 con 0x7fc3b8101fc0 2024-09-21T05:54:39.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:39 smithi116 ceph-mon[34332]: pgmap v525: 129 pgs: 129 active+clean; 99 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-09-21T05:54:39.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:39 smithi160 ceph-mon[33979]: pgmap v525: 129 pgs: 129 active+clean; 99 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-09-21T05:54:39.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.911+0000 7fc3bee14640 1 -- 172.21.15.70:0/1053538482 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3b802e640 con 0x7fc3b8101fc0 2024-09-21T05:54:39.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.912+0000 7fc3b5ffb640 1 -- 172.21.15.70:0/1053538482 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+12019 (secure 0 0 0) 0x7fc3ac0b23f0 con 0x7fc3b8101fc0 2024-09-21T05:54:39.915 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:54:39.915 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":38,"btime":"2024-09-21T05:54:00:635553+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3519318330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3519318330},{"type":"v1","addr":"172.21.15.70:6835","nonce":3519318330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2706663460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2706663460},{"type":"v1","addr":"172.21.15.70:6837","nonce":2706663460}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:47:06.246985+0000","modified":"2024-09-21T05:54:00.122725+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24628,"mds_2":24611,"mds_3":24610,"mds_4":24598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14787":{"gid":14787,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/1914209867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1914209867},{"type":"v1","addr":"172.21.15.70:6839","nonce":1914209867}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3392175775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3392175775},{"type":"v1","addr":"172.21.15.70:6841","nonce":3392175775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/3543945704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3543945704},{"type":"v1","addr":"172.21.15.160:6833","nonce":3543945704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6833/283778129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":283778129},{"type":"v1","addr":"172.21.15.116:6833","nonce":283778129}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/3787256790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3787256790},{"type":"v1","addr":"172.21.15.116:6835","nonce":3787256790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.160:6835/2001692372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2001692372},{"type":"v1","addr":"172.21.15.160:6835","nonce":2001692372}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.160:6837/2558120045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2558120045},{"type":"v1","addr":"172.21.15.160:6837","nonce":2558120045}]},"join_fscid":-1,"export_targets":[0,1,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24611":{"gid":24611,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/444312934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":444312934},{"type":"v1","addr":"172.21.15.116:6837","nonce":444312934}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.160:6839/1339744282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1339744282},{"type":"v1","addr":"172.21.15.160:6839","nonce":1339744282}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/3952175670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3952175670},{"type":"v1","addr":"172.21.15.116:6839","nonce":3952175670}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24641,"qdb_cluster":[24598,24611,24610,24628,24641]},"id":1}]} 2024-09-21T05:54:39.915 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 38 2024-09-21T05:54:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.915+0000 7fc3bee14640 1 -- 172.21.15.70:0/1053538482 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc3a80b6510 msgr2=0x7fc3a80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.915+0000 7fc3bee14640 1 --2- 172.21.15.70:0/1053538482 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc3a80b6510 0x7fc3a80b8a20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4009230 tx=0x7fc3a4005d50 comp rx=0 tx=0).stop 2024-09-21T05:54:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.915+0000 7fc3bee14640 1 -- 172.21.15.70:0/1053538482 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3b8101fc0 msgr2=0x7fc3b8102f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.915+0000 7fc3bee14640 1 --2- 172.21.15.70:0/1053538482 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3b8101fc0 0x7fc3b8102f60 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac00e9f0 tx=0x7fc3ac00edf0 comp rx=0 tx=0).stop 2024-09-21T05:54:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.915+0000 7fc3bee14640 1 -- 172.21.15.70:0/1053538482 shutdown_connections 2024-09-21T05:54:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.915+0000 7fc3bee14640 1 --2- 172.21.15.70:0/1053538482 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fc3a80b6510 0x7fc3a80b8a20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.915+0000 7fc3bee14640 1 --2- 172.21.15.70:0/1053538482 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc3b8109e50 0x7fc3b81039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.915+0000 7fc3bee14640 1 --2- 172.21.15.70:0/1053538482 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3b8109500 0x7fc3b81034a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.915+0000 7fc3bee14640 1 --2- 172.21.15.70:0/1053538482 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3b8101fc0 0x7fc3b8102f60 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.915+0000 7fc3bee14640 1 -- 172.21.15.70:0/1053538482 >> 172.21.15.70:0/1053538482 conn(0x7fc3b8079f90 msgr2=0x7fc3b8107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.915+0000 7fc3bee14640 1 -- 172.21.15.70:0/1053538482 shutdown_connections 2024-09-21T05:54:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:39.915+0000 7fc3bee14640 1 -- 172.21.15.70:0/1053538482 wait complete. 2024-09-21T05:54:40.694 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:40 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1053538482' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:54:40.723 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:54:40.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:40 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1053538482' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:54:40.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:40 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1053538482' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:54:40.968 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:54:41.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.442+0000 7f4c372f2640 1 -- 172.21.15.70:0/530489448 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c30103b60 msgr2=0x7f4c30103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:41.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.442+0000 7f4c372f2640 1 --2- 172.21.15.70:0/530489448 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c30103b60 0x7f4c30103f70 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c009900 tx=0x7f4c2c02a410 comp rx=0 tx=0).stop 2024-09-21T05:54:41.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.443+0000 7f4c372f2640 1 -- 172.21.15.70:0/530489448 shutdown_connections 2024-09-21T05:54:41.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.443+0000 7f4c372f2640 1 --2- 172.21.15.70:0/530489448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c30109df0 0x7f4c30110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:41.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.443+0000 7f4c372f2640 1 --2- 172.21.15.70:0/530489448 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c301094a0 0x7f4c301098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:41.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.443+0000 7f4c372f2640 1 --2- 172.21.15.70:0/530489448 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c30103b60 0x7f4c30103f70 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:41.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.443+0000 7f4c372f2640 1 -- 172.21.15.70:0/530489448 >> 172.21.15.70:0/530489448 conn(0x7f4c3007b850 msgr2=0x7f4c3007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:41.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.443+0000 7f4c372f2640 1 -- 172.21.15.70:0/530489448 shutdown_connections 2024-09-21T05:54:41.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.443+0000 7f4c372f2640 1 -- 172.21.15.70:0/530489448 wait complete. 2024-09-21T05:54:41.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.443+0000 7f4c372f2640 1 Processor -- start 2024-09-21T05:54:41.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.443+0000 7f4c372f2640 1 -- start start 2024-09-21T05:54:41.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.444+0000 7f4c372f2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c30103b60 0x7f4c3019c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:41.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.444+0000 7f4c372f2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c301094a0 0x7f4c3019ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:41.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.444+0000 7f4c372f2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c30109df0 0x7f4c301a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:41.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.444+0000 7f4c372f2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4c30113aa0 con 0x7f4c30109df0 2024-09-21T05:54:41.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.444+0000 7f4c372f2640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4c30113920 con 0x7f4c30103b60 2024-09-21T05:54:41.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.444+0000 7f4c372f2640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4c30113c20 con 0x7f4c301094a0 2024-09-21T05:54:41.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.444+0000 7f4c3588f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c30109df0 0x7f4c301a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:41.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.444+0000 7f4c3588f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c30109df0 0x7f4c301a1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33894/0 (socket says 172.21.15.70:33894) 2024-09-21T05:54:41.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.444+0000 7f4c3588f640 1 -- 172.21.15.70:0/1775597435 learned_addr learned my addr 172.21.15.70:0/1775597435 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:54:41.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.444+0000 7f4c3508e640 1 --2- 172.21.15.70:0/1775597435 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c30103b60 0x7f4c3019c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:41.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.444+0000 7f4c3488d640 1 --2- 172.21.15.70:0/1775597435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c301094a0 0x7f4c3019ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:41.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.444+0000 7f4c3588f640 1 -- 172.21.15.70:0/1775597435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c301094a0 msgr2=0x7f4c3019ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:41.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.444+0000 7f4c3588f640 1 --2- 172.21.15.70:0/1775597435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c301094a0 0x7f4c3019ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:41.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.444+0000 7f4c3588f640 1 -- 172.21.15.70:0/1775597435 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c30103b60 msgr2=0x7f4c3019c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:41.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.444+0000 7f4c3588f640 1 --2- 172.21.15.70:0/1775597435 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c30103b60 0x7f4c3019c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:41.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.444+0000 7f4c3588f640 1 -- 172.21.15.70:0/1775597435 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c301a26c0 con 0x7f4c30109df0 2024-09-21T05:54:41.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.444+0000 7f4c3588f640 1 --2- 172.21.15.70:0/1775597435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c30109df0 0x7f4c301a1f90 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4c2800eaa0 tx=0x7f4c2800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:41.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.444+0000 7f4c267fc640 1 -- 172.21.15.70:0/1775597435 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c2800cdb0 con 0x7f4c30109df0 2024-09-21T05:54:41.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.444+0000 7f4c267fc640 1 -- 172.21.15.70:0/1775597435 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f4c28005020 con 0x7f4c30109df0 2024-09-21T05:54:41.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.444+0000 7f4c372f2640 1 -- 172.21.15.70:0/1775597435 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c301a29b0 con 0x7f4c30109df0 2024-09-21T05:54:41.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.444+0000 7f4c267fc640 1 -- 172.21.15.70:0/1775597435 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c280116d0 con 0x7f4c30109df0 2024-09-21T05:54:41.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.445+0000 7f4c372f2640 1 -- 172.21.15.70:0/1775597435 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c301a9110 con 0x7f4c30109df0 2024-09-21T05:54:41.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.445+0000 7f4c372f2640 1 -- 172.21.15.70:0/1775597435 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c30103f70 con 0x7f4c30109df0 2024-09-21T05:54:41.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.447+0000 7f4c267fc640 1 -- 172.21.15.70:0/1775597435 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f4c28005580 con 0x7f4c30109df0 2024-09-21T05:54:41.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.447+0000 7f4c267fc640 1 --2- 172.21.15.70:0/1775597435 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4c1c0b6510 0x7f4c1c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:41.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.448+0000 7f4c3508e640 1 --2- 172.21.15.70:0/1775597435 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4c1c0b6510 0x7f4c1c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:41.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.448+0000 7f4c267fc640 1 -- 172.21.15.70:0/1775597435 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f4c280e7bb0 con 0x7f4c30109df0 2024-09-21T05:54:41.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.448+0000 7f4c3508e640 1 --2- 172.21.15.70:0/1775597435 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4c1c0b6510 0x7f4c1c0b8a20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c005d90 tx=0x7f4c2c005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:41.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.451+0000 7f4c267fc640 1 -- 172.21.15.70:0/1775597435 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4c28016030 con 0x7f4c30109df0 2024-09-21T05:54:41.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.630+0000 7f4c372f2640 1 -- 172.21.15.70:0/1775597435 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4c3019d880 con 0x7f4c30109df0 2024-09-21T05:54:41.632 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:41 smithi070 ceph-mon[30981]: pgmap v526: 129 pgs: 129 active+clean; 99 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T05:54:41.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.631+0000 7f4c267fc640 1 -- 172.21.15.70:0/1775597435 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24983 (secure 0 0 0) 0x7f4c3019d880 con 0x7f4c30109df0 2024-09-21T05:54:41.634 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-21T05:54:41.634 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":85,"fsid":"96c6636e-77db-11ef-baf5-efdc52797490","created":"2024-09-21T05:38:42.297307+0000","modified":"2024-09-21T05:48:38.706309+0000","last_up_change":"2024-09-21T05:46:15.910344+0000","last_in_change":"2024-09-21T05:45:53.382766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:42:25.611590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:47:01.987981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:47:04.388107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T05:47:10.651871+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00be8b82-7cb1-443f-ad18-02916f734df7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6803","nonce":1667051447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6805","nonce":1667051447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6809","nonce":1667051447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1667051447},{"type":"v1","addr":"172.21.15.70:6807","nonce":1667051447}]},"public_addr":"172.21.15.70:6803/1667051447","cluster_addr":"172.21.15.70:6805/1667051447","heartbeat_back_addr":"172.21.15.70:6809/1667051447","heartbeat_front_addr":"172.21.15.70:6807/1667051447","state":["exists","up"]},{"osd":1,"uuid":"28ca8c5c-5e81-4e64-ac0e-3c8c3c2d3930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6801","nonce":1037621846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6803","nonce":1037621846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6807","nonce":1037621846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1037621846},{"type":"v1","addr":"172.21.15.116:6805","nonce":1037621846}]},"public_addr":"172.21.15.116:6801/1037621846","cluster_addr":"172.21.15.116:6803/1037621846","heartbeat_back_addr":"172.21.15.116:6807/1037621846","heartbeat_front_addr":"172.21.15.116:6805/1037621846","state":["exists","up"]},{"osd":2,"uuid":"e9b42bf2-a38b-4cf9-8774-4950de12d0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6801","nonce":69260815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6803","nonce":69260815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6807","nonce":69260815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":69260815},{"type":"v1","addr":"172.21.15.160:6805","nonce":69260815}]},"public_addr":"172.21.15.160:6801/69260815","cluster_addr":"172.21.15.160:6803/69260815","heartbeat_back_addr":"172.21.15.160:6807/69260815","heartbeat_front_addr":"172.21.15.160:6805/69260815","state":["exists","up"]},{"osd":3,"uuid":"25d8e9a8-3c14-43d6-9bb1-b44cd377133f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6811","nonce":3849416072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6813","nonce":3849416072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6817","nonce":3849416072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3849416072},{"type":"v1","addr":"172.21.15.70:6815","nonce":3849416072}]},"public_addr":"172.21.15.70:6811/3849416072","cluster_addr":"172.21.15.70:6813/3849416072","heartbeat_back_addr":"172.21.15.70:6817/3849416072","heartbeat_front_addr":"172.21.15.70:6815/3849416072","state":["exists","up"]},{"osd":4,"uuid":"bdb84cbd-d718-4f69-90d0-2e732e580df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6809","nonce":3444857438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6811","nonce":3444857438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6815","nonce":3444857438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3444857438},{"type":"v1","addr":"172.21.15.116:6813","nonce":3444857438}]},"public_addr":"172.21.15.116:6809/3444857438","cluster_addr":"172.21.15.116:6811/3444857438","heartbeat_back_addr":"172.21.15.116:6815/3444857438","heartbeat_front_addr":"172.21.15.116:6813/3444857438","state":["exists","up"]},{"osd":5,"uuid":"a490eeba-549f-4caa-8cd5-4168a23dafa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6809","nonce":3063220427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6811","nonce":3063220427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6815","nonce":3063220427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":3063220427},{"type":"v1","addr":"172.21.15.160:6813","nonce":3063220427}]},"public_addr":"172.21.15.160:6809/3063220427","cluster_addr":"172.21.15.160:6811/3063220427","heartbeat_back_addr":"172.21.15.160:6815/3063220427","heartbeat_front_addr":"172.21.15.160:6813/3063220427","state":["exists","up"]},{"osd":6,"uuid":"1bf22f48-c02f-4f09-b0fe-2597a55fd795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6819","nonce":3650315688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6821","nonce":3650315688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6825","nonce":3650315688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3650315688},{"type":"v1","addr":"172.21.15.70:6823","nonce":3650315688}]},"public_addr":"172.21.15.70:6819/3650315688","cluster_addr":"172.21.15.70:6821/3650315688","heartbeat_back_addr":"172.21.15.70:6825/3650315688","heartbeat_front_addr":"172.21.15.70:6823/3650315688","state":["exists","up"]},{"osd":7,"uuid":"40d59744-4860-4a92-aa21-3f33e575e5b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6817","nonce":2034132009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6819","nonce":2034132009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6823","nonce":2034132009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":2034132009},{"type":"v1","addr":"172.21.15.116:6821","nonce":2034132009}]},"public_addr":"172.21.15.116:6817/2034132009","cluster_addr":"172.21.15.116:6819/2034132009","heartbeat_back_addr":"172.21.15.116:6823/2034132009","heartbeat_front_addr":"172.21.15.116:6821/2034132009","state":["exists","up"]},{"osd":8,"uuid":"65dc02e7-0dcd-4fa7-955a-4d5c00fbe4cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6817","nonce":3381625184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6819","nonce":3381625184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6823","nonce":3381625184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3381625184},{"type":"v1","addr":"172.21.15.160:6821","nonce":3381625184}]},"public_addr":"172.21.15.160:6817/3381625184","cluster_addr":"172.21.15.160:6819/3381625184","heartbeat_back_addr":"172.21.15.160:6823/3381625184","heartbeat_front_addr":"172.21.15.160:6821/3381625184","state":["exists","up"]},{"osd":9,"uuid":"d8438a9c-012f-4082-be3f-9653cdfaac78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6827","nonce":3555256209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6829","nonce":3555256209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6833","nonce":3555256209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":3555256209},{"type":"v1","addr":"172.21.15.70:6831","nonce":3555256209}]},"public_addr":"172.21.15.70:6827/3555256209","cluster_addr":"172.21.15.70:6829/3555256209","heartbeat_back_addr":"172.21.15.70:6833/3555256209","heartbeat_front_addr":"172.21.15.70:6831/3555256209","state":["exists","up"]},{"osd":10,"uuid":"871619b0-181e-4020-9511-2cec296bfe70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6825","nonce":541280433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6827","nonce":541280433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6831","nonce":541280433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":541280433},{"type":"v1","addr":"172.21.15.116:6829","nonce":541280433}]},"public_addr":"172.21.15.116:6825/541280433","cluster_addr":"172.21.15.116:6827/541280433","heartbeat_back_addr":"172.21.15.116:6831/541280433","heartbeat_front_addr":"172.21.15.116:6829/541280433","state":["exists","up"]},{"osd":11,"uuid":"302da945-7929-4b0c-a20b-099175752c41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6825","nonce":2632369083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6827","nonce":2632369083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6831","nonce":2632369083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2632369083},{"type":"v1","addr":"172.21.15.160:6829","nonce":2632369083}]},"public_addr":"172.21.15.160:6825/2632369083","cluster_addr":"172.21.15.160:6827/2632369083","heartbeat_back_addr":"172.21.15.160:6831/2632369083","heartbeat_front_addr":"172.21.15.160:6829/2632369083","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:41:34.446744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:41:59.336955+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:42:23.958219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:42:49.396007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:43:15.325344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:43:41.923141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:07.873970+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:33.897951+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:58.397680+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:24.568406+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:49.504565+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:14.698577+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.e","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6800/605055695":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/897886925":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/1968357524":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/693721445":"2024-09-22T05:39:37.296630+0000","172.21.15.70:0/2810307308":"2024-09-22T05:39:12.492271+0000","172.21.15.70:6801/605055695":"2024-09-22T05:39:37.296630+0000","172.21.15.70:6801/1668927582":"2024-09-22T05:39:12.492271+0000","172.21.15.70:6800/1668927582":"2024-09-22T05:39:12.492271+0000","172.21.15.70:0/1979536420":"2024-09-22T05:39:12.492271+0000","172.21.15.70:0/2674019604":"2024-09-22T05:39:12.492271+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:54:41.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.634+0000 7f4c372f2640 1 -- 172.21.15.70:0/1775597435 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4c1c0b6510 msgr2=0x7f4c1c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:41.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.634+0000 7f4c372f2640 1 --2- 172.21.15.70:0/1775597435 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4c1c0b6510 0x7f4c1c0b8a20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c005d90 tx=0x7f4c2c005e50 comp rx=0 tx=0).stop 2024-09-21T05:54:41.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.634+0000 7f4c372f2640 1 -- 172.21.15.70:0/1775597435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c30109df0 msgr2=0x7f4c301a1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:41.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.634+0000 7f4c372f2640 1 --2- 172.21.15.70:0/1775597435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c30109df0 0x7f4c301a1f90 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4c2800eaa0 tx=0x7f4c2800ef60 comp rx=0 tx=0).stop 2024-09-21T05:54:41.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.634+0000 7f4c372f2640 1 -- 172.21.15.70:0/1775597435 shutdown_connections 2024-09-21T05:54:41.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.634+0000 7f4c372f2640 1 --2- 172.21.15.70:0/1775597435 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f4c1c0b6510 0x7f4c1c0b8a20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:41.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.634+0000 7f4c372f2640 1 --2- 172.21.15.70:0/1775597435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c301094a0 0x7f4c3019ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:41.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.634+0000 7f4c372f2640 1 --2- 172.21.15.70:0/1775597435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c30109df0 0x7f4c301a1f90 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:41.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.634+0000 7f4c372f2640 1 --2- 172.21.15.70:0/1775597435 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c30103b60 0x7f4c3019c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:41.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.634+0000 7f4c372f2640 1 -- 172.21.15.70:0/1775597435 >> 172.21.15.70:0/1775597435 conn(0x7f4c3007b850 msgr2=0x7f4c30107350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:41.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.634+0000 7f4c372f2640 1 -- 172.21.15.70:0/1775597435 shutdown_connections 2024-09-21T05:54:41.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:41.634+0000 7f4c372f2640 1 -- 172.21.15.70:0/1775597435 wait complete. 2024-09-21T05:54:41.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:41 smithi116 ceph-mon[34332]: pgmap v526: 129 pgs: 129 active+clean; 99 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T05:54:41.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:41 smithi160 ceph-mon[33979]: pgmap v526: 129 pgs: 129 active+clean; 99 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T05:54:42.442 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs fail cephfs 2024-09-21T05:54:42.693 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:54:42.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:42 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1775597435' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:54:42.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:42 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1775597435' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:54:42.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:42 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1775597435' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:54:43.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.187+0000 7f8ea67f0640 1 -- 172.21.15.70:0/2198893341 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ea0075730 msgr2=0x7f8ea0075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:43.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.187+0000 7f8ea67f0640 1 --2- 172.21.15.70:0/2198893341 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ea0075730 0x7f8ea0075b40 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f8e90009900 tx=0x7f8e9002a410 comp rx=0 tx=0).stop 2024-09-21T05:54:43.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.188+0000 7f8ea67f0640 1 -- 172.21.15.70:0/2198893341 shutdown_connections 2024-09-21T05:54:43.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.188+0000 7f8ea67f0640 1 --2- 172.21.15.70:0/2198893341 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ea0110140 0x7f8ea0112560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:43.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.188+0000 7f8ea67f0640 1 --2- 172.21.15.70:0/2198893341 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ea0076080 0x7f8ea010fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:43.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.188+0000 7f8ea67f0640 1 --2- 172.21.15.70:0/2198893341 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ea0075730 0x7f8ea0075b40 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:43.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.188+0000 7f8ea67f0640 1 -- 172.21.15.70:0/2198893341 >> 172.21.15.70:0/2198893341 conn(0x7f8ea007b850 msgr2=0x7f8ea007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:43.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.188+0000 7f8ea67f0640 1 -- 172.21.15.70:0/2198893341 shutdown_connections 2024-09-21T05:54:43.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.188+0000 7f8ea67f0640 1 -- 172.21.15.70:0/2198893341 wait complete. 2024-09-21T05:54:43.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.188+0000 7f8ea67f0640 1 Processor -- start 2024-09-21T05:54:43.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.188+0000 7f8ea67f0640 1 -- start start 2024-09-21T05:54:43.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.189+0000 7f8ea67f0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ea0075730 0x7f8ea019c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:43.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.189+0000 7f8ea67f0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ea0076080 0x7f8ea019cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:43.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.189+0000 7f8ea67f0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ea0110140 0x7f8ea01a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:43.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.189+0000 7f8ea67f0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea0115c90 con 0x7f8ea0075730 2024-09-21T05:54:43.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.189+0000 7f8ea67f0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea0115b10 con 0x7f8ea0110140 2024-09-21T05:54:43.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.189+0000 7f8ea67f0640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea0115e10 con 0x7f8ea0076080 2024-09-21T05:54:43.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.189+0000 7f8e9ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ea0075730 0x7f8ea019c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:43.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.189+0000 7f8e9ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ea0075730 0x7f8ea019c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33914/0 (socket says 172.21.15.70:33914) 2024-09-21T05:54:43.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.189+0000 7f8e9ffff640 1 -- 172.21.15.70:0/4053606074 learned_addr learned my addr 172.21.15.70:0/4053606074 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:54:43.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.189+0000 7f8ea4d8d640 1 --2- 172.21.15.70:0/4053606074 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ea0110140 0x7f8ea01a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:43.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.189+0000 7f8e9ffff640 1 -- 172.21.15.70:0/4053606074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ea0076080 msgr2=0x7f8ea019cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:43.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.189+0000 7f8e9ffff640 1 --2- 172.21.15.70:0/4053606074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ea0076080 0x7f8ea019cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:43.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.189+0000 7f8e9ffff640 1 -- 172.21.15.70:0/4053606074 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ea0110140 msgr2=0x7f8ea01a1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:43.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.189+0000 7f8e9ffff640 1 --2- 172.21.15.70:0/4053606074 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ea0110140 0x7f8ea01a1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:43.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.189+0000 7f8e9ffff640 1 -- 172.21.15.70:0/4053606074 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea01a25f0 con 0x7f8ea0075730 2024-09-21T05:54:43.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.189+0000 7f8e9ffff640 1 --2- 172.21.15.70:0/4053606074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ea0075730 0x7f8ea019c680 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f8e90005940 tx=0x7f8e900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:43.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.189+0000 7f8e9d7fa640 1 -- 172.21.15.70:0/4053606074 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9003f030 con 0x7f8ea0075730 2024-09-21T05:54:43.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.190+0000 7f8e9d7fa640 1 -- 172.21.15.70:0/4053606074 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f8e90003cb0 con 0x7f8ea0075730 2024-09-21T05:54:43.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.190+0000 7f8ea67f0640 1 -- 172.21.15.70:0/4053606074 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ea01a2880 con 0x7f8ea0075730 2024-09-21T05:54:43.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.190+0000 7f8e9d7fa640 1 -- 172.21.15.70:0/4053606074 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e90035070 con 0x7f8ea0075730 2024-09-21T05:54:43.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.190+0000 7f8ea67f0640 1 -- 172.21.15.70:0/4053606074 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ea01a9040 con 0x7f8ea0075730 2024-09-21T05:54:43.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.191+0000 7f8ea67f0640 1 -- 172.21.15.70:0/4053606074 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ea0075b40 con 0x7f8ea0075730 2024-09-21T05:54:43.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.192+0000 7f8e9d7fa640 1 -- 172.21.15.70:0/4053606074 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f8e90042030 con 0x7f8ea0075730 2024-09-21T05:54:43.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.193+0000 7f8e9d7fa640 1 --2- 172.21.15.70:0/4053606074 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f8e880b6510 0x7f8e880b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:43.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.193+0000 7f8e9f7fe640 1 --2- 172.21.15.70:0/4053606074 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f8e880b6510 0x7f8e880b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:43.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.193+0000 7f8e9d7fa640 1 -- 172.21.15.70:0/4053606074 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9237+0+0 (secure 0 0 0) 0x7f8e901082e0 con 0x7f8ea0075730 2024-09-21T05:54:43.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.194+0000 7f8e9f7fe640 1 --2- 172.21.15.70:0/4053606074 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f8e880b6510 0x7f8e880b8a20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0111e30 tx=0x7f8e94005bf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:43.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.196+0000 7f8e9d7fa640 1 -- 172.21.15.70:0/4053606074 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8e900ce780 con 0x7f8ea0075730 2024-09-21T05:54:43.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.412+0000 7f8ea67f0640 1 -- 172.21.15.70:0/4053606074 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f8ea01a92e0 con 0x7f8ea0075730 2024-09-21T05:54:43.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.415+0000 7f8e9d7fa640 1 -- 172.21.15.70:0/4053606074 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v39) ==== 161+0+0 (secure 0 0 0) 0x7f8e900d2b60 con 0x7f8ea0075730 2024-09-21T05:54:43.417 INFO:teuthology.orchestra.run.smithi070.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T05:54:43.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.418+0000 7f8ea67f0640 1 -- 172.21.15.70:0/4053606074 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f8e880b6510 msgr2=0x7f8e880b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:43.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.418+0000 7f8ea67f0640 1 --2- 172.21.15.70:0/4053606074 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f8e880b6510 0x7f8e880b8a20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0111e30 tx=0x7f8e94005bf0 comp rx=0 tx=0).stop 2024-09-21T05:54:43.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.418+0000 7f8ea67f0640 1 -- 172.21.15.70:0/4053606074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ea0075730 msgr2=0x7f8ea019c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:43.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.418+0000 7f8ea67f0640 1 --2- 172.21.15.70:0/4053606074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ea0075730 0x7f8ea019c680 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f8e90005940 tx=0x7f8e900042f0 comp rx=0 tx=0).stop 2024-09-21T05:54:43.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.418+0000 7f8ea67f0640 1 -- 172.21.15.70:0/4053606074 shutdown_connections 2024-09-21T05:54:43.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.418+0000 7f8ea67f0640 1 --2- 172.21.15.70:0/4053606074 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f8e880b6510 0x7f8e880b8a20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:43.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.418+0000 7f8ea67f0640 1 --2- 172.21.15.70:0/4053606074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ea0076080 0x7f8ea019cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:43.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.418+0000 7f8ea67f0640 1 --2- 172.21.15.70:0/4053606074 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ea0110140 0x7f8ea01a1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:43.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.418+0000 7f8ea67f0640 1 --2- 172.21.15.70:0/4053606074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ea0075730 0x7f8ea019c680 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:43.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.418+0000 7f8ea67f0640 1 -- 172.21.15.70:0/4053606074 >> 172.21.15.70:0/4053606074 conn(0x7f8ea007b850 msgr2=0x7f8ea0109ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:43.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.420+0000 7f8ea67f0640 1 -- 172.21.15.70:0/4053606074 shutdown_connections 2024-09-21T05:54:43.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:43.421+0000 7f8ea67f0640 1 -- 172.21.15.70:0/4053606074 wait complete. 2024-09-21T05:54:43.745 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 21 05:54:43 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-a[72620]: ignoring --setuser ceph since I am not root 2024-09-21T05:54:43.745 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 21 05:54:43 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-a[72620]: ignoring --setgroup ceph since I am not root 2024-09-21T05:54:43.746 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 21 05:54:43 smithi070 ceph-mds[72636]: -- 172.21.15.70:0/183633938 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561ba9779860 con 0x561bad921600 2024-09-21T05:54:43.746 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 21 05:54:43 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-a[72620]: starting mds.a at 2024-09-21T05:54:43.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:43 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mon-a[30977]: 2024-09-21T05:54:43.413+0000 7f6249f06640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T05:54:43.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:43 smithi070 ceph-mon[30981]: pgmap v527: 129 pgs: 129 active+clean; 99 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T05:54:43.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:43 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/4053606074' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T05:54:43.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:43 smithi070 ceph-mon[30981]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T05:54:43.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:43 smithi070 ceph-mon[30981]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T05:54:43.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:43 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/4053606074' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T05:54:43.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:43 smithi070 ceph-mon[30981]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T05:54:43.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:43 smithi070 ceph-mon[30981]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-21T05:54:43.747 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 21 05:54:43 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-g[72318]: ignoring --setuser ceph since I am not root 2024-09-21T05:54:43.747 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 21 05:54:43 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-g[72318]: ignoring --setgroup ceph since I am not root 2024-09-21T05:54:43.747 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 21 05:54:43 smithi070 ceph-mds[72325]: -- 172.21.15.70:0/2763485886 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dc1c8e1860 con 0x55dc20a89a80 2024-09-21T05:54:43.747 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 21 05:54:43 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-g[72318]: starting mds.g at 2024-09-21T05:54:43.804 INFO:journalctl@ceph.mds.h.smithi116.stdout:Sep 21 05:54:43 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-h[61893]: ignoring --setuser ceph since I am not root 2024-09-21T05:54:43.804 INFO:journalctl@ceph.mds.h.smithi116.stdout:Sep 21 05:54:43 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-h[61893]: ignoring --setgroup ceph since I am not root 2024-09-21T05:54:43.804 INFO:journalctl@ceph.mds.h.smithi116.stdout:Sep 21 05:54:43 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-h[61893]: starting mds.h at 2024-09-21T05:54:43.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:43 smithi116 ceph-mon[34332]: pgmap v527: 129 pgs: 129 active+clean; 99 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T05:54:43.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:43 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/4053606074' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T05:54:43.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:43 smithi116 ceph-mon[34332]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T05:54:43.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:43 smithi116 ceph-mon[34332]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T05:54:43.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:43 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/4053606074' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T05:54:43.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:43 smithi116 ceph-mon[34332]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T05:54:43.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:43 smithi116 ceph-mon[34332]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-21T05:54:43.805 INFO:journalctl@ceph.mds.b.smithi116.stdout:Sep 21 05:54:43 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-b[62172]: ignoring --setuser ceph since I am not root 2024-09-21T05:54:43.805 INFO:journalctl@ceph.mds.b.smithi116.stdout:Sep 21 05:54:43 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-b[62172]: ignoring --setgroup ceph since I am not root 2024-09-21T05:54:43.806 INFO:journalctl@ceph.mds.b.smithi116.stdout:Sep 21 05:54:43 smithi116 ceph-mds[62176]: -- 172.21.15.116:0/3712032280 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ca6d743860 con 0x55ca718eb180 2024-09-21T05:54:43.806 INFO:journalctl@ceph.mds.b.smithi116.stdout:Sep 21 05:54:43 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-b[62172]: starting mds.b at 2024-09-21T05:54:43.806 INFO:journalctl@ceph.mds.e.smithi116.stdout:Sep 21 05:54:43 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-e[61624]: ignoring --setuser ceph since I am not root 2024-09-21T05:54:43.806 INFO:journalctl@ceph.mds.e.smithi116.stdout:Sep 21 05:54:43 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-e[61624]: ignoring --setgroup ceph since I am not root 2024-09-21T05:54:43.806 INFO:journalctl@ceph.mds.e.smithi116.stdout:Sep 21 05:54:43 smithi116 ceph-mds[61628]: -- 172.21.15.116:0/2104422398 <== mon.2 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557939109860 con 0x55793d2b1180 2024-09-21T05:54:43.806 INFO:journalctl@ceph.mds.e.smithi116.stdout:Sep 21 05:54:43 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-e[61624]: starting mds.e at 2024-09-21T05:54:43.806 INFO:journalctl@ceph.mds.k.smithi116.stdout:Sep 21 05:54:43 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-k[61357]: ignoring --setuser ceph since I am not root 2024-09-21T05:54:43.806 INFO:journalctl@ceph.mds.k.smithi116.stdout:Sep 21 05:54:43 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-k[61357]: ignoring --setgroup ceph since I am not root 2024-09-21T05:54:43.806 INFO:journalctl@ceph.mds.k.smithi116.stdout:Sep 21 05:54:43 smithi116 ceph-mds[61361]: -- 172.21.15.116:0/135073974 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55579cfbd860 con 0x5557a1165a80 2024-09-21T05:54:43.807 INFO:journalctl@ceph.mds.k.smithi116.stdout:Sep 21 05:54:43 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-k[61357]: starting mds.k at 2024-09-21T05:54:43.898 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 21 05:54:43 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-c[62369]: ignoring --setuser ceph since I am not root 2024-09-21T05:54:43.899 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 21 05:54:43 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-c[62369]: ignoring --setgroup ceph since I am not root 2024-09-21T05:54:43.899 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 21 05:54:43 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-c[62369]: starting mds.c at 2024-09-21T05:54:43.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:43 smithi160 ceph-mon[33979]: pgmap v527: 129 pgs: 129 active+clean; 99 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T05:54:43.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:43 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/4053606074' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T05:54:43.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:43 smithi160 ceph-mon[33979]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T05:54:43.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:43 smithi160 ceph-mon[33979]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T05:54:43.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:43 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/4053606074' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T05:54:43.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:43 smithi160 ceph-mon[33979]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T05:54:43.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:43 smithi160 ceph-mon[33979]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-21T05:54:43.900 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 21 05:54:43 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-l[61823]: ignoring --setuser ceph since I am not root 2024-09-21T05:54:43.900 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 21 05:54:43 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-l[61823]: ignoring --setgroup ceph since I am not root 2024-09-21T05:54:43.900 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 21 05:54:43 smithi160 ceph-mds[61827]: -- 172.21.15.160:0/839114609 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563b08a23860 con 0x563b0cbcba80 2024-09-21T05:54:43.900 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 21 05:54:43 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-l[61823]: starting mds.l at 2024-09-21T05:54:43.900 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 05:54:43 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-i[62640]: ignoring --setuser ceph since I am not root 2024-09-21T05:54:43.900 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 05:54:43 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-i[62640]: ignoring --setgroup ceph since I am not root 2024-09-21T05:54:43.901 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 05:54:43 smithi160 ceph-mds[62644]: --2- 172.21.15.160:0/984334744 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff27123180 0x55ff27d1a000 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x55ff27134ba0 tx=0x55ff2705a540 comp rx=0 tx=0).write_message sending message m=0x55ff26fe88c0 seq=3 auth(proto 2 2 bytes epoch 0) 2024-09-21T05:54:43.901 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 05:54:43 smithi160 ceph-mds[62644]: -- 172.21.15.160:0/984334744 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ff22f7bc20 con 0x55ff27123180 2024-09-21T05:54:43.901 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 05:54:43 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-i[62640]: starting mds.i at 2024-09-21T05:54:43.901 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 21 05:54:43 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-f[62097]: ignoring --setuser ceph since I am not root 2024-09-21T05:54:43.901 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 21 05:54:43 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-f[62097]: ignoring --setgroup ceph since I am not root 2024-09-21T05:54:43.901 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 21 05:54:43 smithi160 ceph-mds[62101]: -- 172.21.15.160:0/2783422955 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56254a897c20 con 0x56254ea3f600 2024-09-21T05:54:43.901 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 21 05:54:43 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-f[62097]: starting mds.f at 2024-09-21T05:54:44.132 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T05:54:44.375 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:54:44.791 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:44 smithi070 ceph-mon[30981]: pgmap v529: 129 pgs: 129 active+clean; 99 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-21T05:54:44.791 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:44 smithi070 ceph-mon[30981]: mds.? [v2:172.21.15.70:6839/3250085708,v1:172.21.15.70:6841/3250085708] up:boot 2024-09-21T05:54:44.791 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:44 smithi070 ceph-mon[30981]: mds.? [v2:172.21.15.70:6838/2251577396,v1:172.21.15.70:6840/2251577396] up:boot 2024-09-21T05:54:44.791 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:44 smithi070 ceph-mon[30981]: mds.? [v2:172.21.15.160:6832/1493371268,v1:172.21.15.160:6834/1493371268] up:boot 2024-09-21T05:54:44.791 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:44 smithi070 ceph-mon[30981]: mds.? [v2:172.21.15.160:6833/393308331,v1:172.21.15.160:6835/393308331] up:boot 2024-09-21T05:54:44.791 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:44 smithi070 ceph-mon[30981]: mds.? [v2:172.21.15.116:6832/1954852818,v1:172.21.15.116:6834/1954852818] up:boot 2024-09-21T05:54:44.791 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:44 smithi070 ceph-mon[30981]: mds.? [v2:172.21.15.116:6833/3883549126,v1:172.21.15.116:6835/3883549126] up:boot 2024-09-21T05:54:44.791 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:44 smithi070 ceph-mon[30981]: mds.? [v2:172.21.15.116:6836/2289129592,v1:172.21.15.116:6837/2289129592] up:boot 2024-09-21T05:54:44.792 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:44 smithi070 ceph-mon[30981]: mds.? [v2:172.21.15.116:6838/3995393180,v1:172.21.15.116:6839/3995393180] up:boot 2024-09-21T05:54:44.792 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:44 smithi070 ceph-mon[30981]: mds.? [v2:172.21.15.160:6836/2310064829,v1:172.21.15.160:6838/2310064829] up:boot 2024-09-21T05:54:44.792 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:44 smithi070 ceph-mon[30981]: mds.? [v2:172.21.15.160:6837/2311179910,v1:172.21.15.160:6839/2311179910] up:boot 2024-09-21T05:54:44.792 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:44 smithi070 ceph-mon[30981]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-21T05:54:44.792 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:44 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T05:54:44.792 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:44 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T05:54:44.792 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:44 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T05:54:44.792 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:44 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T05:54:44.792 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:44 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T05:54:44.792 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:44 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T05:54:44.792 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:44 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T05:54:44.792 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:44 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T05:54:44.792 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:44 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T05:54:44.792 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:44 smithi070 ceph-mon[30981]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T05:54:44.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:44 smithi116 ceph-mon[34332]: pgmap v529: 129 pgs: 129 active+clean; 99 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-21T05:54:44.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:44 smithi116 ceph-mon[34332]: mds.? [v2:172.21.15.70:6839/3250085708,v1:172.21.15.70:6841/3250085708] up:boot 2024-09-21T05:54:44.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:44 smithi116 ceph-mon[34332]: mds.? [v2:172.21.15.70:6838/2251577396,v1:172.21.15.70:6840/2251577396] up:boot 2024-09-21T05:54:44.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:44 smithi116 ceph-mon[34332]: mds.? [v2:172.21.15.160:6832/1493371268,v1:172.21.15.160:6834/1493371268] up:boot 2024-09-21T05:54:44.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:44 smithi116 ceph-mon[34332]: mds.? [v2:172.21.15.160:6833/393308331,v1:172.21.15.160:6835/393308331] up:boot 2024-09-21T05:54:44.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:44 smithi116 ceph-mon[34332]: mds.? [v2:172.21.15.116:6832/1954852818,v1:172.21.15.116:6834/1954852818] up:boot 2024-09-21T05:54:44.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:44 smithi116 ceph-mon[34332]: mds.? [v2:172.21.15.116:6833/3883549126,v1:172.21.15.116:6835/3883549126] up:boot 2024-09-21T05:54:44.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:44 smithi116 ceph-mon[34332]: mds.? [v2:172.21.15.116:6836/2289129592,v1:172.21.15.116:6837/2289129592] up:boot 2024-09-21T05:54:44.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:44 smithi116 ceph-mon[34332]: mds.? [v2:172.21.15.116:6838/3995393180,v1:172.21.15.116:6839/3995393180] up:boot 2024-09-21T05:54:44.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:44 smithi116 ceph-mon[34332]: mds.? [v2:172.21.15.160:6836/2310064829,v1:172.21.15.160:6838/2310064829] up:boot 2024-09-21T05:54:44.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:44 smithi116 ceph-mon[34332]: mds.? [v2:172.21.15.160:6837/2311179910,v1:172.21.15.160:6839/2311179910] up:boot 2024-09-21T05:54:44.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:44 smithi116 ceph-mon[34332]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-21T05:54:44.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:44 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T05:54:44.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:44 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T05:54:44.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:44 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T05:54:44.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:44 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T05:54:44.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:44 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T05:54:44.805 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:44 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T05:54:44.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:44 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T05:54:44.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:44 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T05:54:44.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:44 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T05:54:44.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:44 smithi116 ceph-mon[34332]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T05:54:44.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.880+0000 7f8bc5a4c640 1 -- 172.21.15.70:0/3932727263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8bc0105270 msgr2=0x7f8bc010d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:44.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.880+0000 7f8bc5a4c640 1 --2- 172.21.15.70:0/3932727263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8bc0105270 0x7f8bc010d8b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8009900 tx=0x7f8ba802a410 comp rx=0 tx=0).stop 2024-09-21T05:54:44.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.880+0000 7f8bc5a4c640 1 -- 172.21.15.70:0/3932727263 shutdown_connections 2024-09-21T05:54:44.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.880+0000 7f8bc5a4c640 1 --2- 172.21.15.70:0/3932727263 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8bc010ddf0 0x7f8bc0110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:44.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.880+0000 7f8bc5a4c640 1 --2- 172.21.15.70:0/3932727263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8bc0105270 0x7f8bc010d8b0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:44.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.880+0000 7f8bc5a4c640 1 --2- 172.21.15.70:0/3932727263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8bc0104840 0x7f8bc0104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:44.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.880+0000 7f8bc5a4c640 1 -- 172.21.15.70:0/3932727263 >> 172.21.15.70:0/3932727263 conn(0x7f8bc0079730 msgr2=0x7f8bc0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:44.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.880+0000 7f8bc5a4c640 1 -- 172.21.15.70:0/3932727263 shutdown_connections 2024-09-21T05:54:44.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.880+0000 7f8bc5a4c640 1 -- 172.21.15.70:0/3932727263 wait complete. 2024-09-21T05:54:44.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.881+0000 7f8bc5a4c640 1 Processor -- start 2024-09-21T05:54:44.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.881+0000 7f8bc5a4c640 1 -- start start 2024-09-21T05:54:44.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.881+0000 7f8bc5a4c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8bc0104840 0x7f8bc019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:44.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.881+0000 7f8bc5a4c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8bc0105270 0x7f8bc019aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:44.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.881+0000 7f8bc5a4c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8bc010ddf0 0x7f8bc019fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:44.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.881+0000 7f8bc5a4c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc0113a40 con 0x7f8bc0105270 2024-09-21T05:54:44.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.881+0000 7f8bc5a4c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc01138c0 con 0x7f8bc0104840 2024-09-21T05:54:44.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.881+0000 7f8bc5a4c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc0113bc0 con 0x7f8bc010ddf0 2024-09-21T05:54:44.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.881+0000 7f8bbe7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8bc0105270 0x7f8bc019aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:44.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.881+0000 7f8bbe7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8bc0105270 0x7f8bc019aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33964/0 (socket says 172.21.15.70:33964) 2024-09-21T05:54:44.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.881+0000 7f8bbe7fc640 1 -- 172.21.15.70:0/2856639334 learned_addr learned my addr 172.21.15.70:0/2856639334 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:54:44.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.882+0000 7f8bbf7fe640 1 --2- 172.21.15.70:0/2856639334 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8bc010ddf0 0x7f8bc019fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:44.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.882+0000 7f8bbeffd640 1 --2- 172.21.15.70:0/2856639334 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8bc0104840 0x7f8bc019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:44.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.882+0000 7f8bbe7fc640 1 -- 172.21.15.70:0/2856639334 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8bc010ddf0 msgr2=0x7f8bc019fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:44.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.882+0000 7f8bbe7fc640 1 --2- 172.21.15.70:0/2856639334 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8bc010ddf0 0x7f8bc019fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:44.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.882+0000 7f8bbe7fc640 1 -- 172.21.15.70:0/2856639334 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8bc0104840 msgr2=0x7f8bc019a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:44.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.882+0000 7f8bbe7fc640 1 --2- 172.21.15.70:0/2856639334 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8bc0104840 0x7f8bc019a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:44.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.882+0000 7f8bbe7fc640 1 -- 172.21.15.70:0/2856639334 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc01a0360 con 0x7f8bc0105270 2024-09-21T05:54:44.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.882+0000 7f8bbeffd640 1 --2- 172.21.15.70:0/2856639334 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8bc0104840 0x7f8bc019a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:54:44.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.882+0000 7f8bbe7fc640 1 --2- 172.21.15.70:0/2856639334 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8bc0105270 0x7f8bc019aa50 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8ba802a930 tx=0x7f8ba8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:44.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.882+0000 7f8bc4a4a640 1 -- 172.21.15.70:0/2856639334 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba803f030 con 0x7f8bc0105270 2024-09-21T05:54:44.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.882+0000 7f8bc5a4c640 1 -- 172.21.15.70:0/2856639334 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bc01a05f0 con 0x7f8bc0105270 2024-09-21T05:54:44.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.882+0000 7f8bc4a4a640 1 -- 172.21.15.70:0/2856639334 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f8ba8003aa0 con 0x7f8bc0105270 2024-09-21T05:54:44.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.882+0000 7f8bc4a4a640 1 -- 172.21.15.70:0/2856639334 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8035070 con 0x7f8bc0105270 2024-09-21T05:54:44.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.882+0000 7f8bc5a4c640 1 -- 172.21.15.70:0/2856639334 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bc01a0ad0 con 0x7f8bc0105270 2024-09-21T05:54:44.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.883+0000 7f8bc5a4c640 1 -- 172.21.15.70:0/2856639334 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bc0104c50 con 0x7f8bc0105270 2024-09-21T05:54:44.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.886+0000 7f8bc4a4a640 1 -- 172.21.15.70:0/2856639334 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f8ba8042030 con 0x7f8bc0105270 2024-09-21T05:54:44.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.886+0000 7f8bc4a4a640 1 --2- 172.21.15.70:0/2856639334 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f8bac0b6540 0x7f8bac0b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:44.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.886+0000 7f8bbeffd640 1 --2- 172.21.15.70:0/2856639334 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f8bac0b6540 0x7f8bac0b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:44.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.887+0000 7f8bc4a4a640 1 -- 172.21.15.70:0/2856639334 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9667+0+0 (secure 0 0 0) 0x7f8ba81082a0 con 0x7f8bc0105270 2024-09-21T05:54:44.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.887+0000 7f8bbeffd640 1 --2- 172.21.15.70:0/2856639334 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f8bac0b6540 0x7f8bac0b8a50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8bc006bc00 tx=0x7f8bb0007870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:44.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:44.890+0000 7f8bc4a4a640 1 -- 172.21.15.70:0/2856639334 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8ba80ce590 con 0x7f8bc0105270 2024-09-21T05:54:44.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:44 smithi160 ceph-mon[33979]: pgmap v529: 129 pgs: 129 active+clean; 99 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-21T05:54:44.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:44 smithi160 ceph-mon[33979]: mds.? [v2:172.21.15.70:6839/3250085708,v1:172.21.15.70:6841/3250085708] up:boot 2024-09-21T05:54:44.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:44 smithi160 ceph-mon[33979]: mds.? [v2:172.21.15.70:6838/2251577396,v1:172.21.15.70:6840/2251577396] up:boot 2024-09-21T05:54:44.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:44 smithi160 ceph-mon[33979]: mds.? [v2:172.21.15.160:6832/1493371268,v1:172.21.15.160:6834/1493371268] up:boot 2024-09-21T05:54:44.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:44 smithi160 ceph-mon[33979]: mds.? [v2:172.21.15.160:6833/393308331,v1:172.21.15.160:6835/393308331] up:boot 2024-09-21T05:54:44.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:44 smithi160 ceph-mon[33979]: mds.? [v2:172.21.15.116:6832/1954852818,v1:172.21.15.116:6834/1954852818] up:boot 2024-09-21T05:54:44.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:44 smithi160 ceph-mon[33979]: mds.? [v2:172.21.15.116:6833/3883549126,v1:172.21.15.116:6835/3883549126] up:boot 2024-09-21T05:54:44.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:44 smithi160 ceph-mon[33979]: mds.? [v2:172.21.15.116:6836/2289129592,v1:172.21.15.116:6837/2289129592] up:boot 2024-09-21T05:54:44.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:44 smithi160 ceph-mon[33979]: mds.? [v2:172.21.15.116:6838/3995393180,v1:172.21.15.116:6839/3995393180] up:boot 2024-09-21T05:54:44.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:44 smithi160 ceph-mon[33979]: mds.? [v2:172.21.15.160:6836/2310064829,v1:172.21.15.160:6838/2310064829] up:boot 2024-09-21T05:54:44.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:44 smithi160 ceph-mon[33979]: mds.? [v2:172.21.15.160:6837/2311179910,v1:172.21.15.160:6839/2311179910] up:boot 2024-09-21T05:54:44.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:44 smithi160 ceph-mon[33979]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-21T05:54:44.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:44 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T05:54:44.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:44 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T05:54:44.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:44 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T05:54:44.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:44 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T05:54:44.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:44 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T05:54:44.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:44 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T05:54:44.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:44 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T05:54:44.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:44 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T05:54:44.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:44 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T05:54:44.900 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:44 smithi160 ceph-mon[33979]: from='mgr.14150 172.21.15.70:0/4157805154' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T05:54:45.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:45.102+0000 7f8bc5a4c640 1 -- 172.21.15.70:0/2856639334 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f8bc01a6fa0 con 0x7f8bc0105270 2024-09-21T05:54:45.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:45.525+0000 7f8bc4a4a640 1 -- 172.21.15.70:0/2856639334 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v41) ==== 104+0+0 (secure 0 0 0) 0x7f8ba80d2970 con 0x7f8bc0105270 2024-09-21T05:54:45.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:45.528+0000 7f8bc5a4c640 1 -- 172.21.15.70:0/2856639334 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f8bac0b6540 msgr2=0x7f8bac0b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:45.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:45.528+0000 7f8bc5a4c640 1 --2- 172.21.15.70:0/2856639334 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f8bac0b6540 0x7f8bac0b8a50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8bc006bc00 tx=0x7f8bb0007870 comp rx=0 tx=0).stop 2024-09-21T05:54:45.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:45.528+0000 7f8bc5a4c640 1 -- 172.21.15.70:0/2856639334 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8bc0105270 msgr2=0x7f8bc019aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:45.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:45.528+0000 7f8bc5a4c640 1 --2- 172.21.15.70:0/2856639334 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8bc0105270 0x7f8bc019aa50 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8ba802a930 tx=0x7f8ba8004270 comp rx=0 tx=0).stop 2024-09-21T05:54:45.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:45.528+0000 7f8bc5a4c640 1 -- 172.21.15.70:0/2856639334 shutdown_connections 2024-09-21T05:54:45.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:45.528+0000 7f8bc5a4c640 1 --2- 172.21.15.70:0/2856639334 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f8bac0b6540 0x7f8bac0b8a50 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:45.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:45.528+0000 7f8bc5a4c640 1 --2- 172.21.15.70:0/2856639334 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8bc010ddf0 0x7f8bc019fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:45.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:45.528+0000 7f8bc5a4c640 1 --2- 172.21.15.70:0/2856639334 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8bc0105270 0x7f8bc019aa50 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:45.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:45.528+0000 7f8bc5a4c640 1 --2- 172.21.15.70:0/2856639334 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8bc0104840 0x7f8bc019a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:45.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:45.528+0000 7f8bc5a4c640 1 -- 172.21.15.70:0/2856639334 >> 172.21.15.70:0/2856639334 conn(0x7f8bc0079730 msgr2=0x7f8bc0106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:45.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:45.529+0000 7f8bc5a4c640 1 -- 172.21.15.70:0/2856639334 shutdown_connections 2024-09-21T05:54:45.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:45.529+0000 7f8bc5a4c640 1 -- 172.21.15.70:0/2856639334 wait complete. 2024-09-21T05:54:45.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:45 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2856639334' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T05:54:45.852 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:45 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2856639334' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T05:54:45.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:45 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2856639334' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T05:54:46.318 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T05:54:46.567 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:54:46.687 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:46 smithi070 ceph-mon[30981]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T05:54:46.687 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:46 smithi070 ceph-mon[30981]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T05:54:46.687 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:46 smithi070 ceph-mon[30981]: Cluster is now healthy 2024-09-21T05:54:46.687 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:46 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2856639334' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T05:54:46.687 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:46 smithi070 ceph-mon[30981]: fsmap 12 up:standby 2024-09-21T05:54:46.688 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:46 smithi070 ceph-mon[30981]: pgmap v530: 129 pgs: 129 active+clean; 99 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-09-21T05:54:46.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:46 smithi116 ceph-mon[34332]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T05:54:46.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:46 smithi116 ceph-mon[34332]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T05:54:46.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:46 smithi116 ceph-mon[34332]: Cluster is now healthy 2024-09-21T05:54:46.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:46 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2856639334' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T05:54:46.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:46 smithi116 ceph-mon[34332]: fsmap 12 up:standby 2024-09-21T05:54:46.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:46 smithi116 ceph-mon[34332]: pgmap v530: 129 pgs: 129 active+clean; 99 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-09-21T05:54:46.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:46 smithi160 ceph-mon[33979]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T05:54:46.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:46 smithi160 ceph-mon[33979]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T05:54:46.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:46 smithi160 ceph-mon[33979]: Cluster is now healthy 2024-09-21T05:54:46.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:46 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2856639334' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T05:54:46.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:46 smithi160 ceph-mon[33979]: fsmap 12 up:standby 2024-09-21T05:54:46.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:46 smithi160 ceph-mon[33979]: pgmap v530: 129 pgs: 129 active+clean; 99 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-09-21T05:54:47.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.066+0000 7fb196454640 1 -- 172.21.15.70:0/1198982358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb190109eb0 msgr2=0x7fb1901106e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:47.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.066+0000 7fb196454640 1 --2- 172.21.15.70:0/1198982358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb190109eb0 0x7fb1901106e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb188009ca0 tx=0x7fb18802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:54:47.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.066+0000 7fb196454640 1 -- 172.21.15.70:0/1198982358 shutdown_connections 2024-09-21T05:54:47.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.066+0000 7fb196454640 1 --2- 172.21.15.70:0/1198982358 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb190109560 0x7fb190109970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:47.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.066+0000 7fb196454640 1 --2- 172.21.15.70:0/1198982358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb190109eb0 0x7fb1901106e0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:47.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.066+0000 7fb196454640 1 --2- 172.21.15.70:0/1198982358 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb190102080 0x7fb190102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:47.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.066+0000 7fb196454640 1 -- 172.21.15.70:0/1198982358 >> 172.21.15.70:0/1198982358 conn(0x7fb190079ec0 msgr2=0x7fb19007a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:47.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.066+0000 7fb196454640 1 -- 172.21.15.70:0/1198982358 shutdown_connections 2024-09-21T05:54:47.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.066+0000 7fb196454640 1 -- 172.21.15.70:0/1198982358 wait complete. 2024-09-21T05:54:47.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.067+0000 7fb196454640 1 Processor -- start 2024-09-21T05:54:47.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.067+0000 7fb196454640 1 -- start start 2024-09-21T05:54:47.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.067+0000 7fb196454640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb190102080 0x7fb19019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:47.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.067+0000 7fb196454640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb190109560 0x7fb19019aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:47.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.067+0000 7fb196454640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb190109eb0 0x7fb19019fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:47.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.067+0000 7fb196454640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb190113b60 con 0x7fb190102080 2024-09-21T05:54:47.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.067+0000 7fb196454640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb1901139e0 con 0x7fb190109560 2024-09-21T05:54:47.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.067+0000 7fb196454640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb190113ce0 con 0x7fb190109eb0 2024-09-21T05:54:47.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.067+0000 7fb18ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb190102080 0x7fb19019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:47.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.067+0000 7fb18ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb190102080 0x7fb19019a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33972/0 (socket says 172.21.15.70:33972) 2024-09-21T05:54:47.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.067+0000 7fb18ffff640 1 -- 172.21.15.70:0/2983109792 learned_addr learned my addr 172.21.15.70:0/2983109792 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:54:47.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.067+0000 7fb187fff640 1 --2- 172.21.15.70:0/2983109792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb190109560 0x7fb19019aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:47.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.067+0000 7fb1949f1640 1 --2- 172.21.15.70:0/2983109792 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb190109eb0 0x7fb19019fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:47.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.068+0000 7fb18ffff640 1 -- 172.21.15.70:0/2983109792 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb190109eb0 msgr2=0x7fb19019fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:47.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.068+0000 7fb18ffff640 1 --2- 172.21.15.70:0/2983109792 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb190109eb0 0x7fb19019fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:47.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.068+0000 7fb18ffff640 1 -- 172.21.15.70:0/2983109792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb190109560 msgr2=0x7fb19019aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:47.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.068+0000 7fb18ffff640 1 --2- 172.21.15.70:0/2983109792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb190109560 0x7fb19019aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:47.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.068+0000 7fb18ffff640 1 -- 172.21.15.70:0/2983109792 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1901a0420 con 0x7fb190102080 2024-09-21T05:54:47.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.068+0000 7fb18ffff640 1 --2- 172.21.15.70:0/2983109792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb190102080 0x7fb19019a4b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fb18000c890 tx=0x7fb18000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:47.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.068+0000 7fb18dffb640 1 -- 172.21.15.70:0/2983109792 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb180004220 con 0x7fb190102080 2024-09-21T05:54:47.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.068+0000 7fb18dffb640 1 -- 172.21.15.70:0/2983109792 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7fb1800043c0 con 0x7fb190102080 2024-09-21T05:54:47.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.068+0000 7fb196454640 1 -- 172.21.15.70:0/2983109792 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1901a0710 con 0x7fb190102080 2024-09-21T05:54:47.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.068+0000 7fb18dffb640 1 -- 172.21.15.70:0/2983109792 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb180004a00 con 0x7fb190102080 2024-09-21T05:54:47.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.068+0000 7fb196454640 1 -- 172.21.15.70:0/2983109792 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1901a6e70 con 0x7fb190102080 2024-09-21T05:54:47.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.069+0000 7fb196454640 1 -- 172.21.15.70:0/2983109792 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb190102490 con 0x7fb190102080 2024-09-21T05:54:47.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.070+0000 7fb18dffb640 1 -- 172.21.15.70:0/2983109792 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7fb1800079b0 con 0x7fb190102080 2024-09-21T05:54:47.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.071+0000 7fb18dffb640 1 --2- 172.21.15.70:0/2983109792 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb17c0b6510 0x7fb17c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:47.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.072+0000 7fb187fff640 1 --2- 172.21.15.70:0/2983109792 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb17c0b6510 0x7fb17c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:47.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.072+0000 7fb18dffb640 1 -- 172.21.15.70:0/2983109792 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9667+0+0 (secure 0 0 0) 0x7fb1800e79c0 con 0x7fb190102080 2024-09-21T05:54:47.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.072+0000 7fb187fff640 1 --2- 172.21.15.70:0/2983109792 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb17c0b6510 0x7fb17c0b8a20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb190107120 tx=0x7fb17800a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:47.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.075+0000 7fb18dffb640 1 -- 172.21.15.70:0/2983109792 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb180014030 con 0x7fb190102080 2024-09-21T05:54:47.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.254+0000 7fb196454640 1 -- 172.21.15.70:0/2983109792 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb19019b5e0 con 0x7fb190102080 2024-09-21T05:54:47.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.535+0000 7fb18dffb640 1 -- 172.21.15.70:0/2983109792 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v87) ==== 181+0+0 (secure 0 0 0) 0x7fb1800b2030 con 0x7fb190102080 2024-09-21T05:54:47.537 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_metadata' removed 2024-09-21T05:54:47.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.538+0000 7fb196454640 1 -- 172.21.15.70:0/2983109792 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb17c0b6510 msgr2=0x7fb17c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:47.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.538+0000 7fb196454640 1 --2- 172.21.15.70:0/2983109792 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb17c0b6510 0x7fb17c0b8a20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb190107120 tx=0x7fb17800a250 comp rx=0 tx=0).stop 2024-09-21T05:54:47.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.538+0000 7fb196454640 1 -- 172.21.15.70:0/2983109792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb190102080 msgr2=0x7fb19019a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:47.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.538+0000 7fb196454640 1 --2- 172.21.15.70:0/2983109792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb190102080 0x7fb19019a4b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fb18000c890 tx=0x7fb18000cd50 comp rx=0 tx=0).stop 2024-09-21T05:54:47.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.539+0000 7fb196454640 1 -- 172.21.15.70:0/2983109792 shutdown_connections 2024-09-21T05:54:47.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.539+0000 7fb196454640 1 --2- 172.21.15.70:0/2983109792 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7fb17c0b6510 0x7fb17c0b8a20 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:47.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.539+0000 7fb196454640 1 --2- 172.21.15.70:0/2983109792 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb190109eb0 0x7fb19019fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:47.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.539+0000 7fb196454640 1 --2- 172.21.15.70:0/2983109792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb190109560 0x7fb19019aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:47.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.539+0000 7fb196454640 1 --2- 172.21.15.70:0/2983109792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb190102080 0x7fb19019a4b0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:47.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.539+0000 7fb196454640 1 -- 172.21.15.70:0/2983109792 >> 172.21.15.70:0/2983109792 conn(0x7fb190079ec0 msgr2=0x7fb1901054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:47.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.540+0000 7fb196454640 1 -- 172.21.15.70:0/2983109792 shutdown_connections 2024-09-21T05:54:47.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:47.540+0000 7fb196454640 1 -- 172.21.15.70:0/2983109792 wait complete. 2024-09-21T05:54:47.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:47 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2983109792' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T05:54:47.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:47 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2983109792' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T05:54:47.903 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:47 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2983109792' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T05:54:48.357 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T05:54:48.603 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:54:48.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:48 smithi070 ceph-mon[30981]: pgmap v531: 129 pgs: 129 active+clean; 99 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-21T05:54:48.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:48 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2983109792' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T05:54:48.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:48 smithi070 ceph-mon[30981]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T05:54:48.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:48 smithi116 ceph-mon[34332]: pgmap v531: 129 pgs: 129 active+clean; 99 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-21T05:54:48.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:48 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2983109792' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T05:54:48.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:48 smithi116 ceph-mon[34332]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T05:54:48.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:48 smithi160 ceph-mon[33979]: pgmap v531: 129 pgs: 129 active+clean; 99 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-21T05:54:48.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:48 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2983109792' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T05:54:48.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:48 smithi160 ceph-mon[33979]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T05:54:49.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.108+0000 7f9345234640 1 -- 172.21.15.70:0/178289535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9340104900 msgr2=0x7f9340104d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:49.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.108+0000 7f9345234640 1 --2- 172.21.15.70:0/178289535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9340104900 0x7f9340104d10 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f9330009860 tx=0x7f933002a340 comp rx=0 tx=0).stop 2024-09-21T05:54:49.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.108+0000 7f9345234640 1 -- 172.21.15.70:0/178289535 shutdown_connections 2024-09-21T05:54:49.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.108+0000 7f9345234640 1 --2- 172.21.15.70:0/178289535 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f934010deb0 0x7f9340110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:49.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.108+0000 7f9345234640 1 --2- 172.21.15.70:0/178289535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9340105250 0x7f934010d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:49.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.108+0000 7f9345234640 1 --2- 172.21.15.70:0/178289535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9340104900 0x7f9340104d10 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:49.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.108+0000 7f9345234640 1 -- 172.21.15.70:0/178289535 >> 172.21.15.70:0/178289535 conn(0x7f9340079760 msgr2=0x7f9340079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:49.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.108+0000 7f9345234640 1 -- 172.21.15.70:0/178289535 shutdown_connections 2024-09-21T05:54:49.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.109+0000 7f9345234640 1 -- 172.21.15.70:0/178289535 wait complete. 2024-09-21T05:54:49.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.109+0000 7f9345234640 1 Processor -- start 2024-09-21T05:54:49.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.110+0000 7f9345234640 1 -- start start 2024-09-21T05:54:49.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.110+0000 7f9345234640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9340104900 0x7f9340198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:49.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.110+0000 7f9345234640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9340105250 0x7f93401988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:49.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.110+0000 7f9345234640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f934010deb0 0x7f934019db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:49.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.110+0000 7f9345234640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f93401118a0 con 0x7f934010deb0 2024-09-21T05:54:49.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.110+0000 7f9345234640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9340111720 con 0x7f9340105250 2024-09-21T05:54:49.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.110+0000 7f9345234640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9340111a20 con 0x7f9340104900 2024-09-21T05:54:49.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.110+0000 7f933f59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f934010deb0 0x7f934019db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:49.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.110+0000 7f933f59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f934010deb0 0x7f934019db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33996/0 (socket says 172.21.15.70:33996) 2024-09-21T05:54:49.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.110+0000 7f933e59c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9340105250 0x7f93401988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:49.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.110+0000 7f933f59e640 1 -- 172.21.15.70:0/1583188846 learned_addr learned my addr 172.21.15.70:0/1583188846 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:54:49.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.110+0000 7f933ed9d640 1 --2- 172.21.15.70:0/1583188846 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9340104900 0x7f9340198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:49.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.110+0000 7f933f59e640 1 -- 172.21.15.70:0/1583188846 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9340104900 msgr2=0x7f9340198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:49.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.110+0000 7f933f59e640 1 --2- 172.21.15.70:0/1583188846 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9340104900 0x7f9340198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:49.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.110+0000 7f933f59e640 1 -- 172.21.15.70:0/1583188846 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9340105250 msgr2=0x7f93401988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:49.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.110+0000 7f933f59e640 1 --2- 172.21.15.70:0/1583188846 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9340105250 0x7f93401988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:49.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.110+0000 7f933f59e640 1 -- 172.21.15.70:0/1583188846 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934019e280 con 0x7f934010deb0 2024-09-21T05:54:49.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.111+0000 7f933f59e640 1 --2- 172.21.15.70:0/1583188846 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f934010deb0 0x7f934019db50 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f9338009fa0 tx=0x7f933800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:49.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.111+0000 7f9327fff640 1 -- 172.21.15.70:0/1583188846 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9338004b20 con 0x7f934010deb0 2024-09-21T05:54:49.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.111+0000 7f9345234640 1 -- 172.21.15.70:0/1583188846 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f934019e570 con 0x7f934010deb0 2024-09-21T05:54:49.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.111+0000 7f9327fff640 1 -- 172.21.15.70:0/1583188846 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f9338003e20 con 0x7f934010deb0 2024-09-21T05:54:49.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.111+0000 7f9327fff640 1 -- 172.21.15.70:0/1583188846 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933800b570 con 0x7f934010deb0 2024-09-21T05:54:49.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.111+0000 7f9345234640 1 -- 172.21.15.70:0/1583188846 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93401a4cd0 con 0x7f934010deb0 2024-09-21T05:54:49.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.112+0000 7f9345234640 1 -- 172.21.15.70:0/1583188846 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9340104d10 con 0x7f934010deb0 2024-09-21T05:54:49.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.114+0000 7f9327fff640 1 -- 172.21.15.70:0/1583188846 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f933801d020 con 0x7f934010deb0 2024-09-21T05:54:49.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.115+0000 7f9327fff640 1 --2- 172.21.15.70:0/1583188846 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f93280b6510 0x7f93280b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:49.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.115+0000 7f933ed9d640 1 --2- 172.21.15.70:0/1583188846 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f93280b6510 0x7f93280b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:49.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.115+0000 7f9327fff640 1 -- 172.21.15.70:0/1583188846 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9113+0+0 (secure 0 0 0) 0x7f93380e7fe0 con 0x7f934010deb0 2024-09-21T05:54:49.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.115+0000 7f933ed9d640 1 --2- 172.21.15.70:0/1583188846 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f93280b6510 0x7f93280b8a20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9330005940 tx=0x7f93300058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:49.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.118+0000 7f9327fff640 1 -- 172.21.15.70:0/1583188846 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9338024030 con 0x7f934010deb0 2024-09-21T05:54:49.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.299+0000 7f9345234640 1 -- 172.21.15.70:0/1583188846 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f93401a4f70 con 0x7f934010deb0 2024-09-21T05:54:49.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.542+0000 7f9327fff640 1 -- 172.21.15.70:0/1583188846 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v88) ==== 169+0+0 (secure 0 0 0) 0x7f93380ae4c0 con 0x7f934010deb0 2024-09-21T05:54:49.545 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data' removed 2024-09-21T05:54:49.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.545+0000 7f9345234640 1 -- 172.21.15.70:0/1583188846 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f93280b6510 msgr2=0x7f93280b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:49.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.545+0000 7f9345234640 1 --2- 172.21.15.70:0/1583188846 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f93280b6510 0x7f93280b8a20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9330005940 tx=0x7f93300058b0 comp rx=0 tx=0).stop 2024-09-21T05:54:49.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.545+0000 7f9345234640 1 -- 172.21.15.70:0/1583188846 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f934010deb0 msgr2=0x7f934019db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:49.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.545+0000 7f9345234640 1 --2- 172.21.15.70:0/1583188846 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f934010deb0 0x7f934019db50 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f9338009fa0 tx=0x7f933800c800 comp rx=0 tx=0).stop 2024-09-21T05:54:49.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.545+0000 7f9345234640 1 -- 172.21.15.70:0/1583188846 shutdown_connections 2024-09-21T05:54:49.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.545+0000 7f9345234640 1 --2- 172.21.15.70:0/1583188846 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f93280b6510 0x7f93280b8a20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:49.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.545+0000 7f9345234640 1 --2- 172.21.15.70:0/1583188846 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f934010deb0 0x7f934019db50 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:49.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.545+0000 7f9345234640 1 --2- 172.21.15.70:0/1583188846 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9340105250 0x7f93401988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:49.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.545+0000 7f9345234640 1 --2- 172.21.15.70:0/1583188846 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9340104900 0x7f9340198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:49.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.545+0000 7f9345234640 1 -- 172.21.15.70:0/1583188846 >> 172.21.15.70:0/1583188846 conn(0x7f9340079760 msgr2=0x7f9340107a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:49.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.547+0000 7f9345234640 1 -- 172.21.15.70:0/1583188846 shutdown_connections 2024-09-21T05:54:49.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:49.547+0000 7f9345234640 1 -- 172.21.15.70:0/1583188846 wait complete. 2024-09-21T05:54:49.560 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:49 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1583188846' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T05:54:49.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:49 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1583188846' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T05:54:49.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:49 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1583188846' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T05:54:50.327 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 96c6636e-77db-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-21T05:54:50.576 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:54:50.696 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:50 smithi070 ceph-mon[30981]: pgmap v533: 97 pgs: 97 active+clean; 577 KiB data, 758 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:54:50.696 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:50 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/1583188846' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T05:54:50.696 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:50 smithi070 ceph-mon[30981]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T05:54:50.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:50 smithi116 ceph-mon[34332]: pgmap v533: 97 pgs: 97 active+clean; 577 KiB data, 758 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:54:50.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:50 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/1583188846' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T05:54:50.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:50 smithi116 ceph-mon[34332]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T05:54:50.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:50 smithi160 ceph-mon[33979]: pgmap v533: 97 pgs: 97 active+clean; 577 KiB data, 758 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:54:50.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:50 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/1583188846' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T05:54:50.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:50 smithi160 ceph-mon[33979]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T05:54:51.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.133+0000 7f97d9c54640 1 -- 172.21.15.70:0/3168876387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f97d4102a70 msgr2=0x7f97d4102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:51.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.133+0000 7f97d9c54640 1 --2- 172.21.15.70:0/3168876387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f97d4102a70 0x7f97d4102e80 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f97c4009900 tx=0x7f97c402a410 comp rx=0 tx=0).stop 2024-09-21T05:54:51.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.133+0000 7f97d9c54640 1 -- 172.21.15.70:0/3168876387 shutdown_connections 2024-09-21T05:54:51.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.133+0000 7f97d9c54640 1 --2- 172.21.15.70:0/3168876387 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97d41083b0 0x7f97d41087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:51.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.133+0000 7f97d9c54640 1 --2- 172.21.15.70:0/3168876387 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97d4108d00 0x7f97d410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:51.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.133+0000 7f97d9c54640 1 --2- 172.21.15.70:0/3168876387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f97d4102a70 0x7f97d4102e80 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:51.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.133+0000 7f97d9c54640 1 -- 172.21.15.70:0/3168876387 >> 172.21.15.70:0/3168876387 conn(0x7f97d4079730 msgr2=0x7f97d4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:51.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.133+0000 7f97d9c54640 1 -- 172.21.15.70:0/3168876387 shutdown_connections 2024-09-21T05:54:51.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.134+0000 7f97d9c54640 1 -- 172.21.15.70:0/3168876387 wait complete. 2024-09-21T05:54:51.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.134+0000 7f97d9c54640 1 Processor -- start 2024-09-21T05:54:51.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.134+0000 7f97d9c54640 1 -- start start 2024-09-21T05:54:51.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.135+0000 7f97d9c54640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97d4102a70 0x7f97d419b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:51.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.135+0000 7f97d9c54640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97d41083b0 0x7f97d419b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:51.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.135+0000 7f97d9c54640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f97d4108d00 0x7f97d419bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:51.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.135+0000 7f97d9c54640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f97d4112960 con 0x7f97d4108d00 2024-09-21T05:54:51.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.135+0000 7f97d9c54640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f97d41127e0 con 0x7f97d4102a70 2024-09-21T05:54:51.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.135+0000 7f97d9c54640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f97d4112ae0 con 0x7f97d41083b0 2024-09-21T05:54:51.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.135+0000 7f97d3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f97d4108d00 0x7f97d419bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:51.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.135+0000 7f97d3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f97d4108d00 0x7f97d419bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55976/0 (socket says 172.21.15.70:55976) 2024-09-21T05:54:51.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.135+0000 7f97d3fff640 1 -- 172.21.15.70:0/2327247917 learned_addr learned my addr 172.21.15.70:0/2327247917 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-21T05:54:51.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.135+0000 7f97caffd640 1 --2- 172.21.15.70:0/2327247917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97d41083b0 0x7f97d419b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:51.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.135+0000 7f97d37fe640 1 --2- 172.21.15.70:0/2327247917 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97d4102a70 0x7f97d419b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:51.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.135+0000 7f97d3fff640 1 -- 172.21.15.70:0/2327247917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97d41083b0 msgr2=0x7f97d419b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:51.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.135+0000 7f97d3fff640 1 --2- 172.21.15.70:0/2327247917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97d41083b0 0x7f97d419b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:51.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.135+0000 7f97d3fff640 1 -- 172.21.15.70:0/2327247917 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97d4102a70 msgr2=0x7f97d419b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:51.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.135+0000 7f97d3fff640 1 --2- 172.21.15.70:0/2327247917 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97d4102a70 0x7f97d419b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:51.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.135+0000 7f97d3fff640 1 -- 172.21.15.70:0/2327247917 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97d41a6540 con 0x7f97d4108d00 2024-09-21T05:54:51.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.135+0000 7f97d3fff640 1 --2- 172.21.15.70:0/2327247917 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f97d4108d00 0x7f97d419bcb0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009fd0 tx=0x7f97cc00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:51.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.136+0000 7f97d17fa640 1 -- 172.21.15.70:0/2327247917 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97cc017070 con 0x7f97d4108d00 2024-09-21T05:54:51.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.136+0000 7f97d9c54640 1 -- 172.21.15.70:0/2327247917 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97d41a6830 con 0x7f97d4108d00 2024-09-21T05:54:51.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.136+0000 7f97d17fa640 1 -- 172.21.15.70:0/2327247917 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1097+0+0 (secure 0 0 0) 0x7f97cc003e20 con 0x7f97d4108d00 2024-09-21T05:54:51.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.136+0000 7f97d17fa640 1 -- 172.21.15.70:0/2327247917 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97cc010460 con 0x7f97d4108d00 2024-09-21T05:54:51.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.136+0000 7f97d9c54640 1 -- 172.21.15.70:0/2327247917 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97d41a6d70 con 0x7f97d4108d00 2024-09-21T05:54:51.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.137+0000 7f97d9c54640 1 -- 172.21.15.70:0/2327247917 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97d4103cf0 con 0x7f97d4108d00 2024-09-21T05:54:51.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.138+0000 7f97d17fa640 1 -- 172.21.15.70:0/2327247917 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f97cc003970 con 0x7f97d4108d00 2024-09-21T05:54:51.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.139+0000 7f97d17fa640 1 --2- 172.21.15.70:0/2327247917 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f97c00b6510 0x7f97c00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:51.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.139+0000 7f97d37fe640 1 --2- 172.21.15.70:0/2327247917 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f97c00b6510 0x7f97c00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:51.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.139+0000 7f97d17fa640 1 -- 172.21.15.70:0/2327247917 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8496+0+0 (secure 0 0 0) 0x7f97cc0e70f0 con 0x7f97d4108d00 2024-09-21T05:54:51.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.139+0000 7f97d37fe640 1 --2- 172.21.15.70:0/2327247917 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f97c00b6510 0x7f97c00b8a20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f97c4000c00 tx=0x7f97c4005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:51.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.143+0000 7f97d17fa640 1 -- 172.21.15.70:0/2327247917 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f97cc0b1c60 con 0x7f97d4108d00 2024-09-21T05:54:51.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.320+0000 7f97d9c54640 1 -- 172.21.15.70:0/2327247917 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f97d410aad0 con 0x7f97d4108d00 2024-09-21T05:54:51.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.549+0000 7f97d17fa640 1 -- 172.21.15.70:0/2327247917 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v89) ==== 178+0+0 (secure 0 0 0) 0x7f97cc0b6ba0 con 0x7f97d4108d00 2024-09-21T05:54:51.552 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data_ec' removed 2024-09-21T05:54:51.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.553+0000 7f97d9c54640 1 -- 172.21.15.70:0/2327247917 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f97c00b6510 msgr2=0x7f97c00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:51.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.553+0000 7f97d9c54640 1 --2- 172.21.15.70:0/2327247917 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f97c00b6510 0x7f97c00b8a20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f97c4000c00 tx=0x7f97c4005d50 comp rx=0 tx=0).stop 2024-09-21T05:54:51.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.553+0000 7f97d9c54640 1 -- 172.21.15.70:0/2327247917 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f97d4108d00 msgr2=0x7f97d419bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:51.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.553+0000 7f97d9c54640 1 --2- 172.21.15.70:0/2327247917 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f97d4108d00 0x7f97d419bcb0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009fd0 tx=0x7f97cc00b260 comp rx=0 tx=0).stop 2024-09-21T05:54:51.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.553+0000 7f97d9c54640 1 -- 172.21.15.70:0/2327247917 shutdown_connections 2024-09-21T05:54:51.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.553+0000 7f97d9c54640 1 --2- 172.21.15.70:0/2327247917 >> [v2:172.21.15.70:6800/1366013939,v1:172.21.15.70:6801/1366013939] conn(0x7f97c00b6510 0x7f97c00b8a20 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:51.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.553+0000 7f97d9c54640 1 --2- 172.21.15.70:0/2327247917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97d41083b0 0x7f97d419b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:51.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.553+0000 7f97d9c54640 1 --2- 172.21.15.70:0/2327247917 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f97d4108d00 0x7f97d419bcb0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:51.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.553+0000 7f97d9c54640 1 --2- 172.21.15.70:0/2327247917 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97d4102a70 0x7f97d419b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:51.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.553+0000 7f97d9c54640 1 -- 172.21.15.70:0/2327247917 >> 172.21.15.70:0/2327247917 conn(0x7f97d4079730 msgr2=0x7f97d41014f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:51.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.553+0000 7f97d9c54640 1 -- 172.21.15.70:0/2327247917 shutdown_connections 2024-09-21T05:54:51.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-21T05:54:51.553+0000 7f97d9c54640 1 -- 172.21.15.70:0/2327247917 wait complete. 2024-09-21T05:54:51.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:51 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2327247917' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T05:54:51.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:51 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2327247917' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T05:54:51.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:51 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2327247917' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T05:54:52.317 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T05:54:52.342 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T05:54:52.374 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T05:54:52.406 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T05:54:52.407 DEBUG:teuthology.orchestra.run.smithi070:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T05:54:52.422 DEBUG:teuthology.orchestra.run.smithi116:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T05:54:52.438 DEBUG:teuthology.orchestra.run.smithi160:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T05:54:52.464 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T05:54:52.464 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-21T05:54:52.464 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-96c6636e-77db-11ef-baf5-efdc52797490@mon.a 2024-09-21T05:54:52.553 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:52 smithi070 systemd[1]: Stopping Ceph mon.a for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:54:52.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:52 smithi116 ceph-mon[34332]: pgmap v535: 33 pgs: 33 active+clean; 577 KiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:54:52.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:52 smithi116 ceph-mon[34332]: from='client.? 172.21.15.70:0/2327247917' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T05:54:52.804 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:52 smithi116 ceph-mon[34332]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T05:54:52.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:52 smithi160 ceph-mon[33979]: pgmap v535: 33 pgs: 33 active+clean; 577 KiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:54:52.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:52 smithi160 ceph-mon[33979]: from='client.? 172.21.15.70:0/2327247917' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T05:54:52.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:52 smithi160 ceph-mon[33979]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T05:54:52.937 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:52 smithi070 ceph-mon[30981]: pgmap v535: 33 pgs: 33 active+clean; 577 KiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:54:52.937 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:52 smithi070 ceph-mon[30981]: from='client.? 172.21.15.70:0/2327247917' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T05:54:52.937 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:52 smithi070 ceph-mon[30981]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T05:54:52.938 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:52 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mon-a[30977]: 2024-09-21T05:54:52.791+0000 7f624f711640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T05:54:52.938 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:52 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mon-a[30977]: 2024-09-21T05:54:52.791+0000 7f624f711640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T05:54:53.226 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:52 smithi070 podman[92892]: 2024-09-21 05:54:52.935439127 +0000 UTC m=+0.283812646 container died d741ecc9460fce3a2d7752ab1417e65ab7c69540ef10cd6d103a3341ef4a60b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T05:54:53.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:53 smithi070 podman[92892]: 2024-09-21 05:54:53.433596806 +0000 UTC m=+0.781970314 container cleanup d741ecc9460fce3a2d7752ab1417e65ab7c69540ef10cd6d103a3341ef4a60b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mon-a, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T05:54:53.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 21 05:54:53 smithi070 bash[92892]: ceph-96c6636e-77db-11ef-baf5-efdc52797490-mon-a 2024-09-21T05:54:53.863 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mon.a.service' 2024-09-21T05:54:53.918 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:54:53.918 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-21T05:54:53.918 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-21T05:54:53.918 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-96c6636e-77db-11ef-baf5-efdc52797490@mon.b 2024-09-21T05:54:54.233 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:53 smithi116 systemd[1]: Stopping Ceph mon.b for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:54:54.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:54 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mon-b[34328]: 2024-09-21T05:54:54.231+0000 7f7d70482640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T05:54:54.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:54 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mon-b[34328]: 2024-09-21T05:54:54.231+0000 7f7d70482640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-21T05:54:54.554 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:54 smithi116 podman[64909]: 2024-09-21 05:54:54.303015505 +0000 UTC m=+0.193827655 container died 047d833cfc82c8fe5154f15fbef178788e8a0ddc54038073ee0a39d7e1f53aa8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mon-b, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T05:54:54.893 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:54 smithi116 podman[64909]: 2024-09-21 05:54:54.673911893 +0000 UTC m=+0.564724049 container cleanup 047d833cfc82c8fe5154f15fbef178788e8a0ddc54038073ee0a39d7e1f53aa8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mon-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T05:54:54.893 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:54 smithi116 bash[64909]: ceph-96c6636e-77db-11ef-baf5-efdc52797490-mon-b 2024-09-21T05:54:55.142 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mon.b.service' 2024-09-21T05:54:55.164 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:54 smithi116 podman[64922]: 2024-09-21 05:54:54.892096308 +0000 UTC m=+0.584391895 container remove 047d833cfc82c8fe5154f15fbef178788e8a0ddc54038073ee0a39d7e1f53aa8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mon-b, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T05:54:55.164 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:55 smithi116 systemd[1]: ceph-96c6636e-77db-11ef-baf5-efdc52797490@mon.b.service: Deactivated successfully. 2024-09-21T05:54:55.164 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:55 smithi116 systemd[1]: Stopped Ceph mon.b for 96c6636e-77db-11ef-baf5-efdc52797490. 2024-09-21T05:54:55.164 INFO:journalctl@ceph.mon.b.smithi116.stdout:Sep 21 05:54:55 smithi116 systemd[1]: ceph-96c6636e-77db-11ef-baf5-efdc52797490@mon.b.service: Consumed 9.869s CPU time. 2024-09-21T05:54:55.188 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:54:55.188 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-21T05:54:55.188 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-21T05:54:55.189 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-96c6636e-77db-11ef-baf5-efdc52797490@mon.c 2024-09-21T05:54:55.525 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:55 smithi160 systemd[1]: Stopping Ceph mon.c for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:54:55.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:55 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mon-c[33963]: 2024-09-21T05:54:55.522+0000 7f05ff01d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T05:54:55.898 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:55 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mon-c[33963]: 2024-09-21T05:54:55.522+0000 7f05ff01d640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T05:54:55.899 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:55 smithi160 podman[65246]: 2024-09-21 05:54:55.697540096 +0000 UTC m=+0.311818698 container died e471412be3096d668a36e06f0ac901c61e4040bda6b134091d9ca548226cfd9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mon-c, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T05:54:56.343 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:56 smithi160 podman[65246]: 2024-09-21 05:54:56.132351455 +0000 UTC m=+0.746630056 container cleanup e471412be3096d668a36e06f0ac901c61e4040bda6b134091d9ca548226cfd9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mon-c, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T05:54:56.343 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 05:54:56 smithi160 bash[65246]: ceph-96c6636e-77db-11ef-baf5-efdc52797490-mon-c 2024-09-21T05:54:56.561 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mon.c.service' 2024-09-21T05:54:56.603 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:54:56.603 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-21T05:54:56.603 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-21T05:54:56.604 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-96c6636e-77db-11ef-baf5-efdc52797490@mgr.x 2024-09-21T05:54:56.995 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:54:56 smithi070 systemd[1]: Stopping Ceph mgr.x for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:54:57.495 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:54:57 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T05:54:57.178+0000 7f9a00671640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T05:54:57.495 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:54:57 smithi070 podman[93013]: 2024-09-21 05:54:57.221163239 +0000 UTC m=+0.417958058 container died 85b0c3a2a65042de3f6a5a445b338e4e80c156264e94c1ffbdf8fc4d540e246c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T05:54:57.975 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:54:57 smithi070 podman[93013]: 2024-09-21 05:54:57.722450997 +0000 UTC m=+0.919245809 container cleanup 85b0c3a2a65042de3f6a5a445b338e4e80c156264e94c1ffbdf8fc4d540e246c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T05:54:57.975 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 21 05:54:57 smithi070 bash[93013]: ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-x 2024-09-21T05:54:58.145 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mgr.x.service' 2024-09-21T05:54:58.179 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:54:58.181 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-21T05:54:58.181 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-21T05:54:58.181 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-96c6636e-77db-11ef-baf5-efdc52797490@mgr.y 2024-09-21T05:54:58.517 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Sep 21 05:54:58 smithi116 systemd[1]: Stopping Ceph mgr.y for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:54:58.804 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Sep 21 05:54:58 smithi116 podman[65045]: 2024-09-21 05:54:58.516334712 +0000 UTC m=+0.142803739 container died 43281668584a56d0c488c06cd9d4dc4f3b557ebe9395e8441ec2b6544f2c5332 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-y, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T05:54:59.157 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Sep 21 05:54:58 smithi116 podman[65045]: 2024-09-21 05:54:58.904809194 +0000 UTC m=+0.531278266 container cleanup 43281668584a56d0c488c06cd9d4dc4f3b557ebe9395e8441ec2b6544f2c5332 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-21T05:54:59.157 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Sep 21 05:54:58 smithi116 bash[65045]: ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-y 2024-09-21T05:54:59.334 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mgr.y.service' 2024-09-21T05:54:59.370 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:54:59.370 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-21T05:54:59.370 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-21T05:54:59.371 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-96c6636e-77db-11ef-baf5-efdc52797490@mgr.z 2024-09-21T05:54:59.726 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 05:54:59 smithi160 systemd[1]: Stopping Ceph mgr.z for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:55:00.048 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 05:54:59 smithi160 podman[65387]: 2024-09-21 05:54:59.724693691 +0000 UTC m=+0.153862570 container died bb38d8e43da1355082f4461ba6d109505c77fc033e22ce3dacacc69379a74c2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-z, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T05:55:00.357 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 05:55:00 smithi160 podman[65387]: 2024-09-21 05:55:00.154459299 +0000 UTC m=+0.583628177 container cleanup bb38d8e43da1355082f4461ba6d109505c77fc033e22ce3dacacc69379a74c2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-21T05:55:00.357 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 05:55:00 smithi160 bash[65387]: ceph-96c6636e-77db-11ef-baf5-efdc52797490-mgr-z 2024-09-21T05:55:00.578 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mgr.z.service' 2024-09-21T05:55:00.614 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:55:00.614 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-21T05:55:00.614 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T05:55:00.614 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.0 2024-09-21T05:55:00.745 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 21 05:55:00 smithi070 systemd[1]: Stopping Ceph osd.0 for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:55:01.245 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 21 05:55:00 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-0[46523]: 2024-09-21T05:55:00.935+0000 7f1c9a12f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T05:55:01.245 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 21 05:55:00 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-0[46523]: 2024-09-21T05:55:00.935+0000 7f1c9a12f640 -1 osd.0 89 *** Got signal Terminated *** 2024-09-21T05:55:01.245 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 21 05:55:00 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-0[46523]: 2024-09-21T05:55:00.935+0000 7f1c9a12f640 -1 osd.0 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T05:55:06.671 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 21 05:55:06 smithi070 podman[93147]: 2024-09-21 05:55:06.331671683 +0000 UTC m=+5.528867248 container died a568167a7353ef9d0818f1da4de1094257f07f3a0cc32e0dea027ab7074a9db1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T05:55:06.980 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 21 05:55:06 smithi070 podman[93147]: 2024-09-21 05:55:06.768570507 +0000 UTC m=+5.965766061 container cleanup a568167a7353ef9d0818f1da4de1094257f07f3a0cc32e0dea027ab7074a9db1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T05:55:06.980 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 21 05:55:06 smithi070 bash[93147]: ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-0 2024-09-21T05:55:07.245 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 21 05:55:06 smithi070 podman[93162]: 2024-09-21 05:55:06.978472458 +0000 UTC m=+0.647646250 container remove a568167a7353ef9d0818f1da4de1094257f07f3a0cc32e0dea027ab7074a9db1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T05:55:07.537 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 21 05:55:07 smithi070 podman[93249]: 2024-09-21 05:55:07.284521285 +0000 UTC m=+0.019481451 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:55:07.537 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 21 05:55:07 smithi070 podman[93249]: 2024-09-21 05:55:07.404192393 +0000 UTC m=+0.139152540 container create 12a4962fa00e5b82f0d8c5ad937755edb448bace914cb776c3c5e990e18f05c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-0-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T05:55:07.839 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 21 05:55:07 smithi070 podman[93249]: 2024-09-21 05:55:07.648436566 +0000 UTC m=+0.383396729 container init 12a4962fa00e5b82f0d8c5ad937755edb448bace914cb776c3c5e990e18f05c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T05:55:07.840 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 21 05:55:07 smithi070 podman[93249]: 2024-09-21 05:55:07.65191703 +0000 UTC m=+0.386877180 container start 12a4962fa00e5b82f0d8c5ad937755edb448bace914cb776c3c5e990e18f05c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T05:55:07.840 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 21 05:55:07 smithi070 podman[93249]: 2024-09-21 05:55:07.748531344 +0000 UTC m=+0.483491519 container attach 12a4962fa00e5b82f0d8c5ad937755edb448bace914cb776c3c5e990e18f05c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True) 2024-09-21T05:55:08.195 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 21 05:55:07 smithi070 podman[93249]: 2024-09-21 05:55:07.838860084 +0000 UTC m=+0.573820237 container died 12a4962fa00e5b82f0d8c5ad937755edb448bace914cb776c3c5e990e18f05c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True) 2024-09-21T05:55:08.561 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.0.service' 2024-09-21T05:55:08.602 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:55:08.602 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T05:55:08.603 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T05:55:08.603 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.1 2024-09-21T05:55:08.919 INFO:journalctl@ceph.osd.1.smithi116.stdout:Sep 21 05:55:08 smithi116 systemd[1]: Stopping Ceph osd.1 for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:55:09.304 INFO:journalctl@ceph.osd.1.smithi116.stdout:Sep 21 05:55:08 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-1[38270]: 2024-09-21T05:55:08.917+0000 7fa60205a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T05:55:09.304 INFO:journalctl@ceph.osd.1.smithi116.stdout:Sep 21 05:55:08 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-1[38270]: 2024-09-21T05:55:08.917+0000 7fa60205a640 -1 osd.1 89 *** Got signal Terminated *** 2024-09-21T05:55:09.305 INFO:journalctl@ceph.osd.1.smithi116.stdout:Sep 21 05:55:08 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-1[38270]: 2024-09-21T05:55:08.917+0000 7fa60205a640 -1 osd.1 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T05:55:14.671 INFO:journalctl@ceph.osd.1.smithi116.stdout:Sep 21 05:55:14 smithi116 podman[65170]: 2024-09-21 05:55:14.393231833 +0000 UTC m=+5.596159735 container died 45ce5a7c592b2f3de226ae5eb86d2d323b701d37509fe4c0b5ac9c4a3959dae2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T05:55:15.004 INFO:journalctl@ceph.osd.1.smithi116.stdout:Sep 21 05:55:14 smithi116 podman[65170]: 2024-09-21 05:55:14.76813318 +0000 UTC m=+5.971061071 container cleanup 45ce5a7c592b2f3de226ae5eb86d2d323b701d37509fe4c0b5ac9c4a3959dae2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-1, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T05:55:15.004 INFO:journalctl@ceph.osd.1.smithi116.stdout:Sep 21 05:55:14 smithi116 bash[65170]: ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-1 2024-09-21T05:55:15.304 INFO:journalctl@ceph.osd.1.smithi116.stdout:Sep 21 05:55:15 smithi116 podman[65186]: 2024-09-21 05:55:15.002933529 +0000 UTC m=+0.611832117 container remove 45ce5a7c592b2f3de226ae5eb86d2d323b701d37509fe4c0b5ac9c4a3959dae2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-1, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-21T05:55:15.608 INFO:journalctl@ceph.osd.1.smithi116.stdout:Sep 21 05:55:15 smithi116 podman[65278]: 2024-09-21 05:55:15.218642348 +0000 UTC m=+0.015865332 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:55:15.608 INFO:journalctl@ceph.osd.1.smithi116.stdout:Sep 21 05:55:15 smithi116 podman[65278]: 2024-09-21 05:55:15.337128912 +0000 UTC m=+0.134351882 container create d8fb391c67e8687a74d08125912ac9f9b211f553f127369ad6e1ddff6eef361d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T05:55:15.608 INFO:journalctl@ceph.osd.1.smithi116.stdout:Sep 21 05:55:15 smithi116 podman[65278]: 2024-09-21 05:55:15.60664064 +0000 UTC m=+0.403863618 container init d8fb391c67e8687a74d08125912ac9f9b211f553f127369ad6e1ddff6eef361d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-1-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T05:55:16.054 INFO:journalctl@ceph.osd.1.smithi116.stdout:Sep 21 05:55:15 smithi116 podman[65278]: 2024-09-21 05:55:15.610260436 +0000 UTC m=+0.407483413 container start d8fb391c67e8687a74d08125912ac9f9b211f553f127369ad6e1ddff6eef361d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-21T05:55:16.054 INFO:journalctl@ceph.osd.1.smithi116.stdout:Sep 21 05:55:15 smithi116 podman[65278]: 2024-09-21 05:55:15.706957217 +0000 UTC m=+0.504180203 container attach d8fb391c67e8687a74d08125912ac9f9b211f553f127369ad6e1ddff6eef361d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=) 2024-09-21T05:55:16.054 INFO:journalctl@ceph.osd.1.smithi116.stdout:Sep 21 05:55:15 smithi116 podman[65278]: 2024-09-21 05:55:15.796388265 +0000 UTC m=+0.593611247 container died d8fb391c67e8687a74d08125912ac9f9b211f553f127369ad6e1ddff6eef361d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T05:55:16.502 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.1.service' 2024-09-21T05:55:16.543 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:55:16.544 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T05:55:16.544 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T05:55:16.544 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.2 2024-09-21T05:55:16.869 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 05:55:16 smithi160 systemd[1]: Stopping Ceph osd.2 for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:55:17.148 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 05:55:16 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-2[38217]: 2024-09-21T05:55:16.867+0000 7fce963d3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T05:55:17.149 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 05:55:16 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-2[38217]: 2024-09-21T05:55:16.867+0000 7fce963d3640 -1 osd.2 89 *** Got signal Terminated *** 2024-09-21T05:55:17.149 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 05:55:16 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-2[38217]: 2024-09-21T05:55:16.867+0000 7fce963d3640 -1 osd.2 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T05:55:22.648 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 05:55:22 smithi160 podman[65513]: 2024-09-21 05:55:22.392553081 +0000 UTC m=+5.649057667 container died 185b6226c82fe9685cdd2a10adf804eec27ab46a09b9010697d9fbfaab066a97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T05:55:23.144 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 05:55:22 smithi160 podman[65513]: 2024-09-21 05:55:22.800205489 +0000 UTC m=+6.056710069 container cleanup 185b6226c82fe9685cdd2a10adf804eec27ab46a09b9010697d9fbfaab066a97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-21T05:55:23.144 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 05:55:22 smithi160 bash[65513]: ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-2 2024-09-21T05:55:23.398 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 05:55:23 smithi160 podman[65530]: 2024-09-21 05:55:23.143202366 +0000 UTC m=+0.747179549 container remove 185b6226c82fe9685cdd2a10adf804eec27ab46a09b9010697d9fbfaab066a97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T05:55:23.756 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 05:55:23 smithi160 podman[65617]: 2024-09-21 05:55:23.371110048 +0000 UTC m=+0.016282136 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:55:23.757 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 05:55:23 smithi160 podman[65617]: 2024-09-21 05:55:23.486199919 +0000 UTC m=+0.131372005 container create caaf0b6fa3244a68ea2b1926582c08f4aaf58c5c790b510d70741aa510289c8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T05:55:24.149 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 05:55:23 smithi160 podman[65617]: 2024-09-21 05:55:23.755619592 +0000 UTC m=+0.400791689 container init caaf0b6fa3244a68ea2b1926582c08f4aaf58c5c790b510d70741aa510289c8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T05:55:24.149 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 05:55:23 smithi160 podman[65617]: 2024-09-21 05:55:23.759145306 +0000 UTC m=+0.404317393 container start caaf0b6fa3244a68ea2b1926582c08f4aaf58c5c790b510d70741aa510289c8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-2-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T05:55:24.149 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 05:55:23 smithi160 podman[65617]: 2024-09-21 05:55:23.855552048 +0000 UTC m=+0.500724138 container attach caaf0b6fa3244a68ea2b1926582c08f4aaf58c5c790b510d70741aa510289c8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-2-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T05:55:24.149 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 05:55:23 smithi160 podman[65617]: 2024-09-21 05:55:23.951949146 +0000 UTC m=+0.597121236 container died caaf0b6fa3244a68ea2b1926582c08f4aaf58c5c790b510d70741aa510289c8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-21T05:55:24.655 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.2.service' 2024-09-21T05:55:24.680 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 05:55:24 smithi160 podman[65640]: 2024-09-21 05:55:24.626311325 +0000 UTC m=+0.664586614 container remove caaf0b6fa3244a68ea2b1926582c08f4aaf58c5c790b510d70741aa510289c8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-2-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T05:55:24.680 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 05:55:24 smithi160 systemd[1]: ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.2.service: Deactivated successfully. 2024-09-21T05:55:24.681 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 05:55:24 smithi160 systemd[1]: Stopped Ceph osd.2 for 96c6636e-77db-11ef-baf5-efdc52797490. 2024-09-21T05:55:24.681 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 05:55:24 smithi160 systemd[1]: ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.2.service: Consumed 31.343s CPU time. 2024-09-21T05:55:24.695 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:55:24.695 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T05:55:24.696 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T05:55:24.696 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.3 2024-09-21T05:55:24.995 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 21 05:55:24 smithi070 systemd[1]: Stopping Ceph osd.3 for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:55:25.495 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 21 05:55:25 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-3[53065]: 2024-09-21T05:55:25.003+0000 7fe9ccb95640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T05:55:25.495 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 21 05:55:25 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-3[53065]: 2024-09-21T05:55:25.003+0000 7fe9ccb95640 -1 osd.3 89 *** Got signal Terminated *** 2024-09-21T05:55:25.495 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 21 05:55:25 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-3[53065]: 2024-09-21T05:55:25.003+0000 7fe9ccb95640 -1 osd.3 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T05:55:27.148 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:26 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:26.879+0000 7f1b877d6640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:00.483620+0000 front 2024-09-21T05:55:00.483478+0000 (oldest deadline 2024-09-21T05:55:26.383298+0000) 2024-09-21T05:55:27.149 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:26 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:26.845+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:28.148 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:27 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:27.916+0000 7f1b877d6640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:00.483620+0000 front 2024-09-21T05:55:00.483478+0000 (oldest deadline 2024-09-21T05:55:26.383298+0000) 2024-09-21T05:55:28.149 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:27 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:27.866+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:28.245 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:27 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:27.976+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:55:28.842 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:28 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:28.411+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:55:29.149 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:28 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:28.877+0000 7f1b877d6640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:00.483620+0000 front 2024-09-21T05:55:00.483478+0000 (oldest deadline 2024-09-21T05:55:26.383298+0000) 2024-09-21T05:55:29.150 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:28 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:28.840+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:29.245 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:28 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:28.984+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:55:29.829 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:29 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:29.405+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:55:30.148 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:29 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:29.880+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:30.148 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:29 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:29.828+0000 7f1b877d6640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:00.483620+0000 front 2024-09-21T05:55:00.483478+0000 (oldest deadline 2024-09-21T05:55:26.383298+0000) 2024-09-21T05:55:30.245 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:29 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:29.943+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:55:30.648 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:30 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:30.381+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:55:30.731 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 21 05:55:30 smithi070 podman[93353]: 2024-09-21 05:55:30.444323911 +0000 UTC m=+5.558075837 container died 2a1b8545d4c42dae912c2dda4ebf878d0399c821539830ea945692ed82ed9f0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T05:55:30.995 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:30 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:30.966+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:55:30.995 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 21 05:55:30 smithi070 podman[93353]: 2024-09-21 05:55:30.92906628 +0000 UTC m=+6.042818196 container cleanup 2a1b8545d4c42dae912c2dda4ebf878d0399c821539830ea945692ed82ed9f0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-3, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-21T05:55:30.995 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 21 05:55:30 smithi070 bash[93353]: ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-3 2024-09-21T05:55:31.148 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:30 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:30.801+0000 7f1b877d6640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:00.483620+0000 front 2024-09-21T05:55:00.483478+0000 (oldest deadline 2024-09-21T05:55:26.383298+0000) 2024-09-21T05:55:31.148 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:30 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:30.866+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:31.304 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:30 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:30.995+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:55:31.495 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 21 05:55:31 smithi070 podman[93382]: 2024-09-21 05:55:31.222670378 +0000 UTC m=+0.768133044 container remove 2a1b8545d4c42dae912c2dda4ebf878d0399c821539830ea945692ed82ed9f0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-3, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T05:55:31.648 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:31 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:31.396+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:55:31.819 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 21 05:55:31 smithi070 podman[93471]: 2024-09-21 05:55:31.447904948 +0000 UTC m=+0.015782271 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:55:31.820 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 21 05:55:31 smithi070 podman[93471]: 2024-09-21 05:55:31.556720829 +0000 UTC m=+0.124598186 container create 4a8a31c1ace963f521f894f8db8dba2f35aac793db0fc378b59998534d363853 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T05:55:31.820 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 21 05:55:31 smithi070 podman[93471]: 2024-09-21 05:55:31.818129093 +0000 UTC m=+0.386006411 container init 4a8a31c1ace963f521f894f8db8dba2f35aac793db0fc378b59998534d363853 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T05:55:32.148 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:31 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:31.873+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:32.148 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:31 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:31.807+0000 7f1b877d6640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:00.483620+0000 front 2024-09-21T05:55:00.483478+0000 (oldest deadline 2024-09-21T05:55:26.383298+0000) 2024-09-21T05:55:32.245 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:31 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:31.998+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:55:32.246 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 21 05:55:31 smithi070 podman[93471]: 2024-09-21 05:55:31.821812547 +0000 UTC m=+0.389689863 container start 4a8a31c1ace963f521f894f8db8dba2f35aac793db0fc378b59998534d363853 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T05:55:32.246 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 21 05:55:31 smithi070 podman[93471]: 2024-09-21 05:55:31.926196861 +0000 UTC m=+0.494074187 container attach 4a8a31c1ace963f521f894f8db8dba2f35aac793db0fc378b59998534d363853 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T05:55:32.246 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 21 05:55:32 smithi070 podman[93471]: 2024-09-21 05:55:32.015399536 +0000 UTC m=+0.583276860 container died 4a8a31c1ace963f521f894f8db8dba2f35aac793db0fc378b59998534d363853 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-3-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T05:55:32.304 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:32 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:31.999+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:55:32.709 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.3.service' 2024-09-21T05:55:32.749 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:55:32.750 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T05:55:32.750 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T05:55:32.750 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.4 2024-09-21T05:55:32.785 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:32 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:32.435+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:55:33.054 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 21 05:55:32 smithi116 systemd[1]: Stopping Ceph osd.4 for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:55:33.054 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:32 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:32.968+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:55:33.148 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:32 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:32.848+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:33.148 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:32 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:32.784+0000 7f1b877d6640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:00.483620+0000 front 2024-09-21T05:55:00.483478+0000 (oldest deadline 2024-09-21T05:55:26.383298+0000) 2024-09-21T05:55:33.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:33 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:33.011+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:55:33.554 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 21 05:55:33 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-4[44508]: 2024-09-21T05:55:33.063+0000 7ff866dd4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T05:55:33.554 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 21 05:55:33 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-4[44508]: 2024-09-21T05:55:33.063+0000 7ff866dd4640 -1 osd.4 89 *** Got signal Terminated *** 2024-09-21T05:55:33.554 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 21 05:55:33 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-4[44508]: 2024-09-21T05:55:33.063+0000 7ff866dd4640 -1 osd.4 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T05:55:33.817 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:33 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:33.456+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:55:34.148 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:33 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:33.815+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:34.148 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:33 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:33.819+0000 7f1b877d6640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:00.483620+0000 front 2024-09-21T05:55:00.483478+0000 (oldest deadline 2024-09-21T05:55:26.383298+0000) 2024-09-21T05:55:34.304 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:33 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:33.968+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:55:34.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:34 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:34.034+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:55:34.804 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:34 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:34.448+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:55:35.148 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:34 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:34.801+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:35.148 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:34 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:34.859+0000 7f1b877d6640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:00.483620+0000 front 2024-09-21T05:55:00.483478+0000 (oldest deadline 2024-09-21T05:55:26.383298+0000) 2024-09-21T05:55:35.304 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:34 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:34.923+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:55:35.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:35 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:35.044+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:55:35.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:35 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:35.044+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:55:35.777 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:35 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:35.479+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:55:35.777 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:35 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:35.479+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:55:36.148 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:35 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:35.776+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:36.148 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:35 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:35.837+0000 7f1b877d6640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:00.483620+0000 front 2024-09-21T05:55:00.483478+0000 (oldest deadline 2024-09-21T05:55:26.383298+0000) 2024-09-21T05:55:36.304 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:35 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:35.906+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:55:36.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:36 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:36.089+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:55:36.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:36 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:36.089+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:55:36.809 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:36 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:36.496+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:55:36.810 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:36 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:36.496+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:55:37.148 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:36 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:36.876+0000 7f1b877d6640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:00.483620+0000 front 2024-09-21T05:55:00.483478+0000 (oldest deadline 2024-09-21T05:55:26.383298+0000) 2024-09-21T05:55:37.148 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:36 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:36.808+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:37.304 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:36 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:36.941+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:55:37.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:37 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:37.041+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:55:37.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:37 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:37.041+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:55:37.803 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:37 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:37.514+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:55:37.803 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:37 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:37.514+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:55:37.804 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:37 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:37.326+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:09.500111+0000 front 2024-09-21T05:55:09.500163+0000 (oldest deadline 2024-09-21T05:55:36.500883+0000) 2024-09-21T05:55:38.148 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:37 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:37.801+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:38.148 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:37 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:37.888+0000 7f1b877d6640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:00.483620+0000 front 2024-09-21T05:55:00.483478+0000 (oldest deadline 2024-09-21T05:55:26.383298+0000) 2024-09-21T05:55:38.149 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:37 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:37.888+0000 7f1b877d6640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:11.585000+0000 front 2024-09-21T05:55:11.585017+0000 (oldest deadline 2024-09-21T05:55:37.485018+0000) 2024-09-21T05:55:38.304 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:37 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:37.908+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:55:38.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:38 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:38.011+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:55:38.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:38 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:38.011+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:55:38.554 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:38 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:38.302+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:09.500111+0000 front 2024-09-21T05:55:09.500163+0000 (oldest deadline 2024-09-21T05:55:36.500883+0000) 2024-09-21T05:55:38.805 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:38 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:38.551+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:55:38.805 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:38 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:38.551+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:55:38.833 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 21 05:55:38 smithi116 podman[65400]: 2024-09-21 05:55:38.564889879 +0000 UTC m=+5.618897292 container died 56ccd07abe03d32c8f25cb888a229e9a5fb88baa246e28b3929acb3a10f805b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True) 2024-09-21T05:55:39.148 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:38 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:38.914+0000 7f1b877d6640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:00.483620+0000 front 2024-09-21T05:55:00.483478+0000 (oldest deadline 2024-09-21T05:55:26.383298+0000) 2024-09-21T05:55:39.212 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:38 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:38.914+0000 7f1b877d6640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:11.585000+0000 front 2024-09-21T05:55:11.585017+0000 (oldest deadline 2024-09-21T05:55:37.485018+0000) 2024-09-21T05:55:39.212 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:38 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:38.804+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:39.213 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:38 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:38.804+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.136791+0000 front 2024-09-21T05:55:13.136825+0000 (oldest deadline 2024-09-21T05:55:38.437010+0000) 2024-09-21T05:55:39.213 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 21 05:55:38 smithi116 podman[65400]: 2024-09-21 05:55:38.947029282 +0000 UTC m=+6.001036702 container cleanup 56ccd07abe03d32c8f25cb888a229e9a5fb88baa246e28b3929acb3a10f805b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True) 2024-09-21T05:55:39.213 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 21 05:55:38 smithi116 bash[65400]: ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-4 2024-09-21T05:55:39.213 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:38 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:38.861+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:55:39.213 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:38 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:38.861+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:55:39.245 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:39 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:39.010+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:55:39.245 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:39 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:39.010+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:55:39.551 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:39 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:39.262+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:09.500111+0000 front 2024-09-21T05:55:09.500163+0000 (oldest deadline 2024-09-21T05:55:36.500883+0000) 2024-09-21T05:55:39.552 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 21 05:55:39 smithi116 podman[65416]: 2024-09-21 05:55:39.198372746 +0000 UTC m=+0.632312427 container remove 56ccd07abe03d32c8f25cb888a229e9a5fb88baa246e28b3929acb3a10f805b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True) 2024-09-21T05:55:39.745 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:39 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:55:39.275+0000 7fa89f319640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.681550+0000 front 2024-09-21T05:55:12.681402+0000 (oldest deadline 2024-09-21T05:55:38.581373+0000) 2024-09-21T05:55:39.803 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 21 05:55:39 smithi116 podman[65509]: 2024-09-21 05:55:39.452819492 +0000 UTC m=+0.015590015 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:55:39.803 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 21 05:55:39 smithi116 podman[65509]: 2024-09-21 05:55:39.566111228 +0000 UTC m=+0.128881781 container create 736b81f05b7185d30a78211e21e4d77b006f51db0eccc4ff8ac41d7bf6e3873f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T05:55:39.803 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 21 05:55:39 smithi116 podman[65509]: 2024-09-21 05:55:39.80221085 +0000 UTC m=+0.364981371 container init 736b81f05b7185d30a78211e21e4d77b006f51db0eccc4ff8ac41d7bf6e3873f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T05:55:39.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:39 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:39.550+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:55:39.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:39 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:39.550+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:55:39.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:39 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:39.786+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:39.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:39 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:39.786+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.136791+0000 front 2024-09-21T05:55:13.136825+0000 (oldest deadline 2024-09-21T05:55:38.437010+0000) 2024-09-21T05:55:40.054 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:39 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:39.900+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:55:40.054 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:39 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:39.900+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:55:40.055 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 21 05:55:39 smithi116 podman[65509]: 2024-09-21 05:55:39.805527223 +0000 UTC m=+0.368297734 container start 736b81f05b7185d30a78211e21e4d77b006f51db0eccc4ff8ac41d7bf6e3873f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T05:55:40.055 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 21 05:55:39 smithi116 podman[65509]: 2024-09-21 05:55:39.902314768 +0000 UTC m=+0.465085283 container attach 736b81f05b7185d30a78211e21e4d77b006f51db0eccc4ff8ac41d7bf6e3873f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T05:55:40.055 INFO:journalctl@ceph.osd.4.smithi116.stdout:Sep 21 05:55:40 smithi116 podman[65509]: 2024-09-21 05:55:40.004189452 +0000 UTC m=+0.566959982 container died 736b81f05b7185d30a78211e21e4d77b006f51db0eccc4ff8ac41d7bf6e3873f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-4-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T05:55:40.318 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:40 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:40.047+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:55:40.318 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:40 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:40.047+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:55:40.398 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:39 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:39.911+0000 7f1b877d6640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:00.483620+0000 front 2024-09-21T05:55:00.483478+0000 (oldest deadline 2024-09-21T05:55:26.383298+0000) 2024-09-21T05:55:40.398 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:39 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:39.911+0000 7f1b877d6640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:11.585000+0000 front 2024-09-21T05:55:11.585017+0000 (oldest deadline 2024-09-21T05:55:37.485018+0000) 2024-09-21T05:55:40.554 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:40 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:40.278+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:09.500111+0000 front 2024-09-21T05:55:09.500163+0000 (oldest deadline 2024-09-21T05:55:36.500883+0000) 2024-09-21T05:55:40.644 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.4.service' 2024-09-21T05:55:40.683 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:55:40.684 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T05:55:40.684 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T05:55:40.684 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.5 2024-09-21T05:55:40.745 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:40 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:55:40.315+0000 7fa89f319640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.681550+0000 front 2024-09-21T05:55:12.681402+0000 (oldest deadline 2024-09-21T05:55:38.581373+0000) 2024-09-21T05:55:40.896 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:40 smithi160 systemd[1]: Stopping Ceph osd.5 for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:55:40.897 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:40 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:40.537+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:55:40.897 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:40 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:40.537+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:55:40.897 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:40 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:40.781+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:40.897 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:40 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:40.781+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.136791+0000 front 2024-09-21T05:55:13.136825+0000 (oldest deadline 2024-09-21T05:55:38.437010+0000) 2024-09-21T05:55:41.148 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:40 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:40.894+0000 7f1b877d6640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:00.483620+0000 front 2024-09-21T05:55:00.483478+0000 (oldest deadline 2024-09-21T05:55:26.383298+0000) 2024-09-21T05:55:41.148 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:40 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:40.894+0000 7f1b877d6640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:11.585000+0000 front 2024-09-21T05:55:11.585017+0000 (oldest deadline 2024-09-21T05:55:37.485018+0000) 2024-09-21T05:55:41.148 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:41 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:41.011+0000 7f1b8f1f3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T05:55:41.148 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:41 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:41.011+0000 7f1b8f1f3640 -1 osd.5 89 *** Got signal Terminated *** 2024-09-21T05:55:41.149 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:41 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:41.011+0000 7f1b8f1f3640 -1 osd.5 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T05:55:41.273 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:40 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:40.933+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:55:41.273 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:40 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:40.933+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:55:41.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:41 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:41.079+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:55:41.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:41 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:41.079+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:55:41.495 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:41 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:55:41.299+0000 7fa89f319640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.681550+0000 front 2024-09-21T05:55:12.681402+0000 (oldest deadline 2024-09-21T05:55:38.581373+0000) 2024-09-21T05:55:41.554 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:41 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:41.271+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:09.500111+0000 front 2024-09-21T05:55:09.500163+0000 (oldest deadline 2024-09-21T05:55:36.500883+0000) 2024-09-21T05:55:41.830 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:41 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:41.511+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:55:41.831 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:41 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:41.511+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:55:42.148 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:41 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:41.879+0000 7f1b877d6640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:00.483620+0000 front 2024-09-21T05:55:00.483478+0000 (oldest deadline 2024-09-21T05:55:26.383298+0000) 2024-09-21T05:55:42.148 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:41 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:41.879+0000 7f1b877d6640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:11.585000+0000 front 2024-09-21T05:55:11.585017+0000 (oldest deadline 2024-09-21T05:55:37.485018+0000) 2024-09-21T05:55:42.148 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:41 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:41.828+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:42.148 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:41 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:41.828+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.136791+0000 front 2024-09-21T05:55:13.136825+0000 (oldest deadline 2024-09-21T05:55:38.437010+0000) 2024-09-21T05:55:42.260 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:41 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:41.958+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:55:42.261 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:41 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:41.958+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:55:42.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:42 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:42.089+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:55:42.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:42 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:42.089+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:55:42.495 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:42 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:55:42.308+0000 7fa89f319640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.681550+0000 front 2024-09-21T05:55:12.681402+0000 (oldest deadline 2024-09-21T05:55:38.581373+0000) 2024-09-21T05:55:42.554 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:42 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:42.259+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:09.500111+0000 front 2024-09-21T05:55:09.500163+0000 (oldest deadline 2024-09-21T05:55:36.500883+0000) 2024-09-21T05:55:42.833 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:42 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:42.516+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:55:42.833 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:42 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:42.516+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:55:43.148 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:42 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:42.905+0000 7f1b877d6640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:00.483620+0000 front 2024-09-21T05:55:00.483478+0000 (oldest deadline 2024-09-21T05:55:26.383298+0000) 2024-09-21T05:55:43.148 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:42 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:42.905+0000 7f1b877d6640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:11.585000+0000 front 2024-09-21T05:55:11.585017+0000 (oldest deadline 2024-09-21T05:55:37.485018+0000) 2024-09-21T05:55:43.148 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:42 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:42.831+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:43.149 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:42 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:42.831+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.136791+0000 front 2024-09-21T05:55:13.136825+0000 (oldest deadline 2024-09-21T05:55:38.437010+0000) 2024-09-21T05:55:43.304 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:43 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:43.219+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:09.500111+0000 front 2024-09-21T05:55:09.500163+0000 (oldest deadline 2024-09-21T05:55:36.500883+0000) 2024-09-21T05:55:43.304 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:43 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:43.006+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:55:43.304 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:43 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:43.006+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:55:43.495 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:43 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:55:43.273+0000 7fa89f319640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.681550+0000 front 2024-09-21T05:55:12.681402+0000 (oldest deadline 2024-09-21T05:55:38.581373+0000) 2024-09-21T05:55:43.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:43 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:43.121+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:55:43.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:43 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:43.121+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:55:43.821 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:43 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:43.561+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:55:43.821 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:43 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:43.561+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:55:43.821 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:43 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:43.561+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:55:44.148 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:43 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:43.819+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:44.148 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:43 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:43.819+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.136791+0000 front 2024-09-21T05:55:13.136825+0000 (oldest deadline 2024-09-21T05:55:38.437010+0000) 2024-09-21T05:55:44.149 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:43 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:43.865+0000 7f1b877d6640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:00.483620+0000 front 2024-09-21T05:55:00.483478+0000 (oldest deadline 2024-09-21T05:55:26.383298+0000) 2024-09-21T05:55:44.149 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:43 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:43.865+0000 7f1b877d6640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:11.585000+0000 front 2024-09-21T05:55:11.585017+0000 (oldest deadline 2024-09-21T05:55:37.485018+0000) 2024-09-21T05:55:44.149 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:43 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:43.865+0000 7f1b877d6640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.485392+0000 front 2024-09-21T05:55:17.485420+0000 (oldest deadline 2024-09-21T05:55:43.385571+0000) 2024-09-21T05:55:44.304 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:44 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:44.174+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:09.500111+0000 front 2024-09-21T05:55:09.500163+0000 (oldest deadline 2024-09-21T05:55:36.500883+0000) 2024-09-21T05:55:44.304 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:44 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:44.028+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:55:44.304 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:44 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:44.028+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:55:44.304 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:44 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:44.028+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:55:44.495 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:44 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:55:44.284+0000 7fa89f319640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.681550+0000 front 2024-09-21T05:55:12.681402+0000 (oldest deadline 2024-09-21T05:55:38.581373+0000) 2024-09-21T05:55:44.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:44 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:44.085+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:55:44.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:44 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:44.085+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:55:44.867 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:44 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:44.821+0000 7f1b877d6640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:00.483620+0000 front 2024-09-21T05:55:00.483478+0000 (oldest deadline 2024-09-21T05:55:26.383298+0000) 2024-09-21T05:55:44.867 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:44 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:44.821+0000 7f1b877d6640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:11.585000+0000 front 2024-09-21T05:55:11.585017+0000 (oldest deadline 2024-09-21T05:55:37.485018+0000) 2024-09-21T05:55:44.867 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:44 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:44.821+0000 7f1b877d6640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.485392+0000 front 2024-09-21T05:55:17.485420+0000 (oldest deadline 2024-09-21T05:55:43.385571+0000) 2024-09-21T05:55:44.867 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:44 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:44.595+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:55:44.867 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:44 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:44.595+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:55:44.867 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:44 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:44.595+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:55:45.148 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:44 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:44.865+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:45.148 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:44 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:44.865+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.136791+0000 front 2024-09-21T05:55:13.136825+0000 (oldest deadline 2024-09-21T05:55:38.437010+0000) 2024-09-21T05:55:45.148 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:44 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:44.865+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:21.338214+0000 front 2024-09-21T05:55:21.338317+0000 (oldest deadline 2024-09-21T05:55:44.838307+0000) 2024-09-21T05:55:45.304 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:45 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:45.156+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:09.500111+0000 front 2024-09-21T05:55:09.500163+0000 (oldest deadline 2024-09-21T05:55:36.500883+0000) 2024-09-21T05:55:45.304 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:45 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:45.048+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:55:45.305 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:45 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:45.048+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:55:45.305 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:45 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:45.048+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:55:45.495 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:45 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:55:45.313+0000 7fa89f319640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.681550+0000 front 2024-09-21T05:55:12.681402+0000 (oldest deadline 2024-09-21T05:55:38.581373+0000) 2024-09-21T05:55:45.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:45 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:45.110+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:55:45.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:45 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:45.110+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:55:45.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:45 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:45.110+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:55:45.898 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:45 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:45.838+0000 7f1b877d6640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:00.483620+0000 front 2024-09-21T05:55:00.483478+0000 (oldest deadline 2024-09-21T05:55:26.383298+0000) 2024-09-21T05:55:45.898 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:45 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:45.838+0000 7f1b877d6640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:11.585000+0000 front 2024-09-21T05:55:11.585017+0000 (oldest deadline 2024-09-21T05:55:37.485018+0000) 2024-09-21T05:55:45.898 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:45 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5[44758]: 2024-09-21T05:55:45.838+0000 7f1b877d6640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.485392+0000 front 2024-09-21T05:55:17.485420+0000 (oldest deadline 2024-09-21T05:55:43.385571+0000) 2024-09-21T05:55:45.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:45 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:45.818+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:45.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:45 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:45.818+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.136791+0000 front 2024-09-21T05:55:13.136825+0000 (oldest deadline 2024-09-21T05:55:38.437010+0000) 2024-09-21T05:55:45.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:45 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:45.818+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:21.338214+0000 front 2024-09-21T05:55:21.338317+0000 (oldest deadline 2024-09-21T05:55:44.838307+0000) 2024-09-21T05:55:45.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:45 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:45.619+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:55:45.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:45 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:45.619+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:55:45.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:45 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:45.619+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:55:46.304 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:46 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:46.119+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:09.500111+0000 front 2024-09-21T05:55:09.500163+0000 (oldest deadline 2024-09-21T05:55:36.500883+0000) 2024-09-21T05:55:46.304 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:46 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:46.033+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:55:46.304 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:46 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:46.033+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:55:46.304 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:46 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:46.033+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:55:46.495 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:46 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:55:46.361+0000 7fa89f319640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.681550+0000 front 2024-09-21T05:55:12.681402+0000 (oldest deadline 2024-09-21T05:55:38.581373+0000) 2024-09-21T05:55:46.495 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:46 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:55:46.361+0000 7fa89f319640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:20.882423+0000 front 2024-09-21T05:55:20.882524+0000 (oldest deadline 2024-09-21T05:55:46.083026+0000) 2024-09-21T05:55:46.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:46 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:46.153+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:55:46.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:46 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:46.153+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:55:46.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:46 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:46.153+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:55:46.782 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:46 smithi160 podman[65731]: 2024-09-21 05:55:46.454041666 +0000 UTC m=+5.569995717 container died 8eed5ff48e36ee9a0543bf31b4f8549a441bcdff27706262c825e1c6c99d3834 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T05:55:46.782 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:46 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:46.632+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:55:46.782 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:46 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:46.632+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:55:46.782 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:46 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:46.632+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:55:47.148 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:46 smithi160 podman[65731]: 2024-09-21 05:55:46.878639108 +0000 UTC m=+5.994593198 container cleanup 8eed5ff48e36ee9a0543bf31b4f8549a441bcdff27706262c825e1c6c99d3834 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T05:55:47.148 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:46 smithi160 bash[65731]: ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5 2024-09-21T05:55:47.148 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:46 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:46.807+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:47.149 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:46 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:46.807+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.136791+0000 front 2024-09-21T05:55:13.136825+0000 (oldest deadline 2024-09-21T05:55:38.437010+0000) 2024-09-21T05:55:47.149 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:46 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:46.807+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:21.338214+0000 front 2024-09-21T05:55:21.338317+0000 (oldest deadline 2024-09-21T05:55:44.838307+0000) 2024-09-21T05:55:47.495 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:47 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:55:47.336+0000 7fa89f319640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.681550+0000 front 2024-09-21T05:55:12.681402+0000 (oldest deadline 2024-09-21T05:55:38.581373+0000) 2024-09-21T05:55:47.495 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:47 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:55:47.336+0000 7fa89f319640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:20.882423+0000 front 2024-09-21T05:55:20.882524+0000 (oldest deadline 2024-09-21T05:55:46.083026+0000) 2024-09-21T05:55:47.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:47 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:47.192+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:55:47.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:47 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:47.192+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:55:47.496 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:47 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:47.192+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:55:47.554 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:47 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:47.123+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:09.500111+0000 front 2024-09-21T05:55:09.500163+0000 (oldest deadline 2024-09-21T05:55:36.500883+0000) 2024-09-21T05:55:47.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:47 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:47.080+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:55:47.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:47 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:47.080+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:55:47.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:47 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:47.080+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:55:47.619 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:47 smithi160 podman[65745]: 2024-09-21 05:55:47.196658988 +0000 UTC m=+0.739566023 container remove 8eed5ff48e36ee9a0543bf31b4f8549a441bcdff27706262c825e1c6c99d3834 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-21T05:55:47.893 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:47 smithi160 podman[65836]: 2024-09-21 05:55:47.549399108 +0000 UTC m=+0.016797071 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:55:47.893 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:47 smithi160 podman[65836]: 2024-09-21 05:55:47.655728598 +0000 UTC m=+0.123126561 container create 57f6a7d1e84365c29462bce03cf4d4bf0c899618187f841d27fb4a9b6664f284 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T05:55:47.893 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:47 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:47.617+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:55:47.893 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:47 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:47.617+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:55:47.893 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:47 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:47.617+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:55:47.894 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:47 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:47.792+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:47.894 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:47 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:47.792+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.136791+0000 front 2024-09-21T05:55:13.136825+0000 (oldest deadline 2024-09-21T05:55:38.437010+0000) 2024-09-21T05:55:47.894 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:47 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:47.792+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:21.338214+0000 front 2024-09-21T05:55:21.338317+0000 (oldest deadline 2024-09-21T05:55:44.838307+0000) 2024-09-21T05:55:48.148 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:47 smithi160 podman[65836]: 2024-09-21 05:55:47.891673312 +0000 UTC m=+0.359071280 container init 57f6a7d1e84365c29462bce03cf4d4bf0c899618187f841d27fb4a9b6664f284 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T05:55:48.148 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:47 smithi160 podman[65836]: 2024-09-21 05:55:47.895113887 +0000 UTC m=+0.362511851 container start 57f6a7d1e84365c29462bce03cf4d4bf0c899618187f841d27fb4a9b6664f284 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5-deactivate, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T05:55:48.149 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:47 smithi160 podman[65836]: 2024-09-21 05:55:47.99174858 +0000 UTC m=+0.459146546 container attach 57f6a7d1e84365c29462bce03cf4d4bf0c899618187f841d27fb4a9b6664f284 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T05:55:48.149 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 05:55:48 smithi160 podman[65836]: 2024-09-21 05:55:48.083114943 +0000 UTC m=+0.550512922 container died 57f6a7d1e84365c29462bce03cf4d4bf0c899618187f841d27fb4a9b6664f284 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T05:55:48.495 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:48 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:55:48.386+0000 7fa89f319640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.681550+0000 front 2024-09-21T05:55:12.681402+0000 (oldest deadline 2024-09-21T05:55:38.581373+0000) 2024-09-21T05:55:48.495 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:48 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:55:48.386+0000 7fa89f319640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:20.882423+0000 front 2024-09-21T05:55:20.882524+0000 (oldest deadline 2024-09-21T05:55:46.083026+0000) 2024-09-21T05:55:48.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:48 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:48.148+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:55:48.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:48 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:48.148+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:55:48.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:48 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:48.148+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:55:48.554 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:48 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:48.147+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:09.500111+0000 front 2024-09-21T05:55:09.500163+0000 (oldest deadline 2024-09-21T05:55:36.500883+0000) 2024-09-21T05:55:48.554 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:48 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:48.147+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:20.602099+0000 front 2024-09-21T05:55:20.602024+0000 (oldest deadline 2024-09-21T05:55:47.602537+0000) 2024-09-21T05:55:48.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:48 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:48.076+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:55:48.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:48 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:48.076+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:55:48.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:48 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:48.076+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:55:48.763 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:48 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:48.647+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:55:48.763 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:48 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:48.647+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:55:48.763 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:48 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:48.647+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:55:48.780 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.5.service' 2024-09-21T05:55:48.820 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:55:48.820 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T05:55:48.820 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-21T05:55:48.821 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.6 2024-09-21T05:55:49.148 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:48 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:48.834+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:49.148 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:48 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:48.834+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.136791+0000 front 2024-09-21T05:55:13.136825+0000 (oldest deadline 2024-09-21T05:55:38.437010+0000) 2024-09-21T05:55:49.148 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:48 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:48.834+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:21.338214+0000 front 2024-09-21T05:55:21.338317+0000 (oldest deadline 2024-09-21T05:55:44.838307+0000) 2024-09-21T05:55:49.184 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:48 smithi070 systemd[1]: Stopping Ceph osd.6 for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:55:49.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:49 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:49.182+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:55:49.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:49 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:49.182+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:55:49.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:49 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:49.182+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:55:49.496 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:49 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:55:49.323+0000 7fa8a2d2e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T05:55:49.496 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:49 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:55:49.323+0000 7fa8a2d2e640 -1 osd.6 89 *** Got signal Terminated *** 2024-09-21T05:55:49.496 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:49 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:55:49.323+0000 7fa8a2d2e640 -1 osd.6 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T05:55:49.496 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:49 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:55:49.352+0000 7fa89f319640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.681550+0000 front 2024-09-21T05:55:12.681402+0000 (oldest deadline 2024-09-21T05:55:38.581373+0000) 2024-09-21T05:55:49.496 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:49 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:55:49.352+0000 7fa89f319640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:20.882423+0000 front 2024-09-21T05:55:20.882524+0000 (oldest deadline 2024-09-21T05:55:46.083026+0000) 2024-09-21T05:55:49.554 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:49 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:49.175+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:09.500111+0000 front 2024-09-21T05:55:09.500163+0000 (oldest deadline 2024-09-21T05:55:36.500883+0000) 2024-09-21T05:55:49.554 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:49 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:49.175+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:20.602099+0000 front 2024-09-21T05:55:20.602024+0000 (oldest deadline 2024-09-21T05:55:47.602537+0000) 2024-09-21T05:55:49.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:49 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:49.109+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:55:49.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:49 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:49.109+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:55:49.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:49 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:49.109+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:55:49.881 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:49 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:49.612+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:55:49.881 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:49 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:49.612+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:55:49.881 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:49 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:49.612+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:55:50.148 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:49 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:49.879+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:50.148 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:49 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:49.879+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.136791+0000 front 2024-09-21T05:55:13.136825+0000 (oldest deadline 2024-09-21T05:55:38.437010+0000) 2024-09-21T05:55:50.148 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:49 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:49.879+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:21.338214+0000 front 2024-09-21T05:55:21.338317+0000 (oldest deadline 2024-09-21T05:55:44.838307+0000) 2024-09-21T05:55:50.495 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:50 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:55:50.325+0000 7fa89f319640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.681550+0000 front 2024-09-21T05:55:12.681402+0000 (oldest deadline 2024-09-21T05:55:38.581373+0000) 2024-09-21T05:55:50.495 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:50 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:55:50.325+0000 7fa89f319640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:20.882423+0000 front 2024-09-21T05:55:20.882524+0000 (oldest deadline 2024-09-21T05:55:46.083026+0000) 2024-09-21T05:55:50.496 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:50 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:50.203+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:55:50.496 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:50 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:50.203+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:55:50.496 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:50 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:50.203+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:55:50.554 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:50 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:50.157+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:09.500111+0000 front 2024-09-21T05:55:09.500163+0000 (oldest deadline 2024-09-21T05:55:36.500883+0000) 2024-09-21T05:55:50.554 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:50 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:50.157+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:20.602099+0000 front 2024-09-21T05:55:20.602024+0000 (oldest deadline 2024-09-21T05:55:47.602537+0000) 2024-09-21T05:55:50.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:50 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:50.069+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:55:50.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:50 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:50.069+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:55:50.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:50 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:50.069+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:55:51.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:50 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:50.656+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:55:51.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:50 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:50.656+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:55:51.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:50 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:50.656+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:55:51.149 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:50 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:50.832+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:51.149 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:50 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:50.832+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.136791+0000 front 2024-09-21T05:55:13.136825+0000 (oldest deadline 2024-09-21T05:55:38.437010+0000) 2024-09-21T05:55:51.149 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:50 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:50.832+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:21.338214+0000 front 2024-09-21T05:55:21.338317+0000 (oldest deadline 2024-09-21T05:55:44.838307+0000) 2024-09-21T05:55:51.149 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:50 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:50.832+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.139603+0000 front 2024-09-21T05:55:27.139546+0000 (oldest deadline 2024-09-21T05:55:50.639468+0000) 2024-09-21T05:55:51.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:51 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:51.169+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:55:51.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:51 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:51.169+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:55:51.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:51 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:51.169+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:55:51.495 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:51 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:55:51.302+0000 7fa89f319640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.681550+0000 front 2024-09-21T05:55:12.681402+0000 (oldest deadline 2024-09-21T05:55:38.581373+0000) 2024-09-21T05:55:51.495 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:51 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:55:51.302+0000 7fa89f319640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:20.882423+0000 front 2024-09-21T05:55:20.882524+0000 (oldest deadline 2024-09-21T05:55:46.083026+0000) 2024-09-21T05:55:51.495 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:51 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:55:51.302+0000 7fa89f319640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.983769+0000 front 2024-09-21T05:55:28.983808+0000 (oldest deadline 2024-09-21T05:55:51.283861+0000) 2024-09-21T05:55:51.554 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:51 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:51.126+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:09.500111+0000 front 2024-09-21T05:55:09.500163+0000 (oldest deadline 2024-09-21T05:55:36.500883+0000) 2024-09-21T05:55:51.554 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:51 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:51.126+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:20.602099+0000 front 2024-09-21T05:55:20.602024+0000 (oldest deadline 2024-09-21T05:55:47.602537+0000) 2024-09-21T05:55:51.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:51 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:51.089+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:55:51.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:51 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:51.089+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:55:51.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:51 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:51.089+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:55:51.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:51 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:51.644+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:55:51.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:51 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:51.644+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:55:51.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:51 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:51.644+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:55:51.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:51 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:51.787+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:51.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:51 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:51.787+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.136791+0000 front 2024-09-21T05:55:13.136825+0000 (oldest deadline 2024-09-21T05:55:38.437010+0000) 2024-09-21T05:55:51.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:51 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:51.787+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:21.338214+0000 front 2024-09-21T05:55:21.338317+0000 (oldest deadline 2024-09-21T05:55:44.838307+0000) 2024-09-21T05:55:51.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:51 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:51.787+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.139603+0000 front 2024-09-21T05:55:27.139546+0000 (oldest deadline 2024-09-21T05:55:50.639468+0000) 2024-09-21T05:55:52.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:52 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:52.142+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:55:52.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:52 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:52.142+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:55:52.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:52 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:52.142+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:55:52.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:52 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:52.142+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.548695+0000 front 2024-09-21T05:55:27.548624+0000 (oldest deadline 2024-09-21T05:55:51.648724+0000) 2024-09-21T05:55:52.495 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:52 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:55:52.291+0000 7fa89f319640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.681550+0000 front 2024-09-21T05:55:12.681402+0000 (oldest deadline 2024-09-21T05:55:38.581373+0000) 2024-09-21T05:55:52.496 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:52 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:55:52.291+0000 7fa89f319640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:20.882423+0000 front 2024-09-21T05:55:20.882524+0000 (oldest deadline 2024-09-21T05:55:46.083026+0000) 2024-09-21T05:55:52.496 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:52 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:55:52.291+0000 7fa89f319640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.983769+0000 front 2024-09-21T05:55:28.983808+0000 (oldest deadline 2024-09-21T05:55:51.283861+0000) 2024-09-21T05:55:52.554 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:52 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:52.166+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:09.500111+0000 front 2024-09-21T05:55:09.500163+0000 (oldest deadline 2024-09-21T05:55:36.500883+0000) 2024-09-21T05:55:52.555 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:52 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:52.166+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:20.602099+0000 front 2024-09-21T05:55:20.602024+0000 (oldest deadline 2024-09-21T05:55:47.602537+0000) 2024-09-21T05:55:52.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:52 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:52.065+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:55:52.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:52 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:52.065+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:55:52.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:52 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:52.065+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:55:53.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:52 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:52.654+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:55:53.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:52 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:52.654+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:55:53.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:52 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:52.654+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:55:53.149 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:52 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:52.757+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:53.149 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:52 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:52.757+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.136791+0000 front 2024-09-21T05:55:13.136825+0000 (oldest deadline 2024-09-21T05:55:38.437010+0000) 2024-09-21T05:55:53.149 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:52 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:52.757+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:21.338214+0000 front 2024-09-21T05:55:21.338317+0000 (oldest deadline 2024-09-21T05:55:44.838307+0000) 2024-09-21T05:55:53.149 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:52 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:52.757+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.139603+0000 front 2024-09-21T05:55:27.139546+0000 (oldest deadline 2024-09-21T05:55:50.639468+0000) 2024-09-21T05:55:53.304 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:53 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:53.165+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:09.500111+0000 front 2024-09-21T05:55:09.500163+0000 (oldest deadline 2024-09-21T05:55:36.500883+0000) 2024-09-21T05:55:53.304 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:53 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:53.165+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:20.602099+0000 front 2024-09-21T05:55:20.602024+0000 (oldest deadline 2024-09-21T05:55:47.602537+0000) 2024-09-21T05:55:53.304 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:53 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:53.165+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.603010+0000 front 2024-09-21T05:55:27.603119+0000 (oldest deadline 2024-09-21T05:55:52.303036+0000) 2024-09-21T05:55:53.304 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:53 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:53.042+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:55:53.305 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:53 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:53.042+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:55:53.305 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:53 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:53.042+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:55:53.305 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:53 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:53.042+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:55:53.495 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:53 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:55:53.310+0000 7fa89f319640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.681550+0000 front 2024-09-21T05:55:12.681402+0000 (oldest deadline 2024-09-21T05:55:38.581373+0000) 2024-09-21T05:55:53.495 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:53 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:55:53.310+0000 7fa89f319640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:20.882423+0000 front 2024-09-21T05:55:20.882524+0000 (oldest deadline 2024-09-21T05:55:46.083026+0000) 2024-09-21T05:55:53.495 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:53 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:55:53.310+0000 7fa89f319640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.983769+0000 front 2024-09-21T05:55:28.983808+0000 (oldest deadline 2024-09-21T05:55:51.283861+0000) 2024-09-21T05:55:53.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:53 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:53.137+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:55:53.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:53 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:53.137+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:55:53.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:53 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:53.137+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:55:53.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:53 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:53.137+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.548695+0000 front 2024-09-21T05:55:27.548624+0000 (oldest deadline 2024-09-21T05:55:51.648724+0000) 2024-09-21T05:55:53.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:53 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:53.608+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:55:53.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:53 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:53.609+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:55:53.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:53 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:53.609+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:55:53.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:53 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:53.742+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:53.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:53 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:53.742+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.136791+0000 front 2024-09-21T05:55:13.136825+0000 (oldest deadline 2024-09-21T05:55:38.437010+0000) 2024-09-21T05:55:53.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:53 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:53.742+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:21.338214+0000 front 2024-09-21T05:55:21.338317+0000 (oldest deadline 2024-09-21T05:55:44.838307+0000) 2024-09-21T05:55:53.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:53 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:53.742+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.139603+0000 front 2024-09-21T05:55:27.139546+0000 (oldest deadline 2024-09-21T05:55:50.639468+0000) 2024-09-21T05:55:54.495 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:54 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:55:54.260+0000 7fa89f319640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.681550+0000 front 2024-09-21T05:55:12.681402+0000 (oldest deadline 2024-09-21T05:55:38.581373+0000) 2024-09-21T05:55:54.596 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:54 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:55:54.260+0000 7fa89f319640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:20.882423+0000 front 2024-09-21T05:55:20.882524+0000 (oldest deadline 2024-09-21T05:55:46.083026+0000) 2024-09-21T05:55:54.596 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:54 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6[59207]: 2024-09-21T05:55:54.260+0000 7fa89f319640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.983769+0000 front 2024-09-21T05:55:28.983808+0000 (oldest deadline 2024-09-21T05:55:51.283861+0000) 2024-09-21T05:55:54.596 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:54 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:54.088+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:55:54.596 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:54 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:54.088+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:55:54.596 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:54 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:54.088+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:55:54.597 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:54 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:54.088+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.548695+0000 front 2024-09-21T05:55:27.548624+0000 (oldest deadline 2024-09-21T05:55:51.648724+0000) 2024-09-21T05:55:54.597 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:54 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:54.141+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:09.500111+0000 front 2024-09-21T05:55:09.500163+0000 (oldest deadline 2024-09-21T05:55:36.500883+0000) 2024-09-21T05:55:54.598 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:54 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:54.141+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:20.602099+0000 front 2024-09-21T05:55:20.602024+0000 (oldest deadline 2024-09-21T05:55:47.602537+0000) 2024-09-21T05:55:54.598 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:54 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:54.141+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.603010+0000 front 2024-09-21T05:55:27.603119+0000 (oldest deadline 2024-09-21T05:55:52.303036+0000) 2024-09-21T05:55:54.598 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:54 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:54.067+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:55:54.598 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:54 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:54.067+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:55:54.598 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:54 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:54.067+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:55:54.598 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:54 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:54.067+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:55:54.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:54 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:54.561+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:55:54.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:54 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:54.561+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:55:54.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:54 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:54.561+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:55:54.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:54 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:54.715+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:54.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:54 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:54.715+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.136791+0000 front 2024-09-21T05:55:13.136825+0000 (oldest deadline 2024-09-21T05:55:38.437010+0000) 2024-09-21T05:55:54.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:54 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:54.715+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:21.338214+0000 front 2024-09-21T05:55:21.338317+0000 (oldest deadline 2024-09-21T05:55:44.838307+0000) 2024-09-21T05:55:54.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:54 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:54.715+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.139603+0000 front 2024-09-21T05:55:27.139546+0000 (oldest deadline 2024-09-21T05:55:50.639468+0000) 2024-09-21T05:55:55.051 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:54 smithi070 podman[93573]: 2024-09-21 05:55:54.762709279 +0000 UTC m=+5.749805882 container died 33a2866e3567ebb9a44f79dee4f69e13a0dc06d1606e96ab7acb6d09ae44faf5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-21T05:55:55.409 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:55 smithi070 podman[93573]: 2024-09-21 05:55:55.166179363 +0000 UTC m=+6.153275961 container cleanup 33a2866e3567ebb9a44f79dee4f69e13a0dc06d1606e96ab7acb6d09ae44faf5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T05:55:55.409 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:55 smithi070 bash[93573]: ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6 2024-09-21T05:55:55.409 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:55 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:55.115+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:55:55.409 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:55 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:55.115+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:55:55.409 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:55 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:55.115+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:55:55.409 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:55 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:55.115+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.548695+0000 front 2024-09-21T05:55:27.548624+0000 (oldest deadline 2024-09-21T05:55:51.648724+0000) 2024-09-21T05:55:55.554 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:55 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:55.161+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:09.500111+0000 front 2024-09-21T05:55:09.500163+0000 (oldest deadline 2024-09-21T05:55:36.500883+0000) 2024-09-21T05:55:55.554 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:55 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:55.161+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:20.602099+0000 front 2024-09-21T05:55:20.602024+0000 (oldest deadline 2024-09-21T05:55:47.602537+0000) 2024-09-21T05:55:55.554 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:55 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:55.161+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.603010+0000 front 2024-09-21T05:55:27.603119+0000 (oldest deadline 2024-09-21T05:55:52.303036+0000) 2024-09-21T05:55:55.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:55 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:55.068+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:55:55.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:55 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:55.068+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:55:55.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:55 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:55.068+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:55:55.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:55 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:55.068+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:55:55.715 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:55 smithi070 podman[93588]: 2024-09-21 05:55:55.407649708 +0000 UTC m=+0.645203233 container remove 33a2866e3567ebb9a44f79dee4f69e13a0dc06d1606e96ab7acb6d09ae44faf5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T05:55:55.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:55 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:55.565+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:55:55.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:55 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:55.565+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:55:55.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:55 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:55.565+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:55:55.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:55 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:55.763+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:55.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:55 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:55.763+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.136791+0000 front 2024-09-21T05:55:13.136825+0000 (oldest deadline 2024-09-21T05:55:38.437010+0000) 2024-09-21T05:55:55.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:55 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:55.763+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:21.338214+0000 front 2024-09-21T05:55:21.338317+0000 (oldest deadline 2024-09-21T05:55:44.838307+0000) 2024-09-21T05:55:55.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:55 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:55.763+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.139603+0000 front 2024-09-21T05:55:27.139546+0000 (oldest deadline 2024-09-21T05:55:50.639468+0000) 2024-09-21T05:55:55.995 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:55 smithi070 podman[93679]: 2024-09-21 05:55:55.616298945 +0000 UTC m=+0.015957555 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:55:55.995 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:55 smithi070 podman[93679]: 2024-09-21 05:55:55.744056427 +0000 UTC m=+0.143715072 container create 3d7e2de83f0db42b3a4ecfdc19009e16bfe91680fe2d92a65c7b7ae8636f0c09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T05:55:56.462 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:56 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:56.115+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:55:56.462 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:56 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:56.115+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:55:56.462 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:56 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:56.115+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:55:56.462 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:56 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:56.115+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.548695+0000 front 2024-09-21T05:55:27.548624+0000 (oldest deadline 2024-09-21T05:55:51.648724+0000) 2024-09-21T05:55:56.462 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:56 smithi070 podman[93679]: 2024-09-21 05:55:56.004819594 +0000 UTC m=+0.404478200 container init 3d7e2de83f0db42b3a4ecfdc19009e16bfe91680fe2d92a65c7b7ae8636f0c09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T05:55:56.462 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:56 smithi070 podman[93679]: 2024-09-21 05:55:56.008085344 +0000 UTC m=+0.407743944 container start 3d7e2de83f0db42b3a4ecfdc19009e16bfe91680fe2d92a65c7b7ae8636f0c09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T05:55:56.462 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:56 smithi070 podman[93679]: 2024-09-21 05:55:56.088239222 +0000 UTC m=+0.487897823 container attach 3d7e2de83f0db42b3a4ecfdc19009e16bfe91680fe2d92a65c7b7ae8636f0c09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T05:55:56.462 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 21 05:55:56 smithi070 podman[93679]: 2024-09-21 05:55:56.195183924 +0000 UTC m=+0.594842538 container died 3d7e2de83f0db42b3a4ecfdc19009e16bfe91680fe2d92a65c7b7ae8636f0c09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T05:55:56.554 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:56 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:56.118+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:09.500111+0000 front 2024-09-21T05:55:09.500163+0000 (oldest deadline 2024-09-21T05:55:36.500883+0000) 2024-09-21T05:55:56.554 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:56 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:56.118+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:20.602099+0000 front 2024-09-21T05:55:20.602024+0000 (oldest deadline 2024-09-21T05:55:47.602537+0000) 2024-09-21T05:55:56.555 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:56 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:56.118+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.603010+0000 front 2024-09-21T05:55:27.603119+0000 (oldest deadline 2024-09-21T05:55:52.303036+0000) 2024-09-21T05:55:56.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:56 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:56.093+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:55:56.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:56 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:56.093+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:55:56.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:56 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:56.093+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:55:56.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:56 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:56.093+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:55:56.878 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.6.service' 2024-09-21T05:55:56.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:56 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:56.581+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:55:56.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:56 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:56.581+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:55:56.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:56 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:56.581+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:55:56.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:56 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:56.745+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:56.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:56 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:56.745+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.136791+0000 front 2024-09-21T05:55:13.136825+0000 (oldest deadline 2024-09-21T05:55:38.437010+0000) 2024-09-21T05:55:56.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:56 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:56.745+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:21.338214+0000 front 2024-09-21T05:55:21.338317+0000 (oldest deadline 2024-09-21T05:55:44.838307+0000) 2024-09-21T05:55:56.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:56 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:56.745+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.139603+0000 front 2024-09-21T05:55:27.139546+0000 (oldest deadline 2024-09-21T05:55:50.639468+0000) 2024-09-21T05:55:56.916 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:55:56.916 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-21T05:55:56.916 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-21T05:55:56.916 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.7 2024-09-21T05:55:57.218 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:56 smithi116 systemd[1]: Stopping Ceph osd.7 for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:55:57.219 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:57 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:57.076+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:09.500111+0000 front 2024-09-21T05:55:09.500163+0000 (oldest deadline 2024-09-21T05:55:36.500883+0000) 2024-09-21T05:55:57.219 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:57 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:57.076+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:20.602099+0000 front 2024-09-21T05:55:20.602024+0000 (oldest deadline 2024-09-21T05:55:47.602537+0000) 2024-09-21T05:55:57.219 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:57 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:57.076+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.603010+0000 front 2024-09-21T05:55:27.603119+0000 (oldest deadline 2024-09-21T05:55:52.303036+0000) 2024-09-21T05:55:57.219 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:57 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:57.216+0000 7fdd9ed6c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T05:55:57.219 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:57 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:57.216+0000 7fdd9ed6c640 -1 osd.7 89 *** Got signal Terminated *** 2024-09-21T05:55:57.219 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:57 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:57.216+0000 7fdd9ed6c640 -1 osd.7 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T05:55:57.219 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:57 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:57.122+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:55:57.219 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:57 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:57.122+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:55:57.219 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:57 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:57.123+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:55:57.219 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:57 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:57.123+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:55:57.245 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:57 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:57.082+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:55:57.245 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:57 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:57.082+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:55:57.245 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:57 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:57.082+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:55:57.245 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:57 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:57.082+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.548695+0000 front 2024-09-21T05:55:27.548624+0000 (oldest deadline 2024-09-21T05:55:51.648724+0000) 2024-09-21T05:55:57.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:57 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:57.546+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:55:57.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:57 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:57.546+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:55:57.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:57 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:57.546+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:55:57.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:57 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:57.724+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:57.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:57 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:57.724+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.136791+0000 front 2024-09-21T05:55:13.136825+0000 (oldest deadline 2024-09-21T05:55:38.437010+0000) 2024-09-21T05:55:57.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:57 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:57.724+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:21.338214+0000 front 2024-09-21T05:55:21.338317+0000 (oldest deadline 2024-09-21T05:55:44.838307+0000) 2024-09-21T05:55:57.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:57 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:57.724+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.139603+0000 front 2024-09-21T05:55:27.139546+0000 (oldest deadline 2024-09-21T05:55:50.639468+0000) 2024-09-21T05:55:58.420 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:58 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:58.121+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:09.500111+0000 front 2024-09-21T05:55:09.500163+0000 (oldest deadline 2024-09-21T05:55:36.500883+0000) 2024-09-21T05:55:58.421 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:58 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:58.121+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:20.602099+0000 front 2024-09-21T05:55:20.602024+0000 (oldest deadline 2024-09-21T05:55:47.602537+0000) 2024-09-21T05:55:58.421 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:58 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:58.121+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.603010+0000 front 2024-09-21T05:55:27.603119+0000 (oldest deadline 2024-09-21T05:55:52.303036+0000) 2024-09-21T05:55:58.421 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:58 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:58.150+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:55:58.421 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:58 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:58.150+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:55:58.421 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:58 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:58.150+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:55:58.421 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:58 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:58.150+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:55:58.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:58 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:58.129+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:55:58.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:58 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:58.129+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:55:58.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:58 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:58.129+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:55:58.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:58 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:58.129+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.548695+0000 front 2024-09-21T05:55:27.548624+0000 (oldest deadline 2024-09-21T05:55:51.648724+0000) 2024-09-21T05:55:58.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:58 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:58.569+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:55:58.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:58 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:58.569+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:55:58.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:58 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:58.569+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:55:58.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:58 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:58.743+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:58.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:58 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:58.743+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.136791+0000 front 2024-09-21T05:55:13.136825+0000 (oldest deadline 2024-09-21T05:55:38.437010+0000) 2024-09-21T05:55:58.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:58 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:58.743+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:21.338214+0000 front 2024-09-21T05:55:21.338317+0000 (oldest deadline 2024-09-21T05:55:44.838307+0000) 2024-09-21T05:55:58.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:58 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:58.743+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.139603+0000 front 2024-09-21T05:55:27.139546+0000 (oldest deadline 2024-09-21T05:55:50.639468+0000) 2024-09-21T05:55:59.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:59 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:59.110+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:55:59.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:59 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:59.110+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:55:59.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:59 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:59.110+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:55:59.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:55:59 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:55:59.110+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.548695+0000 front 2024-09-21T05:55:27.548624+0000 (oldest deadline 2024-09-21T05:55:51.648724+0000) 2024-09-21T05:55:59.554 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:59 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:59.164+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:09.500111+0000 front 2024-09-21T05:55:09.500163+0000 (oldest deadline 2024-09-21T05:55:36.500883+0000) 2024-09-21T05:55:59.554 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:59 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:59.164+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:20.602099+0000 front 2024-09-21T05:55:20.602024+0000 (oldest deadline 2024-09-21T05:55:47.602537+0000) 2024-09-21T05:55:59.554 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:55:59 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:55:59.164+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.603010+0000 front 2024-09-21T05:55:27.603119+0000 (oldest deadline 2024-09-21T05:55:52.303036+0000) 2024-09-21T05:55:59.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:59 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:59.133+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:55:59.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:59 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:59.133+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:55:59.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:59 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:59.133+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:55:59.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:59 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:59.133+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:55:59.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:55:59 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:55:59.133+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:32.734539+0000 front 2024-09-21T05:55:32.734578+0000 (oldest deadline 2024-09-21T05:55:58.634621+0000) 2024-09-21T05:55:59.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:59 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:59.519+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:55:59.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:59 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:59.519+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:55:59.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:55:59 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:55:59.519+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:55:59.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:59 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:59.750+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:55:59.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:59 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:59.750+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.136791+0000 front 2024-09-21T05:55:13.136825+0000 (oldest deadline 2024-09-21T05:55:38.437010+0000) 2024-09-21T05:55:59.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:59 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:59.750+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:21.338214+0000 front 2024-09-21T05:55:21.338317+0000 (oldest deadline 2024-09-21T05:55:44.838307+0000) 2024-09-21T05:55:59.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:55:59 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:55:59.750+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.139603+0000 front 2024-09-21T05:55:27.139546+0000 (oldest deadline 2024-09-21T05:55:50.639468+0000) 2024-09-21T05:56:00.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:00 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:00.149+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:56:00.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:00 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:00.149+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:56:00.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:00 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:00.149+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:56:00.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:00 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:00.149+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.548695+0000 front 2024-09-21T05:55:27.548624+0000 (oldest deadline 2024-09-21T05:55:51.648724+0000) 2024-09-21T05:56:00.554 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:56:00 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:56:00.141+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:09.500111+0000 front 2024-09-21T05:55:09.500163+0000 (oldest deadline 2024-09-21T05:55:36.500883+0000) 2024-09-21T05:56:00.554 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:56:00 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:56:00.141+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:20.602099+0000 front 2024-09-21T05:55:20.602024+0000 (oldest deadline 2024-09-21T05:55:47.602537+0000) 2024-09-21T05:56:00.555 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:56:00 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:56:00.141+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.603010+0000 front 2024-09-21T05:55:27.603119+0000 (oldest deadline 2024-09-21T05:55:52.303036+0000) 2024-09-21T05:56:00.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:00 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:00.169+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:56:00.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:00 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:00.169+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:56:00.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:00 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:00.169+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:56:00.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:00 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:00.169+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:56:00.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:00 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:00.169+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:32.734539+0000 front 2024-09-21T05:55:32.734578+0000 (oldest deadline 2024-09-21T05:55:58.634621+0000) 2024-09-21T05:56:00.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:00 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:00.553+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:00.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:00 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:00.553+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:00.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:00 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:00.553+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:00.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:00 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:00.788+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:56:00.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:00 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:00.788+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.136791+0000 front 2024-09-21T05:55:13.136825+0000 (oldest deadline 2024-09-21T05:55:38.437010+0000) 2024-09-21T05:56:00.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:00 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:00.788+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:21.338214+0000 front 2024-09-21T05:55:21.338317+0000 (oldest deadline 2024-09-21T05:55:44.838307+0000) 2024-09-21T05:56:00.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:00 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:00.788+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.139603+0000 front 2024-09-21T05:55:27.139546+0000 (oldest deadline 2024-09-21T05:55:50.639468+0000) 2024-09-21T05:56:01.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:01 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:01.174+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:56:01.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:01 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:01.174+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:56:01.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:01 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:01.174+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:56:01.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:01 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:01.174+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.548695+0000 front 2024-09-21T05:55:27.548624+0000 (oldest deadline 2024-09-21T05:55:51.648724+0000) 2024-09-21T05:56:01.554 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:56:01 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:56:01.192+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:09.500111+0000 front 2024-09-21T05:55:09.500163+0000 (oldest deadline 2024-09-21T05:55:36.500883+0000) 2024-09-21T05:56:01.554 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:56:01 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:56:01.192+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:20.602099+0000 front 2024-09-21T05:55:20.602024+0000 (oldest deadline 2024-09-21T05:55:47.602537+0000) 2024-09-21T05:56:01.554 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:56:01 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:56:01.192+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.603010+0000 front 2024-09-21T05:55:27.603119+0000 (oldest deadline 2024-09-21T05:55:52.303036+0000) 2024-09-21T05:56:01.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:01 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:01.160+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:56:01.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:01 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:01.160+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:56:01.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:01 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:01.160+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:56:01.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:01 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:01.160+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:56:01.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:01 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:01.160+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:32.734539+0000 front 2024-09-21T05:55:32.734578+0000 (oldest deadline 2024-09-21T05:55:58.634621+0000) 2024-09-21T05:56:01.898 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:01 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:01.832+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:56:01.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:01 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:01.832+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.136791+0000 front 2024-09-21T05:55:13.136825+0000 (oldest deadline 2024-09-21T05:55:38.437010+0000) 2024-09-21T05:56:01.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:01 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:01.832+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:21.338214+0000 front 2024-09-21T05:55:21.338317+0000 (oldest deadline 2024-09-21T05:55:44.838307+0000) 2024-09-21T05:56:01.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:01 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:01.832+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.139603+0000 front 2024-09-21T05:55:27.139546+0000 (oldest deadline 2024-09-21T05:55:50.639468+0000) 2024-09-21T05:56:01.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:01 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:01.583+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:01.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:01 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:01.583+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:01.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:01 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:01.583+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:01.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:01 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:01.583+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:37.775284+0000 front 2024-09-21T05:55:37.775204+0000 (oldest deadline 2024-09-21T05:56:00.575576+0000) 2024-09-21T05:56:02.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:02 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:02.179+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:56:02.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:02 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:02.179+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:56:02.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:02 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:02.179+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:56:02.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:02 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:02.179+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.548695+0000 front 2024-09-21T05:55:27.548624+0000 (oldest deadline 2024-09-21T05:55:51.648724+0000) 2024-09-21T05:56:02.554 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:56:02 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:56:02.201+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:09.500111+0000 front 2024-09-21T05:55:09.500163+0000 (oldest deadline 2024-09-21T05:55:36.500883+0000) 2024-09-21T05:56:02.554 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:56:02 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:56:02.201+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:20.602099+0000 front 2024-09-21T05:55:20.602024+0000 (oldest deadline 2024-09-21T05:55:47.602537+0000) 2024-09-21T05:56:02.554 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:56:02 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:56:02.201+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.603010+0000 front 2024-09-21T05:55:27.603119+0000 (oldest deadline 2024-09-21T05:55:52.303036+0000) 2024-09-21T05:56:02.554 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:56:02 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7[50692]: 2024-09-21T05:56:02.201+0000 7fdd9b357640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:38.004779+0000 front 2024-09-21T05:55:38.004730+0000 (oldest deadline 2024-09-21T05:56:02.104837+0000) 2024-09-21T05:56:02.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:02 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:02.155+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:56:02.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:02 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:02.155+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:56:02.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:02 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:02.155+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:56:02.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:02 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:02.155+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:56:02.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:02 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:02.155+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:32.734539+0000 front 2024-09-21T05:55:32.734578+0000 (oldest deadline 2024-09-21T05:55:58.634621+0000) 2024-09-21T05:56:02.898 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:02 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:02.793+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:56:02.898 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:02 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:02.793+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.136791+0000 front 2024-09-21T05:55:13.136825+0000 (oldest deadline 2024-09-21T05:55:38.437010+0000) 2024-09-21T05:56:02.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:02 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:02.793+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:21.338214+0000 front 2024-09-21T05:55:21.338317+0000 (oldest deadline 2024-09-21T05:55:44.838307+0000) 2024-09-21T05:56:02.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:02 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:02.794+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.139603+0000 front 2024-09-21T05:55:27.139546+0000 (oldest deadline 2024-09-21T05:55:50.639468+0000) 2024-09-21T05:56:02.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:02 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:02.621+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:02.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:02 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:02.621+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:02.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:02 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:02.621+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:02.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:02 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:02.621+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:37.775284+0000 front 2024-09-21T05:55:37.775204+0000 (oldest deadline 2024-09-21T05:56:00.575576+0000) 2024-09-21T05:56:03.027 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:56:02 smithi116 podman[65612]: 2024-09-21 05:56:02.74091106 +0000 UTC m=+5.637761749 container died 6c3c7c23db8fb16b9d07269441d908729d0a4373b53263d498a4df65ff785de3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2) 2024-09-21T05:56:03.304 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:56:03 smithi116 podman[65612]: 2024-09-21 05:56:03.125038221 +0000 UTC m=+6.021888910 container cleanup 6c3c7c23db8fb16b9d07269441d908729d0a4373b53263d498a4df65ff785de3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-21T05:56:03.304 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:56:03 smithi116 bash[65612]: ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7 2024-09-21T05:56:03.305 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:03 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:03.188+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:56:03.305 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:03 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:03.188+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:56:03.305 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:03 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:03.188+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:56:03.305 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:03 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:03.188+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:56:03.305 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:03 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:03.188+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:32.734539+0000 front 2024-09-21T05:55:32.734578+0000 (oldest deadline 2024-09-21T05:55:58.634621+0000) 2024-09-21T05:56:03.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:03 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:03.173+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:56:03.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:03 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:03.173+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:56:03.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:03 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:03.173+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:56:03.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:03 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:03.173+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.548695+0000 front 2024-09-21T05:55:27.548624+0000 (oldest deadline 2024-09-21T05:55:51.648724+0000) 2024-09-21T05:56:03.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:03 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:03.173+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:36.949736+0000 front 2024-09-21T05:55:36.949852+0000 (oldest deadline 2024-09-21T05:56:02.849500+0000) 2024-09-21T05:56:03.741 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:56:03 smithi116 podman[65639]: 2024-09-21 05:56:03.393090333 +0000 UTC m=+0.653059660 container remove 6c3c7c23db8fb16b9d07269441d908729d0a4373b53263d498a4df65ff785de3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T05:56:03.898 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:03 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:03.811+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:56:03.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:03 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:03.811+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.136791+0000 front 2024-09-21T05:55:13.136825+0000 (oldest deadline 2024-09-21T05:55:38.437010+0000) 2024-09-21T05:56:03.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:03 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:03.811+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:21.338214+0000 front 2024-09-21T05:55:21.338317+0000 (oldest deadline 2024-09-21T05:55:44.838307+0000) 2024-09-21T05:56:03.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:03 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:03.811+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.139603+0000 front 2024-09-21T05:55:27.139546+0000 (oldest deadline 2024-09-21T05:55:50.639468+0000) 2024-09-21T05:56:03.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:03 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:03.603+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:03.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:03 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:03.603+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:03.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:03 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:03.603+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:03.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:03 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:03.603+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:37.775284+0000 front 2024-09-21T05:55:37.775204+0000 (oldest deadline 2024-09-21T05:56:00.575576+0000) 2024-09-21T05:56:03.997 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:56:03 smithi116 podman[65729]: 2024-09-21 05:56:03.642842187 +0000 UTC m=+0.015560793 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:56:03.997 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:56:03 smithi116 podman[65729]: 2024-09-21 05:56:03.752227991 +0000 UTC m=+0.124946589 container create 95739ce6b73fa56fe7128504cc698038577be2c941c39b6cf7880b0861a98748 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-21T05:56:03.997 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:56:03 smithi116 podman[65729]: 2024-09-21 05:56:03.996437656 +0000 UTC m=+0.369156264 container init 95739ce6b73fa56fe7128504cc698038577be2c941c39b6cf7880b0861a98748 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T05:56:04.305 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:56:03 smithi116 podman[65729]: 2024-09-21 05:56:03.999859896 +0000 UTC m=+0.372578496 container start 95739ce6b73fa56fe7128504cc698038577be2c941c39b6cf7880b0861a98748 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-21T05:56:04.305 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:56:04 smithi116 podman[65729]: 2024-09-21 05:56:04.071423858 +0000 UTC m=+0.444142471 container attach 95739ce6b73fa56fe7128504cc698038577be2c941c39b6cf7880b0861a98748 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T05:56:04.305 INFO:journalctl@ceph.osd.7.smithi116.stdout:Sep 21 05:56:04 smithi116 podman[65729]: 2024-09-21 05:56:04.186699687 +0000 UTC m=+0.559418297 container died 95739ce6b73fa56fe7128504cc698038577be2c941c39b6cf7880b0861a98748 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-21T05:56:04.305 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:04 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:04.152+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:56:04.305 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:04 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:04.152+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:56:04.305 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:04 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:04.152+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:56:04.305 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:04 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:04.152+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:56:04.305 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:04 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:04.152+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:32.734539+0000 front 2024-09-21T05:55:32.734578+0000 (oldest deadline 2024-09-21T05:55:58.634621+0000) 2024-09-21T05:56:04.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:04 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:04.144+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:56:04.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:04 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:04.144+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:56:04.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:04 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:04.144+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:56:04.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:04 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:04.144+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.548695+0000 front 2024-09-21T05:55:27.548624+0000 (oldest deadline 2024-09-21T05:55:51.648724+0000) 2024-09-21T05:56:04.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:04 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:04.144+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:36.949736+0000 front 2024-09-21T05:55:36.949852+0000 (oldest deadline 2024-09-21T05:56:02.849500+0000) 2024-09-21T05:56:04.777 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.7.service' 2024-09-21T05:56:04.816 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:56:04.816 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-21T05:56:04.816 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-21T05:56:04.816 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.8 2024-09-21T05:56:04.846 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:04 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:04.589+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:04.846 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:04 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:04.589+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:04.846 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:04 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:04.589+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:04.846 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:04 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:04.589+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:37.775284+0000 front 2024-09-21T05:55:37.775204+0000 (oldest deadline 2024-09-21T05:56:00.575576+0000) 2024-09-21T05:56:05.133 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:04 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:04.845+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:56:05.133 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:04 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:04.845+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.136791+0000 front 2024-09-21T05:55:13.136825+0000 (oldest deadline 2024-09-21T05:55:38.437010+0000) 2024-09-21T05:56:05.133 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:04 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:04.845+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:21.338214+0000 front 2024-09-21T05:55:21.338317+0000 (oldest deadline 2024-09-21T05:55:44.838307+0000) 2024-09-21T05:56:05.133 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:04 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:04.845+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.139603+0000 front 2024-09-21T05:55:27.139546+0000 (oldest deadline 2024-09-21T05:55:50.639468+0000) 2024-09-21T05:56:05.133 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:04 smithi160 systemd[1]: Stopping Ceph osd.8 for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:56:05.133 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:05 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:05.129+0000 7f553b33d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T05:56:05.133 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:05 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:05.129+0000 7f553b33d640 -1 osd.8 89 *** Got signal Terminated *** 2024-09-21T05:56:05.133 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:05 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:05.129+0000 7f553b33d640 -1 osd.8 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T05:56:05.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:05 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:05.164+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:56:05.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:05 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:05.164+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:56:05.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:05 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:05.164+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:56:05.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:05 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:05.164+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.548695+0000 front 2024-09-21T05:55:27.548624+0000 (oldest deadline 2024-09-21T05:55:51.648724+0000) 2024-09-21T05:56:05.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:05 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:05.164+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:36.949736+0000 front 2024-09-21T05:55:36.949852+0000 (oldest deadline 2024-09-21T05:56:02.849500+0000) 2024-09-21T05:56:05.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:05 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:05.142+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:56:05.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:05 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:05.142+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:56:05.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:05 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:05.142+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:56:05.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:05 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:05.142+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:56:05.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:05 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:05.142+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:32.734539+0000 front 2024-09-21T05:55:32.734578+0000 (oldest deadline 2024-09-21T05:55:58.634621+0000) 2024-09-21T05:56:05.818 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:05 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:05.556+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:05.819 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:05 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:05.556+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:05.819 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:05 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:05.556+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:05.819 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:05 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:05.556+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:37.775284+0000 front 2024-09-21T05:55:37.775204+0000 (oldest deadline 2024-09-21T05:56:00.575576+0000) 2024-09-21T05:56:06.148 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:05 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:05.815+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:56:06.148 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:05 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:05.815+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.136791+0000 front 2024-09-21T05:55:13.136825+0000 (oldest deadline 2024-09-21T05:55:38.437010+0000) 2024-09-21T05:56:06.148 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:05 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:05.815+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:21.338214+0000 front 2024-09-21T05:55:21.338317+0000 (oldest deadline 2024-09-21T05:55:44.838307+0000) 2024-09-21T05:56:06.148 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:05 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:05.815+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.139603+0000 front 2024-09-21T05:55:27.139546+0000 (oldest deadline 2024-09-21T05:55:50.639468+0000) 2024-09-21T05:56:06.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:06 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:06.164+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:56:06.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:06 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:06.164+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:56:06.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:06 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:06.164+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:56:06.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:06 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:06.164+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.548695+0000 front 2024-09-21T05:55:27.548624+0000 (oldest deadline 2024-09-21T05:55:51.648724+0000) 2024-09-21T05:56:06.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:06 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:06.164+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:36.949736+0000 front 2024-09-21T05:55:36.949852+0000 (oldest deadline 2024-09-21T05:56:02.849500+0000) 2024-09-21T05:56:06.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:06 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:06.192+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:56:06.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:06 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:06.192+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:56:06.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:06 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:06.192+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:56:06.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:06 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:06.192+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:56:06.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:06 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:06.192+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:32.734539+0000 front 2024-09-21T05:55:32.734578+0000 (oldest deadline 2024-09-21T05:55:58.634621+0000) 2024-09-21T05:56:06.898 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:06 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:06.771+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:56:06.898 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:06 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:06.771+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.136791+0000 front 2024-09-21T05:55:13.136825+0000 (oldest deadline 2024-09-21T05:55:38.437010+0000) 2024-09-21T05:56:06.898 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:06 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:06.771+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:21.338214+0000 front 2024-09-21T05:55:21.338317+0000 (oldest deadline 2024-09-21T05:55:44.838307+0000) 2024-09-21T05:56:06.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:06 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:06.771+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.139603+0000 front 2024-09-21T05:55:27.139546+0000 (oldest deadline 2024-09-21T05:55:50.639468+0000) 2024-09-21T05:56:06.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:06 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:06.594+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:06.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:06 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:06.594+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:06.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:06 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:06.594+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:06.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:06 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:06.594+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:37.775284+0000 front 2024-09-21T05:55:37.775204+0000 (oldest deadline 2024-09-21T05:56:00.575576+0000) 2024-09-21T05:56:07.169 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:07 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:07.167+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:56:07.170 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:07 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:07.167+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:56:07.170 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:07 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:07.167+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:56:07.170 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:07 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:07.167+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:56:07.170 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:07 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:07.167+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:32.734539+0000 front 2024-09-21T05:55:32.734578+0000 (oldest deadline 2024-09-21T05:55:58.634621+0000) 2024-09-21T05:56:07.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:07 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:07.148+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:56:07.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:07 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:07.148+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:56:07.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:07 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:07.148+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:56:07.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:07 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:07.148+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.548695+0000 front 2024-09-21T05:55:27.548624+0000 (oldest deadline 2024-09-21T05:55:51.648724+0000) 2024-09-21T05:56:07.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:07 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:07.148+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:36.949736+0000 front 2024-09-21T05:55:36.949852+0000 (oldest deadline 2024-09-21T05:56:02.849500+0000) 2024-09-21T05:56:07.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:07 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:07.577+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:07.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:07 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:07.577+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:07.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:07 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:07.577+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:07.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:07 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:07.577+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:37.775284+0000 front 2024-09-21T05:55:37.775204+0000 (oldest deadline 2024-09-21T05:56:00.575576+0000) 2024-09-21T05:56:07.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:07 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:07.771+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:56:07.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:07 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:07.771+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.136791+0000 front 2024-09-21T05:55:13.136825+0000 (oldest deadline 2024-09-21T05:55:38.437010+0000) 2024-09-21T05:56:07.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:07 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:07.771+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:21.338214+0000 front 2024-09-21T05:55:21.338317+0000 (oldest deadline 2024-09-21T05:55:44.838307+0000) 2024-09-21T05:56:07.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:07 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:07.771+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.139603+0000 front 2024-09-21T05:55:27.139546+0000 (oldest deadline 2024-09-21T05:55:50.639468+0000) 2024-09-21T05:56:07.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:07 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:07.771+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:45.842202+0000 front 2024-09-21T05:55:45.842171+0000 (oldest deadline 2024-09-21T05:56:07.542291+0000) 2024-09-21T05:56:08.493 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:08 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:08.210+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:56:08.493 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:08 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:08.210+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:56:08.493 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:08 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:08.210+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:56:08.494 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:08 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:08.210+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:56:08.494 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:08 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:08.210+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:32.734539+0000 front 2024-09-21T05:55:32.734578+0000 (oldest deadline 2024-09-21T05:55:58.634621+0000) 2024-09-21T05:56:08.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:08 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:08.140+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:56:08.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:08 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:08.140+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:56:08.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:08 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:08.140+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:56:08.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:08 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:08.140+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.548695+0000 front 2024-09-21T05:55:27.548624+0000 (oldest deadline 2024-09-21T05:55:51.648724+0000) 2024-09-21T05:56:08.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:08 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:08.140+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:36.949736+0000 front 2024-09-21T05:55:36.949852+0000 (oldest deadline 2024-09-21T05:56:02.849500+0000) 2024-09-21T05:56:08.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:08 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:08.612+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:08.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:08 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:08.612+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:08.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:08 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:08.612+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:08.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:08 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:08.612+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:37.775284+0000 front 2024-09-21T05:55:37.775204+0000 (oldest deadline 2024-09-21T05:56:00.575576+0000) 2024-09-21T05:56:08.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:08 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:08.737+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:56:08.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:08 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:08.737+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.136791+0000 front 2024-09-21T05:55:13.136825+0000 (oldest deadline 2024-09-21T05:55:38.437010+0000) 2024-09-21T05:56:08.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:08 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:08.737+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:21.338214+0000 front 2024-09-21T05:55:21.338317+0000 (oldest deadline 2024-09-21T05:55:44.838307+0000) 2024-09-21T05:56:08.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:08 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:08.737+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.139603+0000 front 2024-09-21T05:55:27.139546+0000 (oldest deadline 2024-09-21T05:55:50.639468+0000) 2024-09-21T05:56:08.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:08 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:08.737+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:45.842202+0000 front 2024-09-21T05:55:45.842171+0000 (oldest deadline 2024-09-21T05:56:07.542291+0000) 2024-09-21T05:56:09.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:09 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:09.096+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:56:09.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:09 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:09.096+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:56:09.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:09 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:09.096+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:56:09.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:09 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:09.096+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.548695+0000 front 2024-09-21T05:55:27.548624+0000 (oldest deadline 2024-09-21T05:55:51.648724+0000) 2024-09-21T05:56:09.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:09 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:09.096+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:36.949736+0000 front 2024-09-21T05:55:36.949852+0000 (oldest deadline 2024-09-21T05:56:02.849500+0000) 2024-09-21T05:56:09.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:09 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:09.240+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:56:09.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:09 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:09.240+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:56:09.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:09 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:09.240+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:56:09.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:09 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:09.240+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:56:09.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:09 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:09.240+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:32.734539+0000 front 2024-09-21T05:55:32.734578+0000 (oldest deadline 2024-09-21T05:55:58.634621+0000) 2024-09-21T05:56:09.898 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:09 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:09.741+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.435229+0000 front 2024-09-21T05:55:04.435099+0000 (oldest deadline 2024-09-21T05:55:26.735028+0000) 2024-09-21T05:56:09.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:09 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:09.741+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.136791+0000 front 2024-09-21T05:55:13.136825+0000 (oldest deadline 2024-09-21T05:55:38.437010+0000) 2024-09-21T05:56:09.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:09 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:09.741+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:21.338214+0000 front 2024-09-21T05:55:21.338317+0000 (oldest deadline 2024-09-21T05:55:44.838307+0000) 2024-09-21T05:56:09.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:09 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:09.741+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.139603+0000 front 2024-09-21T05:55:27.139546+0000 (oldest deadline 2024-09-21T05:55:50.639468+0000) 2024-09-21T05:56:09.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:09 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8[51077]: 2024-09-21T05:56:09.741+0000 7f5533920640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:45.842202+0000 front 2024-09-21T05:55:45.842171+0000 (oldest deadline 2024-09-21T05:56:07.542291+0000) 2024-09-21T05:56:09.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:09 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:09.584+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:09.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:09 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:09.584+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:09.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:09 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:09.584+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:09.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:09 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:09.584+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:37.775284+0000 front 2024-09-21T05:55:37.775204+0000 (oldest deadline 2024-09-21T05:56:00.575576+0000) 2024-09-21T05:56:09.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:09 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:09.584+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:45.276532+0000 front 2024-09-21T05:55:45.276639+0000 (oldest deadline 2024-09-21T05:56:09.376796+0000) 2024-09-21T05:56:10.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:10 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:10.092+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:56:10.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:10 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:10.092+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:56:10.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:10 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:10.092+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:56:10.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:10 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:10.092+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.548695+0000 front 2024-09-21T05:55:27.548624+0000 (oldest deadline 2024-09-21T05:55:51.648724+0000) 2024-09-21T05:56:10.496 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:10 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:10.092+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:36.949736+0000 front 2024-09-21T05:55:36.949852+0000 (oldest deadline 2024-09-21T05:56:02.849500+0000) 2024-09-21T05:56:10.496 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:10 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:10.092+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:42.850054+0000 front 2024-09-21T05:55:42.850127+0000 (oldest deadline 2024-09-21T05:56:09.250373+0000) 2024-09-21T05:56:10.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:10 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:10.290+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:56:10.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:10 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:10.290+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:56:10.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:10 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:10.290+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:56:10.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:10 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:10.290+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:56:10.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:10 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:10.290+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:32.734539+0000 front 2024-09-21T05:55:32.734578+0000 (oldest deadline 2024-09-21T05:55:58.634621+0000) 2024-09-21T05:56:10.898 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:10 smithi160 podman[65950]: 2024-09-21 05:56:10.662530419 +0000 UTC m=+5.652911205 container died a95f94c4a016a3984b10864e11dd3a4cd04f242d065a5ad74c91afa04e59e8a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T05:56:10.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:10 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:10.566+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:10.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:10 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:10.566+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:10.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:10 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:10.566+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:10.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:10 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:10.566+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:37.775284+0000 front 2024-09-21T05:55:37.775204+0000 (oldest deadline 2024-09-21T05:56:00.575576+0000) 2024-09-21T05:56:10.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:10 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:10.566+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:45.276532+0000 front 2024-09-21T05:55:45.276639+0000 (oldest deadline 2024-09-21T05:56:09.376796+0000) 2024-09-21T05:56:11.308 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:11 smithi160 podman[65950]: 2024-09-21 05:56:11.005665287 +0000 UTC m=+5.996046068 container cleanup a95f94c4a016a3984b10864e11dd3a4cd04f242d065a5ad74c91afa04e59e8a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T05:56:11.308 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:11 smithi160 bash[65950]: ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8 2024-09-21T05:56:11.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:11 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:11.069+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:56:11.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:11 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:11.069+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:56:11.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:11 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:11.069+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:56:11.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:11 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:11.069+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.548695+0000 front 2024-09-21T05:55:27.548624+0000 (oldest deadline 2024-09-21T05:55:51.648724+0000) 2024-09-21T05:56:11.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:11 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:11.069+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:36.949736+0000 front 2024-09-21T05:55:36.949852+0000 (oldest deadline 2024-09-21T05:56:02.849500+0000) 2024-09-21T05:56:11.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:11 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:11.069+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:42.850054+0000 front 2024-09-21T05:55:42.850127+0000 (oldest deadline 2024-09-21T05:56:09.250373+0000) 2024-09-21T05:56:11.634 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:11 smithi160 podman[65964]: 2024-09-21 05:56:11.306753945 +0000 UTC m=+0.645217298 container remove a95f94c4a016a3984b10864e11dd3a4cd04f242d065a5ad74c91afa04e59e8a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True) 2024-09-21T05:56:11.634 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:11 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:11.555+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:11.634 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:11 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:11.555+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:11.634 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:11 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:11.555+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:11.634 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:11 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:11.555+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:37.775284+0000 front 2024-09-21T05:55:37.775204+0000 (oldest deadline 2024-09-21T05:56:00.575576+0000) 2024-09-21T05:56:11.634 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:11 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:11.555+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:45.276532+0000 front 2024-09-21T05:55:45.276639+0000 (oldest deadline 2024-09-21T05:56:09.376796+0000) 2024-09-21T05:56:11.804 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:11 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:11.309+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:56:11.804 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:11 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:11.309+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:56:11.804 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:11 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:11.309+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:56:11.805 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:11 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:11.309+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:56:11.805 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:11 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:11.309+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:32.734539+0000 front 2024-09-21T05:55:32.734578+0000 (oldest deadline 2024-09-21T05:55:58.634621+0000) 2024-09-21T05:56:11.898 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:11 smithi160 podman[66057]: 2024-09-21 05:56:11.535614362 +0000 UTC m=+0.015873081 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:56:11.899 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:11 smithi160 podman[66057]: 2024-09-21 05:56:11.666032451 +0000 UTC m=+0.146291167 container create 3eec0aec78906001607c3afd077b0ae34fcb8b316c43c62475c4b1a366649c38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-21T05:56:12.393 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:11 smithi160 podman[66057]: 2024-09-21 05:56:11.930679628 +0000 UTC m=+0.410938342 container init 3eec0aec78906001607c3afd077b0ae34fcb8b316c43c62475c4b1a366649c38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T05:56:12.394 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:11 smithi160 podman[66057]: 2024-09-21 05:56:11.933988052 +0000 UTC m=+0.414246767 container start 3eec0aec78906001607c3afd077b0ae34fcb8b316c43c62475c4b1a366649c38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T05:56:12.394 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:12 smithi160 podman[66057]: 2024-09-21 05:56:12.043581264 +0000 UTC m=+0.523839987 container attach 3eec0aec78906001607c3afd077b0ae34fcb8b316c43c62475c4b1a366649c38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T05:56:12.394 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 05:56:12 smithi160 podman[66057]: 2024-09-21 05:56:12.122332193 +0000 UTC m=+0.602590917 container died 3eec0aec78906001607c3afd077b0ae34fcb8b316c43c62475c4b1a366649c38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-8-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T05:56:12.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:12 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:12.033+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:56:12.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:12 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:12.033+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:56:12.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:12 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:12.033+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:56:12.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:12 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:12.033+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.548695+0000 front 2024-09-21T05:55:27.548624+0000 (oldest deadline 2024-09-21T05:55:51.648724+0000) 2024-09-21T05:56:12.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:12 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:12.033+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:36.949736+0000 front 2024-09-21T05:55:36.949852+0000 (oldest deadline 2024-09-21T05:56:02.849500+0000) 2024-09-21T05:56:12.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:12 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:12.033+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:42.850054+0000 front 2024-09-21T05:55:42.850127+0000 (oldest deadline 2024-09-21T05:56:09.250373+0000) 2024-09-21T05:56:12.648 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:12 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:12.568+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:12.648 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:12 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:12.568+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:12.648 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:12 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:12.568+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:12.648 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:12 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:12.568+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:37.775284+0000 front 2024-09-21T05:55:37.775204+0000 (oldest deadline 2024-09-21T05:56:00.575576+0000) 2024-09-21T05:56:12.648 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:12 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:12.568+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:45.276532+0000 front 2024-09-21T05:55:45.276639+0000 (oldest deadline 2024-09-21T05:56:09.376796+0000) 2024-09-21T05:56:12.745 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.8.service' 2024-09-21T05:56:12.804 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:12 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:12.331+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:56:12.804 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:12 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:12.331+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:56:12.804 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:12 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:12.331+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:56:12.804 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:12 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:12.331+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:56:12.804 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:12 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:12.331+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:32.734539+0000 front 2024-09-21T05:55:32.734578+0000 (oldest deadline 2024-09-21T05:55:58.634621+0000) 2024-09-21T05:56:12.805 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:12 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:12.331+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:42.735733+0000 front 2024-09-21T05:55:42.735624+0000 (oldest deadline 2024-09-21T05:56:12.135918+0000) 2024-09-21T05:56:12.823 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:56:12.823 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-21T05:56:12.824 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-21T05:56:12.824 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.9 2024-09-21T05:56:13.120 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:12 smithi070 systemd[1]: Stopping Ceph osd.9 for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:56:13.120 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:13 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:13.032+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:56:13.120 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:13 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:13.032+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:56:13.120 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:13 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:13.032+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:56:13.121 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:13 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:13.032+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.548695+0000 front 2024-09-21T05:55:27.548624+0000 (oldest deadline 2024-09-21T05:55:51.648724+0000) 2024-09-21T05:56:13.121 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:13 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:13.032+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:36.949736+0000 front 2024-09-21T05:55:36.949852+0000 (oldest deadline 2024-09-21T05:56:02.849500+0000) 2024-09-21T05:56:13.121 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:13 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:13.032+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:42.850054+0000 front 2024-09-21T05:55:42.850127+0000 (oldest deadline 2024-09-21T05:56:09.250373+0000) 2024-09-21T05:56:13.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:13 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:13.118+0000 7f0c73392640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T05:56:13.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:13 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:13.118+0000 7f0c73392640 -1 osd.9 89 *** Got signal Terminated *** 2024-09-21T05:56:13.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:13 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:13.118+0000 7f0c73392640 -1 osd.9 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T05:56:13.648 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:13 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:13.530+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:13.648 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:13 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:13.530+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:13.648 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:13 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:13.530+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:13.648 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:13 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:13.530+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:37.775284+0000 front 2024-09-21T05:55:37.775204+0000 (oldest deadline 2024-09-21T05:56:00.575576+0000) 2024-09-21T05:56:13.649 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:13 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:13.530+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:45.276532+0000 front 2024-09-21T05:55:45.276639+0000 (oldest deadline 2024-09-21T05:56:09.376796+0000) 2024-09-21T05:56:13.804 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:13 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:13.307+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:56:13.804 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:13 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:13.307+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:56:13.804 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:13 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:13.307+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:56:13.804 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:13 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:13.307+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:56:13.804 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:13 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:13.307+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:32.734539+0000 front 2024-09-21T05:55:32.734578+0000 (oldest deadline 2024-09-21T05:55:58.634621+0000) 2024-09-21T05:56:13.805 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:13 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:13.307+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:42.735733+0000 front 2024-09-21T05:55:42.735624+0000 (oldest deadline 2024-09-21T05:56:12.135918+0000) 2024-09-21T05:56:14.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:14 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:14.063+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:56:14.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:14 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:14.063+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:56:14.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:14 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:14.063+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:56:14.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:14 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:14.063+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.548695+0000 front 2024-09-21T05:55:27.548624+0000 (oldest deadline 2024-09-21T05:55:51.648724+0000) 2024-09-21T05:56:14.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:14 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:14.063+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:36.949736+0000 front 2024-09-21T05:55:36.949852+0000 (oldest deadline 2024-09-21T05:56:02.849500+0000) 2024-09-21T05:56:14.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:14 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:14.063+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:42.850054+0000 front 2024-09-21T05:55:42.850127+0000 (oldest deadline 2024-09-21T05:56:09.250373+0000) 2024-09-21T05:56:14.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:14 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:14.285+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:56:14.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:14 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:14.285+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:56:14.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:14 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:14.285+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:56:14.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:14 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:14.285+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:56:14.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:14 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:14.285+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:32.734539+0000 front 2024-09-21T05:55:32.734578+0000 (oldest deadline 2024-09-21T05:55:58.634621+0000) 2024-09-21T05:56:14.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:14 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:14.285+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:42.735733+0000 front 2024-09-21T05:55:42.735624+0000 (oldest deadline 2024-09-21T05:56:12.135918+0000) 2024-09-21T05:56:14.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:14 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:14.491+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:14.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:14 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:14.491+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:14.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:14 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:14.491+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:14.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:14 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:14.491+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:37.775284+0000 front 2024-09-21T05:55:37.775204+0000 (oldest deadline 2024-09-21T05:56:00.575576+0000) 2024-09-21T05:56:14.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:14 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:14.491+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:45.276532+0000 front 2024-09-21T05:55:45.276639+0000 (oldest deadline 2024-09-21T05:56:09.376796+0000) 2024-09-21T05:56:15.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:15 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:15.092+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:56:15.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:15 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:15.092+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:56:15.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:15 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:15.092+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:56:15.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:15 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:15.092+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.548695+0000 front 2024-09-21T05:55:27.548624+0000 (oldest deadline 2024-09-21T05:55:51.648724+0000) 2024-09-21T05:56:15.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:15 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:15.092+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:36.949736+0000 front 2024-09-21T05:55:36.949852+0000 (oldest deadline 2024-09-21T05:56:02.849500+0000) 2024-09-21T05:56:15.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:15 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:15.092+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:42.850054+0000 front 2024-09-21T05:55:42.850127+0000 (oldest deadline 2024-09-21T05:56:09.250373+0000) 2024-09-21T05:56:15.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:15 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:15.262+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:56:15.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:15 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:15.262+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:56:15.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:15 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:15.262+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:56:15.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:15 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:15.262+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:56:15.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:15 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:15.262+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:32.734539+0000 front 2024-09-21T05:55:32.734578+0000 (oldest deadline 2024-09-21T05:55:58.634621+0000) 2024-09-21T05:56:15.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:15 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:15.262+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:42.735733+0000 front 2024-09-21T05:55:42.735624+0000 (oldest deadline 2024-09-21T05:56:12.135918+0000) 2024-09-21T05:56:15.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:15 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:15.532+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:15.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:15 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:15.532+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:15.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:15 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:15.532+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:15.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:15 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:15.532+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:37.775284+0000 front 2024-09-21T05:55:37.775204+0000 (oldest deadline 2024-09-21T05:56:00.575576+0000) 2024-09-21T05:56:15.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:15 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:15.532+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:45.276532+0000 front 2024-09-21T05:55:45.276639+0000 (oldest deadline 2024-09-21T05:56:09.376796+0000) 2024-09-21T05:56:15.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:15 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:15.532+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-21T05:55:49.377401+0000 front 2024-09-21T05:55:49.377499+0000 (oldest deadline 2024-09-21T05:56:15.277359+0000) 2024-09-21T05:56:16.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:16 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:16.062+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:56:16.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:16 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:16.062+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:56:16.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:16 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:16.062+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:56:16.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:16 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:16.062+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.548695+0000 front 2024-09-21T05:55:27.548624+0000 (oldest deadline 2024-09-21T05:55:51.648724+0000) 2024-09-21T05:56:16.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:16 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:16.062+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:36.949736+0000 front 2024-09-21T05:55:36.949852+0000 (oldest deadline 2024-09-21T05:56:02.849500+0000) 2024-09-21T05:56:16.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:16 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:16.062+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:42.850054+0000 front 2024-09-21T05:55:42.850127+0000 (oldest deadline 2024-09-21T05:56:09.250373+0000) 2024-09-21T05:56:16.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:16 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:16.242+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:56:16.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:16 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:16.242+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:56:16.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:16 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:16.242+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:56:16.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:16 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:16.242+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:56:16.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:16 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:16.242+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:32.734539+0000 front 2024-09-21T05:55:32.734578+0000 (oldest deadline 2024-09-21T05:55:58.634621+0000) 2024-09-21T05:56:16.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:16 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:16.242+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:42.735733+0000 front 2024-09-21T05:55:42.735624+0000 (oldest deadline 2024-09-21T05:56:12.135918+0000) 2024-09-21T05:56:16.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:16 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:16.524+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:16.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:16 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:16.524+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:16.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:16 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:16.524+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:16.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:16 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:16.524+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:37.775284+0000 front 2024-09-21T05:55:37.775204+0000 (oldest deadline 2024-09-21T05:56:00.575576+0000) 2024-09-21T05:56:16.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:16 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:16.524+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:45.276532+0000 front 2024-09-21T05:55:45.276639+0000 (oldest deadline 2024-09-21T05:56:09.376796+0000) 2024-09-21T05:56:16.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:16 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:16.524+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-21T05:55:49.377401+0000 front 2024-09-21T05:55:49.377499+0000 (oldest deadline 2024-09-21T05:56:15.277359+0000) 2024-09-21T05:56:17.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:17 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:17.087+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:56:17.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:17 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:17.087+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:56:17.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:17 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:17.087+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:56:17.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:17 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:17.087+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.548695+0000 front 2024-09-21T05:55:27.548624+0000 (oldest deadline 2024-09-21T05:55:51.648724+0000) 2024-09-21T05:56:17.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:17 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:17.087+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:36.949736+0000 front 2024-09-21T05:55:36.949852+0000 (oldest deadline 2024-09-21T05:56:02.849500+0000) 2024-09-21T05:56:17.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:17 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:17.087+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:42.850054+0000 front 2024-09-21T05:55:42.850127+0000 (oldest deadline 2024-09-21T05:56:09.250373+0000) 2024-09-21T05:56:17.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:17 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:17.247+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:56:17.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:17 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:17.247+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:56:17.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:17 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:17.247+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:56:17.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:17 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:17.247+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:56:17.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:17 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:17.247+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:32.734539+0000 front 2024-09-21T05:55:32.734578+0000 (oldest deadline 2024-09-21T05:55:58.634621+0000) 2024-09-21T05:56:17.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:17 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:17.247+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:42.735733+0000 front 2024-09-21T05:55:42.735624+0000 (oldest deadline 2024-09-21T05:56:12.135918+0000) 2024-09-21T05:56:17.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:17 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:17.564+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:17.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:17 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:17.564+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:17.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:17 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:17.564+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:17.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:17 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:17.564+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:37.775284+0000 front 2024-09-21T05:55:37.775204+0000 (oldest deadline 2024-09-21T05:56:00.575576+0000) 2024-09-21T05:56:17.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:17 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:17.564+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:45.276532+0000 front 2024-09-21T05:55:45.276639+0000 (oldest deadline 2024-09-21T05:56:09.376796+0000) 2024-09-21T05:56:17.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:17 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:17.564+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-21T05:55:49.377401+0000 front 2024-09-21T05:55:49.377499+0000 (oldest deadline 2024-09-21T05:56:15.277359+0000) 2024-09-21T05:56:18.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:18 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:18.117+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.944885+0000 front 2024-09-21T05:55:04.944866+0000 (oldest deadline 2024-09-21T05:55:27.845008+0000) 2024-09-21T05:56:18.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:18 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:18.117+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:13.046292+0000 front 2024-09-21T05:55:13.046213+0000 (oldest deadline 2024-09-21T05:55:34.746261+0000) 2024-09-21T05:56:18.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:18 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:18.117+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.847321+0000 front 2024-09-21T05:55:18.847253+0000 (oldest deadline 2024-09-21T05:55:44.147212+0000) 2024-09-21T05:56:18.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:18 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:18.117+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:27.548695+0000 front 2024-09-21T05:55:27.548624+0000 (oldest deadline 2024-09-21T05:55:51.648724+0000) 2024-09-21T05:56:18.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:18 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:18.117+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:36.949736+0000 front 2024-09-21T05:55:36.949852+0000 (oldest deadline 2024-09-21T05:56:02.849500+0000) 2024-09-21T05:56:18.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:18 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9[65869]: 2024-09-21T05:56:18.117+0000 7f0c6f97d640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:42.850054+0000 front 2024-09-21T05:55:42.850127+0000 (oldest deadline 2024-09-21T05:56:09.250373+0000) 2024-09-21T05:56:18.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:18 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:18.280+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:56:18.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:18 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:18.280+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:56:18.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:18 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:18.280+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:56:18.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:18 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:18.280+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:56:18.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:18 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:18.280+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:32.734539+0000 front 2024-09-21T05:55:32.734578+0000 (oldest deadline 2024-09-21T05:55:58.634621+0000) 2024-09-21T05:56:18.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:18 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:18.280+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:42.735733+0000 front 2024-09-21T05:55:42.735624+0000 (oldest deadline 2024-09-21T05:56:12.135918+0000) 2024-09-21T05:56:18.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:18 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:18.280+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-21T05:55:52.136565+0000 front 2024-09-21T05:55:52.136498+0000 (oldest deadline 2024-09-21T05:56:18.036301+0000) 2024-09-21T05:56:18.804 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:18 smithi070 podman[93793]: 2024-09-21 05:56:18.546355929 +0000 UTC m=+5.529277138 container died ced7b63b8ef94f948b841b6a40a03b9d4b671c43c826ed9b3b99a974f3034b73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T05:56:18.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:18 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:18.608+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:18.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:18 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:18.608+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:18.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:18 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:18.608+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:18.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:18 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:18.608+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:37.775284+0000 front 2024-09-21T05:55:37.775204+0000 (oldest deadline 2024-09-21T05:56:00.575576+0000) 2024-09-21T05:56:18.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:18 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:18.608+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:45.276532+0000 front 2024-09-21T05:55:45.276639+0000 (oldest deadline 2024-09-21T05:56:09.376796+0000) 2024-09-21T05:56:18.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:18 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:18.608+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-21T05:55:49.377401+0000 front 2024-09-21T05:55:49.377499+0000 (oldest deadline 2024-09-21T05:56:15.277359+0000) 2024-09-21T05:56:19.162 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:18 smithi070 podman[93793]: 2024-09-21 05:56:18.976583262 +0000 UTC m=+5.959504470 container cleanup ced7b63b8ef94f948b841b6a40a03b9d4b671c43c826ed9b3b99a974f3034b73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T05:56:19.163 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:18 smithi070 bash[93793]: ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9 2024-09-21T05:56:19.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:19 smithi070 podman[93808]: 2024-09-21 05:56:19.161370842 +0000 UTC m=+0.603213748 container remove ced7b63b8ef94f948b841b6a40a03b9d4b671c43c826ed9b3b99a974f3034b73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T05:56:19.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:19 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:19.233+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:56:19.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:19 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:19.233+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:56:19.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:19 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:19.233+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:56:19.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:19 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:19.233+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:56:19.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:19 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:19.233+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:32.734539+0000 front 2024-09-21T05:55:32.734578+0000 (oldest deadline 2024-09-21T05:55:58.634621+0000) 2024-09-21T05:56:19.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:19 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:19.233+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:42.735733+0000 front 2024-09-21T05:55:42.735624+0000 (oldest deadline 2024-09-21T05:56:12.135918+0000) 2024-09-21T05:56:19.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:19 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:19.233+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-21T05:55:52.136565+0000 front 2024-09-21T05:55:52.136498+0000 (oldest deadline 2024-09-21T05:56:18.036301+0000) 2024-09-21T05:56:19.899 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:19 smithi070 podman[93896]: 2024-09-21 05:56:19.586960437 +0000 UTC m=+0.108520095 container create c179fe2d2655636fd7cce9178fe5bbb04c5e943e749d7c9d6e4bdfd1721eadda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-21T05:56:19.899 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:19 smithi070 podman[93896]: 2024-09-21 05:56:19.494526431 +0000 UTC m=+0.016086099 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:56:19.899 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:19 smithi070 podman[93896]: 2024-09-21 05:56:19.814591974 +0000 UTC m=+0.336151631 container init c179fe2d2655636fd7cce9178fe5bbb04c5e943e749d7c9d6e4bdfd1721eadda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T05:56:19.899 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:19 smithi070 podman[93896]: 2024-09-21 05:56:19.817775666 +0000 UTC m=+0.339335333 container start c179fe2d2655636fd7cce9178fe5bbb04c5e943e749d7c9d6e4bdfd1721eadda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T05:56:19.899 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:19 smithi070 podman[93896]: 2024-09-21 05:56:19.897781142 +0000 UTC m=+0.419340813 container attach c179fe2d2655636fd7cce9178fe5bbb04c5e943e749d7c9d6e4bdfd1721eadda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-21T05:56:20.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:19 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:19.649+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:20.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:19 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:19.649+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:20.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:19 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:19.649+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:20.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:19 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:19.649+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:37.775284+0000 front 2024-09-21T05:55:37.775204+0000 (oldest deadline 2024-09-21T05:56:00.575576+0000) 2024-09-21T05:56:20.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:19 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:19.649+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:45.276532+0000 front 2024-09-21T05:55:45.276639+0000 (oldest deadline 2024-09-21T05:56:09.376796+0000) 2024-09-21T05:56:20.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:19 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:19.649+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-21T05:55:49.377401+0000 front 2024-09-21T05:55:49.377499+0000 (oldest deadline 2024-09-21T05:56:15.277359+0000) 2024-09-21T05:56:20.245 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 21 05:56:20 smithi070 podman[93896]: 2024-09-21 05:56:20.001036483 +0000 UTC m=+0.522596141 container died c179fe2d2655636fd7cce9178fe5bbb04c5e943e749d7c9d6e4bdfd1721eadda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T05:56:20.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:20 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:20.208+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:56:20.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:20 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:20.208+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:56:20.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:20 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:20.208+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:56:20.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:20 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:20.208+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:56:20.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:20 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:20.208+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:32.734539+0000 front 2024-09-21T05:55:32.734578+0000 (oldest deadline 2024-09-21T05:55:58.634621+0000) 2024-09-21T05:56:20.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:20 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:20.208+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:42.735733+0000 front 2024-09-21T05:55:42.735624+0000 (oldest deadline 2024-09-21T05:56:12.135918+0000) 2024-09-21T05:56:20.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:20 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:20.208+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-21T05:55:52.136565+0000 front 2024-09-21T05:55:52.136498+0000 (oldest deadline 2024-09-21T05:56:18.036301+0000) 2024-09-21T05:56:20.567 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.9.service' 2024-09-21T05:56:20.607 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:56:20.607 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-21T05:56:20.607 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-21T05:56:20.608 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.10 2024-09-21T05:56:20.979 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:20 smithi116 systemd[1]: Stopping Ceph osd.10 for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:56:20.979 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:20 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:20.976+0000 7f6ef9241640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T05:56:21.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:20 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:20.653+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:21.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:20 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:20.653+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:21.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:20 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:20.653+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:21.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:20 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:20.653+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:37.775284+0000 front 2024-09-21T05:55:37.775204+0000 (oldest deadline 2024-09-21T05:56:00.575576+0000) 2024-09-21T05:56:21.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:20 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:20.653+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:45.276532+0000 front 2024-09-21T05:55:45.276639+0000 (oldest deadline 2024-09-21T05:56:09.376796+0000) 2024-09-21T05:56:21.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:20 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:20.653+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-21T05:55:49.377401+0000 front 2024-09-21T05:55:49.377499+0000 (oldest deadline 2024-09-21T05:56:15.277359+0000) 2024-09-21T05:56:21.242 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:20 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:20.976+0000 7f6ef9241640 -1 osd.10 89 *** Got signal Terminated *** 2024-09-21T05:56:21.242 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:20 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:20.976+0000 7f6ef9241640 -1 osd.10 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T05:56:21.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:21 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:21.240+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:56:21.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:21 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:21.240+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:56:21.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:21 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:21.240+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:56:21.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:21 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:21.240+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:56:21.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:21 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:21.240+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:32.734539+0000 front 2024-09-21T05:55:32.734578+0000 (oldest deadline 2024-09-21T05:55:58.634621+0000) 2024-09-21T05:56:21.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:21 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:21.240+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:42.735733+0000 front 2024-09-21T05:55:42.735624+0000 (oldest deadline 2024-09-21T05:56:12.135918+0000) 2024-09-21T05:56:21.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:21 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:21.240+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-21T05:55:52.136565+0000 front 2024-09-21T05:55:52.136498+0000 (oldest deadline 2024-09-21T05:56:18.036301+0000) 2024-09-21T05:56:22.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:21 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:21.661+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:22.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:21 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:21.661+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:22.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:21 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:21.661+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:22.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:21 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:21.661+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:37.775284+0000 front 2024-09-21T05:55:37.775204+0000 (oldest deadline 2024-09-21T05:56:00.575576+0000) 2024-09-21T05:56:22.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:21 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:21.661+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:45.276532+0000 front 2024-09-21T05:55:45.276639+0000 (oldest deadline 2024-09-21T05:56:09.376796+0000) 2024-09-21T05:56:22.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:21 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:21.661+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-21T05:55:49.377401+0000 front 2024-09-21T05:55:49.377499+0000 (oldest deadline 2024-09-21T05:56:15.277359+0000) 2024-09-21T05:56:22.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:22 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:22.219+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:56:22.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:22 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:22.219+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:56:22.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:22 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:22.219+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:56:22.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:22 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:22.219+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:56:22.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:22 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:22.219+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:32.734539+0000 front 2024-09-21T05:55:32.734578+0000 (oldest deadline 2024-09-21T05:55:58.634621+0000) 2024-09-21T05:56:22.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:22 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:22.219+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:42.735733+0000 front 2024-09-21T05:55:42.735624+0000 (oldest deadline 2024-09-21T05:56:12.135918+0000) 2024-09-21T05:56:22.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:22 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:22.219+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-21T05:55:52.136565+0000 front 2024-09-21T05:55:52.136498+0000 (oldest deadline 2024-09-21T05:56:18.036301+0000) 2024-09-21T05:56:23.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:22 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:22.682+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:23.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:22 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:22.682+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:23.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:22 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:22.682+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:23.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:22 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:22.682+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:37.775284+0000 front 2024-09-21T05:55:37.775204+0000 (oldest deadline 2024-09-21T05:56:00.575576+0000) 2024-09-21T05:56:23.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:22 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:22.682+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:45.276532+0000 front 2024-09-21T05:55:45.276639+0000 (oldest deadline 2024-09-21T05:56:09.376796+0000) 2024-09-21T05:56:23.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:22 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:22.682+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-21T05:55:49.377401+0000 front 2024-09-21T05:55:49.377499+0000 (oldest deadline 2024-09-21T05:56:15.277359+0000) 2024-09-21T05:56:23.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:23 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:23.228+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:56:23.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:23 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:23.228+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:56:23.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:23 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:23.228+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:56:23.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:23 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:23.228+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:56:23.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:23 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:23.228+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:32.734539+0000 front 2024-09-21T05:55:32.734578+0000 (oldest deadline 2024-09-21T05:55:58.634621+0000) 2024-09-21T05:56:23.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:23 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:23.228+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:42.735733+0000 front 2024-09-21T05:55:42.735624+0000 (oldest deadline 2024-09-21T05:56:12.135918+0000) 2024-09-21T05:56:23.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:23 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:23.228+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-21T05:55:52.136565+0000 front 2024-09-21T05:55:52.136498+0000 (oldest deadline 2024-09-21T05:56:18.036301+0000) 2024-09-21T05:56:23.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:23 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:23.665+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:23.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:23 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:23.665+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:23.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:23 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:23.665+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:23.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:23 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:23.665+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:37.775284+0000 front 2024-09-21T05:55:37.775204+0000 (oldest deadline 2024-09-21T05:56:00.575576+0000) 2024-09-21T05:56:23.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:23 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:23.665+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:45.276532+0000 front 2024-09-21T05:55:45.276639+0000 (oldest deadline 2024-09-21T05:56:09.376796+0000) 2024-09-21T05:56:23.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:23 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:23.665+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-21T05:55:49.377401+0000 front 2024-09-21T05:55:49.377499+0000 (oldest deadline 2024-09-21T05:56:15.277359+0000) 2024-09-21T05:56:23.899 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:23 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:23.665+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6820 osd.7 since back 2024-09-21T05:56:01.380079+0000 front 2024-09-21T05:56:01.380031+0000 (oldest deadline 2024-09-21T05:56:23.079969+0000) 2024-09-21T05:56:24.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:24 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:24.227+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:56:24.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:24 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:24.227+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:56:24.554 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:24 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:24.227+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:56:24.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:24 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:24.227+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:56:24.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:24 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:24.227+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:32.734539+0000 front 2024-09-21T05:55:32.734578+0000 (oldest deadline 2024-09-21T05:55:58.634621+0000) 2024-09-21T05:56:24.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:24 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:24.227+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:42.735733+0000 front 2024-09-21T05:55:42.735624+0000 (oldest deadline 2024-09-21T05:56:12.135918+0000) 2024-09-21T05:56:24.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:24 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:24.227+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-21T05:55:52.136565+0000 front 2024-09-21T05:55:52.136498+0000 (oldest deadline 2024-09-21T05:56:18.036301+0000) 2024-09-21T05:56:25.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:24 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:24.679+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:25.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:24 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:24.679+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:25.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:24 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:24.679+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:25.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:24 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:24.679+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:37.775284+0000 front 2024-09-21T05:55:37.775204+0000 (oldest deadline 2024-09-21T05:56:00.575576+0000) 2024-09-21T05:56:25.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:24 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:24.679+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:45.276532+0000 front 2024-09-21T05:55:45.276639+0000 (oldest deadline 2024-09-21T05:56:09.376796+0000) 2024-09-21T05:56:25.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:24 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:24.679+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-21T05:55:49.377401+0000 front 2024-09-21T05:55:49.377499+0000 (oldest deadline 2024-09-21T05:56:15.277359+0000) 2024-09-21T05:56:25.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:24 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:24.679+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6820 osd.7 since back 2024-09-21T05:56:01.380079+0000 front 2024-09-21T05:56:01.380031+0000 (oldest deadline 2024-09-21T05:56:23.079969+0000) 2024-09-21T05:56:25.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:25 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:25.245+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.531496+0000 front 2024-09-21T05:55:04.531470+0000 (oldest deadline 2024-09-21T05:55:30.431463+0000) 2024-09-21T05:56:25.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:25 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:25.245+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.732403+0000 front 2024-09-21T05:55:12.732428+0000 (oldest deadline 2024-09-21T05:55:38.632572+0000) 2024-09-21T05:56:25.555 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:25 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:25.245+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:18.633294+0000 front 2024-09-21T05:55:18.633279+0000 (oldest deadline 2024-09-21T05:55:43.333090+0000) 2024-09-21T05:56:25.556 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:25 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:25.245+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-21T05:55:28.034112+0000 front 2024-09-21T05:55:28.034153+0000 (oldest deadline 2024-09-21T05:55:52.734063+0000) 2024-09-21T05:56:25.556 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:25 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:25.245+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:32.734539+0000 front 2024-09-21T05:55:32.734578+0000 (oldest deadline 2024-09-21T05:55:58.634621+0000) 2024-09-21T05:56:25.556 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:25 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:25.245+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:42.735733+0000 front 2024-09-21T05:55:42.735624+0000 (oldest deadline 2024-09-21T05:56:12.135918+0000) 2024-09-21T05:56:25.556 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:25 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10[57178]: 2024-09-21T05:56:25.245+0000 7f6ef582c640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-21T05:55:52.136565+0000 front 2024-09-21T05:55:52.136498+0000 (oldest deadline 2024-09-21T05:56:18.036301+0000) 2024-09-21T05:56:26.050 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:25 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:25.671+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:26.050 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:25 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:25.671+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:26.050 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:25 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:25.671+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:26.050 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:25 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:25.671+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:37.775284+0000 front 2024-09-21T05:55:37.775204+0000 (oldest deadline 2024-09-21T05:56:00.575576+0000) 2024-09-21T05:56:26.050 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:25 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:25.671+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:45.276532+0000 front 2024-09-21T05:55:45.276639+0000 (oldest deadline 2024-09-21T05:56:09.376796+0000) 2024-09-21T05:56:26.051 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:25 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:25.671+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-21T05:55:49.377401+0000 front 2024-09-21T05:55:49.377499+0000 (oldest deadline 2024-09-21T05:56:15.277359+0000) 2024-09-21T05:56:26.051 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:25 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:25.671+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6820 osd.7 since back 2024-09-21T05:56:01.380079+0000 front 2024-09-21T05:56:01.380031+0000 (oldest deadline 2024-09-21T05:56:23.079969+0000) 2024-09-21T05:56:26.772 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:26 smithi116 podman[65833]: 2024-09-21 05:56:26.35261939 +0000 UTC m=+5.559910956 container died fbf43b132fe52866e0451f87e42fbccfc722a3d2be17d03059ce7409f9772455 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T05:56:27.054 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:26 smithi116 podman[65833]: 2024-09-21 05:56:26.852428491 +0000 UTC m=+6.059720091 container cleanup fbf43b132fe52866e0451f87e42fbccfc722a3d2be17d03059ce7409f9772455 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T05:56:27.054 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:26 smithi116 bash[65833]: ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10 2024-09-21T05:56:27.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:26 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:26.721+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:27.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:26 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:26.721+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:27.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:26 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:26.721+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:27.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:26 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:26.721+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:37.775284+0000 front 2024-09-21T05:55:37.775204+0000 (oldest deadline 2024-09-21T05:56:00.575576+0000) 2024-09-21T05:56:27.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:26 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:26.721+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:45.276532+0000 front 2024-09-21T05:55:45.276639+0000 (oldest deadline 2024-09-21T05:56:09.376796+0000) 2024-09-21T05:56:27.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:26 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:26.721+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-21T05:55:49.377401+0000 front 2024-09-21T05:55:49.377499+0000 (oldest deadline 2024-09-21T05:56:15.277359+0000) 2024-09-21T05:56:27.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:26 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:26.721+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6820 osd.7 since back 2024-09-21T05:56:01.380079+0000 front 2024-09-21T05:56:01.380031+0000 (oldest deadline 2024-09-21T05:56:23.079969+0000) 2024-09-21T05:56:27.372 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:27 smithi116 podman[65848]: 2024-09-21 05:56:27.072353406 +0000 UTC m=+0.710118829 container remove fbf43b132fe52866e0451f87e42fbccfc722a3d2be17d03059ce7409f9772455 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True) 2024-09-21T05:56:27.633 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:27 smithi116 podman[65938]: 2024-09-21 05:56:27.370939174 +0000 UTC m=+0.100772002 container create 23d869dd53e32318136ef070f7b6a5aa4eefcae57350f9228fc4d45ec94b8ed5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T05:56:27.633 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:27 smithi116 podman[65938]: 2024-09-21 05:56:27.28576817 +0000 UTC m=+0.015601011 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:56:27.633 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:27 smithi116 podman[65938]: 2024-09-21 05:56:27.632188738 +0000 UTC m=+0.362021565 container init 23d869dd53e32318136ef070f7b6a5aa4eefcae57350f9228fc4d45ec94b8ed5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T05:56:28.054 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:27 smithi116 podman[65938]: 2024-09-21 05:56:27.635539381 +0000 UTC m=+0.365372210 container start 23d869dd53e32318136ef070f7b6a5aa4eefcae57350f9228fc4d45ec94b8ed5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T05:56:28.055 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:27 smithi116 podman[65938]: 2024-09-21 05:56:27.740449517 +0000 UTC m=+0.470282358 container attach 23d869dd53e32318136ef070f7b6a5aa4eefcae57350f9228fc4d45ec94b8ed5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T05:56:28.055 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:27 smithi116 podman[65938]: 2024-09-21 05:56:27.82063237 +0000 UTC m=+0.550465197 container died 23d869dd53e32318136ef070f7b6a5aa4eefcae57350f9228fc4d45ec94b8ed5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T05:56:28.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:27 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:27.674+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:28.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:27 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:27.674+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:28.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:27 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:27.674+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:28.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:27 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:27.674+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:37.775284+0000 front 2024-09-21T05:55:37.775204+0000 (oldest deadline 2024-09-21T05:56:00.575576+0000) 2024-09-21T05:56:28.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:27 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:27.674+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:45.276532+0000 front 2024-09-21T05:55:45.276639+0000 (oldest deadline 2024-09-21T05:56:09.376796+0000) 2024-09-21T05:56:28.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:27 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:27.674+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-21T05:55:49.377401+0000 front 2024-09-21T05:55:49.377499+0000 (oldest deadline 2024-09-21T05:56:15.277359+0000) 2024-09-21T05:56:28.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:27 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:27.674+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6820 osd.7 since back 2024-09-21T05:56:01.380079+0000 front 2024-09-21T05:56:01.380031+0000 (oldest deadline 2024-09-21T05:56:23.079969+0000) 2024-09-21T05:56:28.331 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.10.service' 2024-09-21T05:56:28.356 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:28 smithi116 podman[65961]: 2024-09-21 05:56:28.301844484 +0000 UTC m=+0.475135574 container remove 23d869dd53e32318136ef070f7b6a5aa4eefcae57350f9228fc4d45ec94b8ed5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T05:56:28.356 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:28 smithi116 systemd[1]: ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.10.service: Deactivated successfully. 2024-09-21T05:56:28.357 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:28 smithi116 systemd[1]: Stopped Ceph osd.10 for 96c6636e-77db-11ef-baf5-efdc52797490. 2024-09-21T05:56:28.357 INFO:journalctl@ceph.osd.10.smithi116.stdout:Sep 21 05:56:28 smithi116 systemd[1]: ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.10.service: Consumed 22.919s CPU time. 2024-09-21T05:56:28.372 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:56:28.372 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-21T05:56:28.373 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-21T05:56:28.373 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.11 2024-09-21T05:56:28.701 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:28 smithi160 systemd[1]: Stopping Ceph osd.11 for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:56:29.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:28 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:28.699+0000 7f3f3c1ab640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T05:56:29.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:28 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:28.699+0000 7f3f3c1ab640 -1 osd.11 89 *** Got signal Terminated *** 2024-09-21T05:56:29.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:28 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:28.699+0000 7f3f3c1ab640 -1 osd.11 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T05:56:29.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:28 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:28.715+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:29.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:28 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:28.715+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:29.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:28 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:28.715+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:29.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:28 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:28.715+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:37.775284+0000 front 2024-09-21T05:55:37.775204+0000 (oldest deadline 2024-09-21T05:56:00.575576+0000) 2024-09-21T05:56:29.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:28 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:28.715+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:45.276532+0000 front 2024-09-21T05:55:45.276639+0000 (oldest deadline 2024-09-21T05:56:09.376796+0000) 2024-09-21T05:56:29.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:28 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:28.715+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-21T05:55:49.377401+0000 front 2024-09-21T05:55:49.377499+0000 (oldest deadline 2024-09-21T05:56:15.277359+0000) 2024-09-21T05:56:29.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:28 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:28.715+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6820 osd.7 since back 2024-09-21T05:56:01.380079+0000 front 2024-09-21T05:56:01.380031+0000 (oldest deadline 2024-09-21T05:56:23.079969+0000) 2024-09-21T05:56:30.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:29 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:29.698+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:30.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:29 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:29.698+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:30.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:29 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:29.698+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:30.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:29 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:29.698+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:37.775284+0000 front 2024-09-21T05:55:37.775204+0000 (oldest deadline 2024-09-21T05:56:00.575576+0000) 2024-09-21T05:56:30.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:29 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:29.698+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:45.276532+0000 front 2024-09-21T05:55:45.276639+0000 (oldest deadline 2024-09-21T05:56:09.376796+0000) 2024-09-21T05:56:30.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:29 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:29.698+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-21T05:55:49.377401+0000 front 2024-09-21T05:55:49.377499+0000 (oldest deadline 2024-09-21T05:56:15.277359+0000) 2024-09-21T05:56:30.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:29 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:29.698+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6820 osd.7 since back 2024-09-21T05:56:01.380079+0000 front 2024-09-21T05:56:01.380031+0000 (oldest deadline 2024-09-21T05:56:23.079969+0000) 2024-09-21T05:56:31.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:30 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:30.744+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:31.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:30 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:30.744+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:31.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:30 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:30.744+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:31.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:30 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:30.744+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:37.775284+0000 front 2024-09-21T05:55:37.775204+0000 (oldest deadline 2024-09-21T05:56:00.575576+0000) 2024-09-21T05:56:31.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:30 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:30.744+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:45.276532+0000 front 2024-09-21T05:55:45.276639+0000 (oldest deadline 2024-09-21T05:56:09.376796+0000) 2024-09-21T05:56:31.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:30 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:30.744+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-21T05:55:49.377401+0000 front 2024-09-21T05:55:49.377499+0000 (oldest deadline 2024-09-21T05:56:15.277359+0000) 2024-09-21T05:56:31.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:30 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:30.744+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6820 osd.7 since back 2024-09-21T05:56:01.380079+0000 front 2024-09-21T05:56:01.380031+0000 (oldest deadline 2024-09-21T05:56:23.079969+0000) 2024-09-21T05:56:32.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:31 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:31.749+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:32.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:31 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:31.749+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:32.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:31 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:31.749+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:32.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:31 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:31.749+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:37.775284+0000 front 2024-09-21T05:55:37.775204+0000 (oldest deadline 2024-09-21T05:56:00.575576+0000) 2024-09-21T05:56:32.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:31 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:31.749+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:45.276532+0000 front 2024-09-21T05:55:45.276639+0000 (oldest deadline 2024-09-21T05:56:09.376796+0000) 2024-09-21T05:56:32.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:31 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:31.749+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-21T05:55:49.377401+0000 front 2024-09-21T05:55:49.377499+0000 (oldest deadline 2024-09-21T05:56:15.277359+0000) 2024-09-21T05:56:32.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:31 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:31.749+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6820 osd.7 since back 2024-09-21T05:56:01.380079+0000 front 2024-09-21T05:56:01.380031+0000 (oldest deadline 2024-09-21T05:56:23.079969+0000) 2024-09-21T05:56:33.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:32 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:32.741+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-21T05:55:04.268146+0000 front 2024-09-21T05:55:04.268198+0000 (oldest deadline 2024-09-21T05:55:27.768146+0000) 2024-09-21T05:56:33.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:32 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:32.741+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-09-21T05:55:12.270453+0000 front 2024-09-21T05:55:12.270329+0000 (oldest deadline 2024-09-21T05:55:35.070718+0000) 2024-09-21T05:56:33.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:32 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:32.741+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-09-21T05:55:17.371663+0000 front 2024-09-21T05:55:17.371815+0000 (oldest deadline 2024-09-21T05:55:42.672052+0000) 2024-09-21T05:56:33.148 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:32 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:32.741+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-09-21T05:55:37.775284+0000 front 2024-09-21T05:55:37.775204+0000 (oldest deadline 2024-09-21T05:56:00.575576+0000) 2024-09-21T05:56:33.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:32 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:32.741+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-09-21T05:55:45.276532+0000 front 2024-09-21T05:55:45.276639+0000 (oldest deadline 2024-09-21T05:56:09.376796+0000) 2024-09-21T05:56:33.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:32 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:32.741+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-21T05:55:49.377401+0000 front 2024-09-21T05:55:49.377499+0000 (oldest deadline 2024-09-21T05:56:15.277359+0000) 2024-09-21T05:56:33.149 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:32 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11[57736]: 2024-09-21T05:56:32.741+0000 7f3f38796640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.116:6820 osd.7 since back 2024-09-21T05:56:01.380079+0000 front 2024-09-21T05:56:01.380031+0000 (oldest deadline 2024-09-21T05:56:23.079969+0000) 2024-09-21T05:56:34.508 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:34 smithi160 podman[66171]: 2024-09-21 05:56:34.206223321 +0000 UTC m=+5.632877168 container died 359418d218e22afa15c82afd7d83f83fc5921f7d42eda6e88622474c56e47bc7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-21T05:56:34.508 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:34 smithi160 podman[66171]: 2024-09-21 05:56:34.507032251 +0000 UTC m=+5.933686097 container cleanup 359418d218e22afa15c82afd7d83f83fc5921f7d42eda6e88622474c56e47bc7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-21T05:56:34.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:34 smithi160 bash[66171]: ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11 2024-09-21T05:56:34.898 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:34 smithi160 podman[66186]: 2024-09-21 05:56:34.699755369 +0000 UTC m=+0.496135169 container remove 359418d218e22afa15c82afd7d83f83fc5921f7d42eda6e88622474c56e47bc7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T05:56:35.312 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:35 smithi160 podman[66277]: 2024-09-21 05:56:34.913281166 +0000 UTC m=+0.016162698 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:56:35.312 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:35 smithi160 podman[66277]: 2024-09-21 05:56:35.017393321 +0000 UTC m=+0.120274882 container create de66a42113eb93af7a459a2f7066e54fb51020a5f9e83f63a7828b8ba9798628 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T05:56:35.312 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:35 smithi160 podman[66277]: 2024-09-21 05:56:35.236235228 +0000 UTC m=+0.339116755 container init de66a42113eb93af7a459a2f7066e54fb51020a5f9e83f63a7828b8ba9798628 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-21T05:56:35.312 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:35 smithi160 podman[66277]: 2024-09-21 05:56:35.239549071 +0000 UTC m=+0.342430591 container start de66a42113eb93af7a459a2f7066e54fb51020a5f9e83f63a7828b8ba9798628 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-21T05:56:35.312 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:35 smithi160 podman[66277]: 2024-09-21 05:56:35.310989334 +0000 UTC m=+0.413870864 container attach de66a42113eb93af7a459a2f7066e54fb51020a5f9e83f63a7828b8ba9798628 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T05:56:35.648 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 05:56:35 smithi160 podman[66277]: 2024-09-21 05:56:35.433931342 +0000 UTC m=+0.536812868 container died de66a42113eb93af7a459a2f7066e54fb51020a5f9e83f63a7828b8ba9798628 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-osd-11-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T05:56:36.022 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@osd.11.service' 2024-09-21T05:56:36.063 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:56:36.064 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-21T05:56:36.064 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-21T05:56:36.064 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.a 2024-09-21T05:56:36.353 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 21 05:56:36 smithi070 systemd[1]: Stopping Ceph mds.a for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:56:36.745 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 21 05:56:36 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-a[72620]: 2024-09-21T05:56:36.351+0000 7fcfc93d7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T05:56:36.745 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 21 05:56:36 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-a[72620]: 2024-09-21T05:56:36.351+0000 7fcfc93d7640 -1 mds.a *** got signal Terminated *** 2024-09-21T05:56:39.778 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 21 05:56:39 smithi070 podman[93998]: 2024-09-21 05:56:39.506660706 +0000 UTC m=+3.257590468 container died 95b517185a7a9bd7a296d1302c191f8349b8e4daaca7e5aca882713a35ecca91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-a, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T05:56:40.137 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 21 05:56:39 smithi070 podman[93998]: 2024-09-21 05:56:39.876225624 +0000 UTC m=+3.627155379 container cleanup 95b517185a7a9bd7a296d1302c191f8349b8e4daaca7e5aca882713a35ecca91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-a, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T05:56:40.137 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 21 05:56:39 smithi070 bash[93998]: ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-a 2024-09-21T05:56:40.315 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.a.service' 2024-09-21T05:56:40.351 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:56:40.351 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-21T05:56:40.351 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-21T05:56:40.351 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.d 2024-09-21T05:56:40.745 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 21 05:56:40 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-d[71584]: 2024-09-21T05:56:40.655+0000 7fe490423640 -1 mds.d *** got signal Terminated *** 2024-09-21T05:56:43.124 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 21 05:56:42 smithi070 podman[94133]: 2024-09-21 05:56:42.855724583 +0000 UTC m=+2.292812172 container died 29d06678f4d32093ab13709c0e3dbd599e8d98fadf354912ca37a8ff3e517cd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-d, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731) 2024-09-21T05:56:43.491 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 21 05:56:43 smithi070 podman[94133]: 2024-09-21 05:56:43.22185076 +0000 UTC m=+2.658938349 container cleanup 29d06678f4d32093ab13709c0e3dbd599e8d98fadf354912ca37a8ff3e517cd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T05:56:43.491 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 21 05:56:43 smithi070 bash[94133]: ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-d 2024-09-21T05:56:43.651 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.d.service' 2024-09-21T05:56:43.684 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:56:43.684 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-21T05:56:43.684 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-21T05:56:43.684 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.g 2024-09-21T05:56:44.018 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 21 05:56:43 smithi070 systemd[1]: Stopping Ceph mds.g for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:56:44.495 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 21 05:56:44 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-g[72318]: 2024-09-21T05:56:44.016+0000 7f6ec3ea3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T05:56:44.495 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 21 05:56:44 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-g[72318]: 2024-09-21T05:56:44.016+0000 7f6ec3ea3640 -1 mds.g *** got signal Terminated *** 2024-09-21T05:56:47.819 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 21 05:56:47 smithi070 podman[94254]: 2024-09-21 05:56:47.50926825 +0000 UTC m=+3.603565352 container died 756f023448711284cbf7d407677d1e54c3aade51decf9915616861418996f123 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-g, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-21T05:56:48.145 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 21 05:56:47 smithi070 podman[94254]: 2024-09-21 05:56:47.93378039 +0000 UTC m=+4.028077487 container cleanup 756f023448711284cbf7d407677d1e54c3aade51decf9915616861418996f123 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-g, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T05:56:48.145 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 21 05:56:47 smithi070 bash[94254]: ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-g 2024-09-21T05:56:48.358 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.g.service' 2024-09-21T05:56:48.390 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:56:48.391 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-21T05:56:48.391 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-21T05:56:48.391 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.j 2024-09-21T05:56:48.745 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 21 05:56:48 smithi070 systemd[1]: Stopping Ceph mds.j for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:56:48.745 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 21 05:56:48 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-j[71200]: 2024-09-21T05:56:48.687+0000 7f3f2e221640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T05:56:48.745 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 21 05:56:48 smithi070 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-j[71200]: 2024-09-21T05:56:48.687+0000 7f3f2e221640 -1 mds.j *** got signal Terminated *** 2024-09-21T05:56:52.180 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 21 05:56:51 smithi070 podman[94375]: 2024-09-21 05:56:51.873007223 +0000 UTC m=+3.269134481 container died d3d484dad73275f08cc577db28536c7ae2b9b5b5c11781b94a7251d7d60a6524 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-j, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-21T05:56:52.495 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 21 05:56:52 smithi070 podman[94375]: 2024-09-21 05:56:52.354410056 +0000 UTC m=+3.750537314 container cleanup d3d484dad73275f08cc577db28536c7ae2b9b5b5c11781b94a7251d7d60a6524 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-j, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-21T05:56:52.495 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 21 05:56:52 smithi070 bash[94375]: ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-j 2024-09-21T05:56:52.767 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.j.service' 2024-09-21T05:56:52.789 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 21 05:56:52 smithi070 podman[94387]: 2024-09-21 05:56:52.522304359 +0000 UTC m=+0.644685766 container remove d3d484dad73275f08cc577db28536c7ae2b9b5b5c11781b94a7251d7d60a6524 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-j, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T05:56:52.789 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 21 05:56:52 smithi070 systemd[1]: ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.j.service: Deactivated successfully. 2024-09-21T05:56:52.789 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 21 05:56:52 smithi070 systemd[1]: Stopped Ceph mds.j for 96c6636e-77db-11ef-baf5-efdc52797490. 2024-09-21T05:56:52.799 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:56:52.799 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-21T05:56:52.799 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-21T05:56:52.799 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.b 2024-09-21T05:56:53.096 INFO:journalctl@ceph.mds.b.smithi116.stdout:Sep 21 05:56:52 smithi116 systemd[1]: Stopping Ceph mds.b for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:56:53.554 INFO:journalctl@ceph.mds.b.smithi116.stdout:Sep 21 05:56:53 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-b[62172]: 2024-09-21T05:56:53.094+0000 7f62b9780640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T05:56:53.554 INFO:journalctl@ceph.mds.b.smithi116.stdout:Sep 21 05:56:53 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-b[62172]: 2024-09-21T05:56:53.094+0000 7f62b9780640 -1 mds.b *** got signal Terminated *** 2024-09-21T05:56:55.804 INFO:journalctl@ceph.mds.b.smithi116.stdout:Sep 21 05:56:55 smithi116 podman[66052]: 2024-09-21 05:56:55.541268111 +0000 UTC m=+2.551487525 container died 2940e2ad1cf7b98b5251954dacfa703418b3205cd40633e301053d7f2efe0f30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-b, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T05:56:56.304 INFO:journalctl@ceph.mds.b.smithi116.stdout:Sep 21 05:56:55 smithi116 podman[66052]: 2024-09-21 05:56:55.968792272 +0000 UTC m=+2.979011689 container cleanup 2940e2ad1cf7b98b5251954dacfa703418b3205cd40633e301053d7f2efe0f30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T05:56:56.304 INFO:journalctl@ceph.mds.b.smithi116.stdout:Sep 21 05:56:55 smithi116 bash[66052]: ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-b 2024-09-21T05:56:56.304 INFO:journalctl@ceph.mds.b.smithi116.stdout:Sep 21 05:56:56 smithi116 podman[66064]: 2024-09-21 05:56:56.128365885 +0000 UTC m=+0.581389256 container remove 2940e2ad1cf7b98b5251954dacfa703418b3205cd40633e301053d7f2efe0f30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T05:56:56.354 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.b.service' 2024-09-21T05:56:56.388 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:56:56.388 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-21T05:56:56.388 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-21T05:56:56.388 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.e 2024-09-21T05:56:56.724 INFO:journalctl@ceph.mds.e.smithi116.stdout:Sep 21 05:56:56 smithi116 systemd[1]: Stopping Ceph mds.e for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:56:57.054 INFO:journalctl@ceph.mds.e.smithi116.stdout:Sep 21 05:56:56 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-e[61624]: 2024-09-21T05:56:56.722+0000 7f67394d9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T05:56:57.054 INFO:journalctl@ceph.mds.e.smithi116.stdout:Sep 21 05:56:56 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-e[61624]: 2024-09-21T05:56:56.722+0000 7f67394d9640 -1 mds.e *** got signal Terminated *** 2024-09-21T05:56:59.804 INFO:journalctl@ceph.mds.e.smithi116.stdout:Sep 21 05:56:59 smithi116 podman[66176]: 2024-09-21 05:56:59.528268326 +0000 UTC m=+2.918670116 container died 73c2382a2ce9858266b447743ac6f3157fa912da6057dcb5dd48798320aa732f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-e, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-21T05:57:00.255 INFO:journalctl@ceph.mds.e.smithi116.stdout:Sep 21 05:56:59 smithi116 podman[66176]: 2024-09-21 05:56:59.939143976 +0000 UTC m=+3.329545763 container cleanup 73c2382a2ce9858266b447743ac6f3157fa912da6057dcb5dd48798320aa732f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-e, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T05:57:00.255 INFO:journalctl@ceph.mds.e.smithi116.stdout:Sep 21 05:56:59 smithi116 bash[66176]: ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-e 2024-09-21T05:57:00.255 INFO:journalctl@ceph.mds.e.smithi116.stdout:Sep 21 05:57:00 smithi116 podman[66191]: 2024-09-21 05:57:00.115443299 +0000 UTC m=+0.588574441 container remove 73c2382a2ce9858266b447743ac6f3157fa912da6057dcb5dd48798320aa732f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-e, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-21T05:57:00.373 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.e.service' 2024-09-21T05:57:00.406 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:57:00.407 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-21T05:57:00.407 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-21T05:57:00.407 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.h 2024-09-21T05:57:00.554 INFO:journalctl@ceph.mds.h.smithi116.stdout:Sep 21 05:57:00 smithi116 systemd[1]: Stopping Ceph mds.h for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:57:01.038 INFO:journalctl@ceph.mds.h.smithi116.stdout:Sep 21 05:57:00 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-h[61893]: 2024-09-21T05:57:00.751+0000 7f16829b3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T05:57:01.038 INFO:journalctl@ceph.mds.h.smithi116.stdout:Sep 21 05:57:00 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-h[61893]: 2024-09-21T05:57:00.751+0000 7f16829b3640 -1 mds.h *** got signal Terminated *** 2024-09-21T05:57:03.804 INFO:journalctl@ceph.mds.h.smithi116.stdout:Sep 21 05:57:03 smithi116 podman[66307]: 2024-09-21 05:57:03.525207187 +0000 UTC m=+2.880711062 container died 3a5bcda9a7b1dbb0fb15793d0b8be73109a8ceb28c695f9672d6247658d55835 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-h, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T05:57:04.304 INFO:journalctl@ceph.mds.h.smithi116.stdout:Sep 21 05:57:03 smithi116 podman[66307]: 2024-09-21 05:57:03.967677521 +0000 UTC m=+3.323181389 container cleanup 3a5bcda9a7b1dbb0fb15793d0b8be73109a8ceb28c695f9672d6247658d55835 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-h, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2) 2024-09-21T05:57:04.304 INFO:journalctl@ceph.mds.h.smithi116.stdout:Sep 21 05:57:03 smithi116 bash[66307]: ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-h 2024-09-21T05:57:04.304 INFO:journalctl@ceph.mds.h.smithi116.stdout:Sep 21 05:57:04 smithi116 podman[66320]: 2024-09-21 05:57:04.143949804 +0000 UTC m=+0.618713199 container remove 3a5bcda9a7b1dbb0fb15793d0b8be73109a8ceb28c695f9672d6247658d55835 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-h, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T05:57:04.398 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.h.service' 2024-09-21T05:57:04.433 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:57:04.433 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-21T05:57:04.433 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-21T05:57:04.433 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.k 2024-09-21T05:57:04.757 INFO:journalctl@ceph.mds.k.smithi116.stdout:Sep 21 05:57:04 smithi116 systemd[1]: Stopping Ceph mds.k for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:57:05.054 INFO:journalctl@ceph.mds.k.smithi116.stdout:Sep 21 05:57:04 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-k[61357]: 2024-09-21T05:57:04.754+0000 7fbee3427640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T05:57:05.054 INFO:journalctl@ceph.mds.k.smithi116.stdout:Sep 21 05:57:04 smithi116 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-k[61357]: 2024-09-21T05:57:04.754+0000 7fbee3427640 -1 mds.k *** got signal Terminated *** 2024-09-21T05:57:07.804 INFO:journalctl@ceph.mds.k.smithi116.stdout:Sep 21 05:57:07 smithi116 podman[66430]: 2024-09-21 05:57:07.528807541 +0000 UTC m=+2.882679915 container died bec904e559070c591d9262d9ae772f9e9a7cc9b0cd23a8b0f3cdd131c442cf33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-k, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T05:57:08.349 INFO:journalctl@ceph.mds.k.smithi116.stdout:Sep 21 05:57:08 smithi116 podman[66430]: 2024-09-21 05:57:08.163080694 +0000 UTC m=+3.516953061 container cleanup bec904e559070c591d9262d9ae772f9e9a7cc9b0cd23a8b0f3cdd131c442cf33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-k, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T05:57:08.349 INFO:journalctl@ceph.mds.k.smithi116.stdout:Sep 21 05:57:08 smithi116 bash[66430]: ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-k 2024-09-21T05:57:08.350 INFO:journalctl@ceph.mds.k.smithi116.stdout:Sep 21 05:57:08 smithi116 podman[66443]: 2024-09-21 05:57:08.347493922 +0000 UTC m=+0.820727364 container remove bec904e559070c591d9262d9ae772f9e9a7cc9b0cd23a8b0f3cdd131c442cf33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-k, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T05:57:08.580 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.k.service' 2024-09-21T05:57:08.601 INFO:journalctl@ceph.mds.k.smithi116.stdout:Sep 21 05:57:08 smithi116 systemd[1]: ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.k.service: Deactivated successfully. 2024-09-21T05:57:08.602 INFO:journalctl@ceph.mds.k.smithi116.stdout:Sep 21 05:57:08 smithi116 systemd[1]: Stopped Ceph mds.k for 96c6636e-77db-11ef-baf5-efdc52797490. 2024-09-21T05:57:08.602 INFO:journalctl@ceph.mds.k.smithi116.stdout:Sep 21 05:57:08 smithi116 systemd[1]: ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.k.service: Consumed 2.710s CPU time. 2024-09-21T05:57:08.613 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:57:08.613 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-21T05:57:08.613 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-21T05:57:08.613 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.c 2024-09-21T05:57:08.898 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 21 05:57:08 smithi160 systemd[1]: Stopping Ceph mds.c for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:57:09.398 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 21 05:57:08 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-c[62369]: 2024-09-21T05:57:08.933+0000 7f34878b1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T05:57:09.399 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 21 05:57:08 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-c[62369]: 2024-09-21T05:57:08.933+0000 7f34878b1640 -1 mds.c *** got signal Terminated *** 2024-09-21T05:57:11.832 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 21 05:57:11 smithi160 podman[66380]: 2024-09-21 05:57:11.533296599 +0000 UTC m=+2.731472327 container died 25de6995acab2550442c802609249206b0d35c3a268c588c504b2bbe05d4f56e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-c, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-21T05:57:12.148 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 21 05:57:11 smithi160 podman[66380]: 2024-09-21 05:57:11.929830306 +0000 UTC m=+3.128006024 container cleanup 25de6995acab2550442c802609249206b0d35c3a268c588c504b2bbe05d4f56e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD) 2024-09-21T05:57:12.148 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 21 05:57:11 smithi160 bash[66380]: ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-c 2024-09-21T05:57:12.316 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.c.service' 2024-09-21T05:57:12.352 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:57:12.352 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-21T05:57:12.352 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-21T05:57:12.352 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.f 2024-09-21T05:57:12.898 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 21 05:57:12 smithi160 systemd[1]: Stopping Ceph mds.f for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:57:12.898 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 21 05:57:12 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-f[62097]: 2024-09-21T05:57:12.673+0000 7fb5a9713640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T05:57:12.898 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 21 05:57:12 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-f[62097]: 2024-09-21T05:57:12.673+0000 7fb5a9713640 -1 mds.f *** got signal Terminated *** 2024-09-21T05:57:15.802 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 21 05:57:15 smithi160 podman[66512]: 2024-09-21 05:57:15.523282935 +0000 UTC m=+2.953451483 container died ce62691475eab936657902a1ee9ad02340d0c249a4e6bd0dd46e8b2937c203f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-f, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T05:57:16.148 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 21 05:57:15 smithi160 podman[66512]: 2024-09-21 05:57:15.88311076 +0000 UTC m=+3.313279310 container cleanup ce62691475eab936657902a1ee9ad02340d0c249a4e6bd0dd46e8b2937c203f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-f, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T05:57:16.148 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 21 05:57:15 smithi160 bash[66512]: ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-f 2024-09-21T05:57:16.327 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.f.service' 2024-09-21T05:57:16.361 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:57:16.362 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-21T05:57:16.362 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-21T05:57:16.362 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.i 2024-09-21T05:57:16.898 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 05:57:16 smithi160 systemd[1]: Stopping Ceph mds.i for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:57:16.898 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 05:57:16 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-i[62640]: 2024-09-21T05:57:16.677+0000 7f6349944640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T05:57:16.898 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 05:57:16 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-i[62640]: 2024-09-21T05:57:16.677+0000 7f6349944640 -1 mds.i *** got signal Terminated *** 2024-09-21T05:57:19.789 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 05:57:19 smithi160 podman[66634]: 2024-09-21 05:57:19.536779236 +0000 UTC m=+2.958560346 container died 08c3ec97d5723a8d1bc3480d3df1a59bec54c32248ffbb3a4dcafad15c29b6d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-i, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T05:57:20.072 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 05:57:19 smithi160 podman[66634]: 2024-09-21 05:57:19.870347686 +0000 UTC m=+3.292128787 container cleanup 08c3ec97d5723a8d1bc3480d3df1a59bec54c32248ffbb3a4dcafad15c29b6d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-i, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T05:57:20.072 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 05:57:19 smithi160 bash[66634]: ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-i 2024-09-21T05:57:20.301 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.i.service' 2024-09-21T05:57:20.323 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 05:57:20 smithi160 podman[66647]: 2024-09-21 05:57:20.071390257 +0000 UTC m=+0.528268138 container remove 08c3ec97d5723a8d1bc3480d3df1a59bec54c32248ffbb3a4dcafad15c29b6d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-i, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T05:57:20.323 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 05:57:20 smithi160 systemd[1]: ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.i.service: Deactivated successfully. 2024-09-21T05:57:20.323 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 05:57:20 smithi160 systemd[1]: Stopped Ceph mds.i for 96c6636e-77db-11ef-baf5-efdc52797490. 2024-09-21T05:57:20.323 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 05:57:20 smithi160 systemd[1]: ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.i.service: Consumed 21.362s CPU time. 2024-09-21T05:57:20.333 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:57:20.333 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-21T05:57:20.333 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-21T05:57:20.333 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.l 2024-09-21T05:57:20.577 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 21 05:57:20 smithi160 systemd[1]: Stopping Ceph mds.l for 96c6636e-77db-11ef-baf5-efdc52797490... 2024-09-21T05:57:20.898 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 21 05:57:20 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-l[61823]: 2024-09-21T05:57:20.673+0000 7f89322ae640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T05:57:20.898 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 21 05:57:20 smithi160 ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-l[61823]: 2024-09-21T05:57:20.673+0000 7f89322ae640 -1 mds.l *** got signal Terminated *** 2024-09-21T05:57:23.793 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 21 05:57:23 smithi160 podman[66757]: 2024-09-21 05:57:23.523344072 +0000 UTC m=+2.969679526 container died a3579c252d71d6811f47ee3c058cfc611c34801bdefb9ca37d513d811888c664 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T05:57:24.142 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 21 05:57:23 smithi160 podman[66757]: 2024-09-21 05:57:23.88191582 +0000 UTC m=+3.328251269 container cleanup a3579c252d71d6811f47ee3c058cfc611c34801bdefb9ca37d513d811888c664 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-l, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux ) 2024-09-21T05:57:24.142 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 21 05:57:23 smithi160 bash[66757]: ceph-96c6636e-77db-11ef-baf5-efdc52797490-mds-l 2024-09-21T05:57:24.301 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96c6636e-77db-11ef-baf5-efdc52797490@mds.l.service' 2024-09-21T05:57:24.333 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:57:24.333 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-21T05:57:24.333 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 96c6636e-77db-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T05:57:24.534 INFO:teuthology.orchestra.run.smithi070.stdout:Deleting cluster with fsid: 96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:57:27.025 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 96c6636e-77db-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T05:57:27.589 INFO:teuthology.orchestra.run.smithi116.stdout:Deleting cluster with fsid: 96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:57:30.025 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 96c6636e-77db-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T05:57:30.228 INFO:teuthology.orchestra.run.smithi160.stdout:Deleting cluster with fsid: 96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:57:32.557 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T05:57:32.590 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T05:57:32.624 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T05:57:32.650 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T05:57:32.652 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913497/remote/smithi070/crash 2024-09-21T05:57:32.652 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/crash -- . 2024-09-21T05:57:32.680 INFO:teuthology.orchestra.run.smithi070.stderr:tar: /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T05:57:32.680 INFO:teuthology.orchestra.run.smithi070.stderr:tar: Error is not recoverable: exiting now 2024-09-21T05:57:32.683 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913497/remote/smithi116/crash 2024-09-21T05:57:32.684 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/crash -- . 2024-09-21T05:57:32.728 INFO:teuthology.orchestra.run.smithi116.stderr:tar: /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T05:57:32.728 INFO:teuthology.orchestra.run.smithi116.stderr:tar: Error is not recoverable: exiting now 2024-09-21T05:57:32.729 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913497/remote/smithi160/crash 2024-09-21T05:57:32.730 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/crash -- . 2024-09-21T05:57:32.770 INFO:teuthology.orchestra.run.smithi160.stderr:tar: /var/lib/ceph/96c6636e-77db-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T05:57:32.770 INFO:teuthology.orchestra.run.smithi160.stderr:tar: Error is not recoverable: exiting now 2024-09-21T05:57:32.771 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T05:57:32.772 DEBUG:teuthology.orchestra.run.smithi070:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-21T05:57:32.811 INFO:tasks.cephadm:Compressing logs... 2024-09-21T05:57:32.811 DEBUG:teuthology.orchestra.run.smithi070:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T05:57:32.853 DEBUG:teuthology.orchestra.run.smithi116:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T05:57:32.856 DEBUG:teuthology.orchestra.run.smithi160:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T05:57:32.878 INFO:teuthology.orchestra.run.smithi070.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-21T05:57:32.878 INFO:teuthology.orchestra.run.smithi070.stderr:: No such file or directory 2024-09-21T05:57:32.878 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.0.log 2024-09-21T05:57:32.878 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.9.log 2024-09-21T05:57:32.878 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.log: /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T05:57:32.878 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T05:57:32.878 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.a.log 2024-09-21T05:57:32.879 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-volume.log: /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T05:57:32.879 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mon.a.log 2024-09-21T05:57:32.879 INFO:teuthology.orchestra.run.smithi070.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-21T05:57:32.880 INFO:teuthology.orchestra.run.smithi160.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T05:57:32.880 INFO:teuthology.orchestra.run.smithi160.stderr:: No such file or directory 2024-09-21T05:57:32.880 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T05:57:32.881 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.i.log 2024-09-21T05:57:32.881 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mon.c.log 2024-09-21T05:57:32.881 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T05:57:32.882 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.11.log 2024-09-21T05:57:32.888 INFO:teuthology.orchestra.run.smithi116.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.10.log 2024-09-21T05:57:32.888 INFO:teuthology.orchestra.run.smithi116.stderr:: No such file or directory 2024-09-21T05:57:32.888 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.1.log 2024-09-21T05:57:32.888 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.7.log 2024-09-21T05:57:32.888 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.10.log: /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T05:57:32.888 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.b.log 2024-09-21T05:57:32.888 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.k.log 2024-09-21T05:57:32.888 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.b.log: -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.4.log 2024-09-21T05:57:32.888 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T05:57:32.888 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T05:57:32.889 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mon.c.log: /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.2.log 2024-09-21T05:57:32.889 INFO:teuthology.orchestra.run.smithi160.stderr: 82.8% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T05:57:32.889 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.5.log 2024-09-21T05:57:32.889 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph.log 2024-09-21T05:57:32.889 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.l.log 2024-09-21T05:57:32.890 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph.log: 90.2% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T05:57:32.890 INFO:teuthology.orchestra.run.smithi160.stderr: 86.3% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T05:57:32.890 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.8.log 2024-09-21T05:57:32.890 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mgr.z.log 2024-09-21T05:57:32.893 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph.audit.log: 90.2% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T05:57:32.894 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mgr.y.log 2024-09-21T05:57:32.894 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph.cephadm.log: 82.8% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T05:57:32.894 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph.log 2024-09-21T05:57:32.895 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.g.log 2024-09-21T05:57:32.895 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mon.a.log: 82.8% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph.cephadm.log.gzgzip 2024-09-21T05:57:32.895 INFO:teuthology.orchestra.run.smithi070.stderr: -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.6.log 2024-09-21T05:57:32.895 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.g.log: 90.1% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T05:57:32.896 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph.log 2024-09-21T05:57:32.896 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.d.log 2024-09-21T05:57:32.896 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph.log: 86.3% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T05:57:32.896 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mgr.x.log 2024-09-21T05:57:32.896 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.d.log: 90.9% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T05:57:32.896 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.j.log 2024-09-21T05:57:32.896 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mgr.x.log: 95.0% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.d.log.gz 2024-09-21T05:57:32.897 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.3.log 2024-09-21T05:57:32.898 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.8.log: /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.l.log: 91.0% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T05:57:32.898 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.c.log 2024-09-21T05:57:32.900 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mgr.y.log: 91.0% 92.0% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mgr.y.log.gz 2024-09-21T05:57:32.900 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T05:57:32.900 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.h.log 2024-09-21T05:57:32.900 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mon.b.log 2024-09-21T05:57:32.901 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.h.log: 86.3% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T05:57:32.902 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mgr.z.log: 92.2% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mgr.z.log.gz 2024-09-21T05:57:32.902 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.f.log 2024-09-21T05:57:32.902 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.j.log: 95.1% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.j.log.gz 2024-09-21T05:57:32.902 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-21T05:57:32.913 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T05:57:32.914 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T05:57:32.920 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.e.log 2024-09-21T05:57:32.926 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.log: /var/log/ceph/cephadm.log: 93.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T05:57:32.929 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T05:57:32.933 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T05:57:32.949 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T05:57:32.982 INFO:teuthology.orchestra.run.smithi070.stderr: 93.6% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.g.log.gz 2024-09-21T05:57:33.057 INFO:teuthology.orchestra.run.smithi070.stderr: 94.4% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.a.log.gz 2024-09-21T05:57:33.107 INFO:teuthology.orchestra.run.smithi160.stderr: 93.4% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.l.log.gz 2024-09-21T05:57:33.126 INFO:teuthology.orchestra.run.smithi070.stderr: 90.2% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mgr.x.log.gz 2024-09-21T05:57:33.186 INFO:teuthology.orchestra.run.smithi160.stderr: 91.8% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mon.c.log.gz 2024-09-21T05:57:33.233 INFO:teuthology.orchestra.run.smithi116.stderr: 91.9% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mon.b.log.gz 2024-09-21T05:57:33.466 INFO:teuthology.orchestra.run.smithi116.stderr: 95.3% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.k.log.gz 2024-09-21T05:57:33.588 INFO:teuthology.orchestra.run.smithi070.stderr: 90.5% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mon.a.log.gz 2024-09-21T05:57:34.257 INFO:teuthology.orchestra.run.smithi160.stderr: 94.3% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.f.log.gz 2024-09-21T05:57:34.410 INFO:teuthology.orchestra.run.smithi116.stderr: 94.3% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.h.log.gz 2024-09-21T05:57:35.202 INFO:teuthology.orchestra.run.smithi160.stderr: 94.1% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.c.log.gz 2024-09-21T05:57:36.421 INFO:teuthology.orchestra.run.smithi116.stderr: 95.6% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.e.log.gz 2024-09-21T05:57:37.362 INFO:teuthology.orchestra.run.smithi160.stderr: 91.6% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.11.log.gz 2024-09-21T05:57:37.384 INFO:teuthology.orchestra.run.smithi160.stderr: 92.0% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.8.log.gz 2024-09-21T05:57:37.809 INFO:teuthology.orchestra.run.smithi116.stderr: 92.0% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.10.log.gz 2024-09-21T05:57:38.306 INFO:teuthology.orchestra.run.smithi070.stderr: 91.6% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.6.log.gz 2024-09-21T05:57:38.306 INFO:teuthology.orchestra.run.smithi070.stderr: 91.7% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.3.log.gz 2024-09-21T05:57:38.324 INFO:teuthology.orchestra.run.smithi116.stderr: 91.8% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.1.log.gz 2024-09-21T05:57:38.713 INFO:teuthology.orchestra.run.smithi116.stderr: 91.6% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.7.log.gz 2024-09-21T05:57:38.804 INFO:teuthology.orchestra.run.smithi070.stderr: 91.6% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.9.log.gz 2024-09-21T05:57:38.882 INFO:teuthology.orchestra.run.smithi160.stderr: 91.5% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.2.log.gz 2024-09-21T05:57:39.049 INFO:teuthology.orchestra.run.smithi070.stderr: 91.7% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.0.log.gz 2024-09-21T05:57:39.637 INFO:teuthology.orchestra.run.smithi116.stderr: 91.7% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.4.log.gz 2024-09-21T05:57:40.331 INFO:teuthology.orchestra.run.smithi160.stderr: 93.6% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.i.log.gz 2024-09-21T05:57:41.423 INFO:teuthology.orchestra.run.smithi160.stderr: 91.7% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-osd.5.log.gz 2024-09-21T05:57:41.425 INFO:teuthology.orchestra.run.smithi160.stderr: 2024-09-21T05:57:41.425 INFO:teuthology.orchestra.run.smithi160.stderr:real 0m8.554s 2024-09-21T05:57:41.425 INFO:teuthology.orchestra.run.smithi160.stderr:user 0m33.883s 2024-09-21T05:57:41.425 INFO:teuthology.orchestra.run.smithi160.stderr:sys 0m1.039s 2024-09-21T05:57:46.822 INFO:teuthology.orchestra.run.smithi070.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-21T05:57:46.824 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-21T05:57:46.824 INFO:teuthology.orchestra.run.smithi070.stderr:real 0m13.958s 2024-09-21T05:57:46.824 INFO:teuthology.orchestra.run.smithi070.stderr:user 0m36.818s 2024-09-21T05:57:46.824 INFO:teuthology.orchestra.run.smithi070.stderr:sys 0m1.154s 2024-09-21T05:58:12.584 INFO:teuthology.orchestra.run.smithi116.stderr: 93.7% -- replaced with /var/log/ceph/96c6636e-77db-11ef-baf5-efdc52797490/ceph-mds.b.log.gz 2024-09-21T05:58:12.586 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-09-21T05:58:12.586 INFO:teuthology.orchestra.run.smithi116.stderr:real 0m39.716s 2024-09-21T05:58:12.586 INFO:teuthology.orchestra.run.smithi116.stderr:user 1m6.050s 2024-09-21T05:58:12.586 INFO:teuthology.orchestra.run.smithi116.stderr:sys 0m2.123s 2024-09-21T05:58:12.586 INFO:tasks.cephadm:Archiving logs... 2024-09-21T05:58:12.587 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913497/remote/smithi070/log 2024-09-21T05:58:12.588 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T05:58:17.787 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913497/remote/smithi116/log 2024-09-21T05:58:17.788 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T05:58:26.873 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913497/remote/smithi160/log 2024-09-21T05:58:26.874 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T05:58:31.363 INFO:tasks.cephadm:Removing cluster... 2024-09-21T05:58:31.363 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 96c6636e-77db-11ef-baf5-efdc52797490 --force 2024-09-21T05:58:31.565 INFO:teuthology.orchestra.run.smithi070.stdout:Deleting cluster with fsid: 96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:58:31.929 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 96c6636e-77db-11ef-baf5-efdc52797490 --force 2024-09-21T05:58:32.131 INFO:teuthology.orchestra.run.smithi116.stdout:Deleting cluster with fsid: 96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:58:32.460 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 96c6636e-77db-11ef-baf5-efdc52797490 --force 2024-09-21T05:58:32.667 INFO:teuthology.orchestra.run.smithi160.stdout:Deleting cluster with fsid: 96c6636e-77db-11ef-baf5-efdc52797490 2024-09-21T05:58:32.967 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T05:58:32.967 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T05:58:32.986 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T05:58:33.003 DEBUG:teuthology.orchestra.run.smithi160:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T05:58:33.019 INFO:tasks.cephadm:Teardown complete 2024-09-21T05:58:33.019 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T05:58:33.035 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T05:58:33.035 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T05:58:33.037 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T05:58:33.045 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T05:58:33.138 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T05:58:33.148 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T05:58:33.148 DEBUG:teuthology.orchestra.run.smithi070:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T05:58:33.151 DEBUG:teuthology.orchestra.run.smithi116:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T05:58:33.153 DEBUG:teuthology.orchestra.run.smithi160:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T05:58:33.166 INFO:teuthology.orchestra.run.smithi116.stderr:bash: line 1: ntpq: command not found 2024-09-21T05:58:33.166 INFO:teuthology.orchestra.run.smithi070.stderr:bash: line 1: ntpq: command not found 2024-09-21T05:58:33.167 INFO:teuthology.orchestra.run.smithi160.stderr:bash: line 1: ntpq: command not found 2024-09-21T05:58:33.170 INFO:teuthology.orchestra.run.smithi116.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T05:58:33.170 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================== 2024-09-21T05:58:33.170 INFO:teuthology.orchestra.run.smithi116.stdout:^* hv01.front.sepia.ceph.com 3 6 377 14 -209us[ -240us] +/- 40ms 2024-09-21T05:58:33.170 INFO:teuthology.orchestra.run.smithi116.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 12 +638us[ +638us] +/- 67ms 2024-09-21T05:58:33.170 INFO:teuthology.orchestra.run.smithi116.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 -364us[ -364us] +/- 71ms 2024-09-21T05:58:33.170 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:58:33.171 INFO:teuthology.orchestra.run.smithi070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T05:58:33.171 INFO:teuthology.orchestra.run.smithi070.stdout:=============================================================================== 2024-09-21T05:58:33.172 INFO:teuthology.orchestra.run.smithi070.stdout:^* hv01.front.sepia.ceph.com 3 6 377 14 -172us[ -195us] +/- 40ms 2024-09-21T05:58:33.172 INFO:teuthology.orchestra.run.smithi070.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 14 +681us[ +681us] +/- 67ms 2024-09-21T05:58:33.172 INFO:teuthology.orchestra.run.smithi070.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 13 -327us[ -327us] +/- 71ms 2024-09-21T05:58:33.172 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:58:33.173 INFO:teuthology.orchestra.run.smithi160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T05:58:33.173 INFO:teuthology.orchestra.run.smithi160.stdout:=============================================================================== 2024-09-21T05:58:33.173 INFO:teuthology.orchestra.run.smithi160.stdout:^* hv01.front.sepia.ceph.com 3 6 377 11 -193us[ -221us] +/- 40ms 2024-09-21T05:58:33.173 INFO:teuthology.orchestra.run.smithi160.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 13 +646us[ +618us] +/- 67ms 2024-09-21T05:58:33.173 INFO:teuthology.orchestra.run.smithi160.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 14 -346us[ -374us] +/- 71ms 2024-09-21T05:58:33.173 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:58:33.174 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T05:58:33.183 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T05:58:33.183 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T05:58:33.192 DEBUG:teuthology.orchestra.run.smithi070:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T05:58:33.294 DEBUG:teuthology.orchestra.run.smithi116:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T05:58:33.361 DEBUG:teuthology.orchestra.run.smithi160:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T05:58:33.426 DEBUG:teuthology.orchestra.run.smithi070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T05:58:33.456 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:58:33.456 DEBUG:teuthology.orchestra.run.smithi116:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T05:58:33.484 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:58:33.484 DEBUG:teuthology.orchestra.run.smithi160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T05:58:33.511 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:58:33.512 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T05:58:33.523 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T05:58:33.533 INFO:teuthology.task.internal:Duration was 1600.886398 seconds 2024-09-21T05:58:33.533 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T05:58:33.543 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T05:58:33.543 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T05:58:33.545 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T05:58:33.550 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T05:58:33.584 INFO:teuthology.orchestra.run.smithi070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T05:58:33.585 INFO:teuthology.orchestra.run.smithi116.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T05:58:33.591 INFO:teuthology.orchestra.run.smithi160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T05:58:34.087 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T05:58:34.087 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi070.front.sepia.ceph.com 2024-09-21T05:58:34.087 DEBUG:teuthology.orchestra.run.smithi070:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T05:58:34.108 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi116.front.sepia.ceph.com 2024-09-21T05:58:34.108 DEBUG:teuthology.orchestra.run.smithi116:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T05:58:34.152 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi160.front.sepia.ceph.com 2024-09-21T05:58:34.152 DEBUG:teuthology.orchestra.run.smithi160:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T05:58:34.177 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T05:58:34.178 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T05:58:34.180 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T05:58:34.194 DEBUG:teuthology.orchestra.run.smithi160:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T05:58:34.244 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T05:58:34.244 DEBUG:teuthology.orchestra.run.smithi070:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T05:58:34.248 DEBUG:teuthology.orchestra.run.smithi116:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T05:58:34.260 DEBUG:teuthology.orchestra.run.smithi160:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T05:58:34.914 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T05:58:34.926 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T05:58:34.926 DEBUG:teuthology.orchestra.run.smithi070:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T05:58:34.950 DEBUG:teuthology.orchestra.run.smithi116:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T05:58:34.976 DEBUG:teuthology.orchestra.run.smithi160:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T05:58:35.002 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T05:58:35.013 DEBUG:teuthology.orchestra.run.smithi070:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T05:58:35.015 DEBUG:teuthology.orchestra.run.smithi116:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T05:58:35.019 DEBUG:teuthology.orchestra.run.smithi160:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T05:58:35.035 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = core 2024-09-21T05:58:35.040 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = core 2024-09-21T05:58:35.066 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern = core 2024-09-21T05:58:35.094 DEBUG:teuthology.orchestra.run.smithi070:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T05:58:35.107 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:58:35.108 DEBUG:teuthology.orchestra.run.smithi116:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T05:58:35.124 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:58:35.125 DEBUG:teuthology.orchestra.run.smithi160:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T05:58:35.148 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:58:35.149 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T05:58:35.160 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T05:58:35.160 DEBUG:teuthology.misc:Transferring archived files from smithi070:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913497/remote/smithi070 2024-09-21T05:58:35.160 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T05:58:35.211 DEBUG:teuthology.misc:Transferring archived files from smithi116:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913497/remote/smithi116 2024-09-21T05:58:35.212 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T05:58:35.246 DEBUG:teuthology.misc:Transferring archived files from smithi160:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913497/remote/smithi160 2024-09-21T05:58:35.246 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T05:58:35.282 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T05:58:35.282 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T05:58:35.284 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T05:58:35.287 DEBUG:teuthology.orchestra.run.smithi160:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T05:58:35.332 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T05:58:35.346 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T05:58:35.346 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T05:58:35.363 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T05:58:35.363 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T05:58:35.365 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T05:58:35.368 DEBUG:teuthology.orchestra.run.smithi160:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T05:58:35.378 INFO:teuthology.orchestra.run.smithi070.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 05:58 /home/ubuntu/cephtest 2024-09-21T05:58:35.380 INFO:teuthology.orchestra.run.smithi116.stdout: 266063 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 05:58 /home/ubuntu/cephtest 2024-09-21T05:58:35.391 INFO:teuthology.orchestra.run.smithi160.stdout: 265889 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 05:58 /home/ubuntu/cephtest 2024-09-21T05:58:35.391 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T05:58:35.402 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T05:58:35.427 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/fs/norstats}} duration: 1600.886398077011 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-21T05:58:35.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T05:58:35.505 INFO:teuthology.run:pass